Experts from PHAR, Novartis, and Bausch Health give a discussion around the Delphi panels and how the results are used. For over 15 years, PHAR has conducted RAND/UCLA modified Delphi panels to obtain consensus among clinicians. During this webinar, the experts will broadly present different methods for gaining consensus including the different “Delphi panel” approaches that exist, the history of the method used, the behavioral science behind why these panels work, how these panels (both in person and virtually) are conducted, and the outcome of the panels. In addition to Dr. Michael Broder, President of PHAR’s, experience, there are two researchers (one physician and one research scientist) from the pharmaceutical industry who share their experience participating in these panels. They provide their perspective on leading these panels (including why sometimes it’s recommended they are blinded to all aspects), their experience participating in the discussions, and how they have used the results. Key Topics Include: - Overview of the different ways to obtain consensus from expert clinicians - The broad steps involved in conducting a RAND/UCLA modified Delphi panel method - The possible outcomes of such a panel - Benefits and challenges of this method

1. Copyright 2022. All Rights Reserved. Contact Presenter for Permission
Achieving Consensus When Everyone
is an Expert, but No One Agrees
George Joseph, BPharm, MS, PhD
Vice President
Health Economics & Outcomes Research
Bausch Health
Michael Broder, MD, MSHS
President
PHAR
Jincy Paulose, MD
Executive Medical Director & Team Lead
for Non-Malignant Hematology
Novartis Pharmaceuticals

3. Clinical Experience
Highly Trained Staff
Methodologic Rigor

5. What do we mean by “expert panels?”
Structured consensus method
That brings together multidisciplinary experts
With the goal of achieving consensus on topics that do not
yet have strong empirical evidence
Not ad boards, unstructured discussion, literature/evidence
review only

6. Examples of expert panel methods
RAND/UCLA modified Delphi panel
Nominal group process
GRADE approach
Delphi technique
Consensus development panel
NCCN guidelines development
BOGSAT

7. Discuss ratings during
in-person (or virtual)
meeting
Review literature
and develop
evidence summary
Develop rating
form
Expert panel completes
pre-meeting ratings
(first-round)
Analyze and develop
consensus statements
Expert panel repeats
ratings (second-round)
RAND/UCLA modified Delphi panel

8. Example rating form

9. Mean scores of severity

10. © 2022 10
Panel output

11. Thank you for participating!
CLICK HERE to learn more and
watch the webinar