SlideShare a Scribd company logo
1 of 34
When To Select Observational Studies as Evidence for Comparative Effectiveness Reviews Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
Systematic Review Process Overview
[object Object],[object Object],[object Object],Learning Objectives
[object Object],[object Object],Current Perspective
[object Object],Comparative Effectiveness Reviews
[object Object],[object Object],[object Object],[object Object],[object Object],Danger of Overreliance on Randomized Controlled Trials
[object Object],[object Object],[object Object],[object Object],Observational Studies
[object Object],[object Object],[object Object],Using Observational Studies To Assess Benefits (I)
Using Observational Studies To Assess Benefits (II) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question  Are there gaps in trial evidence? Systematic review question   ( including PICOTS) Yes Refocus the review  question on gaps Assess the suitability of OSs:   Natural history of the disease  or exposure Potential biases Confine review to  controlled trials No
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Gaps in Trial Evidence: PICOTS
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Are Trial Data Sufficient? (I)
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Are Trial Data Sufficient? (II)
[object Object],[object Object],[object Object],[object Object],[object Object],When To Identify Gaps in Trial Evidence
Iterative Process for Identifying Gaps in Evidence ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Extract Data from Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Report Systematic Review
[object Object],[object Object],Gaps in Trial Evidence
Using Observational Studies To Assess Benefits OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Systematic review question   ( including PICOTS) OS = observational study; PICOTS = population, intervention, comparator,  outcome, timing, and setting Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question  Are there gaps in trial evidence? Yes Refocus the review  question on gaps Assess the suitability of OSs:   Natural history of the disease  or exposure Potential biases Confine review to  controlled trials No
[object Object],[object Object],[object Object],[object Object],Will Observational Studies Provide Valid and Useful Information?
[object Object],[object Object],[object Object],Assessing the Suitability of Observational Studies To Answer the Review Questions
[object Object],[object Object],[object Object],Clinical Context
[object Object],[object Object],[object Object],[object Object],Potential Biases That May Limit the Suitability of Including Observational Studies
[object Object],[object Object],[object Object],[object Object],Confounding by Indication
[object Object],[object Object],[object Object],Using Observational Studies To Assess Benefits
[object Object],[object Object],[object Object],[object Object],Harms Assessments
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (I)
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (II)
[object Object],[object Object],[object Object],[object Object],Using Randomized Controlled Trials To Assess Harms (III)
[object Object],[object Object],[object Object],[object Object],Using Data From Unpublished Trials To Assess Harms
[object Object],[object Object],[object Object],[object Object],[object Object],Using Observational Studies To Assess Harms
[object Object],[object Object],[object Object],Hypothesis Testing Versus Hypothesis Generating Chou R, et al.  J Clin Epidemiol  2010;63:502-12.
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Types of Observational Studies That Can Be Used To Assess Harms
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Screening Observational Studies for Inclusion in Harms Assessments
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Key Messages
[object Object],[object Object],References
[object Object],[object Object],Authors

More Related Content

What's hot

4. level of evidence
4. level of evidence4. level of evidence
4. level of evidenceSaurab Sharma
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research DesignsPat Barlow
 
Blinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledBlinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledMANVEER SINGH
 
Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 MedicReS
 
Epi chapter 4
Epi chapter 4Epi chapter 4
Epi chapter 4emmoss21
 
EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1Imad Hassan
 
EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1Imad Hassan
 
Clinical Research Methodology
Clinical  Research  MethodologyClinical  Research  Methodology
Clinical Research Methodologydrmomusa
 
Non Randomised Control Trial
Non Randomised Control TrialNon Randomised Control Trial
Non Randomised Control TrialKarishma Halageri
 
Improving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsImproving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsBrook White, PMP
 
HLinc presentation: levels of evidence
HLinc presentation:  levels of evidenceHLinc presentation:  levels of evidence
HLinc presentation: levels of evidenceCatherineVoutier
 
Risk of bias in systematic review
Risk of bias in systematic reviewRisk of bias in systematic review
Risk of bias in systematic reviewPrabesh Ghimire
 

What's hot (20)

Assessment of Bias
Assessment of BiasAssessment of Bias
Assessment of Bias
 
4. level of evidence
4. level of evidence4. level of evidence
4. level of evidence
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research Designs
 
Blinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveledBlinding in RCT the enigma unraveled
Blinding in RCT the enigma unraveled
 
Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012 Doug Altman - MedicReS World Congress 2012
Doug Altman - MedicReS World Congress 2012
 
Epi chapter 4
Epi chapter 4Epi chapter 4
Epi chapter 4
 
Topic Refinement Quiz
Topic Refinement QuizTopic Refinement Quiz
Topic Refinement Quiz
 
EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1EBM Therapy Appraisal Template F1
EBM Therapy Appraisal Template F1
 
Research Design
Research DesignResearch Design
Research Design
 
Study Eligibility Criteria
Study Eligibility CriteriaStudy Eligibility Criteria
Study Eligibility Criteria
 
EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1EBM Systematic Review Appraisal Template V1
EBM Systematic Review Appraisal Template V1
 
Clinical Research Methodology
Clinical  Research  MethodologyClinical  Research  Methodology
Clinical Research Methodology
 
Non Randomised Control Trial
Non Randomised Control TrialNon Randomised Control Trial
Non Randomised Control Trial
 
Improving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical TrialsImproving Inclusion/Exclusion Criteria for Clinical Trials
Improving Inclusion/Exclusion Criteria for Clinical Trials
 
Blinding Techniques
Blinding TechniquesBlinding Techniques
Blinding Techniques
 
Evidence based medicine
Evidence based medicineEvidence based medicine
Evidence based medicine
 
EBM ppt by ANN
EBM ppt by ANNEBM ppt by ANN
EBM ppt by ANN
 
Study design of Prof Zak
Study design of Prof ZakStudy design of Prof Zak
Study design of Prof Zak
 
HLinc presentation: levels of evidence
HLinc presentation:  levels of evidenceHLinc presentation:  levels of evidence
HLinc presentation: levels of evidence
 
Risk of bias in systematic review
Risk of bias in systematic reviewRisk of bias in systematic review
Risk of bias in systematic review
 

Viewers also liked

2-Epidemiological studies
2-Epidemiological studies2-Epidemiological studies
2-Epidemiological studiesResearchGuru
 
Curious look into Observational studies
Curious look into Observational studiesCurious look into Observational studies
Curious look into Observational studiesArete-Zoe, LLC
 
Case study: Methodology Reviews
Case study: Methodology ReviewsCase study: Methodology Reviews
Case study: Methodology ReviewsCTSI at UCSF
 
What has been learned from the major observational
What has been learned from the major observationalWhat has been learned from the major observational
What has been learned from the major observationalfalcaoebarros
 
2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)Stuart McCully
 
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and TrialsKeck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and Trialslynnkysh
 
Farmacoepi Course Leiden 0210 Part 2
Farmacoepi Course Leiden 0210   Part 2Farmacoepi Course Leiden 0210   Part 2
Farmacoepi Course Leiden 0210 Part 2RobHeerdink
 
Late Phase Presentation
Late Phase PresentationLate Phase Presentation
Late Phase PresentationDavid Selkirk
 
Late Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesLate Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesMedpace
 
What Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldWhat Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldMedpace
 
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...PAREXEL International
 
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsWEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsNathan White, CPC
 
Late Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingLate Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingTTC, llc
 
Observational Techniques
Observational TechniquesObservational Techniques
Observational TechniquesHabiba Khan
 
Clinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaClinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaTTC, llc
 
Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2heba rashed
 
observational analytical study
observational analytical studyobservational analytical study
observational analytical studyDr. Partha Sarkar
 
Study design
Study designStudy design
Study designRSS6
 

Viewers also liked (20)

2-Epidemiological studies
2-Epidemiological studies2-Epidemiological studies
2-Epidemiological studies
 
Curious look into Observational studies
Curious look into Observational studiesCurious look into Observational studies
Curious look into Observational studies
 
Case study: Methodology Reviews
Case study: Methodology ReviewsCase study: Methodology Reviews
Case study: Methodology Reviews
 
What has been learned from the major observational
What has been learned from the major observationalWhat has been learned from the major observational
What has been learned from the major observational
 
2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)2011 01 16 NIS Training (Chcuk Generic)
2011 01 16 NIS Training (Chcuk Generic)
 
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and TrialsKeck Year 2 Evidence Based Medicine - Observational Studies and Trials
Keck Year 2 Evidence Based Medicine - Observational Studies and Trials
 
Farmacoepi Course Leiden 0210 Part 2
Farmacoepi Course Leiden 0210   Part 2Farmacoepi Course Leiden 0210   Part 2
Farmacoepi Course Leiden 0210 Part 2
 
Late Phase Presentation
Late Phase PresentationLate Phase Presentation
Late Phase Presentation
 
Late Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical StudiesLate Phase Outsourcing - Clinical Studies
Late Phase Outsourcing - Clinical Studies
 
What Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real WorldWhat Happens After Your Device is Approved? Collecting Data in the Real World
What Happens After Your Device is Approved? Collecting Data in the Real World
 
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
Realizing Late Phase Value Through Strategic Partnerships with CROs by Joshua...
 
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval ProgramsWEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
WEBINAR: Developing Payer Evidence: The Role of Post Approval Programs
 
Late Phase Study Planning and Budgeting
Late Phase Study Planning and BudgetingLate Phase Study Planning and Budgeting
Late Phase Study Planning and Budgeting
 
Observational Techniques
Observational TechniquesObservational Techniques
Observational Techniques
 
Clinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharmaClinical rd presentation 10 jan2012_sharma
Clinical rd presentation 10 jan2012_sharma
 
Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2Essential Documents of Clinical Trials_2
Essential Documents of Clinical Trials_2
 
Pharmacoepideiology
PharmacoepideiologyPharmacoepideiology
Pharmacoepideiology
 
observational analytical study
observational analytical studyobservational analytical study
observational analytical study
 
Observational study
Observational studyObservational study
Observational study
 
Study design
Study designStudy design
Study design
 

Similar to When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews

Systematic Reviews Class 4c
Systematic Reviews Class 4cSystematic Reviews Class 4c
Systematic Reviews Class 4cguestf5d7ac
 
Living evidence 3
Living evidence 3Living evidence 3
Living evidence 3stanbridge
 
Ich guidelines e9 to e12
Ich guidelines e9 to e12Ich guidelines e9 to e12
Ich guidelines e9 to e12Khushboo Bhatia
 
9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic ReviewResearchGuru
 
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSCritical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSMulugetaAbeneh1
 
evidence based periodontics
 evidence based periodontics    evidence based periodontics
evidence based periodontics neeti shinde
 
Considering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsConsidering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsCochrane.Collaboration
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchYogitha P
 
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxLevel of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxdina410715
 
· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docxVannaJoy20
 
JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1Imad Hassan
 
Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Praveen Ganji
 
Introa-Morton-slides.pdf
Introa-Morton-slides.pdfIntroa-Morton-slides.pdf
Introa-Morton-slides.pdfShahriarHabib4
 
Introduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryIntroduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryRasha Adel
 
Overview Of Ich New E9
Overview Of Ich New E9Overview Of Ich New E9
Overview Of Ich New E9Jay1818mar
 

Similar to When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews (20)

Systematic Reviews Class 4c
Systematic Reviews Class 4cSystematic Reviews Class 4c
Systematic Reviews Class 4c
 
Assessing Applicability
Assessing ApplicabilityAssessing Applicability
Assessing Applicability
 
Dhiwahar ppt
Dhiwahar pptDhiwahar ppt
Dhiwahar ppt
 
Living evidence 3
Living evidence 3Living evidence 3
Living evidence 3
 
Ich guidelines e9 to e12
Ich guidelines e9 to e12Ich guidelines e9 to e12
Ich guidelines e9 to e12
 
9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review9-Meta Analysis/ Systematic Review
9-Meta Analysis/ Systematic Review
 
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTSCritical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
Critical appraisal.docx IMPORTAN TO HEALTH SCIENCE STUDENTS
 
evidence based periodontics
 evidence based periodontics    evidence based periodontics
evidence based periodontics
 
Considering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviewsConsidering adverse effects in prioritising reviews
Considering adverse effects in prioritising reviews
 
Guide for conducting meta analysis in health research
Guide for conducting meta analysis in health researchGuide for conducting meta analysis in health research
Guide for conducting meta analysis in health research
 
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptxLevel of Evidence- Dina Hudiya Nadana Lubis.pptx
Level of Evidence- Dina Hudiya Nadana Lubis.pptx
 
· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx· Reflect on the four peer-reviewed articles you critically apprai.docx
· Reflect on the four peer-reviewed articles you critically apprai.docx
 
JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1JC SEBMA Prognosis Appraisal Template V1
JC SEBMA Prognosis Appraisal Template V1
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2Study designs & amp; trials presentation1 2
Study designs & amp; trials presentation1 2
 
Reserch methodology
Reserch methodologyReserch methodology
Reserch methodology
 
Introa-Morton-slides.pdf
Introa-Morton-slides.pdfIntroa-Morton-slides.pdf
Introa-Morton-slides.pdf
 
Clinical trials
Clinical trialsClinical trials
Clinical trials
 
Introduction to Evidence Based Dentistry
Introduction to Evidence Based DentistryIntroduction to Evidence Based Dentistry
Introduction to Evidence Based Dentistry
 
Overview Of Ich New E9
Overview Of Ich New E9Overview Of Ich New E9
Overview Of Ich New E9
 

More from Effective Health Care Program

The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...Effective Health Care Program
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Effective Health Care Program
 

More from Effective Health Care Program (20)

The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
 
Study Eligibility Criteria Quiz
Study Eligibility Criteria QuizStudy Eligibility Criteria Quiz
Study Eligibility Criteria Quiz
 
Searching for Relevant Studies
Searching for Relevant StudiesSearching for Relevant Studies
Searching for Relevant Studies
 
Searching for Relevant Studies Quiz
Searching for Relevant Studies QuizSearching for Relevant Studies Quiz
Searching for Relevant Studies Quiz
 
Reporting the Review
Reporting the ReviewReporting the Review
Reporting the Review
 
Reporting the Review Quiz
Reporting the Review QuizReporting the Review Quiz
Reporting the Review Quiz
 
Quantitative Synthesis II
Quantitative Synthesis IIQuantitative Synthesis II
Quantitative Synthesis II
 
Quantitative Synthesis II Quiz
Quantitative Synthesis II QuizQuantitative Synthesis II Quiz
Quantitative Synthesis II Quiz
 
Quantitative Synthesis I
Quantitative Synthesis IQuantitative Synthesis I
Quantitative Synthesis I
 
Quantitative Synthesis I Quiz
Quantitative Synthesis I QuizQuantitative Synthesis I Quiz
Quantitative Synthesis I Quiz
 
Presentation of Findings
Presentation of FindingsPresentation of Findings
Presentation of Findings
 
Presentation of Findings Quiz
Presentation of Findings QuizPresentation of Findings Quiz
Presentation of Findings Quiz
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
 
Grading Strength of Evidence
Grading Strength of EvidenceGrading Strength of Evidence
Grading Strength of Evidence
 
Grading Strength of Evidence Quiz
Grading Strength of Evidence QuizGrading Strength of Evidence Quiz
Grading Strength of Evidence Quiz
 
Data Extraction
Data ExtractionData Extraction
Data Extraction
 
Data Extraction Quiz
Data  Extraction QuizData  Extraction Quiz
Data Extraction Quiz
 
Assessing Quality of Individual Studies Quiz
Assessing Quality of Individual Studies QuizAssessing Quality of Individual Studies Quiz
Assessing Quality of Individual Studies Quiz
 
Assessing Quality of Individual Studies
Assessing Quality of Individual StudiesAssessing Quality of Individual Studies
Assessing Quality of Individual Studies
 
Assessing Applicability Quiz
Assessing Applicability QuizAssessing Applicability Quiz
Assessing Applicability Quiz
 

Recently uploaded

Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...narwatsonia7
 
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ooty Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service Kochi
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service KochiLow Rate Call Girls Kochi Anika 8250192130 Independent Escort Service Kochi
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service KochiSuhani Kapoor
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...chandars293
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Dipal Arora
 
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Chandrapur Call girls 8617370543 Provides all area service COD available
Chandrapur Call girls 8617370543 Provides all area service COD availableChandrapur Call girls 8617370543 Provides all area service COD available
Chandrapur Call girls 8617370543 Provides all area service COD availableDipal Arora
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Servicevidya singh
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...Neha Kaur
 
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...Garima Khatri
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...CALL GIRLS
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipurparulsinha
 
High Profile Call Girls Coimbatore Saanvi☎️ 8250192130 Independent Escort Se...
High Profile Call Girls Coimbatore Saanvi☎️  8250192130 Independent Escort Se...High Profile Call Girls Coimbatore Saanvi☎️  8250192130 Independent Escort Se...
High Profile Call Girls Coimbatore Saanvi☎️ 8250192130 Independent Escort Se...narwatsonia7
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...indiancallgirl4rent
 

Recently uploaded (20)

Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 8250192130 ⟟ Call Me For Gen...
 
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ooty Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ooty Just Call 9907093804 Top Class Call Girl Service Available
 
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service Kochi
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service KochiLow Rate Call Girls Kochi Anika 8250192130 Independent Escort Service Kochi
Low Rate Call Girls Kochi Anika 8250192130 Independent Escort Service Kochi
 
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls JaipurRussian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
Russian Call Girls in Jaipur Riya WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
 
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
 
Chandrapur Call girls 8617370543 Provides all area service COD available
Chandrapur Call girls 8617370543 Provides all area service COD availableChandrapur Call girls 8617370543 Provides all area service COD available
Chandrapur Call girls 8617370543 Provides all area service COD available
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
 
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 9907093804 Top Class Call Girl Service Available
 
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...
VIP Russian Call Girls in Varanasi Samaira 8250192130 Independent Escort Serv...
 
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
VIP Mumbai Call Girls Hiranandani Gardens Just Call 9920874524 with A/C Room ...
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
 
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls JaipurCall Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
Call Girls Service Jaipur Grishma WhatsApp ❤8445551418 VIP Call Girls Jaipur
 
Russian Call Girls in Delhi Tanvi ➡️ 9711199012 💋📞 Independent Escort Service...
Russian Call Girls in Delhi Tanvi ➡️ 9711199012 💋📞 Independent Escort Service...Russian Call Girls in Delhi Tanvi ➡️ 9711199012 💋📞 Independent Escort Service...
Russian Call Girls in Delhi Tanvi ➡️ 9711199012 💋📞 Independent Escort Service...
 
High Profile Call Girls Coimbatore Saanvi☎️ 8250192130 Independent Escort Se...
High Profile Call Girls Coimbatore Saanvi☎️  8250192130 Independent Escort Se...High Profile Call Girls Coimbatore Saanvi☎️  8250192130 Independent Escort Se...
High Profile Call Girls Coimbatore Saanvi☎️ 8250192130 Independent Escort Se...
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
 
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
(Rocky) Jaipur Call Girl - 09521753030 Escorts Service 50% Off with Cash ON D...
 

When to Select Observational Studies as Evidence for Comparative Effectiveness Reviews

  • 1. When To Select Observational Studies as Evidence for Comparative Effectiveness Reviews Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9. Using Observational Studies To Assess Benefits (II) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question Are there gaps in trial evidence? Systematic review question ( including PICOTS) Yes Refocus the review question on gaps Assess the suitability of OSs: Natural history of the disease or exposure Potential biases Confine review to controlled trials No
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Using Observational Studies To Assess Benefits OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting. Systematic review question ( including PICOTS) OS = observational study; PICOTS = population, intervention, comparator, outcome, timing, and setting Consider OSs Always consider: Controlled trials Will OSs provide valid and useful information? Assess whether OSs address the review question Are there gaps in trial evidence? Yes Refocus the review question on gaps Assess the suitability of OSs: Natural history of the disease or exposure Potential biases Confine review to controlled trials No
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.