Partnerships for Health System Improvement: Facilitating Evidence-informed Public Health Decision-making
1. Maureen Dobbins, PhD
Kara DeCorby, MSc
Lori Greco, MHSc
Robyn Traynor, MSc
Partnerships for Health
System Improvement
Facilitating evidence-informed Public
Health decision making
2. PHSI Program
● Integrated KT program
● Collaborative partnerships between
researchers & decision-makers
● Applied research – findings of interest to
broader health care system
Background
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
4. Study Purpose
● To enhance capacity for & facilitate contexts
conducive to EIDM
Research Questions
1. What is the impact of a KT strategy on
knowledge, capacity & behaviour for
EIDM?
2. What contextual factors facilitate /
impede impact?
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
5. Methods
Case Study
● Three cases: Ontario health departments
● Tailored KT intervention, involving/delivered by a
Knowledge Broker (KB)
Data Collection
● Quantitative & qualitative; triangulation
● Three time points: baseline, interim, follow-up
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
6. Health Department Partners
Case A
Context
• Large, diverse population served
• Strong MOH/AMOH vision for EIDM
• EIDM strategic priority
• Resources committed for EIDM
Intervention
• Sept 2010 – Jun 2012
• KB on site, 2 d/wk
Mentored Rapid Review teams
Provided training in EIDM skills & methods
Participated in EIDM-related events (meetings,
journal clubs, presentations)
One-on-one consulting (outside of teams)
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
7. Case B
Context
• Large, urban centre served
• MOH committed to EIDM
• Manager „champions‟ supporting project
• EIDM strategic priority
Intervention
• Apr 2011 – Feb 2013
• KB combination of on/off-site: 2 d/wk
Mentored staff teams
Provided training in EIDM skills & methods
Participated in workshops & meetings
Advised Senior Management Team
Health Department Partners
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
8. Case C
Context
• Medium-size, mixed urban/rural population
served
• Commitment from MOH and executive
members.
Intervention
• Apr 2011 – Dec 2012
• KB available off-site*: 2 d/wk (*on-site 2 d/mon)
Mentored staff teams
Provided training in EIDM skills & methods
Participated in workshops & meetings
Advised RKEC on developing department-wide
Policy/Procedure for EIDM and EIDM Guidebook
Health Department Partners
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
10. Case A Case B Case C
• 18 Rapid Reviews
• All-staff EIDM training
provided
• KB facilitated /
contributed to Critical
Appraisal Club.
• Presentations of
research to staff
colleagues & Senior
Management
• 5 questions/reviews
• Additional divisional
training delivered (e.g.
half-day workshops)
• Presentations to
Senior Management
• Abstracts submitted to
present research
• 5 questions/reviews
• EIDM Policy &
Procedure developed
& approved
• RKEC presentations
• All-staff training
delivered
Total Activities
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
11. Results
EIDM Skills & Knowledge
● Improved ability to:
Identify where to begin a literature search
Apply study results to a given scenario
Identify strengths/weaknesses of quality assessment
● No change (or decline in) ability to:
Simply state study results in plain language
Judge the strength of a search strategy
Interpret clinical meaningfulness of study results
Background -- Objectives -- Methods -- Results -- Conclusions
CPHA 2013
Monday June 11th
NOTE: Order of Health Departments in presentation (from west to east):A = PeelB = TorontoC = Durham
We have completed a 3-year, collaborative research study in partnership with three Ontario public health departments. Funding was provided by CIHR 'Partnerships for Health Systems Improvement' grant and each of the partner health departments.
We aimed to investigate tailored Knowledge Brokering strategies for assisting public health staff in developing the skills needed to access and apply relevant research evidence to evidence-informed decisions in practice. Overall, our objective was to enhance capacity for and facilitate contexts conducive to evidence-informed decision making (EIDM).
We used case study methodology and tailored the intervention to the needs of each “case” (health department). A Knowledge Broker and the research team provided training workshops and worked with specific staff teams to address practice-based issues in the health departments in an evidence-informed way. Quantitative and qualitative data were collected at three time points; baseline data analysis further directed the interventions.
Peel
Toronto
Description of partners and their roles:Three Ontario Public Health DepartmentsPartners contributed to designing intervention, coordinating data collection, interpreting results
Our analysis indicated that the intervention impacted staff knowledge and skills, as well as affected program decisions and organizational structure. Our analysis of skills assessment and online survey data, collected at baseline and follow-up, indicated improvement in overall staff understanding of EIDM. Qualitative interview and Knowledge Broker reflective journal data further corroborated that this new knowledge and skill set were being incorporated into health department work.
Note: Based on quick interpretation (i.e. not statistically significant) of EIDM Skills Tool for only 2 HU’s (comparing baseline and follow-up) because still in final phase of data collection for Case B.
But even with decision-maker involvement, we still encounter challenges: