SlideShare a Scribd company logo
1 of 22
Performance Indicators WithinPerformance Indicators Within
and Across Community Settingsand Across Community Settings
Reed EarlyReed Early
Canadian Evaluation SocietyCanadian Evaluation Society
Conference 2013Conference 2013
TorontoToronto
2
Logic ModelLogic Model
Inputs Activities Outputs Outcomes Ultimate
Outcomes
Performance Indicators
3
Organization
Ultimate indicators
Immediate
performance indicators
Beyond the sphere
of influence Beyond attribution
Program/Service Environment
Distant Environment
Performance Indicator ProximityPerformance Indicator Proximity
Management Choice of Indicators
Goals Objectives Indicators
Strategic Choice of Indicators
Strat-
egies
IndicatorsTargets
Consultative Choice of Indicators
Data
Collection IndicatorsAnalysis
Best Practice Choice of Indicators
Indicators
Borrow &
Adapt
Shared and
evaluated
Styles of Indicator SelectionStyles of Indicator Selection
5
ManagementManagement
Indicators reflect goals and objectives –Indicators reflect goals and objectives –
i.e. related toi.e. related to logic model outcomeslogic model outcomes
Useful in service/prevention agenciesUseful in service/prevention agencies
Often mandated via legislationOften mandated via legislation
This style may be used by seniorThis style may be used by senior
managers to independently choose themanagers to independently choose the
indicatorsindicators
6
StrategicStrategic
Indicators reflect strategies and targetsIndicators reflect strategies and targets
– i.e.– i.e. activities, outputs and nearactivities, outputs and near
outcomesoutcomes
Useful for quantifiable or tangibleUseful for quantifiable or tangible
productsproducts
Often result of accountability initiativeOften result of accountability initiative
This style may be used by performanceThis style may be used by performance
team in a larger agencyteam in a larger agency
7
ConsultativeConsultative
Indicators based on focus group or survey ofIndicators based on focus group or survey of
employeesemployees (and statekholders) and Q sort(and statekholders) and Q sort
Useful for decentralized, flat organizationsUseful for decentralized, flat organizations
Requires time, effort and original dataRequires time, effort and original data
collectioncollection
May be used by smaller agencies practicingMay be used by smaller agencies practicing
more democratic managementmore democratic management
8
Best PracticesBest Practices
Selecting indicators from best practicesSelecting indicators from best practices
in literature/Internet, from similarin literature/Internet, from similar
leading agencies, and adaptedleading agencies, and adapted
Useful to any agency with resources toUseful to any agency with resources to
search and researchsearch and research
Requires time, effort, and openness toRequires time, effort, and openness to
experimentationexperimentation
May provide benchmark comparabilityMay provide benchmark comparability
9
Health IndicatorsHealth Indicators
Surgical wait time
Immunization rate
Infant mortality rate
Hospital acquired infections
Inpatient mortality rate
Cost per bed/day
10
Social Services IndicatorsSocial Services Indicators
Child Behavior Checklist
Youth unemployment rate
Teen pregnancy and childbearing
School attendance or graduation rate
Children in families below poverty line
Cost per child in care
11
Industry IndicatorsIndustry Indicators
SalesSales
Sales of new productsSales of new products
Value added to raw material consumedValue added to raw material consumed
Cost savings to industry i.e. reducedCost savings to industry i.e. reduced
training and down timetraining and down time
Increased market share %
Increased geographic penetration
12
Continuing EducationContinuing Education
Reach Relevance
Staffing Overhead
Educational Financial
Efficiency ratio
Effectiveness ratio
13
Performance MeasurementPerformance Measurement
SystemsSystems
community results based indicators, i.ecommunity results based indicators, i.e..
Tools For Action Series A resource guideTools For Action Series A resource guide
for designing a community indicatorfor designing a community indicator
projectproject. a report by SPARC BC, April 2008. a report by SPARC BC, April 2008
– Community Objective and PotentialCommunity Objective and Potential
IndicatorsIndicators, United Way of Greater, United Way of Greater
Milwaukee, Planning, Allocation &Milwaukee, Planning, Allocation &
Monitoring DivisionMonitoring Division
14
How do you develop PI’sHow do you develop PI’s
15
Conference Indicators…Conference Indicators…
– Participant satisfactionParticipant satisfaction
– Citations to conferenceCitations to conference
– Publications from conferencePublications from conference
– Networking and outside connectionsNetworking and outside connections
– Sleeper effectsSleeper effects
– Diffusion of benefitsDiffusion of benefits
– ……othersothers
16
Criteria for IndicatorsCriteria for Indicators
Is it:Is it:
– Authoritative - commonly agreed to beAuthoritative - commonly agreed to be
truetrue
– Economical – only what’s neededEconomical – only what’s needed
– EthicalEthical
– Feasible – possible to measureFeasible – possible to measure
– Logical – outputs vs. outcomesLogical – outputs vs. outcomes
17
Criteria Con’tCriteria Con’t
Is it:Is it:
– Manageable - suggest 10 -40Manageable - suggest 10 -40
– Measurable – qualitative or quantitativeMeasurable – qualitative or quantitative
– Reliable - accurateReliable - accurate
– Specific – at the right level of precisionSpecific – at the right level of precision
– Visible/accessible like a car dashboardVisible/accessible like a car dashboard
– Timely True and ValidTimely True and Valid
18
Analog and ContinuousAnalog and Continuous
MeasuresMeasures
19
Digital and Logical MeasuresDigital and Logical Measures
20
Qualitative and SpacialQualitative and Spacial
21
Ratio and Rate MeasuresRatio and Rate Measures
22
Take away notesTake away notes
Performance indicators relate to logic modelsPerformance indicators relate to logic models
Indicator selection requires care, time andIndicator selection requires care, time and
conscious thoughtconscious thought
Different styles are:Different styles are:
– Management, strategic, consultative, best practiceManagement, strategic, consultative, best practice
Indicators should be selected and evaluatedIndicators should be selected and evaluated
against criteriaagainst criteria

More Related Content

What's hot

Future Challenges of Clinical Development; a View from the CRO - Hani Zaki
Future Challenges of Clinical Development; a View from the CRO - Hani ZakiFuture Challenges of Clinical Development; a View from the CRO - Hani Zaki
Future Challenges of Clinical Development; a View from the CRO - Hani Zaki
TTC, llc
 
Partnership Satisfaction Impact Survey Final
Partnership Satisfaction Impact Survey FinalPartnership Satisfaction Impact Survey Final
Partnership Satisfaction Impact Survey Final
FITT
 
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trendsCros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
Allu Sridhar Venkat
 

What's hot (20)

Compliance framework
Compliance frameworkCompliance framework
Compliance framework
 
International Standard on Assurance Engagements ISAE 3000 Audits
International Standard on Assurance Engagements ISAE 3000 AuditsInternational Standard on Assurance Engagements ISAE 3000 Audits
International Standard on Assurance Engagements ISAE 3000 Audits
 
Future Challenges of Clinical Development; a View from the CRO - Hani Zaki
Future Challenges of Clinical Development; a View from the CRO - Hani ZakiFuture Challenges of Clinical Development; a View from the CRO - Hani Zaki
Future Challenges of Clinical Development; a View from the CRO - Hani Zaki
 
Mtm4 white paper industry analysis (featuring the 5 forces)
Mtm4 white paper   industry analysis (featuring the 5 forces)Mtm4 white paper   industry analysis (featuring the 5 forces)
Mtm4 white paper industry analysis (featuring the 5 forces)
 
PPD Competitive Analysis
PPD Competitive AnalysisPPD Competitive Analysis
PPD Competitive Analysis
 
Factea Offshoring Filter
Factea Offshoring FilterFactea Offshoring Filter
Factea Offshoring Filter
 
Supply Chain Risk Management
Supply Chain Risk ManagementSupply Chain Risk Management
Supply Chain Risk Management
 
COVID-19 Rapid Response Crisis Checklist
COVID-19 Rapid Response Crisis ChecklistCOVID-19 Rapid Response Crisis Checklist
COVID-19 Rapid Response Crisis Checklist
 
Mtm9 white paper macro-environmental (steep) analysis
Mtm9 white paper   macro-environmental (steep) analysisMtm9 white paper   macro-environmental (steep) analysis
Mtm9 white paper macro-environmental (steep) analysis
 
CRO Industry Overview
CRO Industry OverviewCRO Industry Overview
CRO Industry Overview
 
Third-Party Oversight & Governance
Third-Party Oversight & GovernanceThird-Party Oversight & Governance
Third-Party Oversight & Governance
 
Partnership Satisfaction Impact Survey Final
Partnership Satisfaction Impact Survey FinalPartnership Satisfaction Impact Survey Final
Partnership Satisfaction Impact Survey Final
 
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trendsCros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
Cros and other_outsourced_pharmaceutical_support_services_m_a_drivers_and_trends
 
IMA Annual Event LA 2015 Brad Monterio and Liv Watson 23 jun15
IMA Annual Event LA  2015 Brad Monterio and  Liv Watson 23 jun15IMA Annual Event LA  2015 Brad Monterio and  Liv Watson 23 jun15
IMA Annual Event LA 2015 Brad Monterio and Liv Watson 23 jun15
 
Models & Trends in REMS Program Success
Models & Trends in REMS Program SuccessModels & Trends in REMS Program Success
Models & Trends in REMS Program Success
 
Auditing supply chain risk_management
Auditing supply chain risk_management Auditing supply chain risk_management
Auditing supply chain risk_management
 
KRI Consulting Solutions LLC
KRI Consulting Solutions LLCKRI Consulting Solutions LLC
KRI Consulting Solutions LLC
 
Overcoming the Struggles of Small Practices
Overcoming the Struggles of Small PracticesOvercoming the Struggles of Small Practices
Overcoming the Struggles of Small Practices
 
Competition Assessment: UK
Competition Assessment: UKCompetition Assessment: UK
Competition Assessment: UK
 
Vendor Selection Best Practices - Crowe Mead
Vendor Selection Best Practices - Crowe MeadVendor Selection Best Practices - Crowe Mead
Vendor Selection Best Practices - Crowe Mead
 

Viewers also liked

Closing the Knowledge Gap Between Evaluators and Stakeholders
Closing the Knowledge Gap Between Evaluators and StakeholdersClosing the Knowledge Gap Between Evaluators and Stakeholders
Closing the Knowledge Gap Between Evaluators and Stakeholders
CesToronto
 

Viewers also liked (14)

Refranes
RefranesRefranes
Refranes
 
Ces 2013 presentation
Ces 2013 presentationCes 2013 presentation
Ces 2013 presentation
 
Ces 2013 negotiating evaluation design
Ces 2013   negotiating evaluation designCes 2013   negotiating evaluation design
Ces 2013 negotiating evaluation design
 
Ces 2013 towards a cdn definition of evaluation
Ces 2013   towards a cdn definition of evaluationCes 2013   towards a cdn definition of evaluation
Ces 2013 towards a cdn definition of evaluation
 
CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Co...
CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Co...CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Co...
CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Co...
 
Ces 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System LevelCes 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System Level
 
Performance improvement & assessment collaboration
Performance improvement & assessment collaborationPerformance improvement & assessment collaboration
Performance improvement & assessment collaboration
 
Closing the Knowledge Gap Between Evaluators and Stakeholders
Closing the Knowledge Gap Between Evaluators and StakeholdersClosing the Knowledge Gap Between Evaluators and Stakeholders
Closing the Knowledge Gap Between Evaluators and Stakeholders
 
CES 2013 conference - Rethinking the Relationship between Monitoring and Eval...
CES 2013 conference - Rethinking the Relationship between Monitoring and Eval...CES 2013 conference - Rethinking the Relationship between Monitoring and Eval...
CES 2013 conference - Rethinking the Relationship between Monitoring and Eval...
 
Indicators workshop ces 2013
Indicators workshop ces 2013Indicators workshop ces 2013
Indicators workshop ces 2013
 
Living the Values of Engagement and the Strategic View with Program Evaluatio...
Living the Values of Engagement and the Strategic View with Program Evaluatio...Living the Values of Engagement and the Strategic View with Program Evaluatio...
Living the Values of Engagement and the Strategic View with Program Evaluatio...
 
Indicators workshop ces 2013
Indicators workshop ces 2013Indicators workshop ces 2013
Indicators workshop ces 2013
 
Evaluation for Development: matching evaluation to the right user, the right...
Evaluation for Development:  matching evaluation to the right user, the right...Evaluation for Development:  matching evaluation to the right user, the right...
Evaluation for Development: matching evaluation to the right user, the right...
 
Monitoring and Evaluation of International Development Assistance to the Priv...
Monitoring and Evaluation of International Development Assistance to the Priv...Monitoring and Evaluation of International Development Assistance to the Priv...
Monitoring and Evaluation of International Development Assistance to the Priv...
 

Similar to Indicators workshop ces 2013

Ultimate guide to performance measurement
Ultimate guide to performance measurementUltimate guide to performance measurement
Ultimate guide to performance measurement
Rebecca Manjra
 
The Competitive Intelligence Continuum - Taking Wisconsin to the World
The Competitive Intelligence Continuum - Taking Wisconsin to the WorldThe Competitive Intelligence Continuum - Taking Wisconsin to the World
The Competitive Intelligence Continuum - Taking Wisconsin to the World
Arik Johnson
 

Similar to Indicators workshop ces 2013 (20)

How to Use the Barcelona Principles to Save Time & Money, Make Better Decisio...
How to Use the Barcelona Principles to Save Time & Money, Make Better Decisio...How to Use the Barcelona Principles to Save Time & Money, Make Better Decisio...
How to Use the Barcelona Principles to Save Time & Money, Make Better Decisio...
 
Schofield - Using Benchmarks to Accelerate Process Improvement
Schofield - Using Benchmarks to Accelerate Process ImprovementSchofield - Using Benchmarks to Accelerate Process Improvement
Schofield - Using Benchmarks to Accelerate Process Improvement
 
Traffic Lights & Threat Levels
Traffic Lights & Threat LevelsTraffic Lights & Threat Levels
Traffic Lights & Threat Levels
 
Field Interactive MR Pvt Ltd ESOMAR 28 Questions & Answers
Field Interactive MR Pvt Ltd ESOMAR 28 Questions & AnswersField Interactive MR Pvt Ltd ESOMAR 28 Questions & Answers
Field Interactive MR Pvt Ltd ESOMAR 28 Questions & Answers
 
SGS NGO Benchmark Audit
SGS NGO Benchmark AuditSGS NGO Benchmark Audit
SGS NGO Benchmark Audit
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
7Tips
7Tips7Tips
7Tips
 
Alliances - The Ugly Duckling of Sales
Alliances - The Ugly Duckling of SalesAlliances - The Ugly Duckling of Sales
Alliances - The Ugly Duckling of Sales
 
Benchmarking: Underutilized Measuring Tool | Dick Dadamo | Lunch & Learn
Benchmarking: Underutilized Measuring Tool | Dick Dadamo | Lunch & Learn Benchmarking: Underutilized Measuring Tool | Dick Dadamo | Lunch & Learn
Benchmarking: Underutilized Measuring Tool | Dick Dadamo | Lunch & Learn
 
Developing Competitive advantage & Strategic Focus.pptx
Developing Competitive advantage & Strategic Focus.pptxDeveloping Competitive advantage & Strategic Focus.pptx
Developing Competitive advantage & Strategic Focus.pptx
 
Benchmarking Basic.pdf
Benchmarking Basic.pdfBenchmarking Basic.pdf
Benchmarking Basic.pdf
 
Benchmarking and outsourcing
Benchmarking and outsourcingBenchmarking and outsourcing
Benchmarking and outsourcing
 
The Next Frontier for ESG Research and Ratings
The Next Frontier for ESG Research and RatingsThe Next Frontier for ESG Research and Ratings
The Next Frontier for ESG Research and Ratings
 
Touray moriba ba522week4-final rsearchprojct-global marketing _ppt
Touray moriba ba522week4-final rsearchprojct-global marketing _pptTouray moriba ba522week4-final rsearchprojct-global marketing _ppt
Touray moriba ba522week4-final rsearchprojct-global marketing _ppt
 
Frontiers 2015, by 3 Pillar, CES, Rockbridge
Frontiers 2015, by 3 Pillar, CES, RockbridgeFrontiers 2015, by 3 Pillar, CES, Rockbridge
Frontiers 2015, by 3 Pillar, CES, Rockbridge
 
Ultimate guide to performance measurement
Ultimate guide to performance measurementUltimate guide to performance measurement
Ultimate guide to performance measurement
 
Competitive Intelligence
Competitive IntelligenceCompetitive Intelligence
Competitive Intelligence
 
The Competitive Intelligence Continuum - Taking Wisconsin to the World
The Competitive Intelligence Continuum - Taking Wisconsin to the WorldThe Competitive Intelligence Continuum - Taking Wisconsin to the World
The Competitive Intelligence Continuum - Taking Wisconsin to the World
 
Bpr 04 Benchmarking
Bpr 04 BenchmarkingBpr 04 Benchmarking
Bpr 04 Benchmarking
 
Converge Advisory Group
Converge Advisory GroupConverge Advisory Group
Converge Advisory Group
 

More from CesToronto

Improving evaluations and utilization with statistical edge nested data desi...
Improving evaluations and utilization with statistical edge  nested data desi...Improving evaluations and utilization with statistical edge  nested data desi...
Improving evaluations and utilization with statistical edge nested data desi...
CesToronto
 
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
CesToronto
 
Ces conference presentation 2013 final_june 2013
Ces conference presentation 2013 final_june 2013Ces conference presentation 2013 final_june 2013
Ces conference presentation 2013 final_june 2013
CesToronto
 
PRISM - A Composite Score Model by Bongs Lainjo
PRISM - A Composite Score Model by Bongs LainjoPRISM - A Composite Score Model by Bongs Lainjo
PRISM - A Composite Score Model by Bongs Lainjo
CesToronto
 

More from CesToronto (19)

Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?
 
Evaluation pal program monitoring and evaluation technology
Evaluation pal program monitoring and evaluation technologyEvaluation pal program monitoring and evaluation technology
Evaluation pal program monitoring and evaluation technology
 
Developing Performance Measures Through a Consultative Process
Developing Performance Measures Through a Consultative ProcessDeveloping Performance Measures Through a Consultative Process
Developing Performance Measures Through a Consultative Process
 
The international Partnership Initiative to promote Evaluation Capacity Devel...
The international Partnership Initiative to promote Evaluation Capacity Devel...The international Partnership Initiative to promote Evaluation Capacity Devel...
The international Partnership Initiative to promote Evaluation Capacity Devel...
 
Ces 2013 the role of technology and social media - raising the grade
Ces 2013   the role of technology and social media - raising the gradeCes 2013   the role of technology and social media - raising the grade
Ces 2013 the role of technology and social media - raising the grade
 
Evaluating Libraries' Business Services
Evaluating Libraries' Business Services Evaluating Libraries' Business Services
Evaluating Libraries' Business Services
 
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
 
Improving evaluations and utilization with statistical edge nested data desi...
Improving evaluations and utilization with statistical edge  nested data desi...Improving evaluations and utilization with statistical edge  nested data desi...
Improving evaluations and utilization with statistical edge nested data desi...
 
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
Evaluating through a Community of Practice: How 8 Evaluators are Improving Pr...
 
Ces conference presentation 2013 final_june 2013
Ces conference presentation 2013 final_june 2013Ces conference presentation 2013 final_june 2013
Ces conference presentation 2013 final_june 2013
 
Avoiding Chartjunk
Avoiding Chartjunk Avoiding Chartjunk
Avoiding Chartjunk
 
Let’s compare! Practical perspectives on the use of an international comparat...
Let’s compare! Practical perspectives on the use of an international comparat...Let’s compare! Practical perspectives on the use of an international comparat...
Let’s compare! Practical perspectives on the use of an international comparat...
 
Evaluating higher education learning outcomes presentation to ces
Evaluating higher education learning outcomes presentation to cesEvaluating higher education learning outcomes presentation to ces
Evaluating higher education learning outcomes presentation to ces
 
SROI - Moving the conversation from cost to value - SiMPACT
SROI  - Moving the conversation from cost to value - SiMPACTSROI  - Moving the conversation from cost to value - SiMPACT
SROI - Moving the conversation from cost to value - SiMPACT
 
Innovative Synthesis Methods
Innovative Synthesis MethodsInnovative Synthesis Methods
Innovative Synthesis Methods
 
PRISM - A Composite Score Model by Bongs Lainjo
PRISM - A Composite Score Model by Bongs LainjoPRISM - A Composite Score Model by Bongs Lainjo
PRISM - A Composite Score Model by Bongs Lainjo
 
Understanding the Role of Social Capital in Assessing Settlement Outcomes by ...
Understanding the Role of Social Capital in Assessing Settlement Outcomes by ...Understanding the Role of Social Capital in Assessing Settlement Outcomes by ...
Understanding the Role of Social Capital in Assessing Settlement Outcomes by ...
 
Qda ces 2013 toronto workshop
Qda ces 2013 toronto workshopQda ces 2013 toronto workshop
Qda ces 2013 toronto workshop
 
Qda 2013 ces toronto workshop
Qda 2013 ces toronto workshopQda 2013 ces toronto workshop
Qda 2013 ces toronto workshop
 

Recently uploaded

Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
amitlee9823
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
daisycvs
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
lizamodels9
 
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
amitlee9823
 
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
Abortion pills in Kuwait Cytotec pills in Kuwait
 

Recently uploaded (20)

Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
Call Girls Electronic City Just Call 👗 7737669865 👗 Top Class Call Girl Servi...
 
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort ServiceEluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
 
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfDr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
 
Cracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptxCracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptx
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League City
 
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
 
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
Quick Doctor In Kuwait +2773`7758`557 Kuwait Doha Qatar Dubai Abu Dhabi Sharj...
 
Katrina Personal Brand Project and portfolio 1
Katrina Personal Brand Project and portfolio 1Katrina Personal Brand Project and portfolio 1
Katrina Personal Brand Project and portfolio 1
 
Uneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration PresentationUneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration Presentation
 
It will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 MayIt will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 May
 
Falcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business GrowthFalcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business Growth
 
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
 
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
Call Girls Jp Nagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bang...
 
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to ProsperityFalcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
 
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
 
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best ServicesMysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
 
Business Model Canvas (BMC)- A new venture concept
Business Model Canvas (BMC)-  A new venture conceptBusiness Model Canvas (BMC)-  A new venture concept
Business Model Canvas (BMC)- A new venture concept
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 

Indicators workshop ces 2013

  • 1. Performance Indicators WithinPerformance Indicators Within and Across Community Settingsand Across Community Settings Reed EarlyReed Early Canadian Evaluation SocietyCanadian Evaluation Society Conference 2013Conference 2013 TorontoToronto
  • 2. 2 Logic ModelLogic Model Inputs Activities Outputs Outcomes Ultimate Outcomes Performance Indicators
  • 3. 3 Organization Ultimate indicators Immediate performance indicators Beyond the sphere of influence Beyond attribution Program/Service Environment Distant Environment Performance Indicator ProximityPerformance Indicator Proximity
  • 4. Management Choice of Indicators Goals Objectives Indicators Strategic Choice of Indicators Strat- egies IndicatorsTargets Consultative Choice of Indicators Data Collection IndicatorsAnalysis Best Practice Choice of Indicators Indicators Borrow & Adapt Shared and evaluated Styles of Indicator SelectionStyles of Indicator Selection
  • 5. 5 ManagementManagement Indicators reflect goals and objectives –Indicators reflect goals and objectives – i.e. related toi.e. related to logic model outcomeslogic model outcomes Useful in service/prevention agenciesUseful in service/prevention agencies Often mandated via legislationOften mandated via legislation This style may be used by seniorThis style may be used by senior managers to independently choose themanagers to independently choose the indicatorsindicators
  • 6. 6 StrategicStrategic Indicators reflect strategies and targetsIndicators reflect strategies and targets – i.e.– i.e. activities, outputs and nearactivities, outputs and near outcomesoutcomes Useful for quantifiable or tangibleUseful for quantifiable or tangible productsproducts Often result of accountability initiativeOften result of accountability initiative This style may be used by performanceThis style may be used by performance team in a larger agencyteam in a larger agency
  • 7. 7 ConsultativeConsultative Indicators based on focus group or survey ofIndicators based on focus group or survey of employeesemployees (and statekholders) and Q sort(and statekholders) and Q sort Useful for decentralized, flat organizationsUseful for decentralized, flat organizations Requires time, effort and original dataRequires time, effort and original data collectioncollection May be used by smaller agencies practicingMay be used by smaller agencies practicing more democratic managementmore democratic management
  • 8. 8 Best PracticesBest Practices Selecting indicators from best practicesSelecting indicators from best practices in literature/Internet, from similarin literature/Internet, from similar leading agencies, and adaptedleading agencies, and adapted Useful to any agency with resources toUseful to any agency with resources to search and researchsearch and research Requires time, effort, and openness toRequires time, effort, and openness to experimentationexperimentation May provide benchmark comparabilityMay provide benchmark comparability
  • 9. 9 Health IndicatorsHealth Indicators Surgical wait time Immunization rate Infant mortality rate Hospital acquired infections Inpatient mortality rate Cost per bed/day
  • 10. 10 Social Services IndicatorsSocial Services Indicators Child Behavior Checklist Youth unemployment rate Teen pregnancy and childbearing School attendance or graduation rate Children in families below poverty line Cost per child in care
  • 11. 11 Industry IndicatorsIndustry Indicators SalesSales Sales of new productsSales of new products Value added to raw material consumedValue added to raw material consumed Cost savings to industry i.e. reducedCost savings to industry i.e. reduced training and down timetraining and down time Increased market share % Increased geographic penetration
  • 12. 12 Continuing EducationContinuing Education Reach Relevance Staffing Overhead Educational Financial Efficiency ratio Effectiveness ratio
  • 13. 13 Performance MeasurementPerformance Measurement SystemsSystems community results based indicators, i.ecommunity results based indicators, i.e.. Tools For Action Series A resource guideTools For Action Series A resource guide for designing a community indicatorfor designing a community indicator projectproject. a report by SPARC BC, April 2008. a report by SPARC BC, April 2008 – Community Objective and PotentialCommunity Objective and Potential IndicatorsIndicators, United Way of Greater, United Way of Greater Milwaukee, Planning, Allocation &Milwaukee, Planning, Allocation & Monitoring DivisionMonitoring Division
  • 14. 14 How do you develop PI’sHow do you develop PI’s
  • 15. 15 Conference Indicators…Conference Indicators… – Participant satisfactionParticipant satisfaction – Citations to conferenceCitations to conference – Publications from conferencePublications from conference – Networking and outside connectionsNetworking and outside connections – Sleeper effectsSleeper effects – Diffusion of benefitsDiffusion of benefits – ……othersothers
  • 16. 16 Criteria for IndicatorsCriteria for Indicators Is it:Is it: – Authoritative - commonly agreed to beAuthoritative - commonly agreed to be truetrue – Economical – only what’s neededEconomical – only what’s needed – EthicalEthical – Feasible – possible to measureFeasible – possible to measure – Logical – outputs vs. outcomesLogical – outputs vs. outcomes
  • 17. 17 Criteria Con’tCriteria Con’t Is it:Is it: – Manageable - suggest 10 -40Manageable - suggest 10 -40 – Measurable – qualitative or quantitativeMeasurable – qualitative or quantitative – Reliable - accurateReliable - accurate – Specific – at the right level of precisionSpecific – at the right level of precision – Visible/accessible like a car dashboardVisible/accessible like a car dashboard – Timely True and ValidTimely True and Valid
  • 18. 18 Analog and ContinuousAnalog and Continuous MeasuresMeasures
  • 19. 19 Digital and Logical MeasuresDigital and Logical Measures
  • 21. 21 Ratio and Rate MeasuresRatio and Rate Measures
  • 22. 22 Take away notesTake away notes Performance indicators relate to logic modelsPerformance indicators relate to logic models Indicator selection requires care, time andIndicator selection requires care, time and conscious thoughtconscious thought Different styles are:Different styles are: – Management, strategic, consultative, best practiceManagement, strategic, consultative, best practice Indicators should be selected and evaluatedIndicators should be selected and evaluated against criteriaagainst criteria