SlideShare uma empresa Scribd logo
1 de 37
Baixar para ler offline
Monitoring & Evaluation
“Watch your school succeed”
Sep 28 2012

Maram Barqawi,
M&E Manager, mbarqawi@hotmail.com
Jordan Education Initiative
Monitoring & Evaluation
Watch your school succeed
 1 Introduction M&E
 2 What is monitoring?
 3  What is Evaluation?
 4 Theory of Change
 4 Agreeing on Outcomes
 5 Selecting Key Indicators to
   Monitor Outcomes
 6 Set Baseline and Target
 7 Outcome Matrix
 8 Indicators Matrix
Monitoring & Evaluation
                               6

   Management tool         4
                           0
                               0   8
                                   0

                       2               1
                       0               0
                                       0

   Measures how well       0       1
                                   2
                                   0
   your school is
   performing
Monitoring & Evaluation

            M&E shifted from
         auditing and inspections
            to supporting the
        performance of program’s
           work to achieve the
             demanded goals
The Power of Measuring Results
     If you do not measure results, you can not tell success from failure


              If you can not see success, you can not reward it


     If you can not reward success, you are probably rewarding failure


            If you can not see success, you can not learn from it


           If you can not recognize failure, you can not correct it


         If you can demonstrate results, you can win public support
Monitoring & Evaluation
What is Monitoring?
Day-to-day follow up of
activities during
implementation to measure
progress and identify
deviations

Answers the question, “what
are we doing?”
Monitoring Tools
Examples of monitoring tools in the school:
• Personal diaries
• Check lists,
• Attendance sheets
• Field visits reports
• Students scores
Monitoring & Evaluation
What is Evaluation?
assessment of overall
achievement and impacts


Answers the question, “what
have we achieved and what
impact have we made”?
Theory of Change
   You want to make CHANGE
        in your school?



  You have to have a THEORY about how
         to make that CHANGE.
Theory of Change
It is an explanation of how the use of (inputs) by
(activities) produce a group of (outputs and
outcomes) that sets the stage for producing (impact).
Theory of Change is how
 to use the resources you
have to win the change you
            want
Theory of Change (Logical Model)
                           Goal      • Long-term, widespread
                        (Impacts)
       Results
                                         improvement in the school

                        Outcomes
                                     • Changes in behaviors or skills
                                         as a result of the implemented
                                         project.
                                     •   Products and services
       Implementation



                        Outputs
                                         produced
                                     • Tasks personnel undertake to
                        Activities       transform inputs to outputs


                         Inputs
                                     • Financial, human, and material
                                         resources
Theory of Change - Adult Literacy program
                           Goal      • Higher income levels; increase
                        (Impacts)
       Results
                                       access to higher skill jobs

                        Outcomes
                                     • Increased literacy skill; more
                                       employment opportunities


                                     • Number of adults completing
       Implementation




                        Outputs
                                       literacy courses

                        Activities   • Literacy training courses


                         Inputs
                                     • Facilities, trainers, materials
Why Is It Important to
Choose Outcomes?

           “If you don’t know where you’re
            going, any road will get you there.”
                                   Paraphrased from
                                   Lewis Carroll’s
                                   Alice in Wonderland
Why Is It Important to
Choose Outcomes?                   Participative approach



Note: When Choosing Outcomes,
Remember – “Do Not Go It Alone!”


                                    key stakeholder
How to Developing Outcome
Statements?
             From                  To
         School is not        Clean environment
         clean                is created in the
                              school

        Children are
                             Encouraged families
        dropping out of
                             To Keep Kids In
        School
                             School

        ICT skills are low   Improved ICT literacy
        in the school        among students and
                             teachers
How to Developing Outcome
Statements?

 Consider this Outcome Statement:
 “Students in rural areas improve learning
 and gain better quality of life”

 What are the measurement issues??
Input? Activity? Output?
Outcome? Impact?
Theory of Change - Simple
    Example (Training)
Input           Activity     Output           Outcome         Impact
•Materials      • Conduct    • # of           • Capable       • Better
•Trainers         training     Participants     participant     decisions
•Participants   • Followup     trained          s to apply
                                                M&E
                             • # of
                                                techniques
                               workshops
Theory of Change (Logical Model)


Group work 1 (15min):

• Suggest Theory of Change related to
school’s intervention, discuss the
component and draft the flow chart.
To know your progress you need to
measure outcomes?


          Outcomes must be translated to a
               set of key indicators
Indicator
An outcome indicator identifies
 a specific numerical measurement
that tracks progress (or not)
toward achieving an outcome
Selecting Outcome Indicators
A good performance indicator must be CREAM:

Clear         (Precise and unambiguous)
Relevant      (Appropriate to subject at hand)

Economic      (Available at reasonable cost)
Adequate      (Must provide a sufficient basis to assess
              performance)
Monitorable   (Must be amenable to independent validation)
Outcome:
Reduction in dropping out of school.
   Indicators ?
   • % of students finished the Elementary level
   • % of students finished the Secondary level
   • % of children in child labor
   • More teachers hired
Indicator
  • You will need to develop your own
    indicators to meet your own needs.
  • Developing good indicators often takes
    more than one try!
  • Arriving at the final indicators you will
    use will take time!
  • Pilot, Pilot, Pilot!
Outcomes Matrix
                                                Targets
Outcome   Indicators   Baseline
                                  June. 2013   Dec. 2013   June . 2014
Outcome Matrix


Group work 2 (10min):

• go back to your intervention ToC and
suggest indicators for each outcome
Indicator Baseline

             “If you do not know where you are,
              you will have difficulty determining
              where you need to go.”
                                    Harry Hatry
                                    Urban Institute, 1999
Indicator Baseline
• Is the starting point from where implementation
  begins, or the situation prior to a development
  intervention, against which progress can be assessed
  or comparisons made.
Indicators Matrix
 Indicators are usually summarized in a matrix which will guide the

  process of monitoring those indictors.




 Indicators matrix include information about the data sources

  ,collection methods, frequency a, it also assign the responsibilities

  for data collection ,analysis and reporting.
Indicators Matrix
Outcome1 (objective1)
                                                                 Who will
                                   Data     Who will Frequency analyze and
                         Data
Indicator   Baseline             collection collect    of data  report data   Target
                        source
                                  method     data    collection

1.

2.

3.

4.
Source of Indicators
 •   Written records (paper and electronic)
 •   Individuals involved with the program
 •   General public
 •   Trained observers
 •   Mechanical measurements and tests
Setting Indicators’ Targets



A target is :
 “ the desired level of performance to be
       reached within a specific time”
Data Collection Methods:
Quantitative Research Methods
      1.Surveys
      2.Records

Quantitative Research Methods
      1.Focus Groups
      2.Interviews
      3.Observations
How to develop a Monitoring &
Evaluation plan
Indicators Matrix


Group work 3 (15min):

• Use the outcome matrix to develop
the indicators matrix.
Theory of change

Mais conteúdo relacionado

Mais procurados

Monitoring and evaluation (2)
Monitoring and evaluation (2)Monitoring and evaluation (2)
Monitoring and evaluation (2)Dr.RAJEEV KASHYAP
 
Monitoring and Evaluation of Plan
Monitoring and Evaluation of PlanMonitoring and Evaluation of Plan
Monitoring and Evaluation of PlanRuth Senorin
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&Eclearsateam
 
Basics of Monitoring & Evaluation
Basics of Monitoring & EvaluationBasics of Monitoring & Evaluation
Basics of Monitoring & EvaluationFida Karim 🇵🇰
 
Monitoring & evaluation presentation[1]
Monitoring & evaluation presentation[1]Monitoring & evaluation presentation[1]
Monitoring & evaluation presentation[1]skzarif
 
Monitoring and evaluation frameworks logical framework
Monitoring and evaluation frameworks logical frameworkMonitoring and evaluation frameworks logical framework
Monitoring and evaluation frameworks logical frameworkPreston Healthcare Consulting
 
Introduction to monitoring and evaluation
Introduction to monitoring and evaluationIntroduction to monitoring and evaluation
Introduction to monitoring and evaluationMeshack Lomoywara
 
Theory of Change and Outcome Mapping
Theory of Change and Outcome Mapping Theory of Change and Outcome Mapping
Theory of Change and Outcome Mapping ikmediaries
 
Difference between monitoring and evaluation
Difference between monitoring and evaluationDifference between monitoring and evaluation
Difference between monitoring and evaluationDoreen Ty
 
Presentation Training on Result Based Management (RBM) for M&E Staff
Presentation Training on Result Based Management (RBM) for M&E StaffPresentation Training on Result Based Management (RBM) for M&E Staff
Presentation Training on Result Based Management (RBM) for M&E StaffFida Karim 🇵🇰
 
Monotoring and evaluation principles and theories
Monotoring and evaluation  principles and theoriesMonotoring and evaluation  principles and theories
Monotoring and evaluation principles and theoriescommochally
 
monitoring and evaluation
monitoring and evaluationmonitoring and evaluation
monitoring and evaluationTarek Sallam
 

Mais procurados (20)

Monitoring and evaluation (2)
Monitoring and evaluation (2)Monitoring and evaluation (2)
Monitoring and evaluation (2)
 
Monitoring and Evaluation of Plan
Monitoring and Evaluation of PlanMonitoring and Evaluation of Plan
Monitoring and Evaluation of Plan
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
 
Project Monitoring & Evaluation
Project Monitoring & EvaluationProject Monitoring & Evaluation
Project Monitoring & Evaluation
 
Developing a theory of change
Developing a theory of changeDeveloping a theory of change
Developing a theory of change
 
THEORY OF CHANGE
THEORY OF CHANGE THEORY OF CHANGE
THEORY OF CHANGE
 
Basics of Monitoring & Evaluation
Basics of Monitoring & EvaluationBasics of Monitoring & Evaluation
Basics of Monitoring & Evaluation
 
Theory of Change
Theory of ChangeTheory of Change
Theory of Change
 
Monitoring & evaluation presentation[1]
Monitoring & evaluation presentation[1]Monitoring & evaluation presentation[1]
Monitoring & evaluation presentation[1]
 
Monitoring and evaluation frameworks logical framework
Monitoring and evaluation frameworks logical frameworkMonitoring and evaluation frameworks logical framework
Monitoring and evaluation frameworks logical framework
 
Components of a monitoring and evaluation system
Components of a monitoring and evaluation system  Components of a monitoring and evaluation system
Components of a monitoring and evaluation system
 
Introduction to monitoring and evaluation
Introduction to monitoring and evaluationIntroduction to monitoring and evaluation
Introduction to monitoring and evaluation
 
Theory of Change and Outcome Mapping
Theory of Change and Outcome Mapping Theory of Change and Outcome Mapping
Theory of Change and Outcome Mapping
 
Difference between monitoring and evaluation
Difference between monitoring and evaluationDifference between monitoring and evaluation
Difference between monitoring and evaluation
 
Stakeholder Analysis
Stakeholder AnalysisStakeholder Analysis
Stakeholder Analysis
 
Presentation Training on Result Based Management (RBM) for M&E Staff
Presentation Training on Result Based Management (RBM) for M&E StaffPresentation Training on Result Based Management (RBM) for M&E Staff
Presentation Training on Result Based Management (RBM) for M&E Staff
 
M&E Plan
M&E PlanM&E Plan
M&E Plan
 
Monotoring and evaluation principles and theories
Monotoring and evaluation  principles and theoriesMonotoring and evaluation  principles and theories
Monotoring and evaluation principles and theories
 
Logical framework
Logical frameworkLogical framework
Logical framework
 
monitoring and evaluation
monitoring and evaluationmonitoring and evaluation
monitoring and evaluation
 

Semelhante a Theory of change

Get the RoI: Maximise Business Impact with eLearning
Get the RoI: Maximise Business Impact with eLearningGet the RoI: Maximise Business Impact with eLearning
Get the RoI: Maximise Business Impact with eLearning24x7 Learning
 
YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
YouthREX Webinar: Finding and Selecting Tools for Your Outcome EvaluationYouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
YouthREX Webinar: Finding and Selecting Tools for Your Outcome EvaluationLaura Mulrine
 
Quality Assurance_Final
Quality Assurance_FinalQuality Assurance_Final
Quality Assurance_Finalkristin kipp
 
The truth about data: discovering what learners really want
The truth about data: discovering what learners really wantThe truth about data: discovering what learners really want
The truth about data: discovering what learners really wantLearningandTeaching
 
Outputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsOutputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsAshley Brundage
 
If You Evaluate It, They Will Fund
If You Evaluate It, They Will FundIf You Evaluate It, They Will Fund
If You Evaluate It, They Will Fund4Good.org
 
Lessons Learned
Lessons Learned 	Lessons Learned
Lessons Learned flasco_org
 
Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introductionNathan Loynes
 
e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.Symmetry Coaching Ltd
 
Glfes summer institute2013_raleigh_final
Glfes summer institute2013_raleigh_finalGlfes summer institute2013_raleigh_final
Glfes summer institute2013_raleigh_finalTricia Townsend
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomeseaquals
 
Sse workshop 2 spring 2014
Sse workshop 2 spring 2014Sse workshop 2 spring 2014
Sse workshop 2 spring 2014Martin Brown
 
Training Program Evaluation
Training Program EvaluationTraining Program Evaluation
Training Program EvaluationLaura Pasquini
 
The ABCs of Progress Monitoring with Technology
The ABCs of Progress Monitoring with Technology The ABCs of Progress Monitoring with Technology
The ABCs of Progress Monitoring with Technology Hatch Early Learning
 
Developing Student Learing Outcomes
Developing Student Learing OutcomesDeveloping Student Learing Outcomes
Developing Student Learing OutcomesBonner Foundation
 
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...Xyleme
 

Semelhante a Theory of change (20)

Get the RoI: Maximise Business Impact with eLearning
Get the RoI: Maximise Business Impact with eLearningGet the RoI: Maximise Business Impact with eLearning
Get the RoI: Maximise Business Impact with eLearning
 
YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
YouthREX Webinar: Finding and Selecting Tools for Your Outcome EvaluationYouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
YouthREX Webinar: Finding and Selecting Tools for Your Outcome Evaluation
 
Quality Assurance_Final
Quality Assurance_FinalQuality Assurance_Final
Quality Assurance_Final
 
Putting Program Evaluation to Work for You
Putting Program Evaluation to Work for YouPutting Program Evaluation to Work for You
Putting Program Evaluation to Work for You
 
Basics of Extension Evaluation (Foundations Course 2019)
Basics of Extension Evaluation (Foundations Course 2019)Basics of Extension Evaluation (Foundations Course 2019)
Basics of Extension Evaluation (Foundations Course 2019)
 
The truth about data: discovering what learners really want
The truth about data: discovering what learners really wantThe truth about data: discovering what learners really want
The truth about data: discovering what learners really want
 
Outputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsOutputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic Models
 
If You Evaluate It, They Will Fund
If You Evaluate It, They Will FundIf You Evaluate It, They Will Fund
If You Evaluate It, They Will Fund
 
Lessons Learned
Lessons Learned 	Lessons Learned
Lessons Learned
 
Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introduction
 
e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.
 
Learning Metrics: Building Your Training Scorecard
Learning Metrics: Building Your Training ScorecardLearning Metrics: Building Your Training Scorecard
Learning Metrics: Building Your Training Scorecard
 
Glfes summer institute2013_raleigh_final
Glfes summer institute2013_raleigh_finalGlfes summer institute2013_raleigh_final
Glfes summer institute2013_raleigh_final
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
 
Sse workshop 2 spring 2014
Sse workshop 2 spring 2014Sse workshop 2 spring 2014
Sse workshop 2 spring 2014
 
Training Program Evaluation
Training Program EvaluationTraining Program Evaluation
Training Program Evaluation
 
The ABCs of Progress Monitoring with Technology
The ABCs of Progress Monitoring with Technology The ABCs of Progress Monitoring with Technology
The ABCs of Progress Monitoring with Technology
 
Developing Student Learing Outcomes
Developing Student Learing OutcomesDeveloping Student Learing Outcomes
Developing Student Learing Outcomes
 
Training evauation
Training evauationTraining evauation
Training evauation
 
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...
Webinar: "Let's Get Mobile: Changing Your Concept of Mobile Content Design an...
 

Mais de Maram Barqawi

Implementing Evaluation Criteria for Sustainability-EVALMENA 2020
Implementing Evaluation Criteria for Sustainability-EVALMENA 2020Implementing Evaluation Criteria for Sustainability-EVALMENA 2020
Implementing Evaluation Criteria for Sustainability-EVALMENA 2020Maram Barqawi
 
Planning and Measuring Sustainability
Planning and Measuring Sustainability Planning and Measuring Sustainability
Planning and Measuring Sustainability Maram Barqawi
 
Kirkpatrick's Four-Level Training Evaluation Model
Kirkpatrick's Four-Level Training Evaluation ModelKirkpatrick's Four-Level Training Evaluation Model
Kirkpatrick's Four-Level Training Evaluation ModelMaram Barqawi
 
Understanding change through training for gender equality maram barqawi-full
Understanding change through training for gender equality maram barqawi-fullUnderstanding change through training for gender equality maram barqawi-full
Understanding change through training for gender equality maram barqawi-fullMaram Barqawi
 
نظام المتابعة والتقييم المبني على النتائج…10 خطوات
نظام المتابعة والتقييم المبني على النتائج…10 خطواتنظام المتابعة والتقييم المبني على النتائج…10 خطوات
نظام المتابعة والتقييم المبني على النتائج…10 خطواتMaram Barqawi
 
Result based m&e system maram barqawi
Result based m&e system maram barqawiResult based m&e system maram barqawi
Result based m&e system maram barqawiMaram Barqawi
 
Ideas global assembly presentation (april 14, 2011) maram barqawi
Ideas global assembly   presentation (april 14, 2011) maram barqawiIdeas global assembly   presentation (april 14, 2011) maram barqawi
Ideas global assembly presentation (april 14, 2011) maram barqawiMaram Barqawi
 

Mais de Maram Barqawi (7)

Implementing Evaluation Criteria for Sustainability-EVALMENA 2020
Implementing Evaluation Criteria for Sustainability-EVALMENA 2020Implementing Evaluation Criteria for Sustainability-EVALMENA 2020
Implementing Evaluation Criteria for Sustainability-EVALMENA 2020
 
Planning and Measuring Sustainability
Planning and Measuring Sustainability Planning and Measuring Sustainability
Planning and Measuring Sustainability
 
Kirkpatrick's Four-Level Training Evaluation Model
Kirkpatrick's Four-Level Training Evaluation ModelKirkpatrick's Four-Level Training Evaluation Model
Kirkpatrick's Four-Level Training Evaluation Model
 
Understanding change through training for gender equality maram barqawi-full
Understanding change through training for gender equality maram barqawi-fullUnderstanding change through training for gender equality maram barqawi-full
Understanding change through training for gender equality maram barqawi-full
 
نظام المتابعة والتقييم المبني على النتائج…10 خطوات
نظام المتابعة والتقييم المبني على النتائج…10 خطواتنظام المتابعة والتقييم المبني على النتائج…10 خطوات
نظام المتابعة والتقييم المبني على النتائج…10 خطوات
 
Result based m&e system maram barqawi
Result based m&e system maram barqawiResult based m&e system maram barqawi
Result based m&e system maram barqawi
 
Ideas global assembly presentation (april 14, 2011) maram barqawi
Ideas global assembly   presentation (april 14, 2011) maram barqawiIdeas global assembly   presentation (april 14, 2011) maram barqawi
Ideas global assembly presentation (april 14, 2011) maram barqawi
 

Theory of change

  • 1. Monitoring & Evaluation “Watch your school succeed” Sep 28 2012 Maram Barqawi, M&E Manager, mbarqawi@hotmail.com Jordan Education Initiative
  • 2. Monitoring & Evaluation Watch your school succeed 1 Introduction M&E 2 What is monitoring? 3 What is Evaluation? 4 Theory of Change 4 Agreeing on Outcomes 5 Selecting Key Indicators to Monitor Outcomes 6 Set Baseline and Target 7 Outcome Matrix 8 Indicators Matrix
  • 3. Monitoring & Evaluation 6 Management tool 4 0 0 8 0 2 1 0 0 0 Measures how well 0 1 2 0 your school is performing
  • 4. Monitoring & Evaluation M&E shifted from auditing and inspections to supporting the performance of program’s work to achieve the demanded goals
  • 5. The Power of Measuring Results If you do not measure results, you can not tell success from failure If you can not see success, you can not reward it If you can not reward success, you are probably rewarding failure If you can not see success, you can not learn from it If you can not recognize failure, you can not correct it If you can demonstrate results, you can win public support
  • 6. Monitoring & Evaluation What is Monitoring? Day-to-day follow up of activities during implementation to measure progress and identify deviations Answers the question, “what are we doing?”
  • 7. Monitoring Tools Examples of monitoring tools in the school: • Personal diaries • Check lists, • Attendance sheets • Field visits reports • Students scores
  • 8. Monitoring & Evaluation What is Evaluation? assessment of overall achievement and impacts Answers the question, “what have we achieved and what impact have we made”?
  • 9. Theory of Change You want to make CHANGE in your school? You have to have a THEORY about how to make that CHANGE.
  • 10. Theory of Change It is an explanation of how the use of (inputs) by (activities) produce a group of (outputs and outcomes) that sets the stage for producing (impact).
  • 11. Theory of Change is how to use the resources you have to win the change you want
  • 12. Theory of Change (Logical Model) Goal • Long-term, widespread (Impacts) Results improvement in the school Outcomes • Changes in behaviors or skills as a result of the implemented project. • Products and services Implementation Outputs produced • Tasks personnel undertake to Activities transform inputs to outputs Inputs • Financial, human, and material resources
  • 13. Theory of Change - Adult Literacy program Goal • Higher income levels; increase (Impacts) Results access to higher skill jobs Outcomes • Increased literacy skill; more employment opportunities • Number of adults completing Implementation Outputs literacy courses Activities • Literacy training courses Inputs • Facilities, trainers, materials
  • 14. Why Is It Important to Choose Outcomes? “If you don’t know where you’re going, any road will get you there.” Paraphrased from Lewis Carroll’s Alice in Wonderland
  • 15. Why Is It Important to Choose Outcomes? Participative approach Note: When Choosing Outcomes, Remember – “Do Not Go It Alone!” key stakeholder
  • 16. How to Developing Outcome Statements? From To School is not Clean environment clean is created in the school Children are Encouraged families dropping out of To Keep Kids In School School ICT skills are low Improved ICT literacy in the school among students and teachers
  • 17. How to Developing Outcome Statements? Consider this Outcome Statement: “Students in rural areas improve learning and gain better quality of life” What are the measurement issues??
  • 19. Theory of Change - Simple Example (Training) Input Activity Output Outcome Impact •Materials • Conduct • # of • Capable • Better •Trainers training Participants participant decisions •Participants • Followup trained s to apply M&E • # of techniques workshops
  • 20. Theory of Change (Logical Model) Group work 1 (15min): • Suggest Theory of Change related to school’s intervention, discuss the component and draft the flow chart.
  • 21. To know your progress you need to measure outcomes? Outcomes must be translated to a set of key indicators
  • 22. Indicator An outcome indicator identifies a specific numerical measurement that tracks progress (or not) toward achieving an outcome
  • 23. Selecting Outcome Indicators A good performance indicator must be CREAM: Clear (Precise and unambiguous) Relevant (Appropriate to subject at hand) Economic (Available at reasonable cost) Adequate (Must provide a sufficient basis to assess performance) Monitorable (Must be amenable to independent validation)
  • 24. Outcome: Reduction in dropping out of school. Indicators ? • % of students finished the Elementary level • % of students finished the Secondary level • % of children in child labor • More teachers hired
  • 25. Indicator • You will need to develop your own indicators to meet your own needs. • Developing good indicators often takes more than one try! • Arriving at the final indicators you will use will take time! • Pilot, Pilot, Pilot!
  • 26. Outcomes Matrix Targets Outcome Indicators Baseline June. 2013 Dec. 2013 June . 2014
  • 27. Outcome Matrix Group work 2 (10min): • go back to your intervention ToC and suggest indicators for each outcome
  • 28. Indicator Baseline “If you do not know where you are, you will have difficulty determining where you need to go.” Harry Hatry Urban Institute, 1999
  • 29. Indicator Baseline • Is the starting point from where implementation begins, or the situation prior to a development intervention, against which progress can be assessed or comparisons made.
  • 30. Indicators Matrix  Indicators are usually summarized in a matrix which will guide the process of monitoring those indictors.  Indicators matrix include information about the data sources ,collection methods, frequency a, it also assign the responsibilities for data collection ,analysis and reporting.
  • 31. Indicators Matrix Outcome1 (objective1) Who will Data Who will Frequency analyze and Data Indicator Baseline collection collect of data report data Target source method data collection 1. 2. 3. 4.
  • 32. Source of Indicators • Written records (paper and electronic) • Individuals involved with the program • General public • Trained observers • Mechanical measurements and tests
  • 33. Setting Indicators’ Targets A target is : “ the desired level of performance to be reached within a specific time”
  • 34. Data Collection Methods: Quantitative Research Methods 1.Surveys 2.Records Quantitative Research Methods 1.Focus Groups 2.Interviews 3.Observations
  • 35. How to develop a Monitoring & Evaluation plan
  • 36. Indicators Matrix Group work 3 (15min): • Use the outcome matrix to develop the indicators matrix.