INTRODUCTION

Impact evaluation is an integral process in monitoring and evaluation of projects, programs and implementation of policies. The information revealed by impact evaluation establishes the cause of observed impacts of an intervention. The impact of an intervention can be positive, negative, intended or unintended, direct and indirect. Impact evaluation results therefore can be used to improve or reorient an intervention or to inform decisions about whether to continue, discontinue, replicate or scale up an intervention. This 5 days course will equip participants with skills on how to design a program theory of change, conduct impact evaluation estimation using Stata and interpretation, reporting and dissemination of impact evaluation findings.

COURSE DURATION

5 days

WHO SHOULD ATTEND?

• Researchers
• Project staff,
• Development practitioners,
• Staff involved in Policy makers in government, NGOs and development organizations

COURSE OBJECTIVES

By the end of this course the participants will be able to;

• Learn about theories and practices of impact evaluation
• Distinguish impact evaluation and other types of evaluations
• Learn about evaluation problem: Attribution, selection and placement biases
• Gain skills on impact evaluation all the way from project design, implementation to analysis
• Understand Impact Evaluation  designs: randomized, quasi and non-experimental
• Gain hands on experience in impact evaluation estimation using Stata software
• Learn how to combine quantitative and qualitative approaches for impact evaluation
• Report and disseminate impact evaluation findings

COURSE OUTLINE

Module 1: Context of Impact Evaluation

• Impact evaluation: Theory and practice
• What impact is?
• What impact evaluation is?
• How to measure impact
• Definition of Monitoring and evaluation
• Importance of impact evaluation
• Understanding logical framework in Monitoring and evaluation
• Results Framework
• M&E Project Indicators

Module 2: Introduction to Impact Evaluation

• Impact evaluation quantitative and qualitative design approaches
• Experimental and quasi experimental (Randomized Control Trials, Regression Discontinuity, Difference-in-Difference; Propensity Score Matching, instrumental variables)
• Statistical
• Theory based approach
• Case based approach
• Participatory approach
• Synnthesis studies approach
• A theory based evaluation
• A program theory of change (ToC)
• Differences between ToC and log frame
• Hands on exercise: Developing a program theory of change

Determining points of Impact Evaluation

• Hands on exercise: Using ToC derive evaluation questions and outcome indicators
• Types of evaluation questions
• Understanding the results chain
• Evaluation hypothesis
• Impact evaluation indicators

Sampling in Impact Evaluation

• Sampling techniques in Impact Evaluation
• Probability and non-probability sampling techniques

Module 3: Quantitative Data Analysis for Impact Evaluation

Randomized Impact Evaluation

• Setting the counterfactual
• Statistical Design of Randomization
• Impacts of Program Placement
• Impacts of Program Participation
• Capturing Both Program Placement and Participation
• Measuring Spillover Effects

Propensity Score Matching Technique (PSM)

• Introduction to PSM
• Application of PSM in Impact Evaluation
• Constructing propensity scores
• Matching Analysis (Nearest-Neighbour, Stratification, Radius, Kernel)

Module 4: Difference in Difference Method

• What is DID?
• Application of DID in Impact Evaluation
• Estimating DID estimator: Single DID, DID with covariates, Quantile DID
• DID for Cross-Sectional Data
• Balancing Tests
• Diff-in-Diff with Propensity Score Matching

Qualitative and mixed methods Approaches in Impact Evaluation

• Qualitative method of impact evaluation

o   Most Significant Change

o   Outcome Mapping

o   Outcome Harvesting

o   Appreciative Inquiry

• Mixed method of impact evaluation

Module 5: Producing and Disseminating Impact Evaluation findings

• Writing of Impact Evaluation Reports
• Various ways of disseminating impact evaluation  findings (policy briefs, evidence briefs and cases)

***************************

TRAINING CUSTOMIZATION

This training can also be customized for your institution upon request. You can also have it delivered your preferred location. For further inquiries, please contact us through:

• Phone: +254 732 776 700 or 254759285295
• Email: training@fineresultsresearch.org

REQUIREMENTS

Participants should be reasonably proficient in English.  During the trainings, participants should come with their own laptops.

TRAINING FEE

The course fee covers the course tuition, training materials, two break refreshments, lunch, and study visits.

ACCOMMODATION

Accommodation is arranged upon request. For reservations contact us through phone: +254 732 776 700 or 254759285295 or Email: training@fineresultsresearch.org

PAYMENT

Payment should be transferred to FineResults Research Limited bank before commencement of training. Send proof of payment through the email: training@fineresultsresearch.org

CANCELLATION POLICY 

• All requests for cancellations must be received in writing.
• Changes will become effective on the date of written confirmation being received.