Training on Impact Evaluation for Evidence-Based Policy in Development Course

INTRODUCTION

About the Course

The course aimed to address an important prerequisite for incorporating impact evaluation (IE) into programme design: a theoretical and practical understanding of IE approaches to enable selection of appropriate methodologies, coupled with careful appraisal of the resulting evidence. The course introduced participants to current quantitative as well as qualitative evaluation techniques for impact evaluation and gave them an insight into the critical understanding of the roles they can play in the design and assessment of public policy and development interventions. The group enthusiastically tackled the difficulties of learning STATA, NVIVO and the intricacies of evaluation research designs and econometric techniques, all bolstered by the support of the experienced teaching team.

Target Participants

This course is targeted at researchers, project staff, managers, development practitioners, policy makers in government, NGOs and development organizations who want to determine the impact of their interventions.

DURATION

5 days

LEARNING OBJECTIVES

By the end of this course the learners should be able to:   

• Conduct a rigorous impact evaluation of a project

• Learn and practice econometric techniques for impact evaluation

• Carry out impact data analysis using Propensity Matching and Difference-in -Difference

• Understand IE designs: randomized, quasi and non-experimental

• Learn about evaluation problem: Attribution, selection and placement biases

• Learn about theories and practices of impact evaluation

• Conduct sampling and power calculation

• Report and disseminate impact evaluation findings

TOPICS TO BE COVERED

Overview of M&E Fundamentals for Impact Evaluation

• Results Framework

• M&E Project Indicators

• Logical Framework

• Performance Evaluation

Introduction to Impact Evaluation

• Defining impact evaluation

• Deciding whether to evaluate

• Attribution in impact evaluation

• Contribution vs attribution

Determining points of Impact Evaluation

• Types of evaluation questions

• Theories of Change

• The results chain

• Evaluation hypothesis

• Impact evaluation indicators

Counterfactuals in Impact Evaluation

• Causal reference

• Comparison groups and counterfactuals

• Estimating counterfactual in impact evaluation

• Impact Evaluation when a Comparison and Baseline Data are not available

Impact Evaluation Research Designs

• Experimental Design

  • Randomized Control Trials

• Quasi experimental designs

  • Regression Discontinuity

  • Difference-in-Difference

  • Matching

• Non-experimental designs

Sampling in Impact Evaluation

• Sampling techniques in Impact Evaluation

• Sample size calculation,

• Sampling weight

• Statistical power

• Constructing valid comparison groups

Quantitative Data Analysis for Impact Evaluation

Randomized Impact Evaluation

• Setting the counterfactual

• Statistical Design of Randomization

• Impacts of Program Placement

• Impacts of Program Participation

• Capturing Both Program Placement and Participation

• Measuring Spillover Effects

Propensity Score Matching Technique (PSM)

• Introduction to PSM

• Application of PSM in Impact Evaluation

• Constructing propensity scores

• Matching Analysis (Nearest-Neighbour, Stratification, Radius, Kernel )

• Common support

• Doubly Robust Estimation

Difference in Difference Method

• What is DID?

• Application of DID in Impact Evaluation

• Estimating DID estimator: Single DID, DID with covariates, Quantile DID

• DID for Cross-Sectional Data

• Balancing Tests

Qualitative Approaches in Impact Evaluation

• Most Significant Change

• Outcome Mapping

• Outcome Harvesting

• Appreciative Inquiry  

• Diff-in-Diff with Propensity Score Matching

Producing and Disseminating Impact Evaluation findings

• Impact Evaluation Plan

• Impact Evaluation Reports: Baseline report, Impact Evaluation Reports

• Case studies

Closure

Methodology
This instructor led training course is delivered using a blended learning approach and comprises of presentations, guided sessions of practical exercise, web based tutorials and group work. Our facilitators are seasoned industry experts with years of experience, working as professional and trainers in these fields.

All facilitation and course materials will be offered in English. The participants should be reasonably proficient in English.

Accreditation

Upon successful completion of this training, participants will be issued with a certificate of participation.

 Training venue

The training is residential and will be held at the Livecode Technologies Training Centre in Westlands, Nairobi, Kenya. The course fee covers the course tuition, training materials, two break refreshments, lunch, and study visits.

All participants will additionally cater for their, travel expenses, visa application, insurance, and other personal expenses.

 Accommodation

Accommodation is arranged upon request. For reservations contact the Training Officer.

Email: This email address is being protected from spambots. You need JavaScript enabled to view it.

Mobile Number: +254 725 771 853

Training fee

The course fee is KES 70,000.00 or USD 1000.00 exclusive of VAT. The course fees covers the course tuition, training materials, two (2) break refreshments, lunch and study visits. Participants will cater for their travel and accommodation costs.

Payment

Payment should be transferred to Livecode Technologies account through bank on or before the course starting date.

Send proof of payment to This email address is being protected from spambots. You need JavaScript enabled to view it.

Tailor- Made

This scheduled course can also be tailored for your organization. To find out how our tailor-made training can help your organization, contact our team through This email address is being protected from spambots. You need JavaScript enabled to view it.

Please Note: The program content shown here is for guidance purposes only. Our continuous course improvement process may lead to changes in topics and course structure.