Training Course on Impact Evaluation for Evidence Based Policy in Development

Course Description

The course aims to address an important prerequisite for incorporating Impact Evaluation (IE) into project design: a theoretical and practical understanding of IE approaches to enable selection of appropriate methodologies, coupled with careful appraisal of the resulting evidence. This Training Course on Impact Evaluation for Evidence Based Policy in Development offered by Phoenix Center for Policy, Research and Training introduces participants to current quantitative as well as qualitative evaluation techniques for Impact Evaluation and gives them an insight into the critical understanding of the roles they can play in the design and assessment of public policy and development interventions. Participants will tackle the difficulties of learning STATA/SPSS, NVIVO and the intricacies of evaluation research designs and econometric techniques, all bolstered by the support of the experienced training team.

Course Objectives

Upon the successful completion of this Training Course on Impact Evaluation for Evidence Based Policy in Development, participants will be able to:

• Understand theories and practices of impact evaluation
• Conduct a rigorous impact evaluation of a project
• Learn about evaluation problem: Attribution, Contribution, Selection and Placement Biases
• Learn and practice econometric techniques for impact evaluation
• Carry out impact data analysis using Propensity Matching and Difference-in -Difference
• Understand IE designs: randomized, quasi and non-experimental
• Learn about evaluation problem: Attribution, selection and placement biases
• Learn about theories and practices of impact evaluation
• Conduct sampling and power calculation
• Report and disseminate impact evaluation findings

Training Methodology

The course is designed to be highly interactive, challenging and stimulating. It will be an instructor led training and will be delivered using a blended learning approach comprising of presentations, discussions, guided sessions of practical exercise, case study review, web-based tutorials, group work, exploration of relevant issues collaborative strength training, performance measurement, and workshops of participants’ displays, all of which adhere to the highest standards of training. The training technique is built on learning by doing, with lecturers using a learner-centered approach to engage participants and provide tasks that allow them to apply what they’ve learned. Experiential knowledge is also given equal importance within the format of training. Our facilitators are seasoned industry professionals with years of expertise in their chosen fields. All facilitation and course materials will be offered in English.

Who Should Attend?

This Training Course on Impact Evaluation for Evidence Based Policy in Development would be suitable for, but not limited to:

• Project Implementation Staff
• Statisticians
• Research Scientists
• Development Practitioners
• Policy Makers in Government, NGOs and Development Organizations who want to determine the impact of their interventions.
• Anyone interested in learning more about Impact Evaluation designs and methods

Course Outline

Module 1: Overview of M&E Fundamentals for Impact Evaluation

• Results Framework
• M&E Project Indicators
• Logical Framework
• Performance Evaluation

Module 2: Introduction to Impact Evaluation

• Defining Impact Evaluation
• Deciding whether to evaluate
• Attribution in impact evaluation
• Contribution vs attribution

Module 3: Determining Points of Impact Evaluation

• Types of Evaluation Questions
• Theories of Change
• The Results Chain
• Evaluation hypothesis
• Impact Evaluation Indicators

Module 4: Indicators in Impact Evaluation

• What are Indicators?
• Indicator Metrics
• Linking Indicators to Results
• Indicator Matrix
• Tracking of Indicators

Module 5: Counterfactuals in Impact Evaluation

• Causal Reference
• Comparison groups and counterfactuals
• Estimating counterfactual in impact evaluation
• Impact Evaluation in the Absence of Baseline Data

Module 6: Impact Evaluation Research Designs

• Experimental Design
• Randomized Control Trials
• Quasi experimental designs
• Regression Discontinuity
• Difference-in-Difference
• Propensity Score Matching (PSM)
• Non-Experimental Designs

Module 7: Sampling in Impact Evaluation

• Sampling techniques in Impact Evaluation
• Sample Size Calculation,
• Sampling Weight
• Statistical Power
• Constructing valid comparison groups

Module 8: Quantitative Data Analysis for Impact Evaluation 

• Introduction to Statistical Concepts
• Creating Variables and Data Entry
• Data Reconstruction
• Variables Manipulation
• Linking and Integrating Multiple Data Sets in Different Forms
• Descriptive Statistics
• Understanding Data Weighting
• Inferential Statistics: Hypothesis Testing, T-Test, ANOVA, Regression Analysis
  

Module 9: Qualitative Data Analysis for Impact Evaluation

• Principles of Qualitative Data Analysis
• Data Preparation for Qualitative Analysis
• Thematic Analysis for Qualitative Data
• Content Analysis for Qualitative Data
• Manipulation and Analysis of Data Using NVivo

Module 10: Randomized Impact Evaluation

• Setting the counterfactual
• Statistical Design of Randomization
• Impacts of Program Placement
• Impacts of Program Participation
• Capturing Both Program Placement and Participation
• Measuring Spillover Effects

Module 11: Propensity Score Matching Technique (PSM)

• Introduction to PSM
• Application of PSM in Impact Evaluation
• Constructing propensity scores
• Matching Analysis (Nearest-Neighbour, Stratification, Radius, Kernel)
• Common support
• Doubly Robust Estimation

Module 11: Difference in Difference (DID) Method

• What is DID?
• Application of DID in Impact Evaluation
• Estimating DID estimator: Single DID, DID with covariates, Quantile DID
• DID for Cross-Sectional Data
• Balancing Tests
• Diff-in-Diff with Propensity Score Matching

Module 12: Qualitative Approaches in Impact Evaluation

• Most Significant Change
• Outcome Mapping
• Outcome Harvesting
• Appreciative Inquiry

Module 13: Producing and Disseminating Impact Evaluation Findings

• Impact Evaluation Plan
• Impact Evaluation Reports: Baseline report, Impact Evaluation Reports
• Case studies

Requirements

• Participants should be reasonably proficient in English.
• Applicants must live up to Phoenix Center for Policy, Research and Training admission criteria.

NOTE

1. Discounts: Organizations sponsoring Four Participants will have the 5th attend Free
2. What is catered for by the Course Fees: Fees cater for all requirements for the training – Learning materials, Lunches, Teas, Snacks and Certification. All participants will additionally cater for their travel and accommodation expenses, visa application, insurance, and other personal expenses.
3. Certificate Awarded: Participants are awarded Certificates of Participation at the end of the training.
4. The program content shown here is for guidance purposes only. Our continuous course improvement process may lead to changes in topics and course structure.
5. Approval of Course: Our Programs are NITA Participating organizations can therefore claim reimbursement on fees paid in accordance with NITA Rules.

Booking for Training

Simply send an email to the Training Officer on training@phoenixtrainingcenter.com and we will send you a registration form. We advise you to book early to avoid missing a seat to this training.

Or call us on +254720272325 / +254737566961

Payment Options

We provide 3 payment options, choose one for your convenience, and kindly make payments at least 5 days before the Training start date to reserve your seat:

1. Groups of 5 People and Above – Cheque Payments to: Phoenix Center for Policy, Research and Training Limited should be paid in advance, 5 days to the training.
2. Invoice: We can send a bill directly to you or your company.
3. Deposit directly into Bank Account (Account details provided upon request)

Cancellation Policy

1. Payment for all courses includes a registration fee, which is non-refundable, and equals 15% of the total sum of the course fee.
2. Participants may cancel attendance 14 days or more prior to the training commencement date.
3. No refunds will be made 14 days or less before the training commencement date. However, participants who are unable to attend may opt to attend a similar training course at a later date or send a substitute participant provided the participation criteria have been met.
   

Tailor Made Courses

This training course can also be customized for your institution upon request for a minimum of 5 participants. You can have it conducted at our Training Centre or at a convenient location. For further inquiries, please contact us on Tel: +254720272325 / +254737566961 or Email training@phoenixtrainingcenter.com  

Accommodation

Accommodation is arranged upon request and at extra cost. For reservations contact the Training Officer on Email: training@phoenixtrainingcenter.com or on Tel: +254720272325 / +254737566961