Master
2024/2025
Quantitative Approaches to Policy Evaluation and Impact Assessment
Type:
Elective course (Economics and Economic Policy)
Area of studies:
Economics
Delivered by:
Department of Applied Economics
Where:
Faculty of Economic Sciences
When:
2 year, 3 module
Mode of studies:
offline
Open to:
students of one campus
Instructors:
Elena Kotyrlo
Master’s programme:
Economics and Economic policy
Language:
English
ECTS credits:
3
Course Syllabus
Abstract
The course focuses on complexity of identifying the precise effects of a policy. It provides a comprehensive overview of methods and approaches in designing and evaluating programs and policies under uncertainty and confounding conditions. Several reform cases and their evaluation that will be presented in the course. The topics of the study are aimed to review various areas of economics, where policy evaluation can be implemented. The cases will be mostly based on Russian experience.
Learning Objectives
- The aim of the course is to provide students with knowledge and skills of quantitative methods of ex ante and ex post policy evaluation. The course focuses on complexity of identifying the precise effects of a policy. It provides a comprehensive overview of methods and approaches in designing and evaluating programs and policies under uncertainty and confounding conditions. Several reform cases and their evaluation that will be presented in the course. The topics of the study are aimed to review various areas of economics, where policy evaluation can be implemented. The cases will be mostly based on Russian experience. As ex ante evaluation, a simulation and calibration of general equilibrium model will be demonstrated. Classes will include discussion on data sources and their quality, practice in empirical estimation of treatment effects, modelling of ex-ante impact assessment, and presentations of empirical research papers from the evaluation literature. The course will include the use of STATA, MS Excel, and GAMS. Use of R and other statistical analysis software is optional. The course provides students with: a range of quantitative methods of policy evaluation and impact assessment; examples of their application; problems that arise when evaluating programs and policies; directions of further development in the area of policy evaluation and impact assessment; practical exercises that can help in research and analytic activity.
Expected Learning Outcomes
- The student is able to propose an econometric model that approximates and explains the processes taking place in society, as well as an adequate method for its evaluation..
- The student is able to find the necessary statistical data for research
- The student is able to give a meaningful interpretation of the obtained results of estimating econometric models
- The student is able to assess the required econometric models using available statistical data using modern statistical software
Course Contents
- Basic issues of evaluation.
- Randomization.
- Propensity score matching
- Difference-in-difference
- Endogenous treatment
- Binary outcome models
- Switching regression with endogenous treatment
- Regression discontinuity
- Measuring distributional program effects.
Assessment Elements
- Participation in the lectures and seminarsCurrent control in the form of solving problems on impact evaluation based on the population survey data and using Stata package and modeling in GAMS. Presentation of one article at the student's choice at one of the seminars contributes to activity score
- Homework essayHomework essay (upto 5 pages) is to be prepared for final examination. It has to describe a research problem on evaluation of a treatment effect or impact assessment. A student is expected to characterize data, treatment, possible outcomes, and at least two methods of estimation, their comparison for solving the problem, and the anticipated results. Essay has to describe a research problem on evaluation of a treatment effect or impact assessment. A student can use his (her) own research problem (relevant to the course subjects), consider an article among recommended for the course or on his (her) own choice. It is very wise to discuss the selected research problem and the source with the tutor before starting the home work. The student is expected to characterize the problem, goals of the policy and key indicators, data, treatment, possible outcomes, a method of estimation, and the anticipated results of the estimation.
- PresentationPresentation 8–10 minutes is to be based on home work essay. . Optionally, essay and presentation can be prepared by a team of students.
- Final testThe final exam is in the form of a test with problems and multiple choice questions. The duration of the test is 90 min (two academic hours).
Interim Assessment
- 2024/2025 3rd module0.4 * Final test + 0.3 * Homework essay + 0.15 * Participation in the lectures and seminars + 0.15 * Presentation
Bibliography
Recommended Core Bibliography
- Handbook on impact evaluation : quantitative methods and practices, Khandker, S. R., 2010
- Khandker, S. R., Koolwal, G. B., & Samad, H. A. (2010). Handbook on Impact Evaluation : Quantitative Methods and Practices. Washington, D.C.: World Bank Publications. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=305052
Recommended Additional Bibliography
- Giovanni Cerulli. (2015). Econometric Evaluation of Socio-Economic Programs. Springer. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsrep&AN=edsrep.b.spr.adstae.978.3.662.46405.2