Магистратура
2022/2023
Психометрические теории и анализ тестовых заданий
Лучший по критерию «Новизна полученных знаний»
Статус:
Курс обязательный (Обучение и оценивание как наука)
Направление:
37.04.01. Психология
Кто читает:
Институт образования
Где читается:
Институт образования
Когда читается:
1-й курс, 3, 4 модуль
Формат изучения:
без онлайн-курса
Охват аудитории:
для всех кампусов НИУ ВШЭ
Прогр. обучения:
Обучение и оценивание как наука
Язык:
английский
Кредиты:
6
Контактные часы:
60
Course Syllabus
Abstract
Prerequisite: basic knowledge in statistics.
This course introduces the fundamental concept of modern measurement theory, including Rasch measurement approach and item response theory (IRT) approach. The course starts with a short
review of classical test theory, its connection to item response theory and basic assumptions of the latter. Smooth transition to Rasch measurement includes such topics as basic principles and basic assumptions of Rasch measurement. While presented Rasch models for dichotomous and polytomous data the students will learn how Rasch analysis constructs linear measures from scored observations. Theoretical and practical aspects of data analysis, output interpretation and reporting will be introduced. In addition to presenting the Rasch model, the course covers some basic methods for parameter estimation and for assessing fit and dimensionality, as well as differential item functioning (DIF). Introduction to linking and equating problems will be done. Further, the course addresses a variety of other dichotomous and polytomous item response theory (IRT) models, such as 1PL, 2PL, and 3PL models, GRM and GPCM models, and extensions, including topics of multidimensional and multifaced modelling. The course is accessible for students without a sophisticated background in psychometrics or statistics, as well as for those who want to gain a deeper understanding on measurement principles. The use of Winsteps and R software demonstrate how to apply the basic psychometric analysis methods to real-world examples in education and psychology.
Learning Objectives
- The objectives of mastering the discipline "Psychometric Theories and Analysis of Test Items" is to master the basic theoretical principles and practical skills of analyzing test items, building and analyzing tools and scales within the framework of IRT and modern measurement approaches.
Expected Learning Outcomes
- Possess practical skills in using standard IRT methods and models for building and analyzing specific assessment tools in education, building and analyzing scales and methods in psychology, sociology and other social sciences;
- Navigate the flow of scientific information to search for the necessary mathematical models and methods of analysis to solve psychometric problems.
- Be able to choose and apply IRT models that correspond to the goals of the analysis (dichotomous and polytomic, one-dimensional and multidimensional, multifaceted, etc).
- Analyze test items and tests in the framework of IRT using appropriate software products, interpret and present the results of the analysis
Course Contents
- Disadvantages and limitations of classical testing theory (CTT)
- Principles for measuring latent variables within the framework of IRT.
- Rasch models
- Dichotomous Rasch Model
- Polytomous Rasch models
- Rating Scale Analysis
- IRT modeling for the development of psychological scales
- Linking
- Dichotomous IRT models
- Polytomous models of IRT
- Estimating the parameters of IRT models
- Analysis of measurement properties of items in IRT
- DIF analysis
- Test taker analysis
- Standard Setting
- Multifaceted models
- Multidimensional IRT models
Assessment Elements
- IWW - individual and group written work
- Group Presentations on Written Assignment (GP WPI)
- Group Article Presentations (GPA)
- Exam. Theory
- Exam. Practice
Interim Assessment
- 2022/2023 4th module0.2 * Exam. Theory + 0.2 * Exam. Practice + 0.15 * Group Presentations on Written Assignment (GP WPI) + 0.15 * Group Article Presentations (GPA) + 0.3 * IWW - individual and group written work
Bibliography
Recommended Core Bibliography
- Applications of item response theory to practical testing problems, Lord, F. M., 2008
- Applying the rasch model : fundamental measurement in the human sciences, Bond, T. G., 2007
- Fundamentals of item response theory, Hambleton, R. K., 1991
- Introduction to classical and modern test theory, Crocker, L., 2008
- Item response theory for psychologists, Embretson, S. E., 2009
- James, A., Algina, J., & Swaminathan, H. (2015). Psychometrics: Classical Test Theory. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.7E3F0482
- Rasch models for measurement, Andrich, D., 1988
Recommended Additional Bibliography
- Ronald K. Hambleton, & Russell W. Jones. (n.d.). ========================= = ITEMS. Instructional Topics in Educational Measurement ========================= An NCME Instructional Module on Comparison of Classical Test Theory and Item Response Theory and Their Applications to Test Development. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.46F2C9F0