Master
2023/2024
Test development II
Type:
Elective course (Science of Learning and Assessment)
Area of studies:
Psychology
Delivered by:
Department of Educational Programmes
Where:
Institute of Education
When:
2 year, 1 module
Mode of studies:
offline
Open to:
students of all HSE University campuses
Master’s programme:
Science of Learning and Assessment
Language:
English
ECTS credits:
3
Contact hours:
30
Course Syllabus
Abstract
Prerequisite: knowledge of the Test and Questionnaire Development in Psychology and Education course OR basic knowledge in the field of developing classical test tasks (multiple choice, comparison, sequencing, open tasks, statements for psychological testing) and documentation for the test, operationalization skills and creating a theoretical framework.The main goal of this course is to deepen students’ understanding of test development process and get students acquainted with modern (technologically enhanced) test development practices& Students will:• broaden their systematic view on test development• understand basic principles of Evidence-Centered Design• learn how to develop technologically enhanced items• be able to plan and execute their own pilot study with qualitative and quantitative methods (including cognitive laboratories)• differentiate between test translation, adaptation and localization
Learning Objectives
- The main goal of this course is to deepen students’ understanding of test development process and get students acquainted with modern (technologically enhanced) test development practices.
Expected Learning Outcomes
- Students will broaden their systematic view on test development
- Students will understand basic principles of Evidence-Centered Design
- Students will learn how to develop technologically enhanced items
- Students will be able to plan and execute their own pilot study with qualitative and quantitative methods (including cognitive laboratories).
Course Contents
- Actualization of knowledge and skills in the field of creating of classical forms items. Introduction to the development of scenario-based tasks
- Technologically enhanced and innovative types of tasks. The Principled Assessment Design paradigm. Evidence-Centered Design approach
- Features of scenario-based tasks development
- Features of research interview guide. Cognitive laboratories
- Situation Judgment Tests
- Scenario Scales Tests
- Planning an approbation study. The process of test administration
Interim Assessment
- 2023/2024 1st module0.1 * Design of the piloting procedure + 0.2 * Presentation + 0.7 * Writting task
Bibliography
Recommended Core Bibliography
- Kim, Y. J., Almond, R. G., & Shute, V. J. (2016). Applying Evidence-Centered Design for the Development of Game-Based Assessments in Physics Playground. International Journal of Testing, 16(2), 142–163. https://doi.org/10.1080/15305058.2015.1108322
Recommended Additional Bibliography
- Behrens, J. T., Mislevy, R. J., Bauer, M., Williamson, D. M., & Levy, R. (2004). Introduction to Evidence Centered Design and Lessons Learned From Its Application in a Global E-Learning Program. International Journal of Testing, 4(4), 295–301. https://doi.org/10.1207/s15327574ijt0404_1