Tag "Large Language Models"
Pioneering Psychometrics-Based Assessment of Large Language Models in Education
In the rapidly evolving landscape of artificial intelligence, understanding the capabilities and limitations of large language models (LLMs) in specialized fields such as education is crucial. A study by Elena Kardanova, Alina Ivanova, Ksenia Tarasova, Taras Pashchenko, Aleksei Tikhoniuk, Elen Yusupova, Anatoly Kasprzhak, Yaroslav Kuzminov, Ekaterina Kruchinskaia, and Irina Brun, introduces a novel psychometrics-based methodology to assess LLM performance in the field of pedagogy. By focusing on the educational domain and developing a robust benchmark tailored for LLM evaluation, the authors offer new insights into the strengths and weaknesses of these models.