AI in Assessment

Recent advancements in artificial intelligence (AI) and intelligent automation have revolutionized educational assessments, with a focus on scalable content generation and personalization. We propose a new ‘Human-Centered AI’ framework and a new test design, the personalized ensemble test (PET) for high-stakes testing. The PET merges psychometrics and AI (computational psychometrics) for efficient, high-quality personalized measurement. It integrates test design, generation, and adaptive administration, while facilitating personalization by test purpose improving efficiency and while ensuring that AI enhances all steps of the test development.  AI-powered content generation allows the development of diverse test items and personalized assessments, making high-quality assessments more affordable and accessible. However, a careful balance is needed between technological progress and human-centered design. This presentation emphasizes the need for interdisciplinary collaboration and presents the human-centered AI framework, integrating AI with human expertise for assessments that adapt to students’ testing goals. It also describes the new multimodal and integrated items developed with AI for the Duolingo English Test, a digital-first, high stakes language test.