Resources on the validity of assessment scores.
On arguably the most important topic in assessment, Professors Gordon Stobart (UCL), Dylan Wiliam (UCL), Tom Haladyna (Arizona State University) and Jennifer Randall (University of Michigan) cut through the complex literature on the validity of assessment scores and give us their views on what matters.
To cite this video:
Oxford University Centre for Educational Assessment. (2024). Validity of assessment [Video]. Vimeo. https://vimeo.com/954723837
A follow-up reading for practitioners:
Newton, P. E. (2016). Macro- and micro-validation: Beyond the ‘Five sources’ framework for classifying validation evidence and analysis. Practical Assessment, Research & Evaluation, 21, 12.
Some references mentioned in the video:
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. https://www.testingstandards.net/open-access-files.html
- Messick, S. (1989). Validity. In R. Linn (Ed.) Educational Measurement (3rd ed., pp13-104). Macmillan Publishing Group. https://doi.org/10.1111/j.1745-3992.1995.tb00881.x
- Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for
educational testing. Educational measurement: issues and practice, 25(4), 6-20. https://doi.org/10.1111/j.1745-3992.2006.00075.x - Almond, R., Steinberg, L., & Mislevy, R. (2002). Enhancing the design and delivery of
assessment systems: A four-process architecture. The Journal of Technology, Learning and
Assessment, 1(5) https://ejournals.bc.edu/index.php/jtla/article/view/1671/1509 - Solano-Flores, G. (2023). How serious are we about fairness in testing and how far we willing
to go? A response to Randall and Bennett with reflections about the standards for
educational and psychological testing. Educational Assessment 28(2), 105-117.
https://doi.org/10.1080/10627197.2023.2226388 - Randall, J., Slomp, D., Poe, M., & Oliveri, M. E. (2022). Disrupting white supremacy in assessment: Towards a justice-oriented, antiracist validity framework. Educational Assessment, 27(2), 170-178. https://doi.org/10.1080/10627197.2022.2042682
- Combining different assessment types for greater insights. Blog by Daisy Christodoulou on
28 September 2023 (QR code given). https://substack.nomoremarking.com/p/usinginnovative-assessments-to-improve
