Assessment Materials Online

Assessment research has some key messages for education practitioners.  In this series, we speak to experts from academia and practice to identify the central issues and provide some top tips on assessment matters.

Please feel free to share the links widely.

 

1)  Understanding Formative Assessment & Giving Good Feedback

In this film we hear from Professor Gordon Stobart (UCL), Associate Professor Victoria Elliott (Oxford University), Daisy Christodoulou (No More Marking), and Natalie Usher (Oxford University). They discuss the importance of formative assessment and how to give students good feedback. (23 mins)

To cite this video:

Oxford University Centre for Educational Assessment. (2024). Formative Assessment and Good Feedback [Video]. Vimeo. https://vimeo.com/943679625

A follow-up reading for practitioners:

Boyd, E., Green, A., Hopfenbeck, T.N. and Stobart, G. (n.d.) Effective Feedback: the key to successful Assessment for Learning. Oxford University Press.

Some references mentioned in the video:

Johnston, P. (2023). Choice words: How our language affects children’s learning. Routledge. https://doi.org/10.4324/9781032680835

Gamlem, S. & Smith, K. (2013) Student perceptions of classroom feedback. Assessment in Education: Principles, Policy and Practice, 20(2), 150-169 https://doi.org/10.1080/0969594x.2012.749212

Boud, D. & Molloy, E. (2013). Feedback in higher and professional education: understanding it and doing it well. Routledge. https://doi.org/10.4324/9780203074336

Winstone, N. E. & Carless, D. (2018). Designing effective feedback processes in higher education: a learning-focused approach. London: Routledge. https://doi.org/10.4324/9781351115940

Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43 (8), 1315-1325 https://doi.org/10.1080/02602938.2018.1463354

 

2)  Marking and mark schemes

Here, we hear from Associate Professor Michelle Meadows (Oxford University), Dr Ed Wolfe (Pearson) and Anne Pinot de Moira (Consultant). They discuss the importance of marking reliability, problems in producing it and ways of making assessment more reliable, including through good mark scheme design. (35 mins)

To cite this video:

Oxford University Centre for Educational Assessment. (2024). Marking and mark schemes [Video]. Vimeo. https://vimeo.com/949058668

A follow-up reading for practitioners:

Tisi J., Whitehouse, G., Maughan S. and Burdett, N. (2013). A Review of Literature on Marking Reliability Research (Report for Ofqual ). Slough: NFER.

Some references mentioned in the video:

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association https://www.testingstandards.net/open-access-files.html

Rhead, S. & Black, B. (2018). Marking consistency metrics – an update. Ofqual report. https://assets.publishing.service.gov.uk/media/5bfbfd70e5274a0fb775cca3/Marking_consistency_metrics_-_an_update_-_FINAL64492.pdf

Fearnley, A. (2005). An investigation of targeted double marking for GCSE and GCE. AQA paper produced for the National Assessment Agency. https://dera.ioe.ac.uk/id/eprint/9450/1/QCDA104979_an_investigation_of_targeted_double_marking_for_GCSE_and_GCE.pdf

Wolfe, E. W. & Wendler, C. L. (2020). Why should we care about human raters? Applied Measurement in Education, 33(3), 189-190. https://doi.org/10.1080/08957347.2020.1750407

 

3)  Validity of assessment

On arguably the most important topic in assessment, Professors Gordon Stobart (UCL), Dylan Wiliam (UCL), Tom Haladyna (Arizona State University) and Jennifer Randall (University of Michigan) cut through the complex literature on the validity of assessment scores and give us their views on what matters. (39 mins)

To cite this video:

Oxford University Centre for Educational Assessment. (2024). Validity of assessment [Video]. Vimeo. https://vimeo.com/954723837

A follow-up reading for practitioners:

Newton, P. E. (2016). Macro- and micro-validation: Beyond the ‘Five sources’ framework for classifying validation evidence and analysis. Practical Assessment, Research & Evaluation, 21, 12. Retrieved from

Fischer, C., Pardos, Z. A., Baker, R. S., Williams, J. J., Smyth, P., Yu, R., Slater, S., Baker, R., & Warschauer, M. (2020). Mining Big Data in Education: Affordances and Challenges. Review of Research in Education, 44(1), 130–160. https://doi.org/10.3102/0091732X20903304

Some references mentioned in the video:

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. https://www.testingstandards.net/open-access-files.html

Messick, S. (1989). Validity. In R. Linn (Ed.) Educational Measurement (3rd ed., pp13-104). Macmillan Publishing Group. https://doi.org/10.1111/j.1745-3992.1995.tb00881.x

Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational measurement: issues and practice, 25(4), 6-20. https://doi.org/10.1111/j.1745-3992.2006.00075.x

Almond, R., Steinberg, L., & Mislevy, R. (2002). Enhancing the design and delivery of assessment systems: A four-process architecture. The Journal of Technology, Learning and Assessment, 1(5) https://ejournals.bc.edu/index.php/jtla/article/view/1671/1509

Solano-Flores, G. (2023). How serious are we about fairness in testing and how far we willing to go? A response to Randall and Bennett with reflections about the standards for educational and psychological testing. Educational Assessment 28(2), 105-117. https://doi.org/10.1080/10627197.2023.2226388

Randall, J., Slomp, D., Poe, M., & Oliveri, M. E. (2022). Disrupting white supremacy in assessment: Towards a justice-oriented, antiracist validity framework. Educational Assessment, 27(2), 170-178. https://doi.org/10.1080/10627197.2022.2042682

Combining different assessment types for greater insights. Blog by Daisy Christodoulou on 28 September 2023 (QR code given). https://substack.nomoremarking.com/p/using-innovative-assessments-to-improve.

 

4)  Digital assessment

What are the promises of digital assessment and have they been delivered? Professors Rebecca Eynon (Oxford University), Alina von Davier (Duolingo), and Art Graesser (University of Memphis) address these issues and discuss the future of digital assessment. (30 mins)

To cite this video:

Oxford University Centre for Educational Assessment. (2024). Digital assessment [Video]. Vimeo. https://vimeo.com/976527870.

A follow-up reading:

Fischer, C., Pardos, Z. A., Baker, R. S., Williams, J. J., Smyth, P., Yu, R., Slater, S., Baker, R., & Warschauer, M. (2020). Mining Big Data in Education: Affordances and Challenges. Review of Research in Education, 44(1), 130–160. https://doi.org/10.3102/0091732X20903304

Some references mentioned in the video:

Shute, V. J. (2011) Stealth Assessment in Computer-Based Games to Support Learning in Computer Games and Instruction, Information Age Publishing https://myweb.fsu.edu/vshute/pdf/shute%20pres_h.pdf  

Ofqual (2020) Online and on-screen assessment in high stakes, sessional qualifications: a review into the barriers to great adoption and how these might be overcome. Ofqual. https://assets.publishing.service.gov.uk/media/5fd361b7e90e0766326f7f6e/Barriers_to_online_111220.pdf 

***************************************************************************************************

This video series was funded by Oxford University’s Teaching Development and Enhancement fund. Further members of the project team: Ali Ahmed, Warda Arif and Jonathan Tridgell.

***************************************************************************************************

You might also like to see our bitesize podcasts on standard-setting for GCSEs.