Assessing methodological trustworthiness in research
The Project
Research syntheses, by way of systematic reviews and meta-analyses, rely on the quality of the underlying studies; their methodological trustworthiness. Systems for assessing their trustworthiness have been developed, but their reliability needs to be investigated. Here, we trained researchers on the Education Endowment Foundation’s (EEF) padlock tool and the Mixed Methods Appraisal Tool (MMAT) and looked at how reliable their judgements were.
This research is conducted in collaboration with Jonathan Kay (EEF) and Sarah Miller (Queen’s University, Belfast) and Madeleine Masters (Oxford) was one of the Researcher on the project.
This research was funded by the John Fell Fund.
More Projects
-
Progress in International Reading Literacy Study (PIRLS) 2026May 2024 - February 2029The Progress in International Reading Literacy Study (PIRLS) is an international comparative study of the reading literacy of students around 10 years of age.
-
The Future of Curriculum and Assessment in EnglandOctober 2024The Government has set up a Curriculum and Assessment Review to look at national curriculum and statutory assessments from age 5 to 18.
-
OUCEA’s Public EngagementRecent knowledge exchange activities with industry and government include: Jo-Anne Baird is a member of Department for Education’s Curriculum and Assessment Review, chaired by Becky Francis Ofsted’s External Reference Group on Insights and Evidence in Education The British Educational Research Association’s Panel on Educational Research Funding SQA’s Qualifications Committee International Assessment Technical Advisory Group (TAG) for the Department of Education (DBE) in South Africa Michelle Meadows is a member of the Institute of Director’s Assessment Committee Ofqual’s Qualifications Reform Group Ofqual advisor on crisis management and disaster planning Stuart Cadwallader is a member of AQA’s Research Committee Jenni Ingram is a member of the OECD Mathematics Expert Group (MEG) Jenni Ingram, Stuart Cadwallader & Jamie Stiff collaborate with Pearson UK on national reports for PISA25 for England, Wales and Northern Ireland and have done so for previous rounds of Programme for International Student Assessment (PISA) tests Ariel Lindorff and Victoria Elliott are collaborating with Pearson UK on the England national report for PIRLS26 and have done so for previous rounds of the Progress in International Reading Literacy Study (PIRLS)
-
Assessment Materials OnlineMay 2024 - October 2024Assessment research has some key messages for education practitioners.
-
Research on Standards in GCSEs in WalesApril 2024 - April 2024OUCEA has a long history of research on the theory and practice of standard setting, as well as how standards in national qualifications are understood.
-
Introducing standardised testing into the Flanders education systemJuly 2023Strengthening the design and implementation of the standardised student assessment reform of the Flemish Community of Belgium The Flemish Community of Belgium has been a stronger performer on international tests, however, performance has been deteriorating and more students are failing to reach basic proficiency levels than before.
More News
-
NewsProfessor Jo-Anne Baird appointed to panel on national curriculum and assessmentSeptember 2, 2024
-
NewsPodcast released exploring all things assessment in time for A-level results dayAugust 14, 2024
-
NewsOxford University Centre for Educational Assessment and Pearson to conduct Progress in International Reading Literacy Study 2026August 8, 2024
-
Research Centre NewsWatch: Top Tips for Education Practitioners in AssessmentMay 13, 2024
Project Details
Theme: Centre for Educational Assessment; Theme 2: Policy, Economy and Society
More Projects
-
Progress in International Reading Literacy Study (PIRLS) 2026May 2024 - February 2029The Progress in International Reading Literacy Study (PIRLS) is an international comparative study of the reading literacy of students around 10 years of age.
-
The Future of Curriculum and Assessment in EnglandOctober 2024The Government has set up a Curriculum and Assessment Review to look at national curriculum and statutory assessments from age 5 to 18.
-
OUCEA’s Public EngagementRecent knowledge exchange activities with industry and government include: Jo-Anne Baird is a member of Department for Education’s Curriculum and Assessment Review, chaired by Becky Francis Ofsted’s External Reference Group on Insights and Evidence in Education The British Educational Research Association’s Panel on Educational Research Funding SQA’s Qualifications Committee International Assessment Technical Advisory Group (TAG) for the Department of Education (DBE) in South Africa Michelle Meadows is a member of the Institute of Director’s Assessment Committee Ofqual’s Qualifications Reform Group Ofqual advisor on crisis management and disaster planning Stuart Cadwallader is a member of AQA’s Research Committee Jenni Ingram is a member of the OECD Mathematics Expert Group (MEG) Jenni Ingram, Stuart Cadwallader & Jamie Stiff collaborate with Pearson UK on national reports for PISA25 for England, Wales and Northern Ireland and have done so for previous rounds of Programme for International Student Assessment (PISA) tests Ariel Lindorff and Victoria Elliott are collaborating with Pearson UK on the England national report for PIRLS26 and have done so for previous rounds of the Progress in International Reading Literacy Study (PIRLS)
-
Assessment Materials OnlineMay 2024 - October 2024Assessment research has some key messages for education practitioners.
-
Research on Standards in GCSEs in WalesApril 2024 - April 2024OUCEA has a long history of research on the theory and practice of standard setting, as well as how standards in national qualifications are understood.
-
Introducing standardised testing into the Flanders education systemJuly 2023Strengthening the design and implementation of the standardised student assessment reform of the Flemish Community of Belgium The Flemish Community of Belgium has been a stronger performer on international tests, however, performance has been deteriorating and more students are failing to reach basic proficiency levels than before.
More News
-
NewsProfessor Jo-Anne Baird appointed to panel on national curriculum and assessmentSeptember 2, 2024
-
NewsPodcast released exploring all things assessment in time for A-level results dayAugust 14, 2024
-
NewsOxford University Centre for Educational Assessment and Pearson to conduct Progress in International Reading Literacy Study 2026August 8, 2024
-
Research Centre NewsWatch: Top Tips for Education Practitioners in AssessmentMay 13, 2024