Now that you have watched the video, read the relevant sections of the papers by Hoferichter & Jentsch (2024) and Kisida et al. (2020) refer to the EEF’s guidance notes, and make a judgement about the level of threat posed by current interventions in these experiments. Record your judgement in the security rating template, and note down any supporting information.
Open the accordion below to compare your judgement with that of an experienced rater.
There is no information provided in this report about any concurrent interventions and the control condition is not described, other than to say that “students from the same year that took any other class served as control group” (Hoferichter & Jentsch, 2024, p. 2445).
Therefore, this study is considered as having a high risk of bias for Confounding.
There is no information provided in this report about any concurrent interventions. However, based on contextual knowledge we can make the following observations: the intervention was a one-off event, otherwise all participants in both treatment and control schools continued with their usual History and Arts curricula. The stratified random allocation helps reassure us that schools would be balanced in observable and unobservable characteristics, in expectation. As such, any additional interventions are likely to be similar across the sample.
Therefore, this study is considered as having a low risk of bias for Concurrent Interventions.
