Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
|
Daily Overview |
| Session | ||
09 SES 08 B: Language Assessment, Digital Reading and Reading Interventions
Paper Session | ||
| Presentations | ||
09. Assessment, Evaluation, Testing and Measurement
Paper Effects of Early Language Stays Abroad on the Foreign Language Proficiency of German High School Students 1: University of Vechta, Germany; 2: Institute for Educational Quality Improvement (IQB) at Humboldt-Universität zu Berlin Presenting Author:Extended stays abroad are seen as important opportunities for acquiring and improving a language. One focus of research on study-abroad experiences is the length of stay, indicating that “the longer, the better” (Llanes, 2011, p. 208), although some research also confirms the effectiveness of shorter stays (Yang, 2016). The Council of the European Union (1997) recommends that all students in all member states should start foreign language education as early as possible. Schools support learning a foreign language through exchange programs to provide authentic learning activities and improve students’ language skills. In a student exchange, students attend a school in, for example, an English- or French-speaking country for a certain period of time. During this time, they usually live with a host family. Apart from exchange programs, students have the opportunity to attend language courses abroad during school breaks that are often organized by private institutions. Students spend a school break, e.g., in an English- or French-speaking country and receive instruction focused on developing competence in the target language. Students taking these courses are usually accommodated in hostels and only rarely in host families. Why can parents, students, and teachers expect gains in language proficiency from a stay abroad? Relevant here is the theory of opportunities which provides a convincing basic explanation of why staying abroad as a student may enhance foreign language learning. Carroll (1963) first introduced the idea of “opportunities to learn,” which has been taken up by utilization-of-learning-opportunities models (e.g., Helmke, 2010). The basic assumption is that the greater the amount of (high-quality) opportunities provided, the higher the learning growth will be. However, what is not considered is that learning is a social and interactional process. This implies that it is not solely the utilization of learning opportunities that matters: Relationships with teachers and peers also significantly influence the learning process. Although empirical research on the effects of stays abroad on L2 acquisition has increased in both linguistics and educational science in recent decades, most empirical studies focus on university students. In comparison, less is known about the effectiveness of stays abroad for younger students, in particular students at the lower secondary level, the target group of our study. To our knowledge, the only empirical study focused on the language outcomes of high school students through attendance of study-abroad programs using large-scale assessment data is the study by Hübner et al. (2021) that asked students in Year 13 whether they had studied abroad during their school career. Heinzmann et al. (2025) note that “in comparison to productive skills, the effect of student exchange on receptive skills, such as listening and reading is poorly studied” (p. 809). Thus, the possible effects of language stays on the two receptive skills require further attention. Although the research literature mentions various programs and different forms of language stays, the language gains from the two types, student exchanges and language courses abroad, have not been researched within one study. With regard to different target languages, in particular EFL and FFL, again there are no reliable findings from studies that compared students’ proficiency with a similar background in both languages. In the study to be presented, we focus on Year 9 students enrolled in German high schools (academic school track) and investigate the following research question: Do language stays abroad have a significant beneficial effect on students’ foreign language skills? Under this research question, we investigate the potentially different effects of stays abroad by examining two types of stays abroad (student exchanges and language courses), two different languages (English and French), and two different language domains (reading and listening comprehension). Methodology, Methods, Research Instruments or Sources Used Our analyses are based on data from the IQB Trends in Student Achievement 2015, a study that assessed language proficiency at the end of Year 9 in German (L1) and in the first foreign language. In this study, a total of 31,532 students from all 16 German federal states took achievement tests of EFL between April and June 2015. In addition, during the same time period, achievement tests of FFL were administered to a separate sample of 3,772 students from six German federal states. These six states were selected due to the availability of a sufficient number of schools offering FFL education. In secondary education, the German school system is characterized by relatively fixed school tracks. In each state, several school types leading to different certificates exist in parallel. The school-type “Gymnasium” represents the academic track for students aiming to obtain the “Abitur,” which in Germany is the university entrance certificate. The data shows that it is mainly within this school type that students engage in language stays abroad. For all other school types, case numbers were too small to allow further statistical analyses. For that reason, we restrict our analyses of the effects of language stays abroad to the subsample of students attending a Gymnasium. Hence, the respective samples comprised 13,073 students for EFL and 3,261 for FFL. For both languages, the achievement tests administered within the IQB Trends Study 2015 assessed foreign language proficiency in the domains of reading comprehension (RC) and listening comprehension (LC). In the student questionnaire, the participants were also asked whether they had ever visited a majority English- or French-speaking country. If that was the case, they were requested by means of a multiple-response item and a constructed-response item to provide further information on the purpose (e.g., student exchange, language courses during summer vacation, school trips, living abroad with parents) and the duration of their visits. Based on the students’ responses to these items, we constructed the independent variables for our analyses. In our analysis of the effects of language stays abroad on students’ foreign language proficiency, we employed propensity score matching (PSM; Rosenbaum & Rubin, 1985) to account for the potential bias associated with self-selection in such learning activities. Through PSM, we were able to control for a large number of possibly important covariates and (carefully) draw causal inferences from estimated differences in foreign language proficiency. Conclusions, Expected Outcomes or Findings One notable finding is that participation in language courses has no significant effect on students’ receptive language skills. In particular, we can show that students who have spent time abroad do not have higher proficiency scores than students who have not spent time abroad. This finding may come as a surprise given the extensive market for language courses and the promises made by providers. However, it should be noted that a stay abroad – whether in the form of a student exchange, a vacation trip, or attendance at a language course abroad – offers further potential benefits for students, such as the development of intercultural competence. Furthermore, the advantages of SE learners were more evident for LC than for RC. Our study revealed a larger association of student exchanges with LC than with RC. This is not surprising, considering that living with a host family during a student exchange exposes learners to numerous authentic communication situations, which, above all, require language skills in speaking and listening. These learning opportunities should, hence, especially enhance their oral language proficiency. This study has limitations. In particular, the data are from a cross-sectional study. Students were asked about their previous sojourns in a questionnaire, and their receptive language proficiencies were tested on the same day. Strictly speaking, this design does not allow us to draw conclusions about causal effects. However, we addressed this issue methodologically by using propensity score matching and including relevant covariates in a stepwise procedure. This approach allows us to compare statistically parallelized individuals in terms of whether they have experienced a stay abroad or not. To explore the robustness of our findings, we additionally employed an alternative approach to account for selectivity bias using fixed-effects regression models and obtained very similar results. References Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64(8), 723–733. https://doi.org/10.1177/016146816306400801 Council of Europe. (1997). Council resolution of 16 December 1997 on the early teaching of European Union languages (98/C 1/02). Official Journal of the European Communities, 1, 2–3. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:31998Y0103(01)&from=EN Heinzmann, S., Ferris, C., Roderer, T., & Ehrsam, K. (2025). Student exchange in primary and secondary education and its effect on language gains, intercultural competence and language learning motivation: a systematic review of research in the European context. International Journal of Multilingualism, 22(2), 783–821. https://doi.org/10.1080/14790718.2024.2331609 Helmke, A. (2010). Unterrichtsqualität und Lehrerprofessionalität. Diagnose, Evaluation und Verbesserung des Unterrichts. Schule weiterentwickeln - Unterricht verbessern. Orientierungsband. [Teaching quality and teacher professionalism. Diagnosis, evaluation, and improvement of teaching. Developing schools – improving teaching. Orientation guide]. Klett-Kallmeyer. Hübner, N., Trautwein, U., & Nagengast, B. (2021). Should I stay or should I go? Predictors and effects of studying abroad during high school. Learning and Instruction, 71, Article 101398. https://doi.org/10.1016/j.learninstruc.2020.101398 Llanes, À. (2011). The many faces of study abroad: An update on the research on L2 gains emerged during a study abroad experience. International Journal of Multilingualism, 8(3), 189–215. https://doi.org/10.1080/14790718.2010.550297 Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39(1), 33–38. https://doi.org/10.1080/00031305.1985.10479383 Yang, J.‑S. (2016). The effectiveness of study-abroad on second language learning: A meta-analysis. The Canadian Modern Language Review, 72(1), 66–94. https://doi.org/10.3138/cmlr.2344 09. Assessment, Evaluation, Testing and Measurement
Paper Assessment and Adaptation of the Extramural English Scale in Swedish Context and Its Prediction of English Reading Comprehension Umeå University, Sweden Presenting Author:This study evaluates and adapts the Extramural English (EE) Scale by Sundqvist and Uztosun (2024) and investigates its relationship with English reading comprehension (ERC) among Swedish Scholastic Aptitude Test test-takers (n = 3,787). As English is increasingly integrated in Swedish society from an early age through informal contexts, assessing young peoples’ engagement in EE and understanding its implications for academic achievement is important. The originally proposed eight-factor EE Scale was evaluated through confirmatory factor analysis (CFA). Although the proposed eight-factor model showed a good fit to the data, some items and scales had nonoptimal psychometric characteristics. Therefore, alternative conceptualizations were explored using exploratory factor analysis (EFA) followed by CFA. Results supported a refined five-factor model. Structural equation modeling (SEM) showed that EE Media and EE Internalized positively predicted ERC scores, whereas EE Gaming and EE Social Interaction were not significantly related to ERC. The EE Digital Creativity factor emerged as a negative predictor. Overall, the adapted scale explained 19 % of the variance in ERC scores. This study contributes to the development of a psychometrically robust measure of EE, facilitating more consistent assessment, replication and comparison of EE research findings across populations and contexts. Methodology, Methods, Research Instruments or Sources Used This study uses the EE Scale and SweSAT data from the spring administration of 2025 (n = 3,787). A non-probability purposive sampling method was used, intentionally targeting first-time test takers to answer the questionnaire. EE data were collected through Sundqvist and Uztosun’s (2024) constructed items. However, item response options were altered into a time-based response scale represented by a 5-point Likert scale: 5 = Daily, 4 = Once or a few times per week, 3 = Once or a few times per month, 2 = Once or a few times per year, and 1 = Less often than once per year or never. EE Scale consisted in the following factors: EE Digital Creativity included three items about creating materials to share with others or for oneself in a digital context, whether that would be a video, podcast or music. EE Gaming factor included seven items about playing digital games alone, with others, and watching others play, and focusing on a specific language skill. EE Internalized factor was about three items gathering data about engagement in activities one does alone, such as daydreaming and the presence of inner speech. EE Music included three items about listening to music, reading music lyrics, and singing. EE Niche Activities factor consisted of three items collecting the amount of engagement in activities such as writing fanfiction, playing board games, and learning English. EE Reading and Listening factor included three items measuring receptive language skills, which refer to understand and process language received. EE Social Interaction, in which six items aim to gather data about speaking and writing to others in real life and digital form. EE Viewing factor includes four items collecting information about watching content and following English-speaking content creators. Moreover, ERC SweSAT subtest data were also used, which includes five sentence-completion items and 15 items related to interpreting short text and long texts, and test-takers are expected to identify relevant information rather than isolated details. The complexity relies on the text rather than the questions, which are straightforward and constructed with simple language. Moreover, the material contains an extended range of topics, such as social science, arts, technology, and natural science (Stage & Ögren, 2004). All the analyses were conducted using R, version 4.5.1 (R Core Team, 2025), to compute Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), modification indices (MI), and Structure Equation Modelling (SEM). Conclusions, Expected Outcomes or Findings This research contributes in addressing the persistent lack of a common measure for EE, a gap that has not allowed to efficiently compare results across different linguistic and educational contexts, particularly within high-stakes assessment such as the SweSAT. Findings indicate that while the original EE Scale offers a viable baseline to address the existing issue, an adapted 5-factor model showed an adequate fit for the SweSAT data, and acceptable factor loadings among the items. Additionally, the adapted EE Scale factors predicted ERC scores, explaining 19% of the variance in ERC score, although the impact of EE was not equal across dimensions: viewing, reading, listening, music and internalized related activities were stronger predictors. The shift from the original 8-factor to a 5-factor structure was a result of adapting the scale to SweSAT data. These dimensions suggest that certain EE activities do not have clear boundaries, that is, SweSAT test-takers perceive these as a collective mode of engaging in EE and applying English skills in a similar way. Interestingly, the EE Internalized factor remained in the adapted EE Scale and positively predicted ERC scores. Regarding EE Digital Creativity, all three items loaded in the adapted EE Scale. However, the activities that represent this factor were the least common among test-takers, and negatively predicted ERC scores. This finding requires further investigation on clarifying the application of English in these EE activities. Furthermore, the EE Social Interaction factor displayed lack of significance in predicting ERC scores. Moreover, the EE Gaming factor remained unchanged from the original EE Scale. However, this factor did not significantly predict ERC scores. Additionally, the EE Niche Activities did not load into the model due to low factor loadings, low communalities and high complexity. References Benson, P. (2011). Teaching and researching autonomy in language learning (2nd ed.). Pearson Education. European Commission (2024). Europeans and their languages. Brussels: European Commission. Löwenadler, J. (2023). Trends in Swedish and English Reading Comprehension Ability among Swedish Adolescents: A Study of SweSAT Data 2012–2018. Scandinavian Journal of Educational Research, 67(4), 591–606. https://doi.org/10.1080/00313831.2022.2042841 Malmström, H., Pecorari, D. (2022). Language choice and internationalisation: The roles of Swedish and English in research and higher education. Institute for Language and Folklore. Neagu, T., Eklöf, H., Laukaityte, I., & Wedman, J. (2025). Reading, watching and gaming: exploring the relationships between extramural English activities and academic L2 English reading comprehension in a Swedish university admissions test context. Education Inquiry, 1-16. https://doi.org/10.1080/20004508.2025.2556572 Poole, F. J., & Clarke-Midura, J. (2020). A systematic review of digital games in second language learning studies. International Journal of Game-Based Learning (IJGBL), 10(3), 1-15. http://dx.doi.org/10.4018/IJGBL.2020070101 R Core Team (2025). R: A language and environment for statistical computing. R Foundation for Statistical Computing[Computer software]. Vienna, Austria. https://www.R-project.org/ Stage, C., & Ögren, G. (2004). The Swedish scholastic assessment test (SweSAT). Development, results and experiences. Sundqvist, P. (2009). Extramural English matters: Out-of-school English and its impact on Swedish ninth graders' oral proficiency and vocabulary [Doctoral dissertation, Karlstad University]. http://kau.diva-portal.org/smash/record.jsf?pid=diva2:275141 Sundqvist, P., & Uztosun, M. S. (2024). Extramural English in Scandinavia and Asia: Scale development, learner engagement, and perceived speaking ability. Tesol Quarterly, 58(4), 1638-1665. https://doi.org/10.1002/tesq.3296Digital Object Identifier (DOI) Sundqvist, P., & Wikström, P. (2015). Out-of-school digital gameplay and in-school L2 English vocabulary outcomes. System, 51, 65-76. https://doi.org/10.1016/j.system.2015.04.001 Sylvén, L. K. (2022). Very young Swedish children’s exposure to English outside of school. In C. Bardel, C. Hedman, K. Rejman, & E. Zetterholm (Eds.), Exploring Language Education: Global and Local Perspectives. Stockholm: Stockholm University Press. https://doi.org/10.16993/bbz.e Warnby, M. (2022). Receptive academic vocabulary knowledge and extramural English involvement–is there a correlation? ITL—International Journal of Applied Linguistics, 173(1), 120–152. https://doi.org/10.1075/itl.21021.war 09. Assessment, Evaluation, Testing and Measurement
Paper Does the platform matter? Examining the effect of Paper and Digital L2 Reading on Comprehension and Delayed Recall Rovira i Virgili University, Spain Presenting Author:This experimental study investigates whether the reading platform, digital or paper, and the texts affect university students’ L2 reading comprehension and information retention. From the literature review, it can be seen that while the impact of the two platforms on reading comprehension has received significant attention in research, the results have been inconsistent due to the involvement of other factors, for instance, while some meta-analysis studies of reading comprehension only considered reading comprehension in the first language (e.g, Clinton, 2019), others did not take into account the language of reading comprehension which is either L1 or L2 (Kong et al., 2018; Peras et al., 2023). Furthermore, the genre, the length of the text, as well as other features connected to digital screens (e.g., the interactive mode, animated visuals) and paper (e.g., 2-D pictures) among different studies could affect the results, especially when the two conditions of digital screens and paper were not comparable. Moreover, there is a lack of studies investigating the relationship between the two platforms and learners’ information retention, especially after a period of time. They are the gaps that this study seeks to cover, including to take into account the text as a variable that can influence learners’ information retention besides the platform (paper versus digital). This study was conducted in students using English as a second language, and their English proficiency was from upper-intermediate to advanced levels. The study did not treat L1 or L2 as a variable because only L2 was used for the experiment. Students’ English levels were treated as a part of learners’ differences that can create individual random effects for the study. With the aforementioned purposes and directions, the research questions of the study are the following: Research question 1: Are there any differences between digital and paper platforms in L2 reading comprehension and information retention? Research question 2: Is there a correlation between characteristics of the texts and students’ L2 information retention? Methodology, Methods, Research Instruments or Sources Used Conducted in two phases (April and November 2024) with a total of 46 participants, the study involved reading both literary and informative texts matched for length, difficulty, and readability (assessed via TTR, Maas’s indices, FRE, and Coh-Metrix). Comprehension and retention were evaluated using multiple-choice and cloze tests, and results were analysed using paired samples T-tests and Linear Mixed Models. The instruments were created using the Bloom taxonomy and then validated, applying test-retest to check the reliability and correlation of the results over time. Conclusions, Expected Outcomes or Findings The study found that platforms and the texts did not significantly impact students’ reading comprehension and information retention, especially when the difficulty of texts (grade levels 8 and 7) is much lower than students’ level (undergraduate students). Instead, the random effects from students played a significant role to explain their results. Notably, students who switched reading platforms showed significant information loss over time with a large effect size, whereas those who maintained the same paper reading did not. However, the small sample size and the local context require caution to interprete the study’s results. Cognitive load theory and neuroscientific findings about handwriting versus typing were used to discuss the study’s findings. References Bennett, A.G., Rebello, N.S. (2012). Retention and Learning. In: Seel, N.M. (eds) Encyclopedia of the Sciences of Learning. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-1428-6_664 Chang, W.-C., & Ku, Y.-M. (2015). The effects of note-taking skills instruction on elementary students’ reading. The Journal of Educational Research, 108(4), 278–291. https://doi.org/10.1080/00220671.2014.886175 Clark, R. C., Nguyen, F., & Sweller, J. (2006). Efficiency in learning: evidence-based guidelines to manage cognitive load / Ruth. John Wiley & Sons. Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta‐analysis. Journal of Research in Reading, 42(2), 288–325. https://doi.org/10.1111/1467-9817.12269 Crossley, S. A., Greenfield, J., & McNamara, D. S. (2008). Assessing Text Readability Using Cognitively Based Indices. TESOL Quarterly, 42(3), 475–493. http://www.jstor.org/stable/40264479 de Jonge, M., Tabbers, H.K. & Rikers, R.M.J.P. The Effect of Testing on the Retention of Coherent and Incoherent Text Material. Educational Psychology Review 27, 305–315 (2015). https://doi.org/10.1007/s10648-015-9300-z DuBay, W. H. (2004). The principles of readability. Online submission. European Commission, Directorate-General for Education, Youth, Sport and Culture, (2019). Key competences for lifelong learning, Publications Office. https://data.europa.eu/doi/10.2766/569540 Fernández-Batanero, J. M.; Montenegro Rueda, M.; Fernández Cerezo, J.; Román Gravan, P. (2021). Impact of ICT on writing and reading skills: a systematic review (2010-2020). Texto Livre: Linguagem e Tecnologia, 14(2), 1-12, doi:10.35699/1983-3652.2021.34055 Field, S., Kuczera, M. & Pont, B. (2007) No more Failures: Ten Steps to Equity in Education. Paris: OECD Furenes M. I., Kucirkova N., Bus A. G. (2021). A comparison of children’s reading on paper versus screen: A meta-analysis. Review of Educational Research, 91(4), 483–517. https://doi.org/10.3102/0034654321998074 Goodwin, A. P., Cho, S.-J., Reynolds, D., Brady, K., & Salas, J. (2020). Digital Versus Paper Reading Processes and Links to Comprehension for Middle School Students. American Educational Research Journal, 57(4), 1837 1867. https://doi.org/10.3102/0002831219890300 Gough, P. B., & Tunmer, W. E. (1986). Decoding, Reading, and Reading Disability. Remedial and Special Education, 7(1), 6-10. https://doi.org/10.1177/074193258600700104 Kintsch, W. (1998). Comprehension: A Paradigm for Cognition. New York: Cambridge University Press. Koizumi, R., & In'nami, Y. (2012). Effects of text length on lexical diversity measures: Using short texts with less than 200 tokens. System, 40(4), 522-532. https://doi.org/10.1016/j.system.2012.10.017 Kong, Y., Seo, Y. S., Zhai, L. (2018). Comparison of reading performance on screen and on paper: A meta-analysis. Computers & Education, 123, 138-149, https://doi.org/10.1016/j.compedu.2018.05.005 09. Assessment, Evaluation, Testing and Measurement
Paper Effectiveness of Computerised Reading Programmes on Chinese Primary Pupils' English Reading: A Cluster Randomised Controlled Trial University of Birmingham, United Kingdom Presenting Author:Reading proficiency is essential for developing critical thinking and for pupils' academic success across all subjects. Globally, millions of pupils struggle with basic reading skills, with international assessments revealing persistent gaps in reading achievement (OECD, 2019). In China, although pupils perform strongly in assessments such as PISA and PIRLS, these tests primarily assess reading in Chinese and are administered only in economically advanced regions like Shanghai (OECD, 2020), limiting generalisability to broader populations. For English reading, which has been compulsory in Chinese primary education for over two decades, little robust evidence exists regarding pupils' proficiency or effective instructional approaches. Following China's 2022 English Curriculum Standards, greater emphasis has been placed on reading proficiency and pupil autonomy. However, persistent challenges remain, including limited access to suitable reading materials, ineffective pedagogical approaches, and regional disparities in resources. To address these issues, substantial government investment through initiatives such as the Education Informatisation 2.0 Action Plan (Ministry of Education, 2018) has led schools to increasingly adopt computerised reading programmes. The COVID-19 pandemic further accelerated this digital adoption. Yet many programmes lack independent rigorous evaluation despite strong claims by developers (See & Gorard, 2020), posing risks when schools and parents adopt them uncritically. One widely used programme is Accelerated Reader (AR), deployed in over 50,000 schools across 90 countries, including more than 800 schools in China (Renaissance, 2026). AR is a computerised supplementary reading programme providing guided reading instruction and formative feedback through comprehension quizzes. The theoretical framework underpinning AR is Vygotsky's (1978) zone of proximal development (ZPD), which posits that learning occurs most effectively when instruction is pitched slightly above a learner's current level but within reach with appropriate support. AR operationalises this theory by matching pupils to books at their individual reading levels and providing immediate feedback through quizzes, enabling pupils to progress through increasingly challenging texts. Cambridge Reading Adventures (CRA), a freely accessible alternative offering comparable functions with digital levelled reading materials, serves as a cost-effective comparison in this study. Despite the large number of schools using AR in China, no independent research has been conducted to test its effectiveness among Chinese pupils. Most existing studies were conducted in the US and UK (Gorard et al., 2015; What Works Clearinghouse, 2016), with no rigorous evaluations in non-English speaking countries, limiting generalisability to contexts such as China where English is taught as a foreign language. The purpose of this research is to investigate the impact of AR and CRA on Chinese primary school pupils' English reading achievement and reading behaviour (defined as reading habits and reading attitudes). The main research questions are: (1) What impact do AR and CRA have on Chinese school pupils' reading performance? (2) What is the impact of AR and CRA on Chinese school pupils' reading behaviour (reading attitudes and habits)? (3) How much of the variation in reading performance can be explained by reading behaviours? This research contributes to the international evidence base on computerised reading programmes in non-English speaking contexts. By comparing a commercial programme with a freely available alternative, the findings offer insights relevant to educational policymakers across Europe and beyond who face decisions about technology investments in linguistically diverse classrooms. The study has particular relevance for contexts where English is taught as a foreign language and where resource constraints necessitate cost-effective solutions. Methodology, Methods, Research Instruments or Sources Used This study employed a cluster randomised controlled trial conducted in Chinese public primary schools across four provinces. The main study involved 1,059 pupils in Years 4 to 6 from 21 classes. Ten classes with 469 pupils were randomly allocated to receive the intervention, while 11 classes with 590 pupils served as business as usual controls. An additional non-randomised class with 54 pupils was included to strengthen sample size. Random allocation was conducted at the class level to minimise contamination between treatment and control conditions. The intervention lasted 12 to 13 weeks, during which treatment pupils used either AR or CRA during designated reading sessions. Reading performance was assessed using pre and post tests adapted from the Cambridge English A1 Movers examination (Cambridge English Qualifications, 2023) and the Australian National Assessment Program Literacy and Numeracy reading tests (National Assessment Program, 2023). Using standardised instruments independent of AR's own assessment tools addressed a key methodological limitation identified in previous studies, where measurement bias from programme specific tests compromised validity (Gorard et al., 2015). Reading behaviours were measured through validated questionnaire items: reading habits were assessed using items adapted from PISA 2018 (OECD, 2019) and PIRLS 2021 (Mullis & Martin, 2019), while reading attitudes were measured using the Heathington Attitude Scale (Heathington, 1975). Alongside the impact evaluation, a process evaluation was conducted through classroom observations and semi-structured interviews with teachers and pupils. This component assessed implementation fidelity, identified conditions essential for programme success, and explored mechanisms of change. Intent to treat analysis was employed, with effect sizes calculated using Hedges' g to account for small sample bias. Subgroup analyses examined differential effects by prior attainment, school type, ethnicity, and family socioeconomic status. Compliance analysis assessed the relationship between quiz completion and outcomes. Path analysis explored direct and indirect effects of AR on reading performance via reading behaviours. Conclusions, Expected Outcomes or Findings The findings indicate that both AR and CRA improved Chinese primary pupils' English reading performance compared to business as usual instruction. AR produced an effect size of +0.22, while CRA showed a larger effect of +0.40, though the latter should be interpreted cautiously due to baseline imbalances between groups. These results add to the existing evidence that AR has a positive impact on students' English reading outcomes in English speaking countries (Gorard et al., 2015; What Works Clearinghouse, 2016), while extending this evidence to non-English speaking contexts. Both programmes enhanced pupils' reading habits. However, results for reading attitudes were mixed: AR showed positive effects, while CRA appeared to negatively affect attitudes despite improving reading enjoyment and willingness to read during free time. Compliance analysis demonstrated that programme fidelity matters: pupils completing more quizzes achieved higher reading scores. Path analysis suggested that AR had a direct positive association with reading performance, independent of behavioural pathways, implying that structured comprehension activities may directly enhance attainment. The process evaluation identified essential implementation conditions including adequate teacher preparation, appropriate reading levels, protected reading time, sufficient book availability, and reliable technical infrastructure. These findings offer cautious optimism for computerised reading programmes in EFL contexts whilst suggesting that core pedagogical elements, including appropriate reading levels, pupil choice of reading materials, sufficient independent reading time, and timely teacher feedback, may play a more central role in programme effectiveness than the delivery format itself. For resource constrained contexts common across Europe and beyond, programmes like CRA present a viable free alternative. Future research should examine longer term effects and conduct component analysis to identify which mechanisms drive programme effectiveness. References Cambridge English Qualifications. (2023). A1 Movers preparation: Sample tests. https://www.cambridgeenglish.org/exams-and-tests/movers/preparation/ Gorard, S., Siddiqui, N., & See, B. H. (2015). Accelerated Reader: Evaluation report and executive summary. Education Endowment Foundation. Heathington, B. S. (1975). The development of scales to measure attitudes towards reading [Unpublished doctoral dissertation]. University of Tennessee. Ministry of Education of the People's Republic of China. (2018). Education Informatisation 2.0 Action Plan. http://www.moe.gov.cn/srcsite/A16/s3342/201804/t20180425_334188.html Mullis, I. V. S., & Martin, M. O. (Eds.). (2019). PIRLS 2021 assessment frameworks. TIMSS & PIRLS International Study Center. National Assessment Program. (2023). NAPLAN practice tests. https://www.nap.edu.au/ OECD. (2019). PISA 2018: Insights and interpretations. OECD Publishing. OECD. (2020). Benchmarking the performance of China's education system. OECD Publishing. https://doi.org/10.1787/4ab33702-en Renaissance Learning. (2026). About us. https://renaissance.cn/ See, B. H., & Gorard, S. (2020). Effective classroom instructions for primary literacy: A critical review of the causal evidence. International Journal of Educational Research, 102, 101577. https://doi.org/10.1016/j.ijer.2020.101577 Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press. What Works Clearinghouse. (2016). Accelerated Reader intervention report. Institute of Education Sciences. | ||