Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
Please note that all times are shown in the time zone of the conference. The current conference time is: 19th Aug 2026, 20:18:33 EET
|
Daily Overview |
| Session | ||
09 SES 13 B: Teacher and Classroom Effects in International Large-Scale Assessments
Paper Session | ||
| Presentations | ||
09. Assessment, Evaluation, Testing and Measurement
Paper Changes in Classroom Composition and Teacher Outcomes in Nordic Countries: A Trend Analysis of TALIS 2018 and 2024 1: University of Oslo, Norway; 2: Aarhus University, Denmark Presenting Author:Nordic education systems have long been associated with equity, social cohesion, and a strong commitment to providing equal learning opportunities for all students (Blossing et al., 2014; Imsen et al., 2017). Educational equity, understood as ensuring fair access to learning regardless of students’ background and providing learners with what they need, remains a core principle of this model (Levinson et al., 2022). Over recent decades, however, demographic change driven by migration, refugee movements, and broader social transformations has reshaped student populations and the everyday conditions of teaching, particularly in urban contexts (Brussino et al., 2021; OECD, 2023). Classrooms are becoming more heterogeneous along multiple dimensions, including students’ migration background, ethnicity, special educational needs, and socio-economic circumstances (Nilsen et al., 2025; Olsen & Hanssen, 2024; Teig et al., 2024). Rising socioeconomic and ethnic inequalities in student outcomes, alongside increasing school segregation by migration background, academic achievement, and socioeconomic status further contribute to this complexity in the Nordic countries (Nilsen et al., 2025; Sandsør et al., 2023; Yang Hansen et al., 2025). RQ1: How have teachers’ workload, well-being, job satisfaction with the school environment, need for professional development for teaching for diversity and student behaviour stress changed from 2018 to 2024 in each of the Nordic countries? RQ2: Among outcomes that exhibit change over time, to what extent are these changes associated with changes in classroom composition? Methodology, Methods, Research Instruments or Sources Used We use data from the two most recent TALIS cycles (2018 and 2024) in four Nordic countries: Denmark, Finland, Norway, and Sweden. TALIS employs a stratified two-stage probability sampling design to obtain nationally representative samples of lower secondary teachers and principals. Further details on the sampling design are provided in the TALIS technical report (OECD, forthcoming). The final sample in this study includes 11788 teachers in 2018 and 11713 teachers in 2024. Data from the two cycles were combined into a single dataset including a dummy variable for the TALIS cycle/time (1 = 2018, 2 = 2024). Teacher outcomes (workload, well-being, job satisfaction with the school environment, need for professional development for teaching for diversity, student behaviour stress) were assessed using established TALIS scales that include three or four items each, all rated on a four-point Likert-type scale reflecting degree or extent. Classroom composition was measured using teachers’ estimates of the proportion of students in the class with selected characteristics (students whose first language is different from the language of instruction, low academic achievers, students with special needs, students with behavioral problems, socio-economic disadvantaged students, and students who are refugees), reported on a five-category percentage scale. Response categories were harmonized across 2018 and 2024. Data were prepared in R version 4.5.2, and analyses were conducted in Mplus 8.11 (Muthen & Muthen, 2017; R Core Team, 2025). The hierarchical structure of teachers nested within schools was addressed using TYPE = COMPLEX with schools as the clustering variable, and teacher weights were applied. The study follows a repeated cross-sectional trend design rather than a longitudinal design. This means that different teachers are surveyed in each country at each time point, but both samples were representative of teachers at the level of the country. Analyses include several steps. CFA and multigroup CFA are used to assess reliability and measurement invariance of each latent construct across 2018 and 2024. A mediation SEM framework is used to examine whether changes in classroom composition account for observed changes in teacher outcomes, inspired by prior work on system-level changes using repeated cross-sectional designs (e.g., Gustafsson & Nilsen, 2016). Initial models estimated changes in outcomes and mediators over time. For outcomes that changed, we tested whether classroom composition mediated these changes, accounting for the sampling design and clustering. Conclusions, Expected Outcomes or Findings Preliminary results show stable job satisfaction and workload across Nordic countries from 2018 to 2024 while teacher well-being worsened only in Norway and Finland. At the same time, student behavioral stress and teachers’ need for professional development increased similarly across the four Nordic countries. We also found differences across the countries in terms of changes in classroom composition. Denmark and Finland saw increases in low-achieving students, students with special needs, and students with behavioral problems, while other categories remained stable. Norway showed increases across all categories, and Sweden only in low-achieving students. Some categories changed together, due to positive, moderate correlations between them e.g., low-achieving students and students with special needs and students with behavioral problems. Preliminary mediation analyses, examining the role of low-achieving students only, indicate that these changes partially accounted for the increase in teachers’ student behavioral stress in Denmark (β = 0.017, p = .027), Finland (β = 0.014, p < .001), and Norway (β = 0.031, p < .001), but not in Sweden (β = 0.010, p = .087). These findings align with prior research suggesting that classroom heterogeneity can contribute to teacher stress, though other factors are also involved. Similarly, changes in low-achieving students partially explained declines in teacher well-being in Norway (β = 0.025, p < .001) and Finland (β = 0.007, p = .002), indicating that classroom composition contributed modestly to reductions in well-being. However, the majority of the decrease in teacher well-being occurred independently of classroom composition, suggesting that other factors, such as workload, instructional challenges, or broader organizational conditions, also play an important role. Further analyses are ongoing and will examine the full set of mediators and outcomes, enabling a more comprehensive understanding of how evolving classroom heterogeneity shapes teacher well-being, professional development needs, and stress across the Nordic countries References Blossing, U., Imsen, G., & Moos, L. (2014). Schools for All: A Nordic Model. The Nordic Education Model, 231–239. https://doi.org/10.1007/978-94-007-7125-3_13 Brussino, O., Cerna, L., Mezzanotte, C., Rutigliano, A., Santiago, P., Borgonovi, F., & Guthrie, C. (2021). Promoting inclusive education for diverse societies: A conceptual framework. https://doi.org/10.1787/94ab68c6-en Gustafsson, J. E., & Nilsen, T. (2016). The Impact of School Climate and Teacher Quality on Mathematics Achievement: A Difference-in-Differences Approach. In T. Nilsen & J.-E. Gustafsson (Eds.), Teacher Quality, Instructional Quality and Student Outcomes: Relationships Across Countries, Cohorts and Time (pp. 81–95). Springer International Publishing. https://doi.org/10.1007/978-3-319-41252-8_4 Imsen, G., Blossing, U., & Moos, L. (2017). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 61(5), 568–583. https://doi.org/10.1080/00313831.2016.1172502 Levinson, M., Geron, T., & Brighouse, H. (2022). Conceptions of Educational Equity. AERA Open, 8, 23328584221121344. https://doi.org/10.1177/23328584221121344 Muthen, L. K., & Muthen, B. (2017). Mplus Version 8 User’s Guide. Muthen & Muthen. Nilsen, T., Senden, B., Ye, W., Jentsch, A., Teig, N., & König, J. (2025). Mathematics teaching quality in classrooms of different compositions in Norway. ZDM – Mathematics Education. https://doi.org/10.1007/s11858-025-01722-y OECD. (2023, January 30). Equity and Inclusion in Education: Finding Strength through Diversity. OECD; OECD Publishing. https://doi.org/10.1787/e9072e21-en OECD. (forthcoming). Teaching and Learning International Survey (TALIS) 2024 Technical Report. OECD Publishing. Olsen, K., & Hanssen, N. B. (2024). The new Norwegian Education Act as arrangements for inclusive education practices for students with SEN: The vanishing concept of the Nordic model? European Journal of Special Needs Education, 39(6), 913–927. https://doi.org/10.1080/08856257.2024.2425513 R Core Team. (2025). R: A Language and Environment for Statistical Computing. In R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/ Sandsør, A. M. J., Zachrisson, H. D., Karoly, L. A., & Dearing, E. (2023). The Widening Achievement Gap Between Rich and Poor in a Nordic Country. Educational Researcher, 52(4), 195–205. https://doi.org/10.3102/0013189X221142596 Teig, N., Nilsen, T., & Hansen, Y. H. (2024). Teaching Quality, Limitations to Teaching, and Their Links to Student Achievement: Insights from Nordic Primary Schools. In IEA Compass: Briefs in Education (IEA). Weintraub, E. C. (1997). Competitive or Collaborative? The Heterogeneous Classroom. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 70(3), 157–159. https://doi.org/10.1080/00098655.1997.10543917 Yang Hansen, K., Patsis, P., & Gustafsson, J.-E. (2025). How does school composition mitigate socioeconomic and ethnic gaps in students’ achievement in Sweden: A long-term trend between 1988 and 2020. Educational Review, 0(0), 1–26. https://doi.org/10.1080/00131911.2025.2599761 09. Assessment, Evaluation, Testing and Measurement
Paper Classroom Composition and Learning Gains: Findings Based on the TALIS Video Study Data 1: Dalarna University, Sweden; 2: Uppsala University; Sweden; 3: Jönköping University, Sweden; 4: Mälardalen University, Sweden Presenting Author:In educational settings, a central question is whether the collective class characteristics influence individual student achievement over and above students’ own characteristics (Televantou et al., 2015). These influences are commonly referred to as compositional effects (e.g., Becker et al., 2022). The effects are detected by aggregating student characteristics, such as prior achievement or socioeconomic status, to classroom or school level and estimating whether the aggregated measures influence the individual outcomes after controlling for the student-level variable on which aggregation is based (Lüdtke et al., 2008; Televantou et al., 2015). Findings on composition effects of class-average prior achievement are, however, inconsistent. While many studies report positive composition effects (e.g., Nilsen et al., 2025; Stäbler et al., 2017), others find none (e.g., Dicke et al., 2026), and effect sizes vary widely and are sensitive to model specification (e.g., Becker et al., 2022; Televantou et al., 2015). One reason for this inconsistency is that composition effects are defined as the difference between within-class and between-class achievement relations, both of which are distorted when prior achievement is measured with error. Standard multilevel models may overestimate composition effects because they ignore both measurement error and sampling bias (Marsh et al., 2009). Prior research shows that composition effects are sensitive to selection bias and measurement error (Becker et al., 2022; Marsh et al., 2009, 2023). Selection bias arises when models fail to adequately capture important aspects of student composition, causing between-class differences to reflect preexisting individual differences rather than true contextual effects. Becker et al. (2022) demonstrate that controlling for prior achievement substantially reduces this bias and that including covariates, such as socioeconomic background and migration status, further attenuates estimated composition effects. Measurement error introduces a second source of bias. When achievement is measured unreliably, multilevel models tend to underestimate individual-level effect and, as a result, overestimate the group-level effect because the regression coefficient for the aggregated score picks up variance left unexplained due to measurement error. Becker et al. (2022) show that correcting for measurement error reduces spurious inflation of composition effects, whereas correcting for sampling error in class means prevents underestimation due to imperfect aggregation. Against this background, the present study builds on this line of research by estimating a sequence of three multilevel models that impose progressively stronger corrections for measurement error and aggregation bias. Applying this methodological approach allows us to assess the models across multiple national contexts. In this respect, the study contributes by extending and validating the method beyond a single-country setting. In addition, as socioeconomic and demographic sorting into classrooms can produce biased composition effects, we estimate three additional models where student-level and class-level background controls are introduced incrementally, to distinguish peer achievement effects from contextual SES composition. In the present study, we address the following research question: What is the magnitude of composition effects, and how does accounting for measurement error alter these estimates? Methodology, Methods, Research Instruments or Sources Used The study utilizes data from the TALIS Video Study 2018, which links mathematics teachers and students across eight countries/jurisdictions (Chile, Colombia, England, Germany, Japan, Madrid, Mexico, and Shanghai) during a common instructional unit (quadratic equations). Excluding Japan and Shanghai because of ceiling effects in these countries, we analyse student data from six school systems, comprising 12440 students nested in 478 classrooms. Based on our interest for national variation in composition effects, we analyze each country separately. Student achievement was measured using a pre-test assessing foundational mathematical and algebraic skills and a post-test measuring students’ ability to solve quadratic equations and apply these methods in problem-solving contexts. Pre-test scores are used as predictors of post-test outcomes. To assess the robustness of within- and between-classroom associations, we employed a staged multilevel structural equation modeling strategy implemented in R that progressively accounts for measurement error and aggregation bias. Measurement reliability was estimated separately by country using IRT-based standard errors and used to fix error variances in subsequent models. Because the relative performance of the model specifications we test depends on sampling and measurement conditions, particularly when nearly all students in a class are sampled (Becker et al., 2022), we estimated all three models for comparison. First, we estimated a doubly-manifest (DM) multilevel regression model in which both pre-test and post-test scores were treated as observed variables. Student-level pre-test scores were cluster-mean centered to estimate within-classroom effects, while classroom means of prior achievement were included to estimate between-classroom (compositional) effects. This model ignores measurement error in both achievement constructs. Second, we estimated a latent-measurement/manifest-aggregation (LM/MA) model. At within-level, pre-test and post-test achievement were modeled as latent variables to correct for individual-level measurement error, while at between-level, classroom means were treated as observed aggregates. This model isolates the impact of student-level unreliability, so differences between DM and LM/MA estimates primarily reflect correction for measurement error at within-level. Third, we estimated a doubly-latent multilevel structural equation model (DLM) in which both student-level achievement and classroom-level composition were modeled as latent variables. At between-level, residual variances of class-level achievement were fixed to zero, representing true classroom means. In a final step, student-level controls were introduced incrementally to the LM/MA and the DLM models. In Model 1, gender and immigration background were included at within-level. In Model 2, parental education and home-resources were additionally included at within-level. In Model 3, parental education and home-resources included at between-level. Conclusions, Expected Outcomes or Findings Our findings show that estimates differed systematically across models. Within-class effects increased from DM to LM/MA in all countries, consistent with attenuation due to measurement error at the student level. Between-class effects were more sensitive to model specification. Across countries, between-level estimates in the LM/MA were substantially reduced once within-level measurement error was accounted for. In contrast, DLM yielded larger between-level estimates than both the DM and LM/MA, consistent with corrections for aggregation bias and sampling error in class means. The DLM produced large and consistently significant between-level effects, ranging from 0.66 to 0.95. Indicating that, once measurement error and aggregation bias are addressed, compositional effects are substantial and comparable in magnitude to individual-level effects. This pattern remained after inclusion of control variables. Interestingly, the socioeconomic status explained little of the between-class achievement differences once prior achievement was controlled. This indicates that although SES-associated segregation is common, accounting for prior knowledge captures the compositional effect that may be associated with SES. Despite the inclusion of covariates, residual confounding cannot be ruled out. Because the TALIS video study did not use a randomized design, unobserved factors, such as school organizational characteristics, may remain correlated with class-average achievement and bias estimated compositional effects. Furthermore, tracking structures were not included in the data, and some observed between-class differences may therefore reflect tracking mechanisms rather than classroom composition per se. References Becker, M., Kocaj, A., Jansen, M., Dumont, H., & Lüdtke, O. (2022). Class-average achievement and individual achievement development: Testing achievement composition and peer spillover effects using five German longitudinal studies. Journal of Educational Psychology, 114(1), 177–197. https://doi.org/10.1037/edu0000519 Dicke, T., Marsh, H.W., Parker, P.D., Pekrun, R., Guo, J., Basarkod, G., Televantou, I., Teuber, Z. (2026). Investigating the effects of class average achievement: attending a high-achieving class is neither beneficial for student achievement nor for academic self-concept, Contemporary Educational Psychology, 84. https://doi.org/10.1016/j.cedpsych.2025.102441 Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies. Psychological methods, 13(3), 203–229. https://doi.org/10.1037/a0012869 Marsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & Nagengast, B. (2009). Doubly-Latent Models of School Contextual Effects: Integrating Multilevel and Structural Equation Approaches to Control Measurement and Sampling Error. Multivariate behavioral research, 44(6), 764–802. https://doi.org/10.1080/00273170903333665 Stäbler, F., Dumont, H., Becker, M., & Baumert, J. (2017). What Happens to the Fish’s Achievement in a Little Pond? A Simultaneous Analysis of Class-Average Achievement Effects on Achievement and Academic Self-Concept. Journal of Educational Psychology, 109(2), 191–207. https://doi.org/10.1037/edu0000135 Televantou, I., Marsh, H. W., Kyriakides, L., Nagengast, B., Fletcher, J., & Malmberg, L.-E. (2015). Phantom effects in school composition research: consequences of failure to control biases due to measurement error in traditional multilevel models. School Effectiveness and School Improvement, 26(1), 75–101. https://doi.org/10.1080/09243453.2013.871302 09. Assessment, Evaluation, Testing and Measurement
Paper Out-of-field Teaching Effects on Instructional Quality and Student Mathematics Outcomes: Evidence from TIMSS 2023 Austria University College of Teacher Education Upper Austria, Austria Presenting Author:Out-of-field (OOF) teaching –when teachers are assigned to subjects outside their formal area of training – has become widespread internationally (Price et al., 2019). While often used to address shortages of subject-qualified teachers, OOF teaching raises concerns about instructional quality (Hobbs & Porsch, 2021; Porsch & Whannell, 2019). Assuming that subject-specific teacher training leads to the development of specific pedagogical and content knowledge (Baumert et al., 2010), differences arise between OOF and in-field teachers. OOF teachers miss certain important learning opportunities; the resulting lack of knowledge of OOF teachers may impact their quality of teaching and instructional practice (Goos & Guerin, 2022) as knowledge (particularly in mathematics) is the foundation of effective teaching and good pedagogy (Goos et al., 2020). Further, in terms of specific knowledge domains in mathematics, research reveals a lower level of algebra knowledge of OOF teachers compared to the algebra knowledge of in-field teachers (Osei & Agyei, 2023). In line with this assumption, OOF teachers frequently encounter challenges when bridging complex concepts, connecting content to students’ prior knowledge, and addressing diverse learning needs (Du Plessis, 2015). They also tend to focus their instruction on students with average performance, as the knowledge required to assist weaker or higher-performing students is not always adequately developed in such teachers (Du Plessis, 2015). Notably, OOF teachers often rate their own teaching quality as low (Porsch & Wilden, 2022) and heavily rely on textbooks for instruction (Du Plessis, 2013; Napier et al., 2020). In the field of mathematics, OOF teachers possess more direct transmission beliefs and teacher-centered teaching methodologies (Lane & Ní Ríordáin, 2020). However, evidence regarding the effects of OOF teaching on student achievement remains unclear, partly due to methodological and conceptual heterogeneity across studies (Porsch & Whannell, 2019). Moreover, little is known about whether teaching experience can compensate for limited formal subject preparation, and whether OOF teaching affects not only cognitive outcomes but also motivational outcomes such as students’ interest in mathematics. In Austria, OOF teaching is common practice in lower secondary education, especially in non-academic school tracks (Sengschmid et al., 2025). Yet empirical evidence on its effects on instructional quality, student performance, and motivation is scarce. Addressing this gap, the present study investigates the role of OOF teaching in lower secondary mathematics education in Austria, drawing on data from the 2023 cycle of the Trends in International Mathematics and Science Study (TIMSS) 2023. The study examines both direct and indirect effects of OOF teaching on students’ mathematics achievement and interest in mathematics. Instructional quality is conceptualized as a potential mediating mechanism, while teaching experience is considered as a moderator that may reduce or enhance the impact of OOF teaching. Instructional quality is operationalized through three core dimensions: clarity of instruction, cognitive activation, and classroom management. Given the pronounced structural differences between academic (AHS) and non-academic (MS) lower secondary schools in Austria, and the uneven distribution of OOF teaching across these tracks, analyses are conducted separately by school-type. The central research questions are:
Methodologically, the study employs multilevel structural equation modeling to account for the nested data structure and to simultaneously model direct and indirect effects. Instructional quality is modeled as classroom-level latent constructs based on student reports. Bayesian Markov Chain Monte Carlo estimation is applied to address missing data and estimation uncertainty. By jointly considering cognitive and motivational outcomes within a differentiated by school-type, this study contributes to a nuanced understanding of the implications of OOF teaching. Methodology, Methods, Research Instruments or Sources Used Data and Sample: The analyses are based on data from the Austrian sample of the 2023 Trends in International Mathematics and Science Study (TIMSS). TIMSS assesses eighth-grade students’ mathematics achievement using standardized tests and collects contextual information at the student, teacher, and school levels. The Austrian TIMSS sample is representative of lower secondary education and allows for differentiated analyses by school type. Because OOF teaching is not evenly distributed across school types in Austria—and because student achievement differs substantially between them—all analyses were conducted separately for academic and non-academic lower secondary schools. In non-academic schools, mathematics instruction is often shared by more than one teacher. To ensure a clear attribution of instructional quality to a specific teacher, the sample was restricted to classes taught by one single mathematics teacher. In addition, teachers instructing groups with fewer than five students were excluded to avoid unstable estimates. After applying these restrictions, the final analytical sample comprised 1,389 students in 109 classes in non-academic schools and 2,251 students in 98 classes in academic schools, resulting in a total of 4,629 students from 157 schools. Measures Student achievement in mathematics was measured using TIMSS plausible values. Students’ interest in mathematics was assessed using the TIMSS scale “Students Like Learning Mathematics.” Teaching quality was assessed via student questionnaires and modeled as latent classroom-level constructs, including clarity of instruction, cognitive activation, and classroom management. Teachers’ OOF status was operationalized based on their reported formal education in mathematics. Teaching experience (BTBG01) was included as a main effect as well as in interaction with OOF teaching to assess whether experience moderates potential OOF effects. Additional control variables were included at the student, teacher, and school levels, including indicators of socioeconomic background. Analytical Strategy Given the multilevel structure of the data and substantial missingness – particularly in the teacher education variable – fully Bayesian Markov Chain Monte Carlo (MCMC) estimation was applied using Blimp 4 (Enders et al., 2020). This approach is well suited for multilevel, mixed-type data and allows for principled handling of missingness. Multilevel SEMs were estimated to examine direct effects of OOF teaching on student outcomes, effects on instructional quality, and indirect effects mediated by instructional quality. Models predicting mathematics achievement were estimated separately for each plausible value and combined following procedures analogous to multiple imputation. Bayesian credible intervals and probabilities of direction were used to assess the strength and uncertainty of estimated effects. Conclusions, Expected Outcomes or Findings This study examined the role of out-of-field teaching in lower secondary mathematics education in Austria, focusing on both cognitive (achievement) and motivational (interest) outcomes, considering instructional quality and teaching experience as key mechanisms. Across models and school types, the evidence for pronounced OOF effects is limited and characterized by uncertainty, indicating that OOF teaching on its own is not a strong determinant of students’ outcomes. For mathematics achievement, no substantial direct effects of OOF teaching were found. Instructional quality showed only weak and statistically uncertain associations with achievement. In AHS, OOF teaching was weakly negatively associated with achievement, but this relationship tend to be moderated by teaching experience and is largely offset by small, imprecise indirect effects via instructional quality. In MS, achievement was more strongly related to students’ socioeconomic background and class composition than to OOF teaching or instructional quality, highlighting the dominant role of contextual factors in this school track. Patterns differed for students’ interest in mathematics. In AHS, OOF teaching showed a tentative total positive association with math interest, although this effect weakened with increasing teaching experience and remained uncertain. In MS, instructional quality emerged as a more relevant predictor—instructional clarity and classroom management positive, cognitive activation negative—of math interest, while OOF teaching showed no meaningful total association. Overall, the findings caution against simplistic narratives that equate OOF teaching with systematically lower student outcomes. While OOF teaching in Austria does not appear to substantially disadvantage student achievement, it may relate to motivational outcomes in school-type-specific ways. Policy efforts should therefore move beyond a narrow focus on reducing OOF teaching and instead emphasize targeted professional support for teachers and, crucially, the reduction of persistent socioeconomic inequalities between students and schools. References References Baumert, J., & Kunter, M. (2013). The COACTIV Model of Teachers’ Professional Competence. In M. Kunter (Ed.), Cognitive activation in the mathematics classroom and professional competence of teachers: Results from the COACTIV project (Vol. 8, pp. 25–48). Springer. https://doi.org/10.1007/978-1-4614-5149-5_2 Du Plessis, A. E. (2015). Effective education: Conceptualising the meaning of out-of-field teaching practices for teachers, teacher quality and school leaders. International Journal of Educational Research, 72, 89–102. https://doi.org/10.1016/j.ijer.2015.05.005 Hobbs, L., & Porsch, R. (2021). Teaching out-of-field: challenges for teacher education. European Journal of Teacher Education, 44(5), 601–610. https://doi.org/10.1080/02619768.2021.1985280 Napier, J. B., Luft, J. A., & Singh, H. (2020). In the Classrooms of Newly Hired Secondary Science Teachers: The Consequences of Teaching In-field or Out-of-field. Journal of Science Teacher Education, 31(7), 802–820. https://doi.org/10.1080/1046560X.2020.1800195 Porsch, R. (2016). Fachfremd unterrichten in Deutschland. Definition - Verbreitung - Auswirkungen [Aspects of teacher training and continuing education in mathematics and the natural sciences]. Die deutsche Schule, 108, 9–32. https://doi.org/10.25656/01:25943 Porsch, R., & Whannell, R. (2019). Out-of-Field Teaching Affecting Students and Learning: What Is Known and Unknown. In L. Hobbs & G. Törner (Eds.), SpringerLink Bücher. Examining the Phenomenon of “Teaching Out-of-field”: International Perspectives on Teaching as a Non-specialist (pp. 179–191). Springer Singapore. https://doi.org/10.1007/978-981-13-3366-8_7 Porsch, R., & Wilden, E. (2022). Teaching English Out-of-Field in Primary School: Differences in Professional Characteristics and Effects on Self-Assessed Instructional Quality. In L. Hobbs & R. Porsch (Eds.), Out-of-Field Teaching Across Teaching Disciplines and Contexts (1st ed. 2022, pp. 117–134). University of Limerick. https://doi.org/10.1007/978-981-16-9328-1_6 Sengschmid, E., Weber, C., Helm, C., & Sabitzer, B. (2025). Out-of-field teaching in Austria: A comprehensive analysis of its prevalence at the school, teacher, and subject levels based on TALIS 2018. European Educational Research Journal, Article 14749041251376730. Advance online publication. https://doi.org/10.1177/14749041251376730 09. Assessment, Evaluation, Testing and Measurement
Paper Do Teachers’ Highest Education Level and Subject Major Matter for Students’ Mathematics Achievement?Evidence from TIMSS 2023 and TIMSS Advanced 2015 Durham Univeristy, United Kingdom Presenting Author:Across many education systems, the recruitment of mathematics teachers relies heavily on two easily observed credentials: teachers’ highest education level and subject major (Ingersoll, 2007). These credentials are routinely used as screening criteria in hiring and placement decisions because they are administratively simple and assumed to reflect professional capacity. However, there is no shared or consistent standard for how these two indicators should be interpreted or weighted in practice. Even within the same education system, requirements and preferences can differ across regions and local authorities (Ma et al., 2021). For example, regions may differ in how strictly “major matching” is enforced, whether a Master’s degree is treated as an advantage or a requirement, and whether certain combinations of education level and major are prioritised for particular grades or schools. This creates uncertainty about what these credentials actually capture and whether they are consistently linked to students’ mathematics outcomes. This paper uses international large-scale assessment data to examine how teachers’ formal qualifications relate to individual students’ mathematics achievement. It brings together two TIMSS cycles that capture different stages of mathematics learning: TIMSS 2023 Grade 8 (lower-secondary) and TIMSS Advanced 2015 (students in the final year of secondary schooling who have taken or are taking advanced mathematics, typically around age 18). Using a common modelling strategy across the two datasets, the study examines whether the same teacher qualifications matter in similar ways across stages and whether the combination of teachers’ education level and subject preparation is especially relevant for advanced mathematics. The main aim of this paper is to provide comparative evidence that can help inform mathematics teacher training and entry requirements, and support stage-specific staffing decisions. It does not make causal claims, but it uses international data to examine whether teacher education level and subject major are consistently associated with students’ mathematics achievement. Research questions
Methodology, Methods, Research Instruments or Sources Used This study is a secondary analysis of international large-scale assessment data from TIMSS 2023 (Grade 8) and TIMSS Advanced 2015 (advanced mathematics, final-year secondary). The two datasets are analysed separately, but the modelling strategy is kept as consistent as possible across them by using parallel outcome definitions and a matched set of student-, school-, and teacher-level variables available in both cycles. The unit of analysis is the individual student, linked to their mathematics teacher through the TIMSS student–teacher–school data structure. Student mathematics achievement is the outcome variable. Teachers’ highest education level was coded into four categories: below Bachelor’s, Bachelor’s, Master’s, and Doctorate.TIMSS includes a wide range of specific teacher majors, so teacher subject background was coded using several alternative groupings. The major classifications focus on distinctions between mathematics, mathematics education, and broader education-related fields (including mathematics education within the education category in some specifications). These alternative classifications are implemented through multiple models to examine whether conclusions are sensitive to how subject background is grouped. The analysis has two parts. First, effect sizes are used to describe achievement differences across teacher categories. Cohen’s d is calculated to summarise the magnitude of differences between students taught by teachers with different highest education levels and different subject-major groupings. Second, the main analyses use multiple linear regression with a three-block structure. Block 1 includes student- and school-level background controls and teacher experience. Block 2 adds teacher subject major, operationalised using multiple alternative classifications. Block 3 adds teachers’ highest education level. For each dataset, the study estimates a set of seven models that vary the teacher-major grouping and related specifications, allowing comparison of coefficients and incremental explanatory power (changes in R²) across model variants. The final specifications include interaction models testing whether the association between teachers’ education level and student achievement varies by teachers’ subject major, using education level × major interaction terms. Conclusions, Expected Outcomes or Findings The results show a broadly consistent pattern for teachers’ highest education level, but the relationship is not simply linear. Students taught by teachers with a Master’s degree tend to achieve higher in mathematics with student and school background while teachers with a Doctorate degree does not appear to bring a further advantage. By contrast, teachers’ subject majors show a clear stage-specific pattern. In Grade 8, education-related majors are generally associated with higher achievement, with mathematics education showing the strongest positive association. In the same stage, teachers with mathematics-only majors perform least well, and the combined mathematics-and-education group (Both) is also associated with lower achievement once background factors are taken into account. In TIMSS Advanced, the pattern shifts: the advantage linked to education-related majors becomes weaker, while mathematics-focused majors show a positive association. A plausible interpretation is that lower-secondary mathematics is not necessarily demanding in terms of advanced content, but it can be demanding to teach well. Helping adolescents grasp basic ideas, correct misunderstandings, and stay engaged often depends on clear explanations and effective teaching strategies. By the advanced stage, students are typically more academically selected and already have stronger foundations, so deeper disciplinary preparation may align more closely with the content demands of high-level courses.This contrast suggests that recruitment and staffing criteria may need to be more explicit about the intended teaching stage, rather than assuming that the same credential profile fits both lower-secondary and upper-secondary level. Finally, interaction models provide little evidence of a meaningful combined effect between highest education level and subject major. Any differences across major groups in the association of education level with achievement are small after controls. Overall, these findings describe robust associations rather than causal effects, but they provide comparative evidence to inform discussion about qualification standards and stage-sensitive workforce planning in mathematics. References Ma Yungjun., Li Li., Ru Zhiwin & Li Danhui. (2021) History and reality: review and prospect of primary and secondary school teacher recruitment. Journal of Guangdong University of Education (06),79-89. Ingersoll, R. (2007). A Comparative Study of Teacher Preparation and Qualifications in Six Nations. 47. https://repository.upenn.edu/handle/20.500.14332/8401 | ||
