Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
|
Daily Overview |
| Session | ||
24 SES 08 A: ***CANCELLED*** Joint Session NW 24 and NW 09
Paper Session | ||
| Presentations | ||
24. Mathematics Education Research
Paper ***WITHDRAWN*** Linguistic Complexity in Digital Mathematics Assessments: Equity and Precision in Measuring Multilingual Learners’ Competence University of Turku, Finland Presenting Author:The increased linguistic diversity in European classrooms has exacerbated equity and assessment validity problems in education. Mathematics assessment tasks often involve a high level of linguistic demand. Although mathematics is often described as a universal language, mathematics assessments typically require extensive use of discipline-specific vocabulary, syntactically complex formulations, dense informational structures, and culturally situated contexts. These linguistic features may act as obstacles for multilingual students who are still acquiring proficiency in the language of instruction. The validity and reliability of digital mathematics assessments in increasingly multilingual European education systems may be seriously undermined when assessment results conflate linguistic proficiency with mathematical ability, systematically underestimating the skills of multilingual learners. The main research questions guiding this study are as follows: How can linguistic complexity in digital mathematics assessment items be operationalized and quantified systematically? How are various linguistic dimensions related to students’ mathematics performance? What role does linguistic complexity play in the differences between assessment outcomes of multilingual and monolingual learners? These questions are directly connected to European priorities on inclusive education and assessment equity, emphasizing the identification, interpretation, and mitigation of language-related barriers in learning contexts that are increasingly multilingual and digitally mediated. This study is situated within the Finnish educational system, where DigiArvi, a national digital mathematics assessment platform, has been implemented. DigiArvi provides a rich dataset containing detailed linguistic annotations of assessment items as well as comprehensive background information on students, including language status, prior achievement, socioeconomic indicators, and gender. Finland’s advanced digital assessment infrastructure combined with its increasingly multicultural classrooms offers a timely case study with implications extendable to other European educational settings experiencing similar demographic changes and technological advances. The theoretical framework draws on sociocultural learning theory and cognitive load theory. Sociocultural learning theory views language as a mediational tool essential for learning and assessing mathematical concepts. Cognitive load theory complements this by suggesting that unnecessary linguistic complexity can limit students’ reasoning abilities. Together, these theories offer a comprehensive framework for investigating how linguistic constraints and supports may coexist in mathematical reasoning throughout the assessment process. This study contributes to ongoing European and international debates on equitable assessment by expanding the conceptualization of linguistic complexity to a more multidimensional perspective. Unlike traditional readability indices, this approach disaggregates language into distinct components to identify which aspects impede or support equitable assessment outcomes. The findings are expected to influence assessment design by balancing linguistic accessibility with maintaining mathematical rigor, with practical implications for policy and practice. Ultimately, this research aims to support inclusive assessment practices in diverse classrooms throughout Europe. Methodology, Methods, Research Instruments or Sources Used The research will adopt a mixed-methods approach to investigate how linguistic features in mathematics test items affect multilingual students' performance. The quantitative component will analyze anonymized item-level response data collected through DigiArvi. Both multilingual and monolingual students will be included as participants, allowing for comparative analysis across different language groups. The complexity of assessment tasks, based on linguistic features, will be measured using computational linguistic techniques. A key feature to be extracted is lexical difficulty, which will be quantified using word frequency and concreteness measures. Additional linguistic features to be disaggregated include syntactic complexity, sentence length, and discourse cohesion. These features will be measured with the aid of validated Natural Language Processing (NLP) tools. This systematic linguistic profiling will help capture the various language demands embedded in digital mathematics assessment items. Multilevel modeling will be employed due to the hierarchical structure of the data, with students nested within classrooms and schools. By controlling for relevant covariates such as prior achievement, socioeconomic background, and gender, this analytical approach will allow for accurate estimation of the impact of linguistic complexity on mathematics achievement. Interaction terms will be included to test the hypothesis that multilingual learners are more negatively affected by linguistic complexity than their monolingual peers. The qualitative phase will involve semi-structured interviews with mathematics teachers from schools participating in the DigiArvi assessments. Purposive sampling will be used to select teachers from classrooms with diverse linguistic profiles. In the context of language-sensitive assessment practices, teachers will be interviewed about their perceptions of language-related challenges in mathematics assessment and instruction, strategies for scaffolding multilingual students, professional development needs, and attitudes toward potential AI-assisted linguistic support. Reflexive thematic analysis, which provides a contextualized understanding of classroom practices and professional perspectives, will guide the interpretation of the interview data. Additionally, classroom observations will be conducted to document instructional practices involving language use during mathematics lessons. These observations aim to supplement qualitative findings by capturing how teachers integrate language and mathematical scaffolding in everyday instruction. The integration of quantitative and qualitative results will further inform the development of AI-powered scaffolding tools, such as those based on large language models. Conclusions, Expected Outcomes or Findings This proposed study is designed to generate new evidence on how linguistic complexity embedded in mathematics assessment items may influence assessment outcomes for multilingual learners. By modeling item-level linguistic features and linking these profiles to student performance data, the study aims to identify specific language characteristics that are most closely associated with performance variability. The expected outcomes include detailed mappings of how lexical, syntactic, and discourse-level complexity in assessment items relate to mathematics achievement, with a particular focus on differential effects for multilingual learners. The integration of teacher interviews and classroom observations is anticipated to enrich the quantitative findings by revealing how assessment language challenges manifest in instructional settings. Insights into teachers’ perceptions, strategies, and professional development needs may inform efforts to enhance instructional practices and support frameworks that are responsive to linguistic diversity. Such insights are expected to contribute to teacher education programs and continuous professional development initiatives focused on linguistically inclusive mathematics instruction and assessment literacy. A key anticipated contribution of this study is its potential to inform the design of linguistically responsive mathematics assessments and equitable assessment policies. For example, the findings may support the development of item design guidelines that minimize unnecessary linguistic burden while preserving mathematical demand. More broadly, the study’s implications extend to international contexts where multilingual student populations are increasing and where assessment equity remains a priority. By advancing theoretical and practical knowledge about the interplay between language and mathematics learning, the study aims to provide actionable recommendations for educators, policymakers, and researchers dedicated to equitable assessment practices. Ultimately, the research seeks to foster assessment environments in which all learners regardless of linguistic background can fully demonstrate their mathematical knowledge and contribute meaningfully to educational systems that value diversity and inclusivity. References Lopez, Alexis A. "Examining the use of bilingual accommodations in digital math assessments: User perceptions." International Journal of Assessment Tools in Education 11.4 (2024): 787-803. Ehmke, Timo, Dominik Leiss, and Lena Heine. "Effects of linguistic demands of reality-based mathematical tasks: discrepancy between teachers' expectations and students' performance." Frontiers in Education. Vol. 10. Frontiers Media SA, 2025. Romo-Vázquez, Avenilde, Caroline Poisard, and Ivonne Sandoval. "Multilingual Mathematics Education: an analysis of a Mexican research-based Master’s degree course developed in the Questioning the World Paradigm." ZDM–Mathematics Education 57.7 (2025): 1425-1438. Venagli, Ilaria, Tanja Kupisch, and Marie Lallier. "How English orthographic proficiency modulates visual attention span in Italian learners with and without dyslexia." Bilingualism: Language and Cognition (2025): 1-14. Lopez, Alexis A., and Sultan Turkan. "Examining how multilingual learners engaged in a digital science modeling assessment through translanguaging." Linguistics and Education 86 (2025): 101393. Jari, Metsämuuronen, and Mikko-Jussi Laakso. "DigiEva 2025 Technical Report." (2025). | ||