Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
|
Daily Overview |
| Session | ||
99 ERC SES 08 J: Teaching with and about AI
Paper Session
| ||
| Presentations | ||
99. Emerging Researchers' Group (for presentation at Emerging Researchers' Conference)
Paper Development and Operationalisation of a Competence Model for Teachers for Teaching and Learning With and About Artificial Intelligence Universität Bayreuth, Germany Presenting Author:The growing influence of artificial intelligence (AI) on everyday life and professional contexts has increased the awareness of the need for AI-related competences (European Parliament and Council, 2024). This need is reinforced by European recommendations calling for enhanced awareness, training, and educational initiatives in schools (Council of Europe & Commissioner for Human Rights, 2019). For such initiatives to be successful, teachers themselves must possess adequate AI-related competences, which in turn require integration into curricula and the development of suitable measurement methods (Hattie, 2023). Initial initiatives aiming to strengthen AI competences among teachers indicate that the availability of a clear competence model, including all relevant dimensions for teaching and learning with and about AI, is highly beneficial (Seyferth-Zapf et al., 2025). Many existing models and assessments build on the TPACK framework (Mishra & Koehler, 2006), which focuses on the interplay of technological knowledge and purposeful use, content knowledge, and pedagogical knowledge required for effective teaching. However, the pedagogical dimension, particularly regarding teaching about AI, often remains underrepresented. Current AI-related competence models are either targeted broadly at “non-experts” (Laupichler et al., 2023) and therefore lack pedagogical specificity, or they are tailored to teachers but remain strongly oriented toward technical aspects of using AI, only implicitly addressing the demands of teaching about AI (Celik, 2023). Additionally, existing models and assessments employ heterogeneous terminology and partially inconsistent definitions of what constitutes competence. To address this, the competence definition by Weinert (2001) is adopted as a theoretically robust foundation. Weinert conceptualises competence as a combination of cognitive abilities and skills, together with motivational, volitional, and social dispositions that enable individuals to successfully manage relevant tasks. This conceptualisation provides a well‑established and internationally recognisable basis for examining AI-related teacher competences. Following this understanding, the present study refers to competence, rather than literacy or competency, in line with Weinert‘s (2001) definition. Based on this conceptual foundation and the identified gap, the lack of a comprehensive model covering all relevant competence dimensions, the aim of this study is to identify, systematise and integrate these dimensions into a coherent AI‑related competence model for teachers and then operationalise it. Accordingly, the study addresses the following research questions: - Which existing competence models for AI-related competences exist, and what are their strengths and weaknesses regarding pedagogical, technological, and ethical requirements? - Which specific competences do teachers need in the context of AI, and how can these AI-related competences be defined? - How should a comprehensive competence model be designed to capture all relevant requirements related to AI for teachers? - Which methodological approaches and operationalisation strategies are suitable for establishing such a competence model in a theoretically grounded and empirically validated manner? The resulting model is intended to provide guidance for teacher education, curriculum development and school improvement. By combining European relevance, theoretical clarity and empirical rigour, the project contributes to a coordinated European dialogue on professional AI competences in education. Methodology, Methods, Research Instruments or Sources Used This study follows a Design Science Research (DSR) approach (Peffers et al., 2007), which provides a systematic framework for developing, validating, and iteratively refining an artefact, in this case a competence model for AI-related teacher competences. DSR consists of iterative steps of problem identification and motivation, objectives of a solution, design and development, demonstration, evaluation, and communication. In this project, the process is structured into three interconnected steps. Step 1 has already been completed, step 2 is in progress, and step 3 is in preparation. The first step aimed to systematically map existing research on AI related competences. The review followed Levac et al. (2010) and the PRISMA-ScR guidelines (Page et al., 2021). It included a multi-database search strategy, development of inclusion and exclusion criteria, a systematic two-stage screening procedure, and structured data extraction and qualitative analysis based on Kuckartz and Radiker (2023). This step has been completed and has provided an initial set of relevant competence dimensions. These findings form the theoretical basis for further model development. Building on the preliminary competence dimensions derived from the literature, the second step collects empirical insights from experts in the field. Participants are recruited through purposive sampling (Ahmad & Wilkins, 2025) to ensure a diverse range of professional perspectives from different stakeholder groups, such as subject didactics, schools, educational research, disciplinary science, education policy, or industry. The interviews are being transcribed, analysed using qualitative content analysis (Kuckartz & Radiker, 2023). This second step serves to iteratively validate, refine, and expand the competence dimensions identified in step 1. The consolidated results from steps 1 and 2 will form a robust basis for the subsequent operationalisation. The third step, which is in planning, will focus on transforming the validated competence dimensions into measurable indicators and items. This will involve deriving behavioural descriptors and formulating scale items. The operationalisation process will emphasise content validity, clarity, and applicability for teacher education contexts. Taken together, these three phases form a coherent, DSR-aligned methodological process that integrates theoretical synthesis, empirical validation, and practical applicability. The resulting model is designed to serve as a comprehensive and operationalisable framework for AI-related teacher competences. Conclusions, Expected Outcomes or Findings The expected outcomes of this study reflect both the preliminary results already obtained and the anticipated contributions of the ongoing and upcoming steps. Initial findings from step 1, the Scoping Literature Review, confirm that no comprehensive competence model specifically addressing all AI‑related competences for teachers currently exists. The majority of existing models place a strong emphasis on technological knowledge and usage-related competences, while AI didacitcs, particularly teaching and learning about AI is only implicitly represented. Furthermore, motivational, volitional, and social dispositions, as conceptualised in Weinert’s definition of competence, are rarely integrated in a systematic manner. Based on these findings, an initial conceptual model was developed, suggesting that AI‑related teacher competence should consist of four overarching dimensions to enable effective instructional practice: - Instructionally relevant AI knowledge, encompassing technical knowledge, understanding of AI systems, and application-oriented skills; - Content-related competences, including both subject knowledge and AI‑specific subject-matter knowledge; - Motivational, volitional and social dispositions and abilities; - Professional teaching competences, integrating AI didactics, and subject didactics Step 2, the expert interviews, is expected to validate, refine, and expand these dimensions, with particular emphasis on strengthening the underdeveloped area of AI didactics. Insights from this step are anticipated to clarify which specific teacher actions, decision-making processes, and reflective practices are essential for teaching with and about AI. The main outcome of Step 3 will be the operationalisation of the consolidated competence model. In contrast to self‑assessment instruments frequently used in digital competence research, this study aims to develop a performance‑based assessment, allowing participants to demonstrate knowledge and skills through authentic tasks. The operationalisation will focus on content validity, clarity, and applicability in teacher education, ultimately producing a reliable and valid construct that empirically corroborates the competence model. References Ahmad, M., & Wilkins, S. (2025). Purposive sampling in qualitative research: a framework for the entire journey. Quality & Quantity, 59(2), 1461–1479. https://doi.org/10.1007/s11135-024-02022-5 Celik, I. (2023). Towards Intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behaviour, 138. https://doi.org/10.1016/j.chb.2022.107468 Council of Europe, & Commissioner for Human Rights. (2019). Unboxing Artificial Intelligence: 10 steps to protect Human Rights. https://rm.coe.int/unboxing-artificial-intelligence-10-steps-to-protect-human-rights-reco/1680946e64 European Parliament and Council. (2024). Regulation (EU) 2024/1689: EU AI Act. Official Journal of the European Union, L 2024/1689, Article 4. http://data.europa.eu/eli/reg/2024/1689/oj/1689 Hattie, J. (2023). Visible learning, the sequel: A synthesis of over 2,100 meta-analyses relating to achievement (First edition). Routledge Taylor & Francis Group. https://doi.org/10.4324/9781003380542 Kuckartz, U., & Radiker, S. (2023). Qualitative Content Analysis: Methods, Practice and Software (2nd ed.). Sage Text UK. https://permalink.obvsg.at/ Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the “Scale for the assessment of non-experts’ AI literacy” – An exploratory factor analysis. Computers in Human Behavior Reports, 12. https://doi.org/10.1016/j.chbr.2023.100338 Levac, D., Colquhoun, H., & O'Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science : IS, 5, 69. https://doi.org/10.1186/1748-5908-5-69 Mishra, P., & Koehler, M. J. (2006). Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge. Teachers College Record: The Voice of Scholarship in Education, 108(6), 1017–1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., . . . Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ (Clinical Research Ed.), 372, n71. https://doi.org/10.1136/bmj.n71 Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems, 24(3), 45–77. https://doi.org/10.2753/MIS0742-1222240302 Seyferth-Zapf, C., Mikula, L., & Ehmann, M. (2025). Förderung KI-bezogener Kompetenzen bei Lehramtsstudierenden: Praxis- und theorieorientierte Entwicklung und Evaluation eines hochschuldidaktischen Konzepts. Journal Für Allgemeine Didaktik, 13, 108–134. https://doi.org/10.35468/jfad-13-2025-05 Weinert, F. E. (2001). Concept of competence: A conceptual clarification. In D. S. Rychen & L. H. Salganik (Eds.), Defining and selecting key competencies (pp. 45–65). Hogrefe & Huber Publishers. 99. Emerging Researchers' Group (for presentation at Emerging Researchers' Conference)
Paper Start Sailing in AI Wave:Empirical Study on the AI Readiness of Early Career Science Teachers and Its Impact on Job Satisfaction 1: Beijing Normal University, China, People's Republic of; 2: Capital Normal University, China, People's Republic of Presenting Author:Artificial intelligence (AI) technology has been increasingly integrated into K-12 education, offering a novel pathway for optimizing instructional practices and improving students' academic performance (Wang et al., 2023). This transformative trend is particularly prominent in science education, where AI tools unlock revolutionary potential for teaching complex scientific concepts, delivering personalized learning, and conducting interdisciplinary scientific inquiry (Erduran, 2023). This imposes higher demands on science teachers: they are required to not only possess the professional competence to lead AI-driven instructional innovation, but also acutely perceive and effectively address various ethical issues that emerge continuously in AI-enabled teaching practices. In particular, for early career science teachers (ECSTs) in their first three years of appointment, this shift presents both opportunities and challenges, as their core responsibilities entail adapting to technological disruption while establishing foundational professional competencies (Barrett, 2025). ECSTs must not only rapidly master AI-based teaching tools and methodologies to align with evolving instructional requirements, but also navigate the reshaping of professional roles and competency challenges brought about by technological transformation (H et al., 2025). Their AI readiness serves as a pivotal underpinning for addressing the aforementioned pressures. Against this backdrop, job satisfaction among ECSTs has grown in significance and merits special attention. Neglecting the interactive relationship between AI readiness and job satisfaction will not only directly dampen ECSTs' initiative to proactively integrate AI into teaching and undermine the implementation effectiveness of AI-enabled education, but also adversely affect their career development trajectories. Crucially, low job satisfaction may lead to early career attrition. Surveys indicate that the natural attrition rate of early career teachers (ECTs) has exceeded 30% in some European countries in recent years (OECD, 2021) — a phenomenon that directly reflects their low job satisfaction and thus jeopardizes the stability and sustainable development of the teaching workforce. While existing research has examined the association between AI readiness and job satisfaction, it lacks empirical evidence in non-Western contexts. In particular, few studies have systematically explored the mechanism through which four-dimensional AI readiness influences job satisfaction among ECSTs in China. Currently, China's Ministry of Education, Ministry of Science and Technology, and other relevant departments have issued a series of policies to promote and support the full integration of AI into K-12 science education (Ministry of Education et al., 2025). This policy context further underscores the urgency of investigating the practical predicaments faced by this teacher cohort. Drawing on the scale developed by Karaca et al. (2021) and the Technology Acceptance Model (TAM), this study adopts the localized framework proposed by Wang et al. (2023), which defines AI readiness as teachers' state of preparedness across the cognitive, ability, vision, and ethical dimensions in the context of AI implementation in educational settings. This study aims to investigate ECSTs' AI readiness and its impact on job satisfaction against the backdrop of AI-enabled science education. Clarifying the inherent correlation between the two is essentially the key to addressing the dilemma of the escalation of technological requirements and the imbalance in teachers' professional adaptation, and it holds great significance for safeguarding the professional growth of ECSTs and laying a solid foundation for the development of the science teaching workforce in the AI era. Methodology, Methods, Research Instruments or Sources Used This study primarily addressed the following research questions:1.What are the overall level and distribution characteristics of AI readiness among ECSTs?2.What inherent interrelationships exist among the four dimensions (cognition, ability, vision, and ethics) of ECSTs' AI readiness?3.What is the causal relationship between ECSTs' AI readiness and their perceived AI threat, AI-enabled innovation, and job satisfaction?4.Are there significant differences in AI readiness, perceived AI threat, AI-enabled innovation, and job satisfaction among ECSTs with different demographic backgrounds? To address the above questions, convenience sampling was adopted to recruit ECSTs from multiple provinces in China, and a total of 448 valid samples were obtained (189 males and 273 females; average age=25.6 years). The participants' teaching subjects included general science, physics, chemistry, and biology, among others. Data were collected via a questionnaire survey, which was revised based on validated scales (the Teacher AI Readiness Scale and the Job Satisfaction Scale) and with reference to the localized framework proposed by Wang et al. (2023). The questionnaire consisted of 41 items rated on a 5-point Likert scale (1=strongly disagree, 5=strongly agree), and measured seven core variables: four dimensions of AI readiness (cognition, ability, vision, and ethics) adapted from Karaca et al. (2021), perceived AI threat adapted from Mirbabaie et al. (2022), AI-enabled innovation derived from Popenici & Kerr (2017), and job satisfaction derived from Ragu-Nathan et al. (2008). The questionnaire was refined and optimized through back-translation, expert consultation, and a pilot test. Harman's single-factor test was conducted to assess common method bias, and the results showed that the unrotated first common factor explained 37.63% of the total variance (40%). This indicated a low level of common method bias, which did not exert a significant impact on the study results. For data analysis, Partial Least Squares Structural Equation Modeling (PLS-SEM) was performed using the PLSPM package in R software to examine the interrelationships among the variables. Two-step cluster analysis was applied to clarify the distribution characteristics of AI readiness levels, and guided by the Bayesian Information Criterion (BIC), the optimal cluster solution was finally identified. The results of reliability and validity tests demonstrated an ideal level of measurement quality: all Cronbach's α coefficients for the scales were greater than 0.90, and all average variance extracted (AVE) values exceeded 0.77. Conclusions, Expected Outcomes or Findings This study Reveals the action mechanism of ECSTs' AI readiness and expands the empirical dimensions and scenarios of the Educational Technology Acceptance Theory.The study draws the following conclusions in response to its four core research questions: First, cluster analysis categorized the research sample into three groups: the high AI readiness group (32.59%), the intermediate AI readiness group (49.33%), and the low AI readiness group (18.08%). This finding indicates that nearly half of the ECSTs attain intermediate AI readiness, while a small proportion remain at the low level. Second, regarding the interrelationships among AI readiness dimensions and inter-variable mechanisms, the study confirmed that cognition, ability, and vision all positively shape ECSTs’ awareness of AI ethics, with vision serving as the core driver of ethical practice (the strongest predictive effect). Meanwhile, the impact of AI readiness on ECSTs’ perceived AI threat, AI-enabled instructional innovation, and job satisfaction is focused: ability acts as the key hub, which mitigates ECSTs’ perceived AI threat with a path coefficient of β=-0.35and drives AI-enabled instructional innovation with a path coefficient of β=0.35. Furthermore, AI-enabled instructional innovation is the core positive driver of job satisfaction with a strong path coefficient of β=0.52, whereas perceived AI threat exerts a negative impact on job satisfaction with a path coefficient of β=-0.29. The cognition, vision, and ethics dimensions of AI readiness have no direct effect on the aforementioned outcome variables, with their impacts likely via indirect paths. Finally, in terms of demographic differences, gender exerts heterogeneous effects on the relevant variables: male ECSTs exhibit slightly higher AI readiness than their female counterparts and perform more prominently in AI-enabled innovation, while female ECSTs report a stronger perceived AI threat. This reflects inherent gender differences in technological adaptation and risk perception, thus providing a basis for gender-targeted AI literacy cultivation for ECSTs. References Barrett, A. J. (2025). Immersion in virtual reality-based teacher training simulations with artificial intelligence-integrated student agents to increase learning achievement for early-career teachers. (Order No. 32045788, The Florida State University).ProQuest Dissertations and Theses,,108. Erduran Sibel.(2023).AI is transforming how science is done. Science education must reflect this change..Science (New York, N.Y.),382(6677),eadm9788-eadm9788. H, R. E., & Efe, A. (2025). Science Teachers’ Perceptions Of The Artificial Intelligence In Science Education: Challenges, Readiness, Benefits, And Impact On Student Learning.Journal of Baltic Science Education,24(4), 655-669. Karaca, O., Çalıs¸kan, S. A., & Demir, K. (2021). Medical artificial intelligence readiness scale for medical students (MAIRS-MS)–development, validity and reliability study. BMC Medical Education, 21(1), 1–9. Mirbabaie, M., Brünker, F., Mollmann ¨ Frick, N. R., & Stieglitz, S. (2022). The rise of artificial intelligence–understanding the AI identity threat at the workplace. Electronic Markets, 32(1), 73–99. Popenici, S. A., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning, 12(1), 1–13. Ragu-Nathan, T., Tarafdar, M., Ragu-Nathan, B. S., & Tu, Q. (2008). The consequences of technostress for end users in organizations: Conceptual development and empirical validation. Information Systems Research, 19(4), 417–433. Wang Xinghua,Li Linlin,Tan Seng Chee,Yang Lu &Lei Jun.(2023).Preparing for AI-enhanced education: Conceptualizing and empirically examining teachers’ AI readiness.Computers in Human Behavior,146. Wang, N., & Lester, J. (2023). K-12 education in the age of AI: A call to action for K-12 AI literacy.International Journal of Artificial Intelligence in Education,33(2), 228-232. 99. Emerging Researchers' Group (for presentation at Emerging Researchers' Conference)
Paper How AI-TPACK Self-Reports Misalign with Performance: Evidence from an AI-Supported Multimodal Design Task in Pre-service Science Teacher Education 1: Hainan Normal University, China, People's Republic of; 2: University of Turku; 3: University of Helsinki Presenting Author:Background and Rationale The integration of artificial intelligence (AI) into teacher education has attracted increasing attention from scholars and policymakers worldwide, intensifying calls to define and evaluate teachers’ competencies for an AI-rich educational landscape (Zhai & Nehm, 2023). Within teacher education, a growing body of work has sought to conceptualise teachers’ capabilities to use AI tools effectively, ethically, and pedagogically. Building on the Technological Pedagogical Content Knowledge (TPACK) framework, recent scholarship has proposed AI-TPACK by incorporating AI-related dimensions into teachers’ professional knowledge base (Celik, 2023; Ning et al., 2024). Correspondingly, researchers have developed and validated self-report AI-TPACK scales to capture pre- and in-service teachers’ perceived readiness to integrate AI into teaching (Ning et al., 2024), and these instruments are increasingly adopted in empirical studies as a basis for competency evaluation (Karatas & Atac, 2025; Xu et al., 2025). However, reliance on self-report instruments raises enduring validity concerns, particularly when the target competency involves complex, design-based practice rather than general dispositions or confidence (Akyuz, 2018). This challenge becomes especially salient with generative AI (GenAI), which can support multimodal science teaching—an area where teachers must coordinate multimodal resources (e.g., text, image, audio, animation) to foster conceptual understanding (Kress, 2001; Nielsen & Yeo, 2022). These conditions make it crucial to examine whether self-reported AI-TPACK aligns with demonstrated competence in authentic, AI-supported multimodal design tasks. Research context To examine this measurement gap in an authentic teacher-education setting, this study is situated in a pre-service science teacher education course where participants completed an AI-supported multimodal design task. Specifically, pre-service teachers used generative AI to support the creation of web-based animations and interactive representations intended to teach abstract scientific concepts. The same cohort also completed a widely used AI-TPACK self-report questionnaire, enabling a direct comparison between perceived competence and demonstrated performance within a shared instructional context. Empirically, the study draws on 116 GenAI-assisted multimodal assignments, which were evaluated using a TPACK-aligned performance rubric across the seven TPACK dimensions, and these scores were matched with participants’ questionnaire responses. To contextualise and interpret patterns of convergence and divergence, we further conducted six focus group interviews with 24 pre-service teachers, exploring how they perceived AI’s role in science teaching and how they evaluated their own capabilities when working with AI-supported design tasks. Research Questions: RQ1: To what extent do pre-service science teachers’ AI-TPACK self-reports align with performance-based TPACK scores derived from an AI-supported multimodal design task? RQ2: What patterns of misalignment emerge across the seven TPACK dimensions? RQ3: How can the observed misalignment be interpreted in terms of construct validity? Theoretical Framework This study integrates TPACK (Mishra & Koehler, 2006) with Kane’s (2013) argument-based validation to examine the meaning and limits of AI-TPACK self-report scores in an AI-supported multimodal design context. TPACK specifies the competence domain of interest—teachers’ integrated use of content, pedagogy, and technology knowledge (CK, PK, TK) and their intersections in designing multimodal science representations. Kane’s framework then examines the use of AI-TPACK questionnaires as a validity claim. First, we examine relations to other measures by comparing self-report scores with rubric-based performance scores from an AI-supported multimodal design task. Second, we use qualitative data as response-process evidence to explain why self-reports misalign with task performance and to refine defensible score interpretations. International Implications Globally, AI-TPACK self-report scales are increasingly used to monitor teacher readiness and evaluate AI-focused teacher education. Using data from China—a major, fast-evolving AI-in-education context—this study provides internationally relevant validity evidence. It cautions against relying solely on self-reports when benchmarking teacher competence and supports combining questionnaires with performance-based assessment for cross-country comparisons. Methodology, Methods, Research Instruments or Sources Used This study adopted a convergent mixed-methods design in which quantitative and qualitative data were collected within the same course context, analysed in parallel, and then integrated to generate meta-inferences about alignment and misalignment between measures (Greene et al., 1989; Creswell & Clark, 2018). Sampling Participants were 116 pre-service primary science teachers enrolled in a compulsory course at a normal university in China. The course required an assessed design task where students used generative AI to support the production of multimodal teaching materials. Ethical procedures included informed consent, anonymisation, etc. Data Collection 1.AI-TPACK self-report questionnaire. All participants completed a validated AI-TPACK survey (Ning et al., 2024), yielding item-level responses across seven theoretically defined dimensions. 2.Performance-based assessment (coursework). Each participant submitted a GenAI-assisted multimodal assignment (i.e., creating an HTML-based animation/interactive representation to explain the Earth's seasons). Artefacts were evaluated using a TPACK-aligned, 21-item performance rubric developed for this study to operationalise observable indicators across the seven TPACK dimensions. Two raters conducted initial independent scoring, followed by calibration rounds to refine decision rules before full-scale scoring. 3.Focus groups. Six semi-structured focus groups (n = 24) explored how participants interpreted AI-TPACK items, how they approached the design task, and perceived reasons for misalignment between self-perceptions and performance. Data Analysis Quantitative analysis (aligned to RQ1–RQ2). Confirmatory factor analysis (CFA) was conducted to examine the factorial validity of the AI-TPACK measurement model. A seven-factor model was specified, with each item loading on its corresponding latent construct. Estimation used maximum likelihood (ML), and fit was evaluated using χ², CFI, TLI, RMSEA, and SRMR. To examine effects of background variables on self-reported AI-TPACK and course performance, multivariate regression analyses were conducted in Mplus with gender, year of study, and programme track as predictors, reporting standardised coefficients. For subsequent alignment analyses, factor scores for latent variables were estimated and exported. Alignment analysis (RQ1–RQ2). To assess alignment, AI-TPACK factor scores were correlated with performance scores from the multimodal coursework assessment at both overall and dimension levels. Misalignment patterns were further profiled through score comparisons (e.g., distributional contrasts and categorical banding of high/medium/low scores) to identify systematic overestimation and dimension-specific gaps. Qualitative analysis and integration (RQ3). Focus group transcripts were analysed using deductive coding to generate response-process and context-anchoring explanations for divergence. Integration was conducted via joint displays, linking dominant quantitative misalignment profiles to qualitative accounts of how participants construed questionnaire items and evaluated their own competence in relation to the task. Conclusions, Expected Outcomes or Findings Quantitative analyses indicate a systematic misalignment between pre-service teachers’ self-reported AI-TPACK and their demonstrated competence in an AI-supported multimodal design task. CFA supports the intended seven-factor structure of the AI-TPACK questionnaire, suggesting acceptable internal structure for the target sample. However, when AI-TPACK factor scores were compared with performance scores, alignment was largely absent. Across dimensions, self-report–performance correlations were non-significant, with one exception: a small positive association between self-reported PK and task-based TK (p < .05). Moreover, when scores were categorised into low/medium/high bands, participants’ self-ratings were consistently higher than their coursework performance, indicating a pattern of overestimation rather than random noise. Regression analyses further suggest that gender, year of study, and programme track offer limited explanatory power for this misalignment. Focus group evidence provides interpretive insight into why self-report AI-TPACK may not translate into enacted competence in this task context. First, participants highlighted that questionnaire items are context-general, prompting them to anchor responses in familiar teaching scenarios rather than the specific demands of AI-supported multimodal design. Second, many expressed doubts about the current maturity of AI tools for complex design and debugging, which shaped their strategies, persistence, and reliance on AI assistance. Third, participants commonly viewed AI as useful for compensating gaps in content knowledge (CK), yet reported low confidence in technological knowledge (TK), producing a “content-support” orientation that did not necessarily yield robust technical implementation in the final artefact. Taken together, the study offers validity-oriented implications for AI-TPACK measurement and teacher education. It cautions against using self-report AI-TPACK scales as stand-alone indicators of competence in AI-supported multimodal design and supports combining questionnaires with performance-based assessment to enable defensible score interpretations. Conceptually, the findings suggest that AI-TPACK self-reports may primarily capture perceived readiness and scenario-based confidence, whereas rubric-based assessment captures task-enacted design competence in a technology-intensive context. References Akyüz, D. (2018). Measuring technological pedagogical content knowledge (TPACK) through performance assessment. Computers & Education, 125, 212–225. https://doi.org/10.1016/j.compedu.2018.06.012 Celik, I. (2023). Towards intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI-based) tools into education. Computers in Human Behavior, 136, 107468. https://doi.org/10.1016/j.chb.2022.107468 Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE. Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255–274. https://doi.org/10.3102/01623737011003255 Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000 Karataş, F., & Ataç, B. A. (2025). When TPACK meets artificial intelligence: Analyzing TPACK and AI-TPACK components through structural equation modelling. Education and Information Technologies, 30, 8979–9004. https://doi.org/10.1007/s10639-024-13164-2 Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold. Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x Nielsen, W., & Yeo, S. (2022). Multimodal representations in primary science: A systematic review. Research in Science Education, 52, 1343–1367. https://doi.org/10.1007/s11165-020-09974-6 Ning, Y., Zhang, C., Xu, B., Zhou, Y., & Wijaya, T. T. (2024). Teachers’ AI-TPACK: Exploring the relationship between knowledge elements. Sustainability, 16(3), 978. https://doi.org/10.3390/su16030978 Xu, G., Yu, A., Gao, A., Chen, H., & Li, M. (2025). Developing an AI-TPACK framework: Exploring the mediating role of AI attitudes in pre-service TCSL teachers’ self-efficacy and AI-TPACK. Education and Information Technologies, 30, 22471–22495. https://doi.org/10.1007/s10639-025-13630-5 Zhai, X., & Nehm, R. H. (2023). AI and formative assessment: The train has left the station. Journal of Research in Science Teaching, 60(7), 1227–1233. https://doi.org/10.1002/tea.21885 99. Emerging Researchers' Group (for presentation at Emerging Researchers' Conference)
Paper ***WITHDRAWN*** AI-Assisted Inquiry-Based Teaching: A Lesson Study with Science Teachers 1: Kahramanmaraş Sütçü İmam University (Türkiye); 2: Middle East Technical University (Türkiye) Presenting Author:Teachers need to learn more effective teaching methods, and it is important for teachers to have a better understanding of instruction to support their students' learning (Murata et al., 2012). The arrival of artificial intelligence (AI) has increased its integration into education, making it necessary to change the way teachers design, deliver, and think about their teaching practices (Novita, 2025). Despite the increasing importance placed on artificial intelligence in education, it remains unclear how teachers will effectively implement it in their classrooms (Ifenthaler et al., 2024). Teachers cannot manage the rapid evolution of AI on their own; therefore, lesson study is ideal for managing this process more efficiently. Lesson study assists as a powerful professional development model to talk this absence, which requires the inclusion of evolving pedagogical strategies aligned with curriculum standards and student needs, is a critical but time-consuming activity among teachers' various teaching tasks (Novita, 2025). Lewis & Tsuchida (1998) defined lesson study as a teaching method with lesson characteristics that are meticulously planned, monitored, recorded, and discussed by other teachers. Moreover, it is presented through a cycle organized in a collaborative environment, consisting of goal setting, curriculum analysis, lesson planning, supervised instruction, and evaluation and review stages (Murata et al., 2012). Teachers can use inquiry in the process because inquiry enable students to use rational thinking, form statements, and evaluating alternative descriptions (Hofstein & Lunetta, 2003). When examining the literature on science education, the concept of inquiry is defined in a multifaceted way, encompassing processes such as exploring science, making observations, asking questions, examining various sources of information and books, collecting data, analysing it, and interpreting it (Hofstein & Lunetta, 2003). Therefore, this study designed as teachers can integrate artificial intelligence into their lessons, from the learning and application stages to the assessment stage. Stages of collaborative lesson study are as follows (Demir et al., 2012). The first stage is goal setting and planning. Instructional activities are designed to help students achieve the stated goals. Second phase is the instruction phase. At this point, one teacher volunteers to teach the lesson, and the others participate as passive observers. Teachers do not evaluate the quality of the instruction; they focus on the obvious signs of student learning. Teachers review the results of their observations and decide together how the observed lesson can be improved. Following this evaluation session, they discuss their experiences of observing and implementing the lesson and focus on revisions to be made to the lesson. Accordingly, revised lesson is implemented in another class by the same teacher or another member (Demir et al., 2012).The aim of this study was to reveal how middle school science teachers design lesson plans using artificial intelligence-supported teaching tools in the lesson study process, how they integrate these tools into their inquiry-based teaching. The fundamental research question that guided this study was: How do middle school science teachers integrate artificial intelligence tools into inquiry-based teaching designs in the lesson study process? This research is expected to be significant because it examines how middle school science teachers prepare lesson plans using AI-supported instructional tools within the framework of a collaborative lesson study process, and how they adopt an inquiry-based learning approach in this process. The research will comprehensively address teachers' experiences in creating AI-enriched lesson plans, the educational opportunities they encounter, and the challenges they face. The collaborative lesson planning process supports teachers' professional development through collaborative planning, implementation, and evaluation. In this context, the integration of AI tools into the teaching process and the reflection of inquiry-based activities in lessons will be analysed in detail from the teachers' perspectives. Methodology, Methods, Research Instruments or Sources Used A case study, a qualitative research method, was used to examine how different teachers integrate inquiry-based learning and artificial intelligence into lesson study (Yin, 2003). The study group consisted of four middle school science teachers working in state schools affiliated with the Ministry of National Education. Lesson planning is a professional development process where teachers come together to prepare lesson plans collaboratively, one teacher implements the lesson, others observe, and then they discuss the effectiveness of the lesson and revise the plan. This cycle focuses on optimizing the teaching of a specific subject/lesson. First, in an initial session researchers with volunteer teachers goals are set. Then, AI tools were introduced, and a short AI tool training was given by researcher. Teachers prepared AI-assisted lesson plans; each plan evaluated and revised according to an evaluation criterion. Plans, AI outputs, and source documents were collected by researcher. Classroom applications were carried out by the teacher; researchers make observations. Teachers share their post-implementation findings; improvement suggestions are identified, and the next cycle is planned. Two cycles were conducted, with data collected in each cycle. The study concluded with interviews with teachers.Teacher interviews and lesson plans will be thematically coded. Document analysis will be performed for lesson plans generated by AI according to the Testing a TPACK based technology integration assessment rubric by Harris et al. (2010). Conclusions, Expected Outcomes or Findings This study is expected to provide critical insights into the interaction between AI-integrated pedagogy and the Lesson Study model. Mainly, the findings are expected to demonstrate that the collaborative nature of Lesson Study serves as a fundamental support for teachers, reducing technical anxiety and fostering a community of inquiry where AI is used not only for content creation but also as a cognitive partner for pedagogical design. Specifically, the research is expected to reveal: - Teachers will develop specialized pedagogical guidance skills that allow them to create more complex, inquiry-based scenarios (e.g., simulations, identifying misunderstandings) more efficiently than traditional methods. - The integration of AI tools into the Lesson Study cycle will lead to more personalized and adaptable learning environments that go beyond standard direct instruction. However, this study also aims to highlight critical challenges such as the ethical implications of AI in classrooms and the risk of over-reliance on content produced without pedagogical critique. Ultimately, this research aims to propose a practical framework for AI-Powered Lesson Development that integrates sustainable, collaborative teacher professional development with rapid technological advancements in science education. References Demir, K., Sutton-Brown, C., & Czerniak, C. (2012). Constraints to Changing Pedagogical Practices in Higher Education: An example from Japanese lesson study. International Journal of Science Education, 34(11), 1709–1739. https://doi.org/10.1080/09500693.2011.645514 Harris, J., Grandgenett, N., & Hofer, M. J. (2010). Testing a TPACK-based technology integration assessment rubric. In C. D. Maddux, D. Gibson, & B. Dodge (Eds.), Research highlights in technology and teacher education (pp. 323–331). Society for Information Technology and Teacher Education. Hofstein, A., & Lunetta, V. N. (2003). The laboratory in science education: Foundations for the twenty‐first century. Science Education, 88(1), 28–54. https://doi.org/10.1002/sce.10106 Ifenthaler, D., Majumdar, R., Gorissen, P., Judge, M., Mishra, S., Raffaghelli, J., & Shimada, A. (2024). Artificial intelligence in Education: Implications for policymakers, researchers, and practitioners. Technology Knowledge and Learning, 29(4), 1693–1710. https://doi.org/10.1007/s10758-024-09747-0 Lewis, C. C., & Tsuchida, I. (1998). A lesson is like a swiftly flowing river: How research lessons improve Japanese education. American Educator, 14 (17), 50–52. doi:10.1177/136548029900200117 Murata, A., Bofferding, L., Pothen, B. E., Taylor, M. W., & Wischnia, S. (2012). Making connections among student learning, content, and teaching: Teacher talk paths in elementary mathematics lesson study. Journal for research in mathematics education, 43(5), 616-650. https://doi.org/10.5951/jresematheduc.43.5.0616 Novita, N. R. (2025). AI in Lesson Planning: Improving Teacher Efficiency and Instructional Design. Jurnal Riset Rumpun Ilmu Pendidikan, 4(2), 192–202. https://doi.org/10.55606/jurripen.v4i2.5560 Yin, R. K. (2003). Case study research: Design and methods (Vol. 5). Sage Publications. ISBN 0-7619-2553-8 | ||