Conference Agenda
| Session | ||
11 SES 13 A: Improving School Leadership
Paper Session | ||
| Presentations | ||
11. Educational Improvement and Quality Assurance
Paper Professional Learning of Novice School Principals Palacky University Olomouc, Czech Republic (Czechia) Presenting Author:This paper aims to develop a conceptual understanding of the professional learning needs of novice school principals, positioning these needs as a key prerequisite for quality development of both individuals and their schools. The transition into the principalship represents a critical phase in leadership development, with substantial implications for school quality, organizational stability, and educational outcomes. Research across education systems underscores the pivotal role of school leadership in shaping institutional effectiveness and learning quality (Leksy et al., 2024). In decentralized education systems, including the Czech Republic, principals hold primary responsibility for school governance and educational provision (Act No. 561/2004 Coll.). Principals participate in approximately 70% of decisions influencing school quality (MEYS, 2025, p. 6). At the same time, they face a substantial administrative burden and rank among the most overloaded actors in the education system. This accumulation of responsibility and workload constrains principals’ capacity not only for instructional and strategic leadership, but also for their own professional learning, which remains essential for sustained quality of schools and continuous improvement. In practice, principals´ professional learning does not unfold as a linear or pre-planned process, instead it emerges from context-specific learning needs shaped by everyday leadership challenges. These include the development of their professional, managerial, and legal competencies, as well as psychosocial and emotional capacities linked to role transition and leadership identity formation (Johnson et al., 2020). While some needs are identified early, others surface through engagement with concrete leadership dilemmas and high-stakes decisions (Evans, 2019). Their fulfillment is achieved not only through formal professional development, but also through experiential learning, professional dialogue, informal networks, and supportive relationships (Eraut, 2004). The initial phase of headship is particularly demanding. Pol et al. (2009) define a novice principal as an individual serving within the first two years of their appointment, a period referred to as the entry into the principalship. During this phase, principals experience the sudden assumption of full institutional responsibility, described by Spillane and Lee (2014) as a “responsibility shock.” Concurrently, novice principals are required to navigate a highly complex leadership role that encompasses instructional leadership, human resource management, administration, finance, and legal accountability (Czech School Inspectorate, 2024). This period is frequently associated with high levels of stress, uncertainty, and emotional strain, particularly in contexts of limited systemic support and insufficient prior leadership experience (Spillane and Lee, 2014). Within this context, professional learning emerges as a central mechanism through which novice principals build leadership capacity, respond to role demands, and actively maintain and enhance school quality. The literature conceptualizes professional learning as a multidimensional, active, and reflective process embedded in everyday practice (Darling-Hammond et al., 2017; Evans, 2019; Keay et al., 2019; Salo et al., 2024). Mockler (2020, 2022) emphasizes individual agency, highlighting how professionals shape learning in interaction with organizational, relational, institutional, and systemic conditions. For principals, learning occurs not only through formal preparation and induction, but also through daily leadership practice, professional interaction, informal networks, and peer support. Prior research shows that high-quality principal professional learning enhances leadership competence, teacher development, and student learning, strengthening overall school effectiveness (Darling-Hammond et al., 2022; Leithwood et al., 2020). Adopting qualitative research design, the study examines how early-career principals interpret their emerging learning priorities. Methodology, Methods, Research Instruments or Sources Used The study employed a qualitative interpretivist research design drawing on three-round repeated semi-structured interviews, all conducted with participants’ informed consent and audio-recorded. Data were collected in autumn 2025, and after each interview round, verbatim transcripts were returned to participants for member checking and authorization, enhancing both credibility and ethical rigor. The research focused on novice school principals, and participant selection criteria reflected the study’s conceptual and methodological framework (Creswell, 2018). The sample included principals from schools providing compulsory education who had assumed the principal role for the first time and had served no longer than two years at the start of data collection. Of the eight principals invited, three agreed to participate. The participants were novice female principals who entered headship in 2024 and 2025. To ensure confidentiality, pseudonyms Anna, Klara, and Maria were assigned. Anna assumed the principalship in 2024, taking over a school marked by limited organizational discontinuity and the absence of systematic handover of documentation and key processes. Klara entered the principal role in September 2025. Although she had prior teaching experience, she had no previous leadership experience and assumed responsibility for a school facing staffing and organizational instability. At the time of data collection, she was at the very beginning of her headship. Maria became principal in 2024, entering headship with prior teaching experience and administrative exposure from her former role as deputy principal. At the time of the interviews, she had already accumulated several months of leadership practice and was managing everyday operational demands. The data were analyzed using thematic analysis following Braun and Clarke (2006). The analytical process included repeated transcript reading, open coding of meaning units, theme development, and interpretation in relation to the research question (Braun & Clarke, 2006). An audit trail documented analytic decisions and theme refinement. Trustworthiness was supported through triangulation across interview rounds, member checking, and reflexive memo-writing addressing researcher positionality. Several limitations of the study should be acknowledged. In particular, the study examines principals’ interpreted learning needs rather than objectively assessed leadership performance, and reflect participants’ sense-making within a specific induction phase. As a qualitative study, the analysis is shaped by the researchers’ interpretive framework and the policy and organizational context in which participants are situated. The analysis resulted in three overarching themes capturing novice principals’ professional learning needs, providing insight into leadership learning within the principal pipeline and induction phase. Conclusions, Expected Outcomes or Findings The findings indicate that novice principals’ learning needs cluster into three interrelated leadership domains: self-regulation, strategic leadership, personnel leadership, and administrative management. Professional learning emerges as a situated, reactive, and practice embedded process, shaped by responsibility shock and organizational pressure. In the domain of self-regulation, novice principals describe the need to cope with the sudden burden of taking over a school, often without leadership continuity and in the context of unmet expectations. They report learning to regulate their emotions and manage stress, loneliness, and uncertainty, in order to remain accountable for their own work and the functioning of the school as a whole. This experience reflects the responsibility shock identified by Spillane and Lee (2014) as a critical moment in novice principals’ professional learning. In the domain of strategic and personnel leadership, principals highlight learning needs related to strategic budget management, resource planning, financial stability, conflict resolution, staff development, and navigating legal frameworks, particularly labor and administrative regulations. The third domain concerns administrative management. Principals emphasize the need to familiarize themselves with complex school documentation, reporting requirements, and administrative procedures, particularly when documentation has not adequately been handed over from previous leadership. These needs are closely linked to legal and financial accountability. In line with Evans (2019), learning needs are often activated by concrete operational and organizational demands embedded in everyday leadership practice. The findings underscore the demanding nature of entry into headship as a prerequisite for quality development. This aligns with Crow’s (2006) characterization of early principalship as a critical phase of professional socialization requiring intensive learning and adaptation. Principals’ accounts further highlight the importance of targeted induction and professional support (Hargreaves, 2025). References Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE. Crow, G. M. (2006). Complexity and the beginning principal in the United States: perspectives on socialization. Journal of Educational Administration, 44(4), 310–325. Czech School Inspectorate. (2024). Annual Report of the Czech School Inspectorate for the 2023/2024 School Year. Prague: Czech School Inspectorate. Darling-Hammond, L., Sutcher, L., Podolsky, A., & Espinoza, D. (2022). Developing effective principals: What kind of learning matters? Learning Policy Institute. https://learningpolicyinstitute.org/media/3698/download Eraut, M. (2004). Informal learning in the workplace. Studies in Continuing Education, 26(2), 247–273. Evans, L. (2019). Professional learning in the education profession. Springer. Hargreaves, A. (2025). The dark side of networks: And the implications for school leadership. School Leadership & Management, 45(1), 1–6. https://doi.org/10.1080/13632434.2024.2436308 Johnson, A. D., Clegorne, N., Croft, S. J., & Ford, A. Y. (2020). The Professional Learning Needs of School Principals. Journal of Research on Leadership Education, 16(4), 305-338. https://doi.org/10.1177/1942775120933933 Keay, J., Carse, N., & Jess, M. (2019). Understanding teachers as complex professional learners. Professional Development in Education, 45(1), 125–137. https://doi.org/10.1080/19415257.2018.1529613 Leithwood, K., Sun, J., & Pollock, K. (2020). How school leaders contribute to student success: The four paths framework. Springer. Leksy, K., Gawron, G., Rosário, R., Sormunen, M., Velasco, V., Sandmeier, A., Simovska, V., Wojtasik, T., & Dadaczynski, K. (2024). The importance of school leaders in school health promotion: A European call for systematic integration of health in professional development. Frontiers in Public Health, 11, 1297970. https://doi.org/10.3389/fpubh.2023.1297970 Ministry of Education, Youth and Sports. (2025). System of Support and Leadership for School Principals: Priorities for the Period 2025–2027. MŠMT. https://www.edu.gov.cz Mockler, N. (2020). Teacher professional learning under audit: Reconfiguring practice. Professional Development in Education, 46(4), 596–609. https://doi.org/10.1080/19415257.2019.1634624 Pol, M., Hloušková, L., Novotný, P., & Sedláček, M. (2009). The initial phase of the professional career of primary school principals. Studia Paedagogica, 14(1), 109–126. Salo, P., Nylund, J., & Stjernstrøm, E. (2024). Contextualised professional learning of school leaders: External impulses and internal practices. Educational Management Administration & Leadership, 52(1), 35–52. https://doi.org/10.1177/17411432231170938 Spillane, J. P., & Lee, L. C. (2014). Novice school principals’ sense of ultimate responsibility: Problems of practice in transitioning to the principal’s office. Educational Administration Quarterly, 50(3), 431–465. https://doi.org/10.1177/0013161X13505290 11. Educational Improvement and Quality Assurance
Paper ***WITHDRAWN*** AI Use in School Leadership and Inspection: A Systematic Literature Review The Open University, United Kingdom Presenting Author:Artificial Intelligence (AI) is rapidly reshaping the governance, leadership, and delivery of secondary education across the UK (Adams & Thompson, 2025). While schools are experimenting with AI in teaching, learning, and assessment (Royal Society of Chemistry, 2025), mechanisms for oversight, inclusion, and accountability are not evolving at the same pace (Gökçe, 2025). Despite increasing AI experimentation at school level, there is currently no systematic review that explores how school leaders decide which AI technologies to adopt, how they manage risk, or how they ensure equity. Furthermore, the ways in which school inspectorates engage with and evaluate AI use remains under-examined—despite being pivotal in shaping school policy and leadership decisions around AI integration. Thus, our review was guided by the following resarch questions:
Our research reveals that while some school leaders and inspectorates are moving forward with confidence, others face significant barriers due to the lack of clear policy guidance, infrastructure, and capacity (Shrestha & Baxter, 2026, in press). This systematic literature review draws on 40 sources published between 2020 and 2026, combining peer-reviewed literature, government policy documents, blog posts, and professional commentaries. A cross-national comparative lens is applied to examine developments across the four UK nations. Preliminary findings demonstrate an absence of coherent, system-wide strategies for AI adoption in education leadership and inspection. For example, England’s Department for Education has produced an AI toolkit for school leaders (Department for Education, 2025), yet comparable resources are missing in Wales, Scotland, and Northern Ireland. Even in England, major inspection guidance documents (Ofsted, 2025a; 2025b) make no reference to AI use, despite extensive engagement with school leadership and governance. As Hedlund (2025) notes, inspectorates face challenges in adapting traditional processes to account for AI integration. Policy documents across all four nations (Education Scotland, 2023; Estyn, n.d.; Holmes, 2025; Ofsted, 2025c) lack detailed criteria for evaluating AI in schools, leaving school leaders, inspectors, and policymakers exposed to risk. The evidence underscores the need for a rigorous, comparative, and policy-informed investigation into how AI is adopted, used, and evaluated within school leadership and inspection frameworks. Such inquiry is critical to identifying system-level interventions that can support ethical, equitable, and effective use of AI in education. This review contributes to emerging discussions around digital transformation in education by interrogating the readiness of school leadership and inspection systems to engage with GenAI. It offers timely insights for policy and practice, especially in the context of widening digital inequalities and growing pressures for innovation in school governance. Methodology, Methods, Research Instruments or Sources Used This study employed a systematic literature review methodology, using the SPIDER tool (Sample, Phenomenon of Interest, Design, Evaluation, Research type) to guide literature selection and analysis. SPIDER was used both as a search strategy and a framework for critical analysis. Sample: School leaders (including multi-academy trust members, heads and deputies), school inspectors, and inspectorate officials. Phenomenon of Interest: The use of AI in school leadership and inspection across the UK. Design: Peer-reviewed journal articles, government policy documents, grey literature (including blog posts, news articles, and professional commentaries). Evaluation: Views, experiences, user journeys, and policy analysis. Research Type: Mixed methods studies, qualitative and quantitative research, policy documents, blog posts, and media articles. The search strategy used Boolean operators (e.g. “AI in school leadership” AND “inspection” AND “UK”) and generative AI tools such as Google Scholar Lab, which were prompted to return relevant literature (e.g. “Can you find articles that discuss use of AI in school leadership and inspection in the UK?”). In total, 25 peer-reviewed articles and 15 additional artefacts (policy reports, blogs, news features) were selected. Inclusion criteria ensured that journal articles were peer-reviewed and directly related to the research questions. Grey literature was assessed based on its publication outlet (e.g. government portals, reputable organisations) and whether its content was grounded in evidence. Literature that did not meet these criteria was excluded. Following initial screening, the SPIDER tool was reapplied to deepen the analysis of each literature source. The final dataset was then thematically analysed using Braun and Clarke’s (2006) six-phase framework. Conclusions, Expected Outcomes or Findings AI is transforming the organisation and governance of compulsory education across the UK and globally. Yet, this review reveals a substantial knowledge gap concerning how school leaders practically implement and manage AI technologies (Renta-Davids et al., 2025). The fragmented nature of policy across the UK’s four nations leads to inequities in access, assessment, and leadership readiness. These inconsistencies result in duplication of effort and risk inefficiencies in public resource allocation. The evidence suggests that AI holds significant potential to enhance leadership practices. Some school leaders are deploying AI creatively, particularly in administrative and communications roles, while others are hesitant due to lack of guidance and infrastructure. Emerging data indicates that differential access to digital tools is already reinforcing existing educational inequalities within and between systems. The inspection systems, meanwhile, are struggling to catch up. Leadership decisions about AI are shaped by both institutional goals and the expectations of regulatory bodies. Where inspection frameworks do not include AI, schools are left without direction, potentially prioritising administrative convenience over educational value (Williamson & Piattoeva, 2022). Inspectorates have a key role in signalling what counts as safe, ethical, and effective use of AI—yet current guidance is limited or absent (Ofsted, 2025c). Our review highlights the need for: • Nationally coordinated AI leadership strategies, • Inspectorate guidance aligned with equity and inclusion priorities, and • Professional development pathways for both leaders and inspectors on AI integration. Addressing these gaps is essential not only for supporting responsible innovation but also for safeguarding educational equity and quality. Future research should explore how school-level practices can be harmonised with system-wide goals, ensuring that GenAI serves both learning and leadership in equitable ways. References Adams, D., & Thompson, P. (2025). Transforming school leadership with artificial intelligence: Applications, implications, and future directions. Leadership and Policy in Schools, 24(1), 77–89. Baxter, J. (Ed.). (2017). School inspectors: Policy implementers, policy shapers in national policy contexts (Vol. 1). Springer. https://doi.org/10.1007/978-3-319-52536-5 Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa Department for Education. (2025, June 10). Using AI in education: Support for school and college leaders. https://www.gov.uk/government/publications/using-ai-in-education-support-for-school-and-college-leaders Education Scotland. (2023, May 16). Teaching and learning with artificial intelligence (AI). https://education.gov.scot/resources/teaching-and-learning-with-artificial-intelligence-ai/ Ehren, M., & Baxter, J. (2021). Trust, capacity and accountability: A triptych for improving learning outcomes. In M. Ehren & J. Baxter (Eds.), Trust, Accountability and Capacity in Education System Reform (pp. 288–304). Routledge. https://doi.org/10.4324/9780429344855-14 Estyn. (n.d.). Artificial intelligence. https://estyn.gov.wales/artificial-intelligence/ Gökçe, A.T. (2025). Revolutionizing education with AI: Ethical considerations in K-12 settings. IntechOpen. https://doi.org/10.5772/intechopen.1012230 Hedlund, V. (2025, Sept 25). Ofsted inspections and AI: What school leaders need to know. Third Space Learning. https://thirdspacelearning.com/blog/ai-ofsted-inspections/ Holmes, A. (2025). Generative artificial intelligence in the education system. Northern Ireland Assembly. https://www.niassembly.gov.uk/.../education/2725.pdf Ofsted. (2025a). School monitoring operating guide for inspectors: For use from November 2025. GOV.UK. https://www.gov.uk/government/publications/school-inspection-toolkit-operating-guide-and-information/ Ofsted. (2025b). School inspection operating guide for inspectors: For use from November 2025. GOV.UK. Ofsted. (2025c, June 27). How Ofsted looks at AI during inspection and regulation. https://www.gov.uk/government/publications/how-ofsted-looks-at-ai-during-inspection-and-regulation Renta-Davids, A.-I., Camarero-Figuerola, M., & Camacho, M. (2025). Navigating the challenges and opportunities of artificial intelligence in educational leadership: A scoping review. Review of Education, 13(2), e70101. https://doi.org/10.1002/rev3.70101 Royal Society of Chemistry. (2025). 44% of teachers have used AI, but workload remains unchanged. https://www.rsc.org/.../44-of-teachers-have-used-ai-but-workload-remains-unchanged Shrestha, S., & Baxter, J. (2026, in press). School leadership and AI governance in the UK: A comparative perspective. Williamson, B., & Piattoeva, N. (2022). Education governance and datafication: The politics of data and digital technologies in education. Learning, Media and Technology, 47(1), 1–4. 11. Educational Improvement and Quality Assurance
Paper School Leader Perspectives on Sensing, Seizing, and Reconfiguring Instructional Practices in Australian schools La Trobe University, Australia Presenting Author:The science of learning or “learning sciences” refer[s] to a multidisciplinary field of research that incorporates evidence-based practices from child neuroscience, psychology, sociology, behavioural development, and cognitive learning (Chambers, 2020). Insights from the science of learning such as Cognitive Load Theory (see Sweller et al., 2019) and retrieval practice (e.g., Agarwal et al., 2021) provide strong rationales for instructional approaches that are broadly under-utilised in primary and secondary schools in Australia. Despite this, school principals seeking to adopt a whole-school, science of learning approach do so in a contested environment in which some argue whether these ‘evidence-based’ instructional approaches can be universally applied (Sawyer & Hattam, 2025). Therefore, a principal or school leadership team’s decision to adopt such approaches take place in a uniquely political change management space and those contemplating science of learning approaches must be strategic in how they introduce and approach such change. Drawing upon Dynamic Capabilities (DC), this study examines how school principals and leaders recognise the need for change and begin to strategically engage and seize opportunities, mitigating threats, and then begin the reconfiguration of teaching and leadership practices in their schools. This project is a four-year longitudinal investigation into the change processes undertaken by 63 primary and secondary schools that adopt instructional models aligned with the science of learning. The goal is to understand the mechanisms that best support schools in transitioning to these instructional models, and how such changes impact the schools and their students. This multi-stage approach included structured professional learning (PL) content, a visit to a school who had well-established practices and a system of tracking progress over time (e.g., identification of school leader and teacher goals, alongside reflections on their practices). This presentation focuses on interview data collected from principals and school leaders from 50 primary and secondary schools in the state of Victoria in Australia prior to the multi-staged approach and focuses on principal’s perceptions about whole-school change, highlighting their reasons for pursuing change and their insights into the change journey process. For the purpose of this presentation, principal interview data were analysed to address the following research question: How do school leaders sense, seize, and reconfigure teaching and learning practices when engaging with instructional practice reform? Dynamic Capabilities (DC), originating in strategic management, has been widely used to explain how organisations adapt and innovate in changing environments (Teece, Pisano & Shuen, 1997; Teece, 2007). At its core, DC describes an organisation’s ability to integrate, build, and reconfigure resources, routines, and competencies to sustain performance in changing contexts. Teece (2007) further disaggregates DC into three microfoundations: the capacity to (1) sense and shape opportunities and threats, (2) seize opportunities, and (3) maintain competitiveness through enhancing, combining, protecting and, when necessary, reconfiguring resources and routines (p. 1319). Applying DC to school leaders’ decision-making and experiences offers a distinctive theoretical contribution because schools increasingly confront system-level, pedagogical, and workforce pressures (e.g., declining student achievement outcomes, teacher satisfaction and teacher turnover, and shifts toward school-wide instructional approaches), yet the mechanisms through which schools successfully adapt remain under-examined. While research on professional learning (PL) and instructional reform has emphasised the importance of gaining new knowledge, behaviours, skills and practices (Sims et al., 2021), it has offered limited insight into how schools build the internal capabilities required for sustained instructional transformation. DC provides a powerful lens to examine these processes. We conceptualise schools not merely as instructional sites, but as organisational actors capable of developing adaptive capacity. For international readers, this aligns with global debates on whole-school instructional practice (e.g., structured literacy, explicit instruction, cognitive load theory) and how school reform is successfully managed. Methodology, Methods, Research Instruments or Sources Used This study adopts a qualitative multiple-case design involving 50 primary and secondary schools participating in a professional learning initiative focused on building teacher capability in the learning sciences. The schools voluntarily opted into the initiative, indicating a pre-existing motivation in instructional improvement and therefore providing a natural space for examining capability development. Semi-structured interviews with school principals and leadership teams were employed using an interview guide to explore leaders’ motivations and expectations about embedding or enhancing principles of learning sciences into their instructional model. The interviews incorporated prompts regarding decision-making, drivers of change, leadership strategies, engagement with PL, staff responses, and anticipated challenges. Semi-structured interviews were chosen as a way of structuring the narrative while also allowing for flexibility so that participants could discuss topics of specific importance to them. Interviews were audio-recorded and auto-transcribed using REV and were approximately 45 minutes. Participants were offered an opportunity to review and edit their original transcript within four weeks of receipt. After this point, all transcripts were pooled for analysis. Interviews were transcribed verbatim and coded inductively, with subsequent deductive coding aligned to the DC microfoundations of sensing, seizing, and reconfiguring. The utilisation of DC as an analytical framework enabled understanding of school leader decision-making and actions based on the following microfoundations: 1. Sensing. This microfoundation revealed the performance gaps and concerns regarding inconsistent teacher practice (the “teacher lottery”) that prompted a desire for change in instructional approaches. Interview data indicated that principals and leadership teams sensed a need for change based on their student data and observable inconsistencies across classrooms. 2. Seizing. With a focus on mobilising resources to act on change, the school leaders seized structured PL learning to build teacher capability by leveraging targeted modelling of practice from internal and external educational experts so they could action practical strategies in their classroom. While leaders wanted actionable and practical results, they also recognised that a commitment to teacher capabilities would take time. 3. Reconfiguring. Embedding new instructional models, restructuring routines (e.g., daily reviews and engagement norms), pacing implementation, and restructuring the timetable (e.g., literacy blocks) were key actions identified by the leaders as tangible and intangible assets that would give them a competitive edge. By examining the perspectives of 50 school leaders, this study offers insights into how capabilities are framed and developed in school reform processes. Conclusions, Expected Outcomes or Findings Preliminary analysis identified patterns, aligned to each microfoundation, that support instructional reform and adaptive capacity. First, schools differ significantly in their sensing capabilities, particularly in how they interpret data, problematise inconsistency, and recognise instructional opportunities. Schools with stronger sensing capabilities linked reform to equity, student trajectories, and pedagogical purpose, rather than only to accountability metrics. Second, seizing capabilities appear contingent on the availability of key opportunities, yet while structured PL was valuable it was the modelling of practices by experienced and passionate teachers within and outside the school which was key. Internationally, this finding contributes to debates around how PL needs to be strongly aligned and embedded into practice, allowing teachers to make meaningful links between theory and practice. Third, while many schools demonstrated a willingness to seize new instructional approaches, reconfiguring capabilities were approached differently. While most changes were intangible, such as creating new instructional models that provided key strategies and engagement routines, there were also reconfigurations in timetabling (e.g., creating literacy blocks). A mixture of tangible (e.g., curriculum, structured literacy block in timetable) and intangible (instructional models, routines, knowledge) reconfigurations were required for successful implementation. We expect the study to show that the dynamic capabilities microfoundations offer an explanatory framework for understanding school approaches to instructional reform. Rather than attributing implementation success to leadership charisma, professional learning quality, or teacher buy-in alone, DC foregrounds the organisational processes and decision-making through which reform becomes embedded. This contributes to two key international debates: (1) scaling instructional change, particularly considering pedagogical reforms, and (2) sustaining change, where building capability is central. References Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021). Retrieval practice consistently benefits student learning: A systematic review of applied research in schools and classrooms. Educational Psychology Review, 33(4), 1409-1453. Chambers, A. (2020). Key terms to understand the learning sciences. Education Domain Blog. Aurora Institute. https://aurora-institute.org/blog/key-terms-to-understand-the-learning-sciences/ Sawyer, W., & Hattam, R. (2025). Representing science: An own goal?. The Australian Educational Researcher, 1-16. Sims, S., Fletcher-Wood, H., O'Mara-Eves, A., Cottingham, S., Stansfield, C., Van Herwegen, J., & Anders, J. (2021). What Are the Characteristics of Effective Teacher Professional Development? A Systematic Review and Meta-Analysis. Education Endowment Foundation. Sweller, J., van Merriënboer, J. J., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational psychology review, 31, 261-292. Teece, D. J. (2007). Explicating dynamic capabilities: the nature and microfoundations of (sustainable) enterprise performance. Strategic management journal, 28(13), 1319-1350. Teece, D. J., Pisano, G., & Shuen, A. (1997). Dynamic capabilities and strategic management. Strategic management journal, 18(7), 509-533. 11. Educational Improvement and Quality Assurance
Paper Unpacking the Purposes of Data Use for School Improvement Among School Leaders Pontificia Universidad Católica de Valparaíso, Chile Presenting Author:In Europe, as in other parts of the world, data use is key to informing decision-making for school improvement initiatives (Lasater et al, 2019; Meyers et al, 2022). Schildkamp, Karbautzki, and Vanhoof (2014) conducted a comparative study to examine the purposes for which data are used in five European countries (Germany, Lithuania, the Netherlands, Poland, and the United Kingdom). Concerning the use of data for school and instructional improvement, respondents in all countries reported using data for policy development, school improvement planning, teacher development, and instructional improvement. However, in all countries except the United Kingdom, data use appeared to remain at a very superficial level, not moving beyond the monitoring phase (Schildkamp, Karbautzki, & Vanhoof, 2014, p. 22). Against this backdrop, it is relevant to provide evidence on the purposes for which school leaders in Chilean high schools use data. Chile is widely known for an education system characterized by strong accountability mechanisms and extensive use of standardized testing (SIMCE), which influences the purposes of data use (Falabella, 2020; Silva et al., 2022). According to Schildkamp and Kuiper (2010), data use is the process of systematically analyzing the information sources available within schools and applying the results of this analysis to innovate in teaching, curriculum management, and evaluation of these innovations. Through the effective use of diverse data, school leadership teams and teachers can generate knowledge and organizational learning (Lasater et al 2019). School leaders and teachers can use data for different purposes, including school development, instruction, and accountability (Schildkamp, Lai, and Earl, 2013). School leaders play a central role in shaping teachers’ data-use culture and purposes, as well as in establishing a shared vision, norms, and goals for data use in schools. Examining how they understand the purpose of data provides insights into how school practitioners enact assessment policies and how data is used for students learning opportunities Prior studies have shown that school leaders put these purposes into practice by (1) monitoring progress and identifying areas of need, (2) developing and planning policy, (3) evaluating teachers’ performance and supporting teacher collaboration, (4) public relations, and (5) meeting accountability demands (Shildkamp & Kuiper, 2010). The accountability purpose is highly consequential in Chile because the state can close schools if they remain in the Insufficient category for four consecutive years. In Chile’s quasi-market model, standardized test scores (SIMCE) are used by schools to compete for parents' school choice. A voucher system based on enrollment and daily attendance serves as an incentive to use SIMCE results as a marketing tool. The current study was guided by the following research question: For what purposes do school leaders use student assessment data?
Methodology, Methods, Research Instruments or Sources Used This study is part of a broader mixed-methods research project, whose first phase involves a multiple-case study (n=8) (Yin, 2017). Data sources and procedures In the second semester of 2024 and in 2025, school principals were initially contacted to explain the study and invite them to participate. Once this was secured, the schedule for conducting all the data production procedures was arranged with the Head of the Technical Pedagogical Unit (UTP), who also invited teachers from three departments (we requested Spanish, mathematics, and a third department of their choice. Schools selected science or social studies). Data were collected through interviews and observations, and participants read and signed an IRB-approved informed consent. All interviews and observations were audio recorded and transcribed for further analysis. In-depth, hour-long semi-structured interviews were conducted with the school principal (n=8), the UTP (n=8), and individual interviews with three heads of departments (language, math, and either science or social studies (n=24). Questions covered their trajectory at the school, school improvement priorities, structures for teacher collaboration, their assessments of their own and teachers’ data literacy skills, attitudes toward using data to inform instructional decision-making, and the data used by school leaders and the purposes for which it is used. Although we used a structured interview protocol, these interviews share the limitations inherent in self-reported data, including potential participant bias and self-censorship. We also observed department meetings (n=25). The UTP was asked to arrange the observation, where teachers would analyze data. The conversations were audio recorded, and the researchers took field notes to document the activities conducted, the roles of various participants, turn-taking, how the meeting’s purpose was communicated, issues raised, and levels of agreement and dissent among teachers as they discussed those issues. Follow-up group interviews were conducted with teachers who had attended the meetings observed(n=8). For each of the three departments, UTP invited two or three teachers to participate in an hour-long group interview (n=37 teachers). Questions addressed the extent to which the observed department meeting was typical of their data use, how they evaluated the effectiveness of that meeting, and the decisions made based on their analysis. Data analysis The data were first coded by two researchers using the theoretical framework of data purposes developed by Shildkamp and Kuiper (2010). Codes were then compared among the researchers to reach agreement on shared codes and categories (Patton, 2002). Conclusions, Expected Outcomes or Findings Consistent with the international literature, we identified the same three primary purposes of data use (Schildkamp & Kuiper, 2010). These purposes are not mutually exclusive; rather, they are often combined in creative ways. Despite contextual differences between Chile and Europe, where schools generally have greater autonomy, rely less on standardized testing, and emphasize self-evaluation as a driver of improvement, these three purposes are observed across all eight cases (Schildkamp et al., 2014; Vanari et al., 2025). However, given the characteristics of the Chilean education system, a fourth purpose emerged in two of the eight case studies: the use of data to obtain salary-related benefits. Although this purpose may initially resemble accountability, it differs in nature, as it is not oriented toward responding to external demands (Parcerisa, 2021). The use of data differs between the two cases. In one case, it is explicitly acknowledged; for example, one teacher stated: “I think we analyze data because we lost the incentive. If you had conducted this same study last year, when we had the financial incentive, and now we do not, we would not be analyzing data.” In contrast, in the other case, this purpose is more institutionally masked; nevertheless, teachers also refer to it, stating: “The incentive issue still concerns us a lot—at the end of the day, why lie about it? In Chile, as in studies conducted in Europe, three main uses of data are identified: school development, instruction, and accountability (Schildkamp et al 2013). However, given the idiosyncratic characteristics of the Chilean context, a fourth, economic purpose is added. Using data to position the school in a category that provides teachers with extra income is linked to performance-based incentive schemes, which are embedded within the broader dynamics of marketization that characterize the Chilean education system (Falabella, 2020; Author, 2015). References Author (2015) Falabella, A. (2020). The ethics of competition: accountability policy enactment in Chilean schools´ everyday life. Journal of Education Policy, 35(1), 23-45. Lasater, K., Albiladi, W. S., Davis, W. S., & Bengtson, E. (2019). The data culture continuum: An examination of school data cultures. Educational Administration Quarterly, 56(4), 533-569. Meyers, C. V., Moon, T. R., Patrick, J., Brighton, C. M., & Hayes, L. (2022). Data use processes in rural schools: management structures undermining leadership opportunities and instructional change. School Effectiveness and School Improvement, 33(1), 1-20. Parcerisa, L. (2021). To align or not to align: The enactment of accountability and data-use in disadvantaged school contexts. Educational assessment, evaluation and accountability, 33(3), 455-482. Patton, M. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage Schildkamp, K., & Kuiper, W. (2010). Data-informed curriculum reform: Which data, what purposes, and promoting and hindering factors. Teaching and teacher education, 26(3), 482-496. Schildkamp, K., Karbautzki, L., & Vanhoof, J. (2014). Exploring data use practices around Europe: Identifying enablers and barriers. Studies in educational evaluation, 42, 15-24. Schildkamp, K., Lai, M. K., & Earl, L. (2013). Data-driven decision making around the world: Challenges and opportunities. Dordrecht: Springer. Silva, L., Contreras, J. & Manzi, J. (2022). Evidence-Informed practice of standardized assessments: The case of Chile. In C. Brown & J.R. Malin (Ed.) The Emerald handbook of evidence-informed practice in education (pp. 153-165). Leeds, UK: Emerald Publishing Limited Vanari, K., Reinaru, D., & Eisenschmidt, E. (2025). Data use for school self-evaluation–The process, factors, and leadership practices in Estonian schools. Studies in Educational Evaluation, 85, 101465. | ||