Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
Please note that all times are shown in the time zone of the conference. The current conference time is: 10th May 2025, 09:02:35 EEST
|
Session Overview | |
Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Cap: 32 |
Date: Wednesday, 28/Aug/2024 | |
17:30 - 19:00 | 32 SES 08 B: School Leadership Research in Organizational Education Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Session Chair: Michael Göhlich Paper Session |
|
32. Organizational Education
Paper Improving digital Leadership Skills in traditional Organizations: School Administration and Principals co-design new Settings for Communication to challenge Uncertainty. FAU Erlangen-Nürnberg, Germany Presenting Author:The uncertainties surrounding advancements in school improvement are closely connected with three primary dimensions: (1) A global aspect that shapes the educational system through disruptive crises such as pandemics, wars, and migrations, along with ongoing digital and social transformations (Kushnir 2021). Educational institutions find themselves contending with and addressing the complexities presented by this global dimension of uncertainty in their daily undertakings. This encompasses challenges such as the integration of refugees, the formulation of homeschooling protocols amidst pandemics, and the integration of digital tools and skills into the realms of learning, and organizational procedures. In the hope of managing school quality through data and external evaluation, “external evaluation” was introduced as a new actor in the German administration after PISA 2000 - in addition to administrative supervisors and without a common focus between the two institutions (Diedrich 2020). The introduction of external evaluation introduced evidence and standardization as the main paradigms for school development, hence the effectiveness of school evaluation has not been conclusively proven (Malin et al. 2020, Schmidt 2020). Those significant effectiveness problems describe a (3) third dimension of uncertainty that affects school leaders' decision-making and influences communication and cooperation between school administration, school evaluation, and principals (Kallenbach 2023). These three dimensions of uncertainty describe a real VUCA (volatility, uncertainty, complexity ambiguity) environment especially for principals. To face these systemic adversities, in the presented project school administration and researchers work within a research-practice partnership (RPP) together with stakeholders involved in school advice and support. The aim of this multi-stakeholder partnership is to create an experimental field for the coordination of decision-making for a real problem: the design of new frameworks for the discussion and processing of school evaluation results between all relevant stakeholders, including the perspectives of science. From an organizational education (OE) perspective, the RPP will help to decide from a wider point of view by sharing perspectives and reflecting structures. On the micro-level (Göhlich et al 2018), we aim to establish new forms of collaboration and communication by elaboration and experience within the project. A main element of the development process are design-thinking workshops to create prototypes for feedback setting to discuss external evaluation results with all stakeholders. Design-Thinking (Brown 2008, Mintrop 2016) opens a new and not yet established perspective in the field of school improvement. It structures a participative and iterative process, involves all stakeholder perspectives and focuses on creating new ideas, tryouts, and continuous improvement. In contrast, previously dominant strategies of new public management reforms focused on evidence, such as the introduction of school evaluation in the early 2000s, but brought to light systemic contradictions (Hangartner & Svaton 2020) that hinder decision-making, management and control of school development processes. In our work, we focus on explicit individual sense-making processes, experiences, and tensions in communicative settings and moderated sessions. The design is inspired by principles of network structures and distributed decision-making such as Sociocracy and Holacracy (Robertson 2016, Rau & Koch-Gonzalez 2018). Researchers and school administration establish a participative process that brings new work methods into a hierarchical structure. This approach can be understood as an attempt to disrupt the familiar and established system routines of task distribution, communication and decision-making. Communication and decision-making are main topics and practices in the RPP. The process focuses on three aspects: clarity about roles and related accountabilities, common rules about cooperation and communication, and shared goals. The project mainly addresses the uncertainties within the organizational structure. Clarifying roles, collaboration rules, and goals opens up the potential for successful leadership actions in the VUCA world, such as "Response-ability," "Judgment," "Decision-making," "Question the taken-for-granted," and "Critical thinking" (Elkjaer 2022). Methodology, Methods, Research Instruments or Sources Used In the context of our research-practice-partnership (RPP), we work with a mixed method design and have different roles in the development process – as (a) facilitators, advisors and experts, and (b) as researchers. As experts, advisors, and facilitators, we co-design fieldwork with practitioners, supporting them in analyzing, planning, and carrying out the process. In the project's development setting and workshops with stakeholders, we use design thinking (Brown 2008, Mintrop 2016) as a participative and reflexive framework for co-creative problem solving. It helps us to loosen up the atmosphere for collaboration and to promote stakeholder interaction. For supervision, guidance, and moderation, we use techniques to visualize (e.g., system mapping) and to focus on listening (e.g., round speak, Rosenbrand 2017). From the research perspective, we work as ethnographers, observing stakeholders and administrative leaders in their communication, negotiation, and actions throughout the process. In addition to our observation and note-taking in the field, we take audio-documentations in all steps of the process, including planning sessions with the administrative principals. These in-situ documents are interpreted using the documentary method (Bohnsack et al. 2007, Zala-Mezö et al. 2021) with a focus on contextual research (Goldmann 2021). Contextual research can help analyze various institutional norms that are nested within each other and interact with one another (Jansen & Vogd 2017, Goldmann 2021). It primarily focuses on structures and processes, rather than habits, as documentary methods usually do. Since contradictions are constitutive for schools as organizations, valuable practice consists of negotiation and discourse (Rachenbäumer & Bremm 2021). In our research, we will particularly analyze in-situ sequences of decision-making processes. Although decisions are mainly provoked by external uncertainty (global uncertainty and its local consequences or uncertainty concerning the basis for a decision), decision-making processes refer to tensions or uncertainties in the organizational system (uncertainty about goals, roles, and processes of participation and decision-making). As a wider framework for the interpretation of our sources, convention theory (Storper & Salais 1997, Diaz-Bone 2022) serves to enrich our contextual research. We are in the process of setting up the cooperation project between FAU and the federal school administration. Our working sessions with the stakeholders will start in March 2024, and the design-thinking workshop will be in May 2024. So far, we have observed and analyzed decision-making in the planning process between researchers and persons responsible in administration, which might be a side aspect of our organizational research. Conclusions, Expected Outcomes or Findings In our research project, we aim to identify critical communication and collaboration situations through the observation of collaboration in the field and documentary analysis of in-situ documents. Our goal is to characterize leverage points that contribute to establishing clarity in roles, goals, and collaboration between school administration, school evaluation, and principals. As moderators and facilitators, we employ methods that address co-creativity and participation, sharing of needs and perspectives, and knowledge management 'to deliver actionable knowledge' (Palavicino et al. 2023). Interventions shall help make leverage points visible. We offer tools that support to sharpen focus on system structures, discuss tensions, goals transparency, and self-organization. They refer to practices that promote Transformative Innovation Policy. (Palavicino et al. 2023). In the research-practice-partnership, all actors involved experience how decisions can be made in uncertain and basically contradictory organizational structures. We expect to describe leverage points in cooperation between school administration, school evaluation, and school leaders more precisely by analyzing the in-situ documents. We want to offer knowledge and guidelines to use these leverage points for organizational learning and wayfinding. Within our project, we will design tools that help actors in complex, uncertain, and contradictory organizational structures to negotiate and collaborate in innovation and decision-making processes. Our goal is to create and combine tools that enable leaders and teams to seriously integrate perspective sharing, communication about goals and tensions, co-creation, and open-mindedness into their routines. And to face the wider organizational context and interdependencies. The tools need to be easy to structure and easy to use to foster self-organized and democratic practices in educational organizations. Our tools and guidelines may help establish those basic structures in complex situations in the field of education leaders and administrators and open up the chance to expand horizons and form new purposes and answers (English 2023, Dewey 1916/2008). References Alvial Palavicino, C., Matti, C., & Brodnik, C. (2023). Co-creation for Transformative Innovation Policy: An implementation case for projects structured as portfolio of knowledge services. Evidence & Policy, 1–17. Bohnsack, R. (2007). Die dokumentarische Methode und ihre Forschungspraxis (2. Aufl.). Verlag für Sozialwissenschaften. Brown, T. (2008). Design Thinking. Harvard Business Review. Diaz-Bone, R. (2022). Soziologie der Konventionen. In H. Delitz (Hrsg.), Soziologische Denkweisen aus Frankreich (S. 471–493). Springer. Elkjaer, B. (2022). Taking stock of “Organizational Learning”: Looking back and moving forward. Management Learning, 53(3), 582–604. English, A. R. (2023). Dewey, Existential Uncertainty and Non-affirmative Democratic Education. In M. Uljens (Hrsg.), Non-affirmative Theory of Education and Bildung (Bd. 20, S. 139–158). Springer International Publishing. Göhlich, M., Novotny, P., Revsbark, L., & Schröer, A. (2018). Research Memorandum Organizational Education. Studia Paedagogica, 23(2), 205–215. Kallenbach, L. (2023). Evidenzbasierte Schulentwicklung als mehrdimensionale Spannungsbearbeitung. Ein übergeordneter Erklärungsansatz für anhaltende Wirksamkeitsprobleme. Zeitschrift für Bildungsforschung, 13(1), 109–126. Klein, E. D., & Bremm, N. (Hrsg.). Unterstützung – Kooperation – Kontrolle: Zum Verhältnis von Schulaufsicht und Schulleitung in der Schulentwicklung. Springer. Kushnir, I. (2022). The Role of the European Education Area in European Union Integration in Times of Crises. European Review, 30 (3), 301–321. Leemann, R. J., & Imdorf, C. (2019). Das Potenzial der Soziologie der Konventionen für die Bildungsforschung. In C. Imdorf, R. J. Leemann, & P. Gonon (Hrsg.), Bildung und Konventionen (S. 3–45). Springer. Malin, J. R., Brown, C., Ion, G. van Ackeren, I., Bremm, N., Luzmore, R., Flood, J. & Rind, G. M. (2020). World-wide barriers and enablers to achieving evidence-informed practice in education. What can be learnt from Spain, England, the United States, and Germany? Humanities and Social Sciences Communications, 7 (1), 1–14. Mintrop, R. (2016). Design-based school improvement: A practical guide for education leaders. Harvard Education Press. Robertson, B. (2016). Holacracy. The Revolutionary Management System That Abolishes Hierarchy. Penguin. Rau, T., Koch-Gonzalez, J. (2018): Many Voices One Song: Shared Power with Sociocracy. Sociocracy For All. Schmidt, M. (2020). Wirksame Unbestimmtheit, unbestimmte Wirksamkeit: Eine diskursanalytische Untersuchung zur Schulinspektion. Springer. Zala-Mezö, E., Häbig, J., & Bremm, N. (Hrsg.). (2021). Die Dokumentarische Methode in der Schulentwicklungsforschung. Waxmann. 32. Organizational Education
Paper Relationships between Principals' Self-efficacy related to Work and Transformational Leadership 1HEP Vaud, Switzerland; 2Université du Québec à Trois-Rivières, Canada; 3Université Laval, Canada Presenting Author:According to the Conseil Supérieur de l'Éducation (1999) of Quebec’s jurisdiction, school principals have different responsibilities: educational, political, community and administrative. They must manage the resources at their disposal, and exercise the functions and powers delegated to them by the School board (Gouvernement du Quebec, 2024). According to Sergiovanni (2001), they could be considered as the most influential person within their school. In school administration, leadership can be conceived as all the practices and behaviors of principals that influence the members of the school (Legendre, 2005). Leadership influences the implementation of change (Bateh et al., 2013) and the commitment of students and teachers (Leithwood et al., 2008). As far as leadership is concerned, Bass' transformative leadership is one of the most widely used theories in education. He defines leadership as an interaction during which an individual increases the motivation or skills of his group (Bass & Bass, 2009). The effect of this leadership is to provide creative and productive working conditions that encourage teachers (Leithwood et al., 2008). McCormick et al. (2002) mention that Bandura (2007) describes an individual with a high self-efficacy in the same way that Bass (Bass & Bass, 2009) describes an effective transformative leader. They explain that the effective leader is characterized by commitment, determination, and effectiveness in solving difficulties. Bandura (2007) defines self-efficacy as an individual's belief in his ability to perform a certain task. He specifies that it’s the individual's belief in his ability to organize and execute the course of action required to produce desired results. Self-efficacy is influenced by the complexity and specificity of the profession. It must therefore be defined and studied in relation to jobs or individuals who share a common denominator (Cherniss, 1993). Tschannen-Moran and Gareis (2004) consider that principals’ self-efficacy related to work is a judgment on their own ability to structure a particular course of action in order to produce the desired results in the school they lead. The aim of this study is to examine the relation between self-efficacy related to work and the transformative leadership of Quebec school principals. Research exists on the relation between these variables among principals, mostly in the USA. Daly et al. (2011) indicates some positive and negative relationships between certain self-efficacy dimensions and different factors in the transformational and transactional dimensions, as well as the laissez-faire dimension. However, not all relationships are significant. Marín's research (2013) indicates that certain self-efficacy dimensions explain up to 74% of the variance in transformational leadership practices. He mentions that principals who report a high self-efficacy seem to be more engaged in transformational leadership practices. However, no research seems to focus specifically on the population under study, namely Quebec’s French speaking school principals. Moreover, the results of previous studies seem to lack clarity of the relation (positive or negative) between the variables. Consequently, the research problem lies in the lack of understanding of the relation between self-efficacy and leadership among Quebec’s French speaking school principals. One hundred and twenty-six Quebec French speaking principals responded to the self-efficacy school principal scale (Fernet et al., 2009) and the self-reported leadership scale by Dussault et al. (2013). The results reveal that there is relation between some dimensions of the self-efficacy related to work and different factors of the transformational and transactional dimensions of transformational leadership, with correlations ranging from 0.22 to 0.46. The results also indicate that the dimensions of self-efficacy related to work were not related to the laissez-faire dimension of transformational leadership. These results are discussed in light of Bandura's (2007) self-efficacy and Bass' transformational leadership theories (Bass & Bass, 2009) as well as previous studies. Methodology, Methods, Research Instruments or Sources Used The present research aims to examine the relation between self-efficacy related to work and transformational leadership in principals. A correlational design is used. The chosen sampling method is non-probabilistic. Quebec’s French speaking school principals were invited, via an online survey platform, to complete a questionnaire comprising, among other things, sociodemographic questions, the school principal self-efficacy scale (Fernet et al., 2009) and the self-reported leadership scale of Dussault et al. (2013). One hundred and twenty-six questionnaires were completed. The sample consisted of 77 principals (61%) and 47 assistant principals (37%), with two respondents not indicating their professional status (2%). Eighty-seven respondents were women (69%), while 37 were men (29.4%). Two respondents indicated that they belonged to an "Other" gender (1.6%). Their ages ranged from 32 to 66 (M = 47.54). For the Fernet et al. 2009 scale, the internal consistency (Cronbach alpha) is .76 for the administrative management dimension, .81 for the personnel management and pedagogical leadership dimension, .76 for the external relations management dimension. As for the self-reported leadership scale of Dussault et al. (2013) concerning the transformational dimension, the internal consistency is .78 for charisma, .75 for intellectual stimulation and .77 for personal recognition. For the transactional dimension, the internal consistency is .83 for the contingent reward factor and .80 for management by exception. Finally, the laissez-faire dimension has an internal consistency of .66. The results consists of descriptive statistics (mean, standard deviations, kurtosis, skewness) and correlation. Conclusions, Expected Outcomes or Findings This research indicates that self-efficacy is, among others, one of the potential causes that can influence the transformational leadership of Quebec’s French speaking school principals. These results contribute to the importance of training principals through a university program. Indeed, it would be advisable to emphasize professional integration to reinforce peer training, mentoring and networking. As Cattonar et al. (2007) indicate, this would enable principals to develop their self-efficacy related to work through various sources, including their vicarious experiences (Bandura, 2007). Similarly, leadership training remains a must. Bass and Avolio (1990) indicate that leadership skills can be acquired. It therefore seems appropriate to encourage transformational and transactional leadership practices that can lead to an effective school. (Marzano et al., 2016). The study has certain limitations relate to the lack of available empirical literature, the research design, the sample, and the self-reported measurement of concepts. In terms of future research, it would seem worthwhile to plan repeated-measures research and to verify the factor structure of the different questionnaires to overcome certain limitations of this study. Finally to avoid social desirability bias, it would seem appropriate to carry out this research with teachers and principals. This would enable us to observe principal leadership from a teacher's perspective. References Bandura, A. (2007). Auto-efficacité : le sentiment d’efficacité personnelle (2nd ed.). De Boeck. Bass, B. & Avolio, B. J. (1990). Developing transformational leadership: 1992 and beyond. Journal of European industrial training, 14(4), 468‑478. Bass, B. & Bass, R. (2009). The Bass handbook of leadership: Theory, research, and managerial applications. Free Press. Cattonar, B., Lessard, C., Blais, J.-G., Larose, F., Riopel, M.-C., Tardif, M., … Wright, A. (2007). Les directeurs et les directrices d’école au Canada: contexte, profil et travail. Enquêtes pancanadiennes auprès des directions et des enseignants d’écoles primaires et secondaires (2005-2006). Chaire de recherche du Canada sur le personnel et les métiers de l’Éducation. Cherniss, C. (1993). Role of professional self-efficacy in the etiology and amelioration of burnout. In T. Schaufeli, W. B., Maslach, C., & Marek (Eds.), Professionnal Burnout: Recent developments in theory ans research (pp. 135‑143). Taylor et Francis Group. Conseil supérieur de l’éducation. (1999). Diriger une école secondaire: un nouveau contexte, de nouveaux défis. Conseil supérieur de l’éducation. Daly, A. J., Der-Martirosian, C., Ong-Dean, C., Park, V., & Wishard-Guerra, A. (2011). Leading under sanction: Principals’ perceptions of threat rigidity, efficacy, and leadership in underperforming Schools. Leadership & Policy in Schools, 10(2), 171‑206. Dussault, M., Frenette, É., & Fernet, C. (2013). Leadership: Validation of a self-report scale. Psychological Reports, 112(2), 419‑436. Fernet, C., Austin, S., & Dussault, M. (2009). L’importance de la spécificité des rôles professionnels lors de l’évaluation de la perception d’efficacité personnelle des directions d’école. Paper presented at 31 Colloque de l’ADMEE. Québec. Gouvernement du Québec. (2024). Loi sur l’instruction publique. Recueil des lois et des règlements du Québec. Leithwood, K. Harris, A. et Hopkins, D. (2008). Seven strong claims about sucessful school leadership. School Leadership and Management, 28(1), 27-42 Marín, J. R. (2013). The relationship between ethnicity, self-efficacy, and beliefs about diversity to instructional and transformational leadership practices of urban school principals. (Doctoral dissertation). University of Southern California. Marzano, R. J., Waters, T., & McNulty, B. A. (2005). School leadership that works: From research to results. Association for Supervision and Curriculum Development. McCormick, M. J., Tanguma, J., & Lopez-Forment, A. S. (2002). Extending self-efficacy theory to leadership: A review and empirical test. Journal of Leadership Education, 1(2), 34‑49. Sergiovanni, T. J. (2001). The principalship : A reflective practice perspective (4th ed.). Allyn and Bacon. Tschannen‐Moran, M. & Gareis, C. R. (2004). Principals’ sense of efficacy. Journal of Educational Administration, 42(5), 573‑585. 32. Organizational Education
Paper Middle leaders, School Uncertainty and Organizational Learning Ben-Gurion University, Israel Presenting Author:A school is a stable organization that usually knows how to manage in its uncertain environment. For example, during the Covid-19 pandemic, despite the difficulties, many schools increased their budgets, recruited temporary staff, promoted teachers’ digital literacy, and introduced online platforms (Reimers & Schleicher, 2020). One of the factors enabling this stability is the middle leaders (MLs). MLs are teachers who also perform part-time administrative roles, such as subject leader and head of year. Their primary tasks are coordinating the curriculum, scheduling exams, developing teachers’ professional skills, and monitoring students’ achievements and behavior (De-Nobile, 2021). Positioned as mediators between senior management and teaching staff, MLs facilitate information flow and promote organizational learning, which can reduce uncertainty and foster stability and order in the school. Organizational learning is the process whereby individual personal knowledge becomes organizational knowledge (Argyris & Schön, 1996). According to this theory, such a process contains two kinds of learning. Single-loop learning is learning that uses existing knowledge, norms, policies, and strategies to correct errors. Double-loop learning is learning that not only seeks to solve a problem but also to question and change the basic norms and assumptions that create it. Both forms of learning are essential for organizational functioning. However, in times of uncertainty, engaging in double-loop learning can be a significant advantage in clarifying organizational routines and enhancing the organization’s ability to answer internal and external expectations. In addition, it can lead to a better understanding of the sources of problems, and provide the organization with innovative solutions that better suit its goals. However, double-loop learning can also be challenging to implement because it requires a collaborative climate, reflection, and openness to change, which run counter to the usual organizational culture of competition and success by any means (Senge, 1990). While it has already been found that MLs are essential for school management, it is still unclear how they contribute to organizational learning. The present study seeks to delve deeper into this topic, and understand how MLs influence organizational learning and school uncertainty. Preliminary findings indicate that MLs often engage in single-loop learning, which primarily focuses on immediate problem-solving or what they term “putting out fires” and “patching up holes”. Such learning involves identifying and addressing problems swiftly to prevent escalation. For instance, in one case, the grade-level coordinator told us how she stepped in to teach a class in the absence of a subject teacher, thereby reducing the immediate disruption and maintaining the educational routines. However, the findings show that this order is temporary since the same problems arise again the next day with another teacher. In addition, we did not find indications of double-loop learning. Following the previous example, the grade-level coordinator did not look for the reasons for teacher absenteeism, at the organizational routine of checking the teachers’ attendance, or the reward system accompanying attendance and absence. In another case, the subject coordinator told us that she did not know how to promote a bad teacher. The coordinator can see that he is trying, he prepares, works, and asks for help, but she does not know how to guide him to connect with the students, partly because she does not know the background to his difficulties, and how to provide him with professional guidance so he can improve. In other words, she knows what the problem is but does not know how to break it down, examine its components, and reassemble them in a way that suits the teacher, the students, and the school. Methodology, Methods, Research Instruments or Sources Used The present multiple-case study was conducted from 2021 to 2022 to better understand a complex phenomenon (Yin, 2018), in this case, the MLs’ contribution to organizational learning. Four large, high-achieving Israeli high schools attended by more than 1,000 students, were studied. These schools, led by principals with at least three years of leadership seniority, varied in aspects of sector (state-secular and state-religious), district (south and center), and student demographics (medium and high SES). A team of four researchers collected the data. They conducted semi-structured interviews with four school principals and 61 middle leaders, specifically subject and grade-level coordinators. These MLs hold broad responsibility for all the students, and lead a team of teachers teaching mandatory subjects such as language, English, and mathematics, or specific age groups (respectively). In addition to interviews, the research team observed 33 team and management meetings, and collected relevant documents such as school schedules and work plans. All collected data, including audio recordings of interviews and meetings, were transcribed, and securely stored in a protected digital folder accessible only to the research team. The data was analyzed both inductively and deductively using Dedoose software. The inductive analysis involved examining all the data to develop categories and subcategories, and grouping the main recurring themes in the interviews. For instance, categories such as decision-making processes and problem-solving strategies among MLs were identified. Concurrently, a deductive analysis was performed in accordance with the conceptual framework of organizational learning theory (Argyris & Schön, 1996), which focuses on single-loop learning and double-loop learning. Ethical standards were maintained by presenting the research objectives to the interviewees, protecting their privacy and anonymity, and obtaining their informed consent. Conclusions, Expected Outcomes or Findings We conclude that the MLs focus on single-loop learning, and play a pivotal role in maintaining organizational order and stability. This often leads to mere school survival, as expected from the school environment, but less to double-loop learning, which can clarify school uncertainty. It is interesting to note that the MLs present great confidence in their role, and know exactly what to do. In fact, the better they understood how to perform what was expected of them, the less they engaged in double-loop learning. For example, the greater the pressure from the senior management to prepare the students well for exams, the fewer questions were asked about exams as a valid and reliable measure to test the students’ knowledge. This leads us to another conclusion, that the short-term effectiveness of single-loop learning inhibits engagement in double-loop learning. This means that the effectiveness and immediacy of MLs in problem-solving often reduce the perceived need or motivation to engage in double-loop learning. Such learning, though more challenging, can improve the school and even reduce uncertainty. However, it might create a different form of ambiguity as it changes well-known assumptions, rules, and routines. This conclusion helps to explain the complexities involved in implementing change within schools. This study has theoretical and practical contributions. Theoretically, it offers new insights regarding the nature of MLs and their role in navigating uncertainty and preventing crises within the school. Moreover, it emphasizes the importance of balance in organizational learning. It is not either immediate problem-solving in single-loop learning or long-term deep learning in double-loop learning, but a combination that requires a lot of practice. The practical contribution is a guideline for MLs’ professional development program that emphasizes such a combination: how to do both– promote clarity by problem-solving, and innovative system thinking by engaging in double-loop learning. References Argyris, C., & Schön, C. (1996). Organizational Learning II. Theory. Method and Practice. Addison-Wesley Publishing Company. De-Nobile, J. (2021). “Researching middle leadership in schools: the state of the art”. International Studies in Educational Administration, 49(2), 3-27. Reimers, F., & Schleicher, A. (2020). Schooling disrupted, schooling rethought. How the Covid-19 pandemic is changing education. OECD. https://globaled.gse.harvard.edu/files/geii/files/education_continuity_v3.pdf Senge, P. M. (1990a). The Fifth Discipline: The art and practice of the learning organization. Doubleday Currency. Yin, K. R. (2018). Case Study Research and Applications: Design and Methods (6rd ed.). Sage Publications. |
Date: Thursday, 29/Aug/2024 | |
9:30 - 11:00 | 16 SES 09 B: Artificial Intelligence in Education Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Session Chair: Stefanie A. Hillen Paper Session |
|
16. ICT in Education and Training
Paper A Systematic Review of Empirical Research on Students’ ChatGPT Use in Higher Education University of Stavanger, Norway Presenting Author:This review aims to synthesize empirical research evidence on student’s use of ChatGPT in higher education, emphasizing pedagogical possibilities and addressing emerging threats and challenges. Chat Generative Pre-Trained Transformer (ChatGPT) swiftly gained prominence as an open-access tool in higher education since its introduction in November 2022. It has rapidly become widely used across various domains, including higher education. The use of ChatGPT is still an emerging area, with a surge in studies reflecting its widespread adoption. As higher education institutions grapple with the integration of ChatGPT, concerns and opportunities abound. This review focuses on understanding the impact dimensions on students' use of ChatGPT, particularly considering the evolving landscape of their learning processes. While ChatGPT use is a relatively new practice, research into it is an emerging area for researchers. However, there are still several studies that have been published in such a short time, because of the substantial use of it across the world and in every domain of life including higher education institutions by teachers, students, and administrators. In our systematic review, we examine the impact dimensions on students’ use mainly because of the increasing concerns about how they use it and how this might influence their learning. Initial studies have also explored potential benefits of ChatGPT in language learning within higher education contexts (Baskara,2023). While educational technologies driven by artificial intelligence (AI) are progressively used to automate and provide support for various learning activities (Cavalcanti et al., 2021;), recent research has focused on the impact of ChatGPT, identifying challenges and opportunities in learning, but they have not examined this within the higher education sector (Lo, 2023). The ongoing debate surrounding ChatGPT's use in higher education presents varying perspectives. These concerns and benefits create different perspectives where some argue for its use freely and suggest that graders need to create more critical assigned tasks that require personalized and contextualized examples and justifications which may not directly be generated by ChatGPT, while others argue against its use or its use with caution by students (Tlili et al., 2023). Also, many higher education institutions have started to apply restrictions or ban ChatGPT’s use by students in their updated policy documents. On the other hand, a review of media news articles on how ChatGPT use can disrupt students’ learning and teaching in universities also revealed that the sentiment in media news is on more into the negative discourse than a positive one, hence highlighting the public discussions and university responses on such controversies about academic integrity (Sullivan et al., 2023). There are also those who believe we need to add new components in the process of assessment including verbal exams where students demonstrate their verbal ability to present the assignment that they generate (Rudolph et al., 2023). There are several issues that emerge in the first year of the use of ChatGPT reported and discussed in the published research. However, despite the increasing body of research on ChatGPT in higher education, there is no systematic review that provides a comprehensive overview of what research has found. Therefore, it is timely to present a consolidated overview of the impact dimensions of the ChatGPT’s use and the potential implications for higher education. More specifically, in this review, we sought answers to the following research questions: RQ 1: What are the defining characteristics of empirical research on ChatGPT in higher education? RQ 2: What pedagogical possibilities and insights can we gain from the students’ use of ChatGPT in the context of higher education? Methodology, Methods, Research Instruments or Sources Used To address our research questions, we employed a systematic review approach, following guidelines by Page et al., (2022). The methodological framework guided our process, involving literature search, study identification, data extraction/study coding, study quality appraisal, and thematic analysis. The literature search, conducted on November 10th, 2023, targeted three databases—ERIC, Scopus, and Web of Science—chosen for their extensive coverage of educational studies. The search string, incorporated terms such as "chat generative pre-trained transform*" OR "gpt*" AND "higher education*" OR "universit*" OR "college*." The following inclusion and exclusion criteria were used to identify relevant studies: • Population: Students in higher education. • Concept: Students' use of ChatGPT. • Context: Higher education settings. • Types of studies: Primary research with data. • Publication language: Studies presented in full text in English. • Time of publication: Studies published after the introduction of ChatGPT in November 2022. Studies addressing other aspects, like performance testing or comparisons between teacher and ChatGPT feedback, were excluded. After eliminating duplicates, a two-stage screening process involved reviewing titles and abstracts, followed by full-text examination, with disagreements resolved through discussion. Using EPPI-Reviewer Web, the second author extracted information about each study, including characteristics such as country, research question, study design, research method, study informants, field of study, and study purpose. Findings were also extracted to identify common themes, and the third author reviewed and updated the extracted data for accuracy. Thematic analysis facilitated data synthesis and theme derivation. The analysis team, consisting of three authors, undertook a stepwise process, beginning with data extraction, followed by inductive coding, and subsequent theme generation through co-author discussions. Rigor was maintained through continuous challenge and validation of assumptions and potential biases by the third author. The Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018) in EPPI Reviewer assessed the methodological quality of each included article. This tool, designed for various study types, involved screening questions and additional criteria for assessing quantitative, qualitative, and mixed-method studies. Ratings ('yes,' 'no,' or 'can't tell') were independently assigned by the second and third authors, with disagreements resolved through discussion. Studies with quantitative (randomized control trial), quantitative (non-randomized), and mixed-method designs were omitted from the MMAT's checklist as they were not present in the reviewed studies. Conclusions, Expected Outcomes or Findings Eight studies were identified through a comprehensive literature search in three databases in October 2023, employing various research designs. The analysis revealed four overarching themes: 1) promoting students' learning and skill development; 2) providing content and immediate feedback; 3) activating motivation and engagement; and 4) addressing ethical aspects of ChatGPT use. The results in our review show that ChatGPT might function as an effective tool to provide timely scaffolding by offering precisely enough assistance to empower students to eventually complete their tasks autonomously. Consistently, studies highlight positive impacts, acknowledging ChatGPT for improving writing skills, promoting personalized learning, and facilitating self-directed learning. ChatGPT's role in providing feedback is essential, offering real-time assistance to enhance writing and deepen understanding. This feedback enriches the teaching and learning experience, fostering connection. Findings indicate students view ChatGPT as a motivational tool, recognizing its role in minimizing affective barriers, reducing stress during assignments. Positive perceptions encourage usage, emphasizing teachers' role in enhancing perceived usefulness. However, concerns include potential ethical issues, plagiarism, unauthorized information ownership, and the risk of impeding creativity and critical thinking. Some studies express concerns about blind reliance, potentially slowing actual learning progress. The systematic review suggests practical implications. Clear guidelines, workshops, and ethical ChatGPT use promotion in higher education institutions are recommended. Essential training programs for students and teachers, emphasizing responsible use, are crucial. Redefining assessment policies, aligning with the assessment for learning approach and incorporating multiple evaluation points throughout the course, is advised. In conclusion, the systematic review recognizes the evolving landscape of ChatGPT's integration into higher education and aims to provide a consolidated overview of its impact dimensions and potential implications. By addressing critical research questions, the review endeavors to contribute valuable insights for higher education decision-makers and policymakers navigating the complex terrain of AI-driven tools in the educational landscape. References Baskara, R. (2023). Exploring the implications of ChatGPT for language learning in higher education. Indonesian Journal of English Language Teaching and Applied Linguistics, 7(2), 343-358. Cavalcanti, A. P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y.-S., Gašević, D., & Mello, R. F. (2021). Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence, 2, 100027. Hong, Q. N., Pluye, P., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., & Nicolau, B. (2018). Mixed methods appraisal tool (MMAT), version 2018. Registration of copyright, 1148552(10). Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. Page, M. J., Moher, D., & McKenzie, J. E. (2022). Introduction to PRISMA 2020 and implications for research synthesis methodologists. Research synthesis methods, 13(2), 156-163. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 342-363. Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15. 16. ICT in Education and Training
Paper What do Teachers Think about the Use of Generative Artificial Intelligence (GAI) in their Classrooms? 1Complutense University of Madrid, Spain; 2Cardenal Cisneros Higher Education Centre, Spain; 3Autonomous University of Madrid, Spain Presenting Author:Recently, the advent of Generative Artificial Intelligence (GAI) has sparked significant interest and debate in the field of education. GAI technologies, characterized by their ability to generate new content and provide personalized learning experiences, are reshaping educational paradigms (Dai et al., 2023). These technologies, including advanced language models and adaptive learning systems, offer unique opportunities and challenges for teaching and learning processes (Lo, 2023). Despite the growing interest of GAI as educational tools, there is a lack of research focusing on teachers' perceptions and beliefs about using these technologies in educational settings. In a study conducted by Kaplan-Rakowski et al. (2023), the authors found that, in general, teachers hold favorable views toward the use of GAI in educational settings, irrespective of their individual teaching methodologies. The study revealed a correlation between the frequency of GAI usage by teachers and the positivity of their attitudes towards it. Similar results were found in a recent report with Spanish teachers and families (GAD3, 2024). Moreover, younger teachers hold a more positive view concerning the use of GAI in educational contexts than older ones. In another study conducted by Al-Mughairi and Bhaskar (2024), the factors affecting the adoption AI techniques in higher education were explored. Applying a thematic analysis, the authors found both encouraging and inhibiting factors for the adoption of GAI in educational settings. In particular, four key themes that drive teachers to integrate ChatGPT into their educational practices were identified: 1) The pursuit of innovative educational technologies, 2) Customization of teaching and learning experiences, 3) Efficiency in terms of time management, and 4) Opportunities for professional growth. Conversely, five factors that pose as barriers to adopting ChatGPT were found: 1) Concerns about the tool's reliability and accuracy, 2) A decrease in human-to-human interaction, 3) Issues related to privacy and data security, 4) The absence of adequate support from educational institutions, and 5) The risk of becoming overly dependent on ChatGPT. Teachers' beliefs play a crucial role in the adoption and effective integration of new technologies in teaching practices. Although there is a growing body of research in this regard, there is still a lack of evidence analyzing these views under theoretical lenses (i.e. to what extent are these beliefs more teacher or student-centred?). Understanding these beliefs is essential for developing strategies that support teachers in navigating the challenges posed by GAI and leveraging its benefits effectively. Purpose of Study This study aims to fill this gap by exploring Spanish teachers' beliefs about the use of Generative AI in educational contexts. To this end, we have developed a comprehensive questionnaire comprising 38 items, designed to explore what teachers think about how GAI could affect four dimensions of teaching/learning practices: (1) the kind of learning processes activated by students (more content o process centred) (2) the type of information management performed by students, (3) the evaluation processes designed by teachers and (4) the changes in teachers’ roles and identity as a consequence of the introduction of GAI. The objective is to validate this instrument and collect data from Spanish teachers, providing insights that could inform the development of pedagogical strategies and technological tools that align with teachers' perspectives and educational goals. Methodology, Methods, Research Instruments or Sources Used At the current stage of this research, we are focused on establishing the content validity of the instrument. Twelve subject matter experts, with extensive knowledge in the fields of education, technology, and psychometry, have been engaged to review the questionnaire. They have provided feedback on the relevance, clarity, and appropriateness of each item. Following this, we plan to assess the questionnaire's construct validity using Exploratory and Confirmatory Factor Analysis (EFA & CFA). EFA will be used to uncover the underlying structure of the questionnaire and to identify the interrelationships among the items. CFA will follow to confirm the structure and test our hypotheses about the underlying constructs that the questionnaire is intended to measure. To evaluate the internal consistency of the questionnaire, a reliability analysis will be conducted, employing appropriate methods such as Cronbach's Alpha and/or McDonald's Omega. These statistical techniques will measure the extent to which the items within each dimension are correlated, thus providing an indication of the reliability of the scales. Once the instrument has been piloted and refined based on feedback and statistical analysis, we aim to collect data from at least 200 teachers in higher education. This sample size is chosen to ensure a diverse and representative dataset, enhancing the generalizability of our findings. Both the validation process and the preliminary results will be showcased at the ECER 2024. Conclusions, Expected Outcomes or Findings The aim of this study is twofold. On the one hand, it focuses on the validation of a new instrument designed to measure teachers' beliefs about Generative Artificial Intelligence (GAI) in educational contexts. On the other, it aims to present initial findings on these beliefs, shedding light on how Spanish educators perceive the integration of GAI into their teaching practices and the broader educational landscape. This research carries practical implications for the responsible and effective integration of GAI in educational contexts. For instance, increasing our understanding of teachers ‘beliefs may enhance educators' digital literacy and competency in using GAI for personalized learning. In a rapidly evolving educational landscape, understanding, and aligning with educators' perspectives are essential for harnessing the full potential of AI. References Al-Mughairi, H., & Bhaskar, P. (2024). Exploring the factors affecting the adoption AI techniques in higher education: insights from teachers' perspectives on ChatGPT. Journal of Research in Innovative Teaching & Learning. Dai, Y., Liu, A., & Lim, C. P. (2023). Reconceptualizing ChatGPT and generative AI as a student-driven innovation in higher education. https://doi.org/10.35542/osf.io/nwqju GAD3 (2024). El impacto de la IA en la educación en España. https://empantallados.com/ia/ Kaplan-Rakowski, R., Grotewold, K., Hartwick, P., & Papin, K. (2023). Generative AI and teachers’ perspectives on its implementation in education. Journal of Interactive Learning Research, 34(2), 313-338. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. 16. ICT in Education and Training
Paper Artificial Intelligence Readiness in Education: the Student Teachers’ Journey 1University College Dublin, Ireland; 2Queen's University Belfast, United Kingdom Presenting Author:Five key ideas exist in the area of Artificial Intelligence: Perception, Representation and Reasoning, Learning, Natural Interaction and Societal Impact. This research project aims to consider the contribution (positive and negative) of AI in the field of education and address the ‘readiness’ of Teacher Education to utilise AI as a tool for supporting student teachers’ development in teaching and learning. It is acknowledged that Generative-AI (GAI), such as ChatGPT, lacks the ability to provide criticality, depth and accuracy needed for Masters level writing on PME and PGCE programmes, however as a tool for providing formative feedback or acting as an ‘intelligent tutoring system’, AI could offer exciting opportunities in terms of supportive, personalised, ‘just-in-time’ assistance to student teachers if they were taught properly in how to use generative-AI tools. However this goal requires student teachers to be confident and comfortable in the ethical and effective use of AI. Luckin et al. (2022) refer to “AI Readiness” as the journey that students (and faculty) must take to move from a lack of understanding about the nature of AI and its potential, to comprehending AI’s capabilities and shortcomings, with an awareness of the ethical, social and legal implications of engaging with such a complex technology (Harvard Business Review, 2023). This research study addresses DigiComp 2.2 – the European Digital Competence Framework (Vuorikari et al., 2022) - which was updated in 2022 to include a competence focusing on knowledge, skills and attitudes related to citizens interacting with AI systems, as opposed to technical knowledge about AI itself. ● What are student teachers’ attitudes towards AI and GAI? ● What is the connection between AI anxiety and learning motivation? ● What AI is currently be utilised for educational purposes?
Methodology, Methods, Research Instruments or Sources Used This research project aims to investigate the integration of artificial intelligence (AI) in Initial Teacher Education (ITE) programs, focusing on student teachers in two partner institutions in two neighbouring countries. The study will unfold in three phases, employing an exploratory sequential mixed methods approach. In Phase 1, a literature-based review will identify various types of AI implementation in curricula. The analysis will be aligned with the 5 key ideas of AI, guiding the development of materials for the AI Readiness Journey, intended for online delivery. Moving to Phase 2, the AI-Readiness Journey in ITE will commence with a survey gauging student teachers' attitudes towards AI before undertaking the journey. Building on previous work regarding Technology Readiness, the survey will incorporate an AI Attitude scale. This phase aims to correlate AI attitudes with measures of Technology Readiness, following research by Schepman & Rodway (2022). Participants will engage with AI-Readiness Journey materials to enhance their understanding of AI's potential in education. Phase 3 focuses on Generative-AI as an Intelligent Tutoring System (ITS). Student teachers will be trained in utilizing ChatGPT (or other Generative AIs) to support their knowledge development in teacher education. This phase specifically targets core terminology, theory-practice links, applications of Generative AI for planning, and reflection. Throughout the study, an analysis of survey data will be conducted using SPSS, while qualitative comments will undergo thematic analysis based on Braun & Clarke's framework (2020). Any patterns discerned across subject disciplines or between the two countries will be reported. Although the participant pool might not support robust inferential statistical analysis, this option remains open depending on uptake in Phases 2 and 3. The research aims to shed light on the integration of AI in teacher education and its impact on student teachers' attitudes and readiness. Conclusions, Expected Outcomes or Findings The project's focus on identifying models of AI practice in schools across Northern Ireland (NI) and Ireland is expected to yield valuable insights into the diverse landscape of AI applications in curriculum-based learning. The cross-border cooperation among researchers is crucial in navigating the rapidly changing technological landscape and providing alternative perspectives. The AI-Readiness Journey materials will be instrumental in showcasing how Generative-AI (GAI) can serve as an Intelligent Tutoring System (ITS), supporting student teachers' pedagogical practices during school-based placements. Initial findings suggest the transferability of ITS processes across curricula in both regions and within Europe, emphasising the potential harmonisation of AI implementation in teacher education. The expected outcomes of the project include substantial capacity building in Initial Teacher Education (ITE) programs, primarily benefiting student teachers and potentially extending to teachers in placement schools. Measurable outcomes, such as exemplars of AI in the curriculum, an online AI-Readiness Journey toolkit, and examples of GAI as an ITS, will be shared electronically. These resources aim to modernise ITE programs, providing practical skills in AI and GAI for future educators. Student teachers stand to gain awareness and practical skills in AI and GAI usage, fostering a community of practice within their institutions. Policymakers, including Ireland's Teaching Council and NI's Education Authority, are positioned to receive valuable insights for policy formulation. Institutional benefits extend to the modernization of ITE programs, potentially impacting placement schools through capacity building. The project's outcomes are expected to be well-received, fostering interest and enthusiasm for experimenting with new AI technologies without fear of failure. This approach aligns with the overarching goal of enhancing AI literacy in teacher education, benefiting not only the immediate participants but also the wider academic community across the island of Ireland and Europe. References Braun, V., & Clarke, V. (2020). Thematic Analysis: A Practical Guide. Sage Publications. Luckin, R., Pritchard, A., Ainsworth, S., Akpan, J., & Law, N. (2022). Artificial Intelligence and Education - A summary of the discussions at the Global Education Leaders’ Partnership AI in Education Symposium. Harvard Business Review. https://hbr.org/sponsored/2022/05/artificial-intelligence-and-education Schepman, A., & Rodway, P. (2022). Exploring the Relationship between Attitudes towards Artificial Intelligence and Technology Readiness. Journal of Technology in Human Services, 40(1), 55–75. https://doi.org/10.1080/15228835.2022.2068361 Vuorikari, R., Kankaanranta, M., Ala-Mutka, K., Bacigalupo, M., & Manganello, F. (2022). DigiComp 2.2 - The Digital Competence Framework for Citizens with eight proficiency levels and examples of use (Joint Research Centre Science for Policy Report). Publications Office of the European Union. https://publications.jrc.ec.europa.eu/repository/bitstream/JRC109361/jrc109361_2017%20digcomp%202.2.pdf |
13:45 - 15:15 | 32 SES 11 B: Organizational Learning – Strategies in Times of Uncertainty Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Session Chair: Nicolas Engel Paper Session |
|
32. Organizational Education
Paper Organizational Learning in the Light of Critical Realism and Third Generation SystemsTtheory - some possible practical implications Inland Norway University, Norway Presenting Author:Organizational learning is understood, studied and practiced from different theoretical perspectives, as Elkjaer (2022), among others, shows many examples of. When we as researchers work with collective competence and development processes, for example in schools and kindergartens and across municipal service areas, our theoretical perspectives and basic understandings of organizational learning will have an impact on how we work in practice. We always have some presuppositions when we work with research (and development) (Bateson, 2002, Bhaskar & Danermark, 2006). In a time of great uncertainty, combined with a high degree of complexity in the organizations where collective competence development is to take place, it is also an important ethical question how we as researchers contribute to development processes. How do we handle the uncertainty and complexity? Are we able, as Elkjaer (2022, p. 598) points out, to contribute to what is best for society and act responsibly and openly? And do we contribute to learning becoming a method for developing and maintaining critical thinking? Elkjaer argues for a learning theory of organizational learning inspired by pragmatism. In the study that this paper deals with, we will follow Elkjaer's suggestions for what is important for organizational learning in the future, but we will not pursue pragmatism, but rather go to critical realism, which incidentally has a kinship with pragmatism (Zotzmann et. al., 2022), and we will also connect critical realist insights within systems theory, what Price (2023) refers to as third generation systems theory. Like pragmatism, critical realism is a meta-theoretical position (Bhaskar, 2016), and meta-theory specifies ontological, epistemological and methodological presuppositions in scientific practice (Bhaskar & Danermark, 2006). These assumptions can often be less explicit in research and development work, while it can be very enlightening both for researchers themselves and also for the organizational participants involved in collective competence development if they are made explicit and clear, and preferably understandable - because this should be possible and desirable if the researcher is to act responsibly. There are two intertwined research questions that are discussed in this paper: What is central to a theoretical basis for organizational learning from critical realist meta-theory and third generation systems theory? And what could be important practical implications in light of these theories, for collective competence development in schools and kindergartens, and for the good of society? The aim of the study is to contribute to a theoretical basis for organizational learning related to collective competence development that both addresses uncertainty and complexity, and at the same time provides the most "simple" possible directions for competence and practice development. This contribution is intended for both researchers and organizational participants who are involved in concrete, practical development processes, and who seek basic understandings that can contribute to more sustainable development processes than has often been the case in, for example, school development. The theoretical frameworks that will be addressed and applied in this study are organizational learning, based on Elkjaer's article (2022) and other relevant publications in this field. Furthermore, critical realism is the most central framework in the study, which also underpins the third theoretical perspective, namely third-generation systems theory, as presented by Leigh Price (2023). Critical realism is a comprehensive meta-theory with a large international literature, and in order to extract some of the main points, I particularly use Bhaskar's 2016 book Enlightened Common Sense, which also points in the direction of emphasizing common sense and simplicity, while maintaining an understanding of the complex and avoiding reductionism. Methodology, Methods, Research Instruments or Sources Used The methodological work in this study consists of theoretical work in the form of reading and presenting critical realist meta-theory, including third-generation systems theory and relating this to organizational learning, and placed in a practical context that deals with collective competence development in schools, kindergartens and associated municipal service areas, based on a Norwegian context. As part of this, a literature study of international articles addressing the link between organizational learning and critical realism will be conducted. The purpose of the literature study is to highlight both coinciding and possibly divergent theoretical perspectives, and to make an independent summary and reflection on what may be particularly important theoretical contributions to organizational learning and to practical work with collective competence development. A preliminary search in google scholar for "organizational learning and critical realism" after 2020 shows more than 17,000 results, and it will be an important methodological task to make this literature study manageable within the framework of this paper, and at the same time sufficiently comprehensive and solid that the study can become a useful reference for further development work. Conclusions, Expected Outcomes or Findings The expected results of the study are that important theoretical perspectives related to organizational learning will be highlighted, and that these will also provide guidance for practical work with competence development. References Bateson, G. (2002). Mind and nature: a necessary unity. Cresskill, N.J.: Hampton Press. Bhaskar, R. (2016). Enlightened Common Sense (1st ed.). Routledge. Bhaskar, R., & Danermark, B. (2006). Metatheory, interdisciplinarity and disability research: a critical realist perspective. Scandinavian journal of disability research, 8(4), 278- 297. Elkjaer, B. (2022). Taking stock of “Organizational Learning”: Looking back and moving forward. Management Learning. Vol. 53(3) 582-604 Zotzmann, K., Barman, E., Porpora, D. V., Carrigan, M. & Elder-Vass, D. (2022). Round table: is the common ground between pragmatism and critical realism more important than the differences?, Journal of Critical Realism, 21:3, 352-364, DOI: 10.1080/14767430.2022.2073674 32. Organizational Education
Paper Recruiting Participants – Strategies in Times of Uncertainty. Looking at Adult and Continuing Education. A Scoping Review. German Institute for Adult Education Presenting Author:In the field of adult and continuing education curricula are less regulated than in other areas of education and participation is usually voluntary (Schrader, 2019). Thus, participation in continuing education is a complex phenomenon which depends on various factors (Rubenson & Desjardins, 2009). Boeren (2016), for example, explains participation in continuing education by a multilevel model, which illustrates the interrelationships between factors at different levels. Within this model, organizations and providers of adult and continuing education are recognized as a factor to participation at the meso-level. The field of continuing education is characterized by dynamic change. Particularly when it comes to program planning, the challenge is to keep pace with social changes and address current needs. Program planning in continuing education has to mediate between the three instances of social needs, addressees, and pedagogical mission (von Hippel et al., 2008). Thereby, it has the task to react on foreseen future problems and awaken new educational needs (Siebert, 2014). Constantly changing socially relevant developments can be understood as uncertainty in the sense of this network’s call. Against the background of current developments such as differentiation of the continuing education market, competitive pressure, and digitalization, reaching and addressing new or changing target groups is becoming increasingly important (Echarti et al., 2023; Kraft, 2018). The recruitment of participants as an organizational process is therefore a central challenge for continuing education staff (Caffarella & Daffron, 2013; Käpplinger et al., 2017). Course design is one relevant factor in order to attract participants. Without curricular regulations, it is important to constantly adapt the program to current topics, individual needs and interests, as well as to external changes. Futhermore, the relevance of participant recruitment is underlined when taking into account the “matthew effect” (Boeren, 2016, S. 24), which refers to the actuality that the majority of people who take part in continuing education are those who already have a higher formal qualification, or as it says in Matthews’s Bible story: Those who already have receive more (Boeren, 2016; Rubenson, 1998). In order to promote educational equality, it is particularly important to make efforts to reach the educationally disadvantaged groups (Boeren, 2016). For the German discourse, Mania, Ernst and Wagner (2022) point out that there is no established form or category under which participant recruitment is discussed. In their systematic review, they developed and systemized an overview of the current state of German discussion and research on that topic. Accordingly, participant recruitment is merely treated as a subtopic, viewed from different angles, such as the institutional, organizational, and professional perspective, as well as from the perspective of target group research. Against this background, our intention is to focus on the international state of discussion and research. Up to now there exists no empirical based systematic overviews systematizing the international state of discussion and research on this topic. Our contribution therefore aims to take stock of and systematize the topic of participant recruitment and outreach strategies in adult and continuing education in the international (research) discourse. Our review will focus on the perspective(s) from which the topic is captured and discussed, and on strategies and concepts for addressing participants that can be identified in the sector of adult and continuing education. Our specific interest is the area of literacy and basic education, this due to its particular importance (to reach educationally disadvantaged) and specifics of the recruitment process (e.g., must go beyond written offers). The conceptual framework of our approach is informed by the procedure of conducting a scoping review (Arksey & O'Malley, 2005). Methodology, Methods, Research Instruments or Sources Used In order to condense the international current state of research strands on participant recruitment in adult and continuing education, we conducted a scoping review (Arksey & O'Malley, 2005). Scoping reviews are especially suitable for outlining the current breadth of existing literature on a given topic, and thereby identifying key concepts as well as research gaps (Levac et al., 2010; Munn et al., 2018). Our approach is based on the five-stage methodological framework by Arksey and O’Malley (2005), comprising: 1. identifying the research question, 2. identifying relevant studies, 3. study selection, 4. charting the data and 5. collating, summarising, and reporting the results. 1. Against the background of the findings of Mania, Ernst, and Wagner (2022) for the German discourse, our research questions are: How is recruitment of participants in adult and continuing education discussed and researched in the international discourse? Which terms are used to address the topic and target group(s)? Which recruitment strategies are being discussed? What kind of texts are published in the discourse? 2. The specific challenge of present review is to find suitable search terms for compiling the current international discourse Up to now, there are no established or empirical based terms or categories to refer to. Thus, a comprehensive retrieval strategy was needed. After initial tests, we finally developed a combination compiling four retrieval strands with a total of 13 search words. This gave us 96 possible combinations and resulted in 12,867 hits in three databases (ERIC, FIS Bildung and Web of Science) applied to ‘abstract’. After removing the duplicates 2,199 texts remained. To ensure that also texts with no or short abstracts were not excluded, a second search run was conducted along only two search strands and applied to ‘title’. In total and after removing the duplicates 2,396 texts remained, with which we continued our review procedure. 3. In order to select relevant texts, we screened the abstracts of all 2,396 texts, and applied inclusion and exclusion criteria: subject area, theme, language. Finally, the literature corpus of our scoping review included 128 texts. 4. We charted information from the 128 included texts in an analytical framework using the program Microsoft Excel. Thereby we recorded information on each of the included texts regarding the main categories general information, empiric foundation, (conceptual) positioning of the text and given recruitment approach. Conclusions, Expected Outcomes or Findings Our paper aims at a structures overview of the thematic strands and concrete concepts found in international literature, regarding participant recruitment in adult and continuing education. The analysis shows that the topic of participant recruitment in adult and continuing education has hardly been discussed internationally in the last 20 years, or at best as a subtopic. This is shown, for example, by the fact that the topic is mostly discussed under the term recruitment, often in the combination with the term retention. In addition, recruitment of participants is also considered under the aspects of outreach, marketing, and access. Moreover, it can be said that the discourse is in major parts fuelled by e.g., policy papers, and project reports, whereas empirical studies are rare. This marks a clear research gap. Looking at the strategies mentioned, a variety of approaches are introduced in the discourse, some of which are given here as examples: Besides written communication via brochures, flyers, and program booklets, also recruitment campaigns are discussed that contain door-to-door canvassing, media spots, and forming community networks. Furthermore, the strategy of establishing a professional or voluntary recruiter position emerges from the international discourse. This position is set up to recruit potential participants to adult and continuing education courses. This strategy is not evident from the German findings and is therefore new to the German discourse. Finally, we show that recruitment strategies are particularly discussed with regard to vulnerable target groups as, for example (educationally) disadvantaged adults, illiterate adults, or un(der)-employed adults. References Arksey, H. & O'Malley, L. (2005). Scoping studies: towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616 Boeren, E. (2016). Lifelong Learning Participation in a Changing Policy Context: An Interdisciplinary Theory. Palgrave Macmillan. Caffarella, R. S. & Daffron, S. R. (2013). Planning Programs For Adult Learners: A Practical Guide (3. Aufl.). Jossey-Bass. Echarti, N., Koscheck, S., Martin, A. & Ohly, H. (2023). Weiterbildungsmarkt im Wandel: Ergebnisse der wbmonitor-Umfrage 2022. https://www.bibb.de/dienst/publikationen/de/19365 Käpplinger, B., Robak, S., Fleige, M., von Hippel, A. & Gieseke, W. (Hrsg.). (2017). Cultures of Program Planning in Adult Education: Concepts, Research Results and Archives. Peter Lang. Kraft, S. (2018). Berufsfeld Weiterbildung. In R. Tippelt & A. von Hippel (Hrsg.), Handbuch Erwachsenenbildung/Weiterbildung (6., überarbeitete und aktualisierte Auflage, S. 1109–1128). Springer VS. Levac, D., Colquhoun, H. & O'Brien, K. K. (2010). Scoping studies: advancing the methodology. Implementation Science, 5(1), Artikel 69. https://doi.org/10.1186/1748-5908-5-69 Mania, E., Ernst, S. J. & Wagner, F. (2022). Teilnehmendengewinnung in der Weiterbildung und spezifische Ansprachestrategien in der Alphabetisierung und Grundbildung – ein systematisches Literaturreview. Zeitschrift für Weiterbildungsforschung, 45(1), 171–190. https://doi.org/10.1007/s40955-022-00206-w Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A. & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 1–7. https://doi.org/10.1186/s12874-018-0611-x Rubenson, K. (1998). Adults' readiness to learn: Questionig lifelong learning for all. Adult Education Research Conference. https://newprairiepress.org/aerc/1998/papers/45 Rubenson, K. & Desjardins, R. (2009). The Impact of Welfare State Regimes on Barriers to Participation in Adult Education. Adult Education Quarterly, 59(3), 187–207. https://doi.org/10.1177/0741713609331548 Schrader, J. (2019). Institutionelle Rahmenbedingungen, Anbieter, Angebote und Lehr-Lernprozesse der Erwachsenen- und Weiterbildung. In O. Köller, M. Hasselhorn, F. H. Hesse, K. Maaz, J. Schrader, H. Solda, K. Spieß & K. Zimmer (Hrsg.), Uni-Taschenbücher: Bd. 4785. Das Bildungswesen in Deutschland: Bestand und Potenziale. (S. 701–729). Verlag Julius Klinkhardt. Siebert, H. (2014). Didaktisches Handeln in der Erwachsenenbildung: Didaktik aus konstruktivistischer Sicht. Ziel Verlag. von Hippel, A., Fuchs, S. & Tippelt, R. (2008). Weiterbildungsorganisationen und Nachfrageorientierung – neo-institutionalistische Perspektiven. Zeitschrift für Pädagogik, 54(5), 663–678. |
15:45 - 17:15 | 16 SES 12 B: ICT in the Classroom Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Session Chair: Ana Luísa Rodrigues Paper Session |
|
16. ICT in Education and Training
Paper The Use of Interactive Displays in the Classroom 1Klebelsberg Központ; 2Eszterházy Károly Catholic University, Hungary Presenting Author:The focus of our presentation is the use of smart boards in the classroom. The research was done in the frame of the programme called EFOP-3.2.4. „Development of digital competences” which is the antecedent of an RRF-1.2.1. programme called „Providing equal accessibility to digital education to students and teachers”. These two programmes are originated from recognizing the latest international trends and the needs of educational institutions as for the latest digital technology is concerned. The research problem is to track changes indicated by central governmental development in the convergent regions of Hungary focusing on supplying them with interactive displays. Our purpose was to identify changes in Hungary compared to international trends as far as the number of interactive displays is concerned, identify possible changes in teachers’ classroom practice due to professional development trainings completed in the frame of the programme. The research questions are:
The importance of digital literacy in our everyday life and in the labour market is unquestionable (Ala-Mutka 2011, Area & Pessoa 2012). The notion of digital transformation has been defined in almost every field of life. Education is also an area of digital transformation, consequently the need of change in pedagogical perspectives has become a highly important issue (European Commission 2019a, b). A great number of researches has dealt with the role of digital tools including interactive white boards and interactive displays in education and tackling challenges related to them. A meta-analysis taking and pooling research results between 2002-2011 identified seven problem areas (Shi et al, 2012). From the aspect of our research, the issue of spreading and concentration of technology takes priority. The most important question is how availability of digital tools (interactive displays) is changing due to central governmental interventions. The target populations of the researches were teachers and students whose attitudes, behaviours, expectations, feelings and other mental activities towards interactive displays were analysed. In some cases, the procurement has been accompanied by researches, which can be identified as a continuation of researches related to the use of interactive white boards, since their introduction and spread, and professional experiences, assessment of their use are essential to professional knowledge related to interactive displays. Consequently, the need of change in professional beliefs and concepts has become apparent. The most recent studies have investigated the advantages and disadvantages of interactive displays from the students’ and teachers’ perspectives (İpek & Sözcü, 2016; Schmid & Schimmack, 2010; Sad & Ozhan, 2012; Yıldız & Tüfekçi, 2012; Yang, Yorgancı, & Terzioğlu, 2013; Warwick, Hennessy & Mercer, 2011), the internal and external factors of integrating the use of interactive displays into teaching practice (Drayton, Falk, Stroud, Hobbs & Hammerman, 2010; Stroud et al., 2014), their role in making learning more efficient (Saltan & Arslan, 2013; Saltan, 2019; Türel & Johnson, 2012; Akar, 2020). Our research fills a gap and is unparalleled with its big sample because of the lack of researches related to interactive displays. It is based on the series of governmental actions, including procurement, installation of 3000 interactive displays, organizing professional training for teachers in the convergent regions of Hungary in 2019. Thus, we intended to contribute to the support of teachers’ conceptual change. Methodology, Methods, Research Instruments or Sources Used Research design: Our results are based on two big-sampled quantitative studies carried out in 2020 and 2021. During the research, we used an excavating-descriptive strategy, in which the data was collected in a two-step process. The purpose of the studies was to explore the changes after procurement of interactive displays and professional training specialised on their use. Sampling: The data collection took place in Hungary in two stages, in the spring of 2020 (N1=12657) and 2021 (N2=9754) in both cases during the period of classroom education. In the research, the so-called teachers working in school district-maintained institutions of the convergence region participated. Regarding the age of the respondents, the youngest respondent was 22 years old and the oldest was 79 years old at the time of the survey. The sample matched to the data of the national average, thus, it can be said to be representative of gender and age distribution. The most significant part of the responding teachers (34%) teach humanities or real subjects (28%) in the highest number of hours. The proportion of teachers who teach arts, foreign languages and sports in the highest number of hours is approximately the same (12%, 10%, 9%). 7% of the respondents have the highest number of individual sessions. Research method: Both measurements were done using an online questionnaire, mainly in the framework of questions containing single-choice, multiple-choice, ranking, attitude and frequency scales. The questionnaires had four parts: general questions, questions inquiring about the frequency of the use of interactive displays. Questions referring to the qualitative use of interactive displays (What are their most and least beneficial functions? Which of their functions do you prefer using? What didactic goals do you consider when using interactive displays?) The last group of questions was about trainings referring to the use of interactive displays focusing on different levels of trainings. Data analyzation: During the data analysis, descriptive (mean, median, mode) and mathematical statistical tests (correlation and difference tests) were used. Independents variables were the grade of students and the subjects taught, and teachers’ participation in professional trainings organized within the frame of the program. With the help of analysing the role of independent variables, we could draw a wider picture of the use of digital tools, the teachers’ methods applied during teaching and we could identify some problematic areas of development. Conclusions, Expected Outcomes or Findings As 3000 interactive displays were distributed among schools in the convergence regions, the position of Hungary in the European Union regarding the portion of interactive displays has strengthened. Comparing the results of the two measurements, it can be said that the frequency of using the interactive display in the classroom has increased significantly over a year. Our results give a deeper dimension to the former results (İpek & Sözcü, 2016; Schmid & Schimmack, 2010; Sad & Ozhan, 2012; Yıldız & Tüfekçi, 2012; Yang, Yorgancı, & Terzioğlu, 2013; Warwick, Hennessy & Mercer, 2011) describing the advantages and disadvantages of interactive displays pointing out new benefits and drawbacks in teachers’ point of view. Moreover, we could identify special patterns of their use. The patterns have changed depending on the grades and subjects taught by the teachers during the preiod of research. It shows how teachers try to integrate their use into everyday practice (Drayton, Falk, Stroud, Hobbs & Hammerman, 2010; Stroud et al., 2014). Furthermore, the teachers’ ICT qualification significantly influences the frequency of use and the range of functions showing the qualitative aspects of interactive display use. Among the didactic goals illustration, introduction of new teaching material, direct motivation and frontal work keep their leading position. Comparing the results of two measurements in 2020 and 2021, we can identify manly quantitative changes in the use of interactive displays. It means that we cannot expect revulsion as a result of bigger number of available interactive displays and trainings enhancing their use. We should accept that smaller scale; mainly quantitative changes can be identified due to governmental interventions. References Akar, H. (2020). The effect of smart board use on academic achievement: A meta-analytical and thematic study. IJE in Mathematics, Science and Technology (IJEMST), 8(3), 261-273. Ala-Mutka, K. (2011). Mapping Digital Competence: Towards a Conceptual Understanding, Publications Office of the European Union. Area, M. & Pessoa, T. (2012). From solid to liquid: New literacies to the cultural changes of Web 2.0 Communicar. 38, 13-20. Drayton, B., Falk, J., Stroud, R., Hobbs, K., & Hammerman, J. (2010). After installation: Ubiquitous computing and high school science in three experienced high-technology schools. The Journal of Technology, Learning, and Assessment, 9, 1-57. European Commission (2019a). 2nd Survey of Schools: ICT in Education – Objective 1: Benchmark progress in ICT in schools. Luxembourg European Commission (2019b). 2nd Survey of Schools: ICT in Education – Objective 2: Model for a ‘highly equipped and connected classroom’. Luxembourg Mercer, S. N. Hennessy & P. Warwick (2010). “Using interactive whiteboards to orchestrate classroom dialogue,” Technology, Pedagogy and Education, vol. 19, no. 2, pp. 195–209. İpek, İ., & Sözcü, Ö. F. (2016). Preferences and Attitudes for Using Interactive Whiteboards in Different Courses and Learning. European Journal of Contemporary Education, 15(1), 173-184. Paksi, B. & Schmidt, A. (2017). Pedagógusok új infokommunikációs technológiák használatával kapcsolatos tapasztalatai és vélekedései. EDUCATIO, 26(2), 196-215. Şad, S. N., Özhan, U. (2012). Honeymoon with IWBs: A qualitative insight in primary students’ views on instruction with interactive whiteboard. Computers & Education, 59(4), 1184–1191. Saltan, F. (2019). The New Generation of Interactive Whiteboards: How Students Perceive and Conceptualize? PER Vol. 6(2), pp. 93-102 Saltan, F., & Arslan, K. (2013). Teachers’ Perception of Interactive White Boards: A Case Study. Mersin University Journal of the Faculty of Education, 9(2), 353-365. Schmid, E.C., & Schimmack, E. (2010). First Steps toward a Model of Interactive Whiteboard Training for Language Teachers. IGI Global, USA Shi, Y., Yang, Z., Yang, H. H. & Liu, S. (2012). The Impact of Interactive Whiteboards on Education. ICIMCS’12, China. Stroud, R., Drayton, B. K. & Falk, J. (2014). Interactive Whiteboard Use in High-Tech Science Classrooms: Patterns of Integration. IJET, 9(9), pp. 41–49. Türel, Y. K., & Johnson, T. E. (2012). Teachers' Belief and Use of Interactive Whiteboards for Teaching and Learning. Educational Technology & Society, 15(1), 381–394. Warwick, P., Hennessy, S., & Mercer, N. (2011). Promoting teacher and school development through co-enquiry: Developing interactive whiteboard use in a ‘dialogic classroom’. Teachers and Teaching, 17(3), 303–324. 16. ICT in Education and Training
Paper Classroom Disruptions in Digital Settings 1Karlsruhe Institute of Technology (KIT), Germany; 2University of Freiburg, Germany Presenting Author:The average classroom is disrupted every 42 seconds (Wettstein & Scherzinger, 2018). Over the time of an entire day at school, teachers and students are facing up to hundreds of minor and major disruptions. Since a well-structured lesson and a less disturbed classroom are key aspects for students’ academic success (Adeyemo, 2012; Marquez et al., 2016; Talebi et al., 2015), there is an urgent need for educators worldwide to address this issue. This is especially true when facing the consequences of permanent disruptions as stress for teachers: (mental and physical) health issues (Kokkinos, 2007; Wettstein et al., 2021). Additional to this already important matter the educational systems around the world have to deal with more and more digitization (Meinokat & Wagner, 2022). This transforms educational systems worldwide (European Union, 2020; Wohlfart & Wagner, 2023) and affects all areas of teaching in classes. Classroom Management, as “the actions teachers take to create an environment that supports and facilitates both academic and social-emotional learning” (Evertson & Weinstein, 2006, p. 4) is therefore affected as well. Dealing with disruptions, so “behavior[s] that seriously interferes with the teaching process, and/or seriously upsets the normal running of the classroom” (Infantino & Little, 2005, p. 493), is part of classroom management, but research so far is missing the impact of the digital changes on this topic. The pandemic has shown that teaching already and in future might benefit from and in digital settings (Meinokat & Wagner, submitted). Digital settings can occur in different forms: digital enhanced face-to-face learning, online learning, or blended learning (Meinokat & Wagner, 2022). All forms can be found interdisciplinary across various subjects at schools. Research in this area so far is lacking an explicit look at the topic of classroom disruptions, rather focusing on classroom management generally, and is mostly teacher focused (Meinokat & Wagner, 2022). To generate a more complete understanding of this important research area, teaching must be investigated from different perspectives. This cumulative PhD Project is therefore addressing classroom disruptions in digital settings from multiple views and regarding various subjects, answering the following research questions:
Methodology, Methods, Research Instruments or Sources Used This cumulative PhD Project is using a mixed method approach, adapting the used approach according to earlier gathered insights and suitability. Every research design is producing a unique scientific journal article. At the beginning, a systematic literature review according to the PRISMA statement (Moher et al., 2009) is developed to construct an overview of already existing research in this area, find further gaps in the literature and prepare future research. Research in this area so far is teacher focused but missing the digital aspects of teaching. Therefore, a qualitative, semi-structured guideline-based interview study with expert teachers is conducted. The interviews are analyzed via qualitative content analysis (Mayring, 2014). The differences between subjects, school forms and age groups of students ask for further investigation, leading to further interview studies with dedicated focus to vocational education and physical education. To address the issue of teacher centered research, the project will then conduct research on students. The higher number of students compared to available teachers in schools makes it possible to address quantitative research, resulting in a quantitative survey with students in various agents. To address the interdisciplinary character of this project and make the findings comparable amongst the students, this part of the project focuses on the subject of mathematics. This generates a view on the research are from multiple angles and with an interdisciplinary character while having, for the first time in research, the aspect of digitization as the focus for the look at classroom disruptions. Conclusions, Expected Outcomes or Findings The literature review (Meinokat & Wagner, 2022) shows that the terms of digital settings and classroom disruptions are not defined uniformly. Creating and systemizing definitions for these topics, international research is very teacher oriented. Expert interviews with teachers about their teaching during the pandemic in multiple subjects (Meinokat & Wagner, submitted), their teaching at (digital) learning factories in vocational schools (Meinokat & Wagner, under review), and their teaching of physical education facing the problem of refusal behavior show (Meinokat et al., submitted), that teachers are already utilizing digital media given. To address issues on various levels, teachers use their already existing behavior strategies and enhance their skillset as well as improve their strategies using the benefits of digitization in schools. With the gathered information it is possible to generate systemizations for disruptions and behavior strategies for teachers to utilize during their reflection and their own teaching. The students’ point of view, gathered through quantitative research will answer questions about different understandings of disruptions between teachers and students, will show the impact of these (mis-)understandings on the students directly, and will lay a foundation for future researcher to dwell deeper into this area. Already practicing teachers and students during teacher education will benefit from these findings, making it easier in future to understand the impact of classroom disruptions on multiple stakeholders in class and use the digital media appropriately to enhance their teaching, creating better learning outcomes for students while saving their own health. References Adeyemo, S. A. (2012). The relationship between effective classroom management and students’ academic achievement. European Journal of Educational Studies, 4(3), 367–381. European Union. (2020). Digital Education Action Plan 2021-2027. In Resetting education and training for the digital age. https://education.ec.europa.eu/focus-topics/digital-education/digital-education-action-plan Evertson, C. M., & Weinstein, C. S. (2006). Classroom Management as a Field of Inquiry. In C. M. Evertson & C. S. Weinstein (Eds.), Handbook of classroom management. Research, practice, and contemporary issues (pp. 3–15). Routledge. Infantino, J., & Little, E. (2005). Students’ Perceptions of Classroom Behaviour Problems and the Effectiveness of Different Disciplinary Methods. Educational Psychology, 25(5), 491–508. https://doi.org/10.1080/01443410500046549 Kokkinos, C. M. (2007). Job stressors, personality and burnout in primary school teachers. The British Journal of Educational Psychology, 77(Pt 1), 229–243. https://doi.org/10.1348/000709905X90344 Marquez, B., Vincent, C., Marquez, J., Pennefather, J., Smolkowski, K., & Sprague, J. (2016). Opportunities and Challenges in Training Elementary School Teachers in Classroom Management: Initial Results from Classroom Management in Action, an Online Professional Development Program. Journal of Technology and Teacher Education, 24(1), 87–109. Mayring, P. (2014). Qualitative Content Analysis. Beltz. Meinokat, P., Gerstmaier, K., & Wagner, I. (submitted). Refusal in physical education – teachers’ strategies and utilization of digital tools. German Journal of Exercise and Sport Research. Meinokat, P., & Wagner, I. (2022). Causes, prevention, and interventions regarding classroom disruptions in digital teaching: A systematic review. Education and Information Technologies, 27(4), 4657–4684. https://doi.org/10.1007/s10639-021-10795-7 Meinokat, P., & Wagner, I. (under review). Classroom Disruptions and Classroom Management in Learning Factory Settings at Vocational Schools. Vocations and Learning. Meinokat, P., & Wagner, I. (submitted). Classroom Disruptions in Digital Teaching during the Pandemic—An interview study. Frontiers in Education. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med, 6(7), 1–7. https://doi.org/10.1371/journal.pmed.1000097.g001 Talebi, S., Davodi, S., & Khoshroo, A. (2015). Investigating the Effective Component of Classroom Management in Predicting Academic Achievement among English Language Students. Procedia - Social and Behavioral Sciences, 205, 591–596. https://doi.org/10.1016/j.sbspro.2015.09.085 Wettstein, A., & Scherzinger, M. (2018). Störungen im Unterricht wirksam begegnen. Schweizerische Zeitschrift für Heilpädagogik, 24(5–6), 26–32. Wettstein, A., Schneider, S., Grosse Holtforth, M., & La Marca, R. (2021). Teacher Stress: A Psychobiological Approach to Stressful Interactions in the Classroom. Frontiers in Education, 6, 681258. https://doi.org/10.3389/feduc.2021.681258 Wohlfart, O., & Wagner, I. (2023). Teachers’ role in digitalizing education: An umbrella review. Educational Technology Research and Development, 71(2), 339–365. https://doi.org/10.1007/s11423-022-10166-0 16. ICT in Education and Training
Paper Adaptive Learning to Maximize Gifted Education: Teacher Perceptions, Practices, and Experiences. 1NIS in Astana, Kazakhstan; 2Nazarbayev University, Kazakhstan Presenting Author:This study aims to explore teachers’ experiences using adaptive learning (AL) approaches in gifted education in Kazakhstan schools. This study employs a qualitative case study methodology to illustrate the phenomenon under examination and includes eight purposefully selected teacher participants who have worked and/or are working on an ALpilot project in gifted education. The results from this study may aid policymakers and school administrators in evaluating and enhancing teachers' experiences in gifted education. Promoting equity and excellence at all levels of education is a top priority for all educational systems to ensure that all children have opportunities for success. Equity, connected to the concept of fairness, means that personal or socio-economic conditions such as ability, gender, ethnic origin, or family origin do not hinder the success of education. Fostering excellence, on the other hand, implies striving to provide quality education tailored to the different talents and needs of all students, striving to enаble each of them to reach their potential (Brusoni et al., 2014; Peters & Engerrand, 2016; Reis, Renzulli & Renzulli, 2021). Both principles are desirable, possible, and compatible (Schleicher, 2014). However, only a few education systems around are capable of achieving both objectives simultaneously to satisfactory levels (Peters & Engerrand, 2016). As a result, the number of students who fully benefit from compulsory education is limited. This is especially true for gifted and talented students, whose clаssroom experiences are usually focused on topics they have already mastered (Letina, 2021; Pfeiffer, 2012) and too often do not have access to quality opportunities to mаximize their learning (Little, 2012; Reis, Renzulli & Renzulli, 2021). The advancement of technology, such as Google clаssroom, Renzulli Learning, and AL systems (e.g., ALEKS, CogBooks, CANVAS) in the 21st century created various opportunities to ensure gifted learners' personalized learning, particularly through the study of pupils' learning to better serve individualized growth. Rather than additional learning material, these personalized approaches to learning promote a range of learning experiences addressing student learning needs. This incorporation of technology into personаlized learning environments has produced a new development path: technology-enabled personalized learning (Peng et al., 2019; Shemshack & Spector, 2020). AL is considered a strаtegy for delivering personalized learning in order to provide each student with efficient, effective, engaging, and individualized learning routes (Harati et al., 2021). The benefit of AL is that the system provides the student with tailored learning opportunities аdjusted to their performance in the previous session. This approach allows the learners to skip information if they are already acquainted with it, and judge it as too simple or too difficult, which positively impacts the individual's educational trajectory (Ordov et al., 2019). The purpose of this study is to examine and describe Kazakhstani teachers’ experiences with AL approaches in gifted education. Drawing on empirical data and associated literature, this study intends to examine how Kazakhstani teachers conceptualize AL, what their experience with the approach has been, and how they go about implementing it. By exаmining teachers' experiences, we aim to discover the obstacles they confront, the teaching strategies they find effective, the opportunities adaptive learning systems offer, as well as the limitations of AL. Methodology, Methods, Research Instruments or Sources Used This study employs a multiple case study research design to explore teachers' perceptions of AL in gifted education. Case study research is an appropriate method for this study as it allows for an in-depth examination of a specific phenomenon, in this case, teachers' perceptions of AL in gifted education, within its real-life context (Yin, 2018). Multiple case study design was chosen for this study due to its capacity to portray a single occurrence inside or apart from a wider phenomenon while fostering comprehension. This research does not qualify as a single-case study since it involves interviews with educators from various regions of the country on their experience in implementing AL in gifted education, in one network of schools. The study focuses on teachers using AL in gifted education in Kazakhstani schools, specifically four special schools for gifted students in different regions of Kazakhstan. Participants, eight teachers with AL experience in teaching gifted students, were recruited through email invitations from school principals. The sample included four male and four female participants, comprising four chemistry and four physics teachers. Their teaching experience ranged from four to 27 years, with an average of 12 years. Inclusion criteria required that participants are teachers who had experience using AL and were willing to participate in a one-hour-long interview. Each participant provided informed consent before data collection, participated of their own will and was free to leave the study with no penalty. To address the study questions, the researcher classified themes that emerged from interview data. In addition, the data from the eight participants were collated in tables to illustrate the frequency of identified themes in accordance with the aim of the research. Following the presentation of the data for each sub-research question is a chapter summary. In addition to the researcher, the interview, which consisted of open-ended questions, was an essential component of this study. Yin (2003) states that case studies may gather data using a variety of methods, including questionnaires, interviews, observations, and written reports from the individuals. The purpose of using in-depth interviews in this study was to get a vivid picture of the participant's opinion on the study issue (Milena, Dinora & Alin, 2008). Further, semi-structured interviews allowed us to obtain a clear image of teachers’ AL experiences in gifted education while allowing for follow-up and investigative inquiries. Conclusions, Expected Outcomes or Findings The primary finding of this study is that teachers think that teachers believe that AL is a beneficial tool for all kids, not just the gifted ones. Teachers have different meanings of AL, but most of them concur that it can improve personalized learning, student-centered learning, learning experience and progress, engagement, and motivation, and learning simplification and metacognition. However, there are other issues that must be resolved, such as technological, educational, managerial, and psychological difficulties. Teachers must use a variety of strategies, including organizational, pedagogical, class administration, curriculum, instruction, and technology strategies, to maximize the possibilities of AL. The results of this research show that AL has the potential to enhance student learning outcomes and assist teachers in their instructional strategies. There are worries that artificial intelligence (AL) may replace human contact and that ties between students and teachers must be maintained. Inadequate teacher training and scarce technology resources are two obstacles to the successful deployment of AL. Overall, teachers view AL as beneficial and would encourage other educators to adopt the technology. References References Brusoni, M., Damian, R., Sauri, J. G., Jackson, S., Kömürcügil, H., Malmedy, M. A. R. I. E., ... & Zobel, L. (2014). The concept of excellence in higher education. Retrieved on March, 18, 2016. Harati, H., Sujo-Montes, L., Tu, C. H., Armfield, S. J., & Yen, C. J. (2021). Assessment and Learning in Knowledge Spaces (ALEKS) Adaptive System Impact on Students’ Perception and Self-Regulated Learning Skills. Education Sciences, 11(10), 603. https://doi.org/10.3390/educsci11100603 Letina, A. (2021). Using Differentiation Strategies for Gifted Pupils in Primary School Science Classes. Revija za Elementarno Izobrazevanje, 14(3), 281-301. https://doi.org/10.18690/rei.14.3.281-301.2021 Little, C. A. (2012). Curriculum as motivation for gifted students. Psychology in the Schools, 49(7), 695-705. https://doi.org/10.1002/pits.21621 Milena, Z. R., Dainora, G., & Alin, S. (2008). Qualitative research methods: A comparison between focus-group and in-depth interview. Analele Universităţii din Oradea, 1274. Nazarbayev Intellectual Schools. (2020). "Annual report of the Autonomous Organization of Education "Nazarbayev Intellectual Schools", the official website of the organization. https://www.nis.edu.kz/Diana/Годовой_отчетАОО2020_1часть_ENG.pdf Ordov, K., Madiyarova, A., Ermilov, V., Tovma, N., & Murzagulova, M. (2019). New trends in education as the aspect of digital technologies. International journal of mechanical engineering and technology, 10(2), 1319-1330. Peng, H., Ma, S., & Spector, J. M. (2019). Personalized adaptive learning: an emerging pedagogical approach enabled by a smart learning environment. Smart Learning Environments, 6(1), 1-14. https://doi.org/10.1186/s40561-019-0089-y Peters, S. J., & Engerrand, K. G. (2016). Equity and excellence: Proactive efforts in the identification of underrepresented students for gifted and talented services. Gifted Child Quarterly, 60(3), 159-171. https://doi.org/10.1177/0016986216643165 Pfeiffer, S. I. (2012). Serving the gifted: Evidence-based clinical and psychoeducational practice. Routledge. https://doi.org/10.4324/9780203883587-8 Reis, S. M., Renzulli, S. J., & Renzulli, J. S. (2021). Enrichment and gifted education pedagogy to develop talents, gifts, and creative productivity. Education Sciences, 11(10), 615. https://doi.org/10.3390/educsci11100615 Schleicher, A. (2014). Equity, excellence and inclusiveness in education. International Summit on the Teaching Profession, Wellington, New Zealand, March, 28. https://doi.org/10.1787/9789264214033-en Shemshack, A., & Spector, J. M. (2020). A systematic literature review of personalized learning terms. Smart Learning Environments, 7(1), 1-20. https://doi.org/10.1186/s40561-020- 00140-9 Yin, R. K. (2003). Case study research: Design and methods. Thousands Oaks. Sage. Young, LC and Wilkinson, IR (1989). The role of trust and co-operation in marketing channels: a preliminary study. European Journal of Marketing, 23(2), 109-122. Yin, R. K. (2018). Case study research and applications: Design and methods. Sage. |
17:30 - 19:00 | 16 SES 13 B: Developing Students' Thinking Skills in Geography Lessons Through Educational Scenarios in a Digital Environment Location: Room 015 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor] Session Chair: Irina Kliziene Research Workshop |
|
16. ICT in Education and Training
Research Workshop Developing Students' Thinking Skills in Geography Lessons Through Educational Scenarios in a Digital Environment Kaunas University of Technology, Lithuania Presenting Author:Developing higher thinking skills in geography is very relevant in today's realities, so it is essential to improve and develop them and look for new ways of developing them in the best and most effective way. The annual national tests of pupils' achievements provide an opportunity to obtain feedback on pupils' knowledge and its application and on developing higher-order thinking skills in geography. Using the insights from the results of these tests, it is the higher-order thinking tasks where pupils struggle the most and perform the worst. The updated general curriculum also emphasizes the importance of higher thinking skills. The curricula contain seven competencies, of which cognitive competence is linked to the development of higher thinking skills. The General Education Standards for Geography state that students should be able to recognise and understand the overall geographical context based on sound factual knowledge, judgment and problem-solving skills (Wuttke, 2005), to educate students to become responsible citizens, and to provide them with the opportunity to engage in social discourse. Developing competencies is one of the most critical objectives in the Geography curriculum. In the scientific area, digital environments are proposed to develop these processes, as they offer more opportunities for creating effective feedback, and searching for information, multimedia content creates even more possibilities for analysing problems, and the possibility of working independently or collaboratively. Developing critical thinking is proposed through virtual reality and various smart technologies, thus increasing students' engagement in problem-solving, achieving better understanding and awareness, and bringing a new dimension to their learning approach. Therefore, it is essential to explore the possibilities of using intelligent tools and to develop educational scenarios that include an educational environment, a model of action where social and digital environments interact. Such educational scenarios could be used by educators teaching the subject of geography to develop higher thinking skills. Failure to develop higher thinking skills or inadequate development of higher thinking skills, results in poorer student learning outcomes, narrowing education to the teaching of knowledge, and a lack of development of thinking skills (Palavan, 2020). Educators' discretionary choice of methods and tools to develop higher thinking skills produces ineffective results. As a result, it is challenging to develop these skills, and pupils do not set themselves higher learning goals or improve. The study aims to improve students' higher thinking skills in geography through educational scenarios in a digital environment. 1. to analyse the possibilities of developing pupils' higher thinking skills in geography lessons by applying educational scenarios in a digital environment; 2. to identify students' higher thinking skills in geography lessons through the use of eye-tracking methodology and think-aloud protocols. The idea behind this research includes the following questions: how to you choose and apply an appropriate conative, metacognitive or other learning strategy? We will explore digital scenarios in the subject of geography by focusing on the problem-solving process, the development of higher thinking skills (Rosiyanti et al., 2021; Nurkaeti, 2018), for which we will apply a eye-tracking approach for a deeper analysis (Strohmair et al., 2020; Schindler et al., 2019). The think-aloud method will be applied for a more in-depth uncovering of the decision process (Rosenzweig et al., 2011; Ericsson, 2006; Shwerdtfeger and Budke, 2021). To formulate arguments in geography lessons, students must engage with the geography problem and use classroom materials to gather data to support their views. A special feature of geography lessons is that students can link arguments from natural science (physical geography) and social science (human geography), and factual and normative arguments can also be used (Budke, 2013). Methodology, Methods, Research Instruments or Sources Used Six educational scenarios have been developed for 2023-2024 in the digital environment (the updated general education curricula focus on developing higher thinking skills in 6 dimensions). This study used an eye-tracking quasi-experiment to quantitatively evaluate the changes in the map-based spatial ability of 9th-grade students by comparing two geography progress monitoring tests (pre-test and post-test). Students coping strategies (higher thinking skills) in geography problems are assessed in geography lessons using the think-aloud methodology applied during the problem-solving process, with only follow-up questions after the problem-solving, and the eye-tracking methodology in the geography problem-solving tasks. Research methods: Eye-tracking is becoming an important research method in geography education and a prerequisite for research-based solutions to improve geography education. This research informs and enables the assessment of cognitive processes in the learner that would not otherwise be observed, or even consciously explained, but are reflected in eye movements, i.e., the observation of geography problem-solving processes, decision-making techniques and strategies, cognitive load and attentional retention is made possible by the tracking and recording of eye movements. Researchers recommend that the relationship between mental representations and eye movements should be monitored while working on the task, not after completion (Hartmann et al., 2016). Therefore, student research is highly relevant and will provide new data for analysing the problem. Thinking aloud protocols, in which pupils are asked to name their thoughts and actions during a task aloud, is a way for the research participant to verbally describe cognitive and metacognitive processes, which are captured by the researcher (by listening, recording and later transcribing) in think-aloud protocols (Ericsson, 2006). This is thought to help construct the students' working processes and identify the problems that emerge in their wording. In addition, this method will aim to understand better students' thinking processes and intermediate stages of writing (Dannecker 2018). The Geography Progress Monitoring Test (GPMT) has been created to respond to all the requirements of the Framework. The tests are designed to cover all domains of activity and the items are evenly distributed across achievement and cognitive ability groups. Data analysis methods: qualitative content analysis will be used to analyse the qualitative data . Sample: twenty 9th-grade students aged 15-16 in the current school year, in their adolescence (based on a study conducted by Schwerdtfeger, Budke, 2021). Conclusions, Expected Outcomes or Findings In the pre-test to measure progress in geography, we found the lowest scores were in the higher thinking skills tasks - meaning connections identification, critical evaluation of information, and finding solutions. The results discovered in our study would direct educators to find a reliable way of improving students' spatial ability and enhancing their ability to solve social and environmental problems with spatial thinking. References Budke, A.(2013). Stärkung von Argumentationskompetenzen im eographieunterricht - sinnlos, unnötig und zwecklos? In: M. Becker-Mrotzek, K. Schramm, E. Thürmann, & H. Vollmer (Eds.), Sprache im Fach. Münster, 353-364. Dannecker, W. (2018). Lautes Denken. Leise lesen und laut Denken. Eine Erhebungsmethode zur Rekonstruktion von „Lesespuren“. In: J. Boelmann (Ed.), Erhebungs- und Auswertungsverfahren. Baltmannsweiler, 131-146. Ericsson, K.A. (2006). Protocol analysis and expert thought: concurrent verbalizations of thinking during experts’ performance on representative tasks. In: K.A. Ericsson, N. Charness, P.J. Feltovich, and R.R. Hoffman, eds. The Cambridge handbook of expertise and expert performance. Cambridge, UK: Cambridge University Press, 223–242. Hartmann, M., & Fischer, M. H. (2016). Exploring the numerical mind by eye-tracking: a special issue. Psychological Research, 80(3), 325–333. Nurkaeti, N. (2018). Polya’s strategy: an analysis of mathematical problem solving difficulty in 5th grade elementary school. Edu Humanities| Journal of Basic Education Cibiru Campus, 10(2), 140. Palavan, O. (2020). The Effect of Critical Thinking Education on the Critical Thinking Skills and the Critical Thinking Dispositions of Preservice Teachers. Educational Research and Reviews,. 15 (10); 606-627. Rosenzweig, C., Krawec, J., & Montague, M. (2011). Metacognitive strategy use of eighth-grade students with and without learning disabilities during mathematical problem solving: A think-aloud analysis. Journal of learning disabilities, 44(6), 508–520. Rosiyanti, H., Ratnaningsih, D. A., & Bahar, H. (2021). Application of Mathematical Problem-Solving Sheets in Polya's Learning Strategy in Social Arithmetic Material. International Journal of Early Childhood Special Education, 13(2), 707–717. Shwerdtfeger, S.,Budke, A. (2021). Reference to Materials in Written Argumentations of Students in Geography Lessons. Journal of Curriculum and Teaching, 10 (3); 20-35. Schindler, M., & Lilienthal, A. J. (2019). Domain-specific interpretation of eye tracking data: towards a refined use of the eye-mind hypothesis for the field of geometry. Educational Studies in Mathematics, 101(1), 123–139. Strohmaier, A. R., MacKay, K. J., Obersteiner, A., & Reiss, K. M. (2020). Eye-tracking methodology in mathematics education research: A systematic literature review. Educational Studies in Mathematics, 104(2), 147–200. Wuttke, E. (2005). Unterrichtskommunikation und Wissenserwerb. Zum Einfluss von Kommunikation auf den Prozess der Wissensgenerierung. Lang. Frankfurt am Main. |
Contact and Legal Notice · Contact Address: Privacy Statement · Conference: ECER 2024 |
Conference Software: ConfTool Pro 2.6.153+TC © 2001–2025 by Dr. H. Weinreich, Hamburg, Germany |