Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
Please note that all times are shown in the time zone of the conference. The current conference time is: 10th May 2025, 09:47:04 EEST
|
Session Overview | |
Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Cap: 48 |
Date: Tuesday, 27/Aug/2024 | |
13:15 - 14:45 | 11 SES 01 A: Adult Education: From Theory to Practice Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Valerija Drozdova Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Transferring Results of Professional Development into Practice: Designing a framework for systematic review University of Latvia, Latvia Presenting Author:Although significant resources are yearly allocated to the professional development of adults in Latvia, there is a lack of evidence on whether the implemented professional development policies and activities has brought the expected practical results, resonating with the insights arrived at worldwide (Kennedy, 2019; Botma et al., 2015; Hughes et al., 2021, etc.), revealing the encountered challenges when transferring the acquired knowledge into practice. The problems still exist despite some early research on transfer of learning (Curry et al., 1994) and many follow up publications on the transfer and impact of professional development. (Borg, 2018; Brion, 2020, 2023; Kennedy, 2016; King, 2014; Blume, et al., 2010; Curry et al., 2005) Besides, these problems are compounded by the lack of clarity about what effectiveness of transfer really means, and also the lack of evidence on how to transfer professional development results into practice effectively. Despite the concept of transfer is being thoroughly explored, it still requires an in-depth look into the factors influencing the process of applying and transferring training results into practice. (Blume, et als, 2010) In the context of Latvia, only indirect evidence can be provided on the existence of such transfer. For example, the report "Results of adult education survey" (CSBL, 2018) mentions that 50.7% of respondents in formal education and 65.3% in non-formal education indicated adult education having led to better job performance. Besides, with teachers being one of the most relevant target groups when learning and professional development are in the focus, it should be noted that in 2018, 88.6 % of teachers in Latvia admitted a positive impact on their teaching practices over the 12 months prior to the survey (OECD, 2020). One of the most recent studies on teachers' work and professional development, (UL Interdisciplinary Centre for Educational Innovation, 2023) points to the need for a qualitative transformation of the professional development system for teachers, including the development of a targeted and goal-oriented support system within the organization. Measuring the impact and quality of implementation of professional development was another important finding, as well as preparing professional support staff for different needs. Nowadays understanding of the nature, implementation and results of professional development has evolved, and there are many definitions, models and approaches to the concept, most of them related to the teacher professional development. The current study seeks to further elaborate the definition of the concept by focusing on holistic perspective of processional development, thus including various forms of learning - formal and informal learning, training, workplace learning, coaching, mentoring, etc. To find evidence-based solutions for developing effective and efficient ways of professional competences of adults and assessing of the transfer of its results into practice in Latvia, first of all, it is necessary to raise awareness of the existing knowledge base, conduct a conceptual feasibility study, and identify indicators for the transfer of professional development results which in the current situation sufficiently reflect the transfer efficiency revealing also methodological concerns (including the recognition that self-reflected evidence produce ’inflating’ effect; see Blume, et al., 2010) related to the measurement and conclusions. Three research questions are stated for systematic literature analysis: 1) What characterizes effective professional development? 2) Which theoretical concepts in the scientific literature represent the transfer of adult professional development into practice? 3) What processes and indicators show effective ways of transferring results professional learning outcomes into practice? Methodology, Methods, Research Instruments or Sources Used The research questions will be addressed by using guidelines of Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA, Page at al., 2021). A systematic review attempts to collect all the existing knowledge on the topic area (Grant & Booth, 2009) and uses a systematic approach to synthesize findings of relevant studies, which is why the research is organized in three steps. First, a preliminary qualitative research of the already published systematic reviews and meta-analysis regarding the transfer of professional development results into practice, the total of 99 units, is done by searching relevant databases (Scopus, ERIC, EBSCO, Sage Journals, SpringerLink Contemporary Journals, Wiley Online Library, Taylor & Francis Library, ScienceDirect, MDPI, Emerald eJournals Premier). The goal of this preliminary research is to identify objectives, keywords, the main theoretical concepts, processes and sectors, and to propose the eligibility criteria (i.e., the inclusion and exclusion criteria related to publication year, language, type of publication, target group, research context, field, etc.) and data sources for the systematic literature analysis according to PRISMA statement (Page at al., 2021). Then, the research field shall be narrowed to the most appropriate published systematic reviews for the specific project objective selected for detailed analysis to identify indicators for measuring how effective professional development and transfer of professional results into practice are. A decision was made to narrow down the databases where articles were searched (Web of Science and Scopus), as it is mostly possible to find articles published by other publishing houses in these databases. This will allow to move into the final research stage – the analysis of new original studies (not systematic reviews) to provide answers to the research questions. Conclusions, Expected Outcomes or Findings The proposed systematic literature review (January-March 2024) will identify the main relevant theoretical concepts, processes, models, solutions as well as performance indicators related to effective professional development and effective transfer of its results into practice. So far we conclude that the system is recommended to be designed so that it was focused, personalized and effective, which can be achieved by designing specific, flexible targeted programs according to the needs of different teaching profiles, commissioning/financing forms of professional development that have an impact on practice, both workplace learning and a flexible choice of different modules (micro-courses), etc. The results of systematic literature analysis will empower the next steps of the research, namely, identification of good practice examples transferable into the socio-cultural and legislative contexts in Latvia. This includes the tools for measuring how effective and efficient transfer of professional development into practice is. This research is funded by the Ministry of Education and Science Republic of Latvia, project “Elaboration of evidence-based solutions for effective professional competence development of adults and assessment of the transfer of its results into practice in Latvia”, project No. VPP-IZM-Izglītība-2023/4-0001. References Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of Training: A Meta-Analytic Review. Journal of Management, 36(4), 1065-1105. Borg, S. (2018). Evaluating the impact of professional development. RELC Journal, 49(2), 195-216. Botma, Y., Van Rensburg, G. H., Coetzee, I. M., & Heyns, T. (2015). A conceptual framework for educational design at modular level to promote transfer of learning. Innovations in Education and Teaching International, 52, 499–509. Brion, C. (2020). Learning transfer: The missing linkage to effective professional development. Journal of Cases in Educational Leadership, 23(3), 32-47. https://doi.org/ Brion, C. (2023). The impact of local culture on adult learning transfer: Implications for human resources professionals. Human Resource Development International, 26(3), 331-340. CSBL - Central Statistical Bureau of Latvia (2018). Results of adult education survey. https://admin.stat.gov.lv/system/files/publication/2018-03/Nr%208%20Apsekojuma%20Pieauguso%20izglitiba%20rezultati%20%2818_00%29%20LV_EN.pdf Curry, D. H., Caplan, P. & Knuppel, J. (1994). Transfer of training and adult learning (TOTAL). Journal of Continuing Social Work Education, 6(1), 8-14. Curry, D., McCarragher, T. & Dellmann‐Jenkins, M. (2005). Training, transfer, and turnover: Exploring the relationship among transfer of learning factors and staff retention in child welfare. Children and Youth Services Review, 27(8), 931-948. Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91-108. Hughes, A. M., Zajac, S., Woods, A. L., & Salas, E. (2020). The Role of Work Environment in Training Sustainment: A Meta-Analysis. Human Factors, 62(1), 166-183. Kennedy, M. M. (2016). How does professional development improve teaching? Review of Educational Research, 86(4), 945-980. Kennedy, M. M. (2019). How We Learn About Teacher Learning. Review of Research in Education, 43(1), 138-162. King, F. (2014). Evaluating the impact of teacher professional development: An evidence-based framework. Professional Development in Education, 40(1), 89-111. Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D. et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372(71). OECD (2020), TALIS 2018 Results (Volume II): Teachers and School Leaders as Valued Professionals, TALIS, OECD Publishing, Paris, UL Interdisciplinary Centre for Educational Innovation. (2023). Kā izglītības sistēma var atbalstīt skolotāju, lai skolēni varētu apgūt 21. gadsimta prasībām atbilstošu izglītību? Ieteikumi izglītības politikas veidotājiem [Recommendations for education policy makers on how the education system can support teachers to provide students with a 21st century education]. UL ICEI. https://www.siic.lu.lv/fileadmin/user_upload/lu_portal/projekti/siic/LU_Izglitibas_Sistemas_Atbalsts_Skolotajiem.pdf 11. Educational Improvement and Quality Assurance
Paper Leadership and School Improvement in Swedish Municipal Adult Education Karlstad University, Sweden Presenting Author:In times of global instability because of climate change, international conflicts, war, and increased migration, the interest in adult education has become global. Adult education is seen as the potential driving force for paving the way for human rights, emancipation, citizenship, multiculturalism, equality, and sustainable societies, and brings hope for a peaceful world (UNESCO, 2022). For this reason, UNESCO emphasizes the need for enabling participation in adult education for more individuals over the world. Swedish municipal adult education, MAE, is the largest in the world per capita (Fejes & Henning Loeb, 2021), and therefore, may seem successful. However, viewing participation in itself as a measure of quality in education is questionable, as the educational mission is often complex and related to the national educational system context, which sets the conditions for practice. While UNESCO concludes that most countries have reported progression in quality in adult education, the trends within Swedish MAE are contrasting. Swedish MAE is facing severe challenges in terms of quality, such as many students leaving MAE without passing (65% of all registered students in 2022, according to the Swedish National Agency for Education, 2023), increased detection of grade fabrications (Fejes, Runesdotter & Wärvik, 2015), and mass exodus of professional practitioners (Portfelt, 2021). While the reasons for this condition have mostly been studied from a critical policy analysis perspective, there is a lack of school improvement research. There is consequently a call for such research studies (Fejes & Henning Loeb, 2021).
This study reports on the research project Leadership and school improvement within Swedish MAE that started in 2019 in collaboration between a researcher (author) and two practitioners working within MAE. The collaborative practice was set up as an action research approach, and the multimethod project evolved over time. The research set-up contrasts with the dominating trends in international research on adult education, and responds to a lack of studies using multimethod and/or quantitative methods (Boeren, 2019; Fejes & Nylander, 2019). We eventually came to study eight local MAE institutions in terms of internal quality work and indirectly, their surrounding practices. Analytically, we defined quality work as the practitioners’ systematic work with supporting each student in their learning and progression, based on the students’ individual pre-conditions, learning capacity, and needs, as far as possible to succeed in their studies.
The aim of this study is to explore the preliminary findings from the research project and shed light on how practices emerge in the local MAE institutions in terms of quality work, and what prefigures practice. Research questions are;
- How is the quality work of the local MAE institutions carried out in practice? - What aspects enable as well as constrain the systematic quality work of the local MAE institutions? The study uses the theory of practice architecture, TPA, as an analytical framework (Kemmis et al., 2014). Here, practice is defined as social processes that emerge in the interplay between individuals, cultures, and structures, as a result of historical as well as ongoing processes. The focus is on practices and how they are brought into the site. Kemmis et al. (2014) emphasize that practices are constituted by the sayings, doings, and relatings that interplay in relation to the studied phenomena in a specific practice. The sayings, doings, and relatings are prefigured by practice architectures that are present or emerging into the site; sayings by cultural-discursive arrangements, doings by material-economic arrangements, and relatings by social-political arrangements. Methodology, Methods, Research Instruments or Sources Used Data is generated by multimethod, such as qualitative policy analysis, a survey completed by teachers in eight local MAE institutions analyzed by factor analysis, multivariate analysis, descriptive statistics, and qualitative content analysis of free text options, and interviews with principals in the eight local MAE institutions. The research project has been approved by the local university’s ethical committee. No personal data have been collected from the respondents. The participants were fully informed about the research project and their rights in accordance with research ethics, and have given their consent to participate in recordings, survey analyses, and reports of the findings. The research project has followed all the ethical guidelines and recommendations of the Swedish Research Council (“Good Research Practice” from 2017, a new edition forthcoming in 2024). All preliminary findings will be integrated and meta-analyzed through the framework theory of practice architecture. Due to the variety of data and findings, the meaning of findings from each study in the research project will be coded into sayings, doings, and relatings in accordance with the theoretical framework. These codes will then be analyzed to identify the surrounding arrangements. Finally, the interrelations between the arrangements will be analyzed to reveal the practice architecture of the local MAE institutions in terms of quality work, and its constraining and enabling traits (Kemmis et al., 2014). Conclusions, Expected Outcomes or Findings How the quality work of the local MAE institutions is carried out in practice Participating practitioners in the study seem to have big interest in and compassion for MAE students. However, the quality work of local MAE institutions emerges as unsystematic, sporadic, optional, and coincidental. Principals are mostly described as absent as pedagogical leaders. Professionals emerge as loosely coupled, and there are no systems or routines in place to support professionals in quality work. Individuals, or small sub-groups of professionals with a particular interest in working systematically with quality work, invent their own systems. As a consequence, several parallel systems sometimes exist and compete with one another within one and the same local MAE, which fragments the efforts to work with quality even more. This tends to produce radical introvertism among some of the professionals within MAE, promote the emergence of informal leaders, and create a type of professional autonomy that make practitioners refuse to be led by a formal leader. Aspects that enable as well as constrain the systematic quality work of the local MAE institutions On the one hand, social-political arrangements enable quality work, as the content in policy focuses systematically on supporting students in their learning. On the other hand, social-political arrangements constrain such quality work by putting MAE into an educational market, forcing local MAE institutions to compete by reducing efforts and costs, not requiring special education teachers or student health, and allowing municipalities to organize MAE under school boards with no knowledge of the educational assignment of MAE. Local quality work is enabled by principals that prioritize their pedagogical leadership, educate their local school board about the mission of MAE, arrange their local MAE to focus on students’ learning and progression, and use scientific approaches to professionalize local MAE professions. References Boeren, E., Cabus, S. & Mackie, A. (2023). Participation in Adult Learning: System Characteristics and Individuals’ Experiences. In: Holford, J., Boyadjieva, P., Clancy, S., Hefler, G., Studená, I. (eds) Lifelong Learning, Young Adults and the Challenges of Disadvantage in Europe. Palgrave Studies in Adult Education and Lifelong Learning. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-14109-6_4 Fejes, A., Nylander, E. (2019). Introduction: Mapping the Research Field on Adult Education and Learning. In: Fejes, A., Nylander, E. (eds) Mapping out the Research Field of Adult Education and Learning. Lifelong Learning Book Series, vol 24. Springer, Cham. https://doi.org/10.1007/978-3-030-10946-2_1 Fejes, A., & Henning Loeb, I. (2021), Om komvux och skolutveckling. (About MAE and school improvement) In Hirsh, Å. & Olin, A. (red), (2021). Skolutveckling i teori och praktik. Malmö: Gleerups Utbildning AB. Fejes, A., Runesdotter., C., & Wärvik, G.B. (2016). Marketisation of adult education: Principals as business leaders, standardised teachers and responsibilised students. International Journal of Lifelong Education, 2016. 35(6), pp.664-681. http://dx.doi.org/10.1080/02601370.2016.1204366 Kemmis, S., Wilkinson, J., Edwards-Groves, C., Hardy, I., Grootenboer, P., & Bristol, L. (2014). Changing Practices, Changing Education. Singapore: Springer Science-Business Media. https://doi.org/10.1007/978-981-4560-47-4. Portfelt, I. (2021). Komvuxrektorers professionella autonomi – frivillig eller påtvingad? I Att jobba som rektor: - om rektorer som professionella yrkesutövare / [ed] Ahlström, B., Berg, G., Håkansson Lindqvist, M. & Sundh, F., Lund: Studentlitteratur , 2021, 1, s. 137-151. UNESCO (2023). Fifth Global Report on Adult Learning and Education. https://unesdoc.unesco.org/ark:/48223/pf0000381666 11. Educational Improvement and Quality Assurance
Paper Teaching/Learning Methodologies for Solving Internal Communication Challenges in Tourism and Hospitality Enterprises Turiba University, Latvia Presenting Author:The development of information and communication technologies, the spread of various social networks, the development of AI, has greatly impacted organizations, the way how they manage communication. This is especially true about the industries where communication is directly related with selling their product, tourism and hospitality industry among them. Communication is a complex, social and never-ending process which takes place in a definite socio-cultural environment. Communication has been defined as ‘the exchange of knowledge (founded upon information exchange)' (Gontier, 2022), ‘a transmission of information that implies the emission of the message’ (Matias & Cardoso, 2021, 133), ‘a unique, powerful, and complicated form of human behaviour' (Waldron 2022: 1), and ‘the use of symbols that represent ideas, which then create meanings that can be shared’ (Topić, 2023, 537). Communication happens in different contexts, among different interlocutors and for various purposes. In ECER2022, the author presented the article on intergenerational communication problems in tourism enterprises (Luka, Šakytė-Statnickė, Budrytė-Ausiejienė, 2023). In ECER2023 teaching/learning initiatives to organize adult learning to solve intergenerational communication problems were presented (Šakytė-Statnickė, Budrytė-Ausiejienė, Luka, Drozdova, 2023). The contribution of ECER2024 will focus on internal organizational communication, its challenges and the skills and knowledge necessary for efficient internal communication and the methodologies on how they could be developed. Theoretical framework is based on the theories of organizational communication, focusing on internal communication, and the development of knowledge and skills required for efficient internal organizational communication. Business communication refers to information exchange between a company and its employees ‘based on an examination of the structure and operation of communication networks and systems’ (Kraljević, Russo, 2022, 112). Communication in organizations is divided into internal and external communication. In turn, internal communication may be further subdivided into two-way symmetrical communication (a dialogue between the management and the employees) and asymmetrical communication (upward or downward) (Balakrishnan, Angusamy, & Rosli, 2024). The latest research presented in literature higlights the following knowledge and skills crucial for efficient internal organizational communication: 1) knowledge of understanding internal communication and its role within an organization, organizational culture, crisis management, strategic use of digital media and understanding multicultural and global issues 2) oral communication skills, listening, empathy, flexibility to change, teamwork, interpersonal communication and leadership (Yue, Thelen, 2023; Gomes, Santos, Martins, 2023; Verčič, Špoljarić, 2020; Verčič, Men, 2023; Waititu, Barker, 2023). Therefore, it is essential to apply such teaching/learning methods that would increase the employees’ essential knowledge and develop skills mentioned above in various contexts, practising symmetrical and asymmetrical communication situations. Integration of digital and analogue learning methods and tools may be beneficial therein (Orr, Luebcke, Schmidt, et al., 2020). It is especially important because in the future the contrast between a physical and a virtual space will become less and less important, the two spaces will probably merge. Reciprocal questioning is of utmost importance as well. In practice, learners are trained to ask generic questions of each other, following the teaching of a piece of content. For example: What is the main idea here? How would you compare this with . . .? Collaborative learning groups, jigsaw groups, chatrooms, concept mapping, problem-solving tasks are other opportunities (Biggs, Tang, 2011). Project-based and games-based learning are usuful as well (Council Recommendtion, 2018) as they incraese learner engagement. The aim of the research presented in ECER2024 is to analyze internal organizational communication goals, practices, benefits and challenges in tourism and hospitality enterprises and offer teaching/learning methods to eliminate the existing problems. Research question: What challenges of internal communication do tourism and hospitality industry companies face and what teaching/learning methods may be applied to educate employees in managing more efficient internal organizational communication? Methodology, Methods, Research Instruments or Sources Used This research was conducted in the Nordplus Adult Development project „NordTourNet-3: Solving Communication Problems of Different Generations in Tourism Companies” (NPAD-2020/10015; 2020-2023). The project partners are three education institutions from Lithuania, Latvia and Sweden implementing adult education programs. The qualitative exploratory research conducted is in line with interpretivism paradigm to understand ‘individual cases and situation’ and meanings holistically (Coe, 2017, 6). Qualitative exploratory research (Collis, Hussey, 2009) applying 12 semi-structured interviews and 9 unobtrusive social observations in tourism companies were done (Aurini, Heath, Howells, 2016). This contribution employs the data derived from 12 in-depth semi-structured expert interviews with top level tourism and hospitality industry management representatives and business owners conducted in Lithuania, Latvia and Sweden face-to-face onsite or using video conferencing applications (Zoom or Cisco Webex) (Aurini, Heath, Howells, 2016). The interviews were transcribed, coded and analysed applying qualitative content analysis (Croucher, Cronn-Mills, 2019, 162). Criterion sample was created, involving 4 participants from Lithuania, 5 participants from Latvia and 3 participants from Sweden representing 4 accommodation enterprises, 2 catering enterprises, 6 participants represented tour organization (travel agencies, tour operating companies, tourist information centres). The companies employed from 2 to 23 employees. The interview guide included 5 parts. This contribution focuses on the data of Part 2 (information about participants and their companies), Part 3 (internal communication of the company, including the social media used), Part 5 (different communication problems encountered in the company and their reasons). The research was conducted during the Covid-19 period and post-Covid period from January 2021 to June 2022. Research limitations: participants managed or owned small or medium-sized enterprises. This is a typical situation in the target countries, wherein a great majority of accommodation and catering enterprises are family run businesses. However, providing the sample had included also participants from large enterprises, the results could have differed. Another limitation was the Covid-19 period since all companies had to sack part of their employees as tourism was among the first industries to suffer from the crisis. Conclusions, Expected Outcomes or Findings 3 categories of themes were defined: 1) the main goals of internal communication in the organization, 2) the internal communication channels used in the organization, and 3) the strengths and weaknesses of internal communication in the organization. The main goals of internal communication depend on the type of the company. Below LV, LT, SE stand for the respective country: 1) For accommodation business: pass on information to the employees (LV2, LV5, LT1), ensure that daily duties are fulfilled properly (LV5), get feedback from employees about job satisfaction (LT1), improve language skills (SE3). 2) For catering business: ensure reputation (LT4), improve language skills (SE2), escape miscommunication and eliminate disagreements (SE2). 3) For tour organization: provide high standard of services (LV1, LT2, LT3), set goals and reach them (LV3), make sure that the information is passed to all employees (LV4, LT2, SE1), brainstorm business ideas (LV4). The internal communication channels are similar to all countries: 1) Written: e-mail (LV2, LV3, LV4, LV5, LT2, LT3, SE2), WhatsApp or FB group (LV3, LV5, LT1, LT3, LT4, SE2), messaging (LT2, SE3), google drive (LT1, LT3). The predominance of e-mail is explained by participant LT2: ‘Email is the main means of communication because all information has to be in writing’. 2) Oral: phone calls (LV2, LV3, LT1, LT2, LT3, SE2, SE3), F2F meetings (LV4, LT1, LT2, LT3, LT4, SE1, SE2, SE3), visits (LV3, LT1), video conferencing application (LT3). F2F communication is preferred in all businesses, disregarding the company size. Such weaknesses were discovered: cultural differences (LV1), lack of information, quality of information passed (LV2, LV5, LT2, LT3, LT4), language problems (LV2, LV5), lack of feedback (LV3, LT1, LT2), communication barriers (LV2, LV3, LV4, SE2), breaking the rules (LT2), intergenerational communication conflicts (LT2, LT3), different approaches to communication channels (LT2). References *Aurini, J.D., Heath, M., Howells, S. (2016). The How to of Qualitative Research. Sage. *Balakrishnan, K., Angusamy, A., Rosli, M.D.R. (2024). Two-way asymmetrical communication mediating internal communication and employee engagement. Environment and Social Psychology, 9(2), 2074. *Biggs, J., Tang, C. (2011). Teaching for Quality Learning at University. What the student does. McGraw-Hill Education. *Coe, R.J. (2017). The nature of educational research. R.J. Coe (Eds.), Research Methods & Methodologies in Education, (5-14), Sage. *Collis, J., Hussey, R. (2009). Business Research. Basingstoke: Palgrave Macmillan. *Council Recommendation of 22 May 2018 on key competences for lifelong learning, 2018/C 189/01. *Croucher, S.M., Cronn-Mills, D. (2019). Understanding Communication Research Methods. Routledge. *Gomes, P., Santos, E., Martins, E. (2023). An exploratory analysis of internal communication in times of the COVID-19 pandemic. Global Business and Organizational Excellence (GBOE), 42, 37-49. *Gontier, N. (2022). Defining Communication and Language from Within a Pluralistic Evolutionary Worldview. Topoi, 41, 609-622. *Kraljević, S., Russo, A. (2022). Communication in the Management Process -Productive Communication. Pomorski zbornik, 62, 111-124. *Luka, I., Drozdova, V., Šakytė-Statnickė, G., Budrytė-Ausiejienė, L. (2023). Solving Intergenerational Communication Problems in Tourism and Hospitality Enterprises. Journal of Education Culture and Society, 14(1), 207-228. *Matias, A. & Cardoso, L. (2021). Defining communication: factors and barriers of a complex concept. European Journal of Social Sciences Studies, 7(1), 131-141. *Orr, D., et al. (2020). Higher Education Landscape 2030: A Trend Analysis based on the AHEAD International Horizon Scanning. Springer Open. *Šakytė-Statnickė, G., Budrytė-Ausiejienė, L., Luka, I., Drozdova, V. (2023). Internal and External Communication between Employees of Different Generations: Emerging Problems in Lithuanian, Latvian, and Swedish Tourism Organizations. Journal of Tourism and Services, 14(26). *Topić, M. (2023) Editorial 28.4: Interpersonal Communication and Social Listening. Corporate Communications: an international journal, 28(4), 537-543. *Verčič, A.T., Men, L.R. (2023). Redefining the link between internal communication and employee engagement. Public Relations Review, 49, 102279. *Verčič, A.T. Verčič, D., Čož, S., Špoljarić, A. (2024). A systematic review of digital internal communication. Public Relations Review, 50, 102400. *Waititu, P., Barker, R. (2023). Employees’ Perceptions on the use of Online Internal Communication for Knowledge Sharing. The Electronic Journal of Knowledge Management, 21(2), 103-113. *Waldron, V.R. (2022). Foreword: Yes, reading interpersonal communication theory can be life changing. In Braithwaite, D.O., Schrodt, P. (eds.), Interpersonal Communication: Multiple Perspectives, 1-7. Taylor & Francis. *Yue, C.A., Thelen, P.D. (2023). The state of internal communication in Latin America: An international Delphi study. Public Relations Review, 49, 102262. |
15:15 - 16:45 | 11 SES 02 A: Increasing Students' Subject Knowledge and Developing Language Proficiency Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Valerija Drozdova Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper The Effect of the “Parallel Text” Method on the Students’ Understanding of Physics in English and Improve Their Language Skills Nazarbayev Intellectual School, Kazakhstan Presenting Author:Since the students of the high school continue to study all the profile subjects in English after completing the basic school, it is more difficult for them to study in English. Each year, when analyzing the results of the final summary evaluation of 12th-grade students, it was determined that the majority of students do not understand the command words in chemistry, biology, physics, and informatics, some terms, and the meaning of dialect words found in context. To this end, in the course of studying the methods of light learning of the subject in English, we decided that it is better to consult with English experts and try one of the most common methods of their use "parallel text". In the vast majority of articles and books published in Scholar.google.com, the definition of parallel text is a text within its translation. Based on the research of world-class scientists and educators: Michael Cysouw and Bernhard Wälchli (2007) highlight the role of parallel texts in facilitating theorists' work, transcribing texts like the "Biblical" in 400+ languages.Alex M. Kushnir (2018) emphasizes accessing master-level translations using parallel texts for a deeper understanding.MOHSEN GHADESSY and YANJIE GAO (2000) mention the importance of parallel texts for designing dictionaries and teaching translation methods. Yudina (2022) notes the use of parallel texts in learning Russian and provides an example in physics. Among the articles listed above, some authors prioritize not providing a full translation version of the script during task compilation. Therefore, we decided to take into account the level of knowledge of students before using the method of "parallel text". The study was attended by high school students with a basic and average level of English. In the study, educational materials in physics were given in two different directions. First, an English translation of team words and some terms was offered for students who were constantly confused about the meaning of team words. In the second direction, 70-80% of the context of the assignment was translated for students with very low English levels, and command words and keywords were underlined. The reason we gave the text is that when the students studied in English, the translation in their native language was given so that they could not search the context for a long time. It is noted that many world-class teachers and psychologists adhere to this direction. According to experts who use the method, it is not necessary to provide a full translation of the parallel text to avoid the risk of students becoming dependent on translation in their native language, rather than the context given in English. Another solution to avoid ingenuity, interactive lessons were organized, where students discussed the material in English, and teachers drew attention to the importance of working independently with English texts. Particular attention was paid to the quality of translation of educational materials. It was noted that the translation not only accurately represents the meaning of the original, but also adapts to the level of language proficiency of students. That is, by the level of education of students, the level of assignments was given. The main objective is to assess parallel texts' effectiveness in enhancing understanding of physical concepts in English. The study aims to address issues like command word comprehension, terminology understanding, and English language difficulties. Key questions include the impact on students' understanding of physics concepts and the effect on language achievements and motivation. The study also highlights the importance of accurate translations adapting to students' language proficiency levels. Interactive lessons and discussions in English aim to prevent dependence on native language translations. Methodology, Methods, Research Instruments or Sources Used To implement this study, we used surveys, interviews, and analysis of the results of Term1. According to the results of Term 1, students' grades in Physics were not satisfying. The quality of knowledge in physics in the 1st quarter amounted to 45%. Having reviewed the results of Term 1 marks, it was determined that the students had a poor understanding of context. Students were surveyed to determine the reasons for the lower grades in Term 1. As a result of the survey, 82% of students reported that they do not fully understand the meaning of assignments given in English in physics. He suggested confusing the meaning of team words, often difficult under Section B, and a written translation of some physical terms by the teacher. As part of the study aimed at improving the understanding of physical concepts by students studying in English, they were interviewed to assess the effectiveness of the method. The interview was conducted with a group of students. The questions were related to the frequency of use of the method, its impact on the understanding of physical concepts and language progress, changes in the attitude towards studying, and interest and interest in the learning process. Most of the students noted that the method of parallel text helped them to better understand physical concepts. The students noted that the presence of native texts next to English versions makes it easier to understand complex topics and terms. Several students noted the improvement of their English language skills, in particular, filling out the scientific terminology and academic dictionary fund. Almost everyone who participated in the interview noted that the use of parallel texts was interesting for the reading process, contributed to better participation in the reading process, and increased their motivation to study physics. Most of the students noted that they began to use parallel texts not only in classes but also in their training, which allowed them to get deeper into the material. The students noted that this method makes it easier to remember new terms, reduces the stress of reading, and makes the learning process interesting and attractive. This not only improved their language skills but also increased their level of knowledge of physics as a whole. Conclusions, Expected Outcomes or Findings Students’ feedback showed there was a significant change in their progress in the study of the subject, the results of the quality of education in the second quarter amounted to 90%. Learning Objectives in Term 2 may have been influenced by the increase in the quality of education as a result of life-related factors, but we think that the influence of the method is more significant. Students’ academic achievements significantly improved. However, there were some difficulties in the study. Students become addicted to their mother tongue too dependent on translation, and there was a side of not making enough effort to understand English-language material. As a solution we suggest to gradually reduce the use of the native language in parallel texts by encouraging students to pay more attention to English text, marking only by underlined command words and offering alternatives to rare terms. Another challenge was the waste of time and resources. We offer to use of ready-made resources, increasing the quality of materials, as well as the exchange of materials with other partners. We hope feedback from students, team control and the results of the survey will confirm the effectiveness of the method used and the answers to our research question. We plan to apply this method to our lower classes in the following quarters. We are confident that this short-term study of the high estuaries has reached its goal. We can confidently say that this method will allow our students to develop academic literacy, prepare for international exams, and learn the subject in another language easily and quickly. In the future, we plan to study the impact of this method on different aspects of pupils' academic performance, the impact on the development of other skills, as well as its effectiveness in subjects that are related to physics. References 1.Michael Cysouw & Bernhard Wälchli Max Plank Institute for Evolutionary Anthropology Deutscher Platz 6 D-04103 Leipzig cysouw@eva.mpg.de . “Parallel texts: Using translational equivalents in linguistic typology”. (2007). 2.Alex M.Kushnir (2018). “Parallel texts” as a metodical universal... 3.A.N. Yudina Federal State Budgetary Educational Institution «International Center of Education «Interdom» named after E.D. Stasova» THE METHOD OF READING PARALLEL TEXT AS ONE OF THE EFFECTIVE WAYS TO STUDY PHYSICS IN A FOREIGN LANGUAGE. (2022). 4.Michael Barlow. Pages: (106–115), DOI:https://doi.org/10.1163/9789004485204_008. “Parallel Texts in Language Teaching”. (2000). 5.William A. Gale Kenneth W. Church I AT&T Bell Laboratories Murray Hill, N.J., 07974 gale@research.att.com. “Identifying Word Correspondences in Parallel Texts”. (1991). 6.Jisong CHEN1 , Rowena CHAU2 , Chung-Hsing YEH3 School of Business Systems, Faculty of Information Technology Monash University, Clayton, Victoria 3800, Australia. “Discovering Parallel Text from the World Wide Web”. (2004). 7.Poznań Studies in Contemporary Linguistics 46(3), 2010, pp. 349–365 © School of English, Adam Mickiewicz University, Poznań, Poland doi:10.2478/v10010-010-0018-2. “NATIVE AND NON-NATIVE MODELS IN ELT: ADVANTAGES, DISADVANTAGES, AND THE IMPLICATIONS OF ACCENT PARALLELISM” (2010). 8.Kunstová, Adéla, Univerzita Karlova, Filozofická fakulta. “The position of scene-setting adverbials in English and Czech. A comparison on the basis of parallel texts” (2013). 11. Educational Improvement and Quality Assurance
Paper Relationship between Emotional Intelligence and Reading Comprehension Among Secondary School Students Nazarbayev Intellectual School, Kazakhstan Presenting Author:The primary objective of the present investigation was to empirically examine the potential correlation between the emotional intelligence of students and their reading comprehension. The study focused on 53 eleventh-grade students from Nazarbayev Intellectual School in Turkistan, Kazakhstan, selected from two classes. A reading comprehension test, specifically the IELTS reading comprehension section, was administered to assess the students' reading comprehension abilities. Additionally, the participants completed the USMEQ-i, as developed by Yusoff (2010), to measure their emotional intelligence. Statistical analyses, employing the Pearson Product Moment formula and Regression Analysis through the SPSS program, were conducted to ascertain both the correlation and the influence between emotional intelligence and reading comprehension. The findings revealed a statistically significant positive correlation between students' emotional intelligence and reading comprehension, as indicated by an r-value of .661. Furthermore, it was determined that students' emotional intelligence exerted an influence of 43.7% on their reading comprehension.
The concept of Emotional Intelligence (EI) originated in 1990 with Salovey and Mayer, aligned with earlier work on social intelligence and Gardner's intrapersonal and interpersonal intelligences. Daniel Goleman popularized it in 1995 with his book "Emotional Intelligence: Why It Can Matter More than IQ." Emotional intelligence involves using emotions to guide thinking and action, as well as facing challenges. It combines emotions and intelligence, considering emotions as valuable sources of information for navigating the social environment. Reading comprehension is now recognized as a multifaceted skill, involving both lower-level and higher-level processing. This complexity affects slow readers, leading to a lack of motivation and self-efficacy in processing target language reading. Consequently, individuals with poor reading comprehension struggle to grasp the essential meaning. To address this issue, there's a suggestion that developing students' emotional intelligence is crucial. High emotional intelligence, as highlighted by Downey et al. (cited in Abdolrezapour, 2013), is linked to enhanced motivation, planning, and decision-making. These emotional competencies positively impact academic performance. Human behavior is influenced by emotions, and individuals with strong emotional intelligence can manage their emotions effectively, leading to clearer thinking. Reading comprehension, a cognitive task, can be challenging, with readers sometimes feeling bored, hindering cognitive processing. Bryant (2007) suggests that reading comprehension involves emotional processing. Emotional intelligence integrates intellect and emotion, considering emotions as valuable sources of information for sense-making (Salovey & Grewal, 2005). Proficiency in comprehension correlates with emotional intelligence, as language learning involves communication, and understanding and controlling emotions are integral (Fani, 2015b). This research supports Nurhasnah's (2014) discovery of a significant positive correlation between students' emotional intelligence and reading comprehension in eighth-grade students. The correlation between emotional intelligence and comprehension proficiency is expected, given that language learning involves communication, understanding emotions, and the ability to control them. However, it differs from Ghabanchi and Rastegar's (2014) study, where emotional intelligence showed a weak correlation compared to intelligence quotient and reading comprehension.
The study emphasizes the importance of emotional intelligence in English language education, as supported by the influence of emotional intelligence (43.7%) on reading comprehension. This aligns with Motallebzadeh's (2009) findings, suggesting that reading comprehension is significantly influenced by emotional intelligence. Dehkordi and Bidabadi (2015) also acknowledge emotional intelligence's impact on EFL learners' reading comprehension, while Zarezadeh (2013) asserts that emotional intelligence affects English language learning. Recognizing emotional intelligence as a crucial component in education, Elias (2004, as cited in Fatum, 2008) and Downey et al. (2008, as cited in Abdolrezapour, 2013) highlight its contribution to increased motivation, planning, and decision-making, positively influencing academic performance.
Methodology, Methods, Research Instruments or Sources Used The study focused on eleventh-grade students (N=60) from Nazarbayev Intellectual School in Turkistan, Kazakhstan, with 53 selected as samples. Emotional intelligence was assessed using the Universiti Sains Malaysia Emotional Quotient Inventory (USMEQ-i) by Yusoff (2010), featuring 46 items across seven domains and a faking index. Faking index scores were categorized as low (0.00–2.00), average (2.01–2.99), and high (3.00–4.00). A high faking index suggests unreliable results, warranting validation through additional analysis. USMEQ-i, validated for construct validity, demonstrated a high Cronbach's alpha coefficient (0.96) for reliability across four intervals (2, 4, 6, and 8 months). Reading comprehension was evaluated using the TOEFL Junior section with 42 multiple-choice questions, ensuring validity and reflecting language testing best practices. The reading section's reliability coefficient was 0.89, with a standard error of measurement of 10.0. USMEQ-i scores were calculated following guidelines, with domain totals divided by the respective item count. The global emotional intelligence score, excluding the faking index domain, was obtained by summing the domain scores and dividing by 39. TOEFL Junior reading comprehension was scored using a standard system, with correct answers receiving 1 point and incorrect ones scoring 0. The total score ranged from 0 to 100. Students' emotional intelligence, analyzed descriptively, exhibited a USMEQ-i score range of 1.33 to 3.23, with a total sum score of 137.26 and a mean of 2.5898, indicating an average level among eleventh-grade students. Distribution showed 15 students in high emotional intelligence (2.81-4.00) and 38 in average (1.21-2.80), with none in the low category. For reading comprehension, TOEFL Junior scores ranged from 31 to 67, with a sum of 2523 and a mean of 47.60, categorizing students as having poor comprehension. Normality and linearity tests indicated normal data. There was a linear relationship between emotional intelligence and reading comprehension. The Pearson correlation revealed a significant positive correlation (r = .661, p < .05) between emotional intelligence and reading comprehension. Students' emotional intelligence significantly influenced reading comprehension (t = 6.290, p < .05). Conclusions, Expected Outcomes or Findings Firstly, the Pearson Product Moment Correlation revealed a positive and significant correlation (r = .661) between the reading comprehension and emotional intelligence of eleventh-grade students at NIS Turkistan. This positive correlation suggests that as students' emotional intelligence scores increase, their reading comprehension scores tend to increase, albeit with a modest impact on their reading comprehension achievement. The results indicate a possible connection between emotional intelligence and the approach students take during reading comprehension tests, including factors like attention-building, motivation promotion, and the activation of their will to complete the test, even when their capabilities are less proficient. This outcome aligns with prior theoretical and empirical studies, particularly supported by Motallebzadeh (2009), who found a positive relationship between emotional intelligence and reading comprehension. The contribution of emotional intelligence to improved performance on reading comprehension tests may be explained by cognitive processes involving both lower and higher-level processing. Higher-level processing involves assembling clause-level information into a text model, allowing students to build interpretations consistent with their goals, attitudes, and background knowledge. The findings also resonate with Karbalaei and Sanati (2014), indicating a strong positive relationship between emotional intelligence and reading comprehension. The study emphasizes the role of emotional processing in reading comprehension. In conclusion, the research underscores a positive and significant correlation between emotional intelligence and reading comprehension, emphasizing the importance of emotional intelligence in students' English learning, particularly in reading comprehension. Students are encouraged to be mindful of, explore, and enhance their emotional intelligence, while teachers should also consider and integrate emotional intelligence into the learning process. References 1.Abdolrezapour, P. (2013). The relationship between emotional intelligence and EFL learners' writing performance. Procedia - Social and Behavioral Sciences, 70, 331-339. 2.Abdolrezapour, P., & Tavakoli, M. (2010). The relationship between emotional intelligence and EFL learners’ achievement in reading comprehension. Innovation in Language Learning and Teaching, 6(1), 1-13. 3.Bryant, H. C. (2007). The relationship between emotional intelligence and reading comprehension in high school students with learning disabilities. Dissertations. (Graduate’s Dissertations). Andrews University, Michigan, United States 4.Fani, T. (2015a). Reading comprehension performance viewed in the light of Bar-on’s emotional intelligence scales and subscales. International Journal of Innovation and Research in Educational Sciences, 2(3), 2349–5219. 5.Fani, T. (2015b). Factors affecting English reading comprehension ability: investigating the role of EI, gender, and major. The IRES 4th International Conference, 59-63. 6.Karbalaei, A., & Sanati, F. (2015). The study of the relationship between emotional intelligence, reading motivation, and anxiety with reading comprehension among Iranian EFL learners. International Journal of English Language and Literature Studies, 4(4), 171- 183. 7.Mayer, J. D., Roberts, R. D., & Barsade, S.G. (2008). Human abilities: emotional intelligence. Annual Review of Psychology, 5, 507–536. 8.Motallebzadeh, K. (2009). The relationship between the emotional intelligence of Iranian EFL learners and their reading comprehension and structural ability. Journal of Teaching English as a Foreign Language and Literature, 1(4), 39-55. 9.Nurhasna. (2014). The correlation between students’ emotional intelligence and their reading comprehension at islamic junior high school Sawah Kampar regency (Undergraduate’s Thesis). State Islamic University of Sultan Syarif Kasim Riau, Pekanbaru, Indonesia. 10.Salovey, P., & Mayer, J. (1990). Emotional intelligence, imagination and cognition, and personality. Educational Psychologist, 9, 185-211. 11.Yılmaz, C. (2012). An investigation into Turkish EFL students attributions in reading comprehension. Journal of Language Teaching and Research, 3(5), 823-828. 12.Yusoff, M. S. B., Rahim, F. A., & Esa, A. R. (2010). The USM Emotional Quotient Inventory (USMEQ-i) Manual. Kelantan, Malaysia: KKMED Publications. 13.Yusoff, M. S. B. (2012). Stability of USMEQ-i in measuring emotional intelligence in medical students. ASEAN Journal of Psychiatry, 13(1), 1-6. 14.Zarezadeh, T. (2013). The effect of emotional intelligence in English language learning. Procedia - Social and Behavioral Sciences, 84, 1286-1289. |
17:15 - 18:45 | 11 SES 03 A: Novel Approaches to Language Teaching/Learning in Formal Education Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Ineta Luka Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Undergraduate Students’ Experience of Using Web-based Learning Technologies in Translation Studies Vilnius University, Lithuania Presenting Author:Since the beginning of the 21st century, the use of web-based learning technologies has been growing rapidly at all levels of education, higher education included. The growth reached the peak during the COVID-19 pandemic when education institutions worldwide had to move traditional face-to-face teaching online. Therefore, it is not surprising that numerous studies have explored the best practices and challenges of online learning (Adedoyin & Soykan 2023, Baczek et al. 2021, Carrilo & Flores 2020, Mishra et al. 2020, Tam 2022, etc.). Research has been also focused on effective ways of using web-based learning technologies in different fields of study, including engineering, science and business studies (Buzetto-More 2015; Pal & Patra 2021), sports education (van der Berg and de Villiers 2021), teacher training (Kidd & Murray 2020), teaching and learning English for Specific Purposes (ESP) and as a Foreign language (EFL) (Aldukhayel 2021; Alharbi & Meccawy 2020; Allen 2015; Balula et al. 2020; Bradley et al. 2010; McLain 2019, Taskiran et al. 2018; Wang 2015), to mention just a few. In the field of translator and interpreter education, the most recent research has been carried out in two major streams. The first one has been focused on the use of translation technology and the development of translator and interpreter curriculum and competencies (Braun et al. 2020; Flanagan & Christensen 2014; Kenny & Doherty 2014; Massey & Ehrensberger-Dow 2011; Mellinger 2017; Moorkens 2018; Pym 2013, etc.). The second one has explored effective teaching methods that integrated digital tools in translator and interpreter training as well as analysed trainers’ and trainees’ experience of using such tools (Hirci & Pisanski Peterlin 2020; Lee & Huh 2018; Pisanski Peterlin & Hirci 2014, etc.). The research literature demonstrates that even though the use of web-based learning technologies has been widely investigated in higher education contexts in many foreign countries, in Lithuanian higher education their use has been under-investigated. Moreover, to the best of our knowledge, no research has been conducted in the field of translator and interpreter training yet. To fill in the gap, the present study set out to gain a deeper understanding of undergraduate translation students’ experience of using web-based learning technologies and the interpretation of their use from the students’ perspective. To this end, two research questions were addressed: (1) what is the undergraduate translation students’ experience of using web-based learning technologies in their studies? and (2) what are the benefits and drawbacks of their use as seen by the students themselves? In the present study, Bower and Torrington’s (2020) term ‘web-based learning technologies’ is used. It refers to the tools that are used for educational purposes, are freely available and accessible online, and enable their users to create and share digital content. The authors’ typology covers 226 learning technologies organised into 15 clusters, including text-based tools, image-based tools, audio tools, video tools, multimodal production tools, digital storytelling tools, web-site creation tools, knowledge organisation and sharing tools, data analysis tools, 3D modelling tools, coding tools, assessment tools, social networking tools, learning management systems, and web-conferencing tools. The present research is based on perception theory, the central idea of which is that perception is a process through which knowledge of the objective world is acquired. It is this process that reveals how the interaction between an individual and the world is viewed and understood by that individual (Maund, 2003). This is relevant for the present study as it is through the interaction between the students and the educational technologies they use that the students’ perceptions can be established, which is crucial for further learning and achievement. Methodology, Methods, Research Instruments or Sources Used The present study was conducted at the end of the spring semester of academic year 2022/2023 at a university in Lithuania with the participation of 34 undergraduate majors (28 female and 6 male students) in translation. The average age of the students during the study was 22. To address the two research questions, qualitative methodology was chosen. The data for the present research were drawn from the study participants’ essays ‘The role of web-based learning technologies in my studies’. To analyse the data, the method of inductive content analysis was used. According to Elo and Kyngäs (2007), this method enables a researcher to establish content-related categories that reflect different aspects of the phenomenon under analysis. The suitability of inductive content analysis for the present study was supported by the main precondition for its use, i.e., this method of qualitative analysis can be used when the research into the phenomenon is non-existent or fragmented. The data analysis was conducted following the three stages described by Elo and Kyngäs (2007). During the first / the preparation stage, the study participants’ essays were read several times and the units of analysis relevant to the research questions were selected. During the second stage, open coding was conducted. This process included three steps, such as (i) writing down the headings that reflected all aspects of student-identified benefits and drawbacks and / or challenges of using web-based learning technologies and generating initial categories, (ii) grouping the identified categories under higher order heading, (3) naming each category and identifying and grouping subcategories. Finally, during the third stage, each subcategory was illustrated by samples selected from the students’ essays. Conclusions, Expected Outcomes or Findings The findings of the present study allow to draw the general conclusion that the undergraduate translation students’ experience of using web-based learning technologies was both positive and negative. More specifically, it was established that most students perceived it as being both beneficial and challenging, a small minority considered it being exclusively positive and one student named it as being a negative experience. The inductive content analysis resulted in the identification of two major categories that reflected the student-identified benefits and drawbacks and / or challenges of using web-based learning technologies. The former category covers five subcategories, such as a positive impact of web-based learning technologies on one’s learning, on the access to educational resources, on time economy, on one’s transferable skills, and on one’s health. The latter category covers seven subcategories that reflect the student-perceived drawbacks and / or challenges of using web-based learning technologies in their studies. These include the negative impacts of using technologies on one’s physical and mental health, on one’s social life, information reliability-related challenges, distractions, the risk of academic cheating, cybersecurity risks, and technical challenges arising while using web-based learning technologies. The limitation of the present study is its sample size, which does not allow for wide-scale generalisations. Yet, its conclusions are important as, on the one hand, they provide an insight into the undergraduate students’ experience of using web-based learning technologies in translation studies. On the other hand, the research revealed the benefits and drawbacks and / or challenges of using such technologies from the students’ perspective. The findings of the present research are comparable with the results established by researchers in other countries. In this way, they contribute to the scarce international research conducted in the field by deepening our understanding of and expanding our knowledge about it. References 1.Adedoyin, Olasile, and Emrah Soykan. 2023. Covid-19 Pandemic and Online Learning: The Challenges and Opportunities. Interactive Learning Environments, 31 (2), 863-875. DOI:10.1080/10494820.2020.1813180. 2.Balula, Ana, Ciro Martins, Marco Costa, and Fábio Marques. 2020. Mobile Betting – Learning Business English Terminology Using MALL. Teaching English with Technology, 20 (5), 6–22. http://www.tewtjournal.org. 3.Bower, Matt, and Jodie Torrington. 2020. Typology of Free Web-based Learning Technologies (2020). Technical Report, April 2020, 1-15. DOI:10.13140/RG.2.2.11064.16647. 4.Braun, Sabine, Elena Davitti, and Caterine Slater. 2020. ‘It’s Like Being in Bubbles’: Affordances and Challenges of Virtual Learning Environments for Collaborative Learning in Interpreter Education. The Interpreter and Translator Trainer, 14 (3), 259-278. DOI:10.1080/1750399X.2020.1800362. 5.Aldukhayel, Dukhayel. 2021. Vlogs in L2 Listening: EFL Learners’ and Teachers’ Perceptions. Computer Assisted Language Learning, 34 (8), 1085-1104. DOI:10.1080/09588221.2019.1658608. 6.Elo, S. and Kyngäs, H. (2007). The Qualitative content analysis process. Journal of Advanced Nursing, 62(1), 107-115. DOI:10.1111/j.1365-2648.2007.04569.x. 7.Flanagan, Marian, and Tina Paulsen Christensen. 2014. Testing Post-editing Guidelines: How Translation Trainees Interpret Them and How to Taylor Them for Translator Training Purposes. The Interpreter and Translator Trainer, 8 (2), 257-275. DOI:10.1080/1750399X.2014.936111. 8.Hirci, Nataša, and Agnes Pisanski Peterlin. 2020. Face-to-face and Wiki Revision in Translator Training. The Interpreter and Translator Trainer, 14 (1), 38-57. DOI:10.1080/1750399X.2019.1688066. 9.Kenny, Dorothy, and Stephen Doherty. 2014. Statistical Machine Translation in the Translation Curriculum: Overcoming Obstacles and Empowering Translators. The Interpreter and Translator Trainer, 8 (2), 276-294. DOI:10.1080/1750399X.2014.936112. 10.Lee, Jieun, and Jiun Huh. 2018. Why not Go Online?: A Case Study of Blended Mode Business Interpreting and Translation Certificate Program. The Interpreter and Translator Trainer, 12 (4), 444-466. DOI:1750399X.2018.1540227. 11.Massey, Gary, and Maureen Ehrensberger-Dow. 2011. Technical and Instrumental Competence in the Translator’s Workplace: Using Process Research to Identify Educational and Ergonomic Needs, ILCEA, 14. 2011. doi.org/ 10.4000/ilcea.1060. 12.Maund, Barry. 2003. Perceptions. Routledge. DOI:10.4324/978131571063 13.Moorkens, Joss. 2018. What to Expect from Neural Machine Translation: A Practical In-class Translation Evaluation Exercise. The Interpreter and Translator Trainer, 12 (4), 375-387. DOI:10.1080/1750399X.2018.1501639. 14.Pisanski Peterlin, Agnes, and Nataša Hirci. 2014. It's a Wiki World: Collaboration in Translator Training. Journal of Foreign Language Teaching and Applied Linguistics, 1, 5-15. 15.Pym, Anthony. 2013. Translation Skill-sets in a Machine Translation Age. Meta, 58 (3), 487-503. DOI:10.7202/1025047ar. 11. Educational Improvement and Quality Assurance
Paper Global Perspectives on Hybrid Learning in a Higher Educational Institution Turiba University, Latvia Presenting Author:Higher education has experienced changes in recent years, characterized by a shift towards digitalization and online learning existing simultaneously alongside a synchronous in-person form of studies. This change was influenced by the unprecedented challenges of the COVID-19 pandemic that have led to the discussion about the future of educational models in a post-pandemic world. The rapid adoption of various online learning approaches raised questions among academia regarding the most effective and applicable forms of education, especially in the context of international students in a university setting. The present research focuses on the changes in educational strategies from face-to-face (F2F) or in-person style of learning to a hybrid study approach (Munday, 2022) that combines both F2F and online forms in a post-pandemic era. It investigates the benefits and challenges of hybrid English language learning at Turiba University in Latvia, which has been a globally-focused institution for over fifteen years with 43% international students (Turiba University Handbook, 2022). Students, as observed by Gu and Huang (2022), have had to adjust to the new modes of education which include not only adapting to Webex, Zoom, or other online teaching platforms but also engaging in digitally realized collaborative learning approaches. The theoretical framework of the research is based on the theories about different forms of online teaching and learning (OTL), in particular a hybrid style. The objective of the present study was to conduct a typological examination of the extensive terminology used to describe different methods of online learning styles, specifically focusing on the hybrid style of education. The study looks at the hybrid form of education from an interdisciplinary point of view, integrating such fields as language study, pedagogy, communication studies, and intercultural communication. Increased empirical attention was paid to the study of different forms of education and approaches used during the COVID-19 pandemic from 2021 to 2023. Such concepts as online teaching, online education (Shrestha et al., 2021; Zhao and Xue, 2023), online learning (Gu and Huang, 2021), e-learning education (Bi et al., 2023), eLearning (Matete et al., 2023), online teaching and learning (OTL) (Scherer, et al., 2021, 2023), blended learning (Ashraf et al., 2022(a), Yu et al., 2022; Huang et al., 2022; Luka, 2022, 2023; Tonbuloğlu and Tonbuloğlu, 2023), bLearning (blended learning) (Galvi and Carvajal, 2022), hybrid coaching (Fidan et al., 2022), hybrid learning (Wang, 2023; Kortemeyer et al., 2023; Munday, 2022), hyflex instruction (Lohmann, et al., 2021), flipped learning (van Alten et al., 2021; Chen and Hsu, 2022), flipped classroom (FC) (Divjak, 2022), dual-mode teaching (Olsen-Reeder, 2021), remote teaching (Moser et al., 2021), and emergency remote teaching (ERT) (Yang, 2023; Sum et al., 2022), among others, were encountered and were often used to denote similar things. Although there was a rich study of education realized with the help of technological devices, there is a lack of one clear source where all definitions are provided. This terminological diversity may cause misunderstandings, so the author attempted to make the classification of them. Academic personnel in the context of hybrid style are information curators and facilitators who must be trusted, prepared, present online, and accessible to students, whereas the role of a student is to be open, self-directed, community-oriented, and prepared (Carrasco, 2015:22-23). The main benefits of this approach for students are that it “opens the doors to disconnected, less-privileged students who lack connectivity and financing to engage”; and gives “educational opportunity to those who would otherwise be excluded from traditional higher education system” (Gamage, 2022), as well as “helps to practice internationalization at home” (Gu and Huang 2022:2) and thus allows students to “effectively end their education” (Gamage, 2022). Methodology, Methods, Research Instruments or Sources Used The theoretical framework was designed based on the systematic analysis of over 50 sources of information published from 2020 to 2023. Qualitative research included the observation of English for Special Purposes (ESP) lectures for the course "English for Business Studies" during the second semester of the academic year 2022/2023 with students from the Faculty of Business Administration. It involved semi-structured interviews with both online and in-class students enrolled in the course. The experience described in this article spans from the last phase of the COVID-19 Pandemic (starting from September 2022) to the beginning of the post-pandemic era in June 2023, focusing on the hybrid style learning of ESP by international students. The research period was from January to June 2023. The plan and procedure included the collection of theoretical data, observation and analysis of lectures by the author, and the development of a questionnaire. Participants were 35 students from such countries as India, Sri Lanka, Ukraine, and Uzbekistan. Some students were physically located in Latvia, attending classes F2F on-campus (Munday, 2022), while others studied online from their home country for various reasons. Some students arrived in Latvia later and joined F2F classes, and occasionally, F2F students attended lectures online due to personal reasons, e.g., sickness. All teaching was conducted synchronously. Online students attended lectures using the Cisco Webex platform, which was Turiba University's official teaching platform. Communication also occurred through email, WhatsApp, and BATIS (Turiba University's internal information system). The research questions guiding this study stem from a need to clarify the confusion surrounding the variety of terminology used in online education. A key task was to differentiate and compile a comprehensive table of methods, their descriptions, respective authors, and years of implementation. This compilation serves as a foundation for understanding the evolution and nuances of online learning methodologies, particularly the hybrid style, in the globalized context of higher education. The aim of the study was to develop a taxonomy of the vast terminology used to denote similar concepts in online teaching and learning; to study the theoretical background of hybrid learning; and to distinguish the advantages and drawbacks of the hybrid approach used for teaching ESP, looking at it from an interdisciplinary perspective. The major limitation of the research was the small sample size – a limited number of students participated in the interviews. Conclusions, Expected Outcomes or Findings The hybrid style proved to be a viable approach in post-pandemic realities in the internationalized context of tertiary education when there is high student e-readiness, including self-motivation and self-control. The major challenge that the researcher encountered in hybrid-style lectures was the heterogeneous, multi-layered form of communication among all stakeholders that requires careful management and observation on behalf of a lecturer; a necessity to introduce instructions and rules of behavior for unexpected situations (for example, loss of internet connection, sound deficiencies, misunderstandings on behalf of online students). Interview results showed that students perceive benefits in a hybrid approach, while also facing distinct challenges. The majority considered that a hybrid style is time-saving; benefits from an increase in access to learning and flexibility of studies; and allows some students from underprivileged regions to have access to a safer learning environment, simultaneously having communication with groupmates and academic personnel online. The following challenges in the process of interacting online were indicated: the lack of eye contact and reduced participation in group discussions; occasional difficulty in sharing work between F2F and online students; and occasional loss of concentration. The challenges noted from the intercultural perspective included diverse teaching and learning styles; pronunciation; understanding different accents of students from various cultural groups and time zone differences; and the digital divide. Difficulties noted in learning foreign languages via the hybrid teaching approach included differences in students’ language knowledge and the inability to build perfect synergy between students. Technical difficulties experienced by students included connectivity and infrastructure problems, such as lack of electricity, disconnection of the Internet, and the digital divide. Respondents noted that the hybrid approach allowed them to develop self-confidence, communicative and cooperation skills; improved their active listening, making them more culturally aware, and breaking cultural barriers. References Ashraf, M.A., Mollah, S., Perveen, S., Shabnam, N., & Nahar, L. (2022). Pedagogical applications, prospects, and challenges of blended learning in Chinese higher education: A Systematic Review. Frontiers in Psychology. Bi, J., Javadi, M., & Izadpanah, S. (2023). The comparison of the effect of two methods of face-to-face and e-learning education on learning, retention, and interest in the English language course. Education and Information Technologies. Divjak, B., Rienties, B., Iniesto, F., Vondra, P.& Žižak,M. (2022). Flipped classrooms in higher education during the COVID-19 pandemic: findings and future research recommendations, International Journal of Educational Technology in Higher Education. Dörnyei, Z. (2007) Research Methods in Applied Linguistics. Oxford: Oxford University Press. Gamage, K.A.A., Gamage, A. & Shyama C. P. Dehideniya, S.C.P. (2022). Online and hybrid teaching and learning: Enhance effective student engagement and experience, Education Sciences. https://doi.org/ 10.3390/educsci12100651 Gil, E., Mor, Y., Dimitriadis, Y., & Köppe, C. (2022). Hybrid Learning Spaces. Springer. Gu, M.M. & Huang, C.F. (2022). Transforming habitus and recalibrating capital: University students’ experiences in online learning and communication during the COVID-19 pandemic, Linguistics and Education. Moser, K.M., Wei, T. & Brenner, D. (2021). Remote teaching during COVID-19: Implications from a national survey of language educators. System. Munday, D. (2022). Hybrid pedagogy and learning design influences in a higher education context. Studies in Technology Enhanced Learning Olsen Reeder, V.I. (2022). Dual mode teaching in the language classroom: Reconciling the pandemic, equity, and the future of quality language teaching pedagogy. New Zealand Journal of Educational Studies. Scherer,R., Siddiq,F., Howard,S.H. & Tondeur, J. (2023). The more experienced, the better prepared? New evidence on the relation between teachers’ experience and their readiness for online teaching and learning. Computers in Human Behavior. Smith C.W. & Arnott, S. (2022). “Frencteachers can figure it out: Understanding French as a second language (FSL). Teachers’ work in the context of the COVID-19 pandemic. Canadian Journal of Applied Linguistics. Uysal, M. & Çağanağa, K. (2022). Opinions of teachers on distance education applications in English language teaching. Policies in Northern Cyprus during the COVID-19 pandemic. Frontiers in Psychology. Van Alten, D.C.D, Phielix, C., Janssen, J., & Kester, L. (2021). Secondary students’ online self-regulated learning during flipped learning: A latent profile analysis. Computers in Human Behavior. Wang, L. (2023). Starting university during the pandemic: First-year international students’ complex transitions under online and hybrid-learning conditions. Frontiers in Psychology. Turiba University Handbook for International Students https://www.turiba.lv/storage/files/bat-international-handbook-2022_2.pdf |
Date: Wednesday, 28/Aug/2024 | |
9:30 - 11:00 | 11 SES 04 A: School Education: Quality of Education Systems and Institutions Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Dita Nimante Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Identifying Factors of AcademicFailure to Reverse Underachievement Nazarbayev Intellectual School of chemistry and biology in Kyzylorda, Kazakhstan Presenting Author:Topic: IDENTIFYING FACTORS OF ACADEMIC FAILURE TO REVERSE UNDERACHIVEMENT Research questions: - what are the factors affecting academic underachievement? - what are the effective ways of reversing students' academic underachievement? - what should be considered while providing an individual approach for a student to reverse underachievement? Purpose: to identify the factors of an academic underachievement, to idenitfy the most effective practices to combat the academic failure of students and to identify the pecularities of a successful individual approach while reveresing academic achievement. Theoretical Framework: Recent studies conducted on the theory of motivation were based on the AOM (Achievement Orientation Model) theory introduced by Siegel and McCoach (2003a). The AOM theory is based on Bandura's self-efficacy theory, Weiner’s attribution theory, Eccles’ expectancy-value theory, person-environment fit theory, and Rotter’s locus of control theory (Siegle, McCoach & Roberts, 2017). According to AOM theory, students’ motivation in a combination of all three areas: student’s self-efficacy, goal – valuation, and environmental perception will positively result in student’s task engagement and academic achievement. Seigle et al., (2017) stressed that these three areas can be developed in different levels, but should not be missing at all since it negatively impacts on self-regulation as well as achievement (See Figure 1.). Self-efficacy addresses a student’s belief to be skillful and capable to complete a task where a student might ask himself “Am I smart enough?” (Siegle, Rubensein & McCoach, 2020). Researchers agree that students with low self – efficacy tend to avoid task accomplishment, therefore, the higher self-efficacy students possess, the stronger task engagement they show (Rubenstein, Siegle, Reis, Mccoach, & Burton, 2012; Siegle et al., 2017; Siegle et al., 2020). Environmental perception refers to a student's motivation or demotivation as a result of student’s interaction with peers, parents and teachers as well as the expectation from parents and teachers, and the scale of support a student gets from the outside world (Rubenstein et al., 2012). It is assumed that students get false perceptions and find themselves in an unsupportive environment assuming nobody believes in their success, therefore these students often lack or do not develop enough learning skills important to be academically productive (Ritchotte, Matthews & Flowers, 2014).
Methodology, Methods, Research Instruments or Sources Used This research adopts a constructivist methodology, wherein the knowledge is constructed through the collaborative interaction between the researcher and the students being studied (Guba & Lincoln, 1994, p. 111). The importance of their input in shaping the findings. Additionally, the researcher plays a fundamental role in facilitating the research process and engaging with the participants, as per the principles of constructivism (Guba & Lincoln, 1994, p. 113). According to the research on "Identifying Factors of Academic Failure to Reverse Underachievement," a quantitative research method was employed (Author, Year). This involved collecting and analyzing numerical data through surveys, standardized tests, and other measurement tools to understand various factors such as academic performance, study habits, motivation levels, and socio-economic factors (Creswell, Fetters, & Ivankova, 2004). Statistical analysis techniques were then used to examine relationships and patterns within the data, identifying significant factors associated with academic failure and potential strategies for reversing underachievement (Creswell et al., 2004). This quantitative research method provided a systematic and objective approach to exploring the factors influencing academic performance, offering valuable insights into addressing the issue of underachievement (Creswell et al., 2004). Research desing and sampling: The current research involved 45 participants to collect relevant data by using a survey. The survey was designed to identify factors that contribute to academic failure and explore potential strategies to reverse underachievement. This research design allowed for a systematic and structured approach to collect information from a relatively large sample size. By utilizing a survey, the researchers were able to gather data on various factors that may influence academic performance and analyze the responses to draw meaningful conclusions. The use of a survey as a research tool provided a standardized method for data collection, ensuring consistency and reliability in the findings. The study focused on students from a Nazarbayev Intellectual School in Kyzylorda, specifically targeting low achieveing students there. To gather participants for the study, a purposeful sampling strategy was employed. This approach was chosen because it allowed for the selection of individuals and a research site that would provide the most valuable insights into the central phenomenon being investigated, which in this case was gifted underachievement. This decision was based on the belief that these specific participants and research location would offer the most relevant and informative data for the study, as supported by Creswell (2014). Conclusions, Expected Outcomes or Findings Through analysis of survey results and systematic procedures, we've identified several key hindrances to educational progress, including inadequate grasp of prior material, preference for certain subjects, excessive extracurricular involvement, and psychological fatigue. These factors notably impact academic performance, particularly among 7th and 8th graders transitioning to new social environments. While some adapt smoothly, others face prolonged adjustment, necessitating tailored interventions. A case study underscores the complexities of academic struggles, revealing familial and health-related burdens impeding a student's focus and resulting in declining grades, exacerbated by the absence of paternal guidance. Familial dynamics often contribute to suboptimal home environments, perpetuating cycles of underachievement. Observations highlight prevalent apathy and disinterest, with external motivations, like financial security, dampening academic engagement. Recognizing these complexities, recommendations focus on fostering supportive learning environments through personalized encouragement, critical thinking cultivation, and consistent acknowledgment of achievements. Embracing a culture of learning from mistakes is pivotal to nurturing well-rounded individuals capable of academic success and holistic development. References Bezrukikh, M. M. (1996). Which children are called slow and why it is difficult for them to study. Arktous. Glazer, G. D. (2002). Comments on articles by V. A. Sukhomlinsky. In Anthology of humane pedagogy (pp. page numbers if available). Shalva Amonashvili Publishing House. Lokalova, N. P. (2009). School failure: causes, psychocorrection, psychoprophylaxis. Lunkov, A. I. (1987). How to help your child at school and at home. Ritchotte, J. A., Matthews, M. S., & Flowers, C. P. (2014). The validity of the achievement-orientation model for gifted middle school students: An exploratory study. Gifted Child Quarterly, 58(3), 183-198. DOI: 10.1177/0016986214534890 Rubenstein, L. D., Siegle, D., Reis, S. M., Mccoach, D. B., & Burton, M. G. (2012). A complex quest: The development and research of underachievement interventions for gifted students. Psychology in the Schools, 49(7), 678-694. https://doi.org/10.1002/pits.21620 Siegle, D., & McCoach, D. B. (2005). Making a difference: Motivating gifted students who are not achieving. Teaching exceptional children, 38(1), 22-27 https://doi.org/10.1177/004005990503800104 Siegle, D., McCoach, D. B., & Roberts, A. (2017). Why I believe I achieve determines whether I achieve. High Ability Studies, 28(1), 59-72. https://doi.org/10.1080/13598139.2017.1302873 Siegle, D., Rubenstein, L.D., McCoach D. B. (2020). Do you know what I'm thinking? A comparison of teacher and parent perspectives of underachieving gifted students' attitudes. Psychology in the Schools, 1–19. https://doi.org/10.1002/pits.22345 11. Educational Improvement and Quality Assurance
Paper Teacher Shortages in Rural Communities: Dramatic Increases in Teaching Out-of-Field Across Core Disciplines Texas State University, United States of America Presenting Author:The worldwide teacher shortage has impacted rural communities more than urban and suburban communities (Ingersoll & Tran, 2023). When a qualified teacher is not available to teach a particular course, school principals are forced to assign unqualified people or under-qualified teachers to teach the course. If the teacher is fully trained and qualified to teach (e.g., Math), but is teaching a course outside of their training and qualifications (e.g., English), we say the teacher is teaching English out-of-field (OOF) and teaching Math in-field (du Plessis, 2015; Ingersoll, 1999; 2019). Teaching OOF is not a characteristic of the teacher, but a label that describes the misalignment between the teacher’s qualifications and the course to which they were assigned. If the teacher-of-record has no training and no license to teach, then we say the person is an Unprepared Instructor. The American federal government changed the education laws in 2015 thereby giving states the right to define teacher qualifications as each saw fit. Prior to 2015, teaching OOF was illegal except under specific and limited conditions. Since 2015, Texas has allowed principals to freely assign teachers to courses for which they have no training, and schools are no longer required to inform parents and guardians that this is happening to their children. Teaching OOF is harmful for student learning. Several studies have found that student learn less during a school year when taught OOF compared to similar students taught in-field (Author, 2023; Clotfelter, Ladd & Vigdor, 2010; Lankford, Loeb, & Wyckoff, 2002). Teaching OOF has become an issue of educational equity, because Author (2020) found that particular demographic groups of students were significantly more likely to be taught OOF, including Black students, low-income students, and students living in rural communities. Rural communities have seen a dramatic increase in the number of Unprepared Instructors, with 72% of new teachers hired in rural schools in 2022-23 being unprepared and unqualified to teach, up from only 18% in 2012-13 (Author, 2024). Our goal for this study was to examine changes in the rates of teachers teaching OOF before versus after the federal legislative changes, and to examine these OOF patterns for core secondary course subjects (e.g., English, Math, Biology). Methodology, Methods, Research Instruments or Sources Used For the purposes of this study, we accessed our copy of the Texas State Longitudinal System (TLDS) that includes data on 5.52 million students annually enrolled in Texas public schools. These data include extensive demographic information, educational serviced received, schools attended, attendance rates, standardized test scores, and the teachers who taught them. The teacher data includes extensive information about teaching licenses held, licensure tests taken, years of experience, and the type of teacher preparation program they completed. The state publishes detailed rules about which teaching licenses are “required” to be held by a teacher in order to teach each course so the rules for in-field versus OOF teaching are explicit. We drew a sample of 193 million student-course records for 2011-12 through 2018-19 (pre-pandemic) from the TLDS with a focus on students in secondary grades (Grades 7-12). We selected the 18 subjects with the largest student-course enrollment counts during the 2018-19 school year; each count was in excess of 300,000 students per subject per school year. We then examined changes in the OOF teaching rates by locale (e.g., rural, urban) and by school year. A summary of the statewide descriptive results for 2018-19 include: secondary English is the subject taught most often OOF with over 4 million student-course records taught OOF. Math is second with over 4 million, History is a distant third with under 2.5 million, and Physical Education is fourth with fewer than 2 million. The same patterns hold for rural communities, with the exception that Agriculture is the fourth most common subject taught OOF. The inferential results will be presented too. Across all 18 course subjects, rural schools had the highest rate of OOF teaching of all geographical locales. The rates of OOF teaching increased from 13.9% in 2011-12 to 23.1% in 2018-19. Approximately 1 in 4 student-courses is now taught OOF. For comparison, major suburban schools increased from 7.7% to 11.6% over the same period. Approximately 1 in 9 student-courses is now taught OOF. In other words, students in rural communities are twice as likely to take classes taught OOF compared to students in suburban communities. In rural schools, the subjects with the largest increases in OOF teaching rates between 2011-12 and 2018-19 are: Agriculture (506%), Biology (203%), Art (163%), Spanish (114%), Math (83%), and English (79%). Conclusions, Expected Outcomes or Findings We found that students in rural communities are receiving an inferior education relative to students in suburban and urban schools. Students in rural schools have experienced dramatic increases in the number of courses taught by unqualified and under-qualified teachers since federal laws changed. Prior studies found that teaching OOF is harmful to student learning and the current results imply that the quality of education received by rural students has declined over eight years, with the rates of OOF teaching increasing by over 75% in 7 of 18 core subjects, and more than doubling in 4 of the 18 subjects. We are now exploring ways to increase the pipeline of teachers into rural communities. We are examining where existing rural teachers went to secondary school, and what path they followed to become teachers. Preliminary results indicate the importance of 2-year post-secondary institutions for preparing rural students who go on to teach. We are examining effective exemplar programs in high schools that appear to prepare a large number of students who go on to pursue teaching careers in rural schools. The descriptive and inferential results will be presented, as well as our findings about positive exemplars for preparing future teachers to work in rural schools. References Author. (2020). Author. (2023). Clotfelter, C. T., Ladd, H. F., & Vigdor, J. L. (2010). Teacher credentials and student achievement in high school: A cross subject analysis with student fixed effects. Journal of Human Resources, 45(3), 655–681. Du Plessis, A. (2015). Effective education: Conceptualising the meaning of out-of-field teaching practices for teachers, teacher quality and school leaders. International Journal of Educational Research. 72, 89-102. doi: 10.1016/j.ijer.2015.05.005 Ingersoll, R. M. (2019). Measuring out-of-field teaching. In L. Hobbs & G. Törner (Eds.), Examining the phenomenon of ‘teaching out-of-field’: International perspectives on teaching as a non-specialist (pp. 21–52). Springer. https://doi.org/10.1007/978-981-13-3366-8_2 Ingersoll, R. M., & Tran, H. (2023). Teacher shortages and turnover in rural schools in the US: An organizational analysis. Educational Administration Quarterly, 59(2), 396-431. https://doi.org/10.1177/0013161X231159922 Lankford, H., Loeb, S., & Wyckoff, J. (2002). Teacher sorting and the plight of urban schools: A descriptive analysis. Educational Evaluation and Policy Analysis, 24(1), 37–62. 11. Educational Improvement and Quality Assurance
Paper Quality Assurance with Learning Analytics in Secondary Education: Insights from Flanders and Ireland 1Vrije Universiteit Brussel, Belgium; 2Dublin City University Presenting Author:Since the introduction and proliferation of learning management systems in K-12 schools, as part of the digital transformation in education, a huge amount of data (learning analytics) has become generally available for (re)designing and evaluating education, and for evidence-informed quality assurance (Brown & Malin, 2022). This quality assurance (QA) has become increasingly decentralized in many European countries, making schools responsible and accountable for their own quality. Schools have therefore been developing their own procedures and exploring their responsibilities in the context of QA, but the use of learning analytics (LA) data regarding learning processes often remains un(der)explored. Up till now, LA have primarily proven their potential for QA in the context of higher education. In secondary schools, they are currently mainly used at the micro level, where they are being used by (individual) teachers to identify and tailor to learners’ specific needs. However, the potential use of LA at the school (management) level, or the ways in which schools or school teams can make optimal use of these data, remains an open and under-explored question (Ifenthaler, 2021) for researchers, practitioners and policy makers alike (Gašević et al. 2016). Moreover, there is a lack of capacity to work with these data for strategic planning and quality development in schools. Teaching staff, school leaders and middle managers are often wondering how to start off with learning analytics data in this regard, and often invoke questions from an ethical and privacy perspective. Next to these general questions, there is also the issue of competencies. Even if school staff would know how these data could inform them, there is a general lack of competencies and know-how on how to get started (Ifenthaler, Mah & Yin-Kim Yau, 2019). The QUALAS (Quality Assurance with Learning Analytics in Schools) project therefore aims to build on the available knowledge on QA and LA to identify possibilities for enhancing the capacity of educational professionals in secondary schools in Flanders (Belgium), Ireland, Italy and Spain to make appropriate use of learning analytics for quality assurance. In order to achieve these aims, we first want to identify how LA and QA are currently being coupled and put into practice in secondary education in these different jurisdictions. Additionally, we investigate how the approaches in two of these jurisdictions (Flanders and Ireland) draw on and relate to policy and initiatives of QA and LA at a European level. We start from European conceptualisations of quality assurance, including definitions provided by the European Commission (2018). We further rely on the distinctions drawn between external and internal evaluation, and between government-based and market-based accountability in education (Eurydice, 2015). Concerning LA, we draw on a publication by the European Commission’s Joint Research Centre on the use of learning analytics and its action list for educational stakeholders (Ferguson et al., 2016), and on the European Union’s Digital Education Action Plan. These definitions and conceptualisations are subsequently compared to national (or regional) policy texts and other grey literature concerning QA and LA, in order to answer the following research questions:
Methodology, Methods, Research Instruments or Sources Used In this contribution, we present our findings from a grey literature analysis conducted in the educational jurisdictions of Flanders and Ireland, and situate these in relation to the European policy and research documents sketched above. This grey literature review was conducted as part of the first phase of the Erasmus + ka cooperation project QUALAS, a cooperation between Vrije Universiteit Brussel (Belgium), Dublin City University (Ireland), Universidad de Valladolid (Spain) and Instituto nazionale per la valutazione del sistema educativo di instruzione e di formazione (Italy). This first phase consisted of a rapid narrative systematic review of the existing literature on LA and its connection(s) to quality assurance in secondary education and schools. Grey literature is generally defined as: “that which is produced on all levels of government, academics, business and industry in print and electronic formats, but which is not controlled by commercial publishers.” (Paez, 2017). In our case(s), it includes: (practice-oriented) academic publications and vulgarizing texts, government reports and policy documents, and documents of LA and learning management system providers. This grey literature was incorporated based on the belief that it can make important contributions to a systematic review, because it can provide resources and data that cannot be found within commercially published (academic) literature and can thus help avoid potential (publication) bias (Paez, 2017). Given our focus on national education system contexts, our (grey) search strategy did not include consulting (international) grey literature databases. However, conference proceedings stemming from the results from our systematic search in scientific databases (Scopus, ScienceDirect, Web of Science and EBSCOhost) with a focus on the European context or the respective jurisdictions of Flanders, Ireland, Italy and Spain were included as grey literature items. Additionally, we conducted web searches looking for specific documents, reports and other publications on LA and QA in these jurisdictions, which were conducted in the jurisdictions’ respective languages. All four partner institutions conducted the analysis of grey literature found for their own jurisdictions. A template was provided by the project coordinator to ensure the reliability and validity of the analyses. The analysis protocol focused on: • Definition(s) of QA • Types and functions of LA • Level(s) of use of LA • Data use and LA within QA • Bibliometric info (year, type of publication, authors, target audience, etc.) Conclusions, Expected Outcomes or Findings Including grey literature in our systematic literature review on learning analytics for quality assurance in secondary education in four European countries, and in relation to policies and conceptualisations at a European level, provided us with significant insights additional to those provided by the systematic (scientific) literature review. In this contribution, we focus on our findings in the Flemish and Irish jurisdictions, and link these to the European level. First, we will sketch the main findings for both the Flemish and Irish educational contexts: their approaches to QA, current use of LA in secondary education, and existing links between QA and LA in both jurisdictions. We then identify and discuss four main themes, arising from a comparison between the Flemish and Irish contexts based on the grey literature found in both jurisdictions and their relations to the European context: 1) LA and its relation to QA as expressions of digital optimism and the push for (post-covid) educational digitalisation for national and European recovery and resilience: tackling societal challenges through (digital) education and LA 2) LA for QA: focus on personalisation and differentiation in education 3) Digital education as covering two dimensions (REF): the educational use of digital technologies and devices (including LA) and the digital competence and professional development of educators 4) Reluctancy and fears connected to LA and QA, or educational push-back: the threat of hollowing out education and the teaching profession References Brown, C. & Malin, J.R. (eds). (2022). The Emerald Handbook of Evidence-Informed Practice in Education. Emerald Publishing Limited. European Commission. (2018). Quality assurance for school development. Guiding principles for policy development on quality assurance in school education. Retrieved from: https://education.ec.europa.eu/sites/default/files/document-library-docs/2018-wgs2-quality-assurance-school_en.pdf Eurydice. (2015). Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Retrieved from: https://op.europa.eu/en/publication-detail/-/publication/4a2443a7-7bac-11e5-9fae-01aa75ed71a1/language-en Ferguson, R., Brasher, A., Clow, D., Cooper, A., Hillaire, G., Mittelmeier, J., Rienties, B., Ullmann, T. & Vuorikari, R. (2016). Research Evidence on the Use of Learning Analytics - Implications for Education Policy. In Vuorikari, R. & Castaño Muñoz, J. (Eds.). Joint Research Centre Science for Policy Report. doi:10.2791/955210. Gašević, D., Dawson, S. and Pardo, A. (2016). “How do we start? State and directions of learning analytics adoption”. International Council for Open and Distance Education. Ifenthaler, D. (2021). Learning analytics for school and system management. In OECD Digital Education Outlook 2021. Pushing the Frontiers with Artificial Intelligence, Blockchain and Robots. OECD Library. 161. Ifenthaler, D., Mah, D-K. & Yau, J.Y. (2019). Utilizing Learning Analytics to Support Study Success. Springer Cham. DOI 10.1007/978-3-319-64792-0 Paez, A. (2017). Gray literature: An important resource in systematic reviews. Journal of Evidence-Based Medicine,10(3), 153-240. |
13:45 - 15:15 | 11 SES 06 A: Facilitating Teacher Professional Development Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Buratin Khampirat Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Early Childhood Teachers' Perspectives Toward the Importance of Teacher Leadership: What Really Matters? UNED, Spain Presenting Author:Over the last decades, pedagogical leadership has been consolidated as a key factor to promote the quality of educational institutions. It is a commonplace, but it is also highlighted in the results of educational indicators and in educational policy studies: leadership matters. Traditionally, leadership has been linked to the formal roles of management, especially to the head or principal (Fullan, 2014; González-Falcón et al., 2020), however the most recent research has highlighted on the relevant role of middle leaders (De Nobile, 2018; Gurr, 2023; Lipscombe et al., 2023) and teacher leadership (Muijs y Harris, 2003; Pan et al., 2023). It should also be noted that research has been contextualized more often in secondary education and to a lesser extent in the context of early childhood education (Heikka, et al., 2018; Fonsén et al., 2023; Cooper, 2023). In this framework, this contribution aims to analyze the perspectives about pedagogical leadership of Early Childhood teachers. More specifically, the objective is to explore the perception of early childhood teachers about the importance of indicators of the teacher's pedagogical leadership to explore the possibilities to implement theoretical models in practice through initial and continuous training. Methodology, Methods, Research Instruments or Sources Used We present a survey study focus on gathered the perceptions of Early Childhood teachers regarding the importance of teacher pedagogical leadership. The participants in this research are 36 teachers of five schools located in Madrid Region. The 88.90% are women (n= 60) and the 66.7% teach in the second cycle (3-6 years) of early childhood education. Regarding teaching experience, it is very varied (while 52.8% have less than three years of experience, 27.8% have more than ten years). The instrument was a questionnaire specifically designed for this purpose, considering the background of the literature and especially the proposals of Gento (2002) and González-Fernández et al. (2020, 2021). The questionnaire includes 26 items, which is filled by the teachers on a 6-point scale according to the importance they ascribed to each indicator of teacher pedagogical leadership. Also, the survey includes three open-ended questions about pedagogical leadership in early childhood education (advantages, competencies necessary for teacher leadership and the relationship between leadership-quality). The internal consistency coefficient showed that questionnaire is highly reliable (.913). The questionnaire of this study was distributed during September 2013. The results were analyzed with an exploratory and descriptive approach with SPSS v24 and we also conducted thematic analysis with coding to delve deeper into the arguments and teaching reflections on teacher leadership. Conclusions, Expected Outcomes or Findings The results showed interesting results that allow us to answer our research objectives. First, it should be noted that the set of indicators derived from Gento's (2002) theoretical model are globally valued as important by the participating teachers. However, the quantitative study highlights that the participating teachers perceive the indicators included in the professional, emotional, and charismatic dimensions as more important than those included in the administrative and training dimensions (Gento et al., 2022). Although it is important to delve into the analysis by items, this result has implications for establishing policies that affect issues that really matter while reducing irrelevant ones (excessive bureaucratization of teaching, which reduces the capacity to innovate and improve). In a complementary way, the qualitative analysis carried out allows us to interpret the quantitative scores and position the teacher's pedagogical leadership as an informal but very relevant role in the life of schools (Scallon et al., 2023). Its relevance is in the direct educational relationship with students, and the capacity to improve school coexistence, inclusion, and guidance/tutoring (Fernández y López, 2023; López-Gómez et al., 2020). These results, which should be interpreted considering limitations of generalization, will be discussed to propose a teacher professional development program focused on specific teacher leadership in Early Childhood Education and related teaching competencies. References Cooper, M. (2023). Teachers grappling with a teacher-leader identity: Complexities and tensions in early childhood education. International Journal of Leadership in Education, 26(1), 54-74. De Nobile, J. (2018). Towards a theoretical model of middle leadership in schools. School Leadership & Management, 38(4), 395-416. Fernández, V., & López, J. (2023). The effect of teacher leadership on students’ purposeful learning. Cogent Social Sciences, 9(1), 2197282. Fonsén, E., Szecsi, T., Kupila, P., Liinamaa, T., Halpern, C., & Repo, M. (2023). Teachers’ pedagogical leadership in early childhood education. Educational Research, 65(1), 1-23. Fullan, M. (2014). The principal. Three keys to maximizing impact. Jossey-Bass. Gento, S. (2002). Instituciones Educativas para la Calidad Total. La Muralla. Gento, S., González-Fernández, R. y López-Gómez, E. (2022). Heads of educational institutions and expansion of autonomy with accountability. The mediating role of pedagogical leadership. Revista Española de Pedagogía, 80 (281), 193-209. https://doi.org/10.22550/REP80-1-2022-07 González-Falcón, I., García-Rodríguez, M. P., Gómez-Hurtado, I., & Carrasco-Macías, M. J. (2020). The importance of principal leadership and context for school success: Insights from ‘(in) visible school’. School Leadership & Management, 40(4), 248-265. González-Fernández, R., Khampirat, B., López-Gómez, E., & Silfa-Sención, H. O. (2020). La evidencia del liderazgo pedagógico de directores, jefes de estudios y profesorado desde la perspectiva de las partes interesadas. Estudios sobre Educación, 39, 207-228. González-Fernández, R., López-Gómez, E., Khampirat, B. y Gento, S. (2021). Measuring the importance of pedagogical leadership according to the stakeholders’ perception. Revista de Educación, 394, 39-65. Gurr, D. (2023). A review of research on middle leaders in schools. International encyclopedia of education. London, England: Elsevier. Heikka, J., Halttunen, L., & Waniganayake, M. (2018). Perceptions of early childhood education professionals on teacher leadership in Finland. Early Child Development and Care, 188(2), 143-156. Lipscombe, K., Tindall-Ford, S., & Lamanna, J. (2023). School middle leadership: A systematic review. Educational Management Administration & Leadership, 51(2), 270-288. López-Gómez, E., González-Fernández, R., Medina-Rivilla, A. y Gento-Palacios, S. (2020). Proposal to Promote Quality of Education: A View from Spain. En H. Flavian (Ed.), From Pedagogy to Quality Assurance in Education: An International Perspective (pp. 29-44). Emerald. Muijs, D., & Harris, A. (2003). Teacher leadership—Improvement through empowerment? An overview of the literature. Educational management & administration, 31(4), 437-448. Pan, H. L. W., Wiens, P. D., & Moyal, A. (2023). A bibliometric analysis of the teacher leadership scholarship. Teaching and Teacher Education, 121, 103936. 11. Educational Improvement and Quality Assurance
Paper The Quest For a Quality of Career in Academia PalackyUniversity Olomouc, Czech Republic Presenting Author:In the past few decades, public universities have undergone significant changes, which have reshaped academic work and workplaces (Bentley et al. 2013; Teichler et al. 2013). Technological advancements, globalization etc underline the changing role of universities in the society. The career development systems based on linear male models are no longer relevant to meet the needs of today’s society in diverse contexts. Although there has been an ongoing debate about the impacts of this global shift on the career development of academics (Bentley et al. 2013), in certain countries the linear model of an academic career persists. When examining the careers of academics, particular attention is paid to factors influencing leaving the academia or the university. The findings underline the career age, career stage, tenure status and scientific field as the strongest predictors of intention to exit academia (White-Lewis, D.K., O’Meara, K. & Mathews, K., 2023). Nontenured academics and academics in early stages of the career report lower job satisfaction than senior academics. Focusing on the group of young academics in the beginning of their professional path in the Czech Republic brings also the focus on the position of women in the Czech republic. Women increase the number of graduates on the level of doctoral programmes in contrary to the representation of women in the number of professors and associate professors in the country in the last two decades (Cidlonská & Vohlídalová, 2015). To address the outlined issue, the following main research question has been set: How do the female academics in social sciences understand success in their career? Methodology, Methods, Research Instruments or Sources Used This research focuses on successful careers, rather than on constraints and barriers, which is the feature of much previous research. Purposive sampling in terms of career stages, academic experience and life roles has been used. More specifically to address the main research question, female academics were contacted based on the following criteria: a) Woman in academia - social sciences; b) R2 or R3 research career stage; c) Experience from several scientific workplaces; d) Experience from abroad; e) Permanent effort to contribute to the improvement of the quality of the field through research (a changemaker that has a demonstrable positive impact); f) Woman in more reflected life roles (academia, mother, wife/partner, daughter). The criteria were applied when searching in databases and public documents (CV´s). Out of six women contacted, four agreed to participate in research using the narrative design. Narrative interviews in a number of rounds have been carried out and all transcribed interviews are analyzed being through three dimensions of KCM (still in process). When analysiong the narratives, the attention is paid to the sujet and fabula (what and how in the story), key milestones of the story (epizodes) and turning points of the story. Coding is preformed by two researchers as a support for the reflection of the emotions, attitudes, and opinions of the main researcher. Conclusions, Expected Outcomes or Findings The issue of career development in academia is connected to the promotion of diversity and inclusion. High sense of autonomy and professional identity as well as diverse perseption of quality work and job satisfaction frame the academic career and call for different possible trajectories. The prelliminary resuts show that KCM has brought new perspectives on career success eventhough as the research is still running. They bring impulses for revisiting conditions in Czech academia: influencing the organizations in terms of creating appropriate conditions for different career paths and patterns of women who often experience success and quality differently and who are generally perceived as successful. These bring along challenges for current conditions: Disparities in gender diversity (particulary in leadership roles), underrepresented minority groups (compared to their proportion in the general population), implicit bias, microaggressions, unequal access to resources and opportunities. Findings of this research so far indicate that decision-makers in academia should pay more attention to understanding the unique ways in which authenticity in particular is understood by female academics in social sciences and how this is connected to their understanding success in their career. This may from the longterm perspective encourage universities to look more closely and deeply at their organizational cultures to be more supportive to women and their career paths and patterns. References Cabrera, E. F. (2007). Opting out and opting in: understanding the complexities of women’s career transitions. Career Development International, 12(3), 218–237. https://doi.org/10.1108/13620430710745872 Cidlonská, K. Vohlídalová, M. (2015) To stay or to leave? On a disillusionment of (young) academics and researcher. Aula. 15 (3), p. 3-36. https://www.csvs.cz/wp-content/uploads/2019/02/Aula-01-2015.pdf Dabbs, S. M., Graham, J. A., & Dixon, M. A. (2020). Extending the Kaleidoscope Career Model: Understanding Career Needs of Midcareer Elite Head Coaches. Journal of Sport Management, 34(6), 554–567. Knowles, J., & Mainiero, L. (2021). Authentic talent development in women leaders who opted out: Discovering authenticity, balance, and challenge through the kaleidoscope career model. Administrative Sciences, 11(2). https://doi.org/10.3390/ admsci11020060 Mainiero, L. A., & Gibson, D. E. (2018). The Kaleidoscope Career Model Revisited: How Midcareer Men and Women Diverge on Authenticity, Balance, and Challenge. Journal of Career Development, 45(4), 361–377. https://doi. org/10.1177/0894845317698223 Sullivan, S. E., & Mainiero, L. (2008). Using the Kaleidoscope Career Model to Understand the Changing Patterns of Women’s Careers: Designing HRD Programs That Attract and Retain Women. Advances in Developing Human Resources, 10(1), 32–49. https://doi.org/10.1177/1523422307310110 Sullivan, S. E., & Carraher, S. M. (2018). Chapter 14: Using the kaleidoscope career model to create cultures of gender equity. In Research Handbook of Diversity and Careers. Cheltenham, UK: Edward Elgar Publishing. Retrieved May 22, 2023, from https://doi.org/10.4337/9781785365607.00024 White-Lewis, D.K., O’Meara, K., Mathews, K. et al. Leaving the Institution or Leaving the Academy? Analyzing the Factors that Faculty Weigh in Actual Departure Decisions. Research in Higher Education.64, 473–494 (2023). https://doi.org/10.1007/s11162-022-09712-9. 11. Educational Improvement and Quality Assurance
Paper Facilitators of Teacher Professional Development: Underestimated and Under-Researched Part when Considering Innovations in the Education System?! University Duisburg-Essen, Germany Presenting Author:Against the background of the uncertainty and simultaneity of multiple challenges confronting the school system, such as the shortage of teachers, issues of educational inequality, and the dynamics of technological developments with constantly growing impulses for education and learning, the need for comprehensive, high-quality and thus effective further teacher training as well as support opportunities for all those involved in school development, increases. Especially regarding digitalisation, professional development plays an important role – in Germany and many other European countries as well (Butler et al., 2018; Engec et al., 2021; Fraillon et al., 2019). In the context of digitalisation and for the quality of further teacher training and support services, professional development facilitators are considered to be highly relevant (Gräsel et al., 2020). Despite this assumption, research so far offers little knowledge about in-service trainers (Karsenty et al., 2021; Perry & Booth, 2024), although they necessarily influence the learning of teachers and thus occupy a central position in the professionalisation and support of schools (Lipowsky, 2019; Timperley et al., 2007). This may be due to the fact that defining the term ‘teacher professional development facilitators’ is rather complicated: Focusing the German context, different types of teacher professional development opportunities exist and are offered and deployed by various actors and institutions. These use different terms and understandings when describing teacher professional development facilitators; a standardised definition is non-existent. There also is the umbrella term ‘multipliers’ to describe people disseminating information and knowledge between institutions and levels of the education system, which is used in a wide variation of contexts and understandings, e.g. pupils using peer approaches, student teachers, teachers who pass on learning content from further training courses at their schools; further qualified teachers who train and advise other schools and teachers within the framework of state structures, or managers who are responsible for the conception of training and counselling. In the paper at hand, we understand teacher professional development facilitators as persons who work within the structures of the German federal states and who educate practicing teachers as trainers and counsellors (Endberg & Engec, 2023). This definition comes close to the one issued by Perry and Booth (2024, S. 145): “Our focus is those practitioners who design, lead and deliver formal professional development activities for teachers, including workshops, courses, programmes and similar activities, whether online, face-to-face or blended”. Considering the lack of standardized terminology, the federal and multi-level education structure in Germany, and the under-researched role of teacher professional development facilitators, our aim is to generate descriptive knowledge about the recruitment, qualification, and deployment of professional development facilitators in Germany. Moreover, we use a co-constructive approach by networking representatives of the state institutes/quality institutions of the federal states with responsibility for teacher professional development facilitators within a working group “Multipliers”, which has been initialized within the context of our ongoing research project (part of the joint project “Kompetenzverbund lernen:digital” funded by the Federal Ministry of Education and Research and by the European Union-NextGenerationEU). Here they contribute their expertise on how concepts for the selection, qualification, and deployment of teacher professional development facilitators are implemented in their state. Discussions concerning similarities and differences between the federal states, open questions and existing challenges are encouraged in order to generate a survey to gather the necessary descriptive knowledge about the group of facilitators as “multipliers” in permanently changing circumstances in schools, school systems, countries and the whole world. The guiding research interest therefore revolves around the question: To what extent are there cross-national approaches, strategies and quality criteria for recruitment, qualification, and deployment of teacher professional development facilitators in the context of digitalisation? Methodology, Methods, Research Instruments or Sources Used To answer this question, we draw on existing expert knowledge from the education system and systematise findings from established structures and processes. To this end, a semi-structured survey with leading questions will be conducted in state institutes/quality institutions, which will be answered by responsible persons with relevant expertise in the institutions mentioned. The methodological approach can be considered as an expert (group) interview in written form. One main advantage of expert interviews lies within their power to “add to experimental findings about micro processes and how decisions were made in practice” (von Soest, 2023, S. 277). Regarding the lack of research knowledge, while assuming a great variety in terminology, implementation standards, and qualifying programs for teacher professional development within the federal states, this approach allows for a look ‘behind the scenes’ and into the practices of the state institutes/quality institutions whose role and importance is only slowly gaining attention from the perspective of educational research. The list of open questions will be discussed and modified in the "Multipliers" working group on the basis of preliminary scientific work so that both the existing research desideratum is addressed, and the needs of educational practice are taken into account. The approach and methodology of data collection are deliberately designed to be open: there are no prescribed answers; instead, the expertise should be noted down in the experts’ own words. The interviewees decide whether they answer in writing or provide audio files. The data will be analysed qualitatively by the research team using content analysis (Mayring, 2015) applying a category system following a deductive-inductive approach. Exemplary, the following superordinate categories have been identified by applying the deductive approach: • Group of people (qualifications/professional background, employment/institutional connection, number/quotas of multipliers in the federal states); • Deployment (deployment strategies and areas of application, subject reference/school reference, job description); • Recruitment (strategy/concept, process, criteria); • Qualification (determined goal/s, structured qualification programs/modules, content/skills, needs, reference to competency models/quality criteria e.g. standards or quality frameworks); • Intended and perceived effects for school development, school effectiveness, i.e. student learning (effect logic/chain, ways of evaluating effects/effectiveness); • Possible conditions for success (specific objectives, emphasis and reported challenges of the federal states). The survey is expected to take place in March 2024, so that initial insights into the data and first results can be provided during the conference. Conclusions, Expected Outcomes or Findings “[C]hallenges of school development, like integrating ICT, can best be tackled when working collaboratively” (Gageik et al., 2022, p.18). This does not only hold true for individual schools collaborating within a school network but is also highly relevant considering the multi-level school system in Germany with different levels of authority and responsibility. In this context, facilitators of professional development are seen as a central group of actors whose actions and impact on school development have not yet been sufficiently recognised. As the role of facilitators of professional development in the implementation of innovations in the school system will become more important in the future since schools are key actors in realising the SDG4 (‘Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all’, (UNESCO, 2016) then more research is needed on the multipliers themselves, their qualifications, their application scenarios and strategies and, associated with this, their selection, support and underlying impact assumptions as well as impact measurements. In this paper we aim to contribute to this rarely researched topic. We present preliminary findings from the nation-wide systematic inquiry of practices of recruitment, qualification, and deployment of facilitators of professional development in the German federal states. That offers also new perspectives on this crucial role of facilitators of professional development for spreading innovations into schools and into school systems in Germany and provides a foundation for an international comparison of structures and practices in teacher professional development. This paper also presents the co-constructive, cross-state concept of the working group, which brings together representatives from academia and practice. Initial experiences of the discursive and solution-orientated approach are reported in addition to the jointly modified survey and its preliminary findings. References Butler, D., Leahy, M., Twining, P., Akoh, B., Chtouki, Y., Farshadnia, S., et al. (2018). Education Systems in the Digital Age: The Need for Alignment. Technology, Knowledge and Learning, 23(3), 473–494. https://doi.org/10.1007/s10758-018-9388-6 Endberg, M., & Engec, L.-I. (2023). Unentdeckte Potenziale der Lehrkräftefortbildung im Kontext der Digitalisierung – Wandeln auf neuen Wegen in Fortbildungs- und Unterstützungssystemen. Sektionstagung empirische Bildungsforschung AEPF und KBBB, Universität Potsdam, 13.-15.09.2023. Engec, L.-I., Endberg, M., & van Ackeren, I. (2021). Expertise zur Situation der Fortbildungs- und Unterstützungssysteme für Schulentwicklung im Kontext der Digitalisierung in Deutschland. Bundesweite Ergebnisse und grundlegende Einschätzungen aus dem Forschungsprojekt „ForUSE-digi“ im Rahmen des Metavorhabens „Digitalisierung im Bildungsbereich“. Universität Duisburg-Essen. https://doi.org/10.17185/duepublico/75251 Fraillon, J., Ainley, J., Schulz, W., Duckworth, D., & Friedman, T. (2019). IEA International Computer and Information Literacy Study 2018 Assessment Framework. Springer International Publishing. https://doi.org/10.1007/978-3-030-19389-8 Gageik, L., Hasselkuß, M., & Endberg, M. (2022). School Development Within Networks in a Digital World: Risky Ride or Beneficial Blessing? In K. Ortel-Cass, K. J. C. Laing, & J. Wolf (Eds..), Partnerships in Education. Transdisciplinary Perspectives in Educational Research (5. Vol.). Springer. https://doi.org/10.1007/978-3-030-98453-3_2 Gräsel, C., Schledjewski, J., & Hartmann, U. (2020). Implementation digitaler Medien als Schulentwicklungsaufgabe. Zeitschrift für Pädagogik, 66, 208–224. https://doi.org/10.25656/01:23629 Karsenty, R., Pöhler, Birte, Schwarts, G., Prediger, S., & Arcavi, A. (2021). Processes of decision-making by mathematics PD facilitators: The role of resources, orientations, goals and identities. Journal for Mathematics Teacher Education, 26(1), 27–51. https://doi.org/10.1007/s10857-021-09518-z Lipowsky, F. (2019). Wie kommen Befunde der Wissenschaft in die Klassenzimmer? – Impulse der Fortbildungsforschung. In C. Donie, F. Foerster, M. Obermayr, A. Deckwerth, G. Kammermeyer, G. Lesnke, M. Leuchter, & A. Wildemann (Eds.), Grundschulpädagogik zwischen Wissenschaft und Transfer (pp. 144–161). VS Verlag für Sozialwissenschaften. Mayring, P. (2015). Qualitative Inhaltsanalyse: Grundlagen und Techniken: Bd. 12., überarbeitete Auflage. Beltz Verlag. Perry, E., & Booth, J. (2024). The practices of professional development facilitators. Professional Development in Education, 50(1), 144–156. https://doi.org/10.1080/19415257.2021.1973073 Timperley, H., Wilson, A., Barrar, H., & Fung, I. (2007). Teacher Professional Learning and Development. Best Evidence Synthesis Iteration [BES]. Ministry of Education. http://educationcounts.edcentre.govt.nz/goto/BES UNESCO. (2016). Education 2030. Incheon Declaration and Framework for Action for the implementation of Sustainable Development Goal 4. Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. https://uis.unesco.org/sites/default/files/documents/education-2030-incheon-framework-for-action-implementation-of-sdg4-2016-en_2.pdf von Soest, C. (2023). Why Do We Speak to Experts? Reviving the Strength of the Expert Interview Method. Perspectives on Politics, 21(1), 277–287. https://doi.org/10.1017/S1537592722001116 |
15:45 - 17:15 | 11 SES 07 A: School Education: School Improvement Models Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Gulmira Yestepbergenova Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Crafting Excellence: A Case Study on Leadership Traits in Distinguished Schools 1Sharjah Education Academy -SEA; 2UAEU Presenting Author:This study examined the common characteristics of the leadership team, the main practices followed by the leadership team, and the leadership styles that are mostly followed by leaders in an outstanding school. It is partly a systematic review of works related to school leadership and leadership practices. Besides, it includes a field investigation of leadership traits in the selected schools. The qualitative approach was used and semi-structured interviews were developed based on the study’s purpose and objectives and drawing on the literature review. The findings revealed that the most important characteristics of leadership in outstanding schools are represented in inspirational shared vision, commitment, dedication, loyalty, spirituality, and care. Besides, the most common practices followed by the leadership team are represented in developing people, focus on student achievement and well-being, and redesigning the organization. Significantly, the findings reflect that the leaders adopt a highly distributed leadership style that is mixed and supported by both instructional and transformational leadership styles. Research Question: The study aims to explore the following key areas within an outstanding educational institution: 1- What are the common characteristics of the leadership team in an outstanding school?2- What are the main practices followed by the leadership team in an outstanding school?3- What leadership styles are mostly followed by leaders in an outstanding school The study is grounded in the leadership literature, drawing from several theoretical perspectives: Leadership, School Leadership, and Leadership Styles. The study focuses on three main leadership styles as outlined in the literature: Transformational Leadership, Distributed Leadership, and Instructional Leadership Draws on research and theories to identify common characteristics and practices of successful leaders Methodology, Methods, Research Instruments or Sources Used The study employs a qualitative approach, utilizing semi-structured interviews to gather data from school leaders. The theoretical framework is applied to analyze the data and interpret the findings in the context of outstanding school leadership. Conclusions, Expected Outcomes or Findings The analysis of the interviews conducted at the outstanding school in the current research reflected that the most common characteristics of the leadership in outstanding schools are represented in the inspirational shared vision. In this respect, all interviewed leaders had a very clear ambitious, and dynamic vision that is led by the founder of the school. Moreover, they adopted the principles of commitment, dedication, loyalty, spirituality, and care. Significantly, the practices followed by the leadership team included developing people, as all interviewed school leaders talked about how they started their journey as junior teachers. They were trained, mentored closely, and grew professionally inside the campus until they were equipped with the skills and knowledge to hold the leadership positions they were at. They also focus on students’ achievement and wellbeing, and support teachers’ motivation and commitment, through building collaborative cultures and productive relationships with parents and the community. Apart from this, the leads practices and their views reflected that they adopt a highly distributed leadership style that is mixed and supported with both instructional and transformational leadership styles. Being a case study, the sample size was limited. Therefore, it is recommended that future research should apply the mixed method to take the view of a larger sample. Besides, as the current study focused mainly on three aspects related to characteristics, practices, and leadership styles, future research could include other factors or tackle one of the factors in more depth. References 1. Andrews, J. Murry, A. & Istvanffy, P. A Holistic Approach to On-Reserve School Transformation: Pursuing Pedagogy, Leadership, Cultural Knowledge, and Mental Health as Paths of Change. Canadian Journal of School Psychology, 38(1) (2023) 64–85, https://doi.org/10.1177/08295735221146354 2.Anizah, A. & Maretta, W. Principal Effective Leadership in Developing Teacher Professionalism. Journal of Educational Management, Leadership, and Supervision, 2(1) (2017) 97-105. https://doi.org/10.31851/jmksp.v2i1.1157 3.Arjanto, P. How is principal leadership related to effective school? International Research-Based Education Journal, 4(2) (2022) 163-174, https://journal2.um.ac.id/index.php/irbej/article/view/27883 4.Bass, B. & Riggio, R. Transformational Leaderhip. Mahwah, NJ: Lawrence Erlbaum Associates (2006). 5.Bolden, R. Distributed Leadership. Discussion Papers in Management. University of Exeter (2007). https://doi.org/10.4324/9780203099643 6.Burns, J. Leadership, New York: Harper & Row, (1978). 7.Bush, T. & Glover, D. School Leadership: Concepts and Evidence, (2003), https://dera.ioe.ac.uk/5119/14/dok217-eng-School_Leadership_Concepts_and_Evidence_Redacted.pdf 8.Bush, T. Assessing successful school leadership: What do we know? Educational Management Administration & Leadership, 49(5) (2021) 687–689, https://doi.org/10.1177/17411432211034675 9.Cuban, L. The managerial imperative and the practice of leadership in schools. Suny Press, (1988). 10.Day, C. & Gurr, D. Leading schools successfully: Stories from the field. London, England: Routledge (2014). 11.Dhillon, J. Howard, C. & Holt, J. Outstanding Leadership in Primary Education: Perceptions of School Leaders in English Primary Schools. Management in Education, 34(2) (2020) 61-68, https://doi.org/10.1177/0892020619885942. 12.Guba, E. Criteria for assessing the trustworthiness of naturalistic inquiries. Educational Communication and Technology Journal (29) (1981) 75-91. https://doi.org/10.1007/BF02766777 13.Gurr, D. Finding your leadership, Perspectives in Education, 2 (2015) 1-2. https://www.academia.edu/9067095/Gurr_D_2014_Finding_your_leadership_Perspectives_in_Education_2 14.Hallinger, P. A review of three decades of doctoral studies using the Principal Instructional Management Rating Scale: A lens on methodological progress in educational leadership. Educational Administration Quarterly, 47(2) (2011) 271-306, https://doi.org/10.1177/0013161X10383412 15.Harris, A. & Jones, M. Compassionate leadership, School Leadership & Management, 43(3) (2023) 185-188, https://doi.org/10.1080/13632434.2023.2235540 16.I. Berkovich & R. Bogler, The relationship between school leadership standards and school administration imperatives: an international perspective, School Leadership & Management, 40 (4) (2020) 321-334, https://doi.org/10.1080/13632434.2019.1682538 17.Inegbedion, H. Adeyemi, S. Akintimehin, O. & Eluyela, D. Teachers’ time utilisation and students’ enrolment in School Certificate Examination: Implication for School Leadership. Heliyon, 6(9) (2020), https://doi.org/10.1016/j.heliyon.2020.e04892 18.K. Leithwood, D. Jantzi & R. Steinbach, Changing Leadership for Changing Times, Buckingham: Open University Press (1999). 19.Larsson, P. & Löwstedt, J. Distributed school leadership: Making sense of the educational infrastructure. Educational Management Administration & Leadership, 51(1) (2023) 138–156, https://doi.org/10.1177/1741143220973668 11. Educational Improvement and Quality Assurance
Paper How Does Instilling the Value of School Education Influence Increasing the Level of Academic Achievement of Students of Transitional Age? Nazarbayev intellectual school, Kazakhstan Presenting Author:Values are central to both the theory of education and the practical activities of schools in two ways. First, schools and individual teachers within schools are a major influence, alongside the family, the media and the peer group, on the developing values of children and young people, and thus of society at large. Secondly, schools reflect and embody the values of society; indeed, they owe their existence to the fact that society values and seeks to exert influence on the pattern of its own future development through education. However, the values of society are not as uniform or unchanging as this suggests. Many groups within society have a legitimate claim to a stake in the educational process parents, employers, politicians, local communities, leaders of industry and taxpayers, as well as teachers and children themselves and within each of these groups there is a wide diversity of political, social, economic, religious. ideological and cultural values. (J. Mark Halstead). Instilling the value of school education is a key factor that positively affects the level of academic achievement of transition-age students. Ensuring that students perceive the value of the knowledge and skills they acquire helps them better adapt to the learning process, set goals, and strive to achieve success. This diversity of values within society poses challenges for schools and educators. They must navigate the competing interests and perspectives of different stakeholders while also ensuring that the education provided is aligned with societal values and objectives. Parents often have a strong influence on the values instilled in their children and may have particular expectations of what they want schools to prioritize in their education. Employers may emphasize the development of certain skills or knowledge that align with workforce needs. Politicians may have their own agendas and ideologies that they want to promote through the education system. Local communities may have specific cultural or religious values that they want schools to respect and uphold. At the same time, teachers and students themselves bring their own values and beliefs into the educational environment. Students may come from diverse backgrounds and have different perspectives shaped by their family, culture, and experiences. Teachers also have their own values that influence their teaching approaches and decisions. Managing these diverse values requires a delicate balance. Schools must strive to be inclusive and respectful of different perspectives, while also upholding certain core values that are essential for the functioning of a democratic and pluralistic society, such as respect for human rights, equality, and critical thinking. Additionally, schools have a role in shaping values and promoting social cohesion. They can provide opportunities for students to engage in discussions and debates that foster understanding, empathy, and respect for different viewpoints. Schools can also promote values such as fairness, compassion, and social justice through their curriculum, policies, and the way they handle disciplinary issues and conflicts within the school community. Methodology, Methods, Research Instruments or Sources Used Methods for assessing the impact of instilling values in students on improving academic performance in adolescence Adolescence is considered one of the most difficult periods in a person’s life, especially in the field of education. During this period, students face many changes and challenges, both physical and emotional. They begin to build their personality, form values and beliefs that contribute to their further development. One of the key values that can be instilled in students to improve academic performance is the value of education. It is important to interest and motivate students so that they understand that education has not only academic value, but also allows them to achieve success in the future. Assessing the impact of instilling the value of education on improving student achievement can be done using the following methods: Questioning. Creating a questionnaire that allows students to express their views on the importance of education and its impact on their success. The survey questions should be aimed at identifying the extent to which students understand the importance of education and strive to achieve good results. Observation. Observing students' behavior in and outside the classroom to determine their level of participation and interest in learning materials. Observations may include assessment of participation in the lesson, accuracy in completing tasks, and the exercise of initiative and self-discipline. Interview. Conducting interviews with students to find out what values they associate with education and how they see the connection between these values and their success. Interviews can be conducted individually or in a group. Performance analysis. Examining data on student achievement before and after teaching the value of education. This allows us to assess the extent to which the instilled value influences the improvement of academic performance and the achievement of important educational goals. Qualitative and quantitative research. Conducting research using a variety of methods, including surveys, observations, and data analysis. This approach allows us to obtain comprehensive information about the impact of instilling values on improving the achievement of students in adolescence. Conclusions, Expected Outcomes or Findings Instilling the value of school education is a key factor that positively affects the level of academic achievement of transition-age students. . One of the main goals of school education is to develop a positive attitude towards learning in students. When students realize that education gives them the opportunity to expand their horizons, achieve success and realize their potential, they become more motivated and interested in learning. This in turn helps improve their academic achievements. It is also important to consider that instilling the values of schooling helps transition-age students develop critical thinking and analytical skills. The pursuit of knowledge and understanding stimulates their interest in academic subjects and promotes the development of analytical thinking, which helps improve their academic performance. In addition, introducing the values of school education helps to develop self-regulation and responsibility skills in transition-age students. They begin to understand that regularly completing homework, attending classes, and being involved in the learning process contributes to their success. Introducing the value of school education also has a positive impact on the development of social skills of transition-age students. Schooling provides them with the opportunity to learn how to work in a group, develop communication and team skills, and learn how to resolve conflicts and communicate tolerantly with other people. All this contributes not only to their educational process, but also to their future career, where communication and socialization skills play an important role. Thus, the introduction of the value of school education significantly influences the increase in the level of academic achievements of transition-age students. It promotes the development of a positive attitude towards learning, increased motivation and interest in learning, and the development of critical thinking and analytical skills. References 1) Halstead, M. (2005). Values and values education in schools. In Values in education and education in values (pp. 3-14). Routledge. 2) Halstead, J. M. Values and Values Education in Schools. PUB TYPE, 11. 3) Postman, N. (2011). The end of education: Redefining the value of school. Vintage. 4) Behrendt, M., & Franklin, T. (2014). A review of research on school field trips and their value in education. International Journal of Environmental and Science Education, 9(3), 235-245. 5) Meyer, R. H. (1997). Value-added indicators of school performance: A primer. Economics of education Review, 16(3), 283-301. 6) Taylor, M. J. (2005). Values education: Issues and challenges in policy and school practice. Institutional Issues, 231-254. 7) Meyer, R. H. (1996). Value-added indicators of school performance. Improving America’s schools: The role of incentives, 197-223. 8) Postman, N. (2011). The end of education: Redefining the value of school. Vintage. 11. Educational Improvement and Quality Assurance
Paper The High Performing Schools Programme - impact of a school improvement programme in the Netherlands 1Queen's University Belfas, United Kingdom; 2Katholieke Universiteit Leuven, Belgium Presenting Author:Many industrialized countries face an alarming decline in pupils' academic performances as reported by cross-national studies, such as PISA, PIRLS, and TIMSS. For instance, in the Netherlands—where this study was conducted—the trends of the PISA study from 2003 through 2018 show that the average levels of reading and math performance decreased by at least the equivalent of half a year of schooling (OECD, 2019). Educational policymakers and schools in many countries are looking for ways to reverse this declining trend and improve achievement levels for all pupils. While the literature on school effectiveness and school improvement provides an impressive account of the factors that may contribute to students' academic achievement (see Hopkins & Reynolds, 2001; Muijs & Reynolds, 2003, 2017), validated evidence of the impact of specific school improvement programmes generally yields very mixed results (Coe, 2009). School improvement studies that focus on specific leadership development programs are rather scarce (see Greany & Earley, 2021). In this study, we examined the effectiveness of the High Performing Schools (HPS) program, which focuses on improving school leadership and setting up professional learning communities (PLCs) informed by the educational, psychological, and sociological scientific literature. The HPS improvement programme was developed by scholars and educators at the Academica University of Applied Sciences in the Netherlands, drawing upon the principles of high-performing organization theory, as informed by the studies of De Waal (2006), Senge (2006), and Hill et al. (2016). The programme has three key elements: whole-school CP{D, focussed on the development of knowledge and skills in teaching and learning, leadership development, based on the Zenger-Folkman model (Zener & Folkman, 2014), and the development of professional learning communities. The theory of change proposes that through the development of high quality professional learning at the school level (using professional learning communities and CPD for both teachers and leaders), we can improve teaching quality, which in turn will improve learning outcomes. In this way we combine insights from research on school improvement, teacher and school effectiveness and professional development. The study is confirms within a Dutch context that internationally recognized factors can contribute to effective school improvement programmes here as well, although as mentioned above the primary focus on CPD in HPS makes it relatively straightforward to implement compared to some other approaches which require greater structural change. However, what is noteworthy from the international evidence base is that while the core elements of effective school improvement are known, it is nonetheless common for school improvement initiatives to fail (Coe, 2009; Benoliel & Berkovich, 2020; Bryk, 2010). This study can help shed some light on this important question. The findings suggest that, firstly, there is a need to fully integrate all elements of effective school improvement, including teacher collaboration, and, secondly, support the importance of teacher participation and collaboration to make school improvement work. This suggestion, which joins a growing body of research on implementation of school improvement, implies that school improvement requires sustained and intensive focus to succeed (Kyriakides et al., 2021; Supovitz et al., 2019).
Methodology, Methods, Research Instruments or Sources Used In this study we used a quasi-experimental design in which we evaluated the effectiveness of the HPS intervention by comparison with other schools in the population. The primary sample for this study comprises 47 primary schools that participated in the HPS programme between 2018 and 2021, which we compared with the population of other primary schools in the Netherlands (N = 6,110). For this purpose, we utilized publicly available data on the academic achievement of pupils in Dutch primary schools provided by the Department for the Implementation of Education at two time points. Specifically, we used national data on the results of the high-stakes final test (Eindtoets Basisonderwijs) that all pupils in the country must take at the end of primary school (grade 8), covering reading, writing and mathematics. We examined schools' academic achievement levels at T1 for the school year 2021-2022 while controlling for the achievement levels at T0 at school year 2017-2018. Since participation in the HPS programme is voluntary, there is no random assignment between the intervention and control conditions. As such, it is crucial to ensure that there are no apparent selection effects that can bias the analyses. Therefore, before exploring the effects of the HPS programme, we examine whether there are differences at baseline between schools that participated in the HPS programme and the comparison group. The main analyses were conducted using ANCOVA models. Conclusions, Expected Outcomes or Findings Overall, the analysis of public data on school achievement suggests that the HPS programme has had a positive impact on overall achievement in the 47 participating schools. Schools that participated in the HPS programme demonstrated greater progress on average than the comparison schools. Furthermore, while a decrease in achievement is evident in the comparison group of schools during the Covid-19 pandemic period, the achievement of schools that participated in the HPS programme did not decline; instead, it improved during the COVID-19 pandemic period. However, the size of the effects varied among the subject areas (math, reading, and writing) and among the two types of HPS programme. We found significant effects for math and writing, while no significant effect was found for reading. There are two explanations for these differences. Comparing different implementation models we found that full implementation of all elements was necessary for positive effects to occur. References Benoliel, P., & Berkovich, I. (2021). Learning from intelligent failure: an organizational resource for school improvement. Journal of Educational Administration, 59(4), 402-421. Coe, R. (2009). School Improvement: Reality and Illusion. British Journal of Educational Studies, 57(4), 363-379. De Waal, A. A. (2006). The Characteristics of High Performance Organization. SSRN. http://dx.doi.org/10.2139/ssrn.931873 Hill, A., Mellon, L., Laker, B., & Goddard, J. (2016). The One Type of Leader Who Can Turn Around a Failing School. Harvard Business Review, 20. Available at: https://hbr.org/2016/10/the-one-type-of-leader-who-can-turn-around-a-failing-school Hopkins, D., & Reynolds, D. (2001). The Past, Present and Future of School Improvement: Towards the Third Age. British Educational Research Journal, 27, 459-475. Greany, T., & Earley, P. (Eds.). (2021). School leadership and education system reform. Bloomsbury Publishing. Kyriakides, L., Panayiotis, A., & Dimosthenous, A. (2021). Does the duration of school interventions matter? The effectiveness and sustainability of using the dynamic approach to promote quality and equity. School Effectiveness and School Improvement, 32(4), 607-630. Muijs, D., & Reynolds, D. (2017). Effective Teaching: Evidence and Practice. London: Sage. OECD. (2019). PISA 2018 Results (Volume I). What Students Know and Can Do. OECD. Senge, P. M. (2006). The Fifth Discipline: The Art & Practice of the Learning Organisation. London: Random House. Supovitz, J. A., D'Auria, J., & Spillane, J. P. (2019). Meaningful & sustainable school improvement with distributed leadership. CPRE Research Reports. Retrieved from https://repository.upenn.edu/cpre_researchreports/112 Zenger, J., & Folkman, J. (2014). The Skills Leaders Need at Every Level. Harvard Business Review, 7. |
Date: Thursday, 29/Aug/2024 | |
9:30 - 11:00 | 11 SES 09 A: Education for All: Treatment of Educational Diversity Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Buratin Khampirat Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Teachers’ Attributes for Academic Optimism: Understanding its Development for Equity and Excellence 1University of Antwerp, Belgium; 2Atheneum Martinus Bilzen, Belgium Presenting Author:Individual teachers' academic optimism (TAO) is an important teacher characteristic that influences student achievement. Academically optimistic teachers believe they can make a difference, build trusting relationships with students and parents, and focus on learning (Woolfolk Hoy et al., 2008). Research confirms a strong correlation with student achievement, even after controlling for background variables such as SES and migration (Ates & Unal, 2021). At the same time, TAO is inherently malleable; pessimistic teachers can become optimistic (Hoy, 2012). Despite the essential importance of TAO, the academic community has so far had limited success in grasping how TAO is formed, how it evolves and – crucially – how it can be influenced. Therefore, understanding how teachers attribute their level of academic optimism to certain causes is an important step in expanding the knowledge base on TAO, as this can offer more insight into the mechanisms at play in creating academically optimistic teachers. Using attribution theory, we try to capture how teachers explain high or low levels of TAO. Attribution theory states that the perceived causes of past events determine what will happen in the future (Weiner, 2010). Depending on the underlying properties of causes (locus, stability, and controllability) that teachers attribute to their degree of academic optimism, causal attributions shape teachers' affective reactions, expectations, and behaviour (Tõeväli & Kikas, 2016). In other words, teachers who attribute internally and believe they exert control over student learning are more likely to take responsibility compared to teachers who attribute causes externally, uncontrollably, and stable (Wang et al., 2015). To promote favourable attribution patterns, it is therefore important to understand those causal attribution processes (Suter et al., 2022). Consequently, knowledge about the causes teachers name for high or low levels of academic optimism creates opportunities for understanding the development of TAO. In addition, this study examines the role of students' disadvantaged background and schools' level of academic optimism (SAO) regarding these attributions. After all, teachers' attribution process is not independent of the social (school) context (Murray et al., 2020). Previous research has already shown that school composition influences teachers' attribution processes regarding their students’ success or failure (Riley & Ungerleider, 2012). Despite good intentions, a common attribution error is over-reliance on information based on stereotypes (Reyna, 2008). These stereotypes lead to failure being internally, uncontrollably, and stably attributed to the student, negatively affecting expectations for future success. Because teachers can influence students through their attributions (Georgiou, 2008), it is important to know whether causes for high or low levels of TAO are attributed differently according to school composition. At the same time, we examine whether the degree of school-level academic optimism can be related to those attributional processes. School academic optimism (SAO) is a characteristic of the collectively shared school culture and is reflected in the degree of collective efficacy, the trust the team has in students and parents and the way a school-wide focus on learning exists (Hoy, 2012). As the degree of SAO influences normative culture and behaviour in schools (Wu & Lin, 2018), we also expect an influence on the mode of attribution. Schools with high levels of SAO believe they can make a difference, but whether this also trickles down into the way teachers attribute TAO is unknown. While that information could offer more insight into how schools can create an academically optimistic culture. This all leads to the following research questions: (1) How do teachers attribute causes for high or low levels of TAO? And (2) what role do the number of disadvantaged students and the level of SAO play in making these attributions? Methodology, Methods, Research Instruments or Sources Used In an urban aera data were collected through semi-structured interviews with 16 teachers from eight secondary schools that participated in previous quantitative research on academic optimism. These schools were chosen through purposive sampling by the level of SAO (high/low) and the number of disadvantaged students (highest and lowest quartile). As academic optimism is a latent construct, our approach involved a detailed examination of its subcomponents. We explored the factors influencing teachers' perceptions of high or low levels within these components of academic optimism. To elicit insights, teachers were prompted to identify the causes and subsequently discuss their attributions. In addition to the interview guide, we employed a checklist to systematically address the internal/external locus of control and consider dimensions of stability and controllability for each component. Furthermore, we explicitly inquired about the connection between teachers' beliefs, and the potential influence of students' background characteristics, if respondents did not already raised these context factors themselves. Interviews were transcribed and analysed using Nvivo software, with a codebook developed based on academic optimism and attribution theory. Distinctions were made in attributions for high or low levels of academic optimism components, based on respondents’ positive or negative evaluations. The codebook, applied deductively, considered locus of control, stability, and controllability. Regular team discussions ensured coding accuracy. Each unique attribution received a separate code, with the repetition of the same attribution not included as a new code. The study classified interviews as cases, attaching school characteristics obtained from prior research. Quantifying attributions within each code facilitated comparisons based on school characteristics. This comprehensive process addressed research questions, offering insights into teacher attributions related to academic optimism subcomponents and background characteristics of students. Conclusions, Expected Outcomes or Findings Results show that teachers attribute causes for high degrees of TAO both to themselves (internally) and others (externally), and they mainly perceive these causes as stable and controllable. Low levels of TAO are attributed exclusively externally and outside their control, but both stable and unstable. This is in line with previous research and confirms the self-serving attribution bias where people attribute success internally but failure externally (Cabanis et al., 2013). In addition, the degree of SAO seems to play a role in attribution, rather than school composition. Teachers in academically optimistic schools are more likely to attribute high levels of TAO to positive school characteristics that are stable and controllable. Moreover, they explain low levels of TAO less frequently with causes referring to students' disadvantaged backgrounds, compared to colleagues from less optimistic schools. The latter group attributes causes for low levels of TAO exclusively external and beyond their control. In conclusion, teachers in academically optimistic schools seem to speak differently about their students, their school, and themselves. In the way they attribute low or high levels for TAO opportunities are seen and responsibilities are recognised. This creates possibilities for increasing academic optimism by addressing teachers' perceptions and attributions. After all, academic optimism may be changeable, but if teachers are not willing to assign themselves a role in this process, this transformation will be little successful (Oakland & Tanner, 2007). As higher levels of TAO can lead to better performance for all students the importance of these insights come to the fore. More detailed results, insights, and consequences, as well as limitations, will be covered in the presentation. References Ates, A., & Unal, A. (2021). The relationship between teacher academic optimism and student academic achievement: A meta-analysis. Psycho-Educational Research Reviews, 10(2). https://doi.org/10.52963/perr_biruni_v10.n2.20 Cabanis, M., Pyka, M., Mehl, S., et al. (2013). The precuneus and the insula in self-attributional processes. Cognitive, Affective and Behavioral Neuroscience, 13(2), 330–345. https://doi.org/10.3758/s13415-012-0143-5 Hoy, W. (2012). School characteristics that make a difference for the achievement of all students: A 40-year odyssey. Journal of Educational Administration, 50(1), 76–97. https://doi.org/10.1108/09578231211196078 Murray, R. M., Coffee, P. A., Calum, A. E., & Robert C. (2020). Social Identity Moderates the Effects of Team-Referent Attributions on Collective Efficacy but Not Emotions. Sport, Exercise, and Performance Psychology, 9(3), 322–340. Oakland, J. S., & Tanner, S. (2007). Successful change management. In Total Quality Management and Business Excellence (Vol. 18, Issues 1–2, pp. 1–19). https://doi.org/10.1080/14783360601042890 Reyna, C. (2008). Ian is intelligent but Leshaun is lazy: Antecedentsand consequences of attributional stereotypes inthe classroom. European Journal of Psychology of Education, XXIII(4), 439–458. Riley, T., & Ungerleider, C. (2012). Self-fulfilling Prophecy: How Teachers’ Attributions, Expectations, and Stereotypes Influence the Learning Opportunities Afforded Aboriginal Students. Canadian Journal of Education / Revue Canadienne de l’éducation, 35(2), 303–333. https://doi.org/10.2307/canajeducrevucan.35.2.303 Suter, F., Karlen, Y., Maag Merki, K., & Hirt, C. N. (2022). The relationship between success and failure causal attributions and achievement goal orientations. Learning and Individual Differences, 100, 102225. https://doi.org/10.1016/j.lindif.2022.102225 Tõeväli, P. K., & Kikas, E. (2016). Teachers’ ability and help attributions and children’s math performance and task persistence. Early Child Development and Care, 186(8), 1259–1270. https://doi.org/10.1080/03004430.2015.1089434 Wang, H., Hall, N. C., & Rahimi, S. (2015). Self-efficacy and causal attributions in teachers: Effects on burnout, job satisfaction, illness, and quitting intentions. Teaching and Teacher Education, 47, 120–130. https://doi.org/10.1016/j.tate.2014.12.005 Weiner, B. (2010). The development of an attribution-based theory of motivation: A history of ideas. Educational Psychologist, 45(1), 28–36. https://doi.org/10.1080/00461520903433596 Woolfolk Hoy, A., Hoy, W. K., & Kurz, N. M. (2008). Teacher’s academic optimism: The development and test of a new construct. Teaching and Teacher Education, 24(4), 821–835. https://doi.org/10.1016/j.tate.2007.08.004 Wu, J. H., & Lin, C. Y. (2018). A multilevel analysis of teacher and school academic optimism in Taiwan elementary schools. Asia Pacific Education Review, 19(1), 53–62. https://doi.org/10.1007/s12564-017-9514-5 11. Educational Improvement and Quality Assurance
Paper Social Justice in Portuguese schools - New directions and approaches CIIE/FPCEUP, Portugal Presenting Author:Globalisation has led to increasing diversity in school contexts, in terms of students' backgrounds and nationalities, cultures and languages (Rijkschroeff et al., 2005). This new reality poses unprecedented challenges to schools, in their attempt to achieve equity through teaching-learning environments, to improve contextualised, multicultural settings and student-centred strategies. It is also necessary to consider the perennial social and economic inequality structure, which continues to generate inequalities in academic achievement (Broer et al., 2019). Socioeconomic inequalities are evident in most European cities, segregation is increasing, and the gap between upper and lower classes is widening (Musterd et al., 2017). There is a clear danger that education may reflect this imbalance and once again become a platform for reproducing economic and social inequalities. To counter this tendency, schools are increasingly expected to innovate, to develop effective strategies and methods, and to redesign organisational changes. All these efforts aim at transforming diversity into an asset, increasing students' motivation and engagement in learning, and empowering the whole student community in the acquisition of knowledge. What we intend to bring to this presentation is a qualitative case study, conducted in two elementary schools in Portugal, that addresses how teachers and other members of the educational community regard interventions that are being implemented, for targeted, disenfranchised, groups of students. The selected schools depict a variety of socio-economic, ethnic and immigrant backgrounds. They face a number of challenges, dealing with low SES groups, as well as a wide range of new immigration arrivals, that present linguistic differences. These interventions, which aim at reducing both long-standing and recent inequalities, are described, analysed, and evaluated by the research participants.
Methodology, Methods, Research Instruments or Sources Used These case studies intend to understand the meaning and specificities of these interventions or measures in the perspective of the participants. The collection of data consists of fifteen individual interviews with teachers and headteachers, education staff (school psychologist and social workers) and parents. These materials have undergone content analysis, as systematic description of phenomena (Breakwell, 2012) allowing for the organization of content into several categories, that structure the strategies developed in these school contexts. More specifically, the research questions focus on: what has been created in this school over the last few years to achieve greater success for all pupils, particularly those from disadvantaged groups? What features seem to be producing more transformative teaching and learning? What does not seem to be working as expected? Conclusions, Expected Outcomes or Findings Seeing that the research is ongoing, we still do not have many specific results on the perceived efficacy of these strategies. However, we expect to depict a vast array of interventions. The findings, so far, reveal different types of interventions, which can be organized into pedagogical, classroom tailored strategies, as well as school level organization policies, following the implementation of new legislation acts in education. These strategies connect with the research questions, in their description and evaluation of more or less effectiveness, in the participants perspective, that is, these discourses about strategies and measures are being subjected to a content analysis treatment of their perceived efficacy and barriers. Some concrete examples of innovative interventions implemented by these contexts are, considered by the participants as transformative, could be: the creation of interdisciplinary classes (DACS), coordinating several subjects in the same classroom; a project designed to teach the national language to immigrant students; new school organisation policies to improve attention and discipline (timetables, mobile phone use); strategies for closer links between family and school, among others. References Breakwell, M. G. (2012). Content analysis. Breakwell, Wright & Barnett (Eds). In Research methods in psychology. (p. 511-530). Sage Publisher. Broer, M., Bai Y. & Fonseca, F. (2019). Socioeconomic Inequality and Educational Outcomes Evidence from Twenty Years of TIMSS. International Association for the Evaluation of Educational Achievement (IEA) Musterd, S., Marcińczak,S., van Ham, M. & Tammaru, T. (2017) Socioeconomic segregation in European capital cities. Increasing separation between poor and rich, Urban Geography, 38:7, 1062-1083, DOI: 10.1080/02723638.2016.1228371 Rijkschroeff, R., ten Dam, G. Duyvendak,J.W., de Gruijter , M. and Pels,T. (2005). Educational policies on migrants and minorities in the Netherlands: success or failure? Journal of Education Policy. 20, 4, pp. 417–435 11. Educational Improvement and Quality Assurance
Paper Making a Return to Education and Training: a Systematic Review of Literature (2010-2023) UNED, Spain Presenting Author:Early leaving from education and training (ELET) in the European Union has been a critical objective for the improvement of equity and quality of education systems in the region, at least since the Lisbon European Council (2000), in March 2000, defined the so-called Lisbon Strategy, with the objective for 2010 of making Europe the most competitive and dynamic knowledge-based economy in the world, capable of sustainable economic growth with better and sustainable jobs and greater social cohesion, in which the reduction of ELET was established as an objective. This has been repeated throughout the subsequent education and training strategies that have been published. Reducing dropout remains a priority, however, the scientific literature is beginning to point to a gap in understanding how we can facilitate the return of those who have left education or training and subsequently return (Gilles & Misfud, 2016; Guerrero-Puerta, 2022; Psifidou et al., 2021). Awareness of this process can contribute to a broader integration of the school-work trajectories of young people and, at the same time, broaden the possibilities of support and accompaniment for those who decide to return (Nouwen and Clycq, 2019). In this framework, and due to the scientific literature is very diverse, we propose -as the main objective of the study- to analyze relevant research on the topic in order to present a thematic map of the state of the art on early leaving education and training. Methodology, Methods, Research Instruments or Sources Used The methodology adopted in this study will be a systematic review of the literature focused on the return to education or training after leaving education or training. To carry out this review, two major academic search engines, Scopus and Web of Science, will be used to identify related studies. Studies published between 2010 and 2023 were considered. This methodology will allow us to analyze and synthesize the most up-to-date findings and information on the return of individuals to education or training after having interrupted their educational trajectory. Conclusions, Expected Outcomes or Findings In this line of research on the topic of returning to education or training after leaving, we can find different lines of literature development. On the one hand, De la Cruz & Ilinich (2019), Feito (2015), and Nieto, et al. (2018) focus on the students' return trajectory and explore the meanings they attribute to early school leaving, as well as their influence on the return process using a biographical approach. In addition, they examine the post-dropout period, motivation to return, and students' perceptions of the leaving and return process. These studies highlight the importance of considering factors that led to leaving before being consolidated, which can be projected onto the return process. These investigations also question the linearity of the trajectories and emphasize the importance of addressing the tension between individual agency and structure in the dropout and return processes. In addition, some authors, such as De la Cruz & Ilinich (2019), highlight the influence of individual factors on return, thus, they point out that young people's first contact with the labor market and precarious conditions may be triggers for return. Feito (2015) argues that the low demand of the Spanish productive system in terms of credentials and training has historically contributed to dropout and is now being reversed with an increase in educational return. In addition, another of the resulting lines highlights the importance of accompaniment processes in return transitions. Thiele et al. (2017) study the return of students from lower classes and the importance of guidance to make educational options visible. Emery et al. (2020) reaches similar conclusions when investigating the return trajectories of migrant students, emphasizing the relevance of accompaniment and guidance in this process. In conclusion, these studies highlight the complexity of leaving and returning processes in education, considering individual and structural factors, and emphasizing the importance of support and guidance to facilitate the successful return of students. References Cruz Flores, G. D. L., & Illich Matus Ortega, D. (2019). “¿ Por qué regresé a la escuela?” Abandono y retorno escolar desde la experiencia de jóvenes de educación media superior. Perfiles educativos, 41(165), 8-26. Feito-Alonso, R. (2015). La ESO de adultos. Trayectorias de abandono escolar temprano entre estudiantes con experiencia laboral. Profesorado, Revista de Currículum y formación del profesorado, 19(2), 351-371. Gillies, D. & Mifsud, D. (2016). Policy in transition: the emergence of tackling early school leaving (ESL) as EU policy priority. Journal of education policy, 31(6), 819-832. Guerrero Puerta, L. M. (2022). Jóvenes que Retornan al Sistema de Educación y/o Formación: Un Análisis de su Curso de vida. Nieto, J. M., Pruaño, A. P., & Soto, A. T. (2018). Del abandono educativo temprano al reenganche formativo: un estudio narrativo con biogramas. Educatio siglo XXI, 36(2 Jul-Oct), 93-114. Nouwen, W., & Clycq, N. (2019). The role of social support in fostering school engagement in urban schools characterised by high risk of early leaving from education and training. Social Psychology of Education, 22(5), 1215-1238. Psifidou, I., Mouratoglou, N., & Farazouli, A. (2021). The role of guidance and counselling in minimising risk factors to early leaving from education and training in Europe. Journal of Education and Work, 34(7-8), 810-825. |
13:45 - 15:15 | 11 SES 11 A: Higher Education: Student Needs and Skill Development Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Daiga Kalniņa Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Revolutionizing Learning with The Next-Gen LMS (Scrole) Turiba University, Latvia Presenting Author:In the 21st century where educational organizations are harnessing their skill sets with the help of information and technology, the Knowledge transfer from pedagogy to information and communication technology (ICT) plays a vital role (Reding, 2003). Therefore, in real-life situations, it's crucial to pay attention to what stakeholders of learning organizations need even before we create a product or service. We can make better decisions by understanding their needs and comparing them with what we can offer (Madzík.et.al, 2019). The Kano Model of Satisfaction (1984) is extensively employed by numerous educational and training institutions to assess the impact of individual service components on overall student satisfaction within broader service domains, particularly concerning academic advising or the intended digital learning outcomes (IDLO) of stakeholders in Higher Education Institutions (HEIs). (Mcdowall, 2016) In digital learning, ICT is an important medium. Therefore, designing an LMS to satisfy the needs of stakeholders of HEIs is one of the crucial factors. This study prominently incorporates the theory of attractive quality (Kano model) to analyze the needs of stakeholders for digital learning tools. Kano analysis can offer a better understanding of how stakeholders of HEIs evaluate a product and assist the development of new LMS by focusing on the most important attributes that need to be improved. (Hsu.et.al, 2019) 81 The newly designed LMS will offer 22 new functional factors namely from F1 to F22. These factors comprise various LMS attributes such as ease of use, interactivity index, interconnectivity, design, and layout, (Application Programming Interfaces) API integration, compatibility with various mobile devices, monitoring learners’ performances as well as Human Resource and Accounts Modules integrated. This paper highlights the Kano Method research findings and analysis for the Ph.D. research paper of the author. The 21st century today demands an educational structure that caters to the demands and skills of the new generation in this digital age (OECD, 2019). As per Ferri and colleagues (Ferri.et.al, 2020, pp. 2-3) it is mentioned that a digital learning system implemented properly acts as a very crucial support structure for the delivery of modern constructive coaching. 58 Even though LMS’s have been popular and are widely adopted for their vast offerings that aid digital learning & education. Several authors Umar & colleagues (Umar.et.al, 2017) Brandford (2017) & Naufal (2017) have argued that LMS’s still have limitations that cannot be overlooked. Umar & colleagues highlighted some of the drawbacks of the LMS’s and one of the major factors is that they figured out the primary acceptance and endorsement of the stakeholders that means (teachers/ trainers/ educators/ students/ course designers/ administrative & management personnel as well as owners and managers of the educational institutions or organizations). As per Anderson & Dron (Anderson & Dron, 2017) majority of LMSs are restricted to authorized users deliberately so that the higher authorities of the educational organizations can govern them. Methodology, Methods, Research Instruments or Sources Used To measure the satisfaction level, of the stakeholders with the newly planned LMS named “Scrole” the author has used Kano analysis for this purpose. The analysis is based on the feedback received by the stakeholders of HEIs in Latvia according to the questionnaire prepared and distributed randomly. The survey Google form was drafted to suffice the Kano principles such as functional and dysfunctional ones accordingly. Moreover, self-importance ratings were also taken for the particular product feature codes that comprise 22 features. Analysis was done both continuously and discretely, and results were summarized accordingly. The Technology Pedagogy Content Knowledge (TPACK) (Mishra.et.al, 2017) and Technology Acceptance Model (TAM), (Ros.et.al, 2015) were the main models and frameworks used in framing qualitative and quantitative question sets. It substantiated that those various aspects of the criteria demand the incorporation of various paradigms. Survey analysis highlights almost all 20 out of the 22 features of the “Scrole” are accepted by the stakeholders of HEIs in Latvia. That is except Feature (F12 & 16) yield a value of (P) in the category which according to Kano rules means Positive. It is not always the same and however, things can even change whilst the product is in the pilot testing stage as it is observed that people’s needs, wants and minds change according to the product's versatility and changing trends. (Rust, 2020) Research question: Will the newly designed LMS model fulfill the Technology Acceptance Model (TAM) criteria? Research methods: 1) data collection – stakeholders’ survey (closed-ended questions with functional & dysfunctional and urgency of importance attributes for Kano analysis), stakeholders’ structured observation done by 5 structured Interviews from stakeholders of HEIs from Latvia. Among the Interviewees were three professors from the International College of Cosmetology, the head of the Department of Tourism of Turiba University, and a lecturer of the English Language at the University of Latvia. Mixed-methods data analysis strategies – data interpretation and comparison. For qualitative data analysis, content analysis was applied – the basic analytic method of interpretivism. For quantitative data – descriptive analysis and frequency calculations were carried out. Research process: Stakeholders’ who participated in the "Scrole" survey were specifically targeted according to the HEIs in Latvia. Respondents answered questions that highlighted limitations with LMS, preference factors, daily struggle, inclusion of artificial intelligence for digital learning, and connection of a personal touch with digital modes of learning. Research period: November 2021 – December 2023. Conclusions, Expected Outcomes or Findings Stakeholders consider specially designed software Like Moodle in HEIs, is not easy! Teachers find limitations in terms of time management for training, special software is staggeringly complicated to understand as most teachers don’t have IT backgrounds. The major issue with special digital LMS tools is stakeholders need to depend upon the technical or IT administrator to troubleshoot the problems causing valuable time loss. Other issues highlighted by the stakeholders are generation trends & characteristics, stakeholders have a common opinion that technology should not be the starting point but pedagogy should be, and to practice or implement any new LMS the involvement of all the stakeholders is a must. The biggest concern stakeholders of HEIs raised was about data security. The Attractive Value (A): - When it comes to product attractiveness the value field (A) in discrete analysis gives some of the feature’s percentages below 10% in terms of attractiveness and those are the points the product needs to be worked upon to make it more attractive amongst the stakeholders of HEIs. To overcome the reverse value (R) value for “Scrole” it is important to see what features are being rejected, in this case, it is (F12&F16) that integration with social media and other platforms is not welcomed by the stakeholders of HEIs. The discrete analysis gives a broader overview of every feature accepted or rejected by the stakeholders of HEIs. The Performance Value (P) field shows that all the 22 features of "Scrole" have gained above 50% in terms of Performance features, except F12 & F16, which means that is highly desirable and will be widely accepted by the stakeholders of HEIs in Latvia once developed and launched. "Scrole" LMS has good possible strengths to attract stakeholders to achieve their intended digital learning outcome (IDLO). References Anderson, & Dron. (2017. gada 15. December). Integrating learning management and social networking systems. Integrating learning management and social networking, 25, 5-19. doi:10.17471/2499-4324/950 Ferri.et.al, F. (2020. gada August). Online Learning and Emergency Remote Teaching Opportunities and Challenges in Emergency Situations. MDPI Journals, 10(4), 1-18. doi:10.3390/soc10040086 Hsu.et.al, J.-Y. (2019). Discover Users’ Needs in e-Learning by Kano Analysis and Decision Trees. IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA). Tokyo, Japan: EEE. doi:10.1109/IEA.2019.8714873 Madzík.et.al, P. (2019. gada 28. January ). Application of the Kano Model for a Better Understanding of Customer Requirements in Higher Education—A Pilot Study. MDPI Journal, 1-18. doi:10.3390/admsci9010011 Mcdowall, M. P. (2016). Applying The Kano Model To Higher Education: Moving Beyond Measuring Student Satisfaction. University of North Dakota UND Scholarly Commons. North Dakota : University of North Dakota. Ielādēts 2023. gada 5. Nov no https://commons.und.edu/theses/1931 Mishra.et.al, P. (2017. gada 4. December ). What is Technological Pedagogical Content Knowledge (TPACK)? Journal of Education, Computer Science, Engineering, 193(3). Ielādēts 2023. gada 18. Jan no https://doi.org/10.1177/002205741319300303 OECD. (2019. gada Oct). Educating 21st Century Children. Emotional Well-being in the Digital Age(Educational Research and Innovation), 7081-7092. Riga, Latvia: OECD. doi:http://www.oecd.org/education/educating-21st-century-children-b7f33425-en.htm Rahman.et.al, M. (25. gada 25. Novemeber). Learning Management System (LMS) in Teaching and Learning. International Journal of Academic Research in Business & Social Sciences, 9(11), 1529-1535. doi:10.6007/IJARBSS/v9-i11/6717 Reding, V. (2003). e-learning for Europe. European Council, Education & Culture. Brussels: Publications.eu.int. Ielādēts no http://europa.eu.int Ros.et.al, S. (2015). On the use of extended TAM to assess students' acceptance and intent to use third-generation learning management systems. British Journal of Education & Technology, 46(6), 1250-1271. Ielādēts no https://doi.org/10.1111/bjet.12199 Rust, R. T. (2020. gada 5. March). The future of marketing. International Journal of Research in Marketing, 37(1), 15-26. Ielādēts 2023. gada 2. Dec no https://doi.org/10.1016/j.ijresmar.2019.08.002 Umar.et.al, I. N. (2017. gada 18. August). A Decade of LMS Acceptance and Adoption Research in Sub-Sahara African Higher Education: A Systematic Review of Models, Methodologies, Milestones and Main Challenges. EURASIA Journal of Mathematics, Science and Technology Education, 7270-7286. doi:1305-8223 11. Educational Improvement and Quality Assurance
Paper Competence-based Approach for Educational Improvement of Biology I Programme: the Case of Latvia University of Latvia, Latvia Presenting Author:Competence-based education (CBE) was broadened at the beginning of the 21st century in the context of discussions on the challenges and ways of modernising education, emphasising that it is innovative education: not only a new way of teaching, but also a new way of thinking (Makulova et al., 2015).CBE impacts Europeanisation on national curriculum reforms. The curriculum as a content concept has a continental European tradition and specific Anglo-American roots. It includes a detailed description of the curriculum content that teachers should transmit to students when teaching (Nordin & Sundberg, 2016). At the same time, it can be considered that CBE is a systems-change approach intended to re-shape traditional understandings of what, when, where, an d how students learn and demonstrate academic knowledge and skills (Evans, et al., 2020). This means that developing CBE must simultaneously focus on curriculum, teaching and learning. Nowadays, CBE is being integrated into more and more schools every year It essentially focuses on the development of a student's skills, knowledge (cognitive component), attitudes (affective component) and behaviour (behavioural component) (Cuyacot, E. & Cuyacot, M., 2022). Important elements of competence education are personalized learning, higher student engagement, clear learning objectives, flexibility, adaptation to diverse learners needs, strategies to ensure equity, real-world skills, and continual assessment (Levine & Patrick, 2019; Lorente, 2023). In general, CBE can be considered to be characterised by 5 dimensions: 1) learners progress after demonstrating mastery; 2) there are clear, measurable and achievable outcomes; 3) assessment is meaningful and provides positive learning experiences for learners; 4) learners receive timely, differentiated support based on their individual learning needs; and 5) learning outcomes emphasise competences that involve applying and creating knowledge as well as developing important skills and dispositions (Evans et al., 2019). However, there are also problems in the implementation of CBE, which are related to (1) a lack of standardization - difficult to assess and compare the performance of students across different schools or regions; 2) narrow focus on specific skills or competencies, potentially overlooking the broader development of students in areas such as critical thinking, creativity, and problem-solving; 3) too much emphasis on standardized testing to measure specific competencies; 4) inflexibility not always accommodate individual differences among students; and 5) reduced emphasis on content knowledge (Boritz & Carnaghan, 2003; Lassnigg, 2015; Edwards, 2016; Bowden, 2000; Hodge, et al., 2020). This is particularly true for STEM education (UNESCO, 2019). According to Chalmers et al. (2017) schools face practical difficulties in integrating STEM disciplines in the implementation of Big Ideas (Harlen, 2015). This is attributed to timing, teacher skills, differing curriculum requirements and assessment criteria, and the fact that some STEM disciplines are optional. In general education an improved competence-based education content was fully introduced by 2023. Curriculum reform in Latvia will require a change in teaching and pedagogical approaches (OECD, 2020). The big ideas is central themes or key concepts that guide the teaching and learning of biology, aiming to ensure that students achieve specific learning outcomes related to understanding and engaging with the subject (Skola2030, 2019). The reform of biology content in Latvian schools aims to modernize and enhance the teaching of biology in Latvian schools. It involves changes in the curriculum, teaching methods, and assessment practices to ensure that students gain a deeper understanding of biological concepts and develop critical thinking skills. The aim of the article is to find out how the implementation of CBE approach in Latvian schools improve the learning of biology. To do this, the research question was stated: What are the opinions of biology teachers on the implementation of the Biology I curriculum developed by Skola2030? Methodology, Methods, Research Instruments or Sources Used In 2023 the Faculty of Biology of the University of Latvia implemented the sub-project "Digital Authoring Solutions for the Development of Learning Strategies for STEM Content Acquisition to Mitigate the Impact of Pandemic Biology I" (Identification No VISC 2023/2) of the project "Support for the Development of Individual Competences of Learners" (No 8.3.2.2/16/I/001) financed by the European Social Fund of the Ministry of Education. The aim of the project was to develop a curriculum and 105 interactive lessons for the optimal level of the core course Biology I. In order to achieve the project objectives, a pilot-survey of Latvian secondary school biology teachers was carried out to find out about the implementation of the previous Biology I programme developed by Skola 2030. The survey contained 6 demographic items, 40 Likert-style items with a 5-point scale (1 = strongly disagree to 5 = strongly agree), and 3 open-response items. It was structured in 3 parts. The first part identified the respondent's profile (gender, age, type of school, length of service and subject taught). The second part was an evaluation of the Biology I Curriculum in the context of the competence approach, focusing on the relevance of the content to the core principles of the competence approach. The third part of the study focused on the institutional, professional and personal factors influencing teacher performance. The questionnaire was placed on the QuestionPro e-platform and the snowball sampling method was used to collect respondents. 67 secondary school biology teachers participated in the pilot study (by seniority 1/2 year to 10 years - 8; 11-20 years - 14; 21-30 years - 20; 31-45 years - 25), of whom 12% were male and 88% female, predominantly aged 48% 51-65 years. As this is a pilot study and the number of respondents to the survey will increase, only descriptive statistics are offered in the data analysis. Conclusions, Expected Outcomes or Findings Content of Biology I Curriculum. Teachers consistently rate the relevance of the programme's learning outcomes (M=3.45, SD=0.80) and the use of recommended teaching methods (M=3.33, SD=0.98). Science literacy achieved (M=3.17, SD=1.10), all Big Ideas are included (M=3.14, SD=1.24) in the content of the programme. The logical sequence of biology topics and subtopics are rated average (M=2.55-2.76, SD=1.22-1.13), but below average - the total number of teaching hours is not sufficient to flexibly adapt the curriculum to students' individual needs and that the number of teaching hours is not sufficient (M=2.19, SD=1.09) for students to acquire research skills. Institutional factors. The school has a wide range of ICT facilities (M=3.55, SD=0.95), facilities for laboratory work (M=3.38, SD=1.00) and facilities for microscopy laboratory (M=3.32, SD=1.08). The distribution of responses shows that not all schools have such facilities, which is also reflected in the question on the use of sensors and computers (M=2.97, SD=1.12).There is a need for improvement of resources and materials in order to achieve all the program's results. Professional factors. Teachers lack time to develop lessons (M=2.45, SD=1.03) because they have to look for a lot of additional information (M=4.35, SD=0.72). Teachers have no problems with ensuring classroom discipline (M=4.09, SD=0.72) and they regularly conducts formative assessments (M=4.01, SD=0.76) and provides effective feedback (M=3.57, SD=0.79). Personal factors. A teacher's well-being is determined by the conditions in which they work. They receive support from the school administration and from their colleagues, both in collaborating with other teachers on cross-curricular topics, in observing their own lessons and in observing the lessons of other colleagues. Conclussion. Study confirms that teachers are successfully implementing the competence approach in Biology I, but there is a need to improve the content of Biology I curriculum and provide teachers with teaching materials and resources. References Boritz, J. E., & Carnaghan, C. A. (2003). Competency‐based education and assessment for the accounting profession: A critical review. Canadian Accounting Perspectives, 2(1), 7-42. Bowden, J. A. (2000). Competency-based education–neither a panacea nor a pariah. In Technological Education and National Development conference. Chalmers, C., Carter, M., Cooper, T., & Nason, R. (2017). Implementing “big ideas” to advance the teaching and learning of science, technology, engineering, and mathematics (STEM). International Journal of Science and Mathematics Education, 15, 25-43. https://doi.org/10.1007/s10763-017-9799-1 Cuyacot, E. P., & Cuyacot, M. T. (2022). Competency-based education: Learner’s new process for success. International Journal of Research, 11(4), 89-101. Edwards, R. (2016). Competence-based education and the limitations of critique, International Journal of Training Research, 14:3, 244-255, DOI:10.1080/14480220.2016.1254366 European Council. (2024). European Education Area. https://www.consilium.europa.eu/en/policies/education-area/ Evans, C. M., Graham, S. E., & Lefebvre, M. L. (2019). Exploring K-12 competency-based education implementation in the Northeast States. NASSP Bulletin, 103(4), 300-329. https://doi.org/10.1177/01926365198774 Evans, C. M., Landl, E., & Thompson, J. (2020). Making sense of K‐12 competency‐based education: A systematic literature review of implementation and outcomes research from 2000 to 2019. The Journal of Competency‐Based Education, 5(4), e01228. Harlen, W. (2015). Towards big ideas of science education. School Science Review, 97(359), 97-107. Hodge, S., Mavin, T., & Kearns, S. (2020). Hermeneutic dimensions of competency-based education and training. Vocations and Learning, 13, 27-46. Lassnigg, L. (2015). Competence-based education and educational effectiveness. A critical review of the research literature on outcome-oriented policy making in education. HS Sociological Series. Working Paper 111 Levine, E. & Patrick, S. (2019). What is competency-based education? An updated definition. Vienna, VA: Aurora Institute Lorente, L. M. (2023). Competency-Based Curriculum As A Strategy For STEM Education In The 21st Century. Journal of Namibian Studies: History Politics Culture, 36, 1310-1328. Makulova, A. T., Alimzhanova, G. M., Bekturganova, Z. M., Umirzakova, Z. A., Makulova, L. T., & Karymbayeva, K. M. (2015). Theory and practice of competency-based approach in education. International Education Studies, 8(8), 183-192. Nordin, A., & Sundberg, D. (2016). Travelling concepts in national curriculum policy-making: The example of competencies. European Educational Research Journal, 15(3), 314-328. OECD (2020), OECD Skills Strategy Implementation Guidance for Latvia: Developing Latvia’s Education Development Guidelines 2021-2027, OECD Skills Studies, OECD Publishing, Paris, https://doi.org/10.1787/ebc98a53-en. Skola2030 [School 2030]. (2019). Retrieved from https://www.skola2030.lv/lv (in Latvian) UNESCO (2019). Exploring STEM competences for the 21st century. 11. Educational Improvement and Quality Assurance
Paper Social skills of University Students according to Labor Market Needs: Results of a Survey 1Suranaree University of Technology, Thailand; 2Latvian Academy of Sports Education, Latvia; 3Surindra Rajabhat University, Thailand Presenting Author:In contemporary workplaces, employers increasingly value soft skills such as effective communication, teamwork, and adaptability, making it imperative to explore and understand the social skills cultivated during university education (Sa-Nguanmanasak & Khampirat, 2019; Poláková et al., 2023). Social skills, identified as pivotal employability skills for graduates, extend beyond the confines of academic knowledge, playing an instrumental role in shaping successful trajectories (Owusu et al., 2022; Thomas et al., 2023).
Recognizing their significance, higher education institutions (HEIs) have adopted a holistic approach, emphasizing the concurrent development of social skills alongside academic skills (Arhuis-Inca & Ipanaqué-Zapata, 2023; Khampirat, 2021). This strategic emphasis aligns with the multifaceted nature of success, not only in the labor market but also in personal life and future careers, as asserted by García-Álvarez et al. (2022). Within the sphere of employability, the essence of social skills lies in their transformative impact on graduates' ability to navigate a rapidly evolving professional landscape. The capacity to motivate others, a key facet of these skills, translates into effective team collaboration and leadership (Ćurlin et al., 2020; Garrote & Moser, 2021). The ability to build and maintain relationships, as highlighted by Ćurlin et al. (2020) and Garrote & Moser (2021), serves as a cornerstone for networking and collaborative endeavors. As the labor market continues to demand a workforce equipped with a diverse skill set, the trajectory of higher education is marked by an imperative to produce well-rounded individuals. Social skills, therefore, emerge as catalysts for success, influencing personal and professional growth (Shen & Wang, 2023). This comprehensive skill set becomes a hallmark of graduates prepared not only with academic proficiency but also with the interpersonal acumen and adaptability necessary for a dynamic world (Lee et al., 2024; Narimani et al., 2023; Poláková et al., 2023). The evolving landscape of work and career trajectories underscores the enduring relevance of social skills, positioning them as a linchpin in the paradigm of contemporary education and employability (Aliu & Aigbavboa, 2023). Therefore, the objective of this research proposal is to assess social skills in alignment with the requirements of the labor market. To address this objective, the study formulates the following research questions:
Q1: Which social skills align with the demands of contemporary labor markets? Q2: What is the proficiency level of social skills among Thai students? Q3: Is there a difference in social skill levels between students who have experienced internships and those who have not? Methodology, Methods, Research Instruments or Sources Used The study's design was meticulously developed, grounded in the background, problems, and objectives. It initiated from preliminary work and progressed through the five crucial stages of Social Skills Scale (SOSS) development and analysis. These stages encompassed the creation of a new scale, sample recruitment, item reduction, data collection, and the assessment of reliability and validation. An additional facet involved scrutinizing mean differences across variables such as gender, family average income, types of internships or work experiences, and duration. In Stage I, focused on items generation and selection, the primary objective was to craft a tool for assessing social skills. This phase was firmly grounded in the study's theoretical framework, an extensive literature review, and prior instruments. Utilizing insights from existing studies covering a broad spectrum of competencies, the research constructed 59 initial positive-question items. To ensure suitability for measuring SOSS for labor market needs, existing items from previous studies were selectively chosen. Stage II involved expert reviewing and a pilot study. Seven experts evaluated the initial 59-item SOSS, bringing significant workplace assessment experience. They assessed each item's quality and provided feedback to enhance appropriateness and clarity. Content validity, as judged by experts, was analyzed using the index of item-objective congruence (IOC). The final iteration of the SOSS comprised 59 items rated on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree), available in both English and Thai. The research included 955 participants from 15 universities across Thailand, presenting a diverse demographic profile. 20% were males and 80% were females. Their ages ranged mostly from 19-22 years. Ethical approval was obtained from the Ethics Committee at the University. Data collection was conducted anonymously through the use of Google Forms. Descriptive statistics were employed to understand central tendencies and variabilities in the responses, and exploratory and confirmatory factor analyses were conducted to establish construct validity. Additionally, an independent t-test was utilized to examine differences in social skills across internship experiences. Conclusions, Expected Outcomes or Findings In conclusion, the research systematically addressed three pivotal inquiries, offering invaluable insights into the social skills landscape among Thai students and their alignment with contemporary labor markets. Firstly, the study meticulously identified a comprehensive set of social skills crucial for success in today's dynamic work environments through an extensive literature review and scale development process. Secondly, by surveying 955 participants from 15 universities in Thailand, the research not only illuminated the current state of social skills but also contributed to the ongoing discourse on the role of education in fostering these competencies. Thirdly, the study investigated the impact of internships on social skill levels, revealing whether practical experiences significantly contribute to students' social skill development—a crucial aspect for educational institutions and employers alike. The expected outcomes include a detailed understanding of demanded social skills, serving as a roadmap for curriculum development, proficiency level benchmarking, and insights into the impact of internships. Importantly, the research is beyond the Thai context, with implications applicable to other countries, including European nations. Recognizing the universal value of social skills in the global job market, the identified competencies resonate across diverse cultural and economic contexts. The findings provide guidance for international educational institutions and policymakers to tailor curricula and strategies to match the social skill requirements of their respective labor markets, with specific insights into the impact of internships. References Arhuis-Inca, W., & Ipanaqué-Zapata, M. (2023). The Relationship Between Social Skills, Psychological Well-Being, and Academic Performance in University Students in Chimbote, Peru. Revista Electrónica Educare, 27(2), 1-14. https://doi.org/10.15359/ree.27-2.15848 Aliu, J., & Aigbavboa, C. (2023). Key generic skills for employability of built environment graduates. International Journal of Construction Management, 23(3), 542-552. https://doi.org/10.1080/15623599.2021.1894633 Ćurlin, T., Pejic Bach, M., & Miloloža, I. (2020). Presentation skills of business and economics students: Cluster analysis. Croatian Review of Economic, Business and Social Statistics, 6, 27-42. https://doi.org/10.2478/crebss-2020-0009 García-Álvarez, J., Vázquez-Rodríguez, A., Quiroga-Carrillo, A., & Priegue Caamaño, D. (2022). Transversal competencies for employability in university graduates: A systematic review from the employers’ perspective. Education Sciences, 12(3), 204. https://doi.org/10.3390/educsci12030204 Garrote, H. A., & Moser, O. E. (2021). The social relationships of students with intellectual disabilities in inclusive classrooms. Empirische Sonderpädagogik 13(3), 201-215. https://doi.org/10.5167/uzh-209713 Khampirat, B. (2020). The relationship between paternal education, self-esteem, resilience, future orientation, and career aspirations. PLoS One, 15(12), e0243283. https://doi.org/10.1371/journal.pone.0243283 Khampirat, B. (2021). The impact of work-integrated learning and learning strategies on engineering students’ learning outcomes in Thailand: A multiple mediation model of learning experiences and psychological factors. IEEE Access, 9, 111390-111406. https://doi.org/10.1109/ACCESS.2021.3055620 Lee, Y. A., Park, H. G., Cheon, J. E., Rice, K. G., & Kim, Y.-H. (2024). Mediating role of social skills in the longitudinal relationship between intrapersonal perfectionism and psychological well-being of preadolescents. Journal of School Psychology, 102, 101257. https://doi.org/10.1016/j.jsp.2023.101257 Narimani, M., Sahebgharan fard, M., & Nokhostin Goldoost, A. (2023). Comparing the effectiveness of the model based on progress motivation and social skills training on academic self-efficacy in students with learning disabilities. Journal of Learning Disabilities, 12(3), 91-81. https://doi.org/10.22098/jld.2023.12901.2095 Owusu, J., Hayat, N., Oppong, P. K., & Owusu-Ansah, W. (2022). Achieving entrepreneurial intention through entrepreneurial orientation, social network ties, and market intelligence generation perspectives. International Journal of Research in Business and Social Science, 11(6), 86-97. https://doi.org/10.20525/ijrbs.v11i6.1901 Pagnoccolo, J., & Bertone, S. (2021). The apprentice experience: The role of interpersonal attributes and people-related generic skills. Education + Training, 63(2), 313-327. https://doi.org/10.1108/ET-05-2020-0116 Peng, R., Abdul Razak, R., & Hajar Halili, S. (2023). Factors influencing in-service teachers' technology integration model: Innovative strategies for educational technology. PLoS One, 18(8), e0286112. https://doi.org/10.1371/journal.pone.0286112 Shen, H., & Wang, M. (2023). Effects of social skills on lexical alignment in human-human interaction and human-computer interaction. Computers in Human Behavior, 143, 107718. https://doi.org/10.1016/j.chb.2023.107718 Thomas, S., Kågström, A., Eichas, K., Inam, A., Ferrer-Wreder, L., & Eninger, L. (2023). Children’s social emotional competence in Pakistan and Sweden: Factor structure and measurement invariance of the Social Competence Scale (teacher edition). Frontiers in Psychology, 13, 1020963. |
15:45 - 17:15 | 11 SES 12 A: NW 11 Network Meeting Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Ineta Luka Network Meeting |
|
11. Educational Improvement and Quality Assurance
Paper NW 11 Network Meeting Turiba University, Latvia Presenting Author:Networks hold a meeting during ECER. All interested are welcome. Methodology, Methods, Research Instruments or Sources Used . Conclusions, Expected Outcomes or Findings . References . |
17:30 - 19:00 | 11 SES 13 A: School Education: Various Approaches to Students' Skill Development Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Daiga Kalniņa Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper Effectiveness of Ways of Working With Text Types to Increase Students' Functional Literacy NIS, Kazakhstan Presenting Author:One of the most urgent problems observed in the educational process is the low functional literacy of students. Developing functional literacy in young people is one of the planned steps in the education system in the age of modern education and technology. This is because the main indicator in the educational system is the performance of tasks based on reading literacy, which is analyzed, summarized, and evaluated at a comparative level around the world. In this regard, it is important that students can sort the knowledge and information they have acquired and apply it to their needs in life. That is why every teacher needs to form skills with professional, public, and scientific information to increase reading literacy by working with students' functional literacy tasks in their subject. Our research aims to create a person who, paying attention to the environment, not only understands the changes in the environment but also decides based on them. We sorted and interpreted the surrounding information, selected information, and considered ways to implement it. Expected result: - Pupils will be able to determine the purpose of the text and distinguish its form; - Know the basic sequence of working with text; - Make logical connections using their knowledge and ideas; - Learn to critically reflect and formulate; - Learn to evaluate the ability to use skills in life situations; - Read information selectively and think logically; - Quickly overcome difficulties and obstacles encountered in life; - Know how to solve problems and communicate in the implementation of their ideas. Functional literacy is the knowledge and skills formed by a person adapting to the social environment as a result of connecting school education and the multidisciplinary activities of a person in everyday life. The main feature of functional literacy is the ability to solve life problems based on applied knowledge in various areas of a changing society [1]. Functional literacy is considered to be the main factor contributing to lifelong learning, which overcomes the obstacles faced by people in the cultural, political, social, and economic spheres and finds solutions through creative ideas. That is why functional literacy shows the highest potential in society. This is to prevent our society from getting out of the social crisis in some directions. In the PISA program, texts on personal (30%), social (30%), educational (25%), professional (15%) topics must be selected to form public opinion in accordance with their needs in life. As PISA coordinator, Andreas Schleicher strongly supports this approach, emphasizing the importance of Pisa in providing a comprehensive assessment of how well education systems are preparing students for real challenges[6]. Another aspect to consider when developing a task should be in a system that emphasizes the search, selection, integration and interpretation of Information, Analysis and evaluation. Together with our colleagues, we discussed the topic: "how to improve the reading literacy of students?"we will discuss the issue""." We were looking for an answer to the question and conducted an informal professional conversation. During a professional conversation, we decided that the problem can be solved by changing from the level of understanding and knowledge to the level of analysis, discussion, decision-making. A series of lessons on general topics:" biodiversity"," nature protection " was developed. We planned to use graphic and mobile texts during the lesson. Why were graphic texts chosen? This is because, through a collaborative approach, it is concluded that it will be more effective to work with graphic and moving text to develop reading skills, increasing reading literacy. Methodology, Methods, Research Instruments or Sources Used According to the feedback received from the students, there were a lot of graphic and moving texts in the last tests, and due to their lack of skills in their execution, they did not have enough time, so the development of their digital literacy skills was taken into account. Working with whole and non-whole texts and counting time were our main goals. In this regard, effective ways of working with non-complete, mixed, and complex texts, such as working with a graphic text or searching for an answer from a second text using a hyperlink, were considered for the students. And how do we achieve this? Of course, in order to achieve the results, we have chosen the methods, tasks, and resources to be performed in the process of the research lesson in order to obtain social and professional information so that they are available for our research purpose. Our goal is to form a relationship with the environment, to choose a future profession, to be ready for environmental and economic conditions, and it is based on the development of a self-directed person. The main goal of reading literacy is to interpret the information received by these students and apply it according to their needs in life. Linda Darling-Hammond echoes this sentiment, advocating for education systems that prioritize equity and learning for all students, ensuring a broad range of skills and knowledge are assessed and valued, much in line with the objectives of PISA [5]. The tasks aim to identify and evaluate the information provided in the text. In most cases, the advantages and disadvantages of the problem are compared. According to the study "Critical Reading Strategies" by Professor Vincent R. Ruggiero of the State University of New York, "before reading any text and relying on the information contained in it, everyone should use a four-step critical reading strategy: review, analyze, read, and evaluate." It is recommended to use this reading strategy in order to understand the information in the text in general. We determined the influence of the students' functional literacy development on the skills of analysis, collection, and interpretation of the information obtained by the "FILA", "GROW", "FISHBONE", "SWOT" methods. And we were also considering providing space for the thinking process by making a complete analysis of the information by describing the numerical information seen by the students and the collected information by speaking with graphic texts and pictures. Conclusions, Expected Outcomes or Findings On the other hand, it is possible to get used to turning information from a whole text into a non-whole text by focusing on creative thinking such as "put it in a table, give a graph, convey the main idea with a picture". Entering the second text through a hyperlink, we integrated texts about the weather forecast with information about the environment or endangered animals into the task of searching for the answer to the question, and we worked with the moving text "find the answer to the question by visiting the link." In this regard, the grouping of geographical and biological knowledge was taken into account. We did not forget that the tasks aimed at execution by means of hyperlinks are often based on increasing the application of the knowledge gained in many other subjects in life, and the ability to search for information in accordance with the times is formed. The goal is that students should be able to use the time effectively to access the hyperlink and find the answer to the highlighted question. In tasks aimed at analyzing information in mixed texts, read and draw conclusions from different points of view and dual opinions. He can stop and compare the information he needs. This is the problem that we take into account when creating the main task and when creating open questions and interpretation and comparison questions. In order to create conditions for that, it is necessary to appropriately use questions at the level of constant analysis, application, and evaluation of the thinking process [4]. If the human world is functionally literate in the period of rapid development of technology in modern life, a person who is inclined to live and who can effectively use the acquired knowledge will be formed. References 1. International program PISA 2000, M.: Center for Quality Assessment of Education, IGSE RAE, 2003, p. 8 2. Methodological guide for the formation of reading literacy among students Nur Sultan-2020 3. Rozhdestvenskaya L., Logvinova I. Formation of functional reading skills. Teacher's manual. [Electronic resource]. URL: https://slovesnic.ru/attachments/article/303/frrozhdest.pdf 4. PISA Test Questions/URL: http://www.oecd.org/pisa/pisaproducts/pisa-test-questions.html 5. Darling-Hammond, Linda. "The Flat World and Education: How America's Commitment to Equity Will Determine Our Future," Teachers College Press, 2010. 6. Schleicher, Andreas. "PISA 2018: Insights and Interpretations," OECD, 2019. 11. Educational Improvement and Quality Assurance
Paper Predictors of Schoolchildren's Agency: a Multilevel Model Higher School of Economic, Russian Federation Presenting Author:The contemporary "Age of Uncertainty” requires the ability to respond effectively to global challenges, such as climate change, economic instability and inequality, human rights violations, military-political conflicts, and pandemics, and others. In this context, the task of the formation of agency, that is, the ability to act and transform the surrounding reality, to make decisions and take initiative in various contexts and spheres of public and personal life without external control or support is becoming increasingly important for education systems (Manyukhina, 2022; Sorokin & Froumin, 2022). Agency is defined as the ability of an individual to act, exercising control over his/her life, the ability to set and achieve goals (Cavazzoni et al., 2021), proactively influence the environment, including the transformation of existing and the creation of new forms of interaction in various spheres of public life (Udehn, 2002). Agency is expressed in the ability to be an active participant, guiding and shaping one's life path (Schoon & Cook, 2021). It also implies the optimization of resources, overcoming or transforming constraints on the way to achieve self-set goals (Zimmerman & Ceary, 2006), both in individual subjective reality and in objective social reality. The variety of approaches to the definition of agency and the difficulties in unifying the methodology for measuring this construct are primarily due to its multidimensional (umbrella) character (Schoon & Cook, 2021; Schoon & Неckhausen, 2019). Education is extremely important from the point of view of the agency formation. The construct of agency is based on two components (Cavazzoni et al., 2021; Abebe, 2019; Veronese et al., 2019): personal characteristics ("self-efficacy", "personal autonomy", "optimism”, “self-esteem”, "internal locus of control"), and structural capabilities (socio-economic conditions, the territory of residence, the role of family, and the formal requirements of the institutions). This idea helps to understand the role of education in the formation of appropriate qualities and skills of schoolchildren in the learning process (Manyukhina, 2022). It is noted that institutional and pedagogical practices can contribute either to the expansion or limitation of the manifestation of agency (Ruscoe et al., 2018; Sirkko et al., 2019; Kirby, 2019). At the same time, educational practices that are implemented outside strictly formal school education, including the participation of schoolchildren in extracurricular activities and private lessons, can acquire special importance from the point of view of the formation of proactive behavior. A number of studies have shown that extracurricular activities make a significant contribution to the formation of such qualities as perseverance, independence, self-confidence, creativity, and social activity (Baker, 2008; Durlak, Weissberg, Pachan, 2010; Baharom et al., 2017). The students who study privately tend to practice longer, "smarter," and more efficiently as they establish practice objectives, maximize time and concentration through shorter but generally more productive practice segments (Hamann, Frost, 2000). At present, literature lacks tools for assessing agency of children and adolescents comprehensively, in various spheres of manifestation (Sorokin, Froumin, 2022; Cavazzoni, 2021). Also, there are no general models allowing to correlate different types and levels of children’s agency with individual and structural factors, including educational practices. The purpose of this study was to search for predictors of schoolchildren’s agency at the individual and school levels. Research questions: - What are the individual characteristics of students (gender, age, socioeconomic status, parental level of education, participation in private lessons, and extracurricular activities) are significant predictors of the agency level? - What significant predictors of agency level can be found at the school level (number of students, number of young teachers, proportion of students with low/high socioeconomic status, and others)? - How does the significance of these predictors change when they interact with each other? Methodology, Methods, Research Instruments or Sources Used The data were obtained as a result of the survey of students in grades 4 to 8 (N = 4,603; Mage = 12.4, SD = 1.46; 49.7% female) conducted in 2022 in Yaroslavl, Russia. The population of Yaroslavl is about 600,000 people. The sample is representative of urban schools: a random stratified selection of schools was carried out, taking into account their size as a characteristic of the socio-economic status of an educational organization. A total of 31 schools were selected for the study. Among the study participants, 48.6% noted that the mother or stepmother has tertiary education, and 31.26% of the respondents have both parents with tertiary education. Next, 37.8% of the respondents have a father or stepfather with tertiary education. At the same time, 0.8% of the respondents noted that they do not have "this parent – mother or stepmother," and 5.8% of the respondents – "there is no parent – father or stepfather." Thus, it can be argued that the vast majority of the study participants live in full families, and 48.8% of the respondents live with a brother or sister. More than half of the respondents (65%) attend some extracurricular activities. Slightly more than a quarter of schoolchildren (28.7%) take private lessons. The questionnaires had special section aimed at assessing proactive behavior (agency). In particular, the respondents were asked whether their parents participated in choosing of extracurricular activities (or the decision was made solely by a child him- or herself), whether they tend to take the initiative and make decisions about everyday activities in the company of peers, how the decisions are made about joint activities with parents, and where from they obtain most of the money for their personal expenses (for instance, do they have a paid working experience). The respondents' responses for each category were ranked and as a result, a total integral indicator (agency index) was calculated, i.e., the level of agency for each respondent. Finally, the linear mixed regression model predicting the agency Index was built. The model encompassed both individual and school-level predictors and their interactions. Conclusions, Expected Outcomes or Findings At the individual level, several predictors were found to be significant. Age positively predicted the Agency Index (B = 0.11, SE = 0.01, p < .001), meaning that as the age of the participants increased, their agency index scores also tended to be higher. Parents’ educational level, particularly the mother’s, was also a significant predictor of the Agency Index (B = 0.08, SE = 0.04, p = .033). Participation in private lessons (PL) and extracurricular activities (PEA) both were associated with a higher Agency Index (PL: B = 0.38, SE = 0.05, p < .001; PEA: B = 0.79, SE = 0.04, p < .001). However the students who took private lessons and also participated in extracurricular activities had a slightly lower Agency Index compared to those who only participated in extracurricular activities. At the school level, the number of young teachers was a significant predictor (B = 0.04, SE = 0.01, p < .001), suggesting that schools with more young teachers tend to have students with higher agency index scores. Other school-level predictors were not statistically significant. Cross-level interaction effects revealed a significant interaction between participation in extracurricular activities and the number of young teachers (PEA × Number of young teachers: B = -0.05, SE = 0.01, p < .001), indicating that the positive effect of extracurricular activities on the Agency Index decreased as the number of young teachers in a school increased. That is, schools with more young teachers had a reduced benefit of extracurricular activities for the Agency Index, whereas those with fewer young teachers had a more pronounced benefit. However, the Agency Index appears to be mainly an individual-level phenomenon, with only a minor portion of its variance being explained by differences between schools. In more detail the results will be presented on the Conference. References Baharom M. N., Sharfuddin M., Iqbal J. (2017) A Systematic Review on the Deviant Workplace Behavior. Review of Public Administration and Management, 5(3), 1–8. Baker C. N. (2008) Under-Represented College Students and Extracurricular Involvement: The Effects of Various Student Organizations on Academic Performance. Social Psychology of Education, 11(3), 273-298. Cavazzoni, F., Fiorini, A., & Veronese, G. (2021). How Do We Assess How Agentic We Are? A Literature Review of Existing Instruments to Evaluate and Measure Individuals' Agency. Social Indicators Research, 159(3), 1125-1153. Durlak J. A., Weissberg R. P., Pachan M. (2010) A Meta-Analysis of After-School Programs that Seek to Promote Personal and Social Skills in Children and Adolescents. American Journal of Community Psychology, 45(3). P. 294-309. Hamann D.L., & Frost, R.S. (2000). The Effect of Private Lesson Study on the Practice Habits and Attitudes Towards Practicing of Middle School and High School String Students. Contributions to Music Education, 27(2), 71–93. Kirby, P. (2019). Children’s agency in the modern primary classroom. Children & Society, 34(1), 17–30. Manyukhina, Y. (2022). Children’s agency in the National Curriculum for England: a critical discourse analysis. Education 3-13, 50, 506–520. Ruscoe, A., L. Barblett, and C. Parrath-Pugh. (2018). Sharing power with children: repositioning children as agentic learners. Australasian Journal of Early Childhood, 43(3), 63–71. Schoon, I., & Cook, R. (2021). Can individual agency compensate for background disadvantage? Predicting tertiary educational attainment among males and females. Journal of Youth and Adolescence, 50(3), 408–422. Schoon, I., & Heckhausen, J. (2019). Conceptualizing individual agency in the transition from school to work: a socio-ecological developmental perspective. Adolescent Research Review, 4(4), 135–148. Sirkko, R., Kyrönlampi, T., and Puroila, A. M. 2019. Children’s agency: opportunities and constraints. International Journal of Early Childhood, 51(3), 283–300. Sorokin P. S., Froumin I. D. (2022) Education As a Source for Transformative Agency: Theoretical and Practical Issues. Voprosy Obrazovaniya / Educational Studies Moscow, 1, 116-137. Udehn L. (2002) The Changing Face of Methodological Individualism. Annual Review of Sociology, 28(1), 479–507. Veronese, G., Pepe, A., Cavazzoni, F., Obaid, H., & Perez, J. (2019). Agency via life satisfaction as a protective factor from cumulative trauma and emotional distress among bedouin children in Palestine. Frontiers in Psychology, 10, 1674. Zimmerman, B. J., & Cleary, T. J. (2006). Adolescents’ development of personal agency. In F. Pajares, & T. Urdan (Eds.), Adolescence and Education (Vol. 5): Self-Efficacy Beliefs of Adolescents, 45-69. |
Date: Friday, 30/Aug/2024 | |
9:30 - 11:00 | 11 SES 14 A: Quality Assurance: Improving the Quality of Secondary Schools Location: Room B109 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [-1 Floor] Session Chair: Mudassir Arafat Paper Session |
|
11. Educational Improvement and Quality Assurance
Paper An Exploration of Supporting teachers’ Assessment Literacy in School to School Support Context: A Chinese Case Study 1Beijing Normal University, China; 2Tiangong University, China Presenting Author:Introduction Recent changes in education policy emphasize promoting school-to-school support and school-led improvement to enhance resource sharing and build a professional learning network for high-quality and balanced education (Ainscow et al., 2006; Muijs, 2015; Muijs et al., 2010; Liu, 2018). In China, the government encourages prestigious public schools to support weaker public schools, with supporting teachers sent from prestigious schools to implement improvement missions. Existing studies have focused on the willingness of supporting teachers to rotate to weaker schools and its influencing factors (e.g., Du et al., 2018; Zhang et al., 2023), with limited research on how these teachers undertake the support work (e.g., Zhong et al., 2018; Zhang & Ye, 2023; Qian et al., 2023). The assessment culture differences between supporting and weaker schools greatly influence the process and assessment of school improvement. The supporting schools and teachers often represent a student-centered educational philosophy, in line with the Chinese new curriculum reform, while weaker areas often focus on test and score-oriented education. However, little research exists on how supporting teachers actively engage in assessment reform to promote teaching and learning reform in supported schools. Therefore, this paper aims to explore how supporting teachers employ their assessment literacies to foster teaching and learning reforms in the schools they support and the strategies they use to span across boundaries. Boundary spanning practice and boundary object The concept of 'boundary spanning' arises when individuals venture into unfamiliar territory and must navigate and merge elements from different contexts to create hybrid situations (Engeström et al., 1995). Those who engage in this practice are known as boundary spanners, connecting various communities of practice and facilitating relationships between them (Wenger, 1998). Their activities involve establishing routines that uphold connections between different communities of practice or stakeholders and providing a platform for ongoing engagement in professional activities. To achieve this, leaders may utilize boundary objects (Star and Griesemer, 1989) , which are tangible items or artifacts that exist within multiple communities of practice, serving as a means of translation within multi-site work relations and requirements. The role of individuals as boundary spanners requires the ability to manage and integrate diverse discourses and practices across social boundaries. Additionally, educational infrastructure is essential to foster interactions and networks across schools or communities of practice, support boundary practices, and sustain improvement (Spillane et al., 2016). Teacher assessment literacies framework Assessment is a vital element in education, impacting teaching and learning. Teachers' assessment literacy involves understanding the assessment process, the interaction between assessment and teaching, and the ability to conduct assessments effectively (Stiggins, 1991). The focus has shifted towards "assessment for learning," emphasizing teachers' ability to review students' learning and performance data and develop programs that support student learning. Teacher assessment literacy is a dynamic and context-dependent social practice, involving the articulation and negotiation of classroom and cultural knowledge to achieve student learning goals through assessment (Adie et al., 2020; Ataie-Tabar et al., 2019; Baker & Riches, 2018; Schneider, Deluca, Pozas & Coombs, 2020; Willis et al. 2013). Scholars have redefined the framework of teacher assessment literacy, emphasizing aspects such as selecting appropriate assessment methods, interpreting results, providing student guidance, and using assessments for instructional design and school improvement (Brookhart, 2011). There is also a growing emphasis on the ethical dimensions of teacher assessment, including managing ethical conflicts, upholding fair assessment ethics, and addressing student cheating (Pope et al., 2009; Pastore et al., 2019).
Methodology, Methods, Research Instruments or Sources Used Method This paper seeks to understand the supporting teachers' assessment initiatives in recipient schools, employing a qualitative research approach. The Research site The study will based on the educational support of School Z to School X. School Z, located in a the capital city in China, is at the forefront of national and global education reform, with a focus on using assessment to enhance learning and promote core competencies. In contrast, recipient School X, situated in a province that lags behind in national curriculum reform, emphasizes score-oriented teaching and lacks integration of teaching and assessment. The school also faces challenges such as large class sizes, shortage of professional teachers, and limited assessment feedback to guide and motivate learning. The contrasting assessment cultures at School Z and School X represent the two poles of the integration of teaching and assessment in Chinese schools. Studying how supporting teachers from School Z conducts assessment reforms at School X can provide valuable insights into inspiring improvement. Data collection Z School's support for X School began in March 2018, with 12 supporting teachers dispatched in September of the same year. The first author established a partnership with the team from the start and actively participated in and witnessed most of the support work, collecting data through participatory observation, interviews, and material collection. Participatory Observation: The author visited X School on three occasions, observing classroom lessons, participating in teaching research, and taking part in the selection of teaching innovation awards and X School's guidance on promoting teachers' development through subject research. Interviews: Formal and informal interviews were conducted with the support team, the director of local education bureau, the leadership of X School, and teachers at X School who actively responded to the reforms. Materials Collection: Textual materials were collected, including systems and measurement standards developed by the assistance team, updates on the school's WeChat platform, application materials for the school-based Teaching Innovation Award, and project proposal documents. This also includes reports from the assistance team and assisted school teachers on various occasions. Data analysis This study is rich in data. Researchers focused on data closely aligned with the research question, conducting preliminary data selection based on relevant data. Further data selection was carried out around major themes, and the extracted data was then summarized to ensure unique insights into teacher assessment reform in the context of China's assistance. Conclusions, Expected Outcomes or Findings Conclusions The study found that supporting teachers at X School conducted the following work to build an assessment for learning culture: Established clear curriculum development objectives to guide students' learning. Expanded teachers' understanding of assessment, diversified assessment methods, and enhanced formative assessment. Fully utilized the educational function of homework. Actively developed students' self-assessment ability. Actively implemented "focus on every student's learning, treat every student fairly and justly" assessment ethics. Led stakeholders to establish a unified assessment philosophy. Built the infrastructure support required for assessment reform. The findings are consistent with international discussions on the teacher assessment framework, emphasizing assessment to enhance learning, the integration of teaching and assessment, core quality and competency-based learning assessment, students' self-assessment, and respect for students. The support team also identified a dimension that has not been mentioned in the international literature. This dimension involves developing the mindset of parents and other education stakeholders towards assessment for learning, with the aim of reforming the local assessment culture. To promote a change in mindset, supportive teachers utilized various boundary objects, such as reallocating and decorating school spaces, developing guidelines for teaching and assessment, and reporting school activities from a student-centered perspective. The study also found that different supporting teachers did not adopt the same strategies for assessment practice. They engaged in collaborative discussions and combined individual exploration with their understanding of their teaching subject, teaching characteristics, and prior educational experiences. This personalized exploration fostered professional learning and development. The study suggests that teacher education should prioritize the development of teachers' skills in promoting learning through assessment. The current implementation of "Assessment to Promote Learning" still requires strong top-down support in the context of the new era. References Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practice, 30(1), 3-12. Du, P., Zhang, Y., Ye, J. (2018). Analysis of Teacher's Willingness for Job Rotation Exchange from the Perspective of Push-Pull Theory: A Survey in a District of Beijing. Educational Development Research, 38(04), 37-44. Engeström, Y., Engeström, R. & Kärkkäinen, M. (1995) Polycontextuality and boundary crossing in expert cognition: Learning and problem solving in complex work activities. Learning and Instruction. 5(4), 319-336. Liu, J. (2018) Constructing resource sharing collaboration for quality public education in urban China: Case study of school alliance in Beijing, International Journal of Educational Development, 59, 9-19. Muijs, D., West, M., Ainscow, M. (2010). Why network? Theoretical perspectives on net working. School Effectiveness and School Improvement, 21 (1), 5-26. Muijs, D. (2015). Improving schools through collaboration: a mixed methods study of school-to-school partnerships in the primary sector. Oxford Review of Education. 41 (5), 563–586. Pope, N., Green, S., Johnson, R.. & Mitchell, M. (2009). Examining teacher ethical dilemmas in classroom assessment. Teaching and Teacher Education, 25, 778-782. Pastore, S.; Andrade, H. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138. Qian, H., Walker, A., Zheng, Y. (2023). Boundary-spanning practices of system leaders in China: Enabling conditions and inherent tensions, Educational Management Administration & Leadership,1-20. Star, S. & Griesemer, J.R. (1989). Institutional ecology, “translations” and bound ary objects: amateurs and professionals in Berkeley’s museum of vertebrate zoology, 1907-39. Social Studies of Science 19(3), 387–420. Spillane, J., Shirrell, M. & Hopkins, M. (2016). Designing and deploying a professional learning community (PLC) organizational routine: bureaucratic and collegial arrangements in tandem. Le Travail Collectif Des Enseignants 35, 97-122. Stiggins, R. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534-539. Wenger, E. (1998). Communities of Practice: Learning, Meaning and Identity. Cambridge, UK: Cambridge University Press. Zhong, Y., Ye, J., & Lo, Nai-kwai. (2018). Learning leadership beliefs, behaviors, and influences of teachers in job rotation exchange: A survey based on District Z in Beijing. Educational Development Research, 38(04), 51-58. Zhang, J., Ye, J., Wang, J. (2023). The Effects and Implementation Mechanism of Teacher Exchange and Rotation: An Empirical Analysis Based on Three Mobility Paths. Journal of Educational Studies, 2, 129-143. 11. Educational Improvement and Quality Assurance
Paper Quality Assurance with Learning Analytics in Secondary Education: A Systematic Literature Review on Affordances and Constraints 1Vrije Universiteit Brussel, Belgium; 2Universidad de Valladolid, Spain; 3INVALSI, Italy; 4Dublin City University, Ireland Presenting Author:Quality assurance (QA) in education has become increasingly decentralised in many European countries over the past decades, making schools increasingly responsible for the monitoring, safeguarding and development of their own quality. Although the main concern of quality assurance in schools is to develop the quality of teaching and learning; different, more school-level approaches to QA can be taken, for instance by drawing on a distinction between external and internal evaluation (Eurydice, 2015). Although quality assurance mechanisms are embedded in educational systems’ regulations, several initiatives and evolutions overarch the differences across jurisdictions in Europe. The European Commission’s Education and Training working group, for instance, points towards the need for capacity building in quality assurance processes (European Commission, 2018). This capacity building is linked primarily to the pursuit of evidence-informed quality assurance in schools (Brown & Malin, 2022). As part of their (internal) evaluation procedures and quality development, schools are stimulated to make use of different sources of evidence (Wiseman, 2010) to further develop their quality and inform their decision making. Following the digital transformation in education, huge amounts of digital resources and data have been introduced and proliferated in schools for (re)designing and evaluating education, for instance through the introduction of digital learning management systems and Learning Analytics (LA). LA assess, elicit and analyse static and dynamic information about learners and learning environments for the optimisation of learning processes and environments, as well as for educational decision making in organisations (Ifenthaler & Drachsler, 2020; Rodríguez-Triana, Martínez-Monés, & Villagrá-Sobrino, 2016). Despite its potential, the actual use of LA is still rather scarce in K-12 education compared to the context of higher education (Andresen, 2017; Gander, 2020). Existing literature focused on higher education points to organisational readiness, (Clark et al., 2020), characteristics of data(systems), the ethical issues around the use of LA (Cerratto Pargman & McGrath, 2021; Tzimas & Demetriadis, 2021), and staff readiness (Mandinach & Abrams, 2022) to play an important role in the successful use of LA. In K-12 education, however, LA are currently primarily used at the micro level to identify learners’ needs and tailor instruction to meet these needs (Wise & Jung, 2019). The use of LA by educational professionals, f.i. at the school (management) level, has therefore not yet reached its full potential. This could be due to the fact that K-12 students are mostly minors and even more pressing ethical considerations and caution in the use and processing of learning analytics data are at play. Furthermore, the way secondary schools are organised is very different from higher education. However, the fact remains that schools’ own data regarding learning processes remain largely un(der)explored (Ifenthaler, 2021) due to, i.e., lack of awareness of the vast amount of data available and a lack of capacity to work with these data (Datnow & Hubbard, 2016; O’Brien, McNamara, O’Hara, & Brown, 2019). In this contribution, we present a systematic literature study conducted as part of a larger Erasmus+ KA project titled ‘QUALAS’ (Quality Assurance with Learning Analytics in Schools), which aims to promote capacity building in secondary schools in Flanders (Belgium), Ireland, Italy and Spain to use (different) LA data for quality assurance (QA); according to the key principles for QA put forward by (European Commission, 2018). Our overall aim is to identify and put into practice possibilities for enhancing the capacity of educational professionals in secondary schools to make appropriately use of learning analytics for quality assurance. As a first step, we addressed the following research question: what affordances and constraints does existing literature identify for the use of learning analytics in the context of quality assurance in secondary education? Methodology, Methods, Research Instruments or Sources Used This systematic literature review was conducted as a rapid narrative summary, following the guidelines provided by Amog et al. (2022). It concerns a qualitative review based on the fixed research question mentioned above, which paid no specific attention to the role of theory in the selected studies and made use of purposive sampling. Due to time constraints (as this review presents the first step in the first phase of our overall project), the review concerned a limited number op studies, by: searching by specific years (2011-2023), databases (ScienceDirect, Scopus, Web of Science and EBSCOhost), language (English), and sources (scientific papers). While only one reviewer conducted the title and abstract reviewing, the full text review was conducted jointly by all partners to minimise potential bias (Ganann, Ciliska & Thomas, 2010). Additionally, the review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) protocol by Moher et al., 2020 for developing and conducting the search strategy, selection, analysis synthesis and assessment. The review contained 40 papers that met our criteria for inclusion and exclusion. The criteria for inclusion were: articles written in English within the time span of 2011-2023, and discussing the context of secondary education. Exclusion criteria were: papers only discussing LA in the context of higher education or post-secondary education, papers only mentioning LA as a keyword or descriptor but not studying LA or LA use in or for schools (e.g. by teachers, school leaders, school staff, students, etc.), or studies following (quasi-)experimental designs that only mentioned a form or resource of LA as a means of research data collection without coupling LA to school use by educational professionals or without embedding them in teaching and school practices. The appraisal (coding) of the selected studies was conducted according to the following categories: • Thematic grouping according to: focus on effectiveness or user experiences • Forms or elements of capacity building mentioned • Type of study: empirical, theoretical, review, etc. • Meta data Additionnally, our focus on affordances and constraints for QA was translated to adopting QA as the main coding category for the selected studies. This category included the following themes or sub-categories:- • Function of LA use: accountability, improvement, etc. • Level of LA use: school, team, teacher, students • Type of LA data: descriptive, diagnostic, predictive, prescriptive • Quality of processes, outputs, inputs, or contextual factors Conclusions, Expected Outcomes or Findings Overall, our review confirms the observation made by Hernandez-Leal et al.(2021) that the vast majority of studies concerning LA in secondary education are usually focusing on experimentation with specific techniques or methods (flipped learning, serious games, dashboards, etc.) providing specific types of LA applied as research methods for data collection. Moreover, these are often applied in a very restricted manner, e.g. within a specific subject area or discipline (robotics, language learning, programming, etc.). In response to our research question, we identified a large number of both affordances or opportunities, and constraints or challenges linked to the use of learning analytics for quality assurance in secondary schools. Four main categories can be discerned: 1) Teacher and school staff characteristics (perceptions, intentions, behaviour, data literacy and digital competence, technology acceptance, confidence, pedagogical content knowledge, etc.) 2) School culture: quality of communication, decision making, provision of support, school policy-making and governance, reflexivity and assessment practices, social structures, etc. 3) LA characteristics: private vs. public stakeholders, potential for co-design and inquiry, materiality and accessibility, design, human-technology interactions, etc. 4) Concerns: privacy and ethics, student protection, teacher professionalism and educational marketisation Overall, we find little explicit connections between quality assurance and LA. However, the affordances and constraints we identified for the use of LA for QA in secondary schools, largely mirror those identified in the existing literature on LA in higher education. However, privacy and ethical concerns appear to be even more fundamental in the context of the use of LA for QA in secondary schools. Moreover, LA are generally considered a supplement and aid to the teaching processes, professional judgements and decision-making on the part of educational stakeholders and are approached with due caution; whereas their potential as a means of improving the quality of learning processes and outcomes, is generally assumed and promoted. References Amog, K., Pham, B., Courvoisier, M., Mak, M., Booth, A., Godfrey, C., Hwee, J., Straus, S.E. & Tricco, A.C. 52022). The Web-based "Right Review" tool asks reviewers simple questions to suggest methods from 41 Knowledge Synthesis methods. Journal of Clinical Epidemiology, 147, 42-51 Datnow, A., & Hubbard, L. (2016). Teacher capacity for and beliefs about data-driven decision making: A literature review of international research. Journal of Educational Change, 17(1), 7-28. doi:10.1007/s10833-015-9264-2 European Commission. (2018). Quality assurance for school development. Guiding principles for policy development on quality assurance in school education. Retrieved from Brussels: Eurydice. (2015). Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Retrieved from Luxembourgh: Ganann, R., Cilisk, D. & Thomas, H. (2010). Expediting systematic reviews: methods and implications of rapid reviews. Implementation Science, 5(56), 1-10 Hernandez-Leal, E., et al. N. D. Duque-Mendez and C. Cechinel (2021). Unveiling educational patterns at a regional level in Colombia: data from elementary and public high school institutions. Heliyon 7(9), 1-17. Ifenthaler, D. (2021). Learning analytics for school and system management. OECD Digital Education Outlook 2021 Pushing the Frontiers with Artificial Intelligence, Blockchain and Robots: Pushing the Frontiers with Artificial Intelligence, Blockchain and Robots, 161. Ifenthaler, D., & Drachsler, H. (2020). Learning analytics. O’Brien, S., McNamara, G., O’Hara, J., & Brown, M. (2019). Irish teachers, starting on a journey of data use for school self-evaluation. Studies in Educational Evaluation, 60, 1-13. doi:https://doi.org/10.1016/j.stueduc.2018.11.001 Rodríguez-Triana, M. J., Martínez-Monés, A., & Villagrá-Sobrino, S. (2016). Learning Analytics in Small-Scale Teacher-Led Innovations: Ethical and Data Privacy Issues. Journal of Learning Analytics, 3(1), 43-65. Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53–69-53–69. Wiseman, A. W. (2010). The uses of evidence for educational policymaking: Global contexts and international trends. Review of research in education, 34(1), 1-24. 11. Educational Improvement and Quality Assurance
Paper The Interaction of Quality, Quality Assurance and Evaluation on School Units in the Field of Educational Leadership: a SEM Approach. University of Aegean, Greece Presenting Author:The aim of this proposal is to explore how quality, quality assurance and evaluation of school units are connected in the field of school leadership More specifically, the intention is to examine the possibility of making a structural model that examines the interaction being developed between these concepts. The implementation of quality assurance systems is one of the cornerstones of any educational system, while at the same time is being understood as a way to improve the quality of school units (Buzdar & Jalal, 2019). More specifically, the quality assurance of school units is a mechanism to ensure the provision of high-quality education, to identify and solve problems in the educational system in order to improve its quality. On the other hand, information is collected about the quality of the education provided (European Commission, 2020; Alaba, 2010). Within the framework of quality assurance of school units, quality should be ensured for the main stakeholders of the educational process. The adoption of quality assurance procedures in school units has many advantages, such as the establishment of high standards, the improvement of educational results, the recognition of the strengths and weaknesses of the educational system (Alaba, 2010). Moreover, improving the quality of education is the first strategic objective set by the Council of the European Union for the period 2021-2030 (2021/C 66/01). As it is concluded from the above the quality assurance of school units is aimed at ensuring that the objectives set are achieved and includes, among other things, evaluation procedures (Onuma & Okpalanze, 2017). Evaluation of school units is a key component of quality assurance (Eurydice, 2004) and these two concepts appear to be directly linked, as evaluation is one of the procedures that can be used to ensure the quality of schools in conjunction with others, such as the monitoring of the educational system or even the evaluation of teachers (Euridice, 2015). The association of school quality assurance with school evaluation has been a major topic for many researchers (Gardezi et al., 2023; Onuma & Okpalanze, 2017), but no model of their interaction has been proposed so far. School leadership is a key factor of quality education in schools as it affects school operations in many ways (Anastasiadou & Anastasiadis, 2019). However, the role of school leadership is also crucial for the quality assurance systems used to support schools (Afriadi et al., 2023). More specifically, school leadership has a positive direct impact on quality assurance (Hartati et al., 2019), whereas there is a direct and indirect effect of leadership on quality (Bellibaş et al., 2020). This intercorrelation can create a dynamic organizational entity with novel opportunities (Shattuck & Olcott, 2022). Last but not least, school leadership has become a critical factor for school evaluation in the effort of making schools more autonomous and more accountable as required in recent years (Pont, Nuche & Moorman, 2008). Methodology, Methods, Research Instruments or Sources Used The present research is part of a broader study, which refers to how greek teachers perceive the concepts of quality assurance as well as quality and evaluation of school units. For the needs of the survey a questionnaire was constructed based on the quality indicators that had been the subject of scientific publications in Greece in the last 20 years. The questionnaire was submitted either direct or through e-mails between the time period of May 2021 and April 2022. The sample of the survey consisted of 1095 teachers from public as well as private schools, where 51.9% of the sample was working in primary education and 48.1% in secondary education. Finally, the 82.6% of the sample was working in public schools and respectively the 17.4% in private schools. In the beginning, Exploratory and Confirmatory factor analysis was applied in order to create the model. More specifically, exploratory factor analysis was applied to investigate the factor structure of the scales, as there was no ready-made theoretical model. Confirmatory factor analysis was performed to test whether the data fit the hypothesized measurement model. Additionally, the Cronbach's index was used as a reliability measure, which in all cases was above 0.70. The adequacy of the sample was examined with the statistical index of the Kaiser-Mayer-Olkin Measure of Sampling Adequacy (KMO) and the index of sphericity (Barlett's test of sphericity). Last but not least, two significant criteria were taken into account for the adaptation or creation of the scales: a. the percentage of the total variance explained and b. the item loadings of each factor. Therefore, the correlation index of each question with the final result was verified. The method used was the Maximum Likelihood Estimate (MLE). The structural model to examine the three concepts was done using the Structural Equation Modeling. Some indicators were used to assess the good adaptation of the metric and the structural model: the statistical criterion x2 (p >.05), the CMIN/DF index (≤ 3), the CFI indicator (≥ 0, 90), the SRMR index (& ≤ 0, 08) and the RMSEA index (< 0, 08). Finally, the excellence of the final model in terms of reliability, convergence validity and discriminant validity was ensured by the values of Composite Reliability (CR), Average Extracted Variance (AVE), and the Maximum Shared Variance (MSV). Conclusions, Expected Outcomes or Findings The final Structural Model is supported by indicators that indicate excellent fit. The interpretation of the structural model in the field of the school leadership validates scientifically that the quality objectives significantly affect the objectives of quality assurance (b=0.807, p<.001), which in turn affect the evaluation objectives (b=0.690, p <.001). This finding is considered very important, as no corresponding effect has been identified in another survey. An additional important finding of the proposal is that the school unit quality targets appear to have a negligible impact on the level of education of teachers in terms of school unit assessment (b=0.058, p<.01) and on the degree of education for teachers in terms of the quality assurance of school units (b=0.065, p<.05). Accordingly, it is observed that the degree of training of teachers on the evaluation does not seem to have a great influence on the assessment itself (b=0.108, p<.001), while a major, also, finding is that the level of education of teachers on quality assurance significantly affects the degree to which teachers are educated on the issues of evaluation (b=0.791, p<.001). In conclusion, an interaction was found among the objectives for the quality of school units, their quality assurance and their evaluation, as a direct effect was detected between these concepts. In addition, interesting implications emerged, such as the importance of teacher training in quality assurance and the evaluation of school units. References •Afriadi, B., Fatkar, B., Mirza, M., Fitri, F., Nur, M., Sobirov, B., & Colega Oli, M. (2023). Systematic Review of Education Quality Assurance Management in schools method matching. International Education Trend Issues, 1(2), 58–66. https://doi.org/10.56442/ieti.v1i2.146 •Alaba, S. O. (2010). Improving the standard and quality of primary education in Nigeria: A case study of oyo and Osun States. International Journal for Cross-Disciplinary Subjects in Education, 1(3), 156–160. https://doi.org/10.20533/ijcdse.2042.6364.2010.0021 •Anastasiadou, S., & Anastasiadis, L. (2019). Quality Assurance in Education in the Light of the Effectiveness of Transformational School Leadership. In N. Sykianakis, P. Polychronidou, & A. Karasavvoglou (Eds.), Economic and Financial Challenges for Eastern Europe (pp. 323–344). Chapter, Springer. •Bellibaş, M. Ş., Gümüş, S., & Liu, Y. (2020). Does school leadership matter for teachers’ classroom practice? The influence of instructional leadership and distributed leadership on instructional quality. School Effectiveness and School Improvement, 32(3), 1–26. https://doi.org/10.1080/09243453.2020.1858119 •Buzdar, M. A., & Jalal, H. (2021). Quality enhancement, teaching quality, and students perceived satisfaction: challenges and perspectives in higher education. Research Journal of PNQAHE, 2(2), 1–13. •Council Resolution on a strategic framework for European cooperation in education and training towards the European Education Area and beyond (2021-2030) 2021/C 66/01. (2021). Official Journal, C 66, 1-21. CELEX: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32021G0226(01)[legislation] •European Commission, Directorate-General for Education, Youth, Sport and Culture, (2020). Supporting school self-evaluation and development through quality assurance policies: key considerations for policy-makers: report by ET2020 Working Group Schools, Publications Office. https://data.europa.eu/doi/10.2766/02550 •Eurydice . (2004). Evaluation of Schools providing Compulsory Education in Europe. Belgium. •Eurydice. (2015). Assuring quality in education – Policies and approaches to school evaluation in Europe. Luxembourg •Gardezi, S., McNamara, G., Brown, M., & O’Hara, J. (2023). School inspections: A rhetoric of quality or reality? Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1204642 •Hartati, S., Matin, M. M., & Talib Bon, A. (2019). The Influence of Leadership on Academic Quality Assurance at the Private Nursing Vocational Schools. Proceedings of the International Conference on Industrial Engineering and Operations Management, 23–25. •Onuma, N., & Okpalanze, N. P. (2017). : 10.5829/idosi.mejsr.2017.1695.1714 Assessment of Quality Assurance Practices in Secondary Schools in Enugu State Nigeria. Middle-East Journal of Scientific Research, 25(8), 1695–1714. https://doi.org/10.5829/idosi.mejsr.2017.1695.1714 •Pont, B., Nuche, D., & Moorman, H. (2008). (rep.). Improving School Leadership. Volume 1: Policy and Practice. OECD. •Shattuck, K., & Olcott, D. (2022). The Synergy of Leadership, Quality, Policy, Change: Opportunities and Tensions. American Journal of Distance Education, 36(1), 1–2. https://doi.org/10.1080/08923647.2022.2036550 |
Contact and Legal Notice · Contact Address: Privacy Statement · Conference: ECER 2024 |
Conference Software: ConfTool Pro 2.6.153+TC © 2001–2025 by Dr. H. Weinreich, Hamburg, Germany |