Conference Agenda

Session
02 SES 03 B: AI and Digitalisation
Time:
Tuesday, 27/Aug/2024:
17:15 - 18:45

Session Chair: Andreas Saniter
Location: Room 103 in ΧΩΔ 01 (Common Teaching Facilities [CTF01]) [Floor 1]

Cap: 72

Paper Session

Presentations
02. Vocational Education and Training (VETNET)
Paper

Digitalisation and Transmission of Patient Care Information in Nursing: What Digitally Competent Nurses Need

Andrea Carla Volpe, Patrizia Salzmann, Deli Salini, Kezia Löffel

The Swiss Federal University for Vocational Education and Training SFUVET, Switzerland

Presenting Author: Volpe, Andrea Carla

Increasing digitalisation throughout the world is significantly impacting work processes and activities as well as competence requirements for employees. In the context of nursing care, the introduction of ICT-supported documentation and communication systems and mobile end-devices is of particular importance (Daum, 2017). The transmission and documentation of patient care information (PCI) in healthcare institutions, which are essential to ensure continuity and quality of patient care (Daum, 2017; Güttler et al., 2010), are profoundly affected by the introduction of digital devices and digitalisation (e.g., Rouleau et al., 2017). This raises the question of what digital competences nurses need to successfully cope with PCI transmission.

Internationally, various catalogues of digital competences exist (e.g., Becka et al., 2020; Kuhn et al., 2019). Some of these catalogues address a generic population and not specifically nurses and other healthcare professions (Vuorikari et al., 2022). Furthermore, to date, the international catalogues of digital competencies for nurses and healthcare professions have not been formally integrated into Swiss national educational programmes (e.g., Brunner et al., 2018). Switzerland lacks a consensus on basic digital competences in the field of digital health (e.g., Kuhn et al., 2019). This study applied a work analysis approach to identify typical exemplary professional situations of PCI transmission with digital devices in Swiss hospitals and the competencies required to cope successfully with these situations (Volpe et al., in preparation). It is based on the so-called ‘course-of-action’ approach to work analysis (Durand & Poizat, 2015; Theureau, 2006). This is a theoretical tradition of work analysis inspired by Francophone ergonomics (Filliettaz et al., 2015), a key assumption of which is that the design of learning environments and programmes should be based on a detailed understanding of workplace practices and requirements (e.g., Daniellou, 2005; Durand & Poizat, 2015; Guerin et al., 2007). To analyse real work practices and identify typical situations of PCI transmission, the researchers applied a video ethnography approach, which was performed with on-site observations and video recordings of the professional activities of 24 nurses in six hospitals. Subsequently, the nurses were invited to participate in individual self-confrontation interviews. During these interviews, the nurses were shown video footage of their professional practices and asked to identify the meaningful aspects of their lived experiences using a semiotic approach. Each video clip consisted of a selection (made by the research group) of observed situations relevant to the PCI transmission theme.

The researchers identified six key moments in the transmission and documentation of PCI with digital devices, represented by selected and validated situations and a set of digital competences that the nurses applied or would have been required to successfully deal with these situations.

The results of this study are of high practical relevance, as they can guide the development of nursing competency frameworks and the conception of training content that closely mimics real work situations. They contribute to the existing literature by concretizing the existing international catalogues of digital competences.


Methodology, Methods, Research Instruments or Sources Used
This ethnographic research was conducted in six hospital wards (four in the German-speaking part and two in the Italian-speaking part of Switzerland) and involved 24 nurses. This research was rooted in a work analysis approach within the French ergonomics tradition, specifically the ‘Course of Action’ research programme (Durand & Poizat, 2015; Theureau, 2006; Varela et al., 1991).
The initial familiarisation phase involved context analysis through desk research, semi-structured interviews and questionnaires administered to head nursing managers, ward nursing managers and IT managers in each participating hospital. Prior to the video ethnography data collection, the researchers were also present in each ward for 6–7 days without a camera to familiarise themselves with the field. During data collection, the researchers observed and video-recorded the nurses’ professional activities using wearable devices to capture videos during three shifts per nurse.The researchers then conducted a self-confrontation interview with each nurse, which involved showing videos of their nursing activities and inviting them to explain what was meaningful to them (Poizat & Martin, 2020).
Data processing involved transcribing the self-confrontation interviews, including verbal and non-verbal aspects.Synchronisation protocols aligned the observed situations with the corresponding interview transcriptions. Semiological analysis applied to the protocols included a deconstruction phase to identify significant activities for the nurses. These activities were analysed using a six-component matrix (hexadic sign) inspired by Peirce’s (1994) three experience categories.To identify nurses’ digital competences, i.e., their digital knowledge, skills and attitudes, the focus was on three of the six components: unit of experience, situated knowledge and engagement. Then we identified typical aspects of each person’s experience and compared these aspects among participating nurses. This allowed for specifying the transversal aspects of their experiences.
The analysis of situated knowledge allowed the identification of a considerable amount of knowledge actualised in context, considering both the insights expressed by nursing staff during the self-confrontation interviews and what was expressed as actual actions in the units of experience (which included methodological knowledge or skills activated in situ). A cross-sectional analysis of comments made by nurses during the self-confrontation interviews and the analysis of the engagements revealed a set of attitudes and values concerning collaborative dimensions among colleagues, interactions with patients and interactions with digital tools. Finally, once the nursing digital competences were identified, alignment with the existing macro area of digital competences was applied via the Digital Competence Framework for Citizens (Vuorikari et al., 2022).

Conclusions, Expected Outcomes or Findings
The observed situations of PCI transmission with digital devices were classified into four categories: communication with patients, intraprofessional communication, interprofessional communication and nursing documentation. Within these categories, six key moments of PCI transmission with digital devices represented by selected and validated situations were identified: (a) medication administration, (b) shift handover, (c) patient admission, transfer and discharge, (d) physician–nurse rounds, (e) reading PCI and (f) inserting/editing PCI.
Semiological analyses of the observations and self-confrontation interviews revealed a catalogue of situated digital competences, including knowledge, skills and attitudes that the nurses mobilised to successfully deal with the situations of transmission and documentation of PCI with digital devices. An example of such a situated digital competence in a shift handover situation is: The nurse can filter anamnesis patient data in the clinical information system (CIS) to enhance intra-professional collaboration within the team. To achieve this, the nurse needs to (a) know the Electronic Health Record modules (knowledge), (b) be able to locate information and assess the workload for each patient (skills) and (c) foster interprofessional collaboration (attitudes). This situated digital competence is aligned with the following digital competence macro areas of the Digital Competence Framework for Citizens  (Vuorikari et al., 2022): (a) information and data literacy, (b) communication and collaboration.

References
Becka, D., Bräutigam, C., & Evans, M. (2020). " Digitale Kompetenz" in der Pflege: Ergebnisse eines internationalen Literaturreviews und Herausforderungen beruflicher Bildung (No. 08/2020). Forschung Aktuell.
Brunner, M., McGregor, D., Keep, M., Janssen, A., Spallek, H., Quinn, D., ... Solman, A. (2018). An eHealth capabilities framework for graduates and health professionals: Mixed-methods study. Journal of Medical Internet Research, 20(5), e10229.
Daniellou, F. (2005). The French-speaking ergonomists' approach to work activity: cross-influences of field intervention and conceptual models. Theoretical issues in ergonomics science, 6(5), 409-427.
Daum, M. (2017). Digitalisierung und Technisierung der Pflege in Deutschland. DAA-Stiftung, Bildung und Beruf, Hamburg.
Durand, M., & Poizat, G. (2015). An activity-centred approach to work analysis and the design of vocational training situations. In L. Filliettaz & S. Billett (Eds.), Francophone perspectives of learning through work: Conceptions, traditions and practices (pp. 221–240). Springer.
Filliettaz, L., Billett, S., Bourgeois, E., Durand, M., & Poizat, G. (2015). Conceptualising and connecting Francophone perspectives on learning through and for work. Francophone perspectives of learning through work: Conceptions, traditions and practices, 19-48.
Guérin, F., Laville, A., Daniellou, F., Duraffourg, J., & Kerguelen, A. (2007). Understanding and transforming work: the practice of ergonomics. Lyon: Anact.
Güttler, K., Schoska, M., & Görres, S. (2010). Pflegedokumentation mit IT-Systemen. Eine Symbiose von Wissenschaft, Technik und Praxis. Bern: Hans Huber Verlag.
Kuhn, S., Ammann, D., Cichon, I., Ehlers, J., Guttormsen, S., Hülsken-Giesler, M., Kaap-Fröhlich, S., Kickbusch, I., Pelikan, J., Reber, K., Ritschl, H., & Wilbacher, I. (2019). Wie revolutioniert die digitale Transformation die Bildung der Berufe im Gesundheitswesen? Careum Working Paper 8. Zürich: Careum Stiftung.
Peirce, C. S. (1994). Collected papers of charles sanders peirce (Vol. 1). Harvard University Press.
Poizat, G., & Martin, J. S. (2020). The course-of-action research program: historical and conceptual landmarks. Activités, 17(17-2).
Rouleau, G., Gagnon, M. P., Côté, J., Payne-Gagnon, J., Hudson, E., & Dubois, C. A. (2017). Impact of information and communication technologies on nursing care: Results of an overview of systematic reviews. Journal of Medical Internet Research, 19(4), e122.
Theureau, J. (2006). Le cours d’action: Méthode développée. Octarès.
Varela, F. J., Thompson, E., & Rosch, E. (1991). The embodied mind: Cognitive science and human experience. MIT Press.
Vuorikari Rina, R., Kluzer, S., & Punie, Y. (2022). DigComp 2.2: The Digital Competence Framework for Citizens-With new examples of knowledge, skills and attitudes (No. JRC128415). Joint Research Centre (Seville site).


02. Vocational Education and Training (VETNET)
Paper

Social Capital of Actors in VET: An Egocentric Case Study Based on the AI Pioneers Project

Lisa Meyne, Christine Siemer

University of Bremen, Institute Technology and Education

Presenting Author: Meyne, Lisa; Siemer, Christine

The importance of involved stakeholders and the resulting social networks in international VET cooperation is highlighted in a large number of empirical studies (see e.g., Gessler, 2019). While social network analysis has a broader range of empirical use cases in a wide variety of educational settings (see e.g., Hodge et al., 2020; Jan & Vlachopoulos, 2018), the state of research related to VET (see e.g., Ditchman et al., 2018) is found to a much lesser extent, as is the coverage of social capital within international VET research (see Gessler & Siemer, 2020; Siemer & Gessler, 2021). This paper focuses on the development of social capital in the course of network building and its sustainability in an international consortium using the case study of the funded Erasmus+ project AI Pioneers. The following research questions will be pursued in the context of the submission:

1) Which actors play a central role at the beginning of network building in the field of vocational education and training?

2) What is the intensity of the relationships over the course of the network formation?

This paper will draw on various theoretical approaches in network research to build the theoretical and conceptual framework of the study. As the funded project is an innovation project, the promoter model is used to apply the "content-related dimension of support" (Gessler & Siemer, 2020, p. 46) within the egocentric networks to be analysed with the roles of power promoter, expertise promoter, process promoter and relationship promoter (Witte, 1999). The basic idea of the promoter model is the assumption that promoters are able to overcome barriers in the innovation process due to suitable resources, which has a promising effect on the implementation of projects (e.g., Gessler, 2019; Witte, 1999). Furthermore, the differentiation between bridging and bonding social capital, and thus the intensity of relationships, is crucial (Patulny & Svendsen, 2007). The distinction between strong and weak ties can be traced back to Granovetter (1973). Following on from Granovetter (1973), Marsden and Campbell (1984) empirically addressed the question of which further indicators can be used to capture the strength of social relationships. The authors primarily identified indicators for the closeness of relationships and also refer to the frequency of contact as well as the duration described as the years of acquaintance (Marsden & Campbell, 1984). Following on from this, Gessler and Siemer (2020; see also Siemer & Gessler, 2021) introduce a specification in the form of a level model for measuring the closeness of social relationships which is applied in the course of the present work: 1) Pure exchange of information, 2) Mutual exchange but distanced, 3) Goal-oriented coordination, 4) Cooperation, and 5) Trust in each other. The different levels are characterised to varying degrees by the features of relevance, reciprocity, intentionality, interdependence and consistency, so that the intensity increases over the five levels and the attributes of the subordinate levels are to be assigned to the superordinate levels as well.


Methodology, Methods, Research Instruments or Sources Used
The focus of the funded Erasmus+ project AI Pioneers (funding period 2023-2025) promotes the use and teaching of Artificial Intelligence (AI) in adult and vocational education and training, with a total of 10 project partners from seven different EU countries involved in the AI Pioneers project network (Germany, Greece, Portugal, Italy, Spain, Cyprus, Estonia). The focus of the project, besides the development of policy recommendations, toolkits, implementation guidelines of AI use cases and guidelines for the ethical and trustworthy use of AI in education, is on the implementation and establishment of an international network of AI Pioneers so that educators, stakeholders, policy makers and education planners are addressed as reference points for the design and implementation of future education projects related to AI (see e.g., Attwell et al., 2023). As network formation is at the core of the AI Pioneers project, this article aims to contribute to recording the network structures and describe the social capital that has been created. For this purpose, we use the egocentric network analysis (Fuhse, 2018) and examine the development of the intensity of the established relationships over the duration of the project.
The topic of defining the boundaries of networks is central to network research, although there is no clear consensus on how these are to be clearly defined and what meaning emerges from them (Häußling, 2009). Accordingly, we define the network to be analysed in this study along the thematic focus on the AI Pioneers project. Using egocentric network analysis, the individual project partners are asked about their relevant relationships in the project context, and thus focussing on a specific number of actors and relationships.
We use a standardized guideline for data collection (Döring, 2023). In order to gather as much contextual knowledge as possible about the subsequently generated network maps, the standardized key questions are supplemented by further in-depth questions.  According to Marsden and Campbell: "Egocentric network data describe the local social environments surrounding individual actors in a network – usually comprising one or more of each focal actor’s direct contacts (“alters”) and certain qualities of the dyadic relationships between that actor (“ego”) and the alters" (Marsden & Campbell, 2012, p. 18). The data is analyzed, evaluated and visualized using the VennMaker tool.

Conclusions, Expected Outcomes or Findings
It can be expected that the project partners of the Erasmus+ project AI Pioneers and their relationships with relevant stakeholders, which have arisen in the project context and also relate to it in terms of content, will intensify over the course of the implementation and thus contribute to the sustainability of the network. Furthermore, it can be expected that the networks and thus the social capital of the project partners within the international consortium will differ significantly from one another, possibly due to the different partners and their relationships with project-relevant stakeholders as well as their experience in the implementation of international projects in the context of artificial intelligence in the educational field. Interesting results could also emerge with regard to the organisation of the role of the relationship promoter, as the size of the networks may depend strongly on the commitment of individuals and their networking skills in the context of vocational education and training.
Beyond the research design presented here, future research with regard to the survey of overall networks as well as the associated quantitative key figures in terms of density and centrality would be particularly interesting to follow, as well as the perspective of long-term sustainability of the relationships established beyond the end of the project.

References
Attwell, G., Deitmer, L., & Bekiaridis, G. (2023). AI pioneers: Developing a community of practice for artificial intelligence (AI) and vocational education and training. In V. Tūtlys, L. Vaitkutė & C. Nägele (Eds.), Proceedings of the 5th Crossing Boundaries Conference, Kaunas, 25. – 26. May (pp. 30–37). VETNET, Vytautas Magnus University Education Academy. https://doi.org/10.5281/zenodo.7808076
Ditchman, N. M., Miller, J. L., & Easton, A. B. (2018). Vocational rehabilitation service patterns: An application of social network analysis to examine employment outcomes of transition-age individuals with autism. Rehabilitation Counseling Bulletin, 61(3) 143–153. https://doi.org/10.1177/0034355217709455
Döring, N. (2023). Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschaften. Springer.
Fuhse, J. (2018). Soziale Netzwerke, Konzepte und Forschungsmethoden. Springer.
Gessler, M. (2019). Promotoren der Innovation im transnationalen Berufsbildungstransfer: Eine Fallstudie. In M. Gessler, M. Fuchs & M. Pilz (Eds.), Konzepte und Wirkungen des Transfers dualer Berufsbildung (pp. 231–279). Springer.
Gessler, M., & Siemer, C. (2020). Nachhaltigkeit internationaler Berufsbildungszusammenarbeit: Erfassung des sozialen Kapitals mittels personaler Netzwerkanalysen. In Berufsbildung International – Nachhaltigkeit (S. 44–47). BMBF.
Granovetter, M. S. (1973). The Strength of Weak Ties. American Journal of Sociology, 78(6), 1360–1380. https://doi.org/10.1086/225469
Häußling, R. (2009). Einleitung. In R. Häußling (Ed.), Grenzen von Netzwerken (pp. 7-14). VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-91856-3
Hodge, E., Childs, J., & Au, W. (2020). Power, brokers, and agendas: New directions for the use of social network analysis in education policy. Education Policy Analysis Archives, 28(117).  https://doi.org/10.14507/epaa.28.5874
Jan, S. K., & Vlachopoulos, P. (2018). Social network analysis: A framework for identifying communities in higher education online learning. Technology, Knowledge and Learning, 24, 621–639 https://doi.org/10.1007/s10758-018-9375-y
Marsden, P. V., & Campbell, K. E. (1984): Measuring Tie Strength. In: Social Forces, Vol. 63, No. 2, 482. https://doi.org/10.2307/2579058
Patulny, R. V., & Lind Haase Svendsen, G. (Eds.). Exploring the social capital grid: Bonding, bridging, qualitative, quantitative. International Journal of Sociology and Social Policy, 27(1/2), 32–51. https://doi.org/10.1108/01443330710722742
Siemer, C., & Gessler, M. (2021). The role of research partners in funded model projects in the context of the internationalisation of VET: Research partners as promoters. In C. Nägele, N. Kersh & B. E. Stalder (Eds.), Proceedings of the European Conference on Educational Research (ECER), VETNET (pp. 270–278). https://doi.org/10.5281/zenodo.517243
Witte, E. (1999). Das Promotoren-Modell. In J. Hauschild & H. G. Gemünden (Hrsg.). Promotoren, Champions der Innovation (2. erweiterte Auflage, S. 9 – 41). Springer Fachmedien. https://doi.org/10.1007/978-3-322-99247-5


02. Vocational Education and Training (VETNET)
Paper

Artificial Intelligence (AI) To Support E-Learning

Andreas Saniter, Vivian Harberts

ITB Uni Bremen, Germany

Presenting Author: Saniter, Andreas; Harberts, Vivian

Since the broad public launching of artificial intelligence (AI)-based large language models in autumn 2022, a debate about potential benefits and risks of AI in education, including vocational education and training (VET) arose (cp. Chiu et al. 2023, Nemorin et al. 2023, Windelband 2023). But, as there is only little experience and almost no evidence referring to this technology in education, most publications discuss potential developments and are based on estimations. A broad consensus is, that AI will have serious influence on teaching, training and learning – but if this influence appears as threat or potential often depends strongly on the beliefs of the authors. Additionally, the various dimensions of complex teaching and learning processes might be tackled very different by AI.

Against this background, a transnational consortium with colleagues from Spain, Portugal, Slovenia and Germany decided to deliver a small piece of evidence about the usefulness of AI in a very concrete setting:

Can AI support drop-out prevention in electronic learning (e-learning) via personalised tutoring?

Drop-out rates in e-learnings are high, cp. for example Khali & Ebner (2014) or Dopler et al. (2023). Among the various potential reasons for drop-out is one, that can be influenced by (human or artificial) tutors: If the learner is lost at a certain point, individual support might guide him or her back on the track.


Methodology, Methods, Research Instruments or Sources Used
To work on the question, we have chosen various e-learnings, one focussing on additive manufacturing (AM) that has been developed in a previous project (metals 2019). Target groups are apprentices in technical domains, their participation is voluntarily and completely anonymous (low-stakes), they log-in on devices of their VET-centres with functional e-mails (“user 1”). They are free to choose of 27 modules – they can work on any amount of the modules and can start where they want to start. Each module takes approx. one hour and can be completed via a short multiple-choice test. Navigation within the modules is also up to the learners; there is a suggested sequence, but it is not mandatory to follow the suggestion. Finally, each module offers additional optional materials; for example, links to explanatory videos. Or, to put it different, whilst designing the e-learning modules a high degree of freedom for the learners has been installed.
All navigation patterns of the learners are tracked via the internal tracking function of the learning management system (LMS).


Conclusions, Expected Outcomes or Findings
First pilots with two German classes of industrial mechanics are very promising. The participants represent a broad spectre from being not interested in AM (and thus not in the modules), via pragmatic and efficient work on the modules till engaged learning with many modules and the additional optional materials. Data has been analysed traditionally (comparison of navigation and correlation of patterns, without AI) and some indicators for success respective drop-out have been identified, for example that learning with certain of the offered optional materials increase the success rate in the tests – thus a traditional approach towards individualised tutoring could be to recommend these optional materials to apprentices who struggle with the test.
Currently the AI is fed with the collected data, we hope that it will identify more complex navigation patterns that lead to success respective drop-out – and that analysis of these patterns will lead to more elaborated approaches of individualised tutoring.

References
Chiu, T. K., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, 100118.
Dopler, S., Beil, D., & Putz-Egger, L. M. (2023). Cognitive learning outcomes of virtual vs. in-person gamified workshops: A pre-post survey experiment.
Khalil, Hanan & Ebner, Martin. (2014). MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review.
Metals (2019). https://metals.mobil-lernen.com/de/elearning
Nemorin, S., Vlachidis, A., Ayerakwa, H. M., & Andriotis, P. (2023). AI hyped? A horizon scan of discourse on artificial intelligence in education (AIED) and development. Learning, Media and Technology, 48(1), 38-51.
Windelband, L. (2023). Artificial Intelligence and Assistance Systems for Technical Vocational Education and Training–Opportunities and Risks. In New Digital Work: Digital Sovereignty at the Workplace (pp. 195-213). Cham: Springer International Publishing.