Conference Agenda

Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

Please note that all times are shown in the time zone of the conference. The current conference time is: 17th May 2024, 07:18:56am GMT

 
 
Session Overview
Session
22 SES 08 B
Time:
Wednesday, 23/Aug/2023:
5:15pm - 6:45pm

Session Chair: Carolina Guzmán-Valenzuela
Location: Adam Smith, LT 915 [Floor 9]

Capacity: 50 persons

Paper Session

Show help for 'Increase or decrease the abstract text size'
Presentations
22. Research in Higher Education
Paper

Competence Profiles of Generic Skills Among Finnish Undergraduate Students

Jani Ursin1, Heidi Hyytinen2, Kari Nissinen1, Kaisa Silvennoinen1

1University of Jyväskylä, Finland; 2University of Helsinki, Finland

Presenting Author: Ursin, Jani

Generic skills can be considered important during higher education studies. Previous studies have indicated that generic skills have impact on students’ learning, study success and retention in higher education (Badcock ym. 2010; Arum & Roksa 2011; Tuononen et al. 2019). Previous studies have also shown that undergraduate students have challenges, for instance, in argumentation, interpreting and evaluating information and drawing conclusions (Badcock, Pattison & Harris 2010; Arum & Roksa 2011; Evens, Verburgh & Elen 2013). Furthermore, there is some evidence that student’s educational and socioeconomic background has impact on how well students master generic skills (Arum & Roksa, 2011; Kleemola et al., 2022) and the way of which generic skills are assessed differentiates students in their mastery of generic skills (Hyytinen et al. 2015).

There are numerous generic skills needed during in higher education and in working life. In higher education, typically, focus is on higher-order cognitive skills such as critical thinking and argumentation, analytic reasoning, decision making and writing (e.g. Zoller & Tsaparlis 1997; Arum & Roksa 2011; Lemons & Lemons 2017). The generic skills assessed in this study are analytic reasoning and evaluation (how students can identify the strengths and weaknesses of alternative argumentation and how they can differentiate between trustworthy and untrustworthy sources), problem-solving (how students can recognise a problem and solve it by using argumentation), writing effectiveness (how logically and clearly the answer has been constructed), and writing mechanics (how students use conventions of standard written language and control of language). The aim of the study is to examine

(1) how well Finnish undergraduate students master various generic skills, and

(2) what background factors relate to these skills.


Methodology, Methods, Research Instruments or Sources Used
Instrument: The study used performance-based instrument called Collegiate Learning Assessment International (CLA+). The USA-based instrument was translated and adapted into Finnish and Swedish (official languages in Finland) according to the International Translation Committee guidelines for translating and adapting tests (Bartram et al., 2018). The translated instrument was pre-tested in 20 cognitive laboratories with think-alouds and interviews to make sure that the construct or difficulty of the instrument was not altered in the translation and adaptation phase. CLA+ included three sections: an open-ended written task (performance task, PT), 25 selected response questions (SRQs), and background information survey including 37 questions. Students had 60 minutes to complete the PT, followed by 30 minutes for the SRQs. Thereafter, students filled in a background survey. In total, the computer-based and monitored test lasted for 2 hours 15 minutes. The PT measured analysis and problem solving, writing effectiveness and writing mechanics. To successfully complete the PT, students needed to familiarise themselves with the materials available in an electronic document library and then write an answer to the question, which dealt with the differences in life expectancies in two cities. The SRQs measured critical reading and evaluation, scientific and quantitative reasoning, and critiquing an argument. The SRQs in each section were based on one or more documents. The materials and questions in the sections covered the topics of brain protein, nanotechnology and women in combat.
 
Participants, data collection and analysis. The participants (n = 2402) were students at initial and final stages of Bachelor degree programmes in seven universities of applied sciences (UASs) and eleven universities in Finland. The participants were selected by cluster sampling of programmes to obtain a nationally representative sample across the disciplines provided in the Finnish higher education institutions. The data were collected between August 2019 and March 2020. The participation rate was 25 per cent. The adopted statistical methodology included linear and logistic regression, and structural equation modelling, and the analyses were conducted in the design-based framework, utilizing survey weights and accounting for clustered data. The distortions in the eventual sample data were corrected by using survey weights derived from the Finnish student registers.

Conclusions, Expected Outcomes or Findings
First findings show that the variation in students’ generic skills was explained mainly by factors pertaining to student’s educational and socioeconomic background. Profiling of students suggests three types of competence groups: high performers who perform well independent of task type (whether a PT or SRQs), low performers who perform poorly in both types of tasks, and mixed performers who perform well in one task type but poorly in the other. The mixed performers can be divided into those who perform better in PT than in SRQs, and those who perform better in SRQs than in PT. A detailed comparative analysis on the background characteristics of these competence groups is yet to be done.
References
Arum, R. & Roksa, J. 2011. Academically adrift: Limited learning on college campuses. Chicago: University of Chicago Press.

Badcock, P. B. T., Pattison, P. E. & Harris, K-L. 2010. Developing generic skills through university study: a study of arts, science and engineering in Australia. Higher Education 60 (4), 441–458.
 
Bartram, D. et al. (2018), “ITC Guidelines for Translating and Adapting Tests (Second Edition)”, International Journal of Testing, 18. 101-134.

Evens, M., Verburgh, A. & Elen, J. 2013. Critical thinking in college freshmen: The impact of secondary and higher education. International Journal of Higher Education 2 (3), 139–151.
 
Hyytinen, H., Nissinen, K., Ursin, J., Toom, A. & Lindblom-Ylänne, S. 2015. Problematising the equivalence of the test results of performance-based critical thinking tests for undergraduate students. Studies in Educational Evaluation 44, 1–8.
 
Kleemola, K., Hyytinen, H. & Toom, A. 2022. Critical thinking and writing in transition to higher education in Finland: do prior academic performance and socioeconomic background matter. European Journal of Higher Education.

Lemons, P. P. & Lemons, J. D. 2017. Questions for Assessing Higher-Order Cognitive Skills: It's Not Just Bloom’s. Life Sciences Education 12 (1), 47–58.

Tuononen, T., Parpala, A. & Lindblom-Ylänne, S. 2019. Graduates’ evaluations of usefulness of university education, and early career success–a longitudinal study of the transition to working life. Assessment & Evaluation in Higher Education, 1–14.

Zoller, U., & Tsaparlis, G. 1997. Higher and lower-order cognitive skills: The case of chemistry. Research in Science Education 27, 117–130.


22. Research in Higher Education
Paper

Service-Learning and Development of Transversal Competencies: Reflection as a Catalyst for Results.

Daniel Sáez-Gambín, Miguel A. Santos Rego, Igor Mella-Núñez

Universidade de Santiago de Compostela, Spain

Presenting Author: Mella-Núñez, Igor

The university is an institution responsible for the comprehensive education of its students. In the European context, the European Higher Education Area (EHEA) has been developing for more than twenty years to update the university model so that it responds adequately to the needs of contemporary society. In its latest declaration (Rome Conference, 2020), it demands a university capable of: a) providing solutions to the changes facing society; b) adapting knowledge, skills and competencies to meet new challenges; c) making educational offerings more flexible to participate in programs that enable the improvement of specific skills, d) fostering student-centered learning and teaching, and e) supporting the use of digital technologies for learning, teaching and assessment, scholarly communication and research.

To make progress in these terms, Opazo et al. (2016) indicate that it is essential to use, in a well-planned and structured manner, innovative educational methodologies that complement traditional ones. At this point, the use of Service-Learning programs (SL) fits perfectly as a means for such a mission, by placing academic learning in real contexts and covering needs identified in the community.

These practices have a widely recognized potential for the attainment of transversal skills in university students (Santos Rego, Sáez-Gambín, D., González-Geraldo, et al., 2022). Such skills help prepare students for today's world, drawing links between approaches from both the academic and strictly productive spheres (Alvarez et al., 2022).

However, not all SL experiences are likely to have a positive impact on students' futures, as research to date has recognized certain factors or criteria that determine the quality of projects, and that can have an impact on the benefits provided by these experiences (Billig et al., 2005). Briefly, these "good practices" are related to: the duration and intensity of the project; its academic rigor; the creation of solid partnerships; performing a meaningful service; a correct delimitation of roles; providing diversity in the experience; carrying out an efficient evaluation; and developing an adequate reflection (Imperial et al., 2007; National Youth Leadership Council, 2008).

Among these quality criteria, there is a consensus in the literature that reflection is the most important element. Not surprisingly, reflective processes conform the identity of experience-based methodologies, as they give meaning to what has been experienced, and determine future activities and decisions (Ash & Clayton, 2009). Thus, through dialogical activities with oneself or others, or through research and observation, students question, analyze their experiences, and seek solutions to future problems (García-Romero & Lalueza, 2019).

However, there is a lack of research that empirically studies the effects of the design of service-learning projects on students. Those that have been conducted are mostly focused on describing the experience or studying how it affects students' motivation, feelings or other impressions, and not so much on how the different quality variables are related to the effectiveness of the methodology (Lin, 2021). Despite this, we can find some studies that affirm that a more complete reflection has a greater impact on variables considered mediators of academic performance (Lorenzo, et al., 2021), as well as on student satisfaction with their experience (Santos Rego, Sáez-Gambín, & Lorenzo Moledo, 2022).

Specifically, the objective of this research is to analyze how reflection is related to the development of transversal competencies in university students. This paper is framed in the Research Projects: “Service-Learning (SL) and employability of university graduates in spain: competences for employment” (EDU2017-90651-REDT) and “The impact of the university in the community through service-learning projects. A study focused on reciprocity (SL)” (PID2021-122827OB-I00).


Methodology, Methods, Research Instruments or Sources Used
A quasi-experimental design was conducted (pretest-posttest with a control group), in which two questionnaires were applied to students participating in 19 service-learning projects carried out in the 2020-2021 and 2021-2022 academic years, in Spanish universities.
First, we used the questionnaire on generic competencies of university students (COMGAU) (Regueiro et al., 2019). This instrument integrates a validated scale on transversal competencies, directly related to employability. It consists of 17, 5-point Likert-type questions that groups the competencies proposed in 5 dimensions or factors that explain 59.85% of the total variance: entrepreneurship skills, interpersonal skills, intercultural skills, networking skills, and capacity for analysis and synthesis. Students covered this instrument both at the beginning and at the end of the service-learning project.
Secondly, the professors responsible for each of the projects filled out an SL Experience Registration Form at the university level, validated by a group of experts in the methodology. It included a total of 28 questions grouped into the following modules: university data, identification of the course, partners, assessment, and dissemination of the course. Specifically, the instrument requested details on how the reflection was conducted: when it was carried out (before, during and after), with whom (community, collaborating entity, course and professor, SL working group), and what the reflective process was oriented towards (sharing feelings, relating the service to the contents of the subject, analyzing the problems of the community and developing attitudes and values). Likewise, we asked if they make use of tools or follow-up mechanisms during the project that can help in the reflection process (portfolio, field diaries, interim reports, meetings, etc.).
Combining both instruments, we will carry out analyses in order to: 1) study whether students participating in service-learning projects have a greater development of transversal competencies than those who do not participate in these activities; 2) find out how reflection is conducted in each of the projects; and 3) compare the type of reflection carried out with the degree of development of the students' competencies.

Conclusions, Expected Outcomes or Findings
It is clear that reflection is a central process in SL courses and improvising its realization would be an imprudent act that could have direct repercussions on the effectiveness of the projects. Although the research is still in the process of data exploitation, the background and the academic review allow us to anticipate some of the results. From prior studies it can be concluded that students benefit from a reflection that clearly connects the service with the course objectives; that is continuous throughout the development of the project; that provides feedback from the teacher; and that allows students to explore, clarify and alter their values, as well as to make use of tools that facilitate it, such as portfolios or field diaries (Santos Rego, Sáez-Gambín et al., 2022; Lorenzo et al., 2020).
With this being said, our hypothesis is that a reflection that fulfills these characteristics will also make the learners develop a variety of transversal competencies that employers demand nowadays, and that are sometimes more valued than the academic qualifications (Succi & Canovi, 2019).
Finally, in addition to the fact that quality is a topic yet to be explored when it comes to SL, the strength of this proposal lies in the fact that the research design includes a quasi-experimental methodology, which is an excellent opportunity to provide the basis for future research, especially given the proliferation of papers published about this methodology in recent decades (Redondo-Corcobado & Fuentes, 2020).

References
Ash, S. L., & Clayton, P. H. (2009). Generating, deepening, and documenting learning: The power of critical reflection in applied learning. Journal of Applied Learning in Higher Education, 1(1), 25-48.
Billig, S. H., Root, S., & Jesse, D. (2005). The relationship between the quality indicators of service-learning and student outcomes. In S. Root, J. Callahan, S. H. Billig, Improving service-learning practice: Research on models to enhance impacts (pp. 97-115), Information Age Publisher.
García-Álvarez, J., Vázquez-Rodríguez, A., Quiroga-Carrillo, A., & Priegue Caamaño, D. (2022). Transversal Competencies for Employability in University Graduates: A Systematic Review from the Employers’ Perspective. Education Sciences, 12(3), 204. https://doi.org/10.3390/educsci12030204
García-Romero, D., & Lalueza, J. L. (2019). Procesos de aprendizaje e identidad en aprendizaje-servicio universitario: una revisión teórica. Educación XX1: revista de la Facultad de Educación, 22(2), 45-68. https://doi.org/10.5944/educxx1.22716
Imperial, M. T., Perry, J. L., & Katula, M. C. (2007). Incorporating service learning into public affairs programs: Lessons from the literature. Journal of Public Affairs Education, 13(2), 243-264. https://doi.org/10.1080/15236803.2007.12001478  
Lin, T. H. (2021). Revelations of service-learning project: Multiple perspectives of college students’ reflection. PloS one, 16(9),1-17. https://doi.org/10.1371/journal.pone.0257754
Lorenzo, M., Sáez-Gambín, D., Ferraces-Otero, M. J., & Varela, C. (2020). Reflection and Quality Assessment in Service-Learning Projects. When, With Whom, and Why. Frontiers in Education, 5(605099), 1-14. https://doi.org/10.3389/feduc.2020.605099
National Youth Leadership Council. (2008). K-12 Service-Learning Standards for Quality Practice. https://cdn.ymaws.com/www.nylc.org/resource/resmgr/resources/lift/standards_document_mar2015up.pdf  
Opazo, H., Aramburuzabala P., & Cerrillo, R. (2016). A review of the situation of service-learning in higher education in Spain. Asia-Pacific Journal of Cooperative Education, 17(1), 75-91.
Redondo-Corcobado, P., & Fuentes, J. L. (2020). La investigación sobre el aprendizaje-servicio en la producción científica española: una revisión sistemática. Revista Complutense de Educación, 31(1), 69-82. https://doi.org/10.5209/rced.61836
Regueiro, B., Rodríguez-Fernández, J. E., Crespo, J., & Pino-Juste, M. R. (2021). Design and Validation of a Questionnaire for University Students’ Generic Competencies (COMGAU). Frontiers in Education, 6(606216), 1-15. https://doi.org/10.3389/feduc.2021.606216
Rome Conference (2020). Rome Ministerial Communiqué.  http://www.ehea.info/Upload/Rome_Ministerial_Communique.pdf
Santos Rego, M. A., Sáez-Gambín, D., González-Geraldo, J. L., & García-Romero, D. (2022). Transversal Competences and Employability of University Students: Converging towards Service-Learning. Education Sciences, 12(4), 265. https://doi.org/10.3390/educsci12040265
Santos Rego, M. A., Sáez-Gambín, D., & Lorenzo, M. (2022). Cómo debemos hacer la reflexión en los proyectos de aprendizaje-servicio. In J.L. Fuentes, C. Fernández-Salinero, & J. Ahedo (Eds.), Democracia y tradición en la teoría y práctica educativa del siglo XXI (pp. 153-164), Narcea.


22. Research in Higher Education
Paper

Possibilised by Physics: Students’ Retrospective Narratives about Safe Spaces and Emancipation

Anne-Sofie Nyström1, Anna Danielsson2, Anders Johansson3, Allison Gonsalves4

1Uppsala University, Sweden; 2Stockholm University, Sweden; 3Chalmers University of Technology, Sweden; 4McGill University, Canada

Presenting Author: Danielsson, Anna

The discipline of physics has famously been described as a ‘culture of no culture’ (Traweek 1988), and physics is often perceived as objective, universal, and rational, a way of approaching the world that is untouched by social dynamics. At the same time, physics is also described in terms of aesthetics and beauty. This can concern a strive for mathematical beauty (Hovis and Kragh 1993) or take the form of wonder and awe for the vastness and the purity of nature (Girod 2007). Girod (2007) further discuss how scientists describe being able to understand the world differently and more richly because of their understanding of science. Physics is also entangled with notions of intelligence and cleverness, a discipline inaccessible to many (Archer et al. 2020). The question of the (in)accessibility of the discipline of physics has over the years gained much attention in educational research, particularly in relation to the recruitment and retention of students from underrepresented groups (de Barros Vidor et al. 2020).

In this presentation, we align ourselves with research that has characterized students’ movements through learning ecologies as pathways or trajectories that resist “pipelines” or implied linearity. Recently, researchers (e.g. Avraamidou, 2020; Mendick et al., 2017; Rahm et al., 2021) have taken up notions of landscapes of becoming, pathways through STEM, and wayfaring which resist deficit notions dominant in the pipeline metaphor, and permit an analysis of student agency as they may entail path switching or on/off ramps and intersecting paths. Rahm et al. (2021) offer that to learn about the role of science in learners’ lives, we need to move beyond “connecting the dots” of activities in science, and instead attend to that which cannot be represented in pathways or trajectories. Thus, “becoming somebody” in physics is “tied up in complex ways with a web of meanings and practices that constitute learning lives” (p. 4). In this presentation, our concern is to unpick this web as we trace the meanings three mature university physics students make of their experiences in various physics learning ecologies, across time and space. In their stories, these three mature students do not articulate end goals of “physicist”, nor do they narrate clear pathways into their present undergraduate programs. Rather, they speak of physics in ways that reveal their figuring of physics as part of a web of meaning that entails the tangling of emotions with physics learning that might serve, as Avraamidou (2020) argues “as links between past (e.g., personal histories), present (e.g., social positioning), and future selves (e.g., a science person)” (p. 338).

Our analysis is based on the notion that well-being is connected to whether life can be experienced as meaningful and authentic (Sayer 2011). We draw on Schutz’ phenomenological understanding of people’s experience of the world, which seeks to explain people’s meaning-making and connection in relating to the world and each other (Schutz & Luckmann 1983). The central theoretical notions through which we explore our interviewees' narrative are experiences of connectedness versus experiences of alienation. In particular, we utilize the concept of transcendence to illuminate how the interviewees explain their relationship to physics (e.g. Thurfjell et al 2019). Importantly, we do not investigate how moments can add up to trajectories into physics, but rather how mature students view physics as providing an organizing structure for their life trajectories, to materialize a life that might not have seemed possible outside of the realm of physics.

In the presentation we interweave the analyses of three student narratives, those of Tina (first generation university student, early 40s), Tobias (first generation university student, late 20s), and Kamal (second generation immigrant, late 20s).


Methodology, Methods, Research Instruments or Sources Used
The study draws on interviews with 21 Swedish higher education physics students, who at the time of the interview were doing their first or second year in an Engineering Physics or Bachelor of Physics programme. The interviewed students had responded to a call to participate in a study exploring what has made it possible for some students from underrepresented groups to continue to higher education physics. As such, the interviewed students in some way identify as being ‘unusual’ within their chosen education. The interviews were conducted as ‘time-line interviews’ (Adriansen 2012), taking a broad, life-history approach to exploring the interviewees’ science trajectories (Goodson & Sikes 2001). The interviews were conducted in Swedish and transcribed verbatim by a professional transcriber. The study has ethical approval from the Swedish Ethical Review Authority.
In the analysis, these three interviews with mature students stood out as featuring narratives which told a different story to the rest. While other students described what had made physics possible for them, these stories centred on how physics had possibilised them. How they in this discipline found potential for self-realisation and well-being. We thus focused the analysis for this paper and presentation on the ways that physics has created possibilities for this self-realisation, which led to an analytic focus on transcendence and connectedness.

Conclusions, Expected Outcomes or Findings
In our analysis of the three student narratives we highlight three salient features in their meeting with (university) physics. Firstly, how the regularity and predictability of physics can provide an escape from a messy everyday life, and how existential aspects of science and nature can provide comfort. Tobias talks about how understanding ‘a small detail of nature […] it is something rather magical’. Secondly, the narratives of our interviewees also demonstrate that physics can be a space of comfort, in how it provides ways of connecting with something greater than oneself. Tina and Kamal predominantly talk about this in terms of how interactions with nature and space provides a safe space. Tobias stress the challenging quality of physics, reiterating cultural narratives about the discipline as difficult and not easily accessible, but for him the related potential for total absorption in difficult physics issues provides refuge when thoughts are spinning too fast. Thirdly, for all three students, choosing to do higher education physics functions as an act of emancipation. For Tobias and Kamal from previous successful, but unsatisfying, careers in the arts. For Tina, who has a history of abuse, returning to studying as an adult becomes a way to transcend previous constraints and former identifications. University studies in general, but also physics studies in particular, as a discipline that is perceived as particularly intellectually challenging, becomes a way for her to regain and show self-worth. These three stories collectively cause us to reflect on the value of a higher education in physics, and to look beyond normative trajectories leading to gainful employment as the primary goal. Instead these counter stories help us to see that physics education can possibilise selves in ways that cannot be measured, but may be equally significant to well-being and self-actualisation.
References
Adriansen, H. K. (2012). Timeline interviews: A tool for conducting life history research. Qualitative Studies, 3(1), 40–55.
Archer, L., Moote, J., & MacLeod, E. (2020). Learning that physics is ‘not for me’: Pedagogic work and the cultivation of habitus among advanced level physics students. Journal of the Learning Sciences, 29(3), 347-384.
Avraamidou, L. (2020). Science identity as a landscape of becoming: Rethinking recognition and emotions through an intersectionality lens. Cultural Studies of Science Education, 15(2), 323-345.
de Barros Vidor, C., Danielsson, A., Rezende, F., & Ostermann, F. (2020). What are the Problem Representations and Assumptions about Gender underlying Research on Gender in Physics and Physics Education?: A Systematic Literature Review. Revista Brasileira de Pesquisa em Educação em Ciências, 20(u), 1133-1168.
Girod, M. (2007). A Conceptual Overview of the Role of Beauty and Aesthetics in Science and Science Education. Studies in Science Education, 43(1), 38-61.
Goodson, I., & Sikes, P. J. (2001). Life history research in educational settings: Learning from lives. Open University Press.
Hovis, R. C., & Kragh, H. (1993). PAM Dirac and the beauty of physics. Scientific American, 268(5), 104-109.
Mendick, H., Berge, M., & Danielsson, A. (2017). A critique of the STEM pipeline: Young people’s identities in Sweden and science education policy. British Journal of Educational Studies, 65(4), 481-497.
Rahm, J., Gonsalves, A. J., & Lachaîne, A. (2022). Young women of color figuring science and identity within and beyond an afterschool science program. Journal of the Learning Sciences, 31(2), 199-236.
Sayer, R. A. (2011). Why Things Matter to People: Social Science, Values and Ethical Life. Cambridge: Cambridge University Press.
Schutz, A. & Luckmann, T. (1983). The Structures of the Life­World. Vol 2. Evanston, Il: Northwestern University Press.
Thurfjell, David et al. “The Relocation of Transcendence: Using Schutz to Conceptualize the Nature Experiences of Secular People.” Nature and culture 14(2), pp. 190-214.
Traweek, S. (2009). Beamtimes and lifetimes. Harvard University Press.


 
Contact and Legal Notice · Contact Address:
Privacy Statement · Conference: ECER 2023
Conference Software: ConfTool Pro 2.6.149+TC
© 2001–2024 by Dr. H. Weinreich, Hamburg, Germany