Conference Agenda

Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

 
 
Session Overview
Session
09 SES 17 B: Investigating Gender Disparities in Academic Skills and Vocational Interests
Time:
Friday, 30/Aug/2024:
14:15 - 15:45

Session Chair: Petra Grell
Location: Room 012 in ΧΩΔ 02 (Common Teaching Facilities [CTF02]) [Ground Floor]

Cap: 56

Paper Session

Show help for 'Increase or decrease the abstract text size'
Presentations
09. Assessment, Evaluation, Testing and Measurement
Paper

Towards Understanting Gen Z’s Vocational Interests: Sex and Year Effects

Simona Cotorobai1, Laura Elena Ciolan2

1University of Bucharest, Romania; 2University of Bucharest, Romania

Presenting Author: Cotorobai, Simona

Future of Jobs Report 2023 projected the possible job creation and displacements for the next 4 years, revealing a great increase in all the domains in which AI knowledge and skills will be most wanted and used (ex AI and Machine Learning Specialists, Sustainability Specialists, Business Intelligence Analysts, Information Security Analysts) whereas other domains will decrease in their demand for employees (Administrative and Executive Secretaries, Data Entry Clerks, Bank Tellers and Related Clerks) (World Economic Forum, 2023).

In these times of uncertainty and challenge, the selection of an academic path with the potential to lead to a successful career brings a complex decision-making process for adolescents. The achievement in career choices and job performance is significantly shaped by vocational interests (Rounds & Su, 2014). In this context, obtaining a clear understanding of the vocational interests of high school students belonging to Generation Z (born between 1997 and 2008) would prove particularly valuable. A substantial number of these students make decisions about their college majors during the 10th and 11th grade. If their chosen path aligns with their vocational interests, it is likely to enhance their motivation to complete college (Nye, Prasad, & Rounds, 2021), in a period when Higher education is confronted with serious drop-out rates (Eurostat Statistics, 2022). This latter source reveals that in 2022, the proportion of early leavers from education and training (ages between 18 and 24) in the EU ranged from 2.3% in Croatia to 15.6% in Romania.

According to a recent national survey in Romania focusing on Generation Z, it was found that 76% of respondents identified a passion for their work as the primary motivating factor in their job search (Romanian Business Leaders, 2022). This indicates that, for this demographic, vocational interests take precedence over financial compensation when considering employment opportunities.

As all the previous generations, Gen Z has its distinct futures, being described as more pragmatical and future-oriented compared with the more idealistic Millennials (Twenge, 2020, p. 231). Being born in a digitalized and tech world, vocational interests have also changed, as the current generation is interested in more fields of activity than the previous with an increased interest in information technologies (Roganova & Lanovenko, 2020).

Interests are defined as a cognitive and motivational factor encompassing both engagement and participation in specific content areas. The effectiveness of interest lies in its capacity to generate a rewarding experience through the information search process (Renninger & Hidi,, 2020). Interests have a significant influence on career choices and academic achievement (Hoff, Song, Wee, Phan, & Rounds, 2020), (Stoll, et al., 2020). This is why the present research endeavors to explore the patterns or clusters of interests within the Generation Z adolescent demographic.

A key objective of the study is to ascertain whether distinct patterns of interests emerge among the cohort based on factors such as the year of the examination, age, or gender. This multifaceted approach seeks to provide a nuanced understanding of the intricate interplay between vocational interests and demographic variables, contributing valuable insights to the broader discourse on college domain decisions among adolescents.

Therefore, this research aims to address the following questions:

  1. Are there variations in vocational interest preferences among high school students who took the test during the periods 2012-2014, 2015-2019, and 2020-2023?
  2. Are there distinctions in vocational interest preferences between females and males across and between the established subcohorts?
  3. What are the most prominently scored preferences in the Work Roles scales among the participants across and between subcohorts?
  4. What types of Work Styles do Generation Z individuals predominantly favor across and between subcohorts?

Methodology, Methods, Research Instruments or Sources Used
A quantitative approach will be further employed for the current study. The selected variables include gender, and the year of the testing as independent variables, while the dependent variables comprise the 34 interest scales assessed in the Jackson Vocational Interest Survey (JVIS).

The data collection took place between 2012 and 2023 at a career counseling center in Bucharest, Romania. The participants were evaluated as part of the counseling process they have acquired as a service of the center. The participants completed the test on a dedicated online platform under the guidance of a counselor.

The sample for this study was derived by extracting data from the centers' database, adhering to specific inclusion criteria. The inclusion/exclusion criteria comprised individuals with a date of birth falling within the range of 1997 to 2007, aligning with the generational interval of Generation Z - 1997 - 2012 (Twenge, 2020). Additionally, participants included in the study were required to be between 16 and 17 years old at the time of taking the test, and specifically, they needed to be enrolled in high school. By implementing these criteria, the study ensures a targeted focus on the Generation Z cohort during their adolescent years, meaning being born between 1997 -2007 to meet the age criteria.

Applying the specified criteria resulted in a sample size of 1047 participants, with 580 females and 467 males included in the study.

The data was collected using the Jackson Vocational Interest Survey (JVIS). JVIS scores in a number of 34 interest scales. The interest scales are categorized into two primary groups: Work Roles scales (such as Performing Arts, Life Science, Law, Social Sciences, Elementary Education, Finance, Business, etc.) and Work Styles scales (such as Accountability, Stamina, Independence, Planfulness, Supervision, etc.). (Iliescu, Livinti, 2007). Each interest scale is evaluated on a scale ranging from 1 to 99 points.

The data analysis will be based on a statistical approach and between the methods proposed to be used we mention: descriptive statistics, frequencies (to describe different variables), mean-level comparison (to compare the three subgroups by year and interest scales' scores), ANOVA (when comparing the 34 interest scales' scores across and between subcohorts), mixed-ANOVA (when adding the gender variable).

Conclusions, Expected Outcomes or Findings
We expect our statistical analysis to reveal a complex depiction of the highest and lowest interests scales among the population of 16th-17th years old, demonstrating the multifaced nature of vocational interests.

We anticipate that individuals in subgroups before and after the Covid pandemic might exhibit higher scores in scales measuring aspects of the working environment, reflecting the potential influence of significant external events on individuals' perceptions and preferences. While we do not expect to observe sex differences in vocational interests overall, we anticipate potential variations in the Writing and Academia scales, where females may score higher.

Given that vocational interests play a pivotal role in both career success and subjective well-being (Harris & Rottinghaus, 2017), comprehending the trends in vocational interests among Generation Z adolescents holds significant implications. This understanding can serve as a foundation for crafting improved educational policies, including enhancements in career counseling and higher educational offerings. Additionally, insights into the vocational preferences of this demographic can inform adjustments within the future job market, facilitating a more tailored and responsive approach to meet the evolving needs and aspirations of Generation Z as they navigate their educational and professional journeys.

References
World Economic Forum. (2023). Future of Jobs Report 2023. https://www3.weforum.org/docs/WEF_Future_of_Jobs_2023.pdf
Harris, K. L., & Rottinghaus, P. (2017). Vocational interest and personal style patterns: Exploring subjective well-being using the strong interest inventory. Journal of Career Assessment, 203–218. doi:https://doi.org/10.1177/1069072715621009
Hoff, K. A., Song, Q., Wee, C., Phan, W., & Rounds, J. (2020). Interest fit and job satisfaction: A systematic review and meta-analysis. Journal of Vocational Behavior, 123. doi:https://doi.org/10.1016/j.jvb.2020.103503
Katja, P., & Hell, B. (2020). Stability and change in vocational interests from late childhood to early adolescence. Journal of Vocational Behavior, 121. doi:10.1016/j.jvb.2020.103462
Romanian Business Leaders,  (2022). Raport public, https://mailchi.mp/9c64de820779/raport-insights-pulsez-2022?utm_source=mailchimp&utm_medium=Landing+page&utm_campaign=studiu
Retrieved from https://izidata.ro/.
Renninger, K. A., & Hidi,, S. (2020). To Level the Playing Field, Develop Interest. Policy Insights from the Behavioral and Brain Sciences, 7(1), 10-18. doi:https://doi.org/10.1177/2372732219864705
Roganova, A., & Lanovenko, Y. (2020). Transformation of interests and motivation to learn of Generation Z. Herald of Kiev Institute of Business and Technology, 44-49. doi:https://doi.org/10.37203/kibit.2020.44.06
Stoll, G., Einarsdóttir, S., Song, Q., Ondish, P., Sun, o., & Rounds, J. (2020). The Roles of Personality Traits and Vocational Interests in Explaining What People Want Out of Life. Journal of Research in Personality, 86. doi:10.1016/j.jrp.2020.103939
Twenge, J. M. (2020). Generația internetului. București: Baroque books and art.
Iliescu,D, Livinti, R (trad) (2007), Jackson Vocational Interest Survey - Manual Tehnic si Interpretativ, Cluj-Napoca, Ed. Sinapsis.


09. Assessment, Evaluation, Testing and Measurement
Paper

Evaluation of Policy Factors Influencing the Youth's Choice of Teaching Profession: A Pseudo-Panel Data Approach

Akihiro Hashino

The University of Tokyo, Japan

Presenting Author: Hashino, Akihiro

Recent empirical research in the social sciences has emphasized the importance of causal inference. However, causal inference is challenging when using observational data, primarily cross-sectional, even if it includes relevant variable information, as in international and large-scale educational surveys. The difficulty is more pronounced when the variable of interest, such as a national-level policy, is systemic. This paper demonstrates that by using pseudo-panel data derived from repeated cross-sectional data, we can obtain findings relevant to policy-making, thereby mitigating some of the challenges in causal inference, particularly biases from unobserved confounding factors.

The specific topic addressed in this paper is the assessment of policy factors related to the youth's choice to teach. In general, improving the availability and quality of teacher personnel is a universal and important issue for public education policy (OECD 2018). These research areas concerning the choice of teaching career and teacher supply have been interdisciplinary in education (educational policy studies, sociology of education, educational psychology, etc.) and economics (economics of education, labor economics). In particular, empirical research on the basic issues of "who chooses to teach" and "what factors increase the number of people who want to teach" has been conducted in many countries. While educational and psychological research have pointed out the importance of psychological factors, work environment factors have not been recognized as the main factors influencing career choice (Watt et al. 2017). On the other hand, empirical studies in the economics of education and labor economics have focused exclusively on the impact of salary levels as a policy variable on entry and exit from the workforce and have partially argued for its contribution (Corcoran et al. 2004; Dolton 1990; Manski 1987).

Moreover, Japan, where the presenter is from, has historically excelled in maintaining high-quality teachers, as evidenced by their high competency (Hanushek et al. 2019) and low turnover rates, compared to other countries. However, recent years have seen a growing trend among young people to avoid teaching careers. Japan now faces challenges similar to many countries experiencing a structural teacher shortage. Public debates often cite the relatively inferior work environment of teaching compared to other white-collar jobs as a factor in this avoidance. Yet, substantial evidence is lacking to inform policy priorities in this area.

In this study, we position and extend the groundbreaking recent studies that have used PISA student-level data to analyze the youth’s choice of teaching profession (Park & Byun 2015; Han 2018) as important prior work. We differ from that study in terms of methodology, using pseudo-panel data composed of subpopulations of countries as units; we apply a cross-classified hierarchical model to ask "Which policy factors" promote "whose" entry into the teaching profession among young people? We specifically focus on policy factors related to the working environment, namely, the relative salary level of teachers compared to other professions and the workload of teachers (working hours, number of students per teacher, and time spent on non-teaching tasks).

Applying a cross-classified hierarchical model to the pseudo-panel data, we respond to the question of "which policy factors" encourage "whom" of young people to enter the teaching profession, addressing both causal inference (controlling for time-invariant confounders) and policy relevance (heterogeneity of policy effects). The cross-classified model, which sets up the random effects/coefficients in two types of units, country, and subpopulation, has a major advantage in that it allows for different policy implications for each country. To further increase the robustness of our model, we are expanding it into a semiparametric model (infinite mixture model) that does not rely on a multivariate normal distribution for random effects and coefficients.


Methodology, Methods, Research Instruments or Sources Used
   One problem with existing quantitative empirical studies of the choice of teaching profession and teacher supply is their weak consideration of causal inferences (especially in addressing unobserved confounding factors). This paper attempts to address these problems through an analysis using pseudo-panel data. Pioneering studies based on pseudo-panel data in education (but different from the topic of this paper) include Gustafsson (2008, 2013), who applied them to data from large-scale international surveys, and the ideas in this paper also rely on them.

   In this paper, we use student-level data from OECD member countries in the Programme for International Student Assessment (PISA) as data related to teacher choice. PISA survey data are usually used in empirical analyses with academic achievement as the outcome variable, but they have already been used in several studies of career choices because they include questions on items related to occupations in which students expect to be employed at age 30 (Park & Byun 2015; Han 2018; Han et al. 2018, 2020). Existing studies often rely on cross-section data from a specific time period. In contrast, our analysis uses pseudo-panel data compiled from multiple time points. As each PISA survey targets different respondents (15-year-old students from each country at each time point), it does not constitute individual-level panel data. However, by reorganizing this data into a subpopulation-based panel format, incorporating multiple attribute information, we can exploit the benefits of panel data, such as controlling for time-invariant confounding factors.

  In creating the pseudo-panel data, subpopulations were defined based on information about gender, parental occupation (whether the parent's occupation was in teaching or not), and cognitive ability (subdivided into 10 groups based on PISA scores). The aspiration rate of primary and secondary education teachers within each subpopulation is used as the dependent variable to clarify which policy factors related to the working environment each youth group strongly responds to, influencing their choice or rejection of the teaching profession. Policy factors concerning the working environment include 1) salary level, 2) teacher-student ratio, 3) working hours, and 4) the amount of non-teaching tasks, focusing on the national and temporal levels. The data on policy factors are based on country and time units. These data are analyzed using Bayesian cross-classified parametric/semi-parametric hierarchical models. By employing a cross-classified hierarchical model, we can assume that the effects of policy factors vary between countries and subpopulations, allowing us to obtain policy-relevant insights.

Conclusions, Expected Outcomes or Findings
   By utilizing Bayesian cross-classified hierarchical models on pseudo-panel data regarding the youth’s choice of teaching profession, we could analyze the impact of various policy factors related to the working environment. This approach allowed us to control for time-invariant confounding factors and clarify heterogeneity in the effects of each policy factor across different subpopulations and countries.

   Regarding overall trends, enhancing the working environment appears to motivate female students to choose teaching as a profession more than male students. Specifically, improvements in relative salary, student-teacher ratios, and reduced working hours significantly encourage highly qualified individuals to enter the teaching field. Concerning the effect's magnitude, we observed that a one standard deviation improvement in these factors increases the proportion of students aspiring to teach by 0 to 2 percentage points. However, for high-ability male students whose parents are not teachers, we found no significant incentive to pursue a career in teaching.

   While it is difficult to summarize the differences in policy effects across countries, focusing on Japan, which is the primary concern of the presenter, we find the relative salary level and relative working hours compared to other occupations have a stronger impact. Similarly, the analysis results can point to specific characteristics in other countries.

   These findings contrast with previous research in education and psychology on the choice of the teaching profession, which often underestimates the role of extrinsic factors due to the analogical application of motivational theories of learning. Our findings reveal that the working environment plays a crucial role in influencing young people's decisions to enter the teaching profession and in determining the overall supply of teachers. Moreover, they identify which policy factors will affect the quality of teacher supply.

References
Bryk, A. S., and S. W. Raudenbush (2002) Hierarchical Linear Models: Applications and Data Analysis Methods, Sage Publications.

Condon, P. D. (2020) Bayesian Hierarchical Models with Applications Using R, 2nd edition, CRC Press.

Corcoran, S. P., W. N. Evans, and R. M. Schwab (2004) “Women, the Labor Market, and the Declining Relative Quality of Teachers,” Journal of Policy Analysis and Management, 23(3): 449-470.

Dolton, P. J. (1990), “The Economics of UK Teacher Supply: The Graduate's Decision,” The Economic Journal, 100: 91–104.

Gustafsson, J. (2008) “Effects of International Comparative Studies on Educational Quality on the Quality of Educational Research,” European Educational Research Journal, 7(1):1-17.

Gustafsson, J. (2013) “Causal Inference in Educational Effectiveness Research: A Comparison of Three Methods to Investigate Effects of Homework on Student Achievement,” School Effectiveness and School Improvement, 24(3): 275-295.

Han, S. W. (2018) “Who Expects to Become a Teacher? The Role of Educational Accountability Policies in International Perspective,” Teaching and Teacher Education, 75:141–152.

Han, S. W., F. Borgonovi, and S. Guerriero,  (2018) “What Motivates High School Students to Want to Be Teachers? The Role of Salary, Working Conditions, and Societal Evaluations About Occupations in a Comparative Perspective,” American Educational Research Journal, 55(1): 3–39.

Han, S. W., F. Borgonovi, and S. Guerriero (2020) "Why Don’t More Boys Want to Become Teachers? The Effect of a Gendered Profession on Students’ Career Expectations," International Journal of Educational Research, 103:101645.

Hanushek, E. A., J. F. Kain, and S. G. Rivkin (2004) “Why Public Schools Lose Teachers”, Journal of Human Resources, 39(2): 326–354.

Hanushek, E. A., M. Piopiunik, and S. Wiederhold (2019) “The Value of Smarter Teachers: International Evidence on Teacher Cognitive Skills and Student Performance,” Journal of Human Resources, 54(4), 857-899

Kleinman, K. P. and J. G. Ibrahim (1998) “A Semiparametric Bayesian Approach to the Random Effects Model," Biometrics, 54:921-938.

Manski, C. F. (1987) “Teachers Ability, Earnings, and the Decision to Become a Teacher: Evidence from the National Longitudinal Study of the High School Class of 1972,'' in D. A. Wise ed., Public Sector Payrolls, University of Chicago Press.

OECD(2018) Effective Teacher Policies: Insight from PISA, OECD Publishing.

Park, H., and S. Y. Byun (2015) “Why Some Countries Attract More High-Ability Young Students to Teaching: Cross-National Comparisons of Students’ Expectation of Becoming a Teacher,” Comparative Education Review, 59(3): 523–549.

Watt, H. M. G., P. W. Richardson, and K. Smith eds. (2017) Global Perspectives on Teacher Motivation, Cambridge University Press.