Conference Agenda

Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

Please note that all times are shown in the time zone of the conference. The current conference time is: 17th May 2024, 07:47:49am GMT

 
 
Session Overview
Session
27 SES 11 B: Diversity and the Science and Mathematics Classroom
Time:
Thursday, 24/Aug/2023:
1:30pm - 3:00pm

Session Chair: Anke Wegner
Location: James McCune Smith, TEAL 507 [Floor 5]

Capacity: 63 persons

Paper Session

Show help for 'Increase or decrease the abstract text size'
Presentations
27. Didactics - Learning and Teaching
Paper

Exploring Teachers’ Perceptions towards Inclusive Values for Implementing Differentiated Instruction in Science Lessons

Banu Kurkutova

Nazarbayev Intellectual school, Kazakhstan

Presenting Author: Kurkutova, Banu

Secondary teachers in Kazakhstan have pursued the realization of the Updated Curriculum since 2016 reform. The updated programme requires teachers to teach innovative content and differentiate it to meet the needs of every learner. The most widely-accepted definition of differentiated instruction (DI) belongs to Tomlinson (2017). DI is a way of teaching to reach diverse learners who have diverse needs and employ a variety of ways to engage them sin learning. Being aware of the students’ learning needs will prompt teacher’s instructional practices (Heacox, 2012). There is a variety of differentiated instruction models which mainly focus on differentiating the learning content, process and products (Tomlinson, 2000). Interestingly, Kazakhstani teachers tend to associate DI with the levels of task complexity, however, the discussed approach may provide a great variety of tools (Makoelle, 2020). An explanation for that may lie in the methodological recommendations from the National Academy of Education which monitored the implementation of the new curriculum and as a result issued recommendations. They recommend using levelled assignments from simple to advanced. The methodological recommendation state that Via DI teachers aim to include every learner in the process which makes the education process inclusive and is built on inclusive values. The spread of inclusive education philosophy has become a pushing factor to devise the principles of differentiated instruction and strategies of differentiated learning. Inclusive values are also among universal human values (UN General Assembly, 1948) that guarantee non-discrimination towards human nature. Further on, Booth and Ainscow (2016) underpin the significance of values in achieving school improvement as its driving force and name them “deep-seated beliefs” indicating their profound connection with human actions to create inclusive culture (p.11). They also conceptualized crucial inclusive values for education such as equity and equality, respect, community and collaboration, sustainability, participation and support. As teachers are more involved in the professional development paths and communities in their schools, they tend to welcome inclusive values and practices in such countries as the USA, Canada, Finland, Australia, India etc

The research explored how Kazakhstani teachers translated inclusive values in science classes to meet learners’ individual needs and constructed the link between values and pedagogy to respond to student diversity. Equity and equality are considered to be change-making values in the development of the inclusive school environment. The principles of equity in inclusive education regard the access to education, provision of quality conditions, such as space and pedagogies to enhance students’ growth and achieve more social justice in the society (UNESCO, 2017). Inclusive schools relate diversity to a wider range of human characteristics than merely ability, which means gender, age, culture, ethnicity, socio-economic background and religion. (Ainscow, 2007). Booth and Ainscow (2016) consider all kinds of support to be well-planned when peers learn from each other. And school support policy should embrace not only interaction among children, but also among teacher community to make sure they plan, teach and reflect collaboratively.

The main research question is: what are teachers’ perceptions towards inclusive values for implementing differentiated instruction in science lessons? Sub-questions:

What are science teachers’ perceptions towards inclusive vales in education?

What are science teachers’ perceptions towards DI?

What DI strategies are used for translating inclusive values in science classes?

What challenges do teachers face in DI implementation?


Methodology, Methods, Research Instruments or Sources Used
In this mixed-method study, quantitative data was collected from online survey of science teachers modified from the Differentiated Instruction Survey (Whipple, 2012). The survey aimed at collecting teachers’ perceptions towards inclusive values that enable teachers differentiate instruction in science lessons. The survey was conducted via Qualtrics. This ensured the immediate collection of participants’ responses to a site protected by a firewall.  Qualitative data was gained from lesson observations based on the observation protocol “Inclusive Classroom Observation Tool” (Morningstar & Shogren, 2013). The purpose of it was to get more of explanation of the teacher’s perceptions and experiences, reasons and interpretations towards differentiating learning. The Inclusive Classroom Observation Tool (Morningstar & Shogren, 2013) was adapted and utilised for the evidence of classroom practices, including strategies and approaches to ensure participation and support of every student. Pre and post observation, semi-structured interviews provided context-specific data. Interviews enabled for the collection of in-depth rich data to align with the results of the survey and observations and might identify new issues related to the subject of the study. The researcher interviewed the participants after the lesson observations.  Semi-structured interviews with three science teachers were manually transcribed, coded and analyzed for major themes.Field notes from lesson observations were manually analyzed. Qualtrics data management  was applied to the responses in teacher survey. Data analysis began with the analysis of quantitative data, i.e. questionnaire’s results. Qualtrics data management and statistical analysis were employed for approaching survey responses. They allowed for identifying significant patterns in teachers’ perceptions. The observations of classrooms in a new site yielded valuable data if conducted systematically. Observational schedule was be created.
The interviews were manually transcribed followed by the translation into English and further manually coded and analyzed for major themes. Then categories were closely analyzed to answer the main research question.
Linear Regression analysis was used to correlate teachers’ perceptions towards inclusive values and teachers’ implementation of DI. The linear regression analysis was carried out to identify the correlation between independent variable X and dependent variable Y. Teachers’ perceptions towards inclusive values was considered the independent variable X while teachers’ implementation of differentiated instruction was considered the dependent variable Y.

Conclusions, Expected Outcomes or Findings
Science teachers are aware of the importance of such values as respect for diversity, participation, collaboration, uniqueness, support, encouragement and trust that appear to underlie differentiated instruction to meet the needs of every learner in mixed-ability classes. Two most used strategies for differentiating content were utilizing a variety of assessment tasks and learning materials. Most preferred strategies to differentiate process science teachers said they provide children with choice for learning strategies and grouping students in view of their readiness, interest and preferences. For differentiating by product science teachers opted for connecting the outcome with child interest and providing multiple modes of expression. Another key finding, teachers who place greater importance on inclusive values, tend to implement differentiated instruction more frequently.
The results of the interviews with three science teachers partly supported the survey findings that teachers attempt to differentiate their instruction.  Observational data exposed certain mismatch between what teachers told and what they experienced when teaching.  
The research revealed that teachers find value in inclusion and feel it is important to meet the needs of diverse students and they see that differentiated instruction is a suitable approach to translate these values. However, teachers need to increase their competence in differentiated instruction strategies since they maintain traditional teacher-centred instruction formats in the classroom instead of using differentiated instruction to meet all their students’ needs.
Challenges from the findings might deter realization of equity and equality, participation and collaboration, respect for diversity and trust in school education. The study implications provided insights into the necessity of PD training and workshops on differentiated instruction for teachers that might be crucial for the  local bodies of education and school administrations.This research is relevant for other scholars whose inquiries lie in the field of inclusive education and differentiated instruction to identify their future research topics.

References
Ainscow, M. (2007). Taking an inclusive turn. Journal of research in special educational needs, 7(1), 3-7.
Assembly, U. G. (1948). Universal declaration of human rights. UN General Assembly, 302(2), 14-25.  Retrieved November 18, 2021, from     Universal Declaration of Human Rights | United Nations
Booth, T., & Ainscow, M. (2016). The index for inclusion: A guide to school development led  by inclusive values. Index for Inclusion Network.
Heacox, D. (2012). Differentiating instruction in the regular classroom: How to reach and teach  all learners (Updated anniversary edition). Free Spirit Publishing.
Makoelle, T. M. (2020). Schools’ transition toward inclusive education in post-Soviet countries:     Selected cases in Kazakhstan. Sage Open.
Morningstar, M. E., Shogren, K. A., Lee, H., & Born, K. (2015). Preliminary lessons about    supporting participation and learning in inclusive classrooms. Research and Practice for  Persons with Severe Disabilities, 40(3), 192-210.
Tomlinson, C. A. (2000). The differentiated classroom: Responding to the needs of all learners.    ASCD.
Tomlinson, C. A. (2017). How to differentiate instruction in academically diverse classrooms.   ASCD.
UNESCO. (2017).  A Guide for ensuring inclusion and equity in education; 2017 (inclusiveeducation.ca)
Whipple, K. A. (2012). Differentiated instruction: A survey study of teacher understanding and      implementation in a southeast Massachusetts school district (Doctoral dissertation,   Northeastern University).


27. Didactics - Learning and Teaching
Paper

Examining L2 Textbook Content for Newly Arrived Middle School Students in Sweden: an Analysis of Content and Beliefs

Katerina Kuksa

University of Gothenburg, Sweden

Presenting Author: Kuksa, Katerina

This research is a subset of a broader doctoral study examining conditions for education in second language education in Sweden. The first study examines teachers’ beliefs about teaching newly arrived students Swedish in middle school (Kuksa et. al, 2021) and the second study analyzes the content of L2 textbooks for newly arrived middle school students, as textbooks play a crucial role in shaping learning conditions, language development, and integration into Swedish society. This presentation is about the second study and the aim is to examine how the language development and needs of newly arrived middle school students are addressed in L2 textbooks by answering the following questions: a) What are the characteristics of the textbook content and tasks? b) Are certain reader constructs present in the textbooks, and if so, how can these be described? c) Do the textbooks reflect different beliefs about the Swedish as a Second language as a schoolsubject and if so, in what ways?

Previous studies have highlighted that the primary challenge in teaching newly arrived students is to develop a functional language through ability to speak and understand in daily life, while also building their proficiency in academic language (Cummins, 2000). Textbooks can be a useful resource in language education for, but the lack of resources and skills among teachers to provide explicit language instruction can result in an over-reliance on textbooks. However, L2 textbooks do not always align with the findings of successful second language development as identified by L2 research (Tomlinson, 2017) due to a lack of communication between theorists and practitioners and the use of specialized terminology in publications not accessible to teachers and textbook authors. This results in L2 textbooks providing plenty of activities like filling in blank spaces, transforming sentences, and practicing language under strict guidance. Often they do not provide opportunities to use the language in interactive, communicative activities that would encourage students to express their opinions and intentions (ref?).

The study draws on UNESCO's Agenda 2030, which places a strong emphasis on high-quality education for all as a key aspect in achieving a sustainable society. The theoretical point of departure for this study is Vygotsky's theory of the Zone of Proximal Development (ZDP) combined with the idea of the model reader as proposed by Eco (1979), which posits that the meaning of a text is not only determined by the author, but also by the reader and the context in which the text is read. The model reader is a hypothetical reader who is able to understand the text fully without any misinterpretations or ambiguities and is assumed to have all the necessary background knowledge, cultural references, and linguistic skills. According to Eco, every written text requires the author to create a mental image of the intended reader, which the author subsequently addresses through various linguistic strategies. This means that a textbook has certain expectations of its reader and assumes certain experiences, abilities, and prior knowledge of the intended reader. Relating this to Vygotsky's thoughts on ZPD, it could be argued that the ZPD of the intended model reader should be addressed in teaching materials in order to achieve successful L2 development.

A point of departure is also that all teaching materials convey a certain understanding of knowledge, students, and subject, and through the selection of content and the design of tasks, the Swedish language instruction for newly arrived students is conditioned. The concept of school subject perception, (p. x) or paradigm (as described by Malmgren, 1996), is used to explore how the content, intended readers, and task characteristics are represented in these materials.


Methodology, Methods, Research Instruments or Sources Used
The study has both qualitative and quantitative elements and focuses on printed textbooks in Swedish or Swedish as a second language that are specifically intended for newly arrived students in grades 4 to 6. The publication years range from 2011 to 2022. Five textbooks mached the criteria mentioned above: Fördel Sva för nyanlända 4-6 textbok/övningsbok (Sahlin & Stensson, 2016a, 2016b), Fördel start 4-6 (Fahlgren et.al. 2022), Entré elevbok A (Svensson 2016), Språkkraft svenska för nyanlända 4-6 (Ojala 2017), Språksart svenska som andraspråk: Svenska som andraspråk för nyanlända (Sandberg 2018).

 To answer the first research question, the number of texts, words, pages, and tasks in the textbooks was calculated, as well as the distribution of different topics and types of tasks. The number of words was calculated for running text and the number of gaps or lines that students are expected to fill in the tasks. Gaps refer to tasks that only require students to write one word or phrase in a pre-printed sentence or text, while lines refer to tasks that require students to formulate complete sentences or write a short text. The study does not include any analysis of the images in the textbooks.

The second research question is answered through a qualitative thematic analysis, using the concept of the model reader as proposed by Eco (1979). The analysis focuses on determining the prior knowledge and abilities required to understand the text or complete the task.
The third research question is answered by applying Malmgren's (1996) concept of subject perception. Qualitative thematic analysis is conducted by considering the interpretation of content (texts), the nature of the tasks, the intended students (model readers), and teaching within the students' Zone of Proximal Development (ZPD). This approach allows for an examination of how the texts and tasks provided in L2 textbooks condition the instruction of Swedish as a second language for newly arrived students in middle school.

Conclusions, Expected Outcomes or Findings
The results revealed a large variation in the content offered to students and in how the authors of the textbooks chose to structure it. The main focus was on the development of vocabulary and/or reading and writing of non-fiction texts. The textbooks placed a greater emphasis on reading and writing tasks and less on oral communicative skills or the reading of fiction, although it is a crucial aspect of the Swedish curriculum and helps students to develop critical thinking skills and an understanding of self-identity and existential questions in a wider sense.

The selection of topics and extent of grammatical exercises in the textbooks varied and seemed to be arbitrary. The texts and exercises often assumed varying levels of prior language skills in L2, ranging from everyday language skills to more advanced academic skills, as well as advanced reading and writing abilities in a language other than Swedish. This may make the material challenging for newly arrived students to access and understand, and challenge the students in the Zone of Proximal Development (ZPD).

The main categories of model readers identified were competent native speakers with proficient reading and writing skills in L1 who require genre-specific knowledge and basic vocabulary in Swedish, competent native speakers with developed proficient reading and writing skills in both L1 and Swedish who need genre-specific knowledge, competent native speakers with proficient reading and writing skills in L1 who require basic vocabulary in Swedish. These categories will be discussed further in the presentation together with the
foundings that Swedish as a second language is often perceived as a supportive subject for other school subjects, with limited content, which aligns with previous research that has identified the subject as being primarily used to support Swedish language teaching rather than as an independent subject with its own distinct curriculum.


References
References

Cummins, J. (2000). Language, power and pedagogy bilingual children in the crossfire. Clevedon [England]: Multilingual Matters.

Eco, U. (1979). The role of the reader: explorations in the semiotics of texts. Bloomington: Indiana University Press.

Kuksa, K., Lyngfelt, A. & Ljung Egeland, B. (2021). Svenskundervisning i språkligt heterogena klasser - lärares uppfattningar om språk och social hållbarhet. Forskning om undervisning och lärande, 9(3), 69–88.

Malmgren, L. (1996). Svenskundervisning i grundskolan. (2., [aktualiserade] uppl.) Lund: Studentlitteratur.

Tomlinson, B. (2017). SLA research and materials development for language learning

Выготский Л.С. (1984).  Проблемы детской (возрастной) психологии // Выготский Л.С. Собр. соч.: В 6 т. Т. 4. М. Москва: Педагогика.

Texbooks

Fahlgren, S., Fahlgren, P. & Lundgren, A. (2022). Fördel Start Sva för nyanlända åk 4-6 : ord och enkla fraser. (Första upplagans första tryckning). Stockholm: Natur & Kultur.

Ojala, T. (2017). Språkkraft: svenska för nyanlända. Åk 4-6. (Första upplagan). Malmö: Gleerups.


Sandberg, E. (2018). Språkstart svenska som andraspråk: svenska som andraspråk för nyanlända. (Första upplagan). Stockholm: Liber.

Stensson, H. & Sahlin, P. (2016a). Fördel: Sva för nyanlända. Åk 4-6 Textbok. (Första upplagans första tryckning). Stockholm: Natur & Kultur.
Stensson, H. & Sahlin, P. (2016b). Fördel: SVA för nyanlända. Åk 4-6 Övningsbok. (Första upplagans första tryckning). Stockholm: Natur & Kultur.

Svensson, Y. (2016). Entré Elevbok. A. (Första upplagan). Malmö: Gleerups.


27. Didactics - Learning and Teaching
Paper

Motivational Profiles of High-Achieving Students in the Science Classroom

Marie McGregor

The University of New South Wales, Australia

Presenting Author: McGregor, Marie

Motivation is a critical determinant in student outcomes, including achievements (Vansteenkiste et al., 2009), well-being (Gagne et al., 2015; Ryan & Deci, 2017), creativity, and learning (Vansteenkiste et al., 2009). It influences whether an individual embraces the opportunity to learn or resists (Siegle et al., 2017, 2018), sustains oneself through failures or abandons the task (Subotnik et al., 2011) and reaches their potential or falls short (Siegle et al., 2017). It is a universal construct, meaning that it is essential for all students within the increasingly diverse classrooms that comprise schools today. Recent studies (e.g., Martin et al., 2017) suggest that no single motivation leads to substantial change and that different motivations relate in various ways to outcomes (e.g., well-being vs. ill-being [Ryan & Deci, 2017], creativity vs. uninspired thinking [Csikszentmihalyi et al., 2018], and vitality vs. fragmentation [Orsini et al., 2018]). This variation in student outcomes implies that educators must be familiar with various motivational constructs (Worrell, 2018) to develop adaptive motivational patterns in students. In other words, more motivation is not necessarily better if the motivation is poor quality and associated with detrimental outcomes (e.g., cheating, stress).

Additionally, it is essential to understand the combined effects of different types of motivation at the individual level (Litalien et al., 2019). For instance, self-determination theory posits that motivation comprises specific beliefs (interests, values, pressures, rewards) and a global self-determined motivation which may configure in ways to form patterns within individuals. Studies have examined motivational patterns (or profiles) across a range of contexts, including employment (Graves et al., 2015; Howard et al., 2021), university (Litalien et al., 2019), exercise (Lindwall et al., 2017) and school (Vansteenkiste et al., 2009). Findings suggest patterns of autonomous motivations (e.g., interests, values) are associated with better outcomes than controlled (e.g., ego, rewards, punishments) motivations. However, there is yet to be a clear answer on the benefits of a combined profile typified by autonomous and controlled motivations.

Additionally, most studies still need to integrate global and specific dimensions in research instead of focussing on specific motivations (i.e., interests, values, ego, rewards) at the expense of the global motivation (e.g., Corpus & Wormington, 2014) or vice versa (e.g., Ommundsen & Kvalø, 2007). An exception, Howard et al., (2021) simultaneously considered global and specific motivations and reported profiles that differed across each of these dimensions, with the global dimension representing the most influential factor in employee motivation. Thus, there remains a need to understand further the relative importance of global and specific motivations in characterising profiles and predicting student outcomes.

To the researcher’s knowledge, no studies have explored motivational profiles in a high-achieving population. Instead, there is an ipso facto assumption that high-achieving students are all highly motivated – a myth this study intends to address. Moreover, this study accounts for the dual nature of motivation proposed by self-determination theory to understand how high-achieving students differ quantitatively (global self-determination) and qualitatively (interest, value, ego, rewards). An area that remains unexplored. Surprisingly, few studies have explored motivational profiles at a domain-specific level (i.e., within a single subject), with most considering general motivations towards studying (e.g., Vansteenkiste et al., 2009) college (e.g., Litalien et al., 2019), or employment (e.g., Graves et al., 2015; Howard et al., 2021). Considering how motivational patterns are situated within a specific context is essential. One’s motivations towards science may differ from one’s motivations towards history, and this study intends to address this by investigating profiles within the context of science.

The following research questions emerged:

  • Which motivational profiles emerge in high-achieving students?
  • How do perceptions of the climate of the classroom predict motivational profiles?
  • How do motivational profiles predict student engagement?

Methodology, Methods, Research Instruments or Sources Used
This study used a cross-sectional, non-experimental design to collect survey data from 414 high-achieving students in Years 9 and 10. Relevant ethical approval was obtained from the New South Wales Department of Education and the University of New South Wales, Australia (HREC210175). All survey responses were anonymous to protect student confidentiality. Based on their relevance to the research aims and psychometric rigour, three existing scales were collectively used to develop the survey. These included the Comprehensive Relative Autonomy Index (CRAI; Sheldon et al., 2017), the Teacher as Social Context (classroom climate; Belmont et al., 1992), and the Math and Science Engagement Scale (engagement, Wang et al., 2016).
First, preliminary analyses were conducted to ensure the data were in a suitable numerical format, cleaned, described, and met distributional assumptions for subsequent analyses (e.g., assumptions of normality). Next, bifactor-ESEM was conducted to evaluate the dimensionality of student responses to the C-RAI. This involved estimating and comparing several measurement models to explore possible sources of multidimensionality in data (e.g., confirmatory factor model vs. exploratory structural equation model vs. bifactor confirmatory model vs. bifactor exploratory model). Selection of the final measurement model involved an examination of fit indices, a detailed inspection of the parameter estimates (i.e., factor correlations, cross-loadings, the definition of factors) and a reflection of the theoretical conformity of each model (e.g., Guay et al., 2015; Howard et al., 2018; Litalien et al., 2017; Marsh et al., 2009; Morin et al., 2016).
Finally, latent variable modelling was used to model heterogeneity in the population. Motivation factor scores from the bifactor-ESEM model were used as latent profile indicators to provide partial control for measurement error (Diallo et al., 2016; Peugh & Fan, 2013) to define profiles by global self-determination, intrinsic motivation, identified regulation, introjection approach, introjection avoidance, and external regulation. To select the best fitting model, statistical criteria (e.g., AIC, BIC, CAIC, LMR, BLRT, entropy, posterior probabilities; Nylund-Gibson et al., 2007; Nylund-Gibson & Choi, 2018) were evaluated alongside the substantive meaning and theoretical interpretability of the profiles (Bauer & Curran, 2004; Marsh et al., 2009; Muthén, 2003; Nylund-Gibson et al., 2019). The manual three-step procedure was used to explore how perceptions of the climate of the classroom predicted membership into profiles and how profiles subsequently predicted student engagement in class.

Conclusions, Expected Outcomes or Findings
Four motivational profiles emerged, characterised by unique patterns of specific motivations and global self-determination. This suggested that important motivational information would be lost if one were to consider student motivation only in quantitative (i.e., how much motivation) or qualitative (i.e., which type of motivation) terms or view students as motivationally homogenous. Global self-determination (b = .67, p <.05) and intrinsic motivation (b = .11, p <.05) were powerful predictors of engagement. However, contrary to SDT expectations, introjection approach partnered with autonomous motivations and was a positive predictor of engagement (b = .16, p <.05). Thus, for high-achieving students, the desire to boost one’s ego, feel proud, and experience a sense of accomplishment was a positive motivational driver. This implies that motivational dynamics may be more important than considering motivations in isolation, as it is possible that introjection approach was adaptive only when coupled with high self-determination.
Results supported the benefits of autonomy-supportive teaching (structure, autonomy, involvement) in predicting adaptive motivations and engagement in science. Thus, autonomy-supportive teaching holds much promise. Research has supported the global relevance of teacher professional learning in autonomy-supportive practices to incorporate culturally-informed, responsive, sensitive, and relevant education for all learners (Reeve & Cheon, 2021).
Findings challenged theory by illustrating the distinction between approach and avoidance forms of introjected regulation in the analyses (e.g., motivation to boost vs. motivation to protect one’s ego). Thus, there may be a need to re-evaluate the SDT continuum and the motivations that comprise it and examine under which circumstances students endorse the more maladaptive avoidance form of introjection as opposed to introjection approach.
This investigation's methodological contribution relates to a thorough evaluation of the dimensionality of motivation before estimating profiles in person-centred analyses. This is important to achieve greater clarity and accuracy in understanding the structure of motivation (variable-centred) and within-person dynamics of motivation (person-centred; Morin et al., 2016). The findings make visible the motivational diversity within classrooms to challenge assumptions of homogeneity and understand the complex dynamics at the person-centred level –relevant to all educators who wish to use motivational diversity as a starting point for effective curriculum design for all learners.

References
Belmont, M., Skinner, E., Wellborn, J., & Connell, J. (1992). Teacher as Social Context: A measure of student perceptions of teacher provision of involvement, structure, and autonomy support.
Diallo, T. M. O., Morin, A. J. S., & Lu, H. Z. (2016). Impact of misspecifications of the latent variance–covariance and residual matrices on the class enumeration accuracy of growth mixture models. Structural Equation Modeling, 23(4), 507–531. https://doi.org/10.1080/10705511.2016.1169188
Lindwall, M., Ivarsson, A., Weman-Josefsson, K., Jonsson, L., Ntoumanis, N., Patrick, H., Thøgersen-Ntoumani, C., Markland, D., & Teixeira, P. (2017). Stirring the motivational soup: within-person latent profiles of motivation in exercise. International Journal of Behavioral Nutrition and Physical Activity, 14(1), 4. https://doi.org/10.1186/s12966-017-0464-4
Litalien, D., Gillet, N., Gagné, M., Ratelle, C. F., & Morin, A. J. S. (2019). Self-determined motivation profiles among undergraduate students: A robust test of profile similarity as a function of gender and age. Learning and Individual Differences, 70(January), 39–52. https://doi.org/10.1016/j.lindif.2019.01.005
Marsh, H., Lüdtke, O., Trautwein, U., & Morin, A. J. S. (2009). Classical latent profile analysis of academic self-concept dimensions: Synergy of person- and variable-centered approaches to theoretical models of self-concept. In Structural Equation Modeling (Vol. 16, Issue 2). https://doi.org/10.1080/10705510902751010
Martin, A. J., Ginns, P., & Papworth, B. (2017). Motivation and engagement: Same or different? Does it matter? Learning and Individual Differences, 55, 150–162. https://doi.org/10.1016/j.lindif.2017.03.013
Morin, A. J. S., Boudrias, J. S., Marsh, H., Madore, I., & Desrumaux, P. (2016). Further reflections on disentangling shape and level effects in person-centered analyses: An illustration exploring the dimensionality of psychological health. Structural Equation Modeling, 23(3), 438–454. https://doi.org/10.1080/10705511.2015.1116077
Muthén, B. (2003). Statistical and substantive checking in growth mixture modeling: Comment on Bauer and Curran (2003). Psychological Methods, 8(3), 369–377. https://doi.org/10.1037/1082-989X.8.3.369
Nylund-Gibson, K., Grimm, R. P., & Masyn, K. E. (2019). Prediction from latent classes: A demonstration of different approaches to include distal outcomes in mixture models. Structural Equation Modeling, 26(6), 967–985. https://doi.org/10.1080/10705511.2019.1590146
Peugh, J., & Fan, X. (2013). Modeling Unobserved Heterogeneity Using Latent Profile Analysis: A Monte Carlo Simulation. Structural Equation Modeling, 20(4), 616–639. https://doi.org/10.1080/10705511.2013.824780
Reeve, J., & Cheon, S. H. (2021). Autonomy-supportive teaching: Its malleability, benefits, and potential to improve educational practice. Educational Psychologist, 56(1), 54–77. https://doi.org/10.1080/00461520.2020.1862657
Worrell, F. (2018). Motivation: A Critical Lever for Talent Development. In Talent Development as a Framework for Gifted Education. Implications for Best Practices and Applications in Schools. (pp. 253–281). Prufrock Press Inc.


27. Didactics - Learning and Teaching
Paper

Finding Patterns of Instructional Features Through A Latent Class Analysis

Jimmy Karlsson, Yvonne Liljekvist, Jorryt van Bommel

Karlstad University, Sweden

Presenting Author: Karlsson, Jimmy; van Bommel, Jorryt

This paper reports on an exploratory secondary analysis of classroom observations to inquire patterns of instructional features. These features are explored within and between lesson segments to reveal patterns of instruction, which could provide further knowledge on didactical aspects of teaching and on internal structures of lessons. Insights into these patterns can serve as grounds for further exploration, both between different specific subject contexts and also across different school subjects. The paper aims to answer the following research question: What is the relationship between instructional features within and between different lesson segments.

Observation systems focus on specific dimensions of teaching to deepen understanding and improve teaching (Bell et al., 2019). Although wording, conceptualisation and instrumentalization differ between frameworks, common dimensions include aspects such as instructional clarity, cognitive activation, discourse features and supportive climate (Klette et al., 2017),. Cognitive activation, a concept used in several frameworks (Bell et al., 2019; Klette et al., 2017; Praetorius & Charalambous, 2018), includes practices that “encourage students to engage in higher-level thinking” (Lipowsky et al., 2009, p. 529) by utilizing appropriately challenging tasks, activating previous knowledge and students are expected to explain and challenge their reasoning (Praetorius et al., 2014). Instructional clarity is related to explanation of subject matter and includes aspects of modelling strategies and ways of working (Bell et al., 2019; Klette et al., 2017; Praetorius & Charalambous, 2018). This can be included in the way that Cohen (2018, p. 324) conceptualise explicit instruction as practices that “makes learning processes overt and clear with detailed models, strategies, and examples of the skills students are expected to demonstrate”.

The dimension of cognitive activation and instructional clarity (or degree of explicit instruction) are of special interest for this paper as they are identified to be important aspects of teaching quality, and part of core processes within and across school subjects, and salient in several frameworks. Comparative as well as specific subject didactic research has identified commonalities and differences within and between subjects (Cohen, 2018; Praetorius et al., 2014; Tengberg et al., 2021) regarding these dimensions. For cognitive activation, Praetorius et al. (2014) identified challenges in measuring. They underline the importance of further understanding since cognitive activation might be different depending on the stage of the instructional sequence, or whether it is as the start or end of a lesson. Thus, it is of importance to further explore how instructional features are related within lessons.

The Linking Instruction and Student Achievement (LISA) project is based on the four dimensions previously mentioned as a perspective on instructional quality (Klette et al., 2017). In the LISA-project, instructional features in classrooms was observed and rated following the Protocol for Language Arts Teaching Observation (PLATO) protocol. PLATO revolves around four central domains which are divided into elements (see Grossman et al., 2014, 2015) of which the following are of interest for this paper: modelling (MOD), Strategy Use and Instruction (SUI), Feedback (FB), Intellectual Challenge (IC), Classroom Discourse (CD), Representations of Content (ROC), Connections to Prior Knowledge (CPK), Purpose (PUR). Additionally, the main instructional format was observed, distinguishing between whole class, group work, pair work and individual seat work. Cognitive Activation is mainly related to IC and CD whereas instructional clarity is related to MOD, SUI and ROC.


Methodology, Methods, Research Instruments or Sources Used
Latent class analysis (LCA) provides a probabilistic statistical approach to identify different subgroups, most often called classes, in observed data. The classes represent typologies that can help to understand similarities and differences across observations and variables (Weller et al., 2020). The latent classes stem from patterns in the observed data and class membership is estimated and given a probability (Sinha et al., 2021). This provides a novel approach to observation data which could identify groups of teaching segments and their corresponding characteristic instructional features. Thus, different types of segments can be characterised and aspects of cognitive activation and instructional clarity can be explored, together with other instructional features.

The data stems from the LISA project and a subsample from the Swedish cohort is selected for this analysis. In this sample, 127 mathematics lessons from 16 schools and 31 grade 7 classrooms were videotaped. Each lesson was divided into 15-minute segments giving a total of 403 segments. The average was 13 segments per classroom. Each segment was coded from 1 – 4 for each of the PLATO elements (see Tengberg et al., 2021).

For this study all analysis are performed with R (R Core Team, 2022) and the PoLCA package (Linzer & Lewis, 2011) following the method outlined by Oberski (2016) and Sinha et al. (2021).  

Codes with less than 10% observations are collapsed and grouped to the corresponding side of low (1-2) or high (3-4) end on the scale for that specific PLATO-element. The analysis is run for 1 class solution up to, and including, a 5-class solution. LCA analysis is performed 500 times to find global maximum log-likelihood and avoid local maximum.

Using Bayesian Information Criteria (BIC) and Akaike Information Criteria (AIC) two solutions possible for further inspection are identified, corresponding to 2 and 3 classes as solutions. The 3-class solution is further pursued as it offers a separation of characteristic PLATO-elements within and between the classes and is presented in the results section.

Conclusions, Expected Outcomes or Findings
In conclusion, three different classes of lesson segments and their corresponding instructional features were identified.

The first identified class of segments (proportion = 0.363) was found to exhibit a high probability of incorporating instructional elements that received high ratings, including ROC, MOD, SUI. Additionally, this class was found to possess a higher probability of cognitive activation features mainly related to CD being rated on the higher end, with whole-class instruction as a dominant characteristic, compared to the other classes.

The second class (proportion = 0.325), was characterized by a high probability of individual seat work, with no clear distinction between low or high ratings in IC. However, this class exhibited a high probability of receiving high ratings in ROC and SUI, although lower compared to the first class. This class also had the highest probability of CD being rated as 1, as well as a high probability of MOD being rated as 2, which could indicate a situation where the teacher only addresses a few students.

Finally, the third class (proportion = 0.312) was found to possess a high probability of low-end ratings in MOD and SUI, as well as a high probability of low ratings in ROC. Characteristic for this class of segments was that the teacher was not actively employing instructional features, as identified by PLATO.

The elements of CPK, Feedback and Purpose did not exhibit distinctive patterns in terms of probabilities for low/high-end ratings across the classes. This result suggests that these elements may not be related to the instructional patterns of the three identified classes, but may warrant further exploration in future studies.

The results of the study provide valuable insights into the instructional patterns within  lessons which can be extended to other contexts and subjects.

References
Bell, C. A., Dobbelaer, M. J., Klette, K., & Visscher, A. (2019). Qualities of classroom observation systems. School Effectiveness and School Improvement, 30(1), 3–29. https://doi.org/10.1080/09243453.2018.1539014
Cohen, J. (2018). Practices that cross disciplines?: Revisiting explicit instruction in elementary mathematics and English language arts. Teaching and Teacher Education, 69, 324–335. https://doi.org/10.1016/j.tate.2017.10.021
Grossman, P., Cohen, J., Ronfeldt, M., & Brown, L. (2014). The Test Matters: The Relationship Between Classroom Observation Scores and Teacher Value Added on Multiple Types of Assessment. Educational Researcher, 43(6), 293–303. https://doi.org/10.3102/0013189X14544542
Grossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2015). Measure for Measure: The Relationship between Measures of Instructional Practice in Middle School English Language Arts and Teachers’ Value-Added Scores. American Journal of Education. https://doi.org/10.1086/669901
Klette, K., Blikstad-Balas, M., & Roe, A. (2017). Linking Instruction and Student Achievement. A research design for a new generation of classroom studies. Acta Didactica Norge, 11(3), Article 3. https://doi.org/10.5617/adno.4729
Linzer, D. A., & Lewis, J. B. (2011). poLCA: An R Package for Polytomous Variable Latent Class Analysis. Journal of Statistical Software, 42(10). https://doi.org/10.18637/jss.v042.i10
Lipowsky, F., Rakoczy, K., Pauli, C., Drollinger-Vetter, B., Klieme, E., & Reusser, K. (2009). Quality of geometry instruction and its short-term impact on students’ understanding of the Pythagorean Theorem. Learning and Instruction, 19(6), 527–537. https://doi.org/10.1016/j.learninstruc.2008.11.001
Oberski, D. (2016). Mixture Models: Latent Profile and Latent Class Analysis. In J. Robertson & M. Kaptein (Eds.), Modern Statistical Methods for HCI (pp. 275–287). Springer International Publishing. https://doi.org/10.1007/978-3-319-26633-6_12
Praetorius, A.-K., & Charalambous, C. Y. (2018). Classroom observation frameworks for studying instructional quality: Looking back and looking forward. ZDM, 50(3), 535–553. https://doi.org/10.1007/s11858-018-0946-0
Praetorius, A.-K., Pauli, C., Reusser, K., Rakoczy, K., & Klieme, E. (2014). One lesson is all you need? Stability of instructional quality across lessons. Learning and Instruction, 31, 2–12. https://doi.org/10.1016/j.learninstruc.2013.12.002
R Core Team. (2022). R: A language and environment for statistical computing [Manual]. https://www.R-project.org/
Sinha, P., Calfee, C. S., & Delucchi, K. L. (2021). Practitioner’s Guide to Latent Class Analysis: Methodological Considerations and Common Pitfalls. Critical Care Medicine, 49(1), e63–e79. https://doi.org/10.1097/CCM.0000000000004710
Tengberg, M., Bommel, J. van, Nilsberth, M., Walkert, M., & Nissen, A. (2021). The Quality of Instruction in Swedish Lower Secondary Language Arts and Mathematics. Scandinavian Journal of Educational Research, 0(0), 1–18. https://doi.org/10.1080/00313831.2021.1910564
Weller, B. E., Bowen, N. K., & Faubert, S. J. (2020). Latent Class Analysis: A Guide to Best Practice. Journal of Black Psychology, 46(4), 287–311. https://doi.org/10.1177/0095798420930932


 
Contact and Legal Notice · Contact Address:
Privacy Statement · Conference: ECER 2023
Conference Software: ConfTool Pro 2.6.149+TC
© 2001–2024 by Dr. H. Weinreich, Hamburg, Germany