Conference Agenda

Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

Please note that all times are shown in the time zone of the conference. The current conference time is: 17th May 2024, 03:53:04am GMT

 
 
Session Overview
Session
09 SES 09 A: Bridging Research and Practice in Reading Literacy Interventions: Insights and Applications
Time:
Thursday, 24/Aug/2023:
9:00am - 10:30am

Session Chair: Lisa Palmqvist
Location: Gilbert Scott, EQLT [Floor 2]

Capacity: 120 persons

Paper Session

Show help for 'Increase or decrease the abstract text size'
Presentations
09. Assessment, Evaluation, Testing and Measurement
Paper

The relevance of Rapid Automatized Naming (RAN) in research versus practice

Malena Avall

University of Gothenburg, Sweden

Presenting Author: Avall, Malena

Rapid Automatized Naming, (RAN, a measure of the ability to name aloud objects, colours, digits or letters) and phonological awareness are two reading-related measures that are shown to predict early reading ability strongly and reliably (e.g., Moll et al., 2014; Caravolas et al., 2019). However, the relevance and predictive power of each individual measure is still under debate. This study focuses the influence of RAN on early reading ability, problematizing to what extent RAN contributes to assessments aiming to predict reading ability. The main aim, however, is to problematize how this knowledge is best to put into practice. Thus, when is RAN relevant to use as an indicator of reading ability and when are other indicators more relevant?

Because of the efforts being made to identify children, at an early stage, who are at risk of reading difficulties children are in school screened for their reading ability. But screening children is both time-consuming and costly, and therefore it must be well thought out what is being screened for, how to interpret results, but also how are the results to be used and implemented in the school's operations? Thus, given that children's time in school is limited, any activity that focuses on reading achievement must in one way or another be based on knowledge established to improve reading. Hence, the time it takes to screen children needs to be balanced against the time it takes from teaching.

In previous research, RAN is claimed to be a measure of phonological processing time and reflects how fast representations can be retrieved from long-term memory (Bowey et al., 2005; Torgesen, et al., 1997). Further it has been debated whether RAN and phonological awareness each contribute unique information to early reading, or if the measures will be merely two ways of measuring one ability, phonological processing. For example, Chiappe et al. (2002) found that most of the variance contributed by RAN to reading ability is shared with phonological awareness. Further, and in line with the understanding of RAN and phonological awareness being two sides of the same coin, it is claimed by Ziegler et al. (2010) that RAN will only become the dominant predictor when phonological awareness tasks are not challenging enough.

However, another view is that RAN and phonological awareness are two distinct measures predicting early reading ability (Torppa et al., 2013). In a cross-sectional study de Groot et al., (2015) compared reading disabled children with more skilled readers and found that for the reading disabled children the combination of RAN and phonological awareness showed the highest predictive values. When comparing the effects of phonological awareness and RAN on reading ability phonological awareness appears to be the best predictor of reading disability whilst RAN is indicated to be the best predictor of above-average to excellent reading ability (de Groot et al., 2015).

Other longitudinal studies show that the predictive power of RAN and phonological awareness on reading appears to change by age (e.g. Kirby at al., 2003; Vaessen & Blomert, 2010) and hypothesized by some researchers to be connected to the reading strategy used (Vaessen & Blomert, 2010; Rodriguez et al., 2015). Reading development is assumed to shift from a slow sequential phonological decoding to an automatic orthographic processing (Ehri, 2005).

In order to investigate the relevance of RAN in reading assessment, the present study measured RAN repeatedly among a group of children who were followed from kindergarten through their time in elementary school.


Methodology, Methods, Research Instruments or Sources Used
Method
In this longitudinal study 364 children were recruited from 45 preschools in 8 different municipalities. The children were followed between ages 4 and 15. RAN was measured by three different stimuli, objects, digits and letters. RAN-objects was measured between ages 4 and 15. RAN-letters and RAN-digits were measured between ages 8 and 15.
Word reading and reading fluency was examined. Word reading was measured between ages 8 and 15 by two different tests. The word chain test, where three words are printed without inter-word spaces. The task is to mark the correct inter-word spacing with a vertical line. The test is performed on time. The second test was a Word reading list. The task is to read aloud as many printed real words as possible within 60 s. Words were presented in vertical lists and were not graded by difficulty. The test used was specially developed for this study. Number of correctly read words after 30 seconds was recorded.
Reading fluency was measured at two times, when children were 8 years old and when they were 10 years old. At both times the child reads a narrative text aloud consisting of words with varying complexity regarding for example clusters and phoneme/grapheme correspondence. Rate was recorded
The main analytic method used in this study are regression analyses. RAN performance will be regressed on reading ability at different ages and differentiated by level of performance. Both word reading and reading fluency will be taken into account.

Conclusions, Expected Outcomes or Findings
Results
In the current study the preliminary results suggest that when children still are learning to read RAN predicts both word reading and reading fluency. For children slow at RAN this appears to apply even when they get older. However, for children high performing on RAN it appears as if RAN becomes more relevant when children are older, even if it appears to be significant from the beginning.
Thus, in line with previous research, the preliminary results suggests that the predictive power of RAN on reading achievement change as children get older. Further, it can be assumed that children´s reading development is important when interpreting the results, which might also apply to the reading measure used. The relevance of RAN in reading assessments will be discussed.

References
Bowey, J. A., McGuigan, M., & Ruschena, A. (2005). On the Association between Serial Naming Speed for Letters and Digits and Word-Reading Skill: Towards a Developmental Account. Journal of Research in Reading, 28(4), 400-422.
Caravolas, M., Lervåg, A., Mikulajová, M., Defior, S., Seidlová-Málková, G., & Hulme, C. (2019). A Cross-Linguistic, Longitudinal Study of the Foundations of Decoding and Reading Comprehension Ability. Scientific Studies of Reading, 23(5), 386-402. doi:10.1080/10888438.2019.1580284
Chiappe, P., Stringer, R., Siegel, L. S., & Stanovich, K. E. (2002). Why the timimg deficti hypothesis does not explain reading disability in adults. Reading and Writing: An Interdisciplinary Journl, 15, 73-107
de Groot, B. J. A., van den Bos, K. P., Minnaert, A. E. M. G., & van der Meulen, B. F. (2015). Phonological Processing and Word Reading in Typically Developing and Reading Disabled Children: Severity Matters. Scientific Studies of Reading, 19(2), 166-181. doi:10.1080/10888438.2014.973028
Ehri, L. C. (2005). Learning to Read Words: Theory, Findings, and Issues. Scientific Studies of Reading, 9(2), 167-188. doi:10.1207/s1532799xssr0902_4Jacobsson, 2001
Kirby, J., Parrila, R., & Pfeiffer, S. (2003). Naming speed and phonological awareness as predictors of reading development. Journal of Educational Psychology, 95, 453–464.
Moll, K., Ramus, F., Bartling, J., Bruder, J., Kunze, S., Neuhoff, N., Streiftau, S., Lyytinen, H.,. Leppänen, P. H.T, Lohvansuu, K., Tóth, D., Honbolygó, F., Csépe, V., Bogliotti, C., Iannuzzi, S., Démonet, J. F., Longeras, E., Valdois, S., George, F., . . . Landerl, K. (2014). Cognitive mechanisms underlying reading and spelling development in five European orthographies. Learning and Instruction, 29, 65-77. doi:http://dx.doi.org/10.1016/j.learninstruc.2013.09.003
Rodriguez, C., van den Boer, M., Jimenez, J. E., & de Jong, P. F. (2015). Developmental Changes in the Relations between RAN, Phonological Awareness, and Reading in Spanish Children. Scientific Studies of Reading, 19(4), 273-288.
Torgesen, J. K., Wagner, R. K., Rashotte, C. A., Burgess, S., & Hecht, S. (1997). Contributions of Phonological Awareness and Rapid Automatic Naming Ability to the Growth of Word-Reading Skills in Second-to Fifth-Grade Children. Scientific Studies of Reading, 1(2), 161.
Torppa, M., Parrila, R., Niemi, P., Poikkeus, A.-M., Lerkkanen, M.-K., & Nurmi, J.-E. (2013). The double deficit hypothesis in the transparent Finnish orthography: A longitudinal study from kindergarten to Grade 2. Reading and Writing, 26, 1353–1380. doi:10.1007/s11145-012-9423-2
Vaessen, A., & Blomert, L. (2010). Long-term cognitive dynamics of fluent reading development. Journal of Experimental Child Psychology, 105(3), 213-231. doi:http://dx.doi.org/10.1016/j.jecp.2009.11.005
Ziegler, J. C., Bertrand, D., Tóth, D., Csépe, V., Reis, A., Faísca, L., Saine, N., Lyytinen, H., Vaessen, A.,& Blomert, L. (2010). Orthographic Depth and Its Impact on Universal Predictors of Reading:A Cross-Language Investigation. Psychological Science, 21(4), 551-559. doi:10.1177/0956797610363406


09. Assessment, Evaluation, Testing and Measurement
Paper

Early Phonological Intervention: A Ten Year Follow-up

Ulrika Wolff, Jan-Eric Gustafsson

University of Gothenburg, Sweden

Presenting Author: Wolff, Ulrika

An abundance of research has established that phonological awareness skills are important prerequisites for early reading acquisition (for a review, see Melby-Lervåg et al., 2012). Early develop­ment of phonological awareness implies that a child moves from implicit to explicit control of the sound structure of language, and this explicit control is critical when a child learns to understand and handle the alphabetic principle (e.g., Caravolas et al., 2013; Lundberg et al., 2010). Accordingly, there has been a long tradition of research on phonological training to prevent failure to acquire reading skills. Early examples of such studies are Bradley and Bryant (1983) and Lundberg, Frost and Petersen (1988), and results from later training studies have been summarized in several meta-analyses (e.g., Bus & Van Ijzendoorn, 1999, National Early Literacy Panel, 2008). However, even though the results of the training studies show positive effects, Torgesen (2000) found that around two to six percent of the participants in phonological interventions could be defined as “treatment resisters”. Thus, some children do not grasp the idea of phonemes as discrete entities, and they do not seem to enhance their phonological skills to an acceptable level by the training.

Most phonological interventions have been carried out in combination with, or just before, formal reading instruction starts, and studies have typically investigated development over short periods (Kjeldsen et al., 2019). In the present study phonological awareness training was carried out when children were four and five years old (school starts at age 7 in Sweden). The intention was to begin the study at this early stage when children’s explicit awareness of the structure of speech starts to emerge (Wolff & Gustafsson, 2015; Dodd & Gillon, 2001). The training addressed different aspects of phonological awareness, gradually moving from games and exercises with morphemes and syllables to phonemes. Explicit training of phoneme/grapheme mapping (National Reading Panel, 2000) was later introduced when children were six years old, one year before formal reading instruction started. This training was given to all children regardless of whether they belonged to the experimental or control group. Thus, since everyone received the six-year-old training, the potential effects in this study are derived from the early training at ages 4 and 5.

General fluid intelligence (Gf) is a core concept in the field of intelligence. It is interpreted as the capacity to solve novel, complex problems. Gf is highly correlated with phonological awareness in 4-year-old children (Wolff & Gustafsson, 2015), and both phonology and Gf have been found to relate to early reading ability. de Jong & van der Leij (1999) found that when Gf was controlled for, the relation between phonology and reading decreased, and the direct effect of Gf on reading decreased over time. These findings support the hypothesis that the influence of Gf on early reading skills is mediated through the development of phonological awareness. Thus, we may expect that children with high Gf typically will have a more favorable development of phonological awareness skills. One important question here is if the phonological training will decrease or increase this putative influence.

The research questions are: 1) Does structured phonological awareness training starting at the age of 4 affect reading related skills ten years later in grade 8? and 2) Are there differential effects of phonological awareness training as a function of children’s cognitive abilities? The present study thus aims at extending on the rich knowledge of effects of preventive phonological interventions preceding reading instruction. As to our knowledge there are very few previous studies which investigate long-term effects of phonological awareness training during a ten-year period.


Methodology, Methods, Research Instruments or Sources Used
The participants (N=364) were recruited from 58 preschools in 8 municipalities. The participating preschools were situated in rural as well as urban regions, approximately representative of the Swedish population. Also, non-native Swedish speaking children (n=38) were included. The preschools were to have at least three children who could form a group, and who were between 3 and 10 months and 4 years 4 months old. The preschool groups were randomly assigned to an experimental group (n=138) or to a control group (n=226). The groups comprised three to six children. In case there were two groups at the same preschool, both groups were assigned to the same condition. The experimental group received phonological awareness training for six weeks at the age of 4, and for six weeks at the age of 5. Before the intervention at age 4, (t1) a pre-test was given assessing Gf and phonological awareness; four, five and ten years later in grade 2 (t2), grade 3 (t3) and grade 8 (t4) reading related skills were assessed. Informed consent was obtained from all parents before t1.
The method applied in the current study will be Structural Equation Modeling (SEM), and the models will be estimated with the Mplus 7.4 program (Muthén & Muthén, 1998–2012). The analyses will be carried out investigating direct and indirect effects of early phonological training. There are some obvious advantages of using SEM in the present study. It allows for estimation of relations between multiple dependent variables, and for reciprocal and indirect effects. SEM also allows for the use of manifest and latent variables in the same model. The models will be estimated with the Robust Maximum Likelihood (MLR) estimator in Mplus 7. In order to take the cluster-sampling design of the study into account, the so-called ‘complex option’ in Mplus will be used to obtain cluster-robust estimates of standard errors. Chi-square, Root Mean Square of Approximation (RMSEA) with confidence intervals, Comparative Fit Index (CFI), and Standardised Root Mean Square Residual (SRMR) will be reported.

Conclusions, Expected Outcomes or Findings
Previous findings in the project (Wolff & Gustafsson, 2022) demonstrated that early phonological awareness training preceding the ordinary kindergarten training improves children’s further development of phonological skills. Further, the training affected all the reading related measures in grades 2 and 3 (effect sizes running from d =0.37−0.54) and showed to be particularly beneficial for at-risk children. Bearing in mind the phonological training for all children at age 6, these effects five and six years after training are impressive.
The data files for the recently collected grade 8 data are not yet completely cleaned and organized. Still, the effects of the early phonologicl skills on reading in grade 8 were preliminary investigated, using SEM (Muthén & Muthén, 1998–2012). The assumption in the present study is that Gf is mediated through phonological awareness to early reading. Thus, phonological awareness was regressed on Gf, and reading related skills in grade 8 were regressed on phonological awareness. A manifest variable representing group assignment was related to the reading measures. There was an effect of the early phonological training on a latent measure reflecting reading related tasks in grade 8 (es = .40). When scrutinizing the effects on the manifest reading related measures, there was an effect of training on word decoding (es =.25) and reading comprehension (es =.42), whereas there was no significant effect on spelling.
For the current presentation the model will be extended. Reading related measures in grades 2 and 3 will be included, and thus, most of the training effects on grade 8 reading is expected to be indirect through grades 2 and 3 reading. Direct and indirect effects of Gf and phonological awareness will be investigated. Further, interaction effects of group assignment on the one hand, and Gf and phonological awareness on the other hand respectively will be estimated.

References
Bradley, L. & Bryant, P. (1983). Categorizing sounds and learning to read- a causal connection. Nature, 301, 419-421.
Bus, A.G., & Van Ijzendoorn, M.H. (1999).| Phonological Awareness and Early Reading: A Meta-Analysis of Experimental Training Studies.  Journal of Educational Psychology, 91, 403-414.
Caravolas, M., Lervåg, A., Defior, S., Málková, G.S., & Hulme, C. (2013). Different patterns, but equivalent predictors, of growth in reading in consistent and inconsistent orthographies. Psychological Science, 24, 1398-1407. DOI: 1177/0956797612473122
De Jong, P.F., & Van der Leij, A. (1999). Specific contributions of phonological abilities to early reading acquisition: Results from a Dutch latent variable longitudinal study. Journal of Educational Psychology, 91, 450-476.
Dodd, B. & Gillon, G. (2001) Exploring the relationship between phonological awareness, speech impairment, and literacy. Advances in Speech and Language Pathology, 3, 139-147.
Kjeldsen, A. C., Saarento-Zaprudin, S., & Niemi, P. (2019). Kindergarten training in phonological aware¬ness: Fluency and comprehension gains are greatest for readers-at-risk through grades 1 to 9. Journal of learning disabilities, 5, 366–382. https://doi.org/doi/10.1177/0022219419847154
Lundberg, I., Frost, J. & Petersen, O. (1988). Effects on an extensive program for stimulating phonological awareness in pre-school children. Reading Research Quarterly, 23, 263-284.
Lundberg, I., Larsman, P. & Strid, A. (2010). Development of phonological awareness during the preschool year: the influence of gender and socio-economic status. Reading and Writing: An Interdisciplinary Journal, 25, 305-320.
Melby-Lervåg, M., Lyster, S-A. H. & Hulme, C. (2012). Phonological skills and their role in learning to read: A meta-analytic review. Psychological Bullentin, 138, 322-352.
Muthén, L. K. & Muthén, B. O. (2012). Mplus User’s Guide. Statistical Analysis with Latent Variables. Version 7. Los Angeles, CA: Muthén & Muthén.
National Early Literacy Panel. (2008). Developing early literacy: Report of the National Early Literacy Panel. Washington, DC: National Institute for Literacy.
National Reading Panel. (2000). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. Washington DC: National Institutes of Child Health and Human Development.
Torgesen, J.K. (2000). Individual differences in response to early intervention in reading: The lingering problem of treatment resisters. Learning Disabilities Research & Practice, 15, 55-64.
Wolff, U. & Gustafsson, J.-E. (2015). Structure of phonological ability at age four. Intelligence, 53, 108-117. doi.org/10.1016/j.intell.2015.09.003
Wolff, U. & Gustafsson, J-E (2022) Early phonological training preceding kindergarten training: effects on reading and spelling. Reading and Writing, 35, 1865–1887.
https://doi.org/10.1007/s11145-022-10261-x


09. Assessment, Evaluation, Testing and Measurement
Paper

Digital Inclusive Reading Support Evolving Through Practice To Research Transfer

Ralf Junger1, Judith Hanke2, Kirsten Diehl2

1Leipzig University, Germany; 2University of Flensburg, Germany

Presenting Author: Junger, Ralf; Hanke, Judith

A high percentage of students have considerable reading deficits, not only in Germany, but also in other European countries (Betthäuser et al. 2023; Wallner-Paschon et al. 2017). Therefore, formative diagnostics are essential to record the current learning levels of students so that specific interventions can be shaped at an early stage. This discourse has been intensified in Germany as a result of the significant increase in heterogeneity at primary schools and the disconcerting learning deficits of a large number of primary school children after the COVID-19 pandemic (Stanat et al. 2022). As a result, the German Standing Scientific Commission of the Standing Conference of the Ministers of Education and Cultural Affairs of the Federal States recommends the early intensification of nationwide diagnostics and the "provision of scientifically based, quality-assured diagnostic instruments and related support instruments" as formative diagnostics to ensure basic competencies (Köller et al. 2022, p. 74). Additionally, the Progress in International Reading Literacy Study (PIRLS), is not only conducted through a computer-based assessment since 2016, but also has a focus point in digital forms of reading (Mullis & Martin 2019).

In the collaborative BMBF-funded project DaF-L (digital everyday integrated supportive diagnostic - reading in inclusive education) an adaptive, digital and competence-oriented reading screening with adapted reading packages, consisting of reading texts and reading exercises, is being developed, tested, standardized, and subsequently made available as OER on the online learning application Levumi for the third grade of primary schools in Germany. For the project partners of four German universities an essential component in the development and improvement of digital applications is the cooperation between practice and research. Interviews with experts will be conducted in order to advance the reading packages as well as Levumi. The goal is to ensure a direct transfer of research to practice by examining the ecological validity and usability of the instrument as well as the professional development of the partners in the schools with regard to this unique form of the adaptive approach. Ensuing this, the objective is to enable low-threshold, data-based, and effective reading support, to identify conditions for the success of everyday support-based diagnostics and to improve the conditions for inclusive education in primary schools.

The reading packages for promoting reading comprehension in inclusive classes contain reading texts on three ability levels and reading tasks tailored to them. The reading packages are intended to promote the reading skill reading fluently and the reading abilities reading comprehension and strategies for reading comprehension. The ability to read fluently implies that the students can read “quietly, aloud, automatically, accurately, meaningfully, and quickly (KMK 2020, p. 16).” The students have to read texts and solve reading exercises; therefore, they read both repeatedly (Mayer 2018) and a lot (Kruse et al. 2015), thus promoting reading fluency. In the case of reading comprehension, the students read texts that correspond to their ability level and understand the meaning. Skills involve students identifying textual information at the local level, either explicit or gleaned through simple inferencing. In doing so, they also pay attention to linguistic means to ensure the context of the text as well as link text information, draw conclusions, and construct an overall understanding using their previous knowledge (KMK 2020). In the case of possessing strategies for reading comprehension or reading strategies, the students know to use basic cognitive and metacognitive reading strategies after reading. They work with after-reading strategies such as central text statements (KMK 2020).

The global question of how students can benefit from digital reading packages and how the usability of the application can be improved through collaboration between educators and researchers will be explored.


Methodology, Methods, Research Instruments or Sources Used
The collaborative project follows a multi-method design.
An ABA-design was selected for the intervention study. The study will start in April 2023 until July 2023 and will collect quantitative data of individuals, groups, and classes. It will consist of a survey group (N = 100) and a control group (N = 100).
A) It will start with the interviews and the initial testing. The testing consists of the self-developed digital and competence-oriented reading screening and the ELFE 2, which is an established diagnostic test.
B) Three weeks later, in the first lesson the students will take a self-developed digital a-version test aligned with the reading packages. This will be the start of the four-week intervention phase. The intervention (reading support) will be three times a week for 30 minutes in a classroom setting. The students will work on their digital reading exercises individually. Students will receive a reading package based on their ability level. During the intervention students’ answers will be saved digitally. At the end of the intervention, students will participate in the b-version of the aligned test as well as a second administration of the competence-oriented reading screening and the ELFE 2.
A) A follow-up will be conducted with the ELFE 2.

To ensure a direct practice-research transfer, the expert interviews are planned in a qualitative longitudinal design. Through the processual character of the design, the focus on the stakeholders' perspective is intended to improve usability and thus to increase ecological validity. Concurrently, the understanding of diagnosis and diagnostic practices will be examined. For this purpose, qualitative semi-structured expert interviews will be conducted at three different times to accompany the further development of Levumi in consultation with school practitioners. The following research questions will be pursued in the interviews:
1. How do educators rate the usability of Levumi before the redevelopment?
2. What changes would be beneficial from the educators' perspective to increase the usability of Levumi?
3. How do educators evaluate the ecological validity of the newly developed procedures?
4. What diagnostic practices characterize everyday teaching in schools?
In spring 2022, initial expert interviews (N = 7) were already conducted and evaluated as a needs analysis (M1). Based on this, expert interviews (N = 7) will be conducted in March and April 2023 to examine the reading texts and reading exercises (M2) in order to support the development of the reading packages as a practicable instrument.

Conclusions, Expected Outcomes or Findings
Results from the first expert interviews on the needs analysis (M1) show the necessity of the educators’ participation as users in the development of diagnostic procedures. That way, with the help of a practical research transfer, the usability in support-based diagnostics can be improved and the acceptance of the users can be increased. The results will contribute to the further development of the online learning application Levumi and will be verified through supplementary expert interviews (M2).
The outcomes of the study are expected to improve the student's reading abilities. The collaboration and cooperation of educators and researchers for the development and digitalisation of the reading packages enhanced the usability; therefore, the students' reading abilities were additionally supported. Additionally, in general and for the future, the alliance between educators and researchers could be a very beneficial factor for all involved, especially for the students as the collaboration could foster the improvement and implementation of digital tools in the classroom.
In the presentation, interviews (M1 and M2) as well as the development and implementation of the reading packages will be illustrated and discussed under the global question of how the students benefit from the digital reading packages and how the usability of the application can be improved through collaboration and cooperation between educators and researchers. These results provide significant value for the development of reading support and the usability of digital applications in the Pan-European context. Especially in context of the increased and perpetuated learning gaps in primary schools due to the COVID-19 pandemic. Subsequently, the possibility of transmitting the results to other countries will be discussed.

References
Betthäuser, B. A., Bach-Mortensen, A. M. & Engzell, P. (2023). A systematic review and meta-analysis of the evidence on learning during the COVID-19 pandemic. Nature human behaviour. Vorab-Onlinepublikation.
Köller, O., Thiel, F., van Ackeren, I., Anders, Y., Becker-Mrotzek, M., Cress, U., Diehl, C., Kleickmann, T., Lütje-Klose, B., Prediger, S., Seeber, S., Ziegler, B., Kuper, H., Stanat, P., Maaz, K. & Lewalter, D. (2022). Basale Kompetenzen vermitteln – Bildungschancen sichern. Perspektiven für die Grundschule. Gutachten der Ständigen Wissenschaftlichen Kommission der Kultusministerkonferenz (SWK). SWK: Bonn.
Kruse, G., Rickli, U., Riss, M., & Sommer, T. (2015). Lesen. Das Training Klasse 2./3. Klett.
Kultusministerkonferenz (KMK) (2022). Bildungsstandards für das Fach Deutsch Primarbereich. Oktober 12, 2022,
https://www.kmk.org/fileadmin/Dateien/veroeffentlichungen_beschluesse/2022/2022_06_23-Bista-Primarbereich-Deutsch.pdf
Mayer, A. (2018). Blitzschnelle Worterkennung (BliWo): Grundlagen und Praxis. Borgmann.
Mullis, I. V. S., & Martin, M. O. (Eds.). (2019). PIRLS 2021 Assessment Frameworks. Retrieved from Boston College, TIMSS & PIRLS International Study Center website: https://timssandpirls.bc.edu/pirls2021/frameworks/
Stanat, P., Schipolowski, S., Schneider, R., Sachse, K. A., Weirich, S. & Henschel, S. (2022). IQB-Bildungstrend 2021: Kompetenzen in den Fächern Deutsch und Mathematik am Ende der 4. Jahrgangsstufe im dritten Ländervergleich. Waxmann Verlag.
Wallner-Paschon, C., Itzlinger-Bruneforth, U. & Schreiner, C. (Hrsg.). (2017). PIRLS 2016. Die Lesekompetenz am Ende der Volksschule. Erste Ergebnisse. Graz: Leykam.


09. Assessment, Evaluation, Testing and Measurement
Ignite Talk (20 slides in 5 minutes)

Teacher Ratings on the Strengths and Difficulties Questionnaire for Siblings of Children with Chronic Disorders

Caitlin Prentice, Stian Orm, Krister Fjermestad

University of Oslo, Norway

Presenting Author: Prentice, Caitlin

The educational inclusion of children with chronic disorders – such as developmental and physical disabilities – is a well-studied area, across Europe and globally. The siblings of these children, however, are less studied, particularly in relation to their educational experiences and outcomes. Siblings of children with chronic disorders have divergent, and often adverse, life experiences. Some siblings may experience positive outcomes, such as increases in prosocial functioning (Orm et al., 2022). Overall, however, siblings are at risk for negative psychological effects including emotional and behavioural problems (Havill et al., 2019; Vermaes et al., 2012). Reduced psychological well-being, in turn, can affect siblings’ educational experiences, functioning, and outcomes (Gan et al., 2017).

Studies of siblings of children with chronic disorders (herein “siblings”) tend to utilise mainly parent and self-ratings on measures of psychosocial well-being (Hayden et al., 2019). While these perspectives are important, they offer limited insight into the functioning of siblings within a school environment, particularly in the case of parent-rated measures. Given the centrality of school to children’s daily lives and the importance of education outcomes to later life outcomes, it is essential to consider the perspectives of teachers on sibling well-being. The present study aims to address this gap by examining:

1) Teacher ratings for siblings on the Strengths and Difficulties Questionnaire (SDQ)

2) Agreement between teacher and parent ratings on the SDQ, and

3) Factors that may explain disagreement between raters.

Previous studies of child psychosocial functioning – generally, rather than specific to siblings of children with chronic disorders – have found low to moderate levels of agreement between teacher and parent ratings on the SDQ (Murray et al., 2021). This pattern is also found across different measures of child psychosocial functioning. Across these studies, teachers tend to report fewer problems than parents, particularly in the case of internalising problems. Rather than signalling poor reliability of measures, however, the discrepancy between teacher and parent ratings suggests that children’s behaviour is context and rater-specific. Teacher and parent ratings may be seen as complimentary pieces of a larger picture and understanding differences can facilitate better targeted interventions (De Los Reyes et al., 2015). A number of factors may explain a lack of interrater agreement on the SDQ and other measures of child psychosocial functioning. Factors of the home environment, for example, can influence the level of agreement between raters; family stress has been found to be associated with less agreement between teacher and parent ratings while positive parent-child relationship is associated with more agreement (Cheng et al., 2018).

Overall, little is known about the educational experiences of siblings of children with chronic disorders. Furthermore, the SDQ is widely used across European countries and globally. A better understanding of the conditions under which teacher – parent agreement tends to be higher and lower will help researchers and practitioners to interpret SDQ ratings and target solutions and support accordingly.


Methodology, Methods, Research Instruments or Sources Used
The present study is part of a larger RCT evaluating a therapeutic intervention programme, “SIBS”, for siblings and parents of children with chronic disorders (Fjermestad et al., 2020). SIBS aims to improve the emotional and behavioural well-being of siblings and to improve communication between parents and siblings. Participants were recruited from six sites that provide support to children with chronic disorders and their families across Norway. The SIBS intervention consists of five sessions, with separate and joint sibling and parent components. Data – including SDQ scores – were collected at baseline and at 3, 6, and 12 months following the intervention. The present study uses baseline SDQ scores from teachers (n=127) and parents (n=173).

The SDQ is a measure of children’s behavioural and emotional functioning. It is composed of 25 items organised into five subscales: emotional difficulties, conduct problems, hyperactivity and inattention, peer difficulties, and pro-social behaviour. The first of these four subscales comprise a total difficulties scale of 20 items. Each item includes a statement about the child’s behaviour and three options: not true (0), somewhat true (1), and certainly true (2). The SDQ has been validated across a range of populations and contexts. The psychometric properties of the teacher and parent versions of the SDQ are strong, with satisfactory internal consistency and test-retest reliability (Stone et al., 2010).

Means and standard deviations of teacher and parent scores will be calculated for total difficulties and each of the five subscales. Total scores will be compared with population norms using paired sample t-tests. Agreement between teacher and parent ratings will be calculated using Pearson’s correlation coefficient, for both the SDQ totals and the subscales. Finally, factors associated with agreement will be tested using logistic regressions, and will  include gender and age of the sibling, family stress, child-parent communication, and diagnosis of the child with the chronic disorder.

Conclusions, Expected Outcomes or Findings
Data analysis is currently in progress and therefore results are forthcoming. Preliminary results suggest that siblings’ teacher total SDQ scores are similar to population norms (M = 6.50, SD = 4.89) and that teachers’ scores were significantly lower than parent reports (effect size difference: mother d = .37 and father d = .46).

Results of the study will provide a novel insight into the well-being of siblings of children with chronic disorders and how their strengths and difficulties may be enacted in a school environment. Additionally, the study contributes to discussions about agreement between teacher and parent ratings on the SDQ, providing data from a unique sample of children. Finally, results will contribute to the literature on factors associated with agreement / disagreement between raters, such as parent-child communication, family socio-economic situation, and family stress levels. In previous studies of siblings of children with chronic disorders, the diagnosis of the child with the disorder has affected sibling well-being; thus, it is possible that this factor may also be associated with differences in teacher and parent SDQ scores.    

School is an important part of young people’s lives and teachers play a key role in young people’s well-being and life outcomes. The results from this study can be used to build a foundation for understanding siblings’ experiences and behaviours at school, allowing practitioners to build on existing strengths and offer targeted support if required.

References
Cheng, S., Keyes, K. M., Bitfoi, A., Carta, M. G., Koç, C., Goelitz, D., Otten, R., Lesinskiene, S., Mihova, Z., Pez, O., & Kovess-Masfety, V. (2018). Understanding parent-teacher agreement of the Strengths and Difficulties Questionnaire (SDQ): Comparison across seven European countries. International Journal of Methods in Psychiatric Research, 27(1), e1589. https://doi.org/10.1002/mpr.1589
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. https://doi.org/10.1037/a0038498
Fjermestad, K. W., Silverman, W. K., & Vatne, T. M. (2020). Group intervention for siblings and parents of children with chronic disorders (SIBS-RCT): study protocol for a randomized controlled trial. Trials, 21(1), 851. https://doi.org/10.1186/s13063-020-04781-6
Gan, L. L., Lum, A., Wakefield, C. E., Nandakumar, B., & Fardell, J. E. (2017). School Experiences of Siblings of Children with Chronic Illness: A Systematic Literature Review. Journal of Pediatric Nursing, 33, 23–32. https://doi.org/10.1016/J.PEDN.2016.11.007
Havill, N., Fleming, L. K., & Knafl, K. (2019). Well siblings of children with chronic illness: A synthesis research study. Research in Nursing & Health, 42(5), 334–348. https://doi.org/10.1002/nur.21978
Hayden, N. K., Hastings, R. P., Totsika, V., & Langley, E. (2019). A Population-Based Study of the Behavioral and Emotional Adjustment of Older Siblings of Children with and without Intellectual Disability. Journal of Abnormal Child Psychology, 47(8), 1409–1419. https://doi.org/10.1007/s10802-018-00510-5
Murray, A. L., Speyer, L. G., Hall, H. A., Valdebenito, S., & Hughes, C. (2021). Teacher Versus Parent Informant Measurement Invariance of the Strengths and Difficulties Questionnaire. Journal of Pediatric Psychology, 46(10), 1249–1257. https://doi.org/10.1093/jpepsy/jsab062
Orm, S., Haukeland, Y., Vatne, T., Silverman, W. K., & Fjermestad, K. (2022). Prosocial Behavior Is a Relative Strength in Siblings of Children with Physical Disabilities or Autism Spectrum Disorder. Journal of Developmental and Physical Disabilities, 34(4), 591–608. https://doi.org/10.1007/s10882-021-09816-7
Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010). Psychometric Properties of the Parent and Teacher Versions of the Strengths and Difficulties Questionnaire for 4- to 12-Year-Olds: A Review. Clinical Child and Family Psychology Review, 13(3), 254–274. https://doi.org/10.1007/s10567-010-0071-2
Vermaes, I. P. R., van Susante, A. M. J., & van Bakel, H. J. A. (2012). Psychological Functioning of Siblings in Families of Children with Chronic Health Conditions: A Meta-Analysis. Journal of Pediatric Psychology, 37(2), 166–184. https://doi.org/10.1093/jpepsy/jsr081


 
Contact and Legal Notice · Contact Address:
Privacy Statement · Conference: ECER 2023
Conference Software: ConfTool Pro 2.6.149+TC
© 2001–2024 by Dr. H. Weinreich, Hamburg, Germany