Abstract
Many children on the autism spectrum demonstrate difficulties in oral language development (Kwok et al., 2015), which strongly impacts their outcomes in academic, vocational, health, and social spheres. One oral language skill that is critical for successful communication, social interaction, and reading comprehension is inferential narrative comprehension. For example, growing evidence indicates the important concurrent and predictive association between inferential narrative comprehension and reading comprehension (Cain et al., 2001; Kendeou et al., 2008; McIntyre et al., 2020; van Kleeck, 2008). To date, however, there is little detailed information about the inferential narrative
Narrative comprehension
Narratives may be conceptualized as a sequence of goal-directed actions aimed at solving a problem (Trabasso & Nickels, 1992). Paris and Paris (2003) argue that narrative comprehension relies on the development of a range of skills including visual and mental perspective taking (i.e., theory of mind [ToM]) and story grammar. Although both factual (i.e., understanding explicitly stated information) and inferential (i.e., understanding information that is not explicitly stated by making links) comprehension are important, to
The ability to make causal connections between events and actions takes place early in development, well before children learn how to read. Van den Broek et al. (2005) proposed broad developmental steps in inferencing. Based on their proposal, children develop the ability to create inferential links between concrete and physical events (e.g., a child breaks a toy by dropping it on the ground) before the ability to create links between abstract and internal events (e.g., the child is feeling sad and wants to repair the toy). A few researchers have attempted to identify/attach more precise ages to oral narrative inferencing abilities. To illustrate, by 4 years of age children may be able to provide adequate answers to questions about the character’s main problem (Filiatrault-Veilleux et al., 2016). Mental state inferences would also appear early in development, at approximately 3–4 years of age (Ford & Milosky, 2003, 2008; Spackman et al., 2006), coinciding with steps in ToM development in TD around this age (Wellman & Liu, 2004). By the age of six, TD children are able to infer consequences of actions or events, infer the attempts to solve a problem, and may be able to predict what will happen next (Adams et al., 2009). Various approaches to assessing these skills have been developed to date.
Assessment of inferential narrative comprehension
Narrative comprehension has been assessed in various ways, including different question types, prompts, and material types (see Filiatrault-Veilleux et al., 2015). Question types can include: (a) factual versus inferential questions (Young et al., 2005); (b) text-connecting, coherence, or text-based questions (for which answers can be found in text, e.g., Cain et al., 2001) versus gap-filling questions (Norbury & Bishop, 2002); or (c) elaborative questions, for which connections with background knowledge are required (e.g., Cain et al., 2001). Paris and Paris (2003) further distinguished between inferencing questions about characters’ feelings, dialogues, causal relations, predictions, and themes, in line with the importance of causal inferences for narrative comprehension and how they are hierarchically connected to elements of story grammar (Makdissi & Boisclair, 2006; van Kleeck, 2008). This distinction may be particularly useful when evaluating the inferential narrative comprehension skills of children on the autism spectrum as it allows for investigation of relative strengths and weaknesses that may align with core (e.g., social communication) and associated (e.g., ToM delays and differences) features. Inferencing can involve either coherence inferences (text-based or bridging) that are essential for making links between premises in a text, or they can be elaborative inferences that connect with one’s general knowledge and enrich text representation (e.g., Cain et al., 2001).
Responses required as well as scoring of children’s responses differ between study assessment methods, from prompts leading to dichotomous ratings (correct/incorrect) to requests for elaborations of responses that were rated by quality. For example, Westerveld and Roberts (2017) rated children’s responses as correct or incorrect. In contrast, Paris and Paris (2003) asked children to explain “why” to obtain a richer understanding of the depth of the children’s inferencing ability. They provided a scoring rubric (0–2 points) to distinguish between wrong answers, appropriate answers derived from a single picture, and appropriate answers based on integrating information from multiple pictures. Other researchers have extended this scoring system in an attempt to more closely appraise the quality of children’s responses to inferential questions (Adams et al., 2009; Desmarais et al., 2013; Filiatrault-Veilleux et al., 2016; Lynch & van den Broek, 2007). In these studies, children’s responses were categorized into (a) expected, (b) incomplete, (c) low contingency, and (d) inadequate or off topic. Categorizing children’s responses in this way allows for a more nuanced analysis of children’s performance, and ultimately provides detailed information for effective intervention strategies that can be used in clinical practice.
Finally, assessment of inferential comprehension also varies in terms of the materials that are used during the listening task. Filiatrault-Veilleux et al. (2015) in their scoping review found a wide range of tasks to measure inferential comprehension in children ages 3–6 years, including experimental short stories, story books, published assessments, or short videos, which were either read aloud, or presented via audio or video output.
Inferential comprehension in children with language disorders
Research has explored inferential narrative comprehension development and difficulties in preschool children with language impairment (Kendeou et al., 2008; Rapp & van den Broek, 2005; Reuterskiöld Wagner et al., 1999) as well as school-age children with identified language difficulties (Adams et al., 2009; Botting & Adams, 2005; Bowyer-Crane & Snowling, 2005; Dawes et al., 2018; Dodwell & Bavin, 2008; Ryder et al., 2008). These studies show that children with language disorders have difficulties in completing inferential comprehension tasks. For example, Dodwell and Bavin (2008) found significant differences between 6-year-old children with specific language impairment (SLI, now termed as developmental language disorder [DLD]) and their age-matched peers on inferential questions of the comprehension task from the
Dawes et al. (2018) set out to identify in more detail the language and cognitive skills contributing to narrative inferential comprehension in a group of 67 children with DLD, aged between 5;2 and 6;2. Children watched and listened to a story on an iPad and were asked 14 inferential questions and 10 literal questions while looking at the pictures for a second time. All questions were scored on a 0–2 scale. Results indicated significant associations between inferential narrative comprehension and children’s ability to produce coherent narratives (i.e., narrative macrostructure), their use of vocabulary and syntax during story retell, literal comprehension, vocabulary knowledge, and ToM. Although only narrative macrostructure and ToM were
Autism spectrum disorder (ASD) and inferential comprehension
ASD is characterized by social communication impairments and restrictive and repetitive behaviors and interests (DSM-5; American Psychiatric Association, 2013). ASD is also associated with comorbid language impairments (Kwok et al., 2015), intellectual disability (∼30%; Maenner et al., 2020), and delays and differences in ToM development (see, e.g., Baron-Cohen, 2000; Peterson et al., 2005). ASD is referred to as a “spectrum” due to the spectrum of support needs (from low to high) in both core (i.e., social communication and behavior) and associated features (e.g., cognitive profiles and intellectual functioning, oral language ability, and ToM). Significant heterogeneity is observed in the specific profile of strengths and needs observed in a specific individual with levels of support potentially divergent across areas.
Both core and associated features of ASD may impact narrative comprehension. Challenges in structural language skills at word (vocabulary) and sentence (morpho-syntax) levels may hamper children’s understanding at the text level (e.g., narrative), similar to the difficulties observed in children with DLD (Dawes et al., 2018). Structural language skills (vocabulary and syntax) have also been associated with ToM performance (Paynter & Peterson, 2010) and may thus directly or indirectly (via ToM) impact on inferential comprehension. Intellectual impairment puts children at risk for learning difficulties in general, consistent with the diagnostic criteria (American Psychiatric Association, 2013). Social communication impairments along with difficulties with ToM may also impact on narrative comprehension. ToM refers to perspective taking, including the ability to understand and predict behavior in oneself and other people, and requires understanding of mental states (belief, knowledge, and intentions). ToM difficulties may affect children’s ability to understand the behavior of characters depicted in stories and thus influence their ability to answer questions regarding the story characters’ mental states (e.g., questions referring to the characters’ internal responses) and goal-directed actions. Taken together, challenges with social communication, ToM, and oral language may make children on the spectrum vulnerable to difficulties with inferential comprehension.
While limited, research to date indicates inferential comprehension difficulties in children on the spectrum compared to their TD peers (Norbury & Bishop, 2002; Nuske & Bavin, 2011; Young et al., 2005). For example, Norbury and Bishop (2002) examined the inferential comprehension skills of four groups of children, ages 6–10 years, all of whom demonstrated nonverbal ability within the normal range: (1) SLI or DLD (
The current study
We sought to describe the inferential narrative comprehension skills of verbal children (i.e., able to complete the verbal tasks) on the autism spectrum in their first year of schooling and compare their performance to TD peers matched for age and year of schooling. In the autism group, we investigated the impact of structural language ability (i.e., spoken language skills at word and sentence level as measured on a standardized language test) on children’s inferential comprehension skills. We recruited a relatively large group of 35 children diagnosed with ASD, ranging in age from 5;7 to 6;11, who were all in their first year of schooling, and did not exclude children based on their performance on a standardized language test (e.g., Young et al., 2005). This allowed us to investigate the performance of two subgroups of children on the autism spectrum based on their structural language ability level. First, we compared their performance to that of a group of TD children matched for age and year of schooling. Unlike previous studies (Nuske & Bavin, 2011), this design ensures the children are matched for experience and exposure to the school curriculum. Second, we used an ecologically validated task containing a problem-oriented story that is reflective of the school curriculum, as opposed to short scripts (Nuske & Bavin, 2011) or reactive sequences (Norbury & Bishop, 2002), which may be more relevant for clinical practice. Third, we not only considered the children’s performance on factual versus inferential comprehension questions, we also investigated children’s inferential comprehension performance, specifically looking at causal inference type questions linked to the story characters’ internal response (see Filiatrault-Veilleux et al., 2015). Finally, we adopted a fine-grained coding system for analyzing the children’s responses (Desmarais et al., 2013; Filiatrault-Veilleux et al., 2016), which may in future inform intervention planning in particular.
Two research questions were addressed:
Compared to their TD peers, do children on the autism spectrum show difficulties in inferential comprehension, regardless of their structural language ability? Do children on the autism spectrum show specific significant difficulties in answering inferential questions related to the story characters’ internal response, regardless of their structural language ability?
Based on previous research, and given established challenges in ToM, we anticipated that the children on the spectrum would show difficulties in inferential comprehension, particularly in answering questions related to the story characters’ internal response (Baron-Cohen, 2000; Nuske & Bavin, 2011).
Method
Ethics approval was granted by the University Human Ethics Committee (AHS/13/14/HREC). Approval was also provided by the authorized director from the Department of Education and the school principals. Written parental consent and child assent was obtained prior to the data collection.
Participants
Participants on the autism spectrum included all children (
The children with TD were drawn from a larger study aimed at creating normative data by collecting spoken language samples of young school-age children (Westerveld & Vidler, 2016). To qualify for inclusion, the participants met the following criteria: (a) attended year 1 of formal schooling; (b) were aged between 5;8 and 7;1 to match to the autism group; (c) spoke English as their first language; and (d) were progressing in line with grade expectations at school and had no history of speech and/or language impairment based on parent report. A total of 32 children were selected, ranging in age from 5;8 to 7;1 (mean age 6;4), with 13 boys and 19 girls. There were no statistically significant differences in age between the two groups of participants (ASD vs. TD)
Procedures and measures
All children were assessed individually by certified practicing speech pathologists either at the child’s school or at a venue convenient to the family. All sessions were audio-recorded for transcription and reliability purposes.
Language ability
To assess children’s structural language skills, we administered the core language subtests from the
Participant characteristics.
Note: SCQ = Social Communication Questionnaire; DQ = developmental quotient; CELF-P2 = comprehensive evaluation of language fundamentals-preschool; CLS = core language score; ASD = autism spectrum disorder; BNL = below normal limits; WNL = within normal limits; TD = typically developing; SD = standard deviation.
Measures administered before school entry (see Westerveld et al., 2017).
Narrative comprehension
This task used the protocol described in Westerveld et al. (2004). This task has been used extensively in the past with young school-age children from New Zealand and Australia (e.g., Lennox et al., 2018; Westerveld et al., 2004), including preschool age children on the spectrum (Westerveld & Roberts, 2017). Children were asked to listen to a recording of the story “Ana Gets Lost” (Swan, 1992), while looking at the pictures on a computer screen. Following the first exposure to the story, children were asked eight comprehension questions, without access to the pictures (see Appendix A).
Comprehension scoring
Scoring of the children’s answers to the eight questions followed a well-validated coding methodology consisting of classifying children’s story comprehension answers in different levels of quality, inspired by the scoring system of the
As shown in Appendix A, questions 1, 6, and 7 were classified as factual questions (e.g., Who found Ana?), because they relied on information mentioned explicitly in the story, with a maximum score out of 9 points. Questions 2, 3, 4, 5, and 8 were classified as inferential questions (e.g., Why did Ana have to stay home?), because they relied on drawing inferences from provided information and answers were not explicitly mentioned, for an inferential score out of 15 points. To examine whether inferential questions targeting internal responses were more difficult for the participants on the spectrum, we sub-classified the inferential questions based on whether they required understanding of the character’s internal response, i.e., mental state questions (e.g., Why did Ana get scared?), questions 3, 5, and 8, with a maximum score of 9 points, versus questions 2 and 4 which did not target mental states (e.g., “Why did Ana have to stay at home?”) for a total score of 6 points.
Results
Data screening
There were no missing data. Data were screened for assumptions of parametric analyses. There were no outliers; however outcome variables were not normally distributed; thus Kruskal–Wallis H tests were conducted to compare groups, which allowed for inspection of the differences in mean rank scores between groups. Given differences in gender ratio between groups, data were screened for impact of gender on outcomes (four question types), which were all nonsignificant (all
Group performance in narrative comprehension
We first examined the quality of the participants’ responses by group for each question. As shown in Table 2, there was a range of performance on most questions, except for Q6 (factual question) with the TD group showing a ceiling effect. To address our first hypothesis and investigate whether the group differences in narrative comprehension ability could be explained by the children’s autism status and/or their structural language ability, we examined the groups’ (ASD_WNL, ASD_BNL, and TD) performance on the two types of questions, factual and inferential. As shown in Tables 3 and 4, there were no significant differences in mean rank scores between the TD group and the ASD_WNL group for factual comprehension; both the TD group and the ASD_WNL groups outperformed the ASD_BNL group with large effect sizes. Because of ceiling effects on Q6, we reran the analysis based on Q1 and Q7 only; this did not change the results. When evaluating performance on the inferential questions (total score), the mean rank score of the TD group was significantly higher than the mean rank score of the ASD_WNL group (large effect size); in turn the ASD_WNL group significantly outperformed the ASD_BNL group, with a large effect size.
Quality of the responses by question by group, in number of participants (and percentage).
Note: 0 = inadequate or off topic; 1 = low contingency; 2 = incomplete; 3 = expected/correct; ASD = autism spectrum disorder; BNL = below normal limits; WNL = within normal limits; TD = typically developing.
Group performance on the narrative comprehension task, raw scores, omnibus Krukall–Wallis comparison.
Note: ASD = autism spectrum disorder; BNL = below normal limits; WNL = within normal limits; TD = typically developing.
Post hoc comparison of narrative comprehension performance using Dunn’s (1964) procedure.
Note: ASD = autism spectrum disorder; BNL = below normal limits; WNL = within normal limits; TD = typically developing; IR = internal response.
To address our second hypothesis and investigate whether children on the autism spectrum would show specific significant difficulties in answering inferential questions related to the story characters’ internal response, we evaluated group performance (ASD_WNL vs. TD) on the inferential questions tapping internal response (IR) versus more general inferential questions (other). Results revealed no group differences (ASD_WNL vs. TD) for inferential other (
To further investigate these group differences in inferential comprehension, we considered the children’s individual profiles. As shown in Table 5, there was some overlap in scores between the groups. On the inferential (other) questions, three children in the ASD_BNL group (14.2%) and 10 children in the ASD_WNL group (71.4%) performed within or above the interquartile range (IQR) of the TD group (as presented in Table 3) versus 21 of the TD children (81.2%). In contrast, none of the children in the ASD-BNL group and only six children in the ASD_WNL group (43%) performed within or above (one child) the IQR of the TD group versus 27 TD children (84%).
Performance on inferential questions type (with percentage) by subgroup.
Note: ASD = autism spectrum disorder; BNL = below normal limits; WNL = within normal limits; TD = typically developing.
Discussion
The aim of the current study was to investigate the narrative comprehension skills (both factual and inferential) of a group of young school-age children on the autism spectrum compared to their peers without an autism diagnosis, matched for age and year of schooling. Overall, we found significantly lower scores across factual and inferential narrative comprehension in the ASD_BNL group, compared to the ASD_WNL and TD groups, with large effect sizes, supporting the importance of structural language proficiency measured at the word and sentence levels, for narrative comprehension.
Children on the autism spectrum showed greater difficulties in inferential comprehension than their peers without autism, regardless of their structural language ability consistent with our first hypothesis and previous research (Nuske & Bavin, 2011). When comparing the ASD_WNL group to their TD peers, the children on the autism spectrum demonstrated significant difficulties answering inferential comprehension questions, but performed equally well in factual comprehension (Nuske & Bavin, 2011; Young et al., 2005). Taken together, these findings indicate that children on the spectrum are at risk of demonstrating inferential comprehension difficulties, regardless of their structural language ability, similar to children with diagnosed language disorders (Norbury & Bishop, 2002; Nuske & Bavin, 2011; Young et al., 2005). Considering the importance of narrative comprehension for classroom participation and its links with reading comprehension (Kendeou et al., 2008; Paris & Paris, 2007; Storch & Whitehurst, 2002), these findings are of concern and highlight the importance of routinely assessing children’s language skills beyond the word and sentence levels, as all children in the ASD_WNL group showed age-appropriate performance on the core language subtests of the CELF-P2 (SS 82–122).
At group level, children in the ASD_WNL group showed significant difficulties in answering the internal response inferential questions, compared to their TD peers, consistent with our hypothesis that children on the spectrum would show specific difficulties with this type of inferential comprehension task, which could not be explained by structural language impairment as these children all performed within expected ranges. Likewise, nonverbal IQ (as measured at age 4) appears unlikely to explain these difficulties given the ASD_WNL group showed, on average, performance within expected range (
It is acknowledged that our measure of structural language included elements of both vocabulary and syntax. Thus, scoring WNL on an overall measure does not rule out the possibility that specific elements of structural language such as syntax or more specific understanding of complement syntax may facilitate or hinder the ability to complete inferential comprehension questions requiring understanding of mental states. This is an important question for future research, as syntax more broadly (Paynter & Peterson, 2010), and complement syntax more specifically (Lind & Bowler, 2009) have been associated with ToM in previous studies. Thus, future research that explores the associations between vocabulary, syntax, ToM, and narrative comprehension, and ultimately reading comprehension, would be of value in advancing theoretical understanding of reading comprehension in ASD drawing from models (e.g., Dore et al., 2018) proposed for TD.
Limitations and future directions
We provide an initial, exploratory cross-sectional comparison of types of inferential comprehension skills in children with and without autism; however, we acknowledge a number of limitations. Given the exploratory nature of the study, we prioritized controlling Type 2 over Type 1 errors, acknowledging the limitation of the small sample size, and the need for replication with larger sample sizes in future research. The narrative task was not specifically designed to investigate inferential narrative comprehension skills. Future research should consider adding questions to better reflect the range of inferencing skills that are needed to understand the narrative (beyond those tapping into the characters’ mental states), including text-connecting, coherence, or text-based questions, for which answers can be found in-text (e.g., Cain et al., 2001), as well as gap-filling (Norbury & Bishop, 2002) or elaborative questions, for which connections with background knowledge are required (e.g., Cain et al., 2001). We acknowledge inferential comprehension is a complex construct that relies on a wide range of language and cognitive skills (e.g., Dawes et al., 2018; Florit et al., 2011; Potocki et al., 2016; Silva & Cain, 2015). However, as our study was based on secondary analyses of data we were limited in the range of measures available which would have been valuable to explore as potential mechanisms, such as exposure to narratives (either classroom or speech pathology intervention), cognitive functioning (ToM, executive functioning, thinking, and reasoning), current nonverbal IQ, or more fine-grained measures of language and social-communication skills. As such, as proposed above, future research should incorporate additional measures, drawing from models proposed in TD such as the model of Dore et al. (2018). This will allow us to better explore the skills underpinning inferential comprehension abilities in young clinical populations, including those on the autism spectrum, and elucidate why children on the spectrum may display inferential narrative comprehension difficulties, regardless of their overall oral language proficiency at the word and sentence level (Norbury & Bishop, 2003).
Clinical implications
Assessment of inferential comprehension can vary in terms of scoring systems and materials (Filiatrault-Veilleux et al., 2015). In the current study, we used a fictional problem-oriented story that may be considered more difficult than the tasks used in previous studies, including scripts used by Nuske and Bavin (2011) or reactive sequences (Norbury & Bishop, 2002). However, we emphasize the importance of using ecologically valid story comprehension tasks that are frequently used in clinical practice (Westerveld & Gillon, 2010) and that closely align with the school curriculum in order to detect inferential comprehension difficulties in young children on the autism spectrum that are relevant to participation at school. The scoring system used in the current study to categorize children’s responses may further assist in understanding children’s performance, across the quality continuum (see Appendix A), that may inform detailed goal setting and individualized intervention planning (Desmarais et al., 2013; Filiatrault-Veilleux et al., 2016). For example, in a recent intervention study with children with DLD, coding the quality of responses revealed that most children progressively reached the expected/correct target (Desmarais et al., 2013).
We propose an assess-not-assume approach, as indicated by the variability observed within groups that highlights the need to not assume based on diagnosis and language level, nor to take a waiting-to-fail approach to narrative intervention for young children on the autism spectrum. The current study demonstrates how oral narrative comprehension can be assessed in young school-age children who are at high risk of future reading comprehension difficulties, providing an opportunity for early targeted intervention (see also van Kleeck, 2008). Until further research is conducted into the effectiveness of inferential narrative comprehension for young school-age children on the autism spectrum, we need to draw upon existing research that shows that inferential comprehension strategies can be taught through explicit instruction with 4- to 6-year-old children with language disorders (Dawes et al., 2019; Desmarais et al., 2013). Based on our current results, interventions aimed at supporting children’s ability to make inferences about underlying thoughts and emotions, and predict the actions of other people or characters, for example during shared book reading, may be well suited to promote their inferential narrative comprehension and ToM abilities (Symons et al., 2005). This may also include making mental states tangible through the use of thought bubbles to teach children to answer questions about mental states (Paynter et al., 2013). Further research on the interplay between structural language, ToM, and inferential comprehension and their links to reading development may provide an evidence-based framework for understanding the profiles of strengths and needs for students on the spectrum to support skills into the future.
