Abstract
The prevalence of autism continues to increase with approximately 1 in 36 children now receiving diagnoses; this includes more children receiving an evaluation before age 4 (Maenner et al., 2021; Shaw et al., 2023). With this increase in early identification comes increased need for more accessible and effective early intervention practices, including a modality for reaching families and providers in rural and under-resourced areas.
Naturalistic developmental behavioral interventions
Naturalistic developmental behavioral interventions (NDBIs) refer to empirically supported interventions that are rooted in the principles of applied behavior analysis (ABA) and developmental theory (Schreibman et al., 2015). NDBIs are particularly appealing to families of young children, given that they can be implemented in naturalistic contexts, involve shared control between the adult and child, and capitalize on naturally occurring motivation (Schreibman et al., 2015; Vivanti & Zhong, 2020). Despite the effectiveness of NDBIs (Rogers et al., 2019; Stahmer et al., 2020; Wetherby et al., 2018) and the appeal for families of young children, NDBIs are not widely implemented across service delivery systems (D’Agostino et al., 2023).
Systematically training caregivers to implement NDBIs offers one possible solution to increase access. Evidence suggests caregiver coaching improves implementation of evidence-based practices (e.g. NDBIs) and promotes skill growth for young children (Akamoglu & Meadan, 2018; Heidlage et al., 2019; Kasari et al., 2014); furthermore, its effects are often amplified because of the longevity of a caregiver’s relationship with their child (Hampton et al., 2020; Kasari et al., 2014; Lundahl et al., 2006). In addition, coaching within daily routines, may facilitate generalization to novel activities (Kashinath et al., 2006; McDuffie et al., 2013; Moore et al., 2014). Despite the benefits of caregiver coaching, barriers remain in accessing providers trained to coach caregivers in NDBIs, especially in rural and under-resourced communities (Antezana et al., 2017; Drahota et al., 2020; Mello et al., 2016; Wallace-Watkin et al., 2022).
Telemediated caregiver coaching
Telehealth offers the potential for overcoming the barriers identified above (Antezana et al., 2017; Corona et al., 2020, 2021; Juarez et al., 2018; Knutsen et al., 2016; Olsen et al., 2012; Zwaigenbaum & Warren, 2020). Telemediated service delivery has become increasingly popular since the COVID-19 pandemic (Shaver, 2022), with growing evidence to support its use across intervention services (Ellison et al., 2021; Knutsen et al., 2016; Lindgren et al., 2016; Olsen et al., 2012; Wacker et al., 2013) including NDBIs (D’Agostino et al., 2020; Ingersoll et al., 2016; Vismara et al., 2018).
There are several limitations in this literature to understanding the broader utility of telemediated caregiver coaching for NDBI-based programming. First, few large-scale studies on caregiver coaching have been conducted combining telehealth with NDBIs, particularly across varying geographic areas (e.g. rural vs urban), and with families from diverse backgrounds. Thus, we have limited data to understand for whom these interventions are effective and preferred, and whether outcomes are affected by characteristics of the children and families. Second, although utilizing telehealth to coach caregivers in NDBIs has the potential to address important barriers for families, telemediated coaching alone does not address the shortage of providers capable of training caregivers (Yingling et al., 2021) nor the ongoing coaching and professional development opportunities required by providers (Kyzer et al., 2014; Rogers et al., 2022; Wainer et al., 2017).
Infants and toddlers with developmental delays and disabilities are eligible for early intervention services through Part C of the Individuals with Disabilities Education Act (IDEA; “Early Intervention Program for Infants Toddlers with Disabilities,” 2011). These programs are already embedded within communities and offer an ideal platform for helping families access services. Although early intervention providers (EIPs) are trained to deliver general strategies to promote child development, they may be more limited in their understanding of evidence-based practices to address the specific needs of children with autism or related developmental profiles, NDBI strategies, and manualized curricula (Hendrix et al., 2023; Spiker et al., 2000; Stahmer et al., 2005). However, equipping EIPs with the expertise to coach caregivers in NDBI-based strategies within their ongoing visits may alleviate some of the barriers families experience in accessing specialized care.
Caregiver and provider support services
We developed the Caregiver and Provider Support Services (CAPSS) program to (a) increase access to NDBI-based support services following a diagnostic evaluation for autism and (b) build EIPs’ capacity to serve the growing number of autistic children (Maenner et al., 2020). CAPSS was initially developed as an in-person program through which trained consultants from an academic medical center provided caregiver coaching in NDBI strategies. Beginning in July 2020, the program permanently transitioned to a telehealth-only model of service delivery, following data suggesting that the telehealth model resulted in similar child outcomes to in-person services, and increased the capacity of our program by 25% (Corona et al., 2021).
The purpose of this article is to provide an overview of our telemediated NDBI coaching model, while also examining differences that may emerge between diverse groups and initial feasibility and interest of incorporating EIPs in the CAPSS model. We also examine the impact of this model on (a) child outcomes, (b) caregiver and EIP perceptions of acceptability and effectiveness, (c) reported fidelity to treatment model, and (d) provider perceptions of long-term impact on their service provision, while also examining any differences that exist based on family characteristics.
Method
Overview of service model
CAPSS was developed over the course of an 8-year partnership between our university-based medical center and statewide Part C system. The model consists of six, 1-hour telehealth visits between a behavioral consultant (hereafter: consultant) and a family (i.e. child and at least one caregiver). The family’s EIP participates in at least two sessions. The consultant provides services via telehealth from a university-based medical center, the family is typically based at home, and the family’s EIP has the option to participate with the family in person or via telehealth.
Caregiver education
Prior to the start of services, caregivers, the EIP, and consultant collaboratively select one of five domains to target throughout the CAPSS program (i.e. functional communication, social play skills, toilet training, sleep, or dangerous behavior), each with associated curriculum modules. If caregivers would like to target more than one topic, they are encouraged to select their highest priority and EIPs are encouraged to address additional topics with families after participation in the CAPSS program. The five curriculum modules were developed by our team and guided by the principles of NDBIs. Previous versions of this model utilized a well-known manualized curriculum, (e.g. Early Start Denver Model caregiver training (Rogers et al., 2012). However, the unique nature of this approach (e.g. six 1-hour visits, the need for materials that are easily accessed by caregivers and EIPs) and the priorities identified by our statewide system led us to creating our own modules. The specific NDBI strategies taught vary depending on the focus area, the family’s priorities, and the family’s existing skillset. Each module is divided into six lessons that correspond to the six visits included in the series; each lesson requires 15–20 min to complete. The open-access modules include interactive online courses with specific objectives and printable materials (see Figure 1).

Example of curriculum-specific treatment fidelity checklist (communication curriculum).
EIP collaboration
The family’s EIP was required to join a minimum of two sessions; frequently, EIPs participated in all six sessions. During visits, consultants and EIPs collaborated to share expertise on intervention strategies and coach caregivers during naturalistic routines with their child. In addition to collaboration during visits, consultants engaged EIPs by discussing family goals prior to visits, coordinating a plan for each session, and developing a plan for follow-up (see Figure 2).

Visual representation of the CAPSS service delivery model.
Family-guided routines-based intervention
A family-guided routines-based intervention (FGRBI) framework (Woods, 2021) was used throughout each of the six visits. FGRBI is a responsive framework employed to coach caregivers on the use of evidence-based strategies to promote child learning within everyday routines. FGRBI had been adopted by our state Part C system; therefore, most EIPs had received some training in this approach. The FGRBI model consists of four components in each session: (1) setting the stage for coaching, (2) observing caregiver implementation and embedding opportunities to practice evidence-based strategies, (3) problem-solving and planning next steps, and (4) reflecting on the session and reviewing the action plan. An in-depth description of these components is available in the FGRBI Key Indicators Manual (Woods, 2021).
Cultural responsiveness
Consultants made adaptations to ensure the intervention was responsive to the unique needs of each family. First, consultants utilized interpreters in sessions if the family primarily spoke a language other than English. Second, goals were selected based on family priority, including cultural priority. For example, caregivers were encouraged to teach culturally relevant gestures (e.g. raising arms for “help”) rather than focusing on a specific gesture identified by the consultant (e.g. ASL sign for “help”). Third, consultants received ongoing training on implicit bias and cultural sensitivity from the medical center where they were based, the Part C system, and continuing education related to professional licensing requirements.
Case example
The following is a brief example of a typical CAPSS session: The consultant joined the telehealth session and greeted 2-year-old August, his mother, and his EIP, all present in the home. August’s mother shared recent updates and demonstrated the progress they were making with joint play by engaging in a back-and-forth block routine. August’s mother demonstrated the three strategies that had been introduced previously: following August’s lead in play, taking short turns, and adding interest with sound effects. These strategies addressed the family’s goals of increasing August’s participation in play and attention to others. After the play routine, the team reflected on the play routine, discussing which NDBI strategies worked well and what August’s mother wanted to target during the rest of the session. She said that August had been enjoying bath time and she’d like to increase the back-and-forth engagement during that routine. The consultant and EIP helped August’s mother reflect on how she might apply the previously learned strategies to bath time. The consultant reminded August’s mother of a tip sheet about strategies for building new routines and showed a video example from the online module of a bath time routine. They brainstormed together to identify a new strategy, sitting at eye level, for August’s mother to try during his next bath.
Participants
Consultants
The services described in this article were provided by 10 consultants from a university-based medical center with training and experience implementing NDBIs; including seven Board Certified Behavior Analysts® (BCBAs®), two speech-language pathologists, and one early childhood educator. Consultants had an average of 15 years of experience (range = 3–25) working with families and young children with autism and other developmental delays. A doctoral level BCBA (BCBA-D®) and two BCBAs provided ongoing supervision via direct observation and feedback. Consultants had prior experience with various NDBI models (e.g. Early Start Denver Model Rogers et al., 2012) and Enhanced Milieu Teaching (Hancock et al., 2016) along with specific knowledge of caregiver coaching and adult education.
Early intervention providers
Participating EIPs included 80 individuals from 20 different agencies across the state. All EIPs were required by the state to have a degree in early childhood education or special education, child and family studies, early intervention, or a related field and were required to participate in continuing education for 30 h per year. EIPs participated in sessions by sharing prior knowledge of family needs and interventions, preparing families for sessions, and collaborating with consultants to individualize recommended strategies. Our center offers additional training focused on capacity building that is not described here.
Families
Children and their caregivers were eligible for participation if they were enrolled in Part C services and were receiving developmental therapy from an EIP, had received an autism evaluation (regardless of evaluation outcome), and if the child was under the age of 33 months at the time of referral. This allowed for service completion before the child’s third birthday, when children typically transitioned out of Part C. Data for this article were collected from families who opted to participate in services between July 2020 and June 2022 (
Data analyzed for this article are drawn from 234 families who completed at least one post-intervention measure (
Participant demographics.
GED: general equivalency diploma.
To run post hoc analyses, participants were grouped into categories based on demographic data. Participants were identified as “rural” (62%) or “urban” (38%) based on their address to examine potential group differences by geographic location. The HRSA Rural Grants Eligibility Analyzer (Health Resources and Services Administration, 2023) was used to classify areas as “rural” versus “urban.” To examine potential differences between racial and ethnic groups, participants were grouped as “White” (77%) or “Black, Indigenous, People of Color” (BIPOC; 23%). Data on ethnicity (Hispanic/Latino or Not Hispanic/Latino) were collected separately from data on race so participants who identify as Hispanic/Latino are present in both the White and BIPOC groups. Thus, we separately report data comparing Hispanic/Latino participants (5.1%) to non-Hispanic/Latino participants (94.8%).
Measures
Data collection and analysis
Data were collected and managed using Research Electronic Data Capture (REDCap), a secure, web-based software platform hosted at the university-based medical center (Harris et al., 2009, 2019). Measures were sent directly to relevant shareholders (i.e. caregivers, EIPs, and/or consultants) before the start of services and/or at the conclusion of services.
We collected data specific to child, caregiver, EIP, and consultant outcomes. Pre-intervention and post-intervention data were collected for the following child outcome measures: Communication Symbolic Behavior Scales-Developmental Profile Caregiver Questionnaire (CSBS-DP; Wetherby & Prizant, 2003), MacArthur Bates Communication Development Inventory (MCDI) Short Form (Fenson et al., 1993), and Clinical Global Impression (CGI) Scale. Only post-intervention data were collected for caregiver and EIP acceptability surveys. Post-intervention measures were only sent to families who completed three or more sessions.
In addition, treatment fidelity data were reported by consultants after each session. In December 2022, EIPs were asked to complete an additional impact survey reflecting on the services provided between July 2020 and June 2022.
Child outcomes
Child measures focused on caregiver and consultant perception of severity of challenges, improvement over time, and development of communication skills. All child measures were completed by the caregiver before and immediately following intervention; the CGI scale was also completed by the consultant.
To measure social communication, caregivers were asked to complete the CSBS-DP. The CSBS-DP is a 41-item caregiver-completed, norm-referenced questionnaire that measures communication across three domains: social communication, speech, and symbolic communication.
To measure language, caregivers were asked to complete the MCDI Short Form (Level 1). The MCDI is a caregiver-completed, norm-referenced questionnaire that measures receptive and expressive language development, as well as communicative actions and gestures. We used the MCDI: Short Form (Level I), which is norm-referenced for young children ages 8 to 18 months, although it also used with older children with language delays.
To measure severity of challenges, caregivers and consultants completed the CGI. CGI is a well-researched instrument used to assess the severity of impact of a diagnosis or disability on a person’s daily functioning (Busner & Targum, 2007). For all CGI scales, ratings are on a 7-point Likert-type scale, with higher scores indicating a greater impact and lower scores indicating lesser impact. We created a CGI scale to rate challenges experienced by a child and their family across daily routines (i.e. 1 indicates “no challenges” and 7 indicates “very severe challenges”). Our CGI assessed the presence of challenges across seven domains: child participation in caregiving routines, play-based routines, verbal communication, nonverbal communication, social interactions, restricted or narrow interests, and adaptive behavior.
Acceptability survey (caregivers and EIPs)
To measure acceptability, we collected data on caregiver and EIP satisfaction with services. Caregivers and EIPs independently completed a 15-item survey at the conclusion of services. This survey included 12 closed-ended items and 3 open-ended items, intended to measure satisfaction with the consultant, services, and outcomes. Responses for closed-ended items were reported on a 4-point Likert-type scale, ranging from “strongly disagree” to “strongly agree.”
Treatment fidelity
After each session, consultants completed a three- to five-item checklist self-assessing adherence to curriculum-specific objectives. Treatment fidelity checklists were specific to each curriculum module. Each objective was scored as “discussed,” if the consultant reviewed content related to that item with the family, and “achieved,” if the caregiver demonstrated knowledge or application related to the items. It was possible for an objective to be scored as “discussed” but “not achieved” if a caregiver did not demonstrate the skill. Thus, the “discussed” score provided a measure of consultant implementation fidelity. The “achieved” score provided a measure of caregiver implementation fidelity. See Figure 1 for a sample treatment fidelity checklist.
Impact survey
Following the completion of both service years (December 2022), EIPs completed a 12-item survey as a self-reflection on the long-term impact of services. The survey assessed improvements in knowledge, comfort, and application of NDBI strategies to support young children and caregivers following participation in services. Responses for closed-ended items were reported on a 5-point Likert-type scale, ranging from “not at all improved” to “extremely improved.”
Analytic plan
Post-intervention data analyzed for this article are drawn from 229 families who completed a minimum of three sessions with a consultant and one post-intervention measure. We analyzed child outcomes, as well as consultant, caregiver, and EIP satisfaction. Treatment fidelity was analyzed from all families for whom it was available, which included five additional families who did not complete any post-intervention measures. Due to missing data from some families, sample size differs across measures. For the CSBS-DP, MCDI Short Form (Level 1), and CGI, we used paired sample
Community involvement
The CAPSS program was developed over the last 8 years with significant input from statewide policymakers within the Part C system, caregivers of children with autism and developmental delays (including autistic caregivers), and community providers. Our center also participates in a Community Advisory Council made up of individuals with disabilities, family members, state and community agency representatives, policymakers, and other community members.
Results
A total of 234 families completed an average of 5.43 sessions (SD = 1.05, range = 1–6). An analysis was conducted to determine if group differences existed between those who met inclusion criteria and those who did not. Pearson’s chi-square test or Fisher’s exact test (when an expected frequency of a cell was less than 5) was used to evaluate the independence of two categorical variables (e.g. dropped and non-rural). For most variables (i.e. rural vs non-rural location, child race, child diagnosis, and caregiver income), no significant differences were found between participants and those who dropped out. For child ethnicity (
Group comparisons indicated that attendance did not differ among caregiver income levels (
Child outcomes
Following CAPSS, caregivers reported significant improvements in communication and symbolic behavior on the CSBS-DP. Prior to intervention, participants received an average score of 66.22 (SD 25.35), which increased to 77.68 (SD 29.99) following intervention (
Communication and Symbolic Behavior Scale Developmental Profile (CSBS-DP) composite scores (
Rural versus non-rural group comparisons.
CSBS-DP: Communication and Symbolic Behavior Scale Developmental Profile; EI: early intervention.
White versus BIPOC group comparisons.
BIPOC: Black, Indigenous, People of Color; CSBS-DP: Communication and Symbolic Behavior Scale Developmental Profile; EI: early intervention.
Hispanic/Latino versus non-Hispanic/Latino.
CSBS-DP: Communication and Symbolic Behavior Scale Developmental Profile; EI: early intervention.
Group comparisons indicated that post-treatment CSBS-DP scores did not differ among diagnostic groups (
On the MCDI Short Form, caregivers reported significant improvements in the number of words children were able to say and understand following intervention (
For the CGI, caregivers (
Clinical global impressions scale.
Caregiver acceptability
Satisfaction surveys were sent to caregivers who completed at least three sessions (
EIP acceptability
A total of 104 satisfaction surveys were completed by EIPs regarding their participation in CAPSS. Note that this number exceeds the total number of EIPs (
Treatment fidelity
Overall, consultants reported discussing an average of 89.50% (SD = 15.3%) of treatment objectives. On average, 79.60% (SD = 21.50) of these objectives were achieved. Treatment fidelity did not vary between White and BIPOC participants (see Table 4) or between Hispanic/Latino participants and non-Hispanic/Latino participants (see Table 5). However, rural participants discussed (M (SD) 90.24 (17.13),
EIP impact
A total of 34 EIPs (43% return rate) completed impact surveys. The majority of EIPs reported overall improvements in knowledge, comfort, and application of evidence-based strategies. EIPs self-reported the highest ratings on items related to the impact of direct collaboration with consultants. Specifically, EIPs reported that their knowledge around effective caregiver coaching strategies (85% reported “very improved” or “extremely improved”), comfort engaging in the coaching process with caregivers (80% reported “very improved” or “extremely improved”) and serving other families who have participated in these services (78% reported “very improved” or “extremely improved”) were improved through collaboration with consultants. See Table 7 for an overview of EIP perceptions.
Participation impact on early intervention providers (EIPs) as reported by EIPs (
Discussion
This article adds to existing literature (Corona et al., 2021; D’Agostino et al., 2020; Ingersoll et al., 2016; Vismara et al., 2018) indicating that coaching caregivers to use NDBI strategies via telehealth can yield meaningful child and caregiver outcomes. In addition, the results described here suggest that using telehealth technology to partner with community-based providers (i.e. EIPs) may be an effective strategy for increasing access to NDBIs. These data represent findings from the initial phase of a multi-phase project to increase the capacity of EIPs to provide evidence-based, autism-focused services to families.
This service delivery model was deemed feasible and acceptable to both caregivers and EIPs. Furthermore, EIPs consistently reported that their knowledge, comfort, and application of evidence-based practices improved following participation. This is critical for maintaining knowledge and skills gained through intervention and sustainability of the model across other families over time.
Preliminary data indicate that there was no significant benefit to privileged groups related to child outcomes, caregiver or EIP treatment acceptability, treatment fidelity, or EIP impact. In fact, the only significant difference between groups indicated benefit for traditionally underserved groups, including (a) higher satisfaction rates for BIPOC (vs White) and Hispanic/Latino (vs non-Hispanic/Latino) caregivers and (b) higher procedural fidelity scores for rural (vs urban) participants. Importantly, sample sizes for BIPOC and Hispanic/Latino groups were also notably smaller than White or non-Hispanic/Latino, so results should be considered carefully. One plausible reason for differences in satisfaction and procedural fidelity may be attributed to lower levels of access to services for these populations resulting in greater appreciation for services provided and greater dedication to following recommendations. In addition, child outcomes, attendance, and treatment fidelity did not vary based on family income or caregiver education levels.
Limitations and future directions
There are several factors that limit the internal validity of this article. First, this article describes a large-scale implementation of telehealth-based caregiver coaching, aiming to bridge the gap between clinical research and typical community service provision. As such, the methodology and data lack the rigor of a clinical research study, particularly in that it uses pre-post and post-only measures; lacks a comparison group and randomization; and group sizes were not equivalent. Although the results are promising, observed outcomes must be interpreted cautiously. While child outcomes improved over the course of the program, without a comparison group, it is possible that improvements may be caused by confounding factors, including child maturation and post-diagnosis caregiver adjustments. Similarly, although caregivers and EIPs indicated high social acceptability of the intervention, we cannot speculate how this level of acceptability compares to those of other interventions or business as usual. Direct observational data were not collected on behaviors or specific skills gained by caregivers or EIPs, and that should be examined in future iterations of this program.
Second, data were only included for families who completed at least one post-measure and/or had treatment fidelity data available. Data from families who withdrew from the program and/or did not complete final paperwork were not included, and that group includes families that were more likely to have a lower level of caregiver education or report Hispanic/Latino ethnicity. Third, all outcomes were limited to caregiver and EIP perceptions. We chose to limit data collection measures due to the community-based nature of this program and concerns about over-burdening local providers with data collection. To improve internal validity, future studies might include direct observational measures of intended outcomes along with measures of continued strategy implementation by EIPs.
Fourth, we do not fully understand the reasons that satisfaction rates were higher for BIPOC (vs White) and Hispanic/Latino (vs non-Hispanic/Latino) caregivers. Due to the relatively small sample of families from BIPOC and/or Hispanic/Latino backgrounds, the generalizability of this finding is limited. Because of the community-based nature of this program, we accepted all eligible participants who were referred and did not try to create comparable groups. Earlier, we discussed the possibility of decreased access to services as a reason for increased satisfaction. It is also possible that the cultural responses made to intervention contributed to these differential results. Fifth, the packet of post-intervention measures was sent to the 280 families who completed three or more sessions (86% of total families). Limiting post-intervention measures to these families ensured that we only collected data from families who likely completed enough of the program to observe measurable behavioral differences. However, this prevented us from collecting information from families who dropped out before three sessions; thus, our treatment acceptability may be inflated. Consultants typically sent three to five reminders to complete final paperwork but there were no incentives provided for completion. Future program iterations might incentivize final paperwork completion to increase likelihood of more complete datasets. They might also send out treatment acceptability paperwork to all participants, regardless of the number of sessions completed.
Recommendations for practitioners
Practitioners may consider low-intensity, telehealth-based service models like the one described here to “bridge the gap” between diagnostic evaluations and access to higher-intensity services. Teaching caregivers NDBI strategies to support priority goals in the home may help ameliorate caregiver stress related to service access while simultaneously supporting child development around critical skills in their natural environment. Furthermore, the utilization of telehealth to deliver these low-intensity services both reduces costs to providers (i.e. reduced travel time) and increases access to families living in rural and underserved communities.
Practitioners may also consider partnering with their state Part C system when feasible. Teaming and collaboration are recommended practices in the provision of early childhood services (Division for Early Childhood, 2014; “Early Intervention Program for Infants Toddlers with Disabilities,” 2011) and may build the capacity of local service providers, who can in turn provide increased access to NDBIs in rural and under-resourced communities. When consultants and local EIPs collaborate to serve a family, information relevant to the support needs of the family can be shared tri-directionally. Consultants can use online resources and telehealth technology to observe EIPs and families in intervention sessions. Local EIPs often have a greater understanding of the child and family history as well as local resources and services and will remain involved with the IFSP team for the child’s time in Part C programs. This family- and community-specific knowledge enhances the consultants’ understanding of potential opportunities and barriers that may inform recommendations. It will be important for future work to study the determinants affecting implementation and use of this model with all parties (caregivers, EIPs, consultants) in order to adapt the program to best meet the needs of individual communities and systems.
The CAPSS program combines telehealth-based caregiver coaching on NDBIs with capacity-building strategies for EIPs in order to increase access for families and provider capacity. These results indicate that this telehealth-based approach to disseminating NDBIs is an effective, feasible, and acceptable model for supporting families in under-served communities.
