Abstract
Introduction
Defining Parental Involvement
Parental involvement usually refers to school-related parent–child interactions and parent-school interactions (Hill et al., 2004). While it is well accepted that parental involvement is a multidimensional construct, the number of dimensions and their definition is an open question. Some studies only distinguish home-based and school-based dimensions (Chowa et al., 2013; Walker et al., 2005); parental expectations are sometimes added as a third dimension (Hill & Tyson, 2009). Most conceptualizations, however, break down home-based and school-based involvement into four to six dimensions (Epstein, 1995; Fan & Chen, 2001; Jeynes, 2005; Tardif-Grenier & Archambault, 2016).
Home-based involvement generally includes dimensions such as parental expectations, parent–child communication, and homework supervision (Castro et al., 2015; Fan & Chen, 2001; Jeynes, 2005). Parents who hold high expectations set high standards of success for their children, encourage intellectual pursuit, communicate the usefulness of school, and emphasize high academic aspirations. Parent–child communication refers to discussions that parents have with their child about their school experiences, successes, or difficulties. Parents offering high quality communication demonstrate their interest and emotional support to their child’s schooling. Lastly, homework supervision includes practices such as direct instruction, checking homework, encouragement, and organizing homework space and time.
School-based involvement refers to three types of practices that may be considered separately but are most often combined in a general dimension (Chowa et al., 2013; Fan & Chen, 2001; Epstein, 1995; Hill & Tyson, 2009). These encompass informal and spontaneous communication or contacts between parents and the school staff, more formal contacts such as participation in organized school activities or volunteering, and involvement in school decision-making and administrative processes.
Perceiving Parental Involvement
When addressing parental involvement in school, parents’ and teachers’ perspectives are important (Daniel et al., 2016). Parents are surely good informants to report on their own practices at home and at school, such as how often they contact teachers or their expectations of success for their child. However, student and parent perceptions do not always align. Parents tend to rate themselves as more involved than what their child perceives (DePlanty et al., 2007; Thomas et al., 2020). Teachers’ perspective may also be informative but remains limited as they can only form an imprecise impression of parents’ home-based involvement. For these reasons, it is critical to assess students’ perception. Grolnick and Slowiaczek (1994) even argued that students’ subjective experience of parental involvement matters more than the actual practices. For parental involvement to be influential on school outcomes, students need to perceive the support they receive at home, the implicit or explicit messages their parents send them about the importance of school, or the concrete links parents develop with the school. When compared to parent reports, student reports have the greatest contribution to students schooling experience (e.g., DePlanty et al., 2007; Ice & Hoover-Dempsey, 2011), reinforcing the idea that it is not what parents do that is most important, but what the child perceives. Thus, student reports of parental involvement represent the best way to access students’ subjective experience. Furthermore, student reports are especially important in research settings where parents are sometimes not available or able to participate, allowing to study populations that are more difficult to reach (e.g., immigrant parents, parents in disadvantaged areas) and thereby contributing to the advancement of knowledge regarding parental involvement.
Many factors may impact the way parents get involved in their child’s schooling, and ultimately, the way these practices are experienced by children. Namely, parents may be involved differently according to the family cultural background or the child’s characteristics (Antony-Newman, 2019). For instance, many immigrant parents tend to hold higher expectations of success and be more involved in schoolwork at home, while non-immigrant parents tend to be more involved in school (Turney & Kao, 2009; Villiger et al., 2014). Families with low socioeconomic status (SES) face several barriers such as lack of time and resources that may hinder parental involvement practices (Camacho-Thompson et al., 2016). Studies indicated that parents with low SES were less involved in their child’s schooling (Camacho-Thompson et al., 2016; Li et al., 2020). Still, some parental practices, such as teacher-parent communication and home-based practices may be more frequent and easier to implant for these parents (Malone, 2017; Tan, 2019).
Parental involvement may also change over the years; with younger children, parents are more directly involved in activities (e.g., reading, homework supervision), whereas with teenagers, parents tend to provide an environment that enables school success (e.g., encouragement, discussions, support; Boonk et al., 2018). Gender is also important to consider as parents may be involved differently. For instance, parents might offer more emotional support and supervision to girls, and with boys, they communicate more with teachers (Carter & Wojtkiewicz, 2000; Kristjánsson & Sigfúsdóttir, 2009). Therefore, parental involvement may translate differently among different groups and over the years.
Regardless of how and for whom parental involvement is assessed, its benefits on school achievement and adjustment are well established (Barger et al., 2019; Castro et al., 2015). Recently, studies have underlined the importance of parental involvement in student behavioral, affective, and cognitive engagement, which are important predictors of school success (Fredricks et al., 2004). Hence, when parents are involved, students tend to follow instructions better, make more efforts towards school tasks and homework (behavioral engagement), use more self-regulation strategies to organize schoolwork, environment, and time (cognitive engagement), value, like, and have more interest in school (affective engagement; Fan & Williams, 2010; Tardif-Grenier & Archambault, 2017; Wang & Sheikh-Khalil, 2014).
Measuring Parental School Involvement
To better understand how parental involvement is assessed across studies, we briefly reviewed journal articles referenced in Psychinfo since 2000 addressing parental involvement in school. The screening process identified 250 studies (see online supplement, Table S1). These studies assessed parental involvement in several countries, ethnic groups, and grade levels. Parents (43% of the identified studies), school staff (8%) and students (37%) reported parental involvement, and some studies relied on more than one respondent (11%), mostly parents and teachers. When student perception was assessed, it was mainly among high school students (73%) or mixed samples (9%); few studies relied on younger children perspective (primary level; 18%). Measures of parental involvement were very disparate, and most did not go through a rigorous validation process. Namely, less than half of the studies relied on measures that tested factor validity using factor analysis directly in the study (34%) or in another study (11%), a third only evaluated internal consistency (32%) and too many studies (18%) did not address any psychometric qualities. Very few studies estimated measurement invariance (
Study Objectives
The aim of the present study was to undertake the preliminary validation of the Student-Rated Parental School Involvement Questionnaire (SR-PSIQ). Regarding its factor structure, two (home-based and school-based involvement), three (parental expectation, home, and school involvement), four (parental expectation, parent–child communication, homework supervision, in-school involvement), and five-factor models (subdividing in-school involvement into communication and school participation) were compared. Moreover, to ensure that the measurement characteristics of the SR-PSIQ are invariant across time and groups (i.e., student gender, parental immigration status, and SES), measurement invariance was assessed across four measurement occasions spanning over a 2-year period. To better understand how the parental involvement dimensions changed in time or varied according to sociodemographic characteristics, mean differences of the invariant models are reported. Lastly, in addressing the role of perceived parental involvement on student schooling experience, the predictive validity of the SR-PSIQ was evaluated by estimating the longitudinal associations with student behavioral, cognitive, and affective engagement.
Method
Participants and Procedure
The sample consisted of 923 French-Canadian (Montreal, Quebec) students in grades 3 to 6 from five primary schools (30 classrooms) located in disadvantaged and multiethnic urban areas. These students participated in a larger project aiming to study factors associated with student engagement in school (Archambault et al., 2015). Students completed an online questionnaire in the school computer laboratory at the beginning and the end of the school year over two consecutive years (Fall 2012 to Spring 2014), resulting in four measurement occasions (T1-T4). A time sequential design was used. Hence, in the second year, new Grade 3 students were added to the sample while students who were in Grade 6 left, transitioning to secondary school (57.1% participated at all time points during the 2-year period; T1
Measures
Parental Involvement
Items of the Student-Rated Parental School Involvement Questionnaire.
Student Engagement
Students reported their behavioral (6 items, e.g. “I follow my teacher’s instructions during French/reading activities”), cognitive (6 items, e.g. “I check my math work to make sure there are no errors”), and affective engagement (two scales that were subject-related: language arts [3 items] and mathematics [3 items]; e.g. “What we learn in mathematics is interesting”) using the School Engagement Dimensions Scale (Archambault & Vandenbossche-Makombo, 2014). All items were measured on a five-point response scale, from 1 (not at all or almost never) to 5 (a lot or almost always). For each dimension of engagement, an average score was calculated; higher scores indicated higher engagement. All scales showed adequate reliability (α = .667–.800).
Grouping Variables
Students reported their gender (coded as girl = 0; boy = 1), and their parents’ immigration status (coded as immigrant = 0; non-immigrant = 1). SES was based on parents’ report of their family income on five-point responses scale (1 = less than $29,999, 2 = 30,000–49,999$, 3 = 50,000–79,999$, 4 = 80,000–119,999$, 5 = more than $120,000). To assess group invariance across levels of SES, two categories were created according to Canada’s low-income cut-off for the years of the study (2012–2014; Statistics Canada, 2022): low (<$50,000 = 1) and average/high (≥$50,000 = 2).
Statistical Analyses
Model Estimation
All measurement models were estimated using Mplus 8.5 (Muthén & Muthén, 2017). Exploratory factor analysis (EFA) was used to explore the factor structure of the SR-PSIQ. Models from 2 to 5 factors were estimated. Given the categorical nature of the items, robust weighted least square estimator (WLSMV) was used. Under WLSMV, when no covariates are used, missing data is handled by pairwise deletion. This approach performs well when data is missing completely at random (MCAR; Asparouhov & Muthén, 2010). According to Littles MCAR test, ran in IMB SPSS (Version 26), the present data was MCAR (χ2 (1475) = 1499.38,
To determine the number of factors to retain, we used parallel analysis, the recommended method (Timmerman & Lorenzo-Seva, 2011). Since parallel analysis is not available in Mplus for categorical items, the FACTOR program (Version 10.10.03; Lorenzo-Seva & Ferrando, 2006) was used applying Horn’s method with default settings. Theoretical consideration was also an important part of the decision to choose the optimal factor structure. Distribution of items into their respective factor had to be coherent with a priori theoretical expectations. To retain items, based on the traditional criteria suggested by Comrey and Lee (1992), all items had to show a standardized loading of at least .32 on their a priori target factor, while also keeping cross loadings to a minimum. To evaluate scale reliability, McDonald’s Omega coefficients were computed (McNeish, 2018).
Measurement Invariance Analysis
Measurement invariance was assessed in a six-step hierarchical model across time, gender, parental immigration status, and SES. Exploratory structural equation modeling (ESEM) was used for invariance models. ESEM has been proposed to overcome limitations regarding CFA (i.e., zero cross loadings and inflated correlations between factors) and provides all parameters used in SEM, allowing likelihood testing without going through CFA (Asparouhov & Muthén, 2009; Marsh et al., 2009). Because different groups (according to gender or parents’ immigration status) did not contain data on all values of categorical items, data was recoded on a three-point response scale, collapsing categories one and two (see Table 1). All invariance analyses were done with the recoded data.
Measurement invariance was based on Meredith’s (1993) taxonomy with specifications applying to categorical data (see Liu et al., 2017; Mplus syntax for all models are provided in the online supplement). We tested the adequacy of increasingly restrictive models: configural invariance (constraining the number of factors to equality across groups/time), weak invariance (constraining the number of factors and factor loadings to equality across groups/time), strong invariance (constraining number of factors, factor loadings, and item thresholds to equality across groups/time) and strict invariance (constraining number of factors, factor loadings, item thresholds, and item uniquenesses to equality across groups/time). In addition, variance-covariance and latent means invariance were also tested where variances, cross-sectional covariances, and means were also fixed to equality across time points and groups (Marsh et al., 2009; Morin et al., 2013). As suggested for longitudinal data, lagged uniquenesses were included in the longitudinal models (Morin et al., 2013). Latent means differences between groups (gender, immigration status, and SES), and time points are reported.
Model Fit
The overall fit of models was first evaluated using the adjusted Chi-square test of model fit for WLSMV (Muthén & Muthén, 2017). Since the chi-square test tends to be overly sensitive to sample size, model fit was also based on other recommended fit indices: Comparative Fit Index (CFI), Tucker–Lewis Index (TLI), and Root Mean Squared Error of Approximation (RMSEA; West et al., 2012). Common cut-offs for CFI and TLI (>.95), and for RMSEA (<.06), indicated good fit of models (Hu & Bentler, 1999).
Comparison of nested invariance models relied on different fit indices. First, differences in relative fit indices were used; ΔCFI ≤ −.01 and ΔRMSEA ≤.015 between models indicated that invariance hypothesis should not be rejected (Chen, 2007; Cheung & Rensvold, 2002). Difference in TLI was also considered with the same guidelines as for CFI (invariance was supported if ΔTLI ≤ −.01; Morin et al., 2013). The fit of different invariance models was also estimated using chi-square test. Under WLSMV, the difference in χ2 between two nested models does not follow a χ2 distribution (Muthén & Muthén, 2017); the corrected χ2 difference provided in Mplus DIFFTEST was used.
Predictive Validity
Predictive validity was assessed through structural equation modeling. Using ESEM, T2 school engagement dimensions were regressed on each T1 latent parental involvement factor while controlling for the initial level of engagement (T1). Missing data was handled through full information maximum likelihood. All cross-sectional correlations between control variables at T1 and parental involvement factors were estimated.
Results
Factor Structure
Goodness-of-Fit Statistics for the Exploratory Factor Analyses (T1-T4).
*
Standardized Factor Loadings ( λ) and Uniquenesses (δ) From the Longitudinal Invariant Model.
*
Longitudinally Invariant Standardized Factor Correlations.
**
Reliability
Omega coefficients calculated from standardized longitudinal invariant loadings and uniquenesses indicated that the SR-PSIQ scales are reliable. Except for the school-based involvement scale that had a slightly lower omega coefficient (ω = .661), the parental expectation (ω = .878), parent–child communication (ω = .810), and the homework support (ω = .749) scales showed good reliability.
Measurement Invariance
Longitudinal Invariance
Goodness-of-Fit Statistics for Longitudinal and Group Invariance Models.
aVariances and covariances were not constrained to equality, fit is compared to strict invariance model.
*
In the next steps, the variance-covariance and mean invariance models were tested adding equality constraints on the latent factors cross-sectional correlations, variances and means. 2 All indices indicated good fit of models. Although DIFFTESTs were significant, according to the very small changes in CFI, TLI and RMSEA, the added constraints did not worsen model fit.
Standardized Latent Factor Mean Differences Between Measurement Occasions and Sociodemographic Characteristics.
aT4 mean differences for the SES invariances models are from the strict invariance model.
*
Group Invariance
Gender
Measurement invariance across genders was tested at every time point. For brevity, only T4 results are reported in Table 5 (see online supplement Table S2 for full results). All models showed good fit and the added equality constraints did not lead to a significant decrease in model fit. Therefore, factor loadings, thresholds, uniquenesses, latent variances, covariances, and means were invariant across genders for the SR-PSIQ. Except at T1, for which uniqueness invariance was not fully attained, the invariance patterns were similar at other time points.
Despite the apparent invariance of means, some differences between genders can be pointed out. Results presented in Table 6 indicate that differences between boys and girls for the SR-PSIQ scales mainly concerned the parental expectation and the school-based involvement factors; boys perceived higher parental expectations at most time points and higher school-based involvement at T2 and T4. Girls also perceived more homework supervision at T1.
Parental Immigration Status
We next tested if the measurement characteristics were also invariant according to parents’ immigration status. The invariance patterns were very similar at all time points. T4 fit indices are presented in Table 5 (see online supplement Table S3 for full results). The configural invariance model showed good fit. According to all fit indices and DIFFTESTs, there was no significant change from configural through variance-covariance models in all fit indices. Therefore, the structure, loadings, thresholds, uniquenesses, and latent variances and covariances appeared invariant across parents’ immigrant status.
When constraining means to equality, changes in fit indices and significant DIFFTESTs indicated that mean invariance could not be assumed. Latent mean differences according to parents’ immigration status are reported in Table 6. Significant differences concerned the parental expectation factor at T2, T3 and T4 for which immigrant parents were perceived as maintaining higher expectations than non-immigrant parents. At T1, parent–child communication was rated higher by children of immigrant parents. Students also reported higher parent school-based participation among non-immigrant parents at T4.
Family SES
We also tested if the SR-PSIQ measurement properties were invariant according to family SES. T4 fit indices are reported in Table 5 (see online supplement Table S3 for full results). Configural through strict invariance models showed good fit and the added equality constrains (loadings, intercepts, uniquenesses) did not worsen the fit. Adding equality constraints on variances and covariances significantly worsened fit according to DIFFTEST as well as decreases in CFI and TLI slightly above the suggested guidelines, indicating that variances and covariances were not fully invariant across SES. Therefore, mean invariance model was compared to the strict invariance model. Constraining means to equality also decreased model fit suggesting that T4 means were not invariant across SES. According to invariance models at other time points, variances, covariances and means are invariant at T2 and T3.
Latent mean differences are reported in Table 6. Students in low SES families perceived their parents as having higher school expectations than students from average/high SES at T3 and T4. At T4, students from higher SES families perceived their parents as having higher levels of school-based involvement.
Predictive Validity
Standardized Regression Coefficients Between T1 ESEM Latent Factors and T2 School Engagement Dimensions.
†
Discussion
This study is one of the rare studies that tested factorial validity, measurement invariance, and predictive validity of students’ perception of parental involvement among a sample of young elementary school children. Our results support the multidimensionality of parental involvement. Hence, specific dimensions of parental involvement should be assessed separately, rather than general school involvement. While parental school-based involvement is measured through a single factor, home-based involvement includes three dimensions: parental expectations, parent–child communication, and homework supervision. Measuring different aspects of parental involvement, these dimensions show good discriminant validity. Furthermore, the measurement characteristics of the SR-PSIQ are invariant across time and among sociodemographic characteristics; strict invariance is met in all models. This allows us to compare means between groups and time knowing that these differences are not biased by measurement artifacts. Mean invariance is met for gender and time, that is, even if slight differences may arise when comparing specific means, means are relatively stable across time and gender. As for SES and immigration status, mean invariance did not hold suggesting that means differ significantly between groups.
According to mean differences, in line with other studies (e.g., Villiger et al., 2014), results show that parents who were born in a foreign country, maintain higher expectation for their child’s schooling. Immigrant parents also tend to communicate more with their child but are less school-based involved than non-immigrant parents. These results support the idea that immigrant parents may encounter certain barriers regarding their participation in school. As such, it might be easier for them to be involved in their child schooling at home (Camacho-Thompson et al., 2016). In contrast to many studies (e.g., Li et al., 2020), our study further indicates that parents of low SES are perceived by their children as having higher expectation for them regarding school success and attainment, compared to parents from average or high SES. This is potentially explained by the fact that in many low SES communities, children with an immigrant background have highly educated, but underemployed parents (Adversario, 2021). As in our study, these parents also have higher expectations for their children, which is often not reflected by their current SES.
This study also shows that the SR-PSIQ has adequate predictive validity as most scales are related to later school engagement. Students report higher levels of engagement when their parents supervise their homework and communicate more with them, behaviorally, cognitively, and affectively. However, parental expectations are only associated with later behavioral and affective engagement, and to a lesser extent. This result is somewhat surprising as this dimension of parental involvement has been positioned as one of the most important to academic success (Castro et al., 2015). However, practices such as communicating or helping with homework are more concrete and likely to change during the school year than having high expectations. Considering the short time span between measurement occasions, direct actions may be more likely to bring about changes in the level of engagement, especially in a sample of primary students.
Contrary to what might be expected, school-based involvement is associated with lower student engagement. While most studies evidence positive links between school-based participation and school outcomes, our results agree with the few studies that indicate a negative link (Barger et al., 2019; Boonk et al., 2018). Different reasons can explain this result. For instance, if students perceive these contacts as parent or teacher control, more frequent contact with school may hinder student engagement (Vasquez et al., 2016). It is also possible that these contacts with school are more frequent among students with decreasing levels of engagement, that is, those who presented more behavior problems or school difficulties (Archambault & Dupéré, 2017). Evidence shows that teachers are more prone to contact parents when the student is having difficulty than when he is functioning well in class, especially among boys and immigrant students (Zimmermann & Keynton, 2021). Further studies could examine these hypotheses.
Limitations and Future Research
While the SR-PSIQ seems to be a valid instrument that can be used among different populations, the present sample came from a highly disadvantaged urban area. Even if factorial structure withholds, other differences could occur among populations with higher SES. Namely, the negative link between school-based involvement and engagement may be an artifact of parents’ low SES. These parents might be more numerous to have experienced school more negatively and, therefore, to perceive family-school interactions as less welcoming. Future studies could confirm this hypothesis using the SR-PISQ among different populations.
Given that the SR-PSIQ reflects students’ perception of parental involvement, certain aspects are not taken into consideration. For instance, parents’ feeling of welcome at school and school’s openness to parental involvement were not assessed as these aspects of involvement may be difficult for a child to judge, particularly at the primary level. Nevertheless, these dimensions remain important to fully understand parental involvement, and well developed and validated tools assessing parents or teachers points of view are available if these aspects are of one’s interest (e.g., Dawson & Wymbs, 2016; Tardif-Grenier & Archambault, 2016).
Finally, predictive validity in this study has been limited to school engagement. Future studies could examine the predictive value of the SR-PSIQ on other indicators of school success. For instance, it would be relevant to examine the instrument’s capacity to predict achievement, a well-known outcome of parental involvement, or other aspects of school adjustment that have been less examined, such as teacher-student interactions or externalized behaviors.
Supplemental Material
Supplemental Material - Validation of the Student-Rated Parental School Involvement Questionnaire: Factorial Validity and Invariance Across Time and Sociodemographic Characteristics
Supplemental Material for Validation of the Student-Rated Parental School Involvement Questionnaire: Factorial Validity and Invariance Across Time and Sociodemographic Characteristics by Julie Goulet, Isabelle Archambault, Julien Morizot, Elizabeth Olivier and Kristel Tardif-Grenier in Journal of Psychoeducational Assessment
Footnotes
Declaration of Conflicting Interests
Funding
Ethical Approval
Informed Consent
Supplemental Material
Notes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
