Abstract
Keywords
Grounded upon the socio-cultural perspectives of learning (Vygotsky, 1978), a wealth of perspectives in the field of learning sciences has posited that learning is not a passive reception; instead, it is an active process of knowledge building (KB) in socially situated contexts (Bereiter, 2002). Teacher learning, as a KB practice, highlights computer-supported collaborative learning (CSCL) process where individual and collective understandings and practices are deepened with the pedagogical and technological supports (Damşa & Nerland, 2016; Hmelo-Silver & DeSimone, 2013; Kelly, 2006). However, a high quality KB is a complex, higher-order learning activity; simply dividing participants into groups does not necessarily guarantee productive interactions and communications (Dillenbourg, 1999; Scardamalia & Bereiter, 2006; van Aalst, 2009). Instructors should not assume students will automatically acquire metacognitive knowledge and regulation strategy to achieve high quality of collaborative learning. External instructional or technological scaffoldings are usually provided to improve KB quality (Reiser & Tabak, 2014).
Metacognitive scaffolding is one of the primary scaffoldings to help learners assess what they know, what to do, and how to do it to achieve learning goals (Hill & Hannafin, 2001). Most previous work has implemented metacognitive scaffoldings to improve the individual level of self-regulation strategies (e.g., Järvelä et al., 2015). But metacognition should also be considered at a group level rather than only as a reflection of individual learning (Biasutti & Frate, 2018). There is currently a research trend to examine the group-level metacognitive scaffolding (GMS), aiming to help a group of students jointly plan, monitor, reflect and evaluate groups’ work to achieve high quality of collaborative learning (Biasutti & Frate, 2018; Bodemer et al., 2018; Lyons et al., 2021; Zheng et al., 2019). Empirical research initially verifies that groups with GMS could have better metacognitive transitions and group performances compared to the groups without the supports of GMS (e.g., Zheng et al., 2019). Moreover, different forms of GMS can be used in collaborative learning, including task-oriented or idea-oriented GMSs, which can result in different effects on KB performances and processes (Biasutti & Frate, 2018; Hong, 2011; Zheng et al., 2019). Another issue is that the additional cognitive load and workload caused by external scaffoldings may lessen positive effects of scaffoldings (Lyons et al., 2021). Therefore, it is necessary to examine the effects of GMSs on groups’ knowledge building processes and performances in order to further provide implications for instructional design.
Echoing this research trend, this research designs
Literature Review
Knowledge Building Model
Knowledge building (KB) is one of the CSCL modes that highlights sustained improvement of ideas, creation of knowledge products or artifacts, and development of new knowledge in the technology-supported environments (e.g., Knowledge Forum; KF) (Scardamalia & Bereiter, 2006). During the KB process, a group of learners participate in coordinated collaborative activities to maintain dialogues, to build knowledge work on a shared problem, and to achieve shared goals as a collective group (Scardamalia & Bereiter, 2006; van Aalst, 2009). KB is a principle-based approach that is composed of 12 interconnected principles (Scardamalia, 2002); the principles of collective responsibility for community knowledge, epistemic agency, improvable ideas, and a “rise-above” philosophy are particularly conductive to foster the groups’ knowledge building quality (van Aalst & Chan, 2007; Yang, Chen, et al., 2020). These principles confer that students have abilities to carry out progressive work with diverse and messy ideas, to collectively synthesize ideas, to advance beyond competing perspectives, and to advance the community knowledge (Scardamalia, 2002).
Empirical research reveals that the implementation of KB pedagogy has positive results to help pre- and in-service teachers improve domain understanding of teaching content (van Aalst & Chan, 2007; Yang, Chen, et al., 2020) and develop the higher-order thinking skills such as epistemic agency, judging promising ideas (Ouyang & Chang, 2019; Yang et al., 2016; Zhang et al., 2018). Since KB is an active, cognitive-demanding, intentional learning process that requires learners to maintain effective coordination, manage task information, and exploit participation quality of each group member (Bereiter, 2002), it is necessary to provide scaffoldings to help groups engage in productive knowledge-building process. To facilitate the knowledge-building process, various scaffoldings are designed, e.g., instructor-student interactions (van de Pol et al., 2010), structural or procedural scripts (Kollar et al., 2006) or computational or technological tools (e.g., Jeong & Hmelo-Silver, 2016). A series studies conducted by Yang et al. (2016; Yang, Chen, et al., 2020; Yang, Du, et al., 2020) reveal that metacognitive scaffoldings have potential to help learners engage in productive knowledge building. Moving this research strand forward, the current research designs different group-level metacognitive scaffolds to help students engage in successful knowledge building process.
Group-Level Metacognitive Scaffolding
Metacognitive scaffolding originates from the concept of metacognition, the thinking about and reflection on one’s cognitive processing (Ouyang et al., 2021; Winne & Azevedo, 2014). To support collaborative learning, metacognition is extended from the individual level to the social context, e.g.,
Empirical research has used GMS to facilitate the group’s metacognitive skills and knowledge of cognition. First, GMS can take the form as a task-oriented scaffolding to help the groups complete specific tasks or subtasks and achieve collective goals (Hong, 2011). The task-oriented scaffolding aims to facilitate the group’s goal setting, planning, monitoring and strategic enactment (Biasutti & Frate, 2018; Hadwin et al., 2018). Many previous studies provide task-oriented metacognitive scaffolds to support groups’ collaborative learning. For example, Molenaar et al. (2014) designed orientation, planning, and monitoring scaffolds in the structuring and problematizing conditions; results found that the task-oriented metacognitive scaffoldings increased high quality intra-group metacognitive interaction. Kwon et al. (2013) designed a web-based group coordination tool including metacognitive scaffolding components: planning, monitoring, and evaluating. Results found that active metacognitive teams showed higher positive interdependence, fostered more engagement in positive interactions, and enhanced group productivity than passive metacognitive teams. Zheng et al. (2019) designed and examined task-oriented group metacognitive scaffolding (including planning, monitoring, evaluating, and reflection) to foster collaborative learning; results showed positive effects of GMS on group metacognitive transition and group performance and at the same time GMS did not increase students’ cognitive load. The task-oriented group metacognitive scaffolding facilitates the group’s skills to negotiate about the collective goal, evaluate current collaborative progress, and make regulatory decisions about how to stay or get back on track (Hadwin et al., 2011; Winne et al., 2013).
In contrast to the task-oriented scaffolding, GMS can take another form as an idea-oriented scaffolding in terms of the group’s knowledge of cognition (Biasutti & Frate, 2018). The idea-oriented scaffolding aims to facilitate a group’s awareness of information selection, use of materials and resources, and categorization and processing of new information (Biasutti & Frate, 2018; Hong & Sullivan, 2009). In contrast to the task-oriented scaffolds, the idea-oriented metacognitive scaffolds are used to facilitate groups’ metacognition during higher-order thinking, e.g., knowledge building. For example, Knowledge Forum (KF) is widely used to help shape groups’ KB processes with the idea-centered scaffolding supports (Scardamalia & Bereiter, 2006). In KF, the idea-oriented scaffoldings facilitate students work to post their problems, produce initial ideas for problem-solving, and connect, revise, and synthesize ideas (Hong, 2011). Moreover, Ak (2016) adopted technology-supported GMS scaffoldings to facilitate learners’ knowledge construction in asynchronous discussions. Results showed that the groups that used the scaffolded platform with the supports of message labels and sentence openers contributed more high cognitive level discourse (e.g., idea elaborations) than groups that used the non-scaffolded platform. The idea-oriented GMS facilitates the group’s thinking about the knowledge constructed and created through less-scripted, self-organized interactions in groups (Hong, 2011; Hong & Sullivan, 2009; Zhang et al., 2009).
The Effect of GMSs on Collaborative Learning
Previous studies show that GMSs may result in varied effects on groups’ knowledge building. For example, Hong (2011) compared the conventional task-based collaborative learning using Jigsaw instruction and the idea-centered collaborative knowledge building; results showed that engaging students in idea-centered collaboration better enhanced their collaborative competencies, facilitated their peer interactions, and improved the idea improvement quality. But some characteristics of learning and instruction overlapped: the routines and procedures were still the unavoidable parts in the idea-oriented learning while knowledge advancement also occurred in the task-oriented learning (Hong, 2011). Wang et al. (2017) examined the effect of student collaboration in the concept-oriented task (involving sharing information and knowledge) and design-oriented (involving task planning, monitoring and problem-solving) task; results showed that collaborative concept mapping functioned more effectively in the concept-oriented task than the design-oriented task, in terms of promoting students’ question-asking and positive motivations. But there were no significant differences in other social, cognitive, and emotional dimensions. Zheng et al. (2019) used the task-oriented scaffoldings at the group level to foster the CSCL processes and research results showed that GMS had better effects on metacognitive transitions and group performances compared to the traditional collaborative learning without GMS. And the GMS did not increase students’ cognitive load. But some research showed that the external scaffoldings might cause additional cognitive load and workload which lessened positive effects of collaborative learning (Lyons et al., 2021). Given the complexity, it is necessary to further examine how different GMSs influence knowledge building processes in order to further provide implications for instructional design.
One of the major reasons that result in this complication is the complex, multi-dimensional characteristics of collaborative learning. Previous CSCL studies have promoted the use of mixed methods to understand collaborative effectiveness and collaborative learning processes and outcomes (Janssen et al., 2013; Medina & Stahl, 2020; Stahl, 2009). For example, the statistical analysis, sequential analysis, and social network analysis approaches have been used to investigate correlations between collaborative variables (Zemel et al., 2009), sequences of students’ knowledge contributions (Chen et al., 2017) and social interaction structures and participatory roles (Ouyang & Chang, 2019; Ouyang & Scharber, 2017). Moreover, qualitative, ethnographic approaches (e.g., discourse analysis, observation, or interview) have also been used to examine the micro-level relevancies of collaborative activities and students’ actions during collaboration or perceptions about collaboration (Stahl, 2009). Taking quantitative and qualitative methods together, Hong (2011) collected teacher students’ online discussions, survey responses, and interviews to investigate their interaction patterns, reflective patterns, and perceptions about knowledge building. Ak (2016) used a multi-method approach (including content analysis and performance analysis) to examine the effects of technology-supported GMS scaffoldings on learners’ knowledge construction and building in asynchronous discussions. Multiple analytical methods can complement each other to provide a more holistic picture of collaborative learning. Taken together, this quasi-experiment research uses the general, task-oriented, and idea-oriented GMSs to facilitate groups’ KB processes, and uses a mixed method to examine the KB processes, performances, and perceptions under those three GMS scaffoldings.
The Present Study
The Research Purposes and Questions
The study designed three GMSs, namely the general scaffolding (
Research Context and Participants
The research context was a four-day graduate-level online course, titled
The Instructional Process
The instructor (the first author) designed a KB environment enhanced by GMSs. There were three main parts of this course: online lecture hosted through DingTalk (the China’s version of Zoom), the KB activity hosted in KF for groups to build knowledge, and groups’ reflections in DingTalk. KF is a networked, communal knowledge building space, where learners can create, build on, and refer to peers’ notes to summarize and advance their understandings, and create higher order integrations of ideas (see Figure 1A). The KF scaffolds were customized to the course subject, including

The Online Learning Environments. (A) KF (B) KF scaffolds (C) DingTalk discussions.
Adapting from the previous work (Yang et al., 2016; Yang, Chen, et al., 2020), the instructor designed a three-phase KB process as followings. Phase 1 - Cultivating the culture for collaborative research (Day 1). In Phase 1, teacher students read widely to search information, posted notes in their group’s view, summarized main points, and raised questions in KF. Toward the end of Phase 1, they were asked to use a Research Question format to state the problems, and to select the most promising problem for further inquiry. The instructor was engaged in the process to help teachers identify the target topic. Phase 2 - Promoting productive knowledge building using GMSs (Day 2 and Day 3). Groups worked in KF to create, build on, and integrate ideas on the research topic they chose in Phase 2. Teacher students researched their problems by reading additional resources, extended their inquiries, identified gaps of group members, and deepened their understanding about the research topic. At the end of Day 2 and Day 3, groups were asked to post a summary research note. Phase 3 - Deepening KB and domain understanding through reflection (Day 4). In this phase, groups summarized, evaluated, and reflected on what they learned during the previous two phases. The groups were asked to finalize one knowledge gap in Phase 2 and to further optimize their research design. Then groups made a 5-minute presentation to the whole class, and the peer-assessment strategy was used to evaluate group performances.
The Research Procedure
36 participants were assigned to 12 groups (3 teachers/group). The pre-course questionnaire was used to collect in-service teachers’ information regarding their educational background, teaching experiences, use of technologies, and prior knowledge level (see Appendix A). To assure group balance, the instructor assigned participants into triads in terms of their educational background, working experiences, and prior knowledge levels. Then, groups were randomly assigned into one of the three GMS scaffoldings. The GMSs interventions were introduced to groups at Phase 1 (Day 1) and the main intervention was offered during Phase 2 and Phase 3 by the instructor (see Figure 2). Scaffoldings were provided by the instructor through DingTalk every 20–30 minutes during the intervention; groups were required to reflect on those questions and write down their responses in DingTalk when the prompts were provided (see Figure 1C). The general scaffolding (

The Experimental Procedure.
Data collection and Analysis Process
To answer research question 1, groups’ KB processes were examined at two dimensions, namely
Descriptions of Online Behaviors.
To analyze cognitive engagement, quantitative content analysis (QCA) (Grbich, 2006) and lag-sequential analysis (LsA) (Lehmann-Willenbrock et al., 2013) were conducted to examine the content of KF notes. A coding scheme was proposed based on iterative open coding by three trained raters (see Table 2). Three raters next coded all data again and reached an inter-rater reliability (Krippendorff’s alpha = 0.835). The first author double-checked all codes and made the final decisions when there were conflicts. Next, based on the QCA results, LsA was used to examine the sequential contingencies of cognitive codes for each group (Chen et al. 2017). The Yule’Q value was used to calculate the strength a code transitioned to another code (lag = 1). Yule’s Q represents the strength of transitional association because it controls for base numbers of contributions and is descriptively useful (with a range from −1 to +1 and 0 indicating no association) (Chen et al., 2017).
Coding Framework of Cognitive Engagement.
To answer research question 2, the group-level research reflections were used to collect group’s reports of domain understandings during KB processes (at the end of Day 2, Day 3, and Day 4) (see Appendix B). In addition, groups’ final research proposals (at the end of the course) were collected and evaluated as the groups’ final domain understanding. Further, domain understandings were analyzed in terms of a proposed framework, including three dimensions, namely group reflection, idea argumentation, and academic performance (see Table 3).
The Analytical Framework of Domain Understandings.
To answer research question 3, online questionnaire, self-reports and group interviews were conducted. First, teachers were asked to complete a questionnaire three times (at the end of Day 2, Day 3, and Day 4) about their perceptions of collaborative cognitive load experienced during group work (Kirschner et al., 2018) (see Appendix C). The factor analysis of the questionnaire showed a high reliability (Cronbach’s alpha = 0.833) and validity (KMO = 0.806, Bartlett’s test = 0.000). Next, multiple Analyses of Covariance (ANCOVAs) were performed to analyze whether there were statistically significant differences among three GMSs after taking prior knowledge as a covariate. In addition, individual-level self-reports and group-level semi-structured interviews were conducted after the course to gain a deeper understanding of teacher perceptions about the effectiveness of the GMSs provided (see Appendix D). Thematic analysis was conducted to explore strengths and weaknesses of three GMSs.
Results
RQ1: What Were the Effects of Three GMSs on Groups’ Interactional Behavior and Cognitive Engagement during KB Process?
First, the interactional behavior results indicated that
Interactional Behaviors Under Three GMSs (
Second, QCA results showed that
Cognitive Engagement Results (
Moreover, LsA results showed different transitional patterns among three GMSs (see Table 6; Figure 3). Groups with
Sequential Transition of Cognitive Engagement.
The results only showed the top five sequential transitions in terms of average Yule’Q values.

The Cognitive Engagement Sequences Under Three GMSs.
Collaborative Cognitive Loads of Groups With Three Scaffoldings (
*
RQ2: What Were the Effects of Three GMSs on Groups’ Domain Understandings and Collaborative Cognitive Loads?
Regarding domain understandings, groups with
An adapted questionnaire was used to examine teachers’ perceptions of collaborative cognitive load (Kirschner et al., 2018) (see Appendix C). ANCOVA analyses results showed that there were no statistically significant interaction between the variables of prior knowledge and scaffolding except Q1. Therefore, ANCOVA analyses (taking the prior knowledge as a covariate) were further conducted on Q2 to Q6, which showed a statistically significant difference among three GMSs on group composition (Q5) (
RQ3: How Did Teacher Students Perceive the Functions of Three GMSs?
The most noticeable strengths of The scaffolding helped us come up with more new ideas and extend our existing thoughts. (self-reflection, a teacher in Group 11) After the instructor asked some scaffolding questions, my group members provided new information which I was not familiar with… this triggered my further exploration… (group interview, Group 10) …because we have different educational background, sometimes we expressed different thoughts, which were scattered…the scaffolding helped us take some time to reflect on those ideas and think deeper to improve those ideas… (self-reflection, a teacher in Group 9) The questions [from the scaffolding] helped us modify and improve our ideas as a group. (self-reflection, a teacher in Group 10) When we were trapped in the small details which was deviated from the topic, the instructor asked some questions to scaffold us think about the core ideas of our research design which help us make an explicit direction… (group interview, a teacher in Group 11) “although the scaffolding helped us control the group procedures to finish the collaborative task. (self-report, a teacher in Group 5) the scaffolding helped us divide the whole task into subtasks, then we could solve the problem step by step. (self-report, a teacher in Group 7) The general reminders [provided by the scaffolding] was not useful for us… which did not help us solve the specific questions… (self-report, a teacher in Group 6) as the course progressed, I realized that the prompting questions were deliberately designed and delivered by the instructor as a routine, which made it less effective… (group interview, a teacher in Group 8) The questions motivated us to engage actively in the collaborative knowledge building process. (self-report, a teacher in Group 3) sometimes I got distracted… the questions provided by the instructor reminded me to get engaged in the learning process… (group interview, a teacher in Group 2) I hope the instructor can point out what we need to modify directly, rather than providing general reminders about timing (self-report, a teacher in Group 1) it would be more effective if the instructor … could give specific suggestions about the research ideas, especially when we get stuck… (group interview, a teacher in Group 2)
Discussions
Since teaching is an intelligent activity itself (Putnam & Borko, 2000), teachers need to work as knowledge builders, instead of reproducing “best” teaching practices, which highlights the importance of KB practices in teacher education and professional development (Chen & Hong, 2016; Hargreaves, 1999). However, during teachers’ KB processes, they usually do not have awareness and skills for reflecting and regulating their collective idea development without external or technical supports. To address this issue, this study designed the general scaffolding (
For the first research question, the effects of three GMSs on KB process were examined based on KF data. Results showed that
To answer the second research question, the effects of three GMSs on teachers’ domain understandings and collaborative cognitive loads were examined. Analysis of groups’ research reflections and research proposals indicated that
The results of the third research question indicated that groups perceived
This research confirms the potential of the idea-oriented scaffolding for promoting teacher learning and practices through peer interactions, improving domain understandings, and addressing groups’ collaborative cognitive loads. Consistent with previous studies (e.g., Hong 2011; Lin & Chan, 2018; Wang et al., 2017), this research found that
Conclusion, Limitations, and Future Directions
In collaborative knowledge building, teachers can exchange and design curricula, develop new understandings of knowledge, and solve authentic problems to improve teaching quality (Akiba et al., 2019; Voogt et al., 2011; Yuan et al., 2018). The research indicates that the group-level metacognitive scaffolding has positive effects on helping teachers engage in question-idea exchanges with peers and reflecting and regulating their collective knowledge building process, and therefore fostered productive knowledge building. The findings have practical implications for researchers and instructors who are interested in the design of metacognitive environments to support knowledge building, social engagement and learner agency. Although the results verify that the idea-centered scaffolding is the most useful strategy, future research should extend idea-centered collaboration to a longer term and also expand the sample size of participating participants, in order to verify the different effect of the scaffoldings on CPS. In addition, from an analytical perspective, future research can consider conducting a more holistic examination of knowledge building processes on varied dimensions, such as social, cognitive, metacognitive, emotional, and behavioral dimensions. Overall, engaging teachers in knowledge building challenges them to appropriate a novel epistemic process where appropriate metacognitive scaffoldings are needed to improve the KB quality.
Appendix
A. Pre-course questionnaire
Personal information: Name, Gender, Age, current work position, educational background Educational technologies: What educational technologies did you use in your work or study? What educational technologies you would like to learn and further apply to your work? What influences may educational technologies have on your work or study? Collaborative learning: Have you ever experienced any collaborative learning, such as open-ended inquiry or discussions, problem-based learning, or project-based learning in small groups? You prefer to study alone by yourself, in small groups (2–5 people), or in large groups (6–15 people)? Prior knowledge level about theory and application of educational technologies (a total score of 100): 6 yes-or-no questions, 6 single-choice questions, and 6 multiple-choice questions (deleted details of questions due to length limits).
B. Group written reflection
Please make a written reflection about how your group understand about the research topic you are addressing for the research proposal, what you did well and what need to be improved during today’s collaboration, and what you plan to do for the next step.
C. Collaborative cognitive load questionnaire
The collaborative activity was complex enough such that the group needed to spend time and energy ton completing the activity. (task characteristics) The instructor provided enough guidance and support to help us complete the collaborative activity. (task characteristics) Group members applied relevant domain knowledge and experience to complete the collaborative activity related to the research proposal. (learner characteristics) Group members had enough collaborative skills to complete the collaborative activity. (learner characteristics) The group composition were beneficial for the current collaborative activity. (group characteristics) The group members took appropriate roles to complete the collaborative activity. (group characteristics)
D. The final self-report and group interview (selected questions)
The instructor provided scaffoldings during the collaborative processes. Did you think the prompts offered in the scaffolding were effective? Did group collaboration change with the instructor scaffolding? And how? If you thought the scaffolding was not useful, why? And what the instructor could do to make the scaffolding more effective? How?
