Abstract
Keywords
Introduction
Concussion is a common injury among children and adolescents impacting their day-to-day activities at home, in school and extra-curriculars such as sport. 1 Recent evidence-based consensus statements 2 and clinical practice guidelines3,4 have been established as foundational products to assist healthcare professionals with the diagnosis and management of pediatric concussion. These products aim to improve the quality of care provided; enhance patient overall health and wellbeing; prevent long-term symptoms; reduce variation in healthcare professional practices; and optimize the use of health system resources to provide care. 5 Widespread implementation of clinical practice guidelines is essential to achieve these aims and is dependent on effective knowledge translation (KT).
KT is defined as “…the broad range of activities meant to improve the use of health research [evidence] in practice and to inform further research leading to evidence-based decision-making in healthcare (p.1).” 6 Central to KT are dissemination and implementation. Dissemination is a planned process that involves identifying a knowledge user group and setting, and tailoring specific messages, products (e.g. infographics) and sharing mechanisms or channels (e.g. journals, education sessions, websites) to that group to raise awareness.7,8 Implementation is the purposeful use of strategies (e.g. education, audit and feedback, reminders, etc.) guided by theories, models, frameworks and approaches to promote the uptake of evidence-based products to change care delivery.9–11 Dissemination is an important precursor to implementation and while necessary, does not act alone in driving evidence adoption and practice change. 10
Within the concussion context, peer-reviewed journal publications have most often been used to raise awareness of consensus statements and clinical practice guidelines, particularly within the field of sport medicine. 12 While publications may be effective for reaching some healthcare professionals, they are not sufficient to maximize reach and prime for implementation. Developers of concussion consensus statements and clinical practice guidelines recommend more explicit use of KT models and approaches within this field.2,3 We identified an opportunity to create purposeful and planned dissemination efforts to maximize awareness and reach of best practices in concussion care and to effectively prepare knowledge users for evidence adoption.
An integrated knowledge translation (iKT) approach is well-positioned to meet this need. Integrated KT refers to the dynamic relationship between researchers and knowledge users (e.g. concussion care providers) and involves collaborative knowledge production within a research context to foster decision-making. 13 Benefits of iKT include broadening of networks, nurturing collaboration, fostering access to information, and promoting the spread, scale and use of research in practice. 14 Uptake of iKT approaches is becoming more apparent across various contexts, such as community agencies. For example, the international Preventing Violence Across the Lifespan (PreVAiL) Research Network adopted an iKT approach to support the co-production and timely application of research to develop policies and influence systems around family violence. 15 Activities included fostering authentic collaboration throughout the research process, plus priority setting and research question generation. Learning about new research, the evolution of research methods in the field of violence, and enhanced linkages across researchers in this field were valuable outputs identified across the Network. 15 The Canadian Population Attributable Risk of Cancer (ComPARe) study team also adopted an iKT approach to maximize the impact of research on cancer prevention. 16 Bringing together cancer prevention researchers (knowledge producers) and the Canadian Cancer Society (knowledge user) resulted in the co-creation of a KT blueprint to help plan for KT, develop KT products to share study findings, establish a dissemination plan for the work and an evaluation strategy. In the aforementioned examples, applying this approach provided a platform for the knowledge producers and users to create and share information in a way that was meaningful and useful to the knowledge users. 16
With the use of iKT in other health fields as a guide, there is an opportunity across the concussion landscape to bolster the integration of KT processes in the creation of evidence-based guidelines and tools and to promote their sharing (dissemination) and use (implementation). Embracing this spirit, a significant investment in KT practice was at the forefront of the development of the
Method
Development team
This work was co-led by two clinician scientists (a pediatric emergency medicine physician and an occupational therapist) with expertise in pediatric concussion research and care, and a core development team comprised of a guideline developer, scientist with expertise in experimental psychology and behavioural neuroscience, and a post-doctoral fellow. Endorsement from the co-leads and dedicated funding allowed for KT planning to occur at the onset of guideline development. To establish a strong KT vision and integrate KT principles and activities in the guideline development process, a KT practitioner (i.e. KT Specialist) was engaged as the Knowledge Translation and Mobilization Lead. The KT practitioner is Masters’ trained in a health-related discipline, holds an advanced certificate in KT practice, and has experience in the application of KT to the pediatric concussion context. Engaging an individual with KT capacity and training was deemed essential to facilitate optimal KT practice.
iKT design
An in-person consensus meeting was held (Toronto, Ontario) with 46 expert panelist members, representing clinical care and research pediatric concussion experts (e.g. physiatry, neurology, neuropsychology, occupational therapy), administrators, educators and students from across Canada and the United States. Participants were invited based on their knowledge and expertise in the clinical assessment and management of pediatric concussion. The meeting focused on guideline development and provided a collaborative space for the expert panelist members to review and update recommendations, tools and clinical algorithms from the prior guideline, 17 and generate new evidence-informed recommendations. During this two-day meeting there were two KT planning activities: 1. a KT workshop and 2. a knowledge board 18 (a board capturing real-time insights and thoughts shared by others). An iKT approach was used as a foundation for engaging concussion care providers and researchers as knowledge users to assist with KT planning. These activities were informed by KT frameworks and principles to establish a dissemination plan, identify and create meaningful products to share the Living Guideline, and prepare for implementation planning. In order to expand upon recommended outputs from the KT workshop and knowledge board, healthcare professionals, educators, coaches and youth/young adults and families with lived experience in concussion were included via a snowball approach 19 using interviews and focus groups. Specific to these KT aims, Figure 1 outlines iKT activities designed to foster engagement, with the following section describing these activities in greater detail.

Integrated knowledge translation activities to promote dissemination planning, implementation preparation and product development.
KT planning workshop
Building on previous dissemination efforts from the 2014 guideline aims, the purpose of the in-person 4-h KT planning workshop was to co-create a plan to promote sharing and enable use of the Living Guideline. The workshop was organized into two activities: 1. dissemination planning and 2. priming for implementation planning. To position dissemination and implementation planning activities, lay definitions of key terms were provided to ensure participants had a collective understanding of terminology before progressing with KT planning efforts; see Table 1.
Definitions of KT terms shared with expert panelist members.
Activity 1: dissemination planning
Dissemination planning was guided by core concepts from Lavis et al.'s Framework for Knowledge Transfer, chosen for its operational and active focus on sharing evidence-based knowledge.9,21 The knowledge transfer framework poses five key questions for consideration when developing a knowledge sharing strategy: 1. What is the message that you are sharing with decision makers?; 2. Who should the message be shared with?; 3. Who should be sharing the message?; 4. What strategies should be used for sharing the message?; and, 5. With what impact should the message be shared? 21
The session started by sharing the specified goal and then expert panel members were invited to reflect individually on the impact question
Summary of dissemination commitment form responses.
Activity 2: preparing for implementation planning
A group-based activity was further used to inspire creative and critical thinking and foster active participation among the expert panel members. Activity design features included a defined task with specific objectives that would allow participants to bring their knowledge and expertise to the activity through discussion, questioning and reflection;
22
and work together to problem solve and generate ideas
23
related to guideline implementation. The goal was to gather insights across different clinical contexts regarding strategies that would help healthcare professionals implement the Living Guideline and use it to ‘start, stop and/or change’ their concussion practices (behaviour change). Based on their unique disciplines and clinical contexts, experts were asked to select one setting that resonated with them – (i) primary care hospital; (ii) rehabilitation hospital; (iii) primary care community; or (iv) rehabilitation community -- for small group work. All four groups were asked to review the following scenario, influenced by appreciative inquiry principles,
24
from the perspective of their selected clinical context: The new clinical practice guideline has been launched. Your clinical team is now expected to use the recommendations in practice. You have been asked by your Manager to create an implementation strategy for the clinic team. You have a 6 month window to put supports in place and are working with champions to help you do it.
After reviewing the scenario, each group was presented with the generative question “What will help you use this guideline tomorrow?” All groups engaged in a 20-min brainstorming discussion guided by a facilitator. Facilitation prompts, outlined in Table 3, were provided to stimulate discussion among the expert panelist members.
Facilitation prompts for implementation planning.
After 20 min of brainstorming, the groups were instructed to mock-up implementation strategies, defined as methods to increase the delivery of an evidence-based practice for helping healthcare professionals use the guideline. 25 The groups were given 40 min and were provided with supplies (e.g. markers, chart paper, post-its) to help them mock-up their strategies. All groups were asked to identify content to be included in their strategies and think about the operational resources (e.g. budget, people) required to create them. After the mock-up portion of the session, the four groups presented their ideas, followed by a large group discussion regarding priority areas for implementation strategies.
The KT specialist and primary author (CP) engaged in a sense making 26 activity to organize the suggested strategies and identify what purpose these strategies could serve with implementation efforts. Ideas for implementation strategies were organized using Michie, van Stralan and West's Behaviour Change Wheel (BCW) and are summarized in Table 4. 27 The BCW is an approach to characterizing interventions or activities, such as education or training, that promote behaviour change (starting, stopping or changing a practice) 27 in this instance, use of the Living Guideline in clinical practice.
Exemplar implementation strategies to foster Living Guideline use.
*Definitions of intervention functions have been adapted from Michie et al. (2011). 27
Knowledge boards
Knowledge boards 18 (i.e. large poster boards), were also used to stimulate and co-inform dissemination efforts. These boards were placed outside of the conference room and participants were encouraged over the two days to contribute their ideas, with great specificity using post-it notes, on the following questions: 1. What organizations, groups or associations should we share the guidelines with? and 2. How would you share the guideline or information about the guideline with parents, teachers and sport groups? This format provided expert panel members an opportunity to expand on identifying knowledge users for the Living Guideline and channels for information sharing. 21 A summary of ideas generated from the knowledge boards is presented in Table 5. Outputs affirmed suggested knowledge users and dissemination channels that emerged from the earlier dissemination planning activity (KT planning workshop activity 1).
Knowledge board summary.
Product development
Workshop and knowledge board outcomes were subsequently used to guide KT product development to foster the dissemination of and prepare for guideline implementation. Product development was a collective effort, with products created by the Living Guideline's KT practitioner and the development team, with in-kind support from KT and project coordinator staff from the project co-leads’ organizations, and the ONF. An iKT philosophy continued to guide this phase of the work. Over ten individuals, including healthcare professionals, youth/young adults and families with lived experience of concussion, educators and coaches, were engaged as knowledge users via interviews, focus groups and/or email to foster exchange, inform product content and design, and provide feedback on draft versions. Three types of KT products were generated: 1) a guide for health professionals; 2) slide decks to deliver presentations; and, 3) a suite of community resources. Table 6 provides a full list of the eight products, their aim and how they were developed. All products are freely available for download from the Living Guideline website (https://pedsconcussion.com).
Living guideline KT products.
Executing the dissemination plan
The immediate goals of the dissemination plan were to raise awareness and promote reach of the Living Guideline and related KT products to foster use. The plan was executed by the development team, with in kind support from communication experts from the ONF and co-lead representative organizations. Expert panel members from the consensus meeting, in addition to internal and external networks, were invited to help share the Living Guideline. Drawing from the information gathered during the KT workshop and knowledge boards, a variety of dissemination channels were leveraged to share the guideline. Sharing mechanisms were selected based on resources to support their execution, and included media and social media profiling, events, and a network email strategy. Reach of the guideline was evaluated through participant attendance at in-person dissemination activities, as well as tracking website hits and KT product downloads. Details of these activities and associated metrics are described below.
Media and social media
Creation of a media and social media strategy was a joint effort of communication and KT experts to drive spread. The guideline website https://pedsconcussion.com was launched in September 2019. A press release was launched by the ONF in collaboration with the project co-leads’ partnering organizations. Organized by their respective communication departments, the project leads were engaged in newspaper (n = 9), radio (n = 3) and television (n = 1) interviews. Living Guideline development team members, expert panelist members, collaborating organizations and colleagues created Twitter posts to share and highlight different aspects of the guideline. Post-guideline launch, tweets were pre-written and entered in an auto-scheduling programme to highlight Living Guideline recommendations, tools, resources and KT products in a scheduled manner, and were also written to align with internationally recognized days or events (e.g. Brain Injury Awareness Week). Tweets were shared monthly via ONF's Twitter account (reach of 894 followers) and the Living Guideline Twitter account (@PedsConcussion, reach of 350 followers). Many individual posts received over 3000 impressions (@PedsConcussion account) on social media. Expert panel members used social media in real time at events, and created their own posts via Twitter and LinkedIn.
Events
The guideline development team and expert panel members engaged in activities ranging from presentations at conferences and community practice groups, to the delivery of seminars, webinars and workshops. These events were delivered at a local, national, and international level. A variety of knowledge user groups were targeted including healthcare professionals, policy makers, lawyers, researchers, educators (e.g. teachers), sport experts (e.g. coaches), students (e.g. high-school, undergraduate, graduate), and the general public (e.g. parents). Details of the events, targeted knowledge user groups and reach were reported to the funder for the September 2019-March 2020 time period and are outlined in Table 7.
KT events, knowledge user groups and reach.
Targeted email and network strategy
Expert panel members were also invited to share the Living Guideline with their networks. ONF distributed guideline information to 234 subscribers who identified having an interest in acquired brain injury. Organizations representing healthcare professionals likely to be involved in the diagnosis and/or management of pediatric concussion were also targeted, with emails sent to 14 provincial (e.g. Ontario Society of Occupational Therapists, Ontario Association of Social Workers) and 14 national (e.g. Canadian Association of Emergency Physicians, Canadian Psychological Association) organizations.
Website and download metrics
From September 2019 to January 2022, there were nearly 42,000 page views, with international reach to over 105 countries. Push efforts including media, social media, and network activities were heavy in the first six months of the Living Guideline release, resulting in nearly 12,000 page views during that time period. See Figure 2 for a visual description of page views per 6-month period from September 2019 to August 2021. Data was also captured regarding the KT products. Table 8 offers a summary of KT product downloads during this 2.5-year period.

Number of page views per 6-month period from September 2019-August 2021.
KT product reach metrics.
Discussion
This article describes an iKT approach and application of KT frameworks and principles in the creation and dissemination of KT products for the Living Guideline. The primary aim of this work was to develop a dissemination plan informed by knowledge users to raise awareness of this newest evidence-based clinical practice guideline across different audiences.
Knowing the target audience, aligning messaging and dissemination efforts with said audience, and using personal (e.g. interactive education, engagement of opinion leaders) and non-personal (e.g. journals, social media) activities for information sharing are key elements of a dissemination plan. 28 The development team applied an iKT approach to create a meaningful dissemination plan which ensured that a ‘big picture’ of varied knowledge users and contexts were considered in designing key messages, identifying accompanying products, and selecting appropriate dissemination channels. The intensive push efforts by the development team and the expert panel members fostered global reach of the Living Guideline to over 105 countries. Their efforts resulted in almost 12, 000 page views in the first 6 months of guideline release and nearly 42,000 page views over a 2.5-year period (September 2019 – January 2022). Push efforts are ongoing, using social media, virtual and in-person platforms to continue to promote the Living Guideline.
Healthcare professionals were the primary audience for this guideline; however, community resources were created to provide education, tips and strategies to help those impacted by concussion have conversations with healthcare professionals and make decisions about concussion care. Family products, specifically the parent handout and lay version of the guideline had the highest number of downloads throughout the 2.5-year period. These metrics demonstrate that parents are active knowledge users of guidelines and seek evidence-based information to inform their child's concussion care. Vernooij, Willson, Gagliardi and the members of the Guidelines International Network Implementation Working Group's (2016) exploration of patient focused resources accompanying guidelines highlights that such resources can enhance understanding of a health issue, prompt action for managing a health issue, and foster healthcare-patient communication. 29 As demonstrated in the current KT efforts, guideline developers should consider the importance of creating patient-centred resources in tandem with guideline development to promote the improved health of patients. Future efforts to better understand who is downloading resources (e.g. types of healthcare professionals, youth, sport organizations) and for what purpose (e.g. improving knowledge) should be explored to understand the needs of the concussion community and tailor resources appropriately.
Identifying effective products and channels for guideline dissemination to patients is also important to ensure KT efforts reach the right people and provide them with the right information in a way that meets their needs. Creating a dissemination plan in tandem with guideline development that identifies the target audience, scope and dissemination methods is essential for an efficient and effective KT appraoch. 30 A multi-strategy approach that accounts for the needs of knowledge users and a given context can raise awareness of guideline recommendations and improve the health and wellbeing of patients.8,30 Guideline developers need to be mindful of these factors while also considering barriers (e.g. health literacy, trustworthiness of content, internet access, personal needs) to disseminating knowledge to recipients of healthcare. 8 Addressing these considerations must be done in partnership with patients to achieve success. In using an iKT approach, youth, families and others with lived experience were engaged in creating these community resources to foster concussion care, alongside planning for and executing dissemination efforts.
Applying an iKT approach to create a multi-user dissemination plan, develop evidence-based and patient-centred resources, and to prime for implementation required tremendous effort. Investing in KT expertise from the original 2014 guideline to the 2019 Living Guideline was deemed necessary by the development team to execute this plan. Guideline developers should consider engaging a designated KT practitioner knowledgeable in KT science to bring evidence-based KT approaches to fruition. KT practitioners (i.e. knowledge brokers, knowledge translation specialists) play a critical role in enhancing the uptake of evidence into practice. 31 The function and impact of engaging knowledge brokers in driving research into practice has been explored in health-related contexts. 32 The insight and expertise brought by KT practitioners is unique and should not be overlooked as part of engagement and collaboration efforts, KT product development, evidence gathering and synthesis, and dissemination and implementation efforts during the guideline development process. 31 Further, evaluating the impact of the KT practitioner role in driving evidence into care should also be explored.
Future considerations
Understanding the impact of dissemination efforts is critical to assessing the effectiveness of the plan that was created. The primary outcome within the scope of the current work focused on reach of the Living Guideline and accompanying resources. However, guideline development teams would be well served by advocating for resources necessary to explore added indicators such as usefulness (e.g. satisfaction with the guideline, value of knowledge gained), use (e.g. intention to use the information), and partnerships (e.g. number of products created with partners) in order to deepen understanding of broader impacts. Seeking continued feedback from the concussion community will be essential to developing and optimizing KT products for knowledge users.
While sharing and making guidelines available to healthcare professionals is essential, it does not ensure their use in practice. Implementation of recommendations and accompanying tools (e.g. algorithms) from the Living Guideline is critical for optimal diagnosis and management of pediatric concussion. Creating a plan, assessing intervention needs and using strategies to implement that are informed by implementation science is a critical next step in implementation of this Living Guideline.
Conclusion
Guideline dissemination does not guarantee practice change and should not be an afterthought. Effective dissemination of evidence-based resources is however a necessary step toward uptake and use of evidence in practice. Dissemination planning should occur synchronously with guideline development and be informed by appropriate theories, models, frameworks and approaches, and engage varied perspectives in its design.
In the Living Guideline, a KT philosophy to guideline development was supported by the clinician co-leads and development team. Applying an iKT approach allowed for thoughtful interaction and partnership building during the KT planning workshop and community resource building activities. Knowledge user engagement is powerful and can shape and influence the creation of evidence-based products and how these products are shared and used in practice. By demonstrating the breadth and impact of the KT activities accomplished in this work, it is hoped that concussion and other communities will explore how KT practices can bolster efforts to raise awareness and drive evidence into practice, with the goal of enhancing pediatric concussion outcomes.
