Expanding on the extant body of research on content validity, this study applied the tenets of content validity research to the development of an expository book reading intervention focused on science for preschool students with language impairment. This example case explains how, guided by content validity research in healthcare interventions, collaboration with an expert panel was systematically approached in the development of an educational intervention. Specifics as to how feedback was gathered and analyzed are discussed. Of practical importance for practitioners and researchers, this study provides a detailed description of how the knowledge and experience of a panel of experts was captured, analyzed, and incorporated into the development process of an educational intervention to validate its application.
BakasT.FarranC. J.AustinJ. K.GivenB. A.JohnsonE. A.WilliamsL. S. (2009). Content validity and satisfaction with a stroke caregiver intervention program. Journal of Nursing Scholarship, 41, 368–375.
2.
BeckC. T.GableR. K. (2001). Ensuring content validity: An illustration of the process. Journal of Nursing Measurement, 9, 201–215.
3.
BrodM.TeslerL. E.ChristensenT. L. (2009). Qualitative research and content validity: Developing best practices based on science and experience. Quality of Life Research, 18, Article 1263.
4.
CattsH. W.FeyM. E.TomblinJ. B.ZhangX. (2002). A longitudinal investigation of reading outcomes in children with language impairments. Journal of Speech, Language, and Hearing Research, 45, 1142–1157.
5.
CorbinJ. M.StraussA. (2007). Basics of qualitative research: Techniques and procedures for developing grounded theory (3rd ed.). Thousand Oaks, CA: SAGE.
6.
DamschroderL. J.AronD. C.KeithR. E.KirshS. R.AlexanderJ. A.LoweryJ. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, Article 50.
7.
DavisL. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5, 194–197.
8.
DukeN. K.KaysJ. (1998). “Can I say ‘once upon a time’?”: Kindergarten children developing knowledge of information book language. Early Childhood Research Quarterly, 13, 295–318.
9.
GerdeH. K.SchachterR. E.WasikB. A. (2013). Using the scientific method to guide learning: An integrated approach to early childhood curriculum. Early Childhood Education Journal, 41, 315–323.
10.
GrantJ. S.DavisL. L. (1997). Selection and use of content experts for instrument development. Research in Nursing and Health, 20, 269–274.
11.
GreensladeK. J.PlanteE.VanceR. (2009). The diagnostic accuracy and construct validity of the Structured Photographic Expressive Language Test–Preschool. Language, Speech, and Hearing Services in Schools, 40, 150–160.
12.
GubaE. G. (1981). Criteria for assessing the trustworthiness of naturalistic inquiries. Educational Technology Research & Development, 29(2), 75–91.
13.
HaynesS. N.RichardD. C. S.KubanyE. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238–247.
14.
JohnsonL. J.LaMontagneM. J. (1993). Research methods using content analysis to examine the verbal or written communication of stakeholders within early intervention. Journal of Early Intervention, 17, 73–79.
15.
JusticeL. M.BowlesR.PenceK.GosseC. (2010). A scalable tool for assessing children’s language abilities within a narrative context: The NAP (Narrative Assessment Protocol). Early Childhood Research Quarterly, 25, 218–234.
16.
KamhiA. G. (2014). Improving clinical practices for children with language and learning disorders. Language, Speech, and Hearing Services in Schools, 45, 92–103.
17.
KreftingL. (1991). Rigor in qualitative research: The assessment of trustworthiness. The American Journal of Occupational Therapy, 45, 214–222.
18.
LindellM. K.BrandtC. J. (1999). Assessing interrater agreement on the job relevance of a test: A comparison of CVI, T, rWG(J), and r*WG(J) indexes. Journal of Applied Psychology, 84, 640–647.
19.
LynnM. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382–385.
20.
McKenzieJ. F.WoodM. L.KoteckiJ. E.ClarkJ. K.BreyR. A. (1999). Establishing content validity: Using qualitative and quantitative steps. American Journal of Health Behaviors, 23, 311–318.
21.
NGSS Lead States (2013). Next Generation Science Standards: For States, by States. Washington, DC: The National Academies Press.
22.
PentimontiJ. M.ZuckerT. A.JusticeL. M.KaderavekJ. N. (2010). Informational text use in preschool classroom read-alouds. The Reading Teacher, 63, 656–665.
23.
PetersenD. B.SpencerT. D. (2012). The narrative language measures: Tools for language screening, progress monitoring, and intervention planning. Perspectives on Language Learning and Education, 19, 119–129.
24.
PolitD. F.BeckC. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29, 489–497.
25.
RubioD. M.Berg-WegerM.TebbS. S.LeeE. S.RauchS. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27, 94–104.
26.
SantoroL. E.ChardD. J.HowardL.BakerS. K. (2008). Making the very most of classroom read-alouds to promote comprehension and vocabulary. The Reading Teacher, 61, 396–408.
27.
TojibD. R.SugiantoL.-F. (2006). Content validity of instruments in IS research. Journal of Information Technology Theory and Application, 8(3), 31–56.
28.
U.S. Department of Education, National Center for Education Statistics. (2016). Digest of education statistics, 2015 (NCES 2016-014, Chap. 2). https://nces.ed.gov/pubs2017/2017094.pdf
29.
WagnerJ. L.SmithG.FergusonP.van BakergemK.HriskoS. (2011). Feasibility of a pediatric cognitive-behavioral self-management intervention: Coping openly and personally with epilepsy (COPE). Seizure, 20, 462–467.
30.
WaltzC. F.BausellR. B. (1981). Nursing research: Design, statistics and computer analysis. Philadelphia, PA: F.A. Davis.
31.
WasikB. A.BondM. A. (2001). Beyond the pages of a book: Interactive book reading and language development in preschool classrooms. Journal of Educational Psychology, 93, 243–250.
32.
WhitehurstG. J.FalcoF. L.LoniganC. J.FischelJ. E.DeBarysheB. D.Valdez-MenchacaM. C.CaulfieldM. (1988). Accelerating language development through picture book reading. Developmental Psychology, 24, 552–559.
33.
WilliamsJ. P.HallK. M.LauerK. D.StaffordK. B.DeSistoL. A.decaniJ. S. (2005). Expository text comprehension in the primary grade classroom. Journal of Educational Psychology, 97, 538–550.
34.
WyndC. A.SchmidtB.SchaeferM. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research, 25, 508–518.
