Sage Journals: Discover world-class research

Abstract

Continuous bounded responses in psychometrics usually come from the visual analog scale (VAS). The VAS is a rating scale measurement tool that requires respondents to report their agreement with items by tracing a mark somewhere on a fixed-length continuous horizontal segment with ends that are generally labeled “0% disagreement” to “100% agreement” (or other possible labeling) using continuous data. In recent years, the VAS has gradually appeared in medical, educational, and psychological research, such as research on pain, worry, rumination, anxiety, risk perception, and even personality trait measurement. However, there are very few cognitive diagnosis models (CDMs) in cognitive diagnostic assessment that can analyze such continuous bounded data from VAS-type scale. In this study, we propose a family of CDMs for the continuous bounded data in VAS-type scale and provide model selection methods for practice. Three simulation studies were used to examine parameter recovery, the impact of model misspecification on parameter recovery, and the effectiveness of the model selection method. Moreover, real data are used as an illustration to demonstrate the application and effectiveness of the proposed models.

Keywords

DINA model for continuous data cognitive diagnostic assessment visual analog scale

Get full access to this article

View all access options for this article.

References

Abend

Dan

Maoz

Raz

Bar-Haim

(2014). Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety. Journal of Behavior Therapy and Experimental Psychiatry, 45(4), 447–453. https://doi.org/10.1016/j.jbtep.2014.06.004

Aitken

R. C. B.

(1969). A growing edge of measurement of feelings [abridged]: Measurement of feelings using visual analogue scales. Proceedings of the Royal Society of Medicine, 62(10), 989–993. https://doi.org/10.1177/003591576906201005

Allen

I. E.

Seaman

C. A.

(2007). Likert scales and data analyses. Quality Progress, 40, 64–65.

Andrich

(1996). A hyperbolic cosine latent trait model for unfolding polytomous responses: Reconciling Thurstone and Likert methodologies. British Journal of Mathematical and Statistical Psychology, 49(2), 347–365. https://doi.org/10.1111/j.2044-8317.1996.tb01093.x

Babakus

Ferguson

C. E.

Jöreskog

K. G.

(1987). The sensitivity of confirmatory maximum likelihood factor analysis to violations of measurement scale and distributional assumptions. Journal of Marketing Research, 37, 72–141.

Baguley

T. S.

(2012). Serious stats: A guide to advanced statistics for the behavioral sciences (p. 287). Palgrave Macmillan.

Bhatia

(2019). Predicting risk perception: New insights from data science. Management Science, 65(8), 3800–3823. https://doi.org/10.1287/mnsc.2018.3121

Bollen

Barb

(1981). Pearson’s R and Coarsely Categorized Measures. American Sociological Review, 46, 232. https://doi.org/10.2307/2094981

Brooks

S. P.

Gelman

(1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7, 434–455. https://doi.org/10.2307/1390675

10.

Brooks

S. P.

Smith

Vehtari

Plummer

Stone

Robert

C. P.

Titterington

D. M.

Nelder

J. A.

Atkinson

Dawid

A. P.

Lawson

Clark

Bernardo

J. M.

Sahu

S. K.

Richardson

Green

Burnham

K. P.

DeIorio

Robert

C. P.

… Meng

X. L.

(2002). Discussion on the paper by Spiegelhalter, Best, Carlin and van der Linde. Journal of the Royal Statistical Society Series B: Statistical Methodology, 64(4), 616–639.

11.

Carlin

B. P.

Louis

T. A.

(2000). Bayes and empirical Bayes methods for data analysis. Chapman & Hall/CRC.

12.

Cheng

(2009). When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika, 74(4), 619. https://doi.org/10.1007/s11336-009-9123-2

13.

Chin

Chew

C. M.

Lim

H. L.

(2021). Incorporating feedback in online cognitive diagnostic assessment for enhancing grade five students’ achievement in “time”. Journal of Computers in Education, 8(2), 183–212. https://doi.org/10.1007/s40692-020-00176-3

14.

Cohen

(1969). Statistical power analysis for the behavioral sciences. Academic Press.

15.

Couper

M. P.

Tourangeau

Conrad

F. G.

Singer

(2006). Evaluating the effectiveness of visual analog scales: A web experiment. Social Science Computer Review, 24(2), 227–245. https://doi.org/10.1177/0894439305281503

16.

de la Torre

(2010, July 7–9). The partial-credit DINA model [Paper presentation]. International Meeting of the Psychometric Society, Athens, GA, United States.

17.

de la Torre

Douglas

J. A.

(2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69(3), 333–353. https://doi.org/10.1007/BF02295640

18.

de Oliveira

E. B.

Wang

Bazán

J. L.

(2023). A classification model for continuous responses: Identifying risk perception groups on health-related activities. Biometrical Journal, 65, 2100222. https://doi.org/10.1002/bimj.202100222

19.

Gelman

Carlin

J. B.

Stern

H. S.

Rubin

D. B.

(2003). Bayesian data analysis (2nd ed.). CRC Press.

20.

(2019). The sufficient and necessary condition for the identifiability and estimability of the DINA model. Psychometrika, 84, 468–483. https://doi.org/10.1007/s11336-018-9619-8

21.

Haertel

E. H.

(1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26(4), 301–321. https://doi.org/10.1111/j.1745-3984.1989.tb00336.x

22.

Jaeger

Tatsuoka

Berns

Varadi

(2006). Distinguishing neurocognitive functions using partially ordered classification models. Schizophrenia Bulletin, 32, 679–691. https://doi.org/10.1093/schbul/sbj038

23.

Junker

B. W.

Sijtsma

(2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25(3), 258–272. https://doi.org/10.1177/01466210122032064

24.

Kang

Kim

(2014). Application of diagnostic classification models to the development of a psychological inventory: Based on the comparison of diagnostic classification models to exploratory factor analysis. Korea Journal of Counseling, 15(1), 87–107.

25.

Klimek

Bergmann

K.-C.

Biedermann

Bousquet

Hellings

Jung

Merk

Olze

Schlenter

Stock

Ring

Wagenmann

Wehrmann

Mösges

Pfaar

(2017). Visual analogue scales (VAS): Measuring instruments for the documentation of symptoms and therapy monitoring in cases of allergic rhinitis in everyday health care. Allergo Journal International, 26(1), 16–24. https://doi.org/10.1007/s40629-016-0006-7

26.

Kuhlmann

Dantlgraber

Reips

U.-D.

(2017). Erratum to: Investigating measurement equivalence of visual analogue scales and Likert-type scales in Internet-based personality questionnaires. Behavior Research Methods, 49(6), 2182. https://doi.org/10.3758/s13428-017-0868-8

27.

Liu

Jiang

(2020). A general diagnostic classification model for rating scales. Behavior Research Methods, 52(1), 422–439. https://doi.org/10.3758/s13428-019-01239-9

28.

de la Torre

(2016). A sequential cognitive diagnosis model for polytomous responses. British Journal of Mathematical and Statistical Psychology, 69(3), 253–275. https://doi.org/10.1111/bmsp.12070

29.

de la Torre

(2020). GDINA: An R package for cognitive diagnosis modeling. Journal of Statistical Software, 93(14), 1–26. https://doi.org/10.18637/jss.v093.i14

30.

Maris

(1999). Estimating multiple classification latent class models. Psychometrika, 64(2), 187–212. https://doi.org/10.1007/BF02294535

31.

Masjkur

Folmer

(2016). Bayesian random parameter models of fertilizer dosing with independent skew-normally distributed random components. IJSER, International Journal of Scientific & Engineering Research, 7(12), 837–844.

32.

Minchen

de la Torre

(2018). A general cognitive diagnosis model for continuous-response data. Measurement: Interdisciplinary Research and Perspectives, 16(1), 30–44. https://doi.org/10.1080/15366367.2018.1436817

33.

Minchen

N. D.

de la Torre

Liu

(2017). A cognitive diagnosis model for continuous response. Journal of Educational and Behavioral Statistics, 42(6), 651–677. https://doi.org/10.3102/1076998617703060

34.

Molenaar

Cúri

Bazán

J. L.

(2022). Zero and one inflated item response theory models for bounded continuous data. Journal of Educational and Behavioral Statistics, 47(6), 693–735. https://doi.org/10.3102/10769986221108455

35.

Myles

P. S.

Troedel

Boquest

Reeves

(1999). The pain visual analog scale: Is it linear or nonlinear? Anesthesia and Analgesia, 89, 1517–1520.

36.

Noel

(2014). A Beta unfolding model for continuous bounded responses. Psychometrika, 79(4), 647–674. https://doi.org/10.1080/15366367.2018.1436817

37.

Noel

Dauvier

(2007). A Beta item response model for continuous bounded responses. Applied Psychological Measurement, 31(1), 47–73. https://doi.org/10.1177/0146621605287691

38.

Plummer

(2003, March 20–22). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In Hornik

Leisch

Zeileis

(Eds.), Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003), Vienna, Austria. https://www.r-project.org/conferences/DSC-2003/Proceedings/Plummer.pdf

39.

R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

40.

Reips

U.-D.

Funke

(2008). Interval-level measurement with visual analogue scales in Internet-based research: VAS generator. Behavior Research Methods, 40(3), 699–704. https://doi.org/10.3758/BRM.40.3.699

41.

Siegel

(1956). Nonparametric statistics for the behavioral sciences. McGraw-Hill.

42.

Spiegelhalter

D. J.

Best

N. G.

Carlin

B. P.

Van Der Linde

(2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(4), 583–639. https://doi.org/10.1111/1467-9868.00353

43.

Y.-S.

Yajima

(2020). R2jags: Using R to run “JAGS.” R package version 0.6-1. https://CRAN.R-project.org/package=R2jags

44.

Sung

Y.-T.

J.-S.

(2018). The Visual Analogue Scale for Rating, Ranking and Paired-Comparison (VAS-RRP): A new technique for psychological measurement. Behavior Research Methods, 50(4), 1694–1715. https://doi.org/10.3758/s13428-018-1041-8

45.

Tang

Zhan

(2021). Does diagnostic feedback promote learning? Evidence from a longitudinal cognitive diagnostic assessment. AERA Open, 7, 233285842110608. https://doi.org/10.1177/23328584211060804

46.

Templin

J. L.

Bradshaw

(2013). Measuring the reliability of diagnostic classification model examinee estimates. Journal of Classification, 30(2), 251–275. https://doi.org/10.1007/s00357-013-9129-4

47.

Templin

J. L.

Henson

R. A.

(2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11(3), 287–305. https://doi.org/10.1037/1082-989X.11.3.287

48.

Thurstone

L. L.

(1927). A law of comparative judgment. Psychological Review, 34(4), 273–286. https://doi.org/10.1037/h0070288

49.

Thurstone

L. L.

(1928). Attitudes can be measured. American Journal of Sociology, 33(4), 529–554. https://doi.org/10.1086/214483

50.

Ventura

M. T.

Giuliano

A. F. M.

Buquicchio

Bedbrook

Czarlewski

Laune

Bousquet

(2021). Implementation of the MASK-Air^® app for rhinitis and asthma in older adults: MASK@Puglia pilot study. International Archives of Allergy and Immunology, 183(1), 45–50. https://doi.org/10.1159/000518032

51.

von Davier

(2008). A general diagnostic model applied to language testing data. British Journal of Mathematical and Statistical Psychology, 61(2), 287–307. https://doi.org/10.1348/000711007X193957

52.

Weigl

Forstner

(2020). Design of paper-based visual analogue scale items. Educational and Psychological Measurement, 81(3), 595–611. https://doi.org/10.1177/0013164420952118

53.

Wewers

M. E.

Lowe

N. K.

(1990). A critical review of visual analogue scales in the measurement of clinical phenomena. Research in Nursing & Health, 13(4), 227–236. https://doi.org/10.1002/nur.4770130405

54.

Wichelns

G. A.

Renna

M. E.

Mennin

D. S.

(2016). Preliminary validation of subjective anchor scales for worry and rumination. Cognitive Therapy and Research, 40(5), 645–660. https://doi.org/10.1007/s10608-016-9779-8

55.

Wise

Zbozinek

T. D.

Michelini

Hagan

C. C.

Mobbs

(2020). Changes in risk perception and self-reported protective behaviour during the first week of the COVID-19 pandemic in the United States. Royal Society Open Science, 7(9), 200742. https://doi.org/10.1098/rsos.200742

56.

C. Q.

Cai

D. B.

(2020). A diagnostic classification version of schizotypal personality questionnaire using diagnostic classification models. International Journal of Methods in Psychiatric Research, 29(1), 1–16. https://doi.org/10.1002/mpr.1807

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.32 MB

0.00 MB

A Family of Cognitive Diagnosis Models for Continuous Bounded Responses

Abstract

Keywords

Get full access to this article

References

Supplementary Material