The Clock Drawing Test (CDT) is a commonly used tool in clinical practice and research for cognitive screening among older adults. The main goal of the present study was to analyze the interrater reliability of three different CDT scoring systems (by Shulman et al., Babins et al., and Cohen et al.). We used a clock with a predrawn circle. The CDT was evaluated by three independent raters based on the normative data set of healthy older and very old adults and patients with nonamnestic mild cognitive impairment (naMCI; N = 438; aged 61-94). We confirmed a high interrater reliability measured by the intraclass correlation coefficients (ICCs): Shulman ICC = .809, Babins ICC = .894, and Cohen ICC = .862, all p < .001. We found that age and education levels have a significant effect on CDT performance, yet there was no influence of gender. Finally, the scoring systems differentiated between naMCI and age- and education-matched controls: Shulman’s area under the receiver operating characteristic curve (AUC) = .84, Cohen AUC = .71, all p < .001; and a slightly lower discriminative ability was shown by Babins: AUC = .65, p = .012.
BabinsL.SlaterM. E.WhiteheadV.ChertkowH. (2008). Can an 18-point clock-drawing scoring system predict dementia in elderly individuals with mild cognitive impairment?Journal of Clinical and Experimental Neuropsychology, 30, 173-186.
2.
BattersbyW. S.BenderM. B.PollackM.KahnR. L. (1956). Unilateral spatial agnosia (inattention) in patients with cerebral lesions. Brain, 79, 68-93.
3.
BentonA.TranelD. (1996). Visuoperceptual, visuospatial and visuoconstructive disorders. In HeilmanK.ValensteinE. (Eds.), Clinical neuropsychology (3rd ed., pp. 165-214). New York, NY: Oxford University Press.
4.
BezdicekO.LibonD. J.StepankovaH.PanenkovaE.LukavskyJ.GarrettK. D. (2014). Development, validity, and normative data study for the 12-word Philadelphia Verbal Learning Test [czP(r)VLT-12] among older and very old Czech adults. Clinical Neuropsychologist, 28, 1162-1181.
5.
BezdíčekO.LukavskýJ.PreissM. (2011). Validizační studie české verze dotazníku FAQ [Functional activities questionnaire, Czech version: A validation study]. Ceska a Slovenska Neurologie a Neurochirurgie, 74(1), 36-42.
6.
BezdicekO.LukavskyJ.StepankovaH.NikolaiT.AxelrodB. N.MichalecJ. (2015). The Prague Stroop Test: Normative standards in older Czech adults and discriminative validity for mild cognitive impairment in Parkinson’s disease. Journal of Clinical and Experimental Neuropsychology, 37, 794-807.
7.
BezdicekO.MotakL.AxelrodB. N.PreissM.NikolaiT.VyhnalekM. (2012). Czech version of the Trail Making Test: Normative data and clinical utility. Archives of Clinical Neuropsychology, 27, 906-914.
8.
BezdicekO.StepankovaH.MotakL.AxelrodB. N.WoodardJ. L.PreissM. (2014). Czech version of Rey auditory verbal learning test: Normative data. Aging, Neuropsychology, and Cognition, 21, 693-721.
9.
BezdicekO.StepankovaH.NovakovaL. M.KopecekM. (2015). Toward the processing speed theory of activities of daily living in healthy aging: Normative data of the Functional Activities Questionnaire. Aging Clinical and Experimental Research. Advance online publication. doi:10.1007/s40520-015-0413-5
10.
BodnerT.DelazerM.KemmlerG.GurkaP.MarksteinerJ.FleischhackerW. W. (2004). Clock drawing, clock reading, clock setting, and judgment of clock faces in elderly people with dementia and depression. Journal of the American Geriatrics Society, 52, 1146-1150.
11.
BozikasV. P.GiazkoulidouA.HatzigeorgiadouM.KaravatosA.KosmidisM. H. (2008). Do age and education contribute to performance on the clock drawing test? Normative data for the Greek population. Journal of Clinical and Experimental Neuropsychology, 30, 199-203.
12.
BrodatyH.MooreC. M. (1997). The Clock Drawing Test for dementia of the Alzheimer’s type: A comparison of three scoring methods in a memory disorders clinic. International Journal of Geriatric Psychiatry, 12, 619-627.
13.
CaffarraP.GardiniS.ZonatoF.ConcariL.DieciF.CopelliS. (2011). Italian norms for the Freedman version of the Clock Drawing Test. Journal of Clinical and Experimental Neuropsychology, 33, 982-988.
14.
CachoJ.García-GarcíaR.Fernández-CalvoB.GamazoS.Rodríguez-PérezR.AlmeidaA. (2005). Improvement pattern in the Clock Drawing Test in early Alzheimer’s disease. European Neurology, 53, 140-145.
15.
CohenM. J.RicciC. A.KibbyM. Y.EdmondsJ. E. (2000). Developmental progression of clock face drawing in children. Child Neuropsychology, 6(1), 64-76.
16.
CritchleyM. (1953). The parietal lobes. New York, NY: Hafner.
17.
CrockerL.AlginaJ. (2008). Introduction to classical and modern test theory. Mason, OH: Cengage Learning.
18.
DrozdováK.ŠtěpánkováH.LukavskýJ.BezdíčekO.KopečekM. (2015). Normatitvní studie testu Reyovy-Osterriethovy komplexní figury v populaci českých seniorů [Normative data for Rey-Osterrieth complex figure test in older Czech adults]. Ceska a Slovenska Neurologie a Neurochirurgie, 78(111), 542-549.
19.
EhrekeL.LuckT.LuppaM.KonigH. H.VillringerA.Riedel-HellerS. G. (2011). Clock Drawing Test: Screening utility for mild cognitive impairment according to different scoring systems: Results of the Leipzig Longitudinal Study of the Aged (LEILA 75+). International Psychogeriatrics, 23, 1592-1601.
20.
EhrekeL.LuppaM.KonigH. H.Riedel-HellerS. G. (2010). Is the Clock Drawing Test a screening tool for the diagnosis of mild cognitive impairment? A systematic review. International Psychogeriatrics, 22, 56-63.
21.
FolsteinM. F.FolsteinS. E.McHughP. R. (1975). “Mini-mental state.” A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198.
22.
FreedmanM.LeachL.KaplanE.WinocurG.ShulmanK. I.DelisD. C. (1994). Clock Drawing: A neuropsychological analysis. New York, NY: Oxford University Press.
23.
FuzikawaC.Lima-CostaM. F.UchoaE.BarretoS. M.ShulmanK.BambuiH. (2003). A population based study on the intra and inter-rater reliability of the clock drawing test in Brazil: The Bambui Health and Ageing Study. International Journal of Geriatric Psychiatry, 18, 450-456.
24.
GrandeL. J.RudolphJ. L.DavisR.PenneyD. L.PriceC. C.SwensonR. (2013). Clock Drawing: Standing the Test of time. In AshendorfL.SwensonR.LibonD. J. (Eds.), The Boston process approach to neuropsychological assessment. A practitioner’s guide (pp. 229-248). Oxford, England: Oxford University Press.
25.
HubbardE. J.SantiniV.BlankevoortC. G.VolkersK. M.BarrupM. S.ByerlyL. (2008). Clock drawing performance in cognitively normal elderly. Archives of Clinical Neuropsychology, 23, 295-327.
26.
CheluneG. J. (2010). Evidence-based research and practice in clinical neuropsychology. Clinical Neuropsychologist, 24, 454-467.
27.
IvnikR. J.MalecJ. F.TangalosE. G.PetersenR. C.KokmenE.KurlandL. T. (1990). The Auditory-Verbal Learning Test (AVLT): Norms for ages 55 years and older. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2, 304-312.
28.
JørgensenK.KristensenM. K.WaldemarG.VogelA. (2015). The six-item Clock Drawing Test: Reliability and validity in mild Alzheimer’s disease. Aging, Neuropsychology, and Cognition: A Journal on Normal and Dysfunctional Development, 22, 301-311.
29.
JuradoM. B.RosselliM. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17, 213-233.
30.
KopecekM.StepankovaH.LukavskyJ.RipovaD.NikolaiT.BezdicekO. (in press). Montreal Cognitive Assessment (MoCA): Normative data for old and very old Czech adults. Applied Neuropsychology: Adult.
31.
LamL. C. W.ChiuH. F. K.NgK. O.ChanC.ChanW. F.LiS. W. (1998). Clock-face drawing, reading and setting tests in the screening of dementia in Chinese elderly adults. Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 53, 353-357.
32.
LessigM. C.ScanlanJ. M.NazemiH.BorsonS. (2008). Time that tells: Critical clock-drawing errors for dementia screening. International Psychogeriatrics, 20, 459-470.
33.
LezakM. D.HowiesonD. B.BiglerE. D.TranelD. (2012). Neuropsychological assessment (5th ed.). New York, NY: Oxford University Press.
34.
LourençoR. A.Ribeiro-FilhoS. T.MoreiraI. D. F. H.ParadelaE. M. P.MirandaA. S. (2008). The Clock Drawing Test: Performance among elderly with low educational level. Revista Brasileira de Psiquiatria, 30, 309-315.
35.
MackW. J.FreedD. M.WilliamsB.HendersonV. W. (1992). Boston Naming Test: Shortened versions for use in Alzheimer’s disease. Journal of Gerontology, 47, 154-158.
36.
MainlandB. J.AmodeoS.ShulmanK. I. (2014). Multiple clock drawing scoring systems: Simpler is better. International Journal of Geriatric Psychiatry, 29, 127-136.
37.
MainlandB. J.ShulmanK. I. (2013). Clock Drawing Test. In LarnerA. J. (Ed.), Cognitive screening instruments: A practical approach (pp. 79-109). New York, NY: Springer. doi:10.1007/978-1-4471-2452-8
38.
MalloyP. F.CummingsJ. L.CoffeyC. E.DuffyJ.FinkM.LauterbachE. C. (1997). Cognitive screening instruments in neuropsychiatry: A report of the committee on research of the American Neuropsychiatric Association. Journal of Neuropsychiatry and Clinical Neurosciences, 9, 189-197.
39.
MenonC.HallJ.HobsonV.JohnsonL.O’BryantS. E. (2012). Normative performance on the executive clock drawing task in a multi-ethnic bilingual cohort: A project FRONTIER study. International Journal of Geriatric Psychiatry, 27, 959-966.
40.
MeyerJ. P. (2010). Reliability. Oxford, England: Oxford University Press.
41.
MeyersJ. E.MeyersK. R. (1995). Rey complex figure test and recognition trial: Professional manual. Lutz, FL: Psychological Assessment Resources.
42.
MitrushinaM.BooneK. B.RazaniJ.D’EliaL. F. (2005). Handbook of normative data for neuropsychological assessment (2nd ed.). Oxford, England: Oxford University Press.
43.
MunangL. A.ChanM.LimW. S. (2010). Diagnostic performance of the clock drawing test using a pre-drawn circle in persons with early dementia. Asian Journal of Gerontology & Geriatrics, 5(2), 54-61.
44.
NairA. K.GavettB. E.DammanM.DekkerW.GreenR. C.MandelA. (2010). Clock Drawing Test ratings by dementia specialists: Interrater reliability and diagnostic accuracy. Journal of Neuropsychiatry and Clinical Neurosciences, 22(1), 85-92.
45.
NasreddineZ. S.PhillipsN. A.BedirianV.CharbonneauS.WhiteheadV.CollinI. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53, 695-699.
46.
NikolaiT.ŠtěpánkováH.MichalecJ.BezdíčekO.HorákováK.MarkováH. (2015). Testy verbální fluence, česká normativní studie pro osoby vyššího věku [Tests of Verbal Fluency, Czech Normative Study in Older Adults]. Ceska a Slovenska Neurologie a Neurochirurgie, 78/111, 292-299.
47.
NishiwakiY.BreezeE.SmeethL.BulpittC. J.PetersR.FletcherA. E. (2004). Validity of the Clock-Drawing Test as a screening tool for cognitive impairment in the elderly. American Journal of Epidemiology, 160, 797-807.
48.
NybornJ. A.HimaliJ. J.BeiserA. S.DevineS. A.DuY.KaplanE. (2013). The Framingham Heart Study clock drawing performance: Normative data from the offspring cohort. Experimental Aging Research, 39(1), 80-108.
49.
PatocskaiA. T.PakaskiM.VinczeG.FullajtarM.SzimjanovszkiI.DrotosG. (2014). Is there any difference between the findings of Clock Drawing Tests if the clocks show different times?Journal of Alzheimer’s Disease, 39, 749-757.
50.
PetersenR. C.SmithG. E.WaringS. C.IvnikR. J.TangalosE. G.KokmenE. (1999). Mild cognitive impairment: Clinical characterization and outcome. Archives of Neurology, 56, 303-308.
51.
PintoE.PetersR. (2009). Literature review of the Clock Drawing Test as a tool for cognitive screening. Dementia and Geriatric Cognitive Disorders, 27, 201-213.
52.
RabinL. A.BarrW. B.BurtonL. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada: A survey of INS, NAN, and APA Division 40 members. Archives of Clinical Neuropsychology, 20, 33-65.
53.
RatcliffG.DodgeH.BirzescuM.GanguliM. (2003). Tracking cognitive functioning over time: Ten-year longitudinal data from a community-based study. Applied Neuropsychology, 10, 76-88.
54.
RouleauI.SalmonD. P.ButtersN.KennedyC.McGuireK. (1992). Quantitative and qualitative analyses of clock drawings in Alzheimer’s and Huntington’s disease. Brain and Cognition, 18, 70-87.
55.
RoyallD. R.CordesJ. A.PolkM. (1998). CLOX: An executive clock drawing task. Journal of Neurology, Neurosurgery & Psychiatry, 64, 588-594.
56.
RubinovaE.NikolaiT.MarkovaH.SiffelovaK.LaczoJ.HortJ. (2014). Clock Drawing Test and the diagnosis of amnestic mild cognitive impairment: Can more detailed scoring systems do the work?Journal of Clinical and Experimental Neuropsychology, 36, 1076-1083.
57.
SantanaI.DuroD.FreitasS.AlvesL.SimõesM. R. (2013). The Clock Drawing Test: Portuguese norms, by age and education, for three different scoring systems. Archives of Clinical Neuropsychology, 28, 375-387.
58.
SeigerschmidtE.MoschE.SiemenM.ForstlH.BickelH. (2002). The clock drawing test and questionable dementia: Reliability and validity. International Journal of Geriatric Psychiatry, 17, 1048-1054.
59.
SheikhJ. I.YesavageJ. A. (1986). Geriatric Depression Scale (GDS): Recent evidence and development of a shorter version. Clinical Gerontologist, 5, 165-173.
60.
ShulmanK. I. (2000). Clock-drawing: Is it the ideal cognitive screening test?International Journal of Geriatric Psychiatry, 15, 548-561.
61.
ShulmanK. I.Pushkar GoldD.CohenC. A.ZuccheroC. A. (1993). Clock-drawing and dementia in the community: A longitudinal study. International Journal of Geriatric Psychiatry, 8, 487-496.
62.
ShulmanK. I.ShedletskyR.SilverI. L. (1986). The challenge of time: Clock-drawing and cognitive function in the elderly. International Journal of Geriatric Psychiatry, 1, 135-140.
63.
SijtsmaK. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107-120.
64.
SolomonP. R.HirschoffA.KellyB.RelinM.BrushM.DeVeauxR. D. (1998). A 7 minute neurocognitive screening battery highly sensitive to Alzheimer’s diseaseArchives of Neurology, 55, 349-355.
65.
SteenlandN. K.AumanC. M.PatelP. M.BartellS. M.GoldsteinF. C.LeveyA. I. (2008). Development of a rapid screening instrument for mild cognitive impairment and undiagnosed dementia. Journal of Alzheimer’s Disease, 15, 419-427.
66.
ŠtěpánkováH.NikolaiT.LukavskýJ.BezdíčekO.VrajováM.KopečekM. (2015). Mini-Mental State Examination – česká normativní studie [Mini-Mental State Examination – Czech normative study]. Ceska a Slovenska Neurologie a Neurochirurgie, 78/111, 57-63.
67.
StewartR.RichardsM.BrayneC.MannA. (2001). Cognitive function in UK community-dwelling African Caribbean elders: Normative data for a test battery. International Journal of Geriatric Psychiatry, 16, 518-527.
68.
StoreyJ. E.RowlandJ. T. J.BasicD.ConfortiD. A. (2001). A comparison of five clock scoring methods using ROC (receiver operating characteristic) curve analysis. International Journal of Geriatric Psychiatry, 16, 394-399.
69.
SugawaraN.Yasui-FurukoriN.UmedaT.SatoY.KanedaA.TsuchimineS. (2010). Clock drawing performance in a community-dwelling population: Normative data for Japanese subjects. Aging & Mental Health, 14, 587-592.
70.
TroyerA. K.LeachL.StraussE. (2006). Aging and response inhibition: Normative data for the Victoria Stroop Test. Aging Neuropsychology and Cognition, 13(1), 20-35.
71.
TuokkoH.HadjistavropoulosT.RaeS.O’RourkeN. (2000). A comparison of alternative approaches to the scoring of clock drawing. Archives of Clinical Neuropsychology, 15, 137-148.
72.
UrbanováM.VyhnálekM.NikolaiT.MichalecJ.SheardováK.LaczóJ. (2014). Validita testu 16 slov pro diferenciální diagnostiku demence Alzheimerova typu a behaviorální formy frontotemporální demence [Validity of Enhanced Cued Recall Test in the diagnosis of Alzheimer dementia and behavioral variant of frontotemporal dementia]. Ceska a Slovenska Neurologie a Neurochirurgie, 77/110, 576-581.
73.
van der BurgM.BouwenA.StessensJ.YlieffM.FontaineO.De LepeleireJ. (2004). Scoring clock tests for dementia screening: A comparison of two scoring methods. International Journal of Geriatric Psychiatry, 19, 685-689.
74.
WangP.ShiL.ZhaoQ.HongZ.GuoQ. (2014). Longitudinal changes in Clock Drawing Test (CDT) performance before and after cognitive decline. Plos One, 9(5), 1-9.
75.
WardillT.AndersonV. (2008). Assessment of executive functioning in older adults. In AndersonV.JacobsR.AndersonP. J. (Eds.), Executive functions and the frontal lobes: A lifespan perspective (pp. 155-178). New York, NY: Psychology Press.
76.
WechslerD. (1997). WAIS-III: Administration and scoring manual: Wechsler Adult Intelligence Scale. San Antonio, TX: Psychological Corporation.
WeintraubS.SalmonD.MercaldoN.FerrisS.Graff-RadfordN. R.ChuiH. (2009). The Alzheimer’s disease centers’ uniform data set (UDS): The neuropsychological test battery. Alzheimer’s Disease and Associated Disorders, 23, 91-101.
79.
YamamotoS.MogiN.UmegakiH.SuzukiY.AndoF.ShimokataH. (2004). The clock drawing test as a valid screening method for mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 18, 172-179.
