Assessing individual change is feasible and potentially useful in clinical practice. This article provides an overview of the evaluation of statistically significant change in health-related quality of life (HRQOL) for individual patients. We review the standard error of measurement, standard error of prediction, and reliable change indices using a sample of 54 patients receiving care at the UCLA Center for East-West Medicine. The largest amount of change necessary for statistical significance was found for the reliable change index and the smallest change was needed for the standard error of measurement. The amount of change required for statistical significance was intermediate for the standard error of prediction. The median kappa for classifying change (declined, stayed the same, improved) by different indices was .82, indicating a high level of agreement. Future research is needed to determine if one index is most appropriate for evaluating the significance of individual change.
Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004). Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82, 60-70.
2.
Bland, J. M., & Altman, D. G. (1994). Regression towards the mean. British Medical Journal, 308, 1499.
3.
Chobanian, A. V., Bakris, G. L., Black, H. R., Cushman, W. C., Green, L. A., Izzo, J. L., et al. (2003). Seventh report of the Joint National Committee on prevention, detection, evaluation, and treatment of high blood pressure. Hypertension, 42(6), 1206-1252.
4.
Collie, A., Maruff, P., McStephen, M., & Darby, D. (2003). Are reliable change (RC) calculations appropriate for determining the extent of cognitive change in concussed athletes?British Journal of Sports Medicine, 37, 370-372.
5.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
6.
Dudek, F. J. (1979). The continuing misinterpretation of the standard error of measurement. Psychological Bulletin, 86, 335-337.
7.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
8.
Farivar, S. S., Liu, H., & Hays, R. D. (2004). Another look at the half standard deviation estimate of the minimally important difference in health-related quality of life scores. Research Expert Review of Pharmacoeconomics and Outcomes Research, 4(5), 515-523.
9.
Ferguson, R. J., Robinson, A. B., & Splaine, M. (2002). Use of the reliable change index to evaluate clinical significance in SF-36 outcomes. Quality of Life Research, 11, 509-516.
10.
Hahn, E. A., Cella, D., Chassany, O., Fairclough, D., Wong, G., & Hays, R. D. (2004). A guide for clinicians to compare the accuracy and precision of health-related quality of life data relative to other clinical measures. Manuscript submitted for publication.
11.
Hays, R. D., Farivar, S. S., & Liu, H. (in press). Approaches and recommendations for estimating minimally important differences for health-related quality of life measures. COPD: Journal of Chronic Obstructive Pulmonary Disease.
12.
Hays, R. D., Prince-Embury, S., & Chen, H. (1998). RAND-36 Health Status Inventory. San Antonio, TX: Psychological Corporation.
13.
Hsu, L. M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11, 459-467.
14.
Hui, K. K., Zylowska, L., Hui, E. K., Yu, J. L., & Li, J. J. (2002). Introducing integrative East-West medicine to medical students and residents. Journal of Alternative and Complementary Medicine, 8(4), 507-515.
15.
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Toward a standard definition of clinically significant change. Behavior Therapy, 17, 308-311.
16.
McHorney, C. A., & Tarlov, A. R. (1995). Individual-patient monitoring in clinical practice: Are available health status surveys adequate?Quality of Life Research, 4, 293-307.
17.
Mosier, C. I. (1943). On the reliability of a weighted composite. Psychometrica, 8, 161-168.
18.
Nunnally, J. C. (1994). Psychometric theory. New York: McGraw-Hill.
19.
Prisant, L. M., Carr, A. A., Bottini, P. B., Thompson, W. O., & Rhoades, R. B. (1992). Repeatability of automated ambulatory blood pressure measurements. Journal of Family Practice, 34, 569-574.
20.
Reise, S. P. (2000). Using multilevel logistic regression to evaluate person-fit in IRT models. Multivariate Behavioral Research, 35, 543-568.
21.
Speer, D. C., & Greenbaum, P. E. (1995). Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63, 1044-1048.
22.
Ware, J. E., Bayliss, M. S., Rogers, W. H., Kosinski, M., & Tarlov, A. R. (1996). Differences in 4-year health outcomes for elderly and poor, chronically ill patients treated in HMO and fee-for-service systems: Results from the Medical Outcomes Study. Journal of the American Medical Association, 276, 1039-1047.
23.
Ware, J. E., Kosinski, M., & Dewey, J. E. (2000). How to score version two of the SF-36® health survey. Lincoln, RI: Quality Metric.
