Three-way receiver operating characteristic (ROC) surface analysis involves the calculation of a volume under an ROC surface (VUS), which is a measure of discriminatory accuracy of 2 diagnostic tests for 3 diseases. Nonparametric methods for calculating VUS and its standard error have been developed. The author presents the code for roc3D, a Mathematica computer program for performing parametric ROC surface analysis. roc3D calculates VUS assuming a multinormal distribution of test results in the 3 diseased populations, provides user-specified pointwise confidence limits for VUS, and displays a 3-dimensional plot of the ROC surface. Limitations of the roc3D program are discussed.
Green DM, Swets JA. Signal Detection Theory and Psychophysics. New York: RE Kreiger; 1974.
2.
Lusted LB. Signal detectability and medical decision making. Science. 1971;171:1217-1219.
3.
Centor RM. Signal detectability: the use of ROC curves and their analyses. Med Decis Making. 1991;11:102-106.
4.
Mossman D.Three-way ROCs. Med Decis Making. 1999;19:78-89.
5.
Dreiseitl S, Ohno-Machado L, Binder M.Comparing three-class diagnostic tests by three-way ROC analysis. Med Decis Making. 2000;20:323-331.
6.
Wolfram S.Mathematica: A System for Doing Mathematics by Computer. 2nd ed.Reading, MA: Addison-Wesley; 1991.
7.
Dorfman DD, Alf E JR.Maximum likelihood estimation of parameters of signal detection theory—a direct solution. Psychometrika. 1968;33:117-124.
8.
Dorfman DD, Alf E JR.Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals—rating-method data. J Math Psychol. 1969;6:487-496.
9.
Hanley JA, McNeil BJ. The meaning and use of the area under the receiver operating characteristic (ROC) curve. Radiology. 1982; 143:29-36.
10.
Hanley JA. The robustness of the “binormal” assumptions used in fitting ROC curves. Med Decis Making. 1988;8:197-203.
11.
Fryback DG. Bayes’ theorem and conditional nonindependence of data in medical diagnosis. Computers Biomed Res. 1978;11:423-434.
12.
Ma G, Hall WJ. Confidence bands for receiver operating characteristic curves. Med Decis Making. 1993;13:191-197.
