Judgments of the effectiveness of single-subject behavioral interventions are often based on visual examination of graphs of response data, but previous research indicates that such judgments are often unreliable and flawed. Here it is proposed that artificial neural networks could be developed to simulate the judgments of expert judges. A prototype of such a network was designed and trained in the present study, and its use in novel experiments matched the estimates of the expert whose judgments were simulated significantly better than did a prediction equation developed using a multiple regression approach.
Get full access to this article
View all access options for this article.
References
1.
AllisonD. B.FranklinR. D.HeshkaS. (1992) Reflections on visual inspection, response guided experimentation, and Type I error rate in single-case designs. Journal of Experimental Education, 61, 45–51.
2.
BealD.GillisJ. S.StewartT. (1978) The lens model: computational procedures and applications. Perceptual and Motor Skills, 46, 3–28.
3.
BoundsD.LloydP.MathewB.WaddellG. (1988) A multilayer perception network for the diagnosis of low back pain. Proceedings of the IEEE International Conference on Neural Networks, 2, 481–489.
4.
BremnerF. J.GottsS. (1993) Comparing two methods of visual abstraction to human data. Behavior Research Methods, Instruments, and Computers, 25, 212–214.
5.
CollyerC. E.StanleyK. A.BowaterC. (1990) Psychology of the scientist: LXIII. Perceiving scattergrams: is visual line fitting related to estimation of the correlation coefficient?Perceptual and Motor Skills, 71, 371–378.
6.
ConeJ. D. (1981) Psychometric considerations in behavioral assessment. In HersonM.BellackA. S.(Eds.), Behavioral assessment: a practical handbook. (2nd ed.) New York: Pergamon. Pp. 38–68.
7.
CrosbieJ. (1987) The inability of the binomial test to control type I error with single-subject data. Behavioral Assessment, 9, 141–150.
8.
DeProsperoA.CohenS. (1979) Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573–579.
9.
FurlongM. J.WampoldB. E. (1982) Intervention effects and relative variations as dimensions in experts' use of visual inference. Journal of Applied Behavior Analysis, 15, 415–421.
10.
GibsonG.OttenbacherK. (1988) Characteristics influencing the visual analysis of single-subject data: an empirical analysis. Journal of Applied Behavior Analysis, 24, 298–314.
11.
GreenwoodK. M.MatyasT. A. (1990) Problems with the application of interrupted time series analysis for brief single-subject data. Behavioral Assessment, 12, 355–370.
12.
HowellD. C. (1982) Statistical methods for psychology. Boston, MA: Duxbury.
13.
HuitemaB. E. (1985) Autocorrelation in applied behavior analysis: a myth. Behavioral Assessment, 7, 107–118.
14.
JonesR. R.WeinrottM. R.VaughtR. S. (1978) Effects of serial dependency on the agreement between visual and statistical inference. Journal of Applied Behavior Analysis, 11, 277–283.
15.
KazdinA. E. (1982) Single-case research designs: methods for clinical and applied settings. New York: Oxford Univer. Press.
16.
KnappT. J. (1983) Behavior analysts' visual appraisal of behavior change in graphic display. Behavioral Assessment, 5, 155–164.
17.
LawrenceM.MakridakisS. (1989) Factors affecting judgmental forecasts and confidence intervals. Organizational Behavior and Human Decision Processes, 42, 172–187.
18.
LawrenceM.PettersonA. (1990) BrainMaker neural network simulation software. Grass Valley, CA: California Scientific Software.
19.
LevineD. S. (1989) Neural network principles for theoretical psychology. Behavior Research Methods, Instruments, & Computers, 21, 213–224.
20.
MatyasT. A.GreenwoodK. M. (1990a) The effect of serial dependence on visual judgment of single-case charts: an addendum. Occupational Therapy Journal of Research, 10, 208–220.
21.
MatyasT. A.GreenwoodK. M. (1990b) Visual analysis of single-case time series: effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341–351.
22.
MorrisE. K.RosenH. S. (1982) The role of interobserver reliability in the evaluation of graphed data. Behavior Assessment, 4, 387–399.
23.
NelsonN. M.IllingworthW. T. (1991) A practical guide to neural nets. Reading, MA: Addison-Wesley.
24.
OttenbacherK. J. (1986) Reliability and accuracy of visually analyzing graphed data from single-subject designs. American Journal of Occupational Therapy, 40, 464–469.
25.
OttenbacherK. J. (1990a) Visual inspection of single-subject data: an empirical analysis. Mental Retardation, 28, 283–290.
26.
OttenbacherK. J. (1990b) When is a picture worth a thousand p values? A comparison of visual and quantitative methods to analyze single subject data. Journal of Special Education, 23, 436–449.
27.
ParkH. S.MarascuiloL.Gaylord-RossR. (1990) Visual inspection and statistical analysis in single-case designs. Journal of Experimental Education, 58, 311–320.
28.
ParsonsonB. S.BaerD. M. (1986) The graphic analysis of data. In PolingA.FuquaR. W.(Eds.), Research methods in applied behavior analysis: issues and advances. New York: Plenum. Pp. 157–186.
29.
RipleyB. D. (1993) Statistical aspects of neural networks. In Barndorff-NielsenO. E.JensenJ. L.KendallW. S.(Eds.), Networks and chaos—statistical and probabilistic aspects. London: Chapman & Hall. Pp. 101–130.
30.
SharpleyC. F. (1986) Some arguments against analyzing client change graphically. Journal of Counseling and Development, 65, 156–159.
31.
SimpsonP. K. (1990) Artificial neural systems: foundations, paradigms, applications, and implementations. New York: Pergamon.
32.
StanleyJ. (1990) Introduction to neural networks. Sierra Madre, CA: California Scientific Software.
33.
TawnerJ. W.GastD. L. (1984) Single subject research in special education. Columbus, OH: Merrill.
34.
WagenaarW. A.SagariaS. D. (1975) Misperception of exponential growth. Perception & Psychophysics, 18, 416–422.
35.
WampoldB. E.FurlongM. J. (1981) The heuristics of visual inference. Behavioral Assessment, 3, 79–92.
