In marketing journals and market research textbooks, two concepts of statistical significance—p values and αlevels—are commonly mixed together. This is unfortunate because they each have completely different interpretations. The upshot is that many investigators are confused over the meaning of statistical significance. We explain how this confusion has arisen and make several suggestions to teachers and researchers about how to overcome it.
Aaker, David A., Vinay Kumar, and George S. Day. 2001. Marketing research. 7th ed.New York: John Wiley.
2.
Burns, Alvin C., and Ronald F. Bush. 2000. Marketing research. 3rd ed.Upper Saddle River, NJ: Prentice Hall.
3.
Churchill, Gilbert A., and Dawn Iacobucci. 2002. Marketing research: Methodological foundations. 8th ed.New York: Harcourt.
4.
Cicchetti, Domenic V.1998. Role of null hypothesis significance testing (NHST) in the design of neuropsychologic research. Journal of Clinical and Experimental Neuropsychology20:293–295.
5.
Cooper, Donald R., and Pamela S. Schindler. 2006. Marketing research. New York: McGraw-Hill.
6.
Crask, M., R. J. Fox, and R. G. Stout. 1995. Marketing research: Principles and application. Englewood Cliffs, NJ: Prentice Hall.
7.
Fisher, Ronald A.1955. Statistical methods and scientific induction. Journal of the Royal Statistical Society, Series B, 17 (1): 69–78.
8.
Gigerenzer, Gerd, Stefan Krauss, and Oliver Vitouch. 2004. The null ritual: What you always wanted to know about significance testing but were afraid to ask. In The Sage handbook of quantitative methodology for the social sciences, edited by D. Kaplan, 391–408. Thousand Oaks, CA: Sage.
9.
Gigerenzer, G., Z. Swijtink, T. Porter, L. Daston, J. Beatty, and L. Kruger. 1989. The empire of chance. Cambridge: Cambridge University Press.
10.
Goodman, Steven N.1993. p values, hypothesis tests, and likelihood: Implications for epidemiology of a neglected historical debate. American Journal of Epidemiology137 (March): 485–496.
11.
Hair, Joseph F., Robert P. Bush, and David J. Ortinau. 2003. Marketing research within a changing information environment. 2nd ed.New York: McGraw-Hill.
12.
Hubbard, Raymond, and J. Scott Armstrong. 1992. Are null results becoming an endangered species in marketing?Marketing Letters3 (April): 127–136.
13.
Hubbard, Raymond, and J. Scott Armstrong. 1994. Replications and extensions in marketing: Rarely published but quite contrary. International Journal of Research in Marketing11 (June): 233–248.
14.
Hubbard, Raymond, and M. J. Bayarri. 2003. Confusion over measures of evidence (p's) versus errors ([.alpha]'s) in classical statistical testing (with comments). The American Statistician57 (August): 171–182.
15.
Kinnear, Thomas C., and James R. Taylor. 1991. Marketing research: An applied approach. 4th ed.New York: McGraw-Hill.
16.
Lehmann, Donald R., Senil Gupta, and Joel H. Steckel. 1998. Marketing research. New York: Addison-Wesley.
17.
Leone, Robert P., and Randall L. Schultz. 1980. A study of marketing generalizations. Journal of Marketing44 (Winter): 10–18.
18.
Lindsay, R. Murray. 1995. Reconsidering the status of tests of significance: An alternative criterion of adequacy. Accounting, Organizations and Society20 (1): 35–53.
19.
Malhotra, Naresh K.2004. Marketing research: An applied orientation. 4th ed.Upper Saddle River, NJ: Prentice Hall.
20.
McDaniel, C., and R. Gates. 2002. Marketing research: The impact of the internet. 5th ed.Cincinnati, OH: South-Western.
21.
Ottenbacher, Kenneth J.1996. The power of replications and replications of power. The American Statistician50 (3): 271–275.
22.
Parasuraman, A., Dhruv Grewal, and R. Krishnan. 2004. Marketing research. Boston: Houghton Mifflin.
23.
Royall, Richard M.1997. Statistical evidence: A likelihood paradigm. New York: Chapman and Hall.
24.
Sawyer, Alan G., and J. Paul Peter. 1983. The significance of statistical significance tests in marketing research. Journal of Marketing Research20 (May): 122–133.
25.
Schmidt, Frank L.1996. Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods1 (1): 115–129.
26.
Sudman, Seymour, and Edward Blair. 1998. Marketing research: A problem-solving approach. New York: McGraw-Hill.
27.
Thompson, Bruce. 2002. What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher31 (April): 25–32.
28.
Tull, Donald S., and Del I. Hawkins. 1993. Marketing research: Measurement & method. 6th ed.New York: Macmillan.
