I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making fraud much less likely to go undetected. I illustrate this point by describing two cases of suspected fraud I identified exclusively through statistical analysis of reported means and standard deviations. Analyses of the raw data behind these published results provided invaluable confirmation of the initial suspicions, ruling out benign explanations (e.g., reporting errors, unusual distributions), identifying additional signs of fabrication, and also ruling out one of the suspected fraud’s explanations for his anomalous results. If journals, granting agencies, universities, or other entities overseeing research promoted or required data posting, it seems inevitable that fraud would be reduced.
AydukO.GyurakA.LuerssenA. (2008). Individual differences in the rejection-aggression link in the hot sauce paradigm: The case of rejection sensitivity. Journal of Experimental Social Psychology, 44, 775–782.
2.
BarghJ. A.GollwitzerP. M.Lee-ChaiA.BarndollarK.TrotschelR. (2001). The automated will: Nonconscious activation and pursuit of behavioral goals. Journal of Personality and Social Psychology, 81, 1014–1027.
3.
BaumeisterR. F.BratslavskyE.MuravenM.TiceD. M. (1998). Ego depletion: Is the active self a limited resource?Journal of Personality and Social Psychology, 74, 1252–1265.
4.
BenfordF. (1938). The law of anomalous numbers. Proceedings of the American Philosophical Society, 78, 551–572.
5.
BoosD. D. (2003). Introduction to the bootstrap world. Statistical Science, 18, 168–174.
6.
BoosD. D.BrownieC. (1989). Bootstrap methods for testing homogeneity of variances. Technometrics, 31, 69–82.
7.
CackowskiJ. M.NasarJ. L. (2003). The restorative effects of roadside vegetation. Environment and Behavior, 35, 736–751.
8.
CarlisleJ. B. (2012). The analysis of 169 randomised controlled trials to test data integrity. Anaesthesia, 67, 521–537.
9.
De CremerD.van DijkE. (2002). Reactions to group success and failure as a function of identification level: A test of the goal-transformation hypothesis in social dilemmas. Journal of Experimental Social Psychology, 38, 435–442.
10.
de KwaadstenietE. W.van DijkE.WitA.de CremerD. (2006). Social dilemmas as strong versus weak situations: Social value orientations and tacit coordination under resource size uncertainty. Journal of Experimental Social Psychology, 42, 509–516.
11.
EfronB.TibshiraniR. J. (1994). An introduction to the bootstrap. Boca Raton, FL: Chapman & Hall.
12.
FisherR. A. (1936). Has Mendel’s work been rediscovered?Annals of Science, 1, 115–137.
13.
FrederickS. (2012). Overestimating others’ willingness to pay. Journal of Consumer Research, 39, 1–21.
14.
FudenbergD.LevineD. K.ManiadisZ. (2012). On the robustness of anchoring effects in WTP and WTA experiments. American Economic Journal: Microeconomics, 4, 131–145.
15.
GaffanE.GaffanD. (1992). Less-than-expected variability in evidence for primacy and Von Restorff effects in rats’ nonspatial memory. Journal of Experimental Psychology: Animal Behavior Processes, 18, 298–301.
16.
InesiM. E.BottiS.DuboisD.RuckerD. D.GalinskyA. D. (2011). Power and choice: Their dynamic interplay in quenching the thirst for personal control. Psychological Science, 22, 1042–1048.
17.
JohnsonC. S.SmeestersD.WheelerS. C. (2012). Retraction of Johnson, Smeesters, and Wheeler (2012). Journal of Personality and Social Psychology, 103, 605.
18.
KalaiG.McKayB.Bar-HillelM. (1998). The two famous rabbis experiments: How similar is too similar (Discussion Paper 182). Jerusalem, Israel: Center for the Study of Rationality.
19.
KerenG.WillemsenM. C. (2009). Decision anomalies, experimenter assumptions, and participants’ comprehension: Revaluating the uncertainty effect. Journal of Behavioral Decision Making, 22, 301–317. doi:10.1002/bdm.628
20.
KerrN. L.RumbleA. C.ParkE. S.OuwerkerkJ. W.ParksC. D.GallucciM.Van LangeP. A. M. (2009). “How many bad apples does it take to spoil the whole barrel?”: Social exclusion and toleration for bad apples. Journal of Experimental Social Psychology, 45, 603–613.
21.
KeselmanH.OthmanA. R.WilcoxR. R.FradetteK. (2004). The new and improved two-sample t test. Psychological Science, 15, 47–51.
22.
KlinesmithJ.KasserT.McAndrewF. T. (2006). Guns, testosterone, and aggression: An experimental test of a mediational hypothesis. Psychological Science, 17, 568–571.
23.
LiuJ.SmeestersD.TrampeD. (2012). Effects of messiness on preferences for simplicity. Journal of Consumer Research, 39, 199–214.
24.
McGregorH. A.LiebermanJ. D.GreenbergJ.SolomonS.ArndtJ.SimonL.PyszczynskiT. (1998). Terror management and aggression: Evidence that mortality salience motivates aggression against worldview-threatening others. Journal of Personality and Social Psychology, 74, 590–605.
25.
NewmanG. E.MochonD. (2012). Why are lotteries valued less? Multiple tests of a direct risk-aversion mechanism. Judgment and Decision Making, 7, 19–24.
26.
OppenheimerD.MeyvisT.DavidenkoN. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867–872.
27.
RobertsS. (1987). Less-than-expected variability in evidence for three stages in memory formation. Behavioral Neuroscience, 101, 120–130.
28.
RubinD. B.StiglerS. M. (1979). Dorfman’s data analysis. Science, 205, 1204–1206.
29.
SannaL. J.ChangE. C.MiceliP. M.LundbergK. B. (2011). Rising up to higher virtues: Experiencing elevated physical height uplifts prosocial actions [Retracted article]. Journal of Experimental Social Psychology, 47, 472–476.
30.
SannaL. J.ChangE. C.MiceliP. M.LundbergK. B. (2013). Retraction notice to “Rising up to higher virtues: Experiencing elevated physical height uplifts prosocial actions” [Journal of Experimental Social Psychology 47 (2010) 472–476]. Journal of Experimental Social Psychology, 49, 316.
31.
SannaL. J.ChangE. C.ParksC. D.KennedyL. A. (2009). Construing collective concerns: Increasing cooperation by broadening construals in social dilemmas. Psychological Science, 20, 1319–1321.
32.
SannaL. J.ParksC. D.ChangE. C. (2003). Mixed-motive conflict in social dilemmas: Mood as input to competitive and cooperative goals. Group Dynamics: Theory, Research, and Practice, 7, 26–40.
33.
SimonsohnU. (2009). Direct risk aversion: Evidence from risky prospects valued below their worst outcome. Psychological Science, 20, 686–692. doi:10.1111/j.1467-9280.2009.02349.x
34.
SimonsonI.DroletA. (2004). Anchoring effects on consumers’ willingness-to-pay and willingness-to-accept. Journal of Consumer Research, 31, 681–690.
35.
SmeestersD.LiuJ. E. (2011). The effect of color (red versus blue) on assimilation versus contrast in prime-to-behavior effects [Retracted article]. Journal of Experimental Social Psychology, 47, 653–656.
36.
SmeestersD.LiuJ. E. (2013). Retraction notice to “The effect of color (red versus blue) on assimilation versus contrast in prime-to-behavior effects” [Journal of Experimental Social Psychology 47 (2011) 653–656]. Journal of Experimental Social Psychology, 49, 315.
37.
SmeestersD.WheelerS. C.KayA. C. (2009). The role of interpersonal perceptions in the prime-to-behavior pathway. Journal of Personality and Social Psychology, 96, 395–414.
38.
SternbergS.RobertsS. (2006). Nutritional supplements and infection in the elderly: Why do the findings conflict?Nutrition Journal, 5(1), 30. Retrieved from http://www.nutritionj.com/content/5/1/30
39.
TiceD. M.BratslavskyE.BaumeisterR. F. (2001). Emotional distress regulation takes precedence over impulse control: If you feel bad, do it!Journal of Personality and Social Psychology, 80, 53–67.
40.
TverskyA.KahnemanD. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105–110.
41.
Van VugtM.De CremerD.JanssenD. P. (2007). Gender differences in cooperation and competition. Psychological Science, 18, 19–23.
42.
VohsK. D.HeathertonT. F. (2000). Self-regulatory failure: A resource-depletion approach. Psychological Science, 11, 249–254.
43.
WarburtonW. A.WilliamsK. D.CairnsD. R. (2006). When ostracism leads to aggression: The moderating effects of control deprivation. Journal of Experimental Social Psychology, 42, 213–220.
44.
WebbT. L.SheeranP. (2003). Can implementation intentions help to overcome ego-depletion?Journal of Experimental Social Psychology, 39, 279–286.
45.
WichertsJ. M. (2011). Psychology must learn a lesson from fraud case. Nature, 480, 7.
46.
WichertsJ. M.BakkerM. (2012). Publish (your data) or (let the data) perish! Why not publish your data too?Intelligence, 40, 73–76.
47.
WichertsJ. M.BorsboomD.KatsJ.MolenaarD. (2006). The poor availability of psychological research data for reanalysis. American Psychologist, 61, 726–728.
48.
YangY.VosgerauJ.LoewensteinG. F. (2012). The influence of framing on willingness to pay as an explanation of the uncertainty effects. Unpublished manuscript, Carnegie Mellon University.
49.
YuenK. K. (1974). The two-sample trimmed t for unequal population variances. Biometrika, 61, 165–170.
50.
YuleG. U. (1922). An introduction to the theory of statistics. London, England: Charles Griffen.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
