Sage Journals: Discover world-class research

Abstract

Researchers must increasingly account for growing expectations from scientific journals to infuse their work with real-world significance through field experiments. However, field experiments often require researchers to have access to substantial resources or a network that includes nonacademic partners willing to provide those resources. This article aims at overcoming those barriers by providing researchers with the tools they need to conduct randomized field experiments delivered to participants through mobile applications, given limited resources. The method presented herein takes advantage of the facilitated access to user data made possible by computing and development platforms such as Google’s Firebase. While the programming tools required to collect and analyze the data may feel intimidating, this article provides step-by-step instructions and illustrates the procedure with a case study experiment.

Keywords

apps bayesian A/B testing field experiments methods mobile applications

Get full access to this article

View all access options for this article.

References

Annie App . (2020). State of mobile. https://www.appannie.com/en/go/state-of-mobile-2020/ (accessed 30 June 2022).

APA . (2022). Random assignment, APA dictionary of psychology. https://dictionary.apa.org/random-assignment (accessed 30 June 2022).

Appel

Libai

Muller

Shachar

(2020). On the monetization of mobile apps. International Journal of Research in Marketing, 37(1), 93–107. https://doi.org/10.1016/j.ijresmar.2019.07.007

Aribarg

Schwartz

E. M.

(2020). Native advertising in online news: Trade-offs among clicks, brand recognition, and website trustworthiness. Journal of Marketing Research, 57(1), 20–34. https://doi.org/10.1177/0022243719879711

Bashirzadeh

Mai

Faure

(2022). How rich is too rich? Visual design elements in digital marketing communications. International Journal of Research in Marketing, 39(1), 58–76. https://doi.org/10.1016/j.ijresmar.2021.06.008

Bies

S. M.

Bronnenberg

B. J.

Gijsbrechts

(2021). How push messaging impacts consumer spending and reward redemption in store-loyalty programs. International Journal of Research in Marketing, 38(4), 877–899. https://doi.org/10.1016/j.ijresmar.2021.02.001

Bleier

Harmeling

C. M.

Palmatier

R. W.

(2019). Creating effective online customer experiences. Journal of Marketing, 83(2), 98–119. https://doi.org/10.1177/0022242918809930

de Bellis

Hildebrand

Ito

Herrmann

Schmitt

(2019). Personalizing the customization experience: A matching theory of mass customization interfaces and cultural information processing. Journal of Marketing Research, 56(6), 1050–1065. https://doi.org/10.1177/0022243719867698

Fong

Zhang

Luo

Wang

(2019). Targeted promotions on an e-book platform: Crowding out, heterogeneity, and opportunity costs. Journal of Marketing Research, 56(2), 310–323. https://doi.org/10.1177/0022243718817513

10.

Fradkin

Grewal

Holtz

(2021). Reciprocity and unveiling in two-sided reputation systems: Evidence from an experiment on Airbnb. Marketing Science, 40(6), 1013–1029. https://doi.org/10.1287/mksc.2021.1311

11.

Gershon

Cryder

John

L. K.

(2020). Why prosocial referral incentives work: The interplay of reputational benefits and action costs. Journal of Marketing Research, 57(1), 156–172. https://doi.org/10.1177/0022243719888440

12.

Ghose

Han

S. P.

(2014). Estimating demand for mobile applications in the new economy. Management Science, 60(6), 1470–1488. https://doi.org/10.1287/mnsc.2014.1945

13.

Gneezy

(2017). Field experimentation in marketing research. Journal of Marketing Research, 54(1), 140–143. https://doi.org/10.1509/jmr.16.0225

14.

Google . (2022a). Clicks. https://support.google.com/admob/answer/3268930 (accessed 30 June 2022).

15.

Google . (2022b). General methodology. https://support.google.com/optimize/answer/7405543?hl=enandref_topic=9127922 (accessed 30 June 2022).

16.

Google . (2022c) How much revenue can you earn from AdMob? https://admob.google.com/home/resources/how-much-revenue-can-you-earn-from-admob/ (accessed 30 June 2022).

17.

Google . (2022d). Implementation guidance. https://support.google.com/admob/answer/2936217?hl=enandref_topic=2936214 (accessed 30 June 2022).

18.

Google . (2022e). Interstitial ad guidance. https://support.google.com/admob/answer/6066980 (accessed 30 June 2022).

19.

Google . (2022f). Manage ads: Guide to allowing and blocking ads in your apps. https://support.google.com/admob/answer/3150235 (accessed 30 June 2022).

20.

Grewal

Bart

Spann

Zubcsek

P. P.

(2016). Mobile advertising: A framework and research agenda. Journal of Interactive Marketing, 34, 3–14. https://doi.org/10.1016/j.intmar.2016.03.003

21.

Haenlein

Bitner

M. J.

Kohli

A. K.

Lemon

K. N.

Reibstein

D. J.

(2021). Guest editorial: Responsible research in marketing. Journal of the Academy of Marketing Science, 50(1), 8–12. https://doi.org/10.1007/s11747-021-00812-z

22.

Huang

Aral

Y. J.

Brynjolfsson

(2020). Social advertising effectiveness across products: A large-scale field experiment. Marketing Science, 39(6), 1142–1165.

23.

Khenfer

Trendel

(2023). The mitigating effect of structure priming in service failure situations. Unpublished manuscript.

24.

Kong

Rao

(2021). Do “made in USA” claims matter? Marketing Science, 40(4), 731–764. https://doi.org/10.1287/mksc.2020.1274

25.

Yao

Chen

Grewal

(2021). Do larger audiences generate greater revenue under pay what you want? Evidence from a live streaming platform. Marketing Science, 40(5), 964–984. https://doi.org/10.1287/mksc.2021.1292

26.

Morales

A. C.

Amir

Lee

(2017). Keeping it real in experimental research—understanding when, where, and how to enhance realism and measure consumer behavior. Journal of Consumer Research, 44(2), 465–476. https://doi.org/10.1093/jcr/ucx048

27.

Narang

Yadav

M. S.

Rindfleisch

(2021). The “idea advantage”: How content sharing strategies impact engagement in online learning platforms. Journal of Marketing Research, 59(1), 61–78. https://doi.org/10.1177/00222437211017828

28.

Osinga

E. C.

Zevenbergen

van Zuijlen

M. W.

(2019). Do mobile banner ads increase sales? Yes, in the offline channel. International Journal of Research in Marketing, 36(3), 439–453. https://doi.org/10.1016/j.ijresmar.2019.02.001

29.

Paharia

Swaminathan

(2019). Who is wary of user design? The role of power-distance beliefs in preference for user-designed products. Journal of Marketing, 83(3), 91–107. https://doi.org/10.1177/0022242919830412

30.

Rossi

P. E.

Allenby

G. M.

(2003). Bayesian statistics and marketing. Marketing Science, 22(3), 304–328. https://doi.org/10.1287/mksc.22.3.304.17739

31.

Rutz

Aravindakshan

Rubel

(2019). Measuring and forecasting mobile game app engagement. International Journal of Research in Marketing, 36(2), 185–199. https://doi.org/10.1016/j.ijresmar.2019.01.002

32.

Statista . (2022). ‘Mobile operating systems’ market share worldwide from January 2012 to January 2022. https://www.statista.com/statistics/272698/global-market-share-held-by-mobile-operating-systems-since-2009/ (accessed 30 June 2022).

33.

Trafimow

Leonhardt

J. M.

Niculescu

Payne

(2016). A method for evaluating and selecting field experiment locations. Marketing Letters, 27(3), 437–447. https://doi.org/10.1007/s11002-014-9345-7

34.

Van Heerde

H. J.

Moorman

Moreau

C. P.

Palmatier

R. W.

(2021). Reality check: Infusing ecological value into academic marketing research. Journal of Marketing, 85(2), 1–13. https://doi.org/10.1177/0022242921992383

35.

Viglia

Zaefarian

Ulqinaku

(2021). How to design good experiments in marketing: Types, examples, and methods. Industrial Marketing Management, 98, 193–206. https://doi.org/10.1016/j.indmarman.2021.08.007

36.

Yin

Jia

J. S.

Zheng

(2021). The effect of slow-motion video on consumer inference. Journal of Marketing Research, 58(5), 1007–1024. https://doi.org/10.1177/00222437211025054

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.52 MB

0.00 MB