Abstract
Introduction
Obesity remains a public health concern, given that approximately half of adults are expected to have obesity (i.e. body mass index ≥30) by 2030, 1 and obesity is associated with greater risk of comorbidities and mortality. 2 Young adulthood is characterized by high risk of weight gain, with weight gain of 1 to 2 pounds on average per year from age 18 to 35.3,4 An estimated 40% of young adults have obesity, 5 and weight gain during young adulthood is associated with increased risk of cardiovascular disease, type 2 diabetes, hypertension, some cancers, and mortality.6–8 As promoting weight management to prevent and reduce obesity has the potential to reduce risk of chronic disease later in life, there is a need for interventions to reduce obesity and weight gain in young adults.6,9
While there is evidence that intensive behavioral modification programs that promote changes in dietary intake and physical activity can lead to clinically relevant weight loss among adults,10,11 young adults have been largely underrepresented in these trials.12–15 Given that 97% of young adults between the ages of 18 and 29 own a smartphone, 16 using smartphones or other mobile methods to deliver nutrition, physical activity, and weight management programs can potentially increase the reach and impact to this population. The majority of young adults are interested in programs with reduced face-to-face contact and increased flexibility, 17 and there is evidence that internet- and mobile-delivered programs are feasible, acceptable, and potentially scalable solutions for weight loss.18–21
Until recently, most in-person and digital programs have used predetermined schedules of content delivery for various standard behavioral components (e.g. lessons, text messages, and tailored feedback) at fixed time points throughout the intervention. Text messages or other brief intervention messages have been used to deliver behavioral strategies that help support behavior change, but the incorporation of all treatment components into a treatment “package” (i.e. a “black box”) means that little has been learned about what types of messages are most effective, or when they should be sent. Digital health tools such as smart scales, activity trackers, and smartphone-based dietary tracking now allow for the continuous collection of daily or within-day self-monitoring data on weight, activity, and dietary intake. The ability to sync and evaluate participant data in real-time has unique advantages in both intervention design and evaluation. Interventions can now be developed that are delivered “just-in-time” that provide highly adaptive, personalized support wherever and only whenever needed, and adapt over time to an individual's changing behavior and context.22–24 These interventions, called just-in-time adaptive interventions (JITAIs), have shown greater effectiveness relative to comparison and control groups, 25 and have focused on behaviors like increasing daily physical activity, 26 reducing sedentary behavior, 27 and smoking cessation. 28 However, most JITAIs to date have focused on a single behavior and have been short in duration. Few JITAIs have used adaptive, tailored treatments specifically for improving dietary behaviors or multiple behaviors needed for weight loss.29–31
The first JITAI focused on dietary behaviors was tested in an 8-week study in conjunction with a commercially available weight loss website, with the goal of collecting behavioral and contextual data to predict dietary lapses and subsequently deliver tailored intervention messaging to prevent lapses from occurring. 32 Another 8-week study among adults with hypertension promoted reduction in sodium intake by delivering personalized messages when a participant was at a restaurant, grocery store, or at home. 33 Though JITAIs are a potentially transformative and scalable approach to delivering obesity interventions, their development is challenged by limited empirical and practical evidence to inform what type, for whom, and under what conditions JIT support is most effective for improving adherence to multiple weight loss behaviors.34,35
There is little experimental evidence on what types of tailored intervention messages are most effective for promoting daily behavior changes as mediators of weight loss. The microrandomized trial (MRT) is a study design that enables randomization of participants to different interventions one or multiple times per day to test the effect of delivering a single treatment component on the immediate, or proximal, outcome. 36 MRTs thus far have evaluated the effect of intervention messaging on physical activity,26,37–39 dietary adherence, 40 stress management,41,42 smoking cessation,42,43 and app engagement.44–48 Many behavioral weight loss interventions have created messaging content based on behavior change techniques (BCTs), which are observable and replicable components of interventions designed to bring about change in behavior (e.g. feedback, action planning, and social comparison).49–51 However, it is not yet known if brief smartphone-based messages based on specific BCTs are effective at promoting adherence to daily self-weighing and activity and dietary goals.
The objective of this pilot study was to test the preliminary effects of BCT-based intervention messages on adherence to daily weight-related behaviors to inform implementation of a fully powered trial. Based on empirical evidence on effective BCTs to promote weight-related behaviors52,53 and BCTs frequently used in behavioral weight management interventions for young adults, 51 we selected 7 different candidate BCTs to test: (reminders 7.1; outcome feedback, 2.7; social comparison, 6.2; past success, 15.3; goal progress feedback, 1.6; reinforcement, 10.4; implementation intentions, 1.4). An MRT design was used to test which BCT-based intervention messages are effective at promoting achievement of daily weight-related goals (self-weighing, meeting an activity goal, and meeting a dietary goal). We hypothesized that receiving versus not receiving each of the message types would increase likelihood of goal achievement. An additional aim was to examine the relationships between total message views and overall daily goal achievement in the program on weight loss at 12 weeks.
Methods
Study design and participants
This study was a 12-week pilot MRT of BCT-based intervention components designed to promote adherence to daily weight-related behavioral goals. Participants received a weight loss intervention delivered through a smartphone application (i.e. Nudge app, a native iOS application developed for this study), with integrated data from digital devices (wireless scale, Fitbit activity tracker, smartphone, and Nudge app food log), and included several features described below. To test the effects of different intervention components (i.e. 7 BCT-based intervention messages, hereafter called intervention messages) on proximal daily behavioral outcomes, at 4 different times per day (decision points) over 12 weeks, we randomized participants who were available at that time to receive or not receive one of the 7 intervention messages. The microrandomization (participant either received or did not receive the message) allowed each participant to serve as their own control throughout the study.
Young adults were recruited using informational emails sent out through a university listserv and paid Facebook advertisements which directed interested individuals to an online survey to screen for eligibility. Study staff followed up with eligible individuals by phone to describe study details and schedule individuals interested in enrolling for a group session. Participants met the following inclusion criteria: current age 18 to 35, body mass index (BMI) of 25 to 40 kg/m2, self-reported <150 minutes/week of moderate-to-vigorous intensity physical activity (MVPA), English-speaking and writing, owned an iPhone with iOS 11.0 or higher, had internet access and a text messaging plan, and had home wireless internet access compatible with the study wireless scale. Exclusion criteria included: current participation in another physical activity or weight control program, currently pregnant, pregnant in the previous 6 months, or planning pregnancy in the next 3 months, working primarily during night shifts, and health conditions that precluded changes in exercise or diet. Physician consent was required for individuals who reported a diagnosis of or treatment for high blood pressure, high cholesterol, or diabetes. All study procedures were reviewed and approved by the Institutional Review Board of the University of North Carolina at Chapel Hill. Study procedures and data collection took place from February to September 2019; all participants provided informed consent prior to study participation.
Nudge intervention
The 12-week intervention was developed to promote achievement of three daily weight-related behavioral goals detailed below. Participants were given a wireless scale (Fitbit Aria, San Francisco, CA) and physical activity tracker (Fitbit Alta), and downloaded the Nudge smartphone application. Weight and activity data were automatically uploaded to study servers through the Fitbit application programming interface (API). Participants tracked their foods and beverages in the Nudge app food log. To encourage adherence to dietary monitoring, the study used a simplified form of tracking based on the Traffic Light diet that categorizes foods as green (low-calorie, high nutrients), yellow (moderate calories, high nutrients), or red (high-calorie, high-fat, and low nutrients). 54 This simplified self-monitoring approach has been shown to be feasible, and has resulted in equivalent or higher self-monitoring rates and equivalent weight losses compared to detailed calorie self-monitoring.55,56 Participants were encouraged to track only their red foods (RF), though in week 1 they were asked to track green, yellow, and red so that they could learn more about the foods in each color category. The food log section of the app included lists of red, yellow, and green foods, with serving size information, and participants could track their foods by meal (Breakfast, Lunch, Dinner, and Snack). Participants were encouraged to select the “No Red Food” button when they consumed 0 RFs for a meal. The Nudge app included separate pages for Weighing, Active Minutes, and Red Foods that displayed participants’ progress toward their daily goals (Figure 1).

Example Nudge app pages.
During the group kickoff sessions, an interventionist provided a study overview and discussed tracking and daily behavioral goals related to weighing, activity, and eating. Participants were encouraged to focus on limiting their RFs and meeting a personalized daily goal for active minutes to gradually increase activity. The interventionist discussed the rationale for weighing daily and encouraged participants to consider their daily weight as an indicator to help them self-regulate their behaviors (i.e. behavioral changes were working or additional changes were needed). Participants received guidance on sections of the Nudge app, setting up their Fitbit and iPhone settings to ensure frequent syncing of their activity data (i.e. all-day sync, Bluetooth on, background app refresh on, keeping Fitbit app open, and running in background), setting up their scale at home, and how to use the food log. Interventionists discussed the simplified color-coded traffic light system for categorizing foods, gave instructions on logging foods in the app, and provided experiential learning with participants tracking the foods and beverages they consumed the day prior. Participants also received several handouts (food list categories, action steps following session, exercise safety, and setting up the wireless scale).
Daily goals
Participants were encouraged to meet three daily goals: (1) weigh themselves, (2) reach their active minutes (AM) goal, and (3) stay at or under their daily RF limit. Participants’ starting daily AM goal was determined by their self-reported weekly minutes of MVPA assessed at baseline (< 50 minutes/week MVPA = goal of 10 minutes/day; 50-75 minutes/week = 15 minutes/day; 76–100 minutes/week = 20 minutes/day; 101–125 minutes/week = 25 minutes/day; 126–149 minutes/week = 30 minutes/day). Participants used their Fitbit to track AM, which are equivalent to minutes of MVPA that are accumulated in at least 10-minute bouts. Daily AM goals stayed consistent during each program week (Monday–Sunday) but increased by 5 minutes the following week if the participant had reached total weekly AM that were equal to at least 5 times their daily goal.
Participants’ starting daily RF limit was set according to their baseline weight and was designed to produce energy deficits of approximately 300 to 500 calories per day (< 200 lb = 3 RF/day; 200–249 lb = 4 RF/day; ≥ 250 lb = 5 RF/day). The Nudge app did not change RF limits, but the Nudge system alerted study staff of participants who were tracking their RF regularly and staying at or under their RF limit but not losing weight. This circumstance suggested that the RF limit was not low enough to lead to weight loss for the participant, and after review with the study team, study staff would decrease the participant's daily RF limit by 1 (with a minimum limit of 2 RF/day).
Additional program features
The app included 12 lessons, with a new lesson unlocked each week. Lesson content focused on cognitive and behavioral skills such as self-monitoring, problem solving, overcoming barriers, social support, goal setting, cognitive restructuring, and making peace with the scale (i.e. seeing weight as an objective indicator of how daily diet and activity choices affect weight, rather than as a judgment). Resources included information specific to using the Nudge eating plan, food lists categorized by green, yellow, and RF, how to use a Fitbit, and a video about the benefits of daily weighing. At the beginning of each week, participants also received personalized feedback about their progress overall and in the past week. Feedback was tailored using computer algorithms that provided comprehensive feedback on participants’ weighing, AM, and RF intake in the context of their overall and recent weight change.
Intervention messages based on behavior change techniques
Within the Nudge app, we tested 7 different types of intervention messages (Table 1) designed to deliver distinct BCTs, which are observable and replicable components of interventions that are designed to bring about behavior change. 50 We selected BCTs that are commonly used in behavioral weight loss interventions with young adults, 57 have demonstrated efficacy for improving behavioral mediators of weight loss,52,53 or have the potential to promote overall self-regulation but have not been systematically evaluated for their effects on weight-related behaviors. We hypothesized that receiving, compared to not receiving, each of these 7 types of intervention messages would promote proximal change (either on the day of or day after receiving a message) by increasing the likelihood of participant achievement of the weight-related behavioral goals. The 7 types of intervention messages included: (1) reminders for weighing and self-monitoring of AM and RF (reminders; 7.1); (2) feedback on outcome of behaviors (i.e. weight change since last weighing) (outcome feedback; 2.7); (3) averaged data about other participants’ behavioral performance from the previous day or previous week (social comparison; 6.2); (4) data on the participant's past success in performing a behavior, when available (past success; 15.3); (5) data on the participant's progress toward the goal that day (i.e. discrepancy between current behavior and daily goal) (goal progress feedback; 1.6); (6) positive, reinforcing statements about goal achievement (reinforcement; 10.4); and (7) prompts for action planning or implementation intentions (“if/then” plans) related to a behavior (implementation intentions; 1.4). Message types 1 to 6 were static messages; implementation intentions were interactive messages with text boxes for the participant to enter their plans. Messages for the seven intervention types were developed separately for each of the three behaviors (weighing, AM, and RFs), and each intervention message focused on a single behavior (Table 1).
Examples of Nudge intervention message types.
Analysis limited to participants who had not yet weighed at time of randomization.
Analysis limited to participants who had not yet met AM goal at time of randomization.
Analysis limited to participants who had not yet exceeded RF limit at time of randomization.
AM: active minutes; RF: red foods.
Microrandomization of intervention messages
Participant eligibility for messages was evaluated at four prespecified times per day (early morning: 7:00AM, late morning: 10:00AM–12:00PM, afternoon: 2:00–4:00PM, and evening: 7:00–9:00PM) using decision rules that incorporated data regarding weight, AM, and RFs. Table 1 depicts each of the seven types of intervention messages and their relevant time points for delivery, primary outcome(s), decision rules for eligibility, and example messages. All seven intervention messages were not available for randomization at all decision points. At each of the four randomization decision points, the system evaluated the sets of decision rules for each intervention message available for randomization during that time period to determine which messages the participant was eligible to receive. Participants could only receive a maximum of three messages per day, one per behavior, such that the behavior that was the focus of the first randomization, whether the message was received or not received, was eliminated from message options for later time periods, and similarly for the second randomization. After evaluating the decision rules and determining which intervention message(s) the participant was eligible to receive (if any), the system would randomly select one from the available message types. At that point, the system microrandomized the participant with equal (50%) probability to receive or not receive the message. When randomized to receive a message, participants received a push notification that said, “Hello, check out a new message in Nudge!” as well as auditory alerts. The message was displayed in the app on the relevant behavior page (i.e. message about weighing displayed at top of Weighing page). If a message had been received but not yet viewed, both the smartphone icon for the Nudge app and an icon on the home page of the Nudge app displayed a red badge notification as additional cues to the participant that a new message was available. The messages were available until the end of the day and at 12:00AM they disappeared.
Measures
Proximal outcomes
Other measures
Demographic characteristics, including age, race, gender, education level, and income, were assessed at baseline using online REDCap questionnaires used in our previous studies among young adults.63,64 Height was measured in person at baseline using a wall mounted stadiometer, with two measures taken and averaged. Weight was measured at baseline and 3 months in person on calibrated scales with participants in light clothing, without shoes. Two measures were administered and averaged. Height and weight measures were used to calculate BMI (weight in kilograms divided by height in meters squared).
Statistical analyses
Given that this was a pilot study, it was not designed to power for all comparisons planned in this paper; instead, it was powered to detect an effect of being randomized to receive any message versus no message. Power analyses for the effect of receiving any message, versus no message, on goal achievement were conducted with the MRT sample size calculator for 80% power to detect an average proximal constant treatment effect (standardized; proximal effects/average standard error) of 0.08, assuming an alpha of .05 and an average of 30% availability.65–67
All analyses were conducted using RStudio statistical software (Version 4.2.1). Descriptive statistics for demographic variables were calculated for the sample. Our primary analyses were to evaluate the effects of: (1) any intervention message (vs. randomized to not receive a message) on adherence to daily weight-related behaviors on the day of randomization (
For each outcome of interest, the analytic sample was limited to time points when participants were determined to be eligible and were randomized to receive or not receive an assigned intervention message. Table 1 specifies the outcomes for each intervention message type. Outcomes varied as some message types were delivered more frequently than others (i.e. delivered whether or not participants were meeting their goal at the time (outcome feedback, social comparison
In exploratory analyses, we examined the effect of receiving and viewing versus receiving and not viewing messages (any message, behavior-specific messages, and BCT-based messages) on achievement of daily goals. We excluded observations for which no message was received. In line with similar studies that used a stabilized weighting approach to account for time-varying confounders in MRT studies,39,66,67,70 we weighted observations for which a message was randomized to be delivered by the inverse of the probability of the message action taken and by message availability and centering the treatment effects for added robustness. Inverse probability weighting adjusts for time-varying confounding of the exposure effect given individuals’ past behavior. This approach is similar to propensity score weighting in that observations in which actions were less likely to have occurred are given more weight than observations that were likely to have occurred.
To create the stabilized inverse probability weights (SIPWs), the numerator was each person's historical probability of viewing a message that they received in the program so far (i.e. up to the point of randomization), and the denominator was probability of viewing the current message, which was calculated with an equation using time of day and recent goal achievement in the past 7 days (as these variables were associated with probability of viewing a message). The probability of achieving a daily goal after viewing a message was estimated using logistic regression models that controlled for previously identified variables associated with message views, including history of message viewing, length of time in program, time of day, total weight change, weight change in last week, recent weighing lapse (vs. none), and dietary goal achievement in past week. 71 In sensitivity analyses comparing results with and without SIPWs, effects were uniformly smaller when accounting for SIPWs, so we report findings when controlling for SIPWs.
To determine if daily goal achievement was associated with weight loss at the end of the program, separate analysis of variance models evaluated the effect of total number of days each behavioral goal was met (weigh, wear tracker, met AM goal, track RF, and met RF limit), and total number of days the three primary daily goals were met (weigh, met AM goal, and met RF limit) on 12-week weight change, controlling for baseline weight.
Results
Participants
A total of 53 young adults were enrolled in the study, the majority of whom were female (79%) with a college or higher degree (85%). Mean BMI was 31.9 kg/m2 (SD = 4.4), and over one-third of the sample identified as Black or from other racial/ethnic minority backgrounds (Table 2). One participant withdrew on the third day of the study due to pregnancy and never received any messages; thus, the full sample consisted of 52 participants. Two additional participants withdrew from the study at days 43 and 60, reporting that they disliked intervention messages and had unforeseen circumstances respectively; their message and behavioral data are included up until the point of withdrawal (Figure 2, CONSORT).

CONSORT diagram.
Baseline demographic characteristics (n = 53).
*Other races include: American Indian or Alaska Native, Asian, Native Hawaiian or Other Pacific Islander, or reported “Other” SD: standard deviation; BMI: body mass index
Decision points and intervention messages delivered
Of 16,086 decision points when participants were eligible for randomization, 127 observations were removed due to system errors that resulted in 2 or 3 randomizations that occurred simultaneously, and it was not possible to determine what the participant could see on their app during those times. Participants were not eligible for an intervention during an additional 3434 decision points (i.e. 21.3% of the time). Thus, 12,525 decision points were available for analysis. Across the decision points when participants were eligible for randomization, participants were randomized to receive 6183 messages (i.e. 49% of the time), with 18% focused on weighing, 39% on AM, and 43% focused on RF (Table 3). The percentage of messages delivered across the 7 intervention types ranged from 8% to 27%. We excluded an additional 630 observations from models that evaluated weighing as an outcome because of an error in variable coding that indicated whether participants were out of town or not, which affected availability for messages related to weighing for a short time period.
Total number and percentage of each intervention message type delivered across 12-week study.
Effects of receiving (vs. not receiving) any intervention messages
Table 4 shows the estimated effects of messages on adherence to daily weight-related behaviors on the day of, or day following, randomization. On average, over the types of intervention messages and study days, the effect of receiving any message versus not receiving a message was associated with a lower number of RFs (odds ratio (OR) = .96, 95% confidence interval (CI): .94, .98,
Odds ratios and incident rate ratios comparing effect of randomization to receive versus not receive messages on daily behavioral outcomes.
Results are provided as OR (95% CIs) for categorical outcomes and IRR (95% CIs) for continuous outcomes. Bolded estimates indicate CIs that did not include 1.0.
Effect of receiving any message on the behavioral outcome.
Effect of receiving any behavior-specific message on the behavioral outcome.
Effect of receiving behavior-change-technique- and-behavior-specific message on the behavioral outcome.
No longer significant at the
*Effect of message on the behavioral outcome tomorrow (i.e. day following randomization).
AM: active minutes; BCT: behavior change technique; CI: confidence interval; IRR: incident rate ratios; OR: odds ratios; RF: red foods.
Effects of receiving (vs. not receiving) behavior-specific messages
When evaluating the effects across the intervention message types focused on a specific behavior (i.e. weighing, AM, or RF) and across study days, on average, receiving behavior-specific messages did not have any effects compared with not receiving them (Table 4).
Effects of receiving (vs. not receiving) BCT-based messages
When examining the unique effects of the seven BCT-based behavior-specific intervention types on their relevant behavioral outcomes (Table 4), only
Inverse probability weighted effects of viewing (vs. receiving and not viewing) any intervention messages
Results are shown in the top row of Table 5.When accounting for stabilized inverse probability weights (SIPWs), receiving and viewing
Odds ratios and incident rate ratios comparing effect of viewing messages received versus not viewing messages received on daily behavioral outcomes.
Results are provided as OR (95% CIs) for categorical outcomes and IRR (95% CIs) for continuous outcomes. Bolded estimates indicate CIs that did not include 1.0.
Effect of receiving and viewing any message on the behavioral outcome.
Effect of receiving and viewing any behavior-specific message on the behavioral outcome.
Effect of receiving and viewing BCT-behavior-specific message on the behavioral outcome.
Near complete separation; cannot estimate model.
No longer significant at the
*Effect of message on the behavioral outcome tomorrow (i.e. day following randomization).
AM: active minutes; BCT: behavior change technique; CI: confidence interval; IRR: incident rate ratios; OR: odds ratios; RF: red foods.
Inverse probability weighted effects of viewing (vs. receiving and not viewing) behavior-specific messages
Results are shown in the second row of Table 5. Viewing messages about activity, versus not viewing them, was associated with higher odds of meeting AM goals (OR = 1.54, 95% CI: 1.09, 2.15) on the day of message receipt. Receiving and viewing messages about RFs, versus not viewing them, was associated with higher odds of meeting a RF limit (OR = 2.41, 95% CI: 1.41, 4.12) on the same day as the message. These effects remained significant after adjustment for multiple comparisons. Viewing behavior-specific messages was not associated with weighing, total AM, or total RFs tracked on the day of message receipt.
Inverse probability weighted effects of viewing (vs. receiving and not viewing) BCT-based messages
Results are shown in the last seven rows of Table 5. Viewing
Weight change and behavioral goal achievement
Participants with complete weight measurements at 12 weeks (n = 51) had an average weight change of −2.7 kg (SD = 3.6) and −3.0% (SD = 4.0). Out of a maximum of 84 days, median days weighed was 72 (IQR 64–80), median days meeting the AM goal was 37 (interquartile range (IQR) 19–52), and median days meeting the RF limit was 36 (IQR 16–50).
Associations between message views, goal attainment, and weight loss
Total message views in the 12-week program were significantly associated with weight (kg) lost (B = −0.04, SE = .017,
Effect of total number of days met behavioral goals on 12-week weight change.
*Bivariate associations.
**Behavioral goals include days weighed, days met AM goal, and days met RF limit (goals range from 0 to 3 per day for a range of 0 to 252 across the 12-week study).
AM: active minutes; RF: red foods.
Discussion
In this MRT we tested the effects of seven different just-in-time adaptive intervention messages on likelihood of adhering to multiple weight-related behavioral goals. Overall, we found that receiving any message may be associated with a small reduction in the total number of RFs consumed, and BCT-based behavior-specific messages may be feasible for promoting daily adherence to self-weighing and staying at or under a RF limit, particularly when participants view the message.
When examining BCT-based messages, proximal effects on their relevant behaviors were only observed for social comparison messages about RFs. All participants were eligible for social comparison messages, whether or not they had exceeded their goal at the time of randomization, so these analyses had more power to evaluate the relationship compared to other message types. However, it is notable that a message indicating how other study participants performed (e.g. % met RF limit yesterday), and asking young adults to consider how they compared or whether they could do better, was associated with fewer total number of RFs consumed when compared to not receiving the message, though it was no longer significant after adjustment for multiple comparisons. While social comparison messages were not associated with meeting the RF limit, the messages appeared to have a positive impact on minimizing the total number of RFs consumed, especially on days when participants had already exceeded their RF limit. These messages were delivered in the late morning and afternoon time points, so perhaps participants had enough time to consider how others were doing in the program and were motivated to make changes to their eating behaviors for the remainder of the day. Mobile apps for weight management and physical activity promotion commonly use social comparison features, 72 yet there is limited evidence evaluating these features as a mechanism for promoting healthy dietary intake. 73 There is evidence that social norms are associated with eating behaviors in young adults.74,75 Given the high prevalence of social media use among young adults, it is possible that exposure to food-related posts external to the Nudge program may have influenced participants’ perceived norms and food intake. For instance, perceived injunctive norms of other social media users’ intake of energy-dense foods have been shown to be associated with study participants’ own intake of energy-dense foods, 76 and in a randomized controlled trial, exposure to junk food content on social media impacted young adults’ food choice. 77 Individuals’ tendency to value comparison to others (i.e. social comparison orientation) has been shown to be associated with weight loss outcomes, but it is unclear whether upward or downward comparisons are more effective for promoting weight-related behaviors. 78 As participants were eligible to receive social comparison messages regardless of whether they had met the daily behavioral goal or not (i.e. upward or downward comparison), additional research is needed to determine how the effects of these messages varied by individual contexts.
No other BCT-based messages were associated with the daily behavioral outcomes. Possible reasons for this finding include lack of power to detect small effects and the possibility that participants began to expect which messages they would be receiving over time. Though each message library for each BCT-behavior combination included 12 messages (e.g. 12 reinforcement messages for weighing, etc.), the content and timing of these messages did not change during the study. Thus, it is possible that participants learned which message types they would be receiving during certain times of day and were less likely to view them if they were not expecting novel content. Additionally, it is possible that the effects of BCT-based messages on behavioral outcomes may depend on individuals’ motivations to weigh themselves, increase their physical activity, or eat a healthier diet. Previous research has shown motivation to be an underlying mechanism of action through which BCTs exert their effects on behavior change.79,80 For example, implementation intentions are more effective for behavior change when participants have high motivation to achieve a goal.81,82 It is possible that the lack of BCT-based message effects on daily goal achievement may be due in part to low autonomous motivation to adhere to the daily goal behaviors. Future work could benefit from examining individual contexts, both psychosocial and behavioral, as moderators of BCT-based message effects.
When exploring the effects of receiving and viewing BCT-based messages, more proximal effects were observed and in expected directions. An important consideration is that participants were not randomized to view or not view the message, and factors related to their program participation thus far may have affected their likelihood of opening the app and viewing a message. 83 However, analyses attempted to control for confounding factors by including covariates for recent weight change and goal achievement. Social comparison messages, past success, and goal progress feedback messages, when viewed, appeared to positively impact achievement of meeting RF goals compared to when not viewed. Reinforcement messages positively impacted weighing goals when viewed.
Of the two message types delivered in the evening, when viewed, only reinforcement had a positive effect on the next day's behavior, and only for weighing, such that receiving and viewing a positive reinforcement message about weighing was associated with greater likelihood of weighing the following day compared to not viewing it. Systematic reviews have demonstrated that BCTs of nonspecific reward and social rewards produced positive effects on physical activity among those with obesity 53 or cancer, 84 though that was not found in the current study. However, reinforcement messages for weighing may have had a greater impact than those focused on AM or RF goals because the weighing behavior most often occurred the following morning and was not as susceptible to barriers that may arise throughout the day that make it more difficult to adhere to AM and RF recommendations. It is possible that reinforcing messages were helpful for those who had low motivation to weigh themselves daily. Previous study participants who have been taught to weigh themselves daily in the context of a weight management program have reported that daily weighing is a useful tool to control their weight and increase their awareness of dietary and activity behaviors, while some have indicated weight fluctuations were discouraging and a barrier to daily weighing. 85 Future work is needed to better personalize messages based on individual perceptions of what young adults would find to be a positive reinforcement with respect to adhering to specific behaviors.
Viewing implementation intention messages had no effect on the next days’ behavioral goal achievement. Prompting implementation intentions has been shown to improve weight loss over short time frames (i.e. 4–10 weeks),86–88 but these studies examined the effects of implementation intentions as part of a comprehensive program on overall weight loss over time and prompted them less frequently (e.g. once and weekly),86–88 as opposed to the isolated effect of an implementation intention message on daily proximal weight-related outcomes. Additionally, in this study, implementation intention messages were interactive, such that participants were prompted to fill in text boxes to set their plan for the next day. It is possible that participants viewed the activity but did not complete it, which would preclude an effect of viewing on goal achievement. Given that implementation intentions are more effective when participants have high motivation to change their behavior, 81 low motivation possibly could have influenced participant receptivity and completion of these messages. Among young adults, there is limited evidence on whether frequent implementation intention prompts can promote daily achievement of multiple weight-related behavioral goals. 87 There is evidence that utilizing action planning together with other BCTs may be more effective for promoting physical activity than action planning alone. 89 A review of 22 systematic reviews that evaluated the effectiveness of BCTs in promoting weight loss showed that the effects of BCT combinations vary by behavioral focus (diet vs. physical activity). 90 While combining self-monitoring and goal-setting BCTs with other self-regulatory strategies have the potential to promote weight loss, the review concluded that there remains a lack of clarity regarding which packages of BCTs are most effective for weight loss and how BCTs might interact or dilute the effects of other BCTs. 90 Additional work should systematically evaluate combinations of BCTs that are effective for promoting multiple weight-management behaviors.
Providing feedback on the outcome of behaviors (e.g. weight change since last weighing occasion and statement about sticking to RF limit), when viewed, did not appear to be beneficial for promoting daily behavioral goal achievement. Given that frequent dietary self-monitoring and goal achievement are associated with improved weight management,91–93 messages that directly cue participants to the association between their recent weight change and the impact of sticking to their goals could help them meet their goals more often, contributing to distal weight change. Previous research has demonstrated that feedback on outcome of behavior predicts positive long-term effects on diet and physical activity in adults with overweight or obesity, 94 however, less is known about effects on daily behavioral goal achievement. In the current study, we did not examine whether message effects varied in the context of more proximal weight change (i.e. gain or loss). Future work should examine moderators of message effects on daily outcomes.
Receipt of goal progress feedback messages was not associated with achievement of any goals compared to no receipt. This is similar to a recent microrandomized trial that tested the effect of goal progress messages on total daily steps and found no effect of message receipt compared to no message. 39 Given that most trackers and mobile programs provide progress indicators and goal reminders, it is unclear if this feedback is providing participants with new information. Messages in the current study were intended to draw attention to the discrepancy between current behavior and the daily goal, whether the current behavior was below or above the goal. While goal-setting and self-monitoring of behaviors are key behavior change strategies, there is limited evidence on whether frequent messages highlighting progress in relation to a goal are effective for promoting regular achievement of weight-related goals. In this trial, viewing goal progress feedback messages about RFs was associated with meeting RF goals suggesting that when participants view these messages, the knowledge of how close or far they are away from their RF goal may help them stay at or under it before the end of the day.
Being randomized to receive reminders to weigh, wear an activity tracker, and track RFs was not effective, though when viewed, reminder messages about RFs were associated with a higher likelihood of completing RF tracking. In general, self-monitoring was high (median of 72 weigh days out of 84, 80 tracker wear days, and 60 days with
The potential of JITAI messages and proximal goal achievement to improve distal weight loss was supported by findings that total number of message views and total number of behavioral goals achieved, both across and by individual behavior, were positively associated with 12-week weight loss. Further examination of ways to sustain message viewing, possible variation in effects over time and by individual contexts, are warranted. Overall weight loss after 12 weeks was modest at 3.0%, though similar to another trial in which participants used RF tracking and achieved 4.0% weight loss at 6 months. 56 Because this was a microrandomized trial with only one treatment group, and total message views is confounded by other aspects of treatment success even after use of SIPWs, it is not clear whether weight losses in this study were a result of the daily messages or other standard behavioral content that was available in the program (e.g. personalized weekly feedback on their progress). Given the clear importance of engagement in mobile programs, it will be necessary to study ways to increase engagement, including different types of messaging, interactive modules, and how to best deliver content and messaging (e.g. text versus video, long text pages vs. short modules, etc.). Both motivation to engage with intervention messages as well as the distinctive components of intervention fidelity (i.e. delivery, receipt, and enactment of messages) are important considerations that should be made when designing and evaluating future mHealth interventions. 96 Additional research is needed to elucidate the relationships among various measures of engagement beyond message views, such as user perceptions and psychological engagement, and intervention effects. 97
Strengths and limitations
A strength of this study was the microrandomized trial design which permitted frequent evaluation of message effects on multiple proximal weight-related behaviors, while prior studies have focused on single behavioral outcomes. The study design allowed for efficient testing of multiple BCT-based message types and examination of the effects of each of the seven message types on three different behaviors. Additionally, though this study had a small sample size, it was a diverse sample with 37% of young adults identifying with racial and ethnic minority backgrounds. Since individuals were excluded if they did not own iPhones, this may have resulted in a biased sample and limits generalizability of the results. Other limitations include the insufficient power to detect effects. For the most part, availability for each message type was lower than proposed in the power analyses, which likely affected the ability to answer the research questions. Expanding criteria for availability such that individuals are eligible to be randomized for each message type across all time points and regardless of their behavioral status (i.e. met goal or not) could improve power in future trials. Additionally, there were some technical issues with location tracking and system errors that lowered the overall number of messages that were available, particularly those that were specific to weighing. Careful testing of location tracking functions prior to study launch and ongoing monitoring of message fidelity and data integrity from study initiation could help identify technical issues earlier and reduce their impacts. While RF consumption was self-reported in the app and may have introduced systematic measurement error (e.g. under-reporting, recall bias), the criteria for meeting the RF limit required that participants had a complete day of tracking, which may have helped limit any systematic under-reporting. While each message focused on a distinct behavior, given the frequency of randomization in a single day, it is possible that any message received could have had carryover effects on other behaviors and prompted individuals to stay on track with achieving goals overall. With the exception of the evening messages, the current analysis focused on the effects of messages on goal achievement on the day of delivery and did not take into account the effects of messages that may have been received in prior days, which may have had lingering effects on goal achievement. The next step will be to conduct a trial with more participants and a longer duration and that allows all message types to be distributed at all time points; this will improve the ability to test the effect of specific BCT-based message types.
Conclusions and implications
Daily BCT-based messages may promote proximal goal achievement, but an important consideration is that only viewing messages (not being randomized to receive them) was associated with goal achievement, and this was likely confounded by other aspects of treatment success. This trial suggests that brief behavioral messages may only impact behavior if the participant reads them and calls attention to the role that participant motivation and contexts may play in participant receptivity to an intervention and its subsequent effects. Future research should consider the distinction between and importance of intervention delivery and receipt. As participant receptivity to and engagement with digital interventions often declines over time, examination of the time-varying effects of BCT-based messages on proximal achievement of weight-related goals is needed. Further optimization of JITAI messaging to support weight management may require collecting more information about participants’ context as potential moderators of message effects on outcomes (e.g. motivation, location, previous message dose, whether already met daily behavioral goal), varying message content or providing alternative incentives to increase engagement later in the program, and using other methods to determine how to send the “right message” at the “right time.”
