21 Jul 2016: The PLOS ONE Staff (2016) Correction: Effects of Three Motivationally Targeted Mobile Device Applications on Initial Physical Activity and Sedentary Behavior Change in Midlife and Older Adults: A Randomized Trial. PLOS ONE 11(7): e0160113. https://doi.org/10.1371/journal.pone.0160113 View correction
While there has been an explosion of mobile device applications (apps) promoting healthful behaviors, including physical activity and sedentary patterns, surprisingly few have been based explicitly on strategies drawn from behavioral theory and evidence.
This study provided an initial 8-week evaluation of three different customized physical activity-sedentary behavior apps drawn from conceptually distinct motivational frames in comparison with a commercially available control app.
Study Design and Methods
Ninety-five underactive adults ages 45 years and older with no prior smartphone experience were randomized to use an analytically framed app, a socially framed app, an affectively framed app, or a diet-tracker control app. Daily physical activity and sedentary behavior were measured using the smartphone’s built-in accelerometer and daily self-report measures.
Mixed-effects models indicated that, over the 8-week period, the social app users showed significantly greater overall increases in weekly accelerometry-derived moderate to vigorous physical activity relative to the other three arms (P values for between-arm differences = .04-.005; Social vs. Control app: d = 1.05, CI = 0.44,1.67; Social vs. Affect app: d = 0.89, CI = 0.27,1.51; Social vs. Analytic app: d = 0.89, CI = 0.27,1.51), while more variable responses were observed among users of the other two motivationally framed apps. Social app users also had significantly lower overall amounts of accelerometry-derived sedentary behavior relative to the other three arms (P values for between-arm differences = .02-.001; Social vs. Control app: d = 1.10,CI = 0.48,1.72; Social vs. Affect app: d = 0.94, CI = 0.32,1.56; Social vs. Analytic app: d = 1.24, CI = 0.59,1.89). Additionally, Social and Affect app users reported lower overall sitting time compared to the other two arms (P values for between-arm differences < .001; Social vs. Control app: d = 1.59,CI = 0.92, 2.25; Social vs. Analytic app: d = 1.89,CI = 1.17, 2.61; Affect vs. Control app: d = 1.19,CI = 0.56, 1.81; Affect vs. Analytic app: d = 1.41,CI = 0.74, 2.07).
The results provide initial support for the use of a smartphone-delivered social frame in the early induction of both physical activity and sedentary behavior changes. The information obtained also sets the stage for further investigation of subgroups that might particularly benefit from different motivationally framed apps in these two key health promotion areas.
Citation: King AC, Hekler EB, Grieco LA, Winter SJ, Sheats JL, Buman MP, et al. (2016) Effects of Three Motivationally Targeted Mobile Device Applications on Initial Physical Activity and Sedentary Behavior Change in Midlife and Older Adults: A Randomized Trial. PLoS ONE 11(6): e0156370. https://doi.org/10.1371/journal.pone.0156370
Editor: Rebecca A. Krukowski, University of Tennessee Health Science Center, UNITED STATES
Received: February 11, 2016; Accepted: May 12, 2016; Published: June 28, 2016
Copyright: © 2016 King et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data contain potentially identifying information and may not be shared publicly. Data may be requested from the corresponding author.
Funding: This work was supported by US Public Health Service grant #RC1 HL099340 from the National Heart, Lung, & Blood Institute of the National Institutes of Health (NIH) awarded to Dr. King; US Public Health Service Grant 1U54EB020405 supporting The National Center for Mobility Data Integration and Insight; and US Public Health Service grant #5T32L007034 from the National Heart, Lung, & Blood Institute. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Current advances in mobile communication technology have paved the way for an explosion of digital health promotion programs and mobile applications (apps), many aimed at promoting physical activity [1–3]. Mobile apps targeting health behavior change hold great promise with respect to offering customized information, continuity of information and support over time, and a potentially wide reach across virtually the entire population. This includes the increasingly prevalent midlife and older segments of the population (ages 45 years and above) that are at increasing risk for the range of chronic diseases that are positively impacted by regular physical activity, but represent the most inactive age group in the U.S. and elsewhere . This age group stands to benefit greatly from the rapid growth of smartphone usage and accompanying health apps. In 2015, about half of adults ages 45–64 years owned a smartphone, along with a 42% increase in smartphone ownership between 2014 and 2015 in adults ages 65 and over (to 27% in 2015) . In addition, 52% of U.S. adults with a high school education or less and 50% of adults in the lowest third of household income now own smartphones.
While thousands of health promoting smartphone apps are currently available, relatively few have applied behavioral theory in a systematic or explicit way [6, 7], and most have not been evaluated for even short-term efficacy or scientific accuracy [8, 9]. Similarly, few apps and other eHealth or mHealth programs have been aimed at bridging the “digital divide” through incorporating elements that would enable use by typically underserved populations with generally lower levels of technology literacy as well as physical activity, e.g., aging adults . Direct, head-to-head comparisons of mobile apps for health behavior change have been rare, and relatively few studies in this field have evaluated more than one health behavior target at a time , or included less studied behaviors, such as sedentary time (i.e., seated/reclining with low energy expenditure) . Evaluation of mobile apps that provide integrated adaptive information throughout the day on two complementary health behaviors (i.e., physical activity and sedentary behavior) has rarely occurred.
The purpose of this investigation was to evaluate systematically, using a controlled experimental design, the initial efficacy of three customized smartphone applications, relative to a commercially available dietary control app, on initial adoption of a more physically active and less sedentary pattern of behavior throughout the day in a sample of insufficiently active midlife and older adults who were not regular smartphone users. These “move more, sit less” apps each focused on a distinct behaviorally based motivational “frame” to better understand their relative efficacy in a sample of midlife and older adults with little mobile technology experience. This older inactive population, while carrying greater chronic disease burden than their younger counterparts, has rarely been targeted specifically in the mobile app health promotion arena .
The primary questions of interest were:
- Would each of the three custom apps produce significant improvements in moderate-to-vigorous physical activity (MVPA) and/or sedentary behavior relative to the control app during the eight-week study period? And
- Would any of the three custom apps produce significant eight-week improvements in MVPA and/or sedentary behavior relative to either of the other custom apps?
The Stanford University School of Medicine Human Subjects Institutional Review Board approved this study in September 2009. All participants provided written informed consent.
Trial Design and Participants
The study was a parallel, randomized trial with 1:1 allocation of participants to use one of three custom physical activity apps or a diet-tracking control app for an 8-week period (described below). Random assignment occurred through use of a computerized version of the Efron procedure  by the study statistical analyst, who was blinded to participant allocation assignment. The Efron procedure, while not guaranteeing identical final participant allocation numbers across study arms, allows for reasonably balanced subject allocation throughout the entire recruitment and randomization period, which is particularly advantageous for studies with smaller sample sizes and multiple study arms . Enrollment and intervention study assignment procedures were carried out by trained, PhD-level study staff.
The target population consisted of community-dwelling adults who met the following eligibility criteria: ages 45 years and older; insufficiently physically active (i.e., engaged in less than 60 minutes of moderate or more vigorous physical activity per week that increased heart rate, breathing, or perspiration); reported typically sitting for 10 or more hours per day; were able to participate safely in a physical activity program based on responses to the physical activity readiness questionnaire ; and were currently using a mobile phone though not a smartphone. The rationale for recruiting individuals who were not current smartphone users was twofold: 1) it facilitated the development of apps that were sufficiently simple and straightforward that they could be used regardless of smartphone proficiency; and 2) it simplified uniform testing of the Android apps in this first-generation study through using a standard smartphone model and platform, which also eliminated the need for participants to carry more than one phone with them or temporarily use a smartphone different from the one that they already had. The primary recruitment methods used were email invitations sent to local electronic mailing lists; in-person recruitment activities occurring at local community and senior centers as well as congregate housing settings; flyers and posters on community notice-boards; and ads on Craigslist.com. After suitable iterative design development and formative testing of the apps, Wave 1 of the study (n = 36) was conducted between April and December of 2011 to confirm the acceptability and feasibility of the study procedures and protocols for the smartphone-naïve, older population being targeted. With the acceptability of the study procedures thus confirmed, the study was registered at ClinicalTrials.gov (Identifier NCT01516411) on 19 January, 2012 and the second wave of participants (n = 59) was enrolled between February and November, 2012. The use of the two waves also helped to ensure adequate subject enrollment across all four seasons, given the relationship between seasonality and physical activity participation . Study follow-up ended as planned June 2013. A copy of the study trial protocol (S1 Protocol) is included as a supporting information file, along with the CONSORT Checklist (S1 CONSORT Checklist). Data may be requested from the corresponding author. The authors confirm that all ongoing and related trials for this intervention are registered.
Interventions: App Development and Descriptions
A detailed description of both app development and descriptions have been published elsewhere . Briefly, a behavioral science-informed user experience iterative design process (BSUED) was applied in the initial development and formative testing of three different smartphone apps , each of which emphasized a distinct type of motivational frame . The Android smartphone platform was used given its ability to provide “live wallpaper”-based glance-able displays, ease of programming, and its ability to run the built-in accelerometer in the background while other smartphone functions were operating . The objective of each app was to shape the user towards a daily goal of approximately 30 minutes of moderate-to-vigorous physical activity and eight or fewer hours of daily sedentary time [18, 19], measured using the smartphone’s built-in accelerometer. To standardize the smartphones being used in this first-generation study and to mitigate potential problems that can occur when current smartphone users are asked to use an additional phone, individuals were recruited who were mobile phone users but not regular smartphone users. All participants were provided with the same model of Android smartphone.
Among the aims of the iterative design and formative user testing process were to develop custom apps that would be generally appealing and engaging for the aging population being targeted. All three apps shared basic behavioral and design elements that have been found to elicit interest and initial participation, including both “push” (notifications) and “pull” (information available via selecting an icon) components; a glance-able display; real-time customized feedback that was driven by the personal data being captured via the built-in accelerometer; behavioral self-monitoring; and a help tab [16, 17]. The above components provided each participant with his/her own customized “just-in-time” feedback and information based on the data being automatically collected by each participant’s smartphone throughout the day.
The specific format and content of each app are described previously . Briefly, the “analytic” app, based on Social Cognitive theory and self-regulatory principles of behavior change [20, 21], emphasized personalized and quantitative goal-setting, behavioral feedback, informational tips promoting behavior change, and problem-solving strategies aimed at behavior change barriers. Two colorful meters, viewable on the phone’s glance-able display throughout the day, showed progress towards goals for moderate-to-vigorous physical activity (MVPA) and sedentary behavior.
The “social” app, based largely on social influence perspectives [22, 23], emphasized social support for behavior change, “just-in-time” social normative feedback , modeling of behaviors by similar others using avatars on the display, and group-based collaboration and competition. Small avatars reflecting the current physical activity/sedentary behavior levels of the participant and other members of the “virtual team” to which he/she had been automatically assigned, as well as another “virtual team”, were viewable on the phone’s glance-able display throughout the day. Team members could also interact with one another through the app’s online message board.
The “affect” app, which applied principles of reinforcement scheduling, attachment and nurturance motives, as well as gamification/play , utilized an avatar in the form of a bird to mirror how active or sedentary the user was throughout the day. The bird avatar, which was viewable on the phone’s glance-able display throughout the day, changed position, posture, and movement depending on how active or inactive the user was up to that time point. Users received “rewards” (e.g., the bird avatar would unexpectedly appear in far-away cities) as a function of increased physical activity levels.
Following the iterative design development and formative testing process (of both the user experience and app functionality), we conducted the first-generation randomized controlled experiment of the three apps evaluating their capabilities for impacting initial (2-month) physical activity and sedentary activity levels, measured via smartphone-based accelerometry, which was validated against Actigraph accelerometry , relative to a commercially available, non-physical activity control app (Calorific), which tracks dietary behaviors throughout the day. As noted earlier, individuals meeting the eligibility criteria were randomly assigned to use one of the three custom apps or the diet-tracking control app for an 8-week period. The first week of the 8-week period was used as a baseline period during which time only the activity-monitoring app (without a behavior change app) was installed on the study smartphones provided to participants. Participants were requested to continue their normal physical activity and sedentary behaviors during the baseline week. Because the participants in this study had not previously used a smartphone, an initial one-on-one 1-hour training session was used to provide participants with instruction on the general use of the smartphone, including wearing it attached to their waist to optimize accurate data capture via the phone’s built-in accelerometer. At the end of this initial week, participants returned to the research facility to receive their randomly assigned behavior change app and basic instruction on its use. In addition to having access to the ‘‘help” tab as part of each app, participants could call project staff with any technical problems or difficulties with the apps during the 8-week project period. In addition, written instructions for the smartphone were provided in the form of the manufacturer’s user manual along with simplified user instructions designed by the research team to highlight key features of both the smartphone and the apps.
Accelerometry-derived daily activity and sedentary time.
The primary outcome measure for this study was estimated minutes in moderate-to-vigorous intensity physical activity (MVPA) based on smartphone-derived accelerometry. Secondary outcome measures were estimated minutes of sedentary time based on smartphone-derived accelerometry and self-reported ecological momentary assessment of daily brisk walking and sitting time collected via the smartphone. We utilized the cut-points generated from our prior research to determine MVPA and sedentary time (see below). These data were collected via the smartphones themselves and sent wirelessly to a secured Stanford University server for storage and analysis. The built-in smartphone accelerometer was used because of this older, technology-naïve population’s general reluctance, revealed during the piloting phase of the study, to wear or carry more than one electronic device.
Smartphone accelerometry data collection and cleaning procedures were consistent with large-scale cross-sectional accelerometer studies [26, 27], such that: (a) valid hours of data consisted of no more than 60 consecutive ‘zero’ values (interpreted as non-wear time); and (b) a valid day was defined as at least 10 valid hours/day. Because data were collected continuously and trajectory-based analyses were conducted, no minimum valid days/week criterion was necessary. As noted above, minutes of moderate-vigorous (>301 counts/min) and sedentary (≤56 counts/min) activities using the phone’s built-in accelerometer were calculated based on our prior validation work using this type of smartphone accelerometer .
Ecological Momentary Assessment (EMA) of target health behaviors.
In addition to collecting movement data throughout the day via the smartphone’s built-in accelerometer, ecological momentary assessment-based (EMA) reporting of brisk walking and sitting time was also collected on a daily basis via the smartphone throughout the 8-week study period. EMA, a method whereby individuals are queried on behaviors, affect, and similar events close in time to the experience of such events, can facilitate more sensitive and accurate recording and/or prediction of such events or behaviors [28, 29]. Daily reporting occurred each evening, at a time most convenient to each participant. In the event that a participant failed to respond at the set time, automated reminder notifications were sent to the smartphone. The brisk walking item consisted of the following question: “How many total minutes of brisk walking have you engaged in today? Choose one response”. Categories of total minutes were as follows: 1–9, 10–14, 15–19, 20–24, 25–29, 30–34, 35–39, 40–49, 50–59, 60–74, 75–89, 90–119, and more than 120 minutes. The sitting time item consisted of the following question: “How many total hours have you been sitting today?” Participants chose a number between 0 and 24 hours.
Sample size calculations for this first-generation smartphone intervention study were based on a prior eight-week physical activity mobile device intervention study with similarly aged insufficiently active adults . In that study, between-arm differences were achieved with approximately 18 participants per arm completing the study. The sample size was increased by approximately 22 percent per arm in the current trial to allow for multiple testing, in conjunction with adding objective measurement of the two major outcome variables (physical activity and sedentary behavior) and use of mixed models analysis to enhance statistical power.
Mixed models analyses were utilized because of the intensive repeated measures design . The advantages of this technique are that it is capable of handling nested observations (e.g., multiple observations for each individual), unbalanced (i.e., unequal) numbers of observations, and missing values . Physical activity (i.e., accelerometer-derived moderate-to-vigorous physical activity, EMA-derived brisk walking) and sedentary behavior (i.e., accelerometer-derived sedentary time, EMA-derived sitting time) outcomes were entered as dependent variables in separate models. Wave of study recruitment and linear, quadratic, and cubic time parameterizations were adjusted for in all models. Main effects for time, and time x study arm interactions were tested. Full-information maximum likelihood estimation was used as part of SAS Enterprise Guide v5.1 software to accommodate missing data in the models. To provide more easily interpretable data, we centered our time variable to the last baseline date (i.e., intervention day 1 = 1), thus allowing easier interpretation of the results. Because of a non-normal distribution of MVPA estimates, MVPA values were log-transformed. Scheffé adjustment for multiple comparisons—customarily used with unequal cell sizes—was applied in interpreting differences between pairs of study arms. The significance level for all statistical analyses was set at P < .05, two-tailed.
Study enrollment, flow, and number of participants per arm that were included in data analyses are summarized in Fig 1. In brief, approximately one fourth of the sample was randomized to each smartphone app (Social n = 22; Affect n = 24; Analytic n = 22, Control = 27). A slightly higher number of participants were randomized to the Control arm, given the potential for somewhat greater dropout occurring with the diet-tracker app used in that arm. The overall study retention rate equaled 94%, with no significant differences between study arms (retention rates for Social = 100% [22/22]; Affect = 92% [22/24]; Analytic = 95% [21/22]; Control = 89% [24/27]). Table 1 reports sample descriptive statistics. No significant between-group baseline differences were found for the demographic variables, physical activity, or sedentary behavior variables measured via accelerometry or ecological momentary assessment (P values ≥ .15). All analyses were conducted using original group assignment. No adverse events or harms were found across the study period.
Changes in Accelerometer-derived Moderate-to-Vigorous Physical Activity (MVPA)
Fig 2 graphically displays overall changes in accelerometer-derived MVPA by study arm. Overall, there were significant quadratic (F[1,2647] = 18.63, P < .001) and cubic (F[1,2647] = 8.00, P = .005) effects for time. The primary questions of interest pertained to whether any of the customized apps would promote significantly higher 8-week MVPA levels relative to the Control app, and whether the effects of the customized apps in promoting 8-week MVPA would differ significantly from one another. Significant main effect differences over time were observed by study arm such that the Social app had significantly higher levels of MVPA relative to the Control app (mean difference [SE] = 3.17 [0.02]; t = 3.57, P = .005; d = 1.05, CI = 0.44,1.67), the Affect app (mean difference [SE] = 1.38 [.02];t = 2.94, P = .03; d = 0.89, CI = 0.27,1.51), and the Analytic (mean difference [SE] = 1.27 [.02]; t = 2.84,P = .04; d = 0.89, CI = 0.27,1.51) following Scheffé adjustment for multiple comparisons. No other significant between-arm differences were found and no time x arm differences were observed. Based upon a significant random effect for time (P < .001), there was substantial amount of inter-individual variability in changes in MVPA across all of the apps.
Changes in Accelerometer-Derived Sedentary Behavior
Fig 3 graphically displays overall changes in accelerometer-derived sedentary behavior by study arm. Overall, there were non-significant linear, quadratic, and cubic effects for time (P values = .10-.24). However, significant main effect differences over time were observed by study arm, similar to those observed for MVPA. The Social app had significantly lower levels of sedentary time relative to the Control app (mean difference [SE] = -.05 [.01]; t = -3.72, P < .001; d = 1.10,CI = 0.48,1.72), the Affect app (mean difference [SE] = -.09 [.01];t = -3.11, P = .02; d = 0.94, CI = 0.32,1.56), and the Analytic (mean difference [SE] = -.09 [.01]; t = -4.07,P < .001; d = 1.24, CI = 0.59,1.89) following Scheffé adjustment for multiple comparisons. No other significant between-arm differences were found and no time x arm differences were observed. Based upon a significant random effect for time (P < .001), there was substantial amount of inter-individual variability in changes in sedentary time across all of the apps.
Changes in Ecological Momentary Assessment (EMA) Outcomes
For the smartphone EMA-reported brisk walking variable, there were no significant overall effects for time or statistically significant differences between study arms. For reported sitting time (see Fig 4), there was an overall significant cubic effect for time (F[1,1264] = 6.82, P < .001). Significant main effect differences over time were also observed by study arm. The Social and Affect apps both reported significantly less sitting time than either the Analytic app (Social app: mean difference [SE] = 1.00 [.03];t = 6.19, P < .001, d = 1.89,CI = 1.17, 2.61; Affect app: mean difference [SE] = .90 [.21];t = 4.61, P = < .001, d = 1.41,CI = 0.74, 2.07) or the Control app (Social app: mean difference [SE] = .46 [.39];t = 5.37, P = < .001, d = 1.59,CI = 0.92, 2.25; Affect app: mean difference [SE] = .36 [.64];t = 4.02, P < .001, d = 1.19,CI = 0.56, 1.81) following Scheffé adjustment for multiple comparisons. No other significant between-arm differences were found and no time x arm differences were observed. Based upon a significant random effect for time (P < .001), there was substantial amount of inter-individual variability in changes in EMA-based sitting time across all of the apps.
For the Social App: Exploration of Between-Participant Social Interactions
Given the significant effects of the Social app on both accelerometry-derived target variables and the EMA-based sitting time variable, preliminary qualitative assessment of the Social app’s message board content was conducted to gain an understanding of the types of messages that were being posted by participants . During the study period, 91.3% of social app participants used the message board, with a total of 775 messages posted. Based on published behavioral intervention taxonomies [34, 35], the top five most frequently used thematic categories were: discussion of barriers to improve physical activity (79% of posted messages contained these themes); expressing gratitude, support, commitment, or affirmations to the group (64% of messages); comments on the usability of the app (64% of messages); stating achievements towards a goal (55% of messages); and providing validation and support for others’ accomplishments (48% of messages). These exploratory findings suggest that the message board was being used by the majority of Social app participants in ways that were consistent with regulatory skill-building .
Post-Intervention User Satisfaction with the Three Apps
User satisfaction related to the three customized apps has been reported previously . Briefly, most participants reported that the apps helped remind them (71%) and motivate them (69%) to increase their physical activity levels as well as sit less throughout the day (87% and 74%, respectively) . There were no significant differences found for such satisfaction ratings between apps.
The results of the current study indicate that, among a sample of midlife and older adults who were insufficiently active and reported sitting for prolonged periods throughout the day, a customized smartphone app that specifically targeted social elements and contexts showed significantly greater short-term improvements in both accelerometer-based MVPA and sedentary behavior relative to a non-physical activity control app as well as the other two intervention apps that specifically targeted different motivational frames (affect/nurturance framing and analytic framing). This was the case even though all three apps were developed using extensive formative evaluation of target group interests and preferences, along with user-experience testing and iteration. The potency of the types of social influences incorporated into this app (i.e., social norm comparisons, implicit cues for within-team collaboration and between-team competition, social interaction opportunities between team members) have been noted in other evaluations of mHealth interventions for physical activity as well as other types of health behaviors [36–38]. Future studies would do well to explore the isolated effects of these different aspects of social influence and support, along with aspects of app functionality and usability, on physical activity and sedentary behavior outcomes. Of note, the overall effect size estimates for the differences found were reasonably large, suggesting potentially meaningful differences that merit further study.
While the Social app showed the largest average changes in physical activity and sedentary behavior across the 8-week study period relative to the other apps, the mean overall changes across this time period were reasonably modest and variable from week to week (as reflected in Figs 2–4). These results and those from other behavioral health interventions suggest that there are likely participant subgroups for each intervention app comprising the overall group means that deserve further systematic evaluation . Unfortunately, the reasonably small sample size in the current investigation prevented the types of subgroup analyses that could have shed further light on what has been called the “whiches conundrum” (i.e., which interventions for which individuals under which circumstances) [40, 41]. Given the diversity of human preferences and experiences, such subgroup analyses are an important means of better customizing behavioral mHealth programs to optimize success (i.e., via a “behavioral” precision health paradigm).
Self-reported sitting time has been found to be associated with all-cause mortality in a growing number of (though not all ) observational studies as well as in a range of countries . Daily self-reports of health behaviors collected via the smartphone supported the decreases in sitting represented via the accelerometry-derived information in the Social app arm, and also indicated decreases in reported sitting time among users of the Affect app. As shown in Figs 3 and 4, the overall shapes of the curves for these two different forms of sedentary behavior measurement were reasonably similar for the Affect app. It is possible that the increased variability derived via the accelerometry-based measurement reduced power to detect significant differences in that arm, given that the accelerometry-based measurement captures overall sedentary behavior, while the behavioral goal reflected in the apps was sitting time. It would be worthwhile exploring these issues further with larger sample sizes and across longer time periods.
Among the strengths of the current investigation were its focus on smartphone applications—an increasingly accessible and scalable delivery system for behavioral health interventions, yet one in which many programs have received surprisingly little systematic evaluation to determine initial efficacy; use of a formal iterative design process to optimize the applicability of the three customized apps for the target population; targeting of two health behaviors that, while complementary, have been found to have independent effects on important health outcomes ; measurement of both health behaviors through objective accelerometry, which also allowed the apps to provide accurate “just-in-time” feedback to users ; and an experimental design in which three different motivationally framed apps were compared “head-to-head” to move the field forward in an arguably more efficient way. The targeting of sedentary behavior, in particular, through this mobile communication mode has received relatively little attention to date. Additionally, while population aging and the increasing physical inactivity accompanying it are occurring globally , few studies in this area have specifically targeted aging adults in mobile application development and testing .
In addition to the above strengths, this “first-generation” intervention study contained a number of limitations that require attention in future work. These include the small sample size and the short intervention time frame which, while useful in evaluating initial app use and induction of changes in physical activity and sedentary behavior, do not systematically address the longer-term use and sustainability issues that remain a major challenge in the eHealth and mHealth fields [9, 36, 47]. Whether the currently tested apps would have been able to maintain user interest and improve the target health behaviors across longer time periods deserves further systematic investigation. To begin to gather information about the potential possibilities for sustained use of each of the apps, we conducted formative work in which 12 participants enrolled in the latter stage of the study (four from each custom app arm who were approached in consecutive order just prior to their study end date) were allowed to continue using their assigned app, if they chose, until all smartphones were collected on day 233 post-study . These participants continued to use their apps for a mean of 191 [SD = 33] days post-study (range = 120–233, with sample sizes too small to explore differences between apps) . These data do provide an initial positive “signal” concerning longer-term use that would be worth investigating in a systematic way.
An additional limitation concerns the use of the smartphones’ built-in accelerometer that, while shown in prior research to be a valid and reliable means of capturing physical activity and sedentary behavior, required participants to wear the phone daily. Expanding the capabilities of such apps to reliably interface with the growing number of wearable accelerometers in the marketplace are increasingly important. This point notwithstanding, it should be noted that the smartphones’ built-in accelerometer was successfully validated against what is currently considered to be the “gold standard” in research-grade ambulatory sensing devices, i.e., the Actigraph . In addition, a recent investigation involving a systematic head-to-head comparison of nine wearable devices currently on the market showed that none of them exceled in accurately capturing both daily physical activity and sedentary behavior . A major challenge facing the wearable device industry is to develop suitable monitors that can accurately capture all three major behaviors—activity, sedentary behavior, and sleep—occurring across the 24-hour day . Similarly, the built-in accelerometer, similar to Actigraph, Fitbit, and similar devices, is not as sensitive to measuring bouts of sedentary behavior as other devices (e.g., ActivPAL, LUMOback) . This circumstance limited our ability to accurately ascertain differences in numbers of breaks in daily sedentary behavior. The relatively few studies that have systematically measured the effects of breaks in daily sitting time on relevant proximal health outcomes have produced mixed results , and this area deserves further systematic attention.
In summary, the results from this first-generation experiment support the overall effectiveness of a socially framed app, customized to the preferences and needs of midlife and older adults with minimal smartphone experience, in the early improvement of physical activity and sedentary behavior patterns. In addition, some partial support was obtained for the further exploration of an affectively framed app, particularly for reducing sitting behavior in this population. In light of the small sample size and short study period, further larger-scale evaluation of potential subgroup effects as well as impacts over time for such differently framed apps are warranted.
We gratefully acknowledge the help and assistance of Dr. Susana Barradas in relation to portions of the study, including the qualitative analysis of the message board interactions for the Social app. We also gratefully acknowledge the assistance by Dr. Benjamin Chrisinger, and the efforts of study participants in contributing to this research.
Conceived and designed the experiments: ACK EBH MPB BB TNR. Performed the experiments: ACK EBH MPB LAG SJW JLS JC. Analyzed the data: EBH MPB LAG. Contributed reagents/materials/analysis tools: MPB JC. Wrote the paper: ACK EBH LAG SJW JLS MPB BB TNR JC.
- 1. Maibach E, Steg L, Anable J. Promoting physical activity and reducing climate change: opportunities to replace short car trips with active transportation. Prev Med. 2009;49(4):326–7. Epub 2009/07/14. doi: S0091-7435(09)00332-6 [pii] pmid:19591861.
- 2. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med. 2007;33(4):336–45. Epub 2007/09/25. doi: S0749-3797(07)00363-7 [pii] pmid:17888860.
- 3. Spring B, Gotsis M, Paiva A, Spruijt-Metz D. Healthy apps: mobile devices for continuous monitoring and intervention. IEEE pulse. 2013;4(6):34–40. pmid:24233190.
- 4. Bassett DR Jr., Wyatt HR, Thompson H, Peters JC, Hill JO. Pedometer-measured physical activity and health behaviors in U.S. adults. Med Sci Sports Exerc. 2010;42(10):1819–25. pmid:20305579; PubMed Central PMCID: PMC2927728.
- 5. Pew Research Center. U.S. Smartphone Use in 2015 Pewinternet.org: Pew Research Center; 2015 [updated April 1, 2015].
- 6. Middelweerd A, Mollee JS, van der Wal CN, Brug J, Te Velde SJ. Apps to promote physical activity among adults: a review and content analysis. Int J Behav Nutr Phys Act. 2014;11:97. pmid:25059981; PubMed Central PMCID: PMCPMC4132213.
- 7. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health. 2014;14:646. pmid:24965805; PubMed Central PMCID: PMCPMC4080693.
- 8. King AC, Glanz K, Patrick K. Technologies to measure and modify physical activity and eating environments. Am J Prev Med. 2015;48(5):630–8. pmid:25891063
- 9. Burke LE, Ma J, Azar KM, Bennett GG, Peterson ED, Zheng Y, et al. Current science on consumer use of mobile health for cardiovascular disease prevention: A scientific statement from the American Heart Association. Circulation. 2015. doi: 10.1161/CIR.0000000000000232 pmid:26271892.
- 10. Carlson SA, Fulton JE, Schoenborn CA, Loustalot F. Trend and prevalence estimates based on the 2008 Physical Activity Guidelines for Americans. Am J Prev Med. 2010;39(4):305–13. pmid:20837280.
- 11. Spring B, Schneider K, McFadden HG, Vaughn J, Kozak AT, Smith MT, et al. Multiple behavior changes in diet and activity: A randomized controlled trial using mobile technology. Archives of Internal Medicine. 2012;172(10):1–8.
- 12. Bond DS, Thomas JG, Raynor HA, Moon J, Sieling J, Trautvetter J, et al. B-MOBILE—a smartphone-based intervention to reduce sedentary time in overweight/obese individuals: a within-subjects experimental trial. PLoS One. 2014;9(6):e100821. pmid:24964010; PubMed Central PMCID: PMC4071034.
- 13. Efron B. Forcing a sequential experiment to be balanced. Biometrika. 1971;58:403–17.
- 14. Thomas S, Reading J, Shephard RJ. Revision of the Physical Activity Readiness Questionnaire (PAR-Q). Canadian J Sports Sci. 1992;17:338–45.
- 15. Pivarnik JM, Reeves MJ, Rafferty AP. Seasonal variation in adult leisure-time physical activity. Medicine & Science in Sports & Exercise. 2003;35:1004–8.
- 16. King AC, Hekler EB, Grieco LA, Winter SJ, Sheats JL, Buman MP, et al. Harnessing different motivational frames to promote daily physical activity and reduce sedentary behavior in aging adults. PLoS One. 2013;8(4):e62613. pmid:23638127
- 17. Hekler EB, King AC, Banerjee B, Robinson T, Alonso M, Cirimele J, et al., editors. A case study of BSUED: Behavioral Science-informed User Experience Design. Chi 2011; 2011 May 7–12, 2011; Vancouver, B.C., Canada.
- 18. Physical Activity Guidelines Advisory Committee. Report of the Physical Activity Guidelines Advisory Committee, 2008. Washington, DC: U.S. Department of Health and Human Services, 2008.
- 19. King AC, Goldberg JH, Salmon J, Owen N, Dunstan D, Weber D, et al. Identifying subgroups of U.S. adults at risk for prolonged television viewing to inform program development. Am J Prev Med. 2010;38(1):17–26. Epub 2010/02/02. doi: S0749-3797(09)00666-7 [pii] pmid:20117553.
- 20. Bandura A. Toward a psychology of human agency. Psychol Sci. 2006;1:164–80.
- 21. Umstattd MR, Wilcox S, Saunders R, Watkins K, Dowda M. Self-regulation and physical activity: the relationship in older adults. Am J Health Behav. 2008;32(2):115–24. Epub 2007/12/07. pmid:18052852.
- 22. Cialdini RB, Demaine LJ, Sagarin BJ, Barrett DW, Rhoads K, Winter PL. Managing social norms for persuasive impact. Social Influence. 2006;1(1):3–15.
- 23. Gabriele JM, Walker MS, Gill DL, Harber KD, Fisher EB. Differentiated roles of social encouragement and social constraint on physical activity behavior. Ann Behav Med. 2005;29(3):210–5. pmid:15946115.
- 24. Nahum-Shani I, Hekler EB, Spruijt-Metz D. Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychol. In press,.
- 25. Hekler EB, Buman MP, Grieco L, Rosenberger M, Winter SJ, Haskell WL, et al. Validation of physical activity tracking via Android smartphones compared to ActiGraph accelerometer: Laboratory-based and free-living validation studies. JMIR. 2015;3(2): e36. . PubMed Central PMCID: PMC4414958.
- 26. Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL, et al. The development of a walkability index: Application to the Neighborhood Quality of Life Study. Br J Sports Med. 2009. Epub 2009/05/02. doi: bjsm.2009.058701 [pii] pmid:19406732.
- 27. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40(1):181–8. Epub 2007/12/20. pmid:18091006.
- 28. Hekler EB, Buman MP, Dunton GF, Atienza AA, King AC. Are daily fluctuations in perceived environment associated with walking after controlling for implementation intentions? Psychology & Health. 2012;27(9):1009–20.
- 29. Dunton GF, Atienza AA, Castro CM, King AC. Using ecological momentary assessment to examine antecedents and correlates of physical activity bouts in adults age 50+ years: a pilot study. Ann Behav Med. 2009;38(3):249–55. pmid:20052568.
- 30. King AC, Ahn DK, Oliveira BM, Atienza AA, Castro CM, Gardner CD. Promoting physical activity through hand-held computer technology. Am J Prev Med. 2008;34(6):138–42.
- 31. Metzler MM, Higgins DL, Beeker CG, Freudenberg N, Lantz PM, Senturia KD, et al. Addressing urban health in Detroit, New York City, and Seattle through community-based participatory research partnerships. Am J Public Health. 2003;93(5):803–11. Epub 2003/05/02. pmid:12721148.
- 32. Raudenbush SW, Xiao-Feng L. Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychol Methods. 2001;6(4):387–401. pmid:11778679.
- 33. Barradas S, Riley K, Hekler EB, Winter S, Grieco L, Sheats J, et al. Understanding social support: Qualitative analysis of message board interactions within a smartphone application. 34th Annual Meeting & Scientific Sessions of the Society of Behavioral Medicine; San Francisco, CA2013.
- 34. Michie S, Ashford S, Sniehotta S, Dombrowski S, Bishop A, French D. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy. Psychol Health. 2011;26(11):1479–98. pmid:21678185
- 35. Miller WR, Moyers TB, Ernst D, Amrhein P. Manual for the Motivational Interviewing Skill Code (MISC). The University of New Mexico: Center on Alcoholism, Substance Abuse, and Addictions, 2008.
- 36. Bort-Roig J, Gilson ND, Puig-Ribera A, Contreras RS, Trost SG. Measuring and influencing physical activity with smartphone technology: a systematic review. Sports Med. 2014;44(5):671–86. pmid:24497157.
- 37. Velicer W, Bickmore T, Byron D, Johnson J. Using relational agents in interventions for multiple risk factors. Ann Behav Med. 2011;41(suppl 1):S146.
- 38. Winter SJ, Goldman Rosas L, Sheats JL, Salvo D, Romero PP, Hekler EB, et al. Testing the acceptability of smartphones to promote health behaviors among technology-naive older Latino adults. NHLBI Cardiovascular, Epidemiology, Biostatistics and Prevention Trainee Session, American Heart Association Annual meeting; March 2014; San Francisco, CA: American Heart Association; 2014.
- 39. King AC, Ahn DF, Atienza AA, Kraemer HC. Exploring refinements in targeted behavioral medicine intervention to advance public health. Ann Behav Med. 2008;35(3):251–60. Epub 2008/06/24. pmid:18568380.
- 40. King AC. Behavioral medicine in the 21st century: transforming "the Road Less Traveled" into the "American Way of Life". Ann Behav Med. 2014;47(1):71–8. pmid:24096957; PubMed Central PMCID: PMC3945721.
- 41. Hekler EB, Buman MP, Otten J, Castro CM, Grieco L, Marcus B, et al. Determining who responds better to a computer- vs. human-delivered physical activity intervention: results from the community health advice by telephone (CHAT) trial. Int J Behav Nutr Phys Act. 2013;10:109–18. pmid:24053756; PubMed Central PMCID: PMC3849440.
- 42. Pulsford RM, Stamatakis E, Britton AR, Brunner EJ, Hillsdon M. Associations of sitting behaviours with all-cause mortality over a 16-year follow-up: the Whitehall II study. Int J Epidemiol. 2015;44(6):1909–16. pmid:26454871; PubMed Central PMCID: PMCPMC4690002.
- 43. Rezende LF, Sa TH, Mielke GI, Viscondi JY, Rey-Lopez JP, Garcia LM. All-Cause Mortality Attributable to Sitting Time: Analysis of 54 Countries Worldwide. Am J Prev Med. 2016. pmid:27017420.
- 44. Katzmarzyk PT, Church TS, Craig CL, Bouchard C. Sitting time and mortality from all causes, cardiovascular disease, and cancer. Med Sci Sports Exerc. 2009;41(5):998–1005. Epub 2009/04/07. [pii]. pmid:19346988.
- 45. Lee IM, Shiroma EJ, Lobelo F, Puska P, Blair SN, Katzmarzyk PT, et al. Effect of physical inactivity on major non-communicable diseases worldwide: an analysis of burden of disease and life expectancy. Lancet. 2012;380(9838):219–29. pmid:22818936; PubMed Central PMCID: PMC3645500.
- 46. Redfern J, Thiagalingam A, Jan S, Whittaker R, Hackett ML, Mooney J, et al. Development of a set of mobile phone text messages designed for prevention of recurrent cardiovascular events. European journal of preventive cardiology. 2014;21(4):492–9. pmid:22605787.
- 47. Bickmore T, Schulman D, Yin L. Maintaining engagement in long-term interventions with relational agents. Internat J Applied Artificial Intelligence. 2010;24(6):648–66.
- 48. Rosenberger ME, Buman MP, Haskell WL, McConnell MV, Carstensen LL. Twenty-four hours of sleep, sedentary behavior, and physical activity with nine wearable devices. Med Sci Sports Exerc. 2016;48(3):457–65. pmid:26484953; PubMed Central PMCID: PMCPMC4760880.
- 49. Larsen RN, Kingwell BA, Robinson C, Hammond L, Cerin E, Shaw JE, et al. Breaking up of prolonged sitting over three days sustains, but does not enhance, lowering of postprandial plasma glucose and insulin in overweight and obese adults. Clin Sci (Lond). 2015;129(2):117–27. pmid:25731923.