A RE-AIM evaluation in early adopters to iteratively improve the online BeUpstanding™ program supporting workers to sit less and move more

Oct 22, 2021 | Healy

BACKGROUND: The web-based BeUpstanding program supports desk workers to sit less and move more. Successfully translated from a research-delivered intervention, BeUpstanding has gone through iterative development and evaluation phases in preparation for wide-scale implementation. In the third planned “early-adopters” phase (01/09/2017-11/06/2019), the program was made freely-available online. An integrated delivery and evaluation platform was also developed to enable workplace champions to run and evaluate the intervention within their work team independent of researcher support. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, this study reports on the extent to which the program and processes were “fit-for-purpose” for a national implementation trial across the indicators of uptake (reach and adoption), implementation and engagement, and effectiveness for behaviour change.

METHODS: Data were collected via the online surveys embedded in the program and through program access analytics. Descriptive data (with linearized variance for the clustered staff-level data) and results from mixed models (repeated data and clustering for pre-post changes) are reported.

RESULTS: Despite purposeful limited promotion, uptake was good, with 182 Australian users initially registering (208 total) and 135 (from 113 organisations) then completing the sign-up process. Recruitment reached users across Australia and in 16 of 19 Australian industries. Implementation was inconsistent and limited, with signed-up users completing 0 to 14 of the program’s 14 steps and only 7 (5.2%) completing all seven core steps. Many champions (n = 69, 51.1%) had low engagement (1 day toolkit usage) and few (n = 30, 22%) were highly engaged (> 1 day toolkit usage and surveyed staff). Although only 18 users (7 organisations) performed the pre- and post-program staff evaluations (337 and 167 staff, respectively), pre-post changes showed the program effectively reduced workplace sitting by - 9.0% (95% CI -12.0, - 5.9%).

DISCUSSION: The program had uptake across industries and across Australia, but implementation and engagement varied widely. Few workplaces completed the evaluation components. In those that did, the program was effective for the primary outcome (workplace sitting). Conducting a planned early adopters phase and a comprehensive evaluation according to RE-AIM helped highlight necessary program improvements to make it more suitable for wide-scale implementation and evaluation.

TRIAL REGISTRATION: Australian and New Zealand Clinic Trials Registry ACTRN12617000682347 . Date registered: 12/05/2017.

PubMed Abstract

Healy, G. N., Winkler, E. A. H., & Goode, A. D. (2021). A RE-AIM evaluation in early adopters to iteratively improve the online BeUpstanding™ program supporting workers to sit less and move more. BMC Public Health, 21(1), 1916. doi:10.1186/s12889-021-11993-1