Anxiety, Depressive Symptoms, Stress, Emotional
Conditions
Brief summary
With the COVID-19 pandemic completely altering the landscape of higher education, students have been experiencing more stress than ever. With Harvard University's plan for students to return to campus for the 2021-2022 academic year, offering an online mental health program such as StriveWeekly could provide students with stress management support as they transition back after 1.5 years of remote learning. This study will use a randomized controlled trial design to test the effectiveness of a waitlist versus StriveWeekly. This study will allow us to test if a program that has previously demonstrated effectiveness with university students in reducing anxiety and depression symptoms will still be effective after the unprecedented amount of stressors during a global pandemic. Primary aim: We aim to evaluate the effectiveness of StriveWeekly in preventing or reducing symptoms of anxiety and depression. The use of a waitlist condition will allow us to experimentally assess if the online intervention is responsible for decreasing / preventing worsened anxiety, depression, and stress symptoms over time. Given the previously established effectiveness of StriveWeekly as an indicated prevention program, we expect students in the intervention condition to experience significantly better symptoms compared to the waitlist from baseline to posttest. Alternatively, if the transition back from remote learning and/or the broad pandemic context interferes with the acceptability or effectiveness of StriveWeekly, then we might expect to see little to no significant differences between the online intervention condition and waitlist condition from baseline to posttest. Secondary aims include: (a) testing moderators of intervention effectiveness and (b) evaluating the intervention in terms of acceptability (e.g., feedback on program name; demographically representativeness of student user sample; satisfactory adherence and satisfaction rates). Exploratory moderation analyses across groups will help determine whether or not the intervention condition produces unique or additive effects for students with certain characteristics over and above changes demonstrated by similar students in the waitlist condition. Acceptability analyses will allow for more nuanced evaluation of StriveWeekly's effectiveness as a program, beyond its ability to facilitate symptom reduction.
Detailed description
Recruitment. Recruitment materials will be distributed via a mass email to all enrolled students, announcements over house emails lists (e.g., academic departments), and social media announcements. Pre-trial needs assessment and pilot. Prior to the full RCT, we will conduct a campus-wide needs assessment survey to gather information about student needs and preferences related to mental health programming. Student responses will inform the specifics of StriveWeekly implementation during the academic year (e.g., preferred timing of programming, appropriateness of content across a diverse student population). After the needs assessment, we will invite a small group of students to participate in a small pilot of the revised StriveWeekly platform. Students who participate in the pilot will be invited to provide their program feedback via online surveys. Students who participate in the pilot data collection will still be eligible for the full RCT study, but may be excluded from the final data analysis sample. Pragmatic trial design. For a trial design using self-guided online intervention, it is important that the design mimics intended intervention use (Fleming et al., 2018). As examples, overly stringent inclusion criteria limit generalizability, or face-to-face assessments may provide added benefit beyond the intervention itself (Fleming et al., 2018). Therefore, as much as possible our methods simulate how a real-world campus might offer online services as usual. First, we are employing cluster randomization, for reasons elaborated below. Second, participants in either condition will be allowed to access other on- or off-campus mental health services and resources; in our statistical analyses we will control for service use rather than excluding such students. Third, all data collection and participant communications will be electronic rather than in-person to: (a) include all students remote or on-campus, (b) avoid unintentionally bolstering motivation (e.g., inducing social desirability to please researchers), and (c) avoid adding barriers (e.g., time demands, concerns about privacy). Finally, survey compensation amount will be modest enough to increase participant response rates without artificially inflating adherence rates or self-reported improvement due to financial incentive. Random assignment. Cluster randomization will be used to assign students according to their residential affiliation to the immediate intervention condition or the waitlist condition (i.e., delayed access). Although cluster randomization can introduce statistical confounds for analyzing intervention outcomes at the individual participant level, they can be preferred: (a) to avoid intervention contamination effects (e.g., if participants in both conditions can regularly interact and thus might exchange health-related knowledge), and (b) if it allows the intervention to be delivered as it would be in real practice (Cook, Delong, Murray, Vollmer, & Heagerty, 2016). Moreover, the benefits of cluster randomization by residential house/dorm affiliation for this trial are crucial for the social aspects of the StriveWeekly program. For example, students will know who else is concurrently participating in the program (e.g., any of their friends in X, Y, Z house), allowing for peer-to-peer engagement. Also, this will allow for easier coordination of any optional complementary programming by residential staff at each house/dorm. A randomizer was already used to assign half the freshmen and upperclassman residential buildings to each condition. Data collection. Prior to beginning any research procedures, students will provide their informed consent online via Qualtrics. Participants will be required to login to Qualtrics via HarvardKey Shibboleth, which will be configured to only allow currently active Harvard accounts. Once consent has been obtained for an individual student, they will be directed to an online survey for the study baseline assessment. The baseline survey will be open for two weeks. Students assigned to the intervention group will receive an access code in the email, allowing them to access the online platform and set-up their account. The intervention group will then be active for seven weeks, after which the posttest survey will open to the intervention group and waitlist group for one-two weeks. Thereafter, students who were assigned to the waitlist group will gain access to the online intervention for seven weeks. After this delayed access group completes the intervention, there will be a follow-up survey for all participants from both conditions. See timeline table below.
Interventions
The intervention (app.striveweekly.com) delivers content via independent modules. Principles covered in content modules: Psychoeducation; Self-monitoring; Values-based goal-setting; Behavioral activation; Cognitive restructuring; Sleep hygiene; Time management; Interpersonal avoidance exposures; Physical exercise; Mindfulness; Relaxation strategies; Maintenance planning. Modules get released week-by-week, and participants are self-guided through content. To facilitate skills practice, every module is accompanied by: a weekly intro email and reminder emails; an extras section for tips/suggestions; and a weekly prize drawing. The Dashboard section of the intervention displays user progress, including self-rating graphs and a history log of skills practice. The Campus section of this dashboard provided: campus-specific announcements; referrals to relevant campus wellness resources; and an anonymous livestream of all campus users' activity.
Sponsors
Study design
Eligibility
Inclusion criteria
* enrolled as a student at Harvard College (academic year 2021-2022)
Exclusion criteria
* invalid data reporting (e.g., straight-lined responses to surveys)
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Depression Anxiety and Stress Scale (DASS-21) | Baseline to Posttest (~8 weeks) | Change in self-reported symptoms of depression, anxiety, and stress (completed via online surveys). Items are rated on a scale of 0-3, with higher scores indicating worse symptoms. Subscale total scores range from 0-21, and DASS-21 total scores range from 0-63. |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Perceived Stress Scale | Baseline to Posttest (~8 weeks) | 10-item self-report about subjective experiences of stress (completed via online surveys). Items are rated on a scale of 0-4 (four items are reverse scored), with higher scores indicating worse stress. Total scores range from 0-40. |
| The Warwick-Edinburgh Mental Wellbeing Scales | Baseline to Posttest (~8 weeks) | A standardized 7-item scale designed to measure mental wellbeing in the general population (i.e., not necessarily clinical) and evaluate change in response to programs that aim to improve mental wellbeing. Completed via online surveys. Items are rated on a 5-point likert scale, with higher scores indicating a positive mental wellbeing and functioning. Total scores range from 7-35. |
Countries
United States
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Immediate Intervention Condition Participants in this condition will receive 7-8 weeks of online intervention modules. Specific modules will be selected based on a campus-wide needs assessment conducted in May 2021.
StriveWeekly: The intervention (app.striveweekly.com) delivers content via independent modules. Principles covered in content modules: Psychoeducation; Self-monitoring; Values-based goal-setting; Behavioral activation; Cognitive restructuring; Sleep hygiene; Time management; Interpersonal avoidance exposures; Physical exercise; Mindfulness; Relaxation strategies; Maintenance planning. Modules get released week-by-week, and participants are self-guided through content. To facilitate skills practice, every module is accompanied by: a weekly intro email and reminder emails; an extras section for tips/suggestions; and a weekly prize drawing. The Dashboard section of the intervention displays user progress, including self-rating graphs and a history log of skills practice. The Campus section of this dashboard provided: campus-specific announcements; referrals to relevant campus wellness resources; and an anonymous livestream of all campus users' activity. | 244 |
| Waitlist Condition Participants in this condition will wait to receive StriveWeekly until after the Immediate Intervention condition is complete and participants from both conditions have completed the posttest survey. | 275 |
| Total | 519 |
Baseline characteristics
| Characteristic | Waitlist Condition | Total | Immediate Intervention Condition |
|---|---|---|---|
| Age, Customized 16+ | 275 Participants | 519 Participants | 244 Participants |
| LGBTQ+ No | 184 Participants | 348 Participants | 164 Participants |
| LGBTQ+ Prefer Not to Say | 12 Participants | 20 Participants | 8 Participants |
| LGBTQ+ Questioning or Unsure | 22 Participants | 36 Participants | 14 Participants |
| LGBTQ+ Yes | 57 Participants | 115 Participants | 58 Participants |
| Race/Ethnicity, Customized Latinx No | 227 Participants | 418 Participants | 191 Participants |
| Race/Ethnicity, Customized Latinx Prefer not to say | 6 Participants | 11 Participants | 5 Participants |
| Race/Ethnicity, Customized Latinx Yes | 42 Participants | 90 Participants | 48 Participants |
| Race/Ethnicity, Customized Race/Ethnicity American Indian or Alaska Native | 4 Participants | 6 Participants | 2 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Asian or Asian American | 94 Participants | 158 Participants | 64 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Black or African American | 22 Participants | 42 Participants | 20 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Middle Eastern | 9 Participants | 16 Participants | 7 Participants |
| Race/Ethnicity, Customized Race/Ethnicity multiracial | 18 Participants | 37 Participants | 19 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Native Hawaiian or other Pacific Islander | 1 Participants | 3 Participants | 2 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Other | 7 Participants | 16 Participants | 9 Participants |
| Race/Ethnicity, Customized Race/Ethnicity Prefer Not to Say | 11 Participants | 19 Participants | 8 Participants |
| Race/Ethnicity, Customized Race/Ethnicity White | 109 Participants | 222 Participants | 113 Participants |
| Region of Enrollment United States | 275 participants | 519 participants | 244 participants |
| Sex/Gender, Customized Female, Woman, Feminine, Trans Woman | 175 Participants | 332 Participants | 157 Participants |
| Sex/Gender, Customized Gender-non-binary, -queer, -non-conforming, -fluid | 8 Participants | 13 Participants | 5 Participants |
| Sex/Gender, Customized Male, Man, Masculine, Trans Man | 87 Participants | 166 Participants | 79 Participants |
| Sex/Gender, Customized Prefer Not to Say | 5 Participants | 8 Participants | 3 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | 0 / 244 | 0 / 275 |
| other Total, other adverse events | 0 / 0 | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 | 0 / 0 |
Outcome results
Depression Anxiety and Stress Scale (DASS-21)
Change in self-reported symptoms of depression, anxiety, and stress (completed via online surveys). Items are rated on a scale of 0-3, with higher scores indicating worse symptoms. Subscale total scores range from 0-21, and DASS-21 total scores range from 0-63.
Time frame: Baseline to Posttest (~8 weeks)
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Immediate Intervention Condition | Depression Anxiety and Stress Scale (DASS-21) | baseline | 16.9 score on a scale | Standard Deviation 10.14 |
| Immediate Intervention Condition | Depression Anxiety and Stress Scale (DASS-21) | posttest | 16.5 score on a scale | Standard Deviation 9.83 |
| Waitlist Condition | Depression Anxiety and Stress Scale (DASS-21) | baseline | 16.3 score on a scale | Standard Deviation 10.13 |
| Waitlist Condition | Depression Anxiety and Stress Scale (DASS-21) | posttest | 18.3 score on a scale | Standard Deviation 10.65 |
Perceived Stress Scale
10-item self-report about subjective experiences of stress (completed via online surveys). Items are rated on a scale of 0-4 (four items are reverse scored), with higher scores indicating worse stress. Total scores range from 0-40.
Time frame: Baseline to Posttest (~8 weeks)
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Immediate Intervention Condition | Perceived Stress Scale | Posttest | 18.7 score on a scale | Standard Deviation 5.99 |
| Immediate Intervention Condition | Perceived Stress Scale | Baseline | 19.1 score on a scale | Standard Deviation 6.5 |
| Waitlist Condition | Perceived Stress Scale | Posttest | 18.8 score on a scale | Standard Deviation 6.46 |
| Waitlist Condition | Perceived Stress Scale | Baseline | 18.5 score on a scale | Standard Deviation 6.5 |
The Warwick-Edinburgh Mental Wellbeing Scales
A standardized 7-item scale designed to measure mental wellbeing in the general population (i.e., not necessarily clinical) and evaluate change in response to programs that aim to improve mental wellbeing. Completed via online surveys. Items are rated on a 5-point likert scale, with higher scores indicating a positive mental wellbeing and functioning. Total scores range from 7-35.
Time frame: Baseline to Posttest (~8 weeks)
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Immediate Intervention Condition | The Warwick-Edinburgh Mental Wellbeing Scales | Baseline | 23.1 score on a scale | Standard Deviation 4.75 |
| Immediate Intervention Condition | The Warwick-Edinburgh Mental Wellbeing Scales | Posttest | 22.8 score on a scale | Standard Deviation 4.49 |
| Waitlist Condition | The Warwick-Edinburgh Mental Wellbeing Scales | Baseline | 23.3 score on a scale | Standard Deviation 4.78 |
| Waitlist Condition | The Warwick-Edinburgh Mental Wellbeing Scales | Posttest | 22.1 score on a scale | Standard Deviation 4.8 |