Skip to content

Implementing and Evaluating Computer-Based Interventions for Mental Health: Testing an Implementation Strategy for VA Outpatient Care

Implementing and Evaluating Computer-Based Interventions for Mental Health (CDA 14-420)

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT03151083
Enrollment
77
Registered
2017-05-12
Start date
2017-05-30
Completion date
2021-06-01
Last updated
2023-07-21

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Insomnia

Keywords

Health Technology, Internet-Based Psychotherapy, self-care, Primary Care, Mental Health

Brief summary

Internet-based self-help programs are personalized, self-guided interventions delivered over a computer, mobile device, or other Internet platform and focused on improving knowledge, awareness, or behavior change for a mental or physical health problem. Through previous and on-going projects at VACT, the investigators are developing a general strategy for implementing Internet-based Self-help programs in VA primary care, specifically among Patient Aligned Care Teams (PACT) and Primary Care Mental Health Integration (PCMHI) providers. An implementation strategy is defined as a systematic intervention to integrate evidence-based health innovations into usual care. The strategy the investigators propose to test consists of four core components: (1) a clinical intermediary for patient support, (2) provider/staff facilitation and education, (3) patient education, and (4) stepped-care for those requiring additional treatment. In the proposed study, the investigators will compare this strategy to a low intensity (control) strategy with respect to the implementation related outcomes of patent engagement, provider adoption through referral to the program, and patient completion, over a six-month active implementation period. The investigators will target the very common clinical problem of insomnia and use the SHUTiTM program, a 6-week self-guided program utilizing standard cognitive-behavioral therapy (CBT) techniques for the treatment of chronic insomnia. The program has been shown to improve insomnia severity and other sleep related outcomes in a number of controlled trials. The clinical effectiveness of SHUTiTM will be evaluated using clinical insomnia outcomes obtained on all patients enrolled over the 6-month active implementation periods. The purpose this study is to evaluate the preliminary (1) effectiveness of an implementation strategy for Internet-based Self-help Interventions and (2) clinical outcomes of a specific Internet-based self-help program for insomnia, SHUTiTM, in VA Connecticut outpatient primary care. The primary hypothesis is that the experimental implementation strategy the investigators are developing, relative to a control strategy, will result in higher rates of program engagement by patients, greater provider adoption through referral to the program, greater program completion, and improved patient insomnia outcomes.

Detailed description

Objective: The purpose this study is to evaluate the preliminary (1) effectiveness of an implementation strategy for Internet-based Self-help Interventions and (2) clinical outcomes of a specific Internet-based self-help program for insomnia, SHUTiTM, in VA Connecticut outpatient primary care. The primary hypothesis is that the experimental implementation strategy the investigators are developing, relative to a control strategy, will result in higher rates of program engagement by patients, greater provider adoption through referral to the program, greater program completion, and improved patient insomnia outcomes. Research Design: The investigators will employ a hybrid implementation-effectiveness study design through which the investigators will primarily test the effectiveness of the implementation strategy, while secondarily evaluating the clinical effectiveness of the SHUTiTM program. The investigators will use a quasi-experimental pre-/post-cohort design whereby SHUTiTM will initially be implemented using a low-intensity (control) strategy, followed by implementation using the experimental strategy. The SHUTiTM program's association with clinical response will be evaluated in an uncontrolled pre-/post-format. Methodology: Internet-based self-help programs are personalized, self-guided interventions delivered over a computer, mobile device, or other Internet platform and focused on improving knowledge, awareness, or behavior change for a mental or physical health problem. Through previous and on-going projects at VACT, the investigators are developing a general strategy for implementing Internet-based Self-help programs in VA primary care, specifically among Patient Aligned Care Teams (PACT) and Primary Care Mental Health Integration (PCMHI) providers. An implementation strategy is defined as a systematic intervention to integrate evidence-based health innovations into usual care. The strategy the investigators propose to test consists of four core components: (1) a clinical intermediary for patient support, (2) provider/staff facilitation and education, (3) patient education, and (4) stepped-care for those requiring additional treatment. The investigators' currently approved protocol (#0002) involves interviewing VA providers, administrators, and staff in order to expand and modify the components of this strategy. In the proposed study, the investigators will compare this strategy to a low intensity (control) strategy with respect to the implementation related outcomes of patent engagement, provider adoption through referral to the program, and patient completion, over a six-month active implementation period. Use of the program will continue and implementation outcomes will be gathered over an additional one-year sustainment phase. The investigators will target the very common clinical problem of insomnia and use the SHUTiTM program, a 6-week self-guided program utilizing standard cognitive-behavioral therapy (CBT) techniques for the treatment of chronic insomnia. The program has been shown to improve insomnia severity and other sleep related outcomes in a number of controlled trials. The clinical effectiveness of SHUTiTM will be evaluated using clinical insomnia outcomes obtained on all patients enrolled over the 6-month active implementation periods. Impact/Significance: The development and testing of evidence-based implementation strategies for Internet-based self-help programs in VA outpatient care is essential given that (1) there is an increasing number of Internet-based self-help programs providing evidence-based treatment for a variety of mental and behavioral health disorders, (2) VA has committed to improving access to care, especially evidence-based and self-care resources, and (3) there is a Congressional mandate that VA implement Internet-based care. This will be first controlled trial of an implementation strategy for Internet-based self-help programs in a VA primary care (PACT/PCMHI) context.

Interventions

BEHAVIORALInternet-based Self-help Insomnia Intervention

The investigators will use the program, SHUTiTM for the treatment of insomnia. The intervention is a CBT-based 6-week, self-administered course accessed via the Internet on mobile, desk-top, and other devices. The program is split into six modules, completed weekly, which include instruction on psycho-education, stimulus control, relaxation training, sleep restriction, medication tapering, and addressing cognitive distortions. The content is delivered via text, video vignettes, case histories, interactive learning tools, interactive skills assessments, symptom assessments, and a sleep log. Homework is assigned after each module. Providers and support staff can follow treatment progress via access to a dashboard of patient information collected by the program. Such information includes progress through the modules, date of last engagement, symptom assessment outcomes, and sleep log data abstracted into commonly used sleep indices such as sleep onset latency and sleep efficiency.

Sponsors

VA Connecticut Healthcare System
CollaboratorFED
US Department of Veterans Affairs
CollaboratorFED
VA Office of Research and Development
Lead SponsorFED

Study design

Allocation
NA
Intervention model
SEQUENTIAL
Primary purpose
HEALTH_SERVICES_RESEARCH
Masking
NONE

Intervention model description

The investigators will employ a hybrid type 3 implementation-effectiveness study design through which the investigator will primarily test the effectiveness of the experimental implementation strategy the investigators are developing and secondarily evaluate the clinical effectiveness of the internet-based self-help program for insomnia. The investigators will use a quasi-experimental pre-/post-cohort design whereby the program will initially be implemented using an enhanced usual care (control) strategy, followed by implementation using the experimental implementation strategy. The program's association with clinical response will be evaluated in an uncontrolled pre-/post-format.

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes

Inclusion criteria

* Patients Receiving care from a VA Connecticut West Haven PACT/PCMHI Provider * Diagnosed with insomnia lasting 3 months by the PACT provider, as evidenced by referral by the provider for access to the SHUTiTM program * Able to provide valid informed consent, as evidenced by answering questions indicating their understanding of the content of the Informed Consent Document * Willing to participate in an internet-based self-help program for insomnia after the access to and requirements of the program are explained to them * English-speaking (The SHUTiTM program is only available in English)

Exclusion criteria

* Evidence of acute psychiatric decompensation requiring inpatient admission or emergency department services within the last month, including suicidality, homicidally, mania, or psychotic decompensation. * Evidence of a conservator of person either verbally reported by the patient or upon inspection of the medical record.

Design outcomes

Primary

MeasureTime frameDescription
Program Engagement: Completion of the First Program Module3 weeks following subject enrollmentThe proportion of participants engaging in the program (completing at least one module) among the unique Veterans treated in VA Connecticut primary care over the respective intervention periods.

Secondary

MeasureTime frameDescription
Program Completion10 Weeks following subject enrollmentCompletion of all six modules of the program. The proportion of individuals completing all six modules among all individuals enrolled.
Provider AdoptionOver each 8-month active implementation PhaseThe number of providers who made a referral to the SHUTi Program among the number of providers with the ability to make a referral.
Insomnia Severity IndexAt enrollment and 10 weeks following enrollment.The ISI will be the primary clinical outcome and is a self-report seven-item measure that targets the subjective symptoms and functional consequences of insomnia. The outcome reported is the change in total ISI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The Insomnia Severity Index to total is the sum on 7 questions scored 0 to 4 (minimum=0, Maximum=28). Higher scores indicate more severe insomnia.

Other

MeasureTime frameDescription
Beck Depression InventoryAt enrollment and 10 weeks following enrollmentThe BDI is a secondary clinical outcome and is a self-report measure of depression severity. The outcome reported is the change in total BDI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The BDI is a 21-item, self-report rating inventory of depression symptoms. Items receive a rating of zero to three and are summed linearly to create a score which ranges from 0 to 63. Higher score indicate more intense symptoms of depression.
Sedative-Hypnotic Medication UseAt enrollment and 10 weeks following enrollmentThe use of sedative-hypnotics will be measured by self-report of the type and dose of specific medications used in the last week. The outcome reported is the change in the reported total weekly number of sedative-hypnotic doses reported from baseline compared to follow-up.

Countries

United States

Participant flow

Recruitment details

Recruitment to digital CBTi occurred through primary care providers who made a referrals to the intervention. Referrals were addressed by the digital intervention coach (or research team member, depending on the cohort), who provided and initial education session about digital CBTi. Participants could then enroll in the trial if they wished. Over the entire course of the trial, 153 individuals were referred and 77 chose to enroll.

Participants by arm

ArmCount
Phase 1: Implementation As Usual (Implementation Through Research Team)
SHUTi digital CBTi Program was implemented in VACT primary care using implementation activities executed by the research team (June 2017 - January 2018). Implementation activities included: Provider Education by the research team, Provider Reminders (information pamphlets in treatment rooms), Patient Advertising/Information (information pamphlets in treatment rooms), Single Referral Pathway Not Integrated Primary Care Workflow (Primary care provider contact research team for patient referral over email).
27
Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)
SHUTi digital CBTi Program implemented in VACT primary care using implementation activities executed by primary care teams (June 2018 to January 2018). Implementation activities included: Provider Education by the research team, Provider Reminders (information pamphlets in treatment rooms), Patient Advertising/Information (information pamphlets in treatment rooms), patient education and motivational support supplied through a digital CBTi coach, the digital CBTi coach was a primary care nurse trained by the research team, technical support and oversight of the digital CBTi coach by the research team. Single Referral Pathway Not Integrated Primary Care Workflow (Primary care provider contact research team for patient referral over email).
20
Phase 3: Primary Care Mental Health Collaborative Care Implementation
SHUTi digital CBTi Program implemented in VACT primary care using implementation activities executed by primary care teams (April 2019 to November 2019). Implementation activities included: Provider Education by the research team, Provider Reminders (information pamphlets in treatment rooms), Patient Advertising/Information (information pamphlets in treatment rooms), patient education and motivational support supplied through a digital CBTi coach, the digital CBTi coach was a peer support specialist working on the primary care mental health collaborative care team, the digital CBTi coach was trained by the research team, technical support and oversight of the digital CBTi coach by the research team. Additional members primary care mental health collaborative care team were educated by the research team to provide education to patients about digital CBTi. Multiple referral pathways to digital CBTi: consults to the digital CBTi Coach, warm handoffs to primary care mental health collaborative care team. Digital CBTi coach consults integrated Primary Care Workflow (Primary care provider placed consult in the medical record).
30
Total77

Baseline characteristics

CharacteristicPhase 1: Implementation As Usual (Implementation Through Research Team)TotalPhase 3: Primary Care Mental Health Collaborative Care ImplementationPhase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)
Age, Customized
<=55
8 Participants22 Participants7 Participants7 Participants
Age, Customized
>55,<=65
9 Participants22 Participants9 Participants4 Participants
Age, Customized
>65
10 Participants33 Participants14 Participants9 Participants
Any Mental Health Diagnosis
Any Mental Health Diagnosis
12 Participants35 Participants15 Participants8 Participants
Any Mental Health Diagnosis
No Mental Health Diagnosis
15 Participants42 Participants15 Participants12 Participants
Any Sedative-Hypnotic Prescription
Any Sedative-Hypnotic Prescription
6 Participants22 Participants12 Participants4 Participants
Any Sedative-Hypnotic Prescription
No Sedative-Hypnotic Prescription
21 Participants55 Participants18 Participants16 Participants
Number of Medical Diagnoses
>=10
13 Participants39 Participants16 Participants10 Participants
Number of Medical Diagnoses
<5
4 Participants17 Participants7 Participants6 Participants
Number of Medical Diagnoses
>=5, <10
10 Participants21 Participants7 Participants4 Participants
Race/Ethnicity, Customized
African American/Non-Hispanic
2 Participants9 Participants3 Participants4 Participants
Race/Ethnicity, Customized
Hispanic
3 Participants7 Participants2 Participants2 Participants
Race/Ethnicity, Customized
Other
1 Participants3 Participants1 Participants1 Participants
Race/Ethnicity, Customized
White/non-Hispanic
21 Participants58 Participants24 Participants13 Participants
Sex: Female, Male
Female
4 Participants11 Participants6 Participants1 Participants
Sex: Female, Male
Male
23 Participants66 Participants24 Participants19 Participants

Adverse events

Event typeEG000
affected / at risk
deaths
Total, all-cause mortality
0 / 77
other
Total, other adverse events
0 / 77
serious
Total, serious adverse events
0 / 77

Outcome results

Primary

Program Engagement: Completion of the First Program Module

The proportion of participants engaging in the program (completing at least one module) among the unique Veterans treated in VA Connecticut primary care over the respective intervention periods.

Time frame: 3 weeks following subject enrollment

Population: Unique Veterans treated in VA Connecticut primary care over the respective intervention periods.

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Phase 1: Implementation As Usual (Implementation Through Research Team)Program Engagement: Completion of the First Program Module17 Participants
Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Program Engagement: Completion of the First Program Module12 Participants
Phase 3: Primary Care Mental Health Collaborative Care ImplementationProgram Engagement: Completion of the First Program Module16 Participants
Secondary

Insomnia Severity Index

The ISI will be the primary clinical outcome and is a self-report seven-item measure that targets the subjective symptoms and functional consequences of insomnia. The outcome reported is the change in total ISI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The Insomnia Severity Index to total is the sum on 7 questions scored 0 to 4 (minimum=0, Maximum=28). Higher scores indicate more severe insomnia.

Time frame: At enrollment and 10 weeks following enrollment.

Population: All enrollees in the trial.

ArmMeasureValue (MEAN)Dispersion
Phase 1: Implementation As Usual (Implementation Through Research Team)Insomnia Severity Index4.3 score on a scaleStandard Deviation 5.6
Secondary

Program Completion

Completion of all six modules of the program. The proportion of individuals completing all six modules among all individuals enrolled.

Time frame: 10 Weeks following subject enrollment

Population: Individuals enrolled in the trial over the respective active implementation period.

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Phase 1: Implementation As Usual (Implementation Through Research Team)Program Completion10 Participants
Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Program Completion7 Participants
Phase 3: Primary Care Mental Health Collaborative Care ImplementationProgram Completion7 Participants
Secondary

Provider Adoption

The number of providers who made a referral to the SHUTi Program among the number of providers with the ability to make a referral.

Time frame: Over each 8-month active implementation Phase

Population: Denominator of providers with the potential to make referrals over each period is estimated due to frequent provider transitions, changes to the referral process, and training programs within primary care.

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Phase 1: Implementation As Usual (Implementation Through Research Team)Provider Adoption31 Participants
Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Provider Adoption26 Participants
Phase 3: Primary Care Mental Health Collaborative Care ImplementationProvider Adoption34 Participants
Other Pre-specified

Beck Depression Inventory

The BDI is a secondary clinical outcome and is a self-report measure of depression severity. The outcome reported is the change in total BDI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The BDI is a 21-item, self-report rating inventory of depression symptoms. Items receive a rating of zero to three and are summed linearly to create a score which ranges from 0 to 63. Higher score indicate more intense symptoms of depression.

Time frame: At enrollment and 10 weeks following enrollment

ArmMeasureValue (MEAN)Dispersion
Phase 1: Implementation As Usual (Implementation Through Research Team)Beck Depression Inventory3.1 score on a scaleStandard Deviation 5.5
Other Pre-specified

Sedative-Hypnotic Medication Use

The use of sedative-hypnotics will be measured by self-report of the type and dose of specific medications used in the last week. The outcome reported is the change in the reported total weekly number of sedative-hypnotic doses reported from baseline compared to follow-up.

Time frame: At enrollment and 10 weeks following enrollment

ArmMeasureValue (MEAN)Dispersion
Phase 1: Implementation As Usual (Implementation Through Research Team)Sedative-Hypnotic Medication Use2.2 weekly sedative-hypnotic dosesStandard Deviation 6.6

Source: ClinicalTrials.gov · Data processed: Feb 16, 2026