Coordination, Administrative
Conditions
Keywords
Coordination, Administrative, Coaching, Primary Care, Quality Improvement
Brief summary
The Coordination Toolkit and Coaching (CTAC) project aims to disseminate strategies for coordination of care for high-risk Veterans via an online toolkit, while evaluating the benefits of adding a distance-coaching strategy to assist sites with deploying the toolkit's tools. The project's focus is on care coordination across outpatient settings. This multi-site project provides: 1) An online toolkit to support better care coordination for vulnerable patients visiting primary care, 2) Random assignment of participating clinics to either a toolkit or a combined toolkit/distance coaching strategy, and 3) A quality improvement approach with plan-do-study-act cycles of improvement, designed to support clinics in a locally initiated effort. The project is recruiting clinics with the goal of improving Veteran experience of care (as measured by a survey called the Hassles Scale).
Detailed description
Background: High-risk Veterans are defined as individuals who are at increased risk for poor clinical outcomes and higher use of unplanned health services relative to their non-high-risk counterparts. These Veterans typically have multiple chronic health problems and are vulnerable to gaps in care due to impaired physical, psychological, and/or social functioning. Despite efforts to integrate care through VA's Patient Aligned Care Teams (PACT) in primary care, deficits in care coordination persist. In VA, most high-risk Veterans are managed in primary care rather than a specialty service. PACT was expected to improve care coordination by creating the care manager role for the PACT teamlet nurse. However, there have been significant challenges in implementing the care manager role as intended. Many of the care coordination challenges involve the medical neighborhood outside of PACT. To improve the quality of care coordination in outpatient care and also develop better methods for spreading innovations, the Coordination Toolkit and Coaching project was funded by VA's Quality Enhancement Research Initiative (QUERI). This project develops and pilots an online toolkit and distance-based coaching process, and then compares the effectiveness of the toolkit alone to the combination of the toolkit plus distance coaching for improving VA patients' experience of care. Both toolkit and combined toolkit/coaching strategies have been used individually in VA quality improvement initiatives, and each strategy has been compared individually to other alternatives. However, to the investigators' knowledge, these strategies have not formally been compared head-to-head. Additional Outcome Information: The project's primary outcome is a measure of patient experience, the Health System Hassles Scale. This 16-item scale asks patients questions such as whether their medications are being refilled on time, whether they were given information about why they were referred to a specialist, whether there has been poor communication between different doctors or clinics, or whether there have been disagreements between doctors about the patient's diagnosis or the best treatment for the patient. Sample Size Calculations: The sample size calculation for this study is based on a simple presumption of a difference-in-differences analysis (across the two time points) for the comparison of the two implementation strategies. The primary outcome is the Health System Hassles Scale. The investigators assume 12 clinics in the study (6 per study group), which will be viewed as clusters in order to evaluate the sample size. Since the number of patients per cluster may vary, the investigators assume a coefficient of variation of cluster sizes of about 0.9. With an effect size of 0.3 standard deviations (which is considered to be a small to medium effect size in Cohen's terminology) for the difference-in-difference analysis and an intra-cluster correlation of 0.023 (based on preliminary evaluation of prior data), then with 80% power and two-sided 5% significance level, 149 patients per clinic are needed for a total of 1788 patients (evenly divided between the two groups). Statistical Analysis Plan: The primary endpoint of the Health System Hassles Scale will be compared between the two implementation groups (toolkit and combined toolkit/coaching) using a difference-in-differences (between the two time points: baseline and 12 months) analysis adjusted for the clustering by clinic. This analysis will be performed initially with a general linear model using the between time point difference as the dependent variable and study group as the independent variable, with clinic as the clustering variable (and, thus, using an appropriately chosen variance-covariance matrix). A further adjustment model may incorporate appropriate covariates including patient-level factors, such as gender, age, and use of non-VA care.
Interventions
The online toolkit provides a set of tools that clinics can use to improve their care coordination processes.
The distance-based coach supports included clinics in carrying out a quality improvement project focused on care coordination, either using the online toolkit or other resources determined by the clinic.
Sponsors
Study design
Eligibility
Inclusion criteria
* VA primary care clinic * Clinic's facility director must sign a letter of endorsement in support of patients being surveyed about their experience of care * Identify a clinic champion to serve as point of contact * Clinic champion has adequate release time to take on a new quality improvement project
Exclusion criteria
* Insufficient number of patients to obtain adequate sample size for primary outcome measure.
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Health Care System Hassles Scale | Baseline and 12 months' follow-up | The primary outcome was the 16-item Health Care System Hassles Scale. Recognized as a measure of care coordination, the Hassles questionnaire lists problems that patients may encounter with their general healthcare, as opposed to their care experience with one specific visit or provider. The questionnaire prompts patients to indicate how much situations such as lack of information about why you've been referred to a specialist have been a problem, using a 5-point scale ranging from 0 -4. Ratings were dichotomized (0 = Not a problem at all vs. 1 = any level of problem indicated) and summed to yield a hassles count ranging from 0 to 16, with higher scores indicating more hassles. |
Countries
United States
Participant flow
Recruitment details
We recruited and enrolled VA primary care clinics from October 2016 to June 2018 using a multi-pronged approach, including teleconference presentations and direct outreach to regional and national leadership. Enrolled clinics participated in a 12-month quality improvement project.
Pre-assignment details
Patient survey data were collected cross-sectionally at baseline and 12-months' follow-up to measure clinic outcomes. For the primary outcome (Health Care System Hassles Scale), both baseline and follow-up data are presented in the outcomes section; the primary measure of effectiveness depends on the change in outcome from baseline to follow-up.
Participants by arm
| Arm | Count |
|---|---|
| Toolkit Only Clinics in this arm are given access to an online care coordination toolkit.
Online Toolkit: The online toolkit provides a set of tools that clinics can use to improve their care coordination processes. | 1,223 |
| Toolkit Only Clinics in this arm are given access to an online care coordination toolkit.
Online Toolkit: The online toolkit provides a set of tools that clinics can use to improve their care coordination processes. | 6 |
| Toolkit Plus Coaching Clinics in this arm are given access to an online care coordination toolkit plus quality improvement support from a distance-based coach.
Online Toolkit: The online toolkit provides a set of tools that clinics can use to improve their care coordination processes.
Distance-based coaching: The distance-based coach supports included clinics in carrying out a quality improvement project focused on care coordination, either using the online toolkit or other resources determined by the clinic. | 1,221 |
| Toolkit Plus Coaching Clinics in this arm are given access to an online care coordination toolkit plus quality improvement support from a distance-based coach.
Online Toolkit: The online toolkit provides a set of tools that clinics can use to improve their care coordination processes.
Distance-based coaching: The distance-based coach supports included clinics in carrying out a quality improvement project focused on care coordination, either using the online toolkit or other resources determined by the clinic. | 6 |
| Total | 2,456 |
Baseline characteristics
| Characteristic | Toolkit Only | Toolkit Plus Coaching | Total |
|---|---|---|---|
| Age, Customized Age 65 or older | 712 Participants | 751 Participants | 1463 Participants |
| Age, Customized Age Less than 65 | 508 Participants | 463 Participants | 971 Participants |
| Age, Customized Age Unknown | 3 Participants | 7 Participants | 10 Participants |
| Race/Ethnicity, Customized Race/ethnicity Asian or Asian-American | 74 Participants | 43 Participants | 117 Participants |
| Race/Ethnicity, Customized Race/ethnicity Black or African-American | 137 Participants | 142 Participants | 279 Participants |
| Race/Ethnicity, Customized Race/ethnicity Hispanic | 142 Participants | 182 Participants | 324 Participants |
| Race/Ethnicity, Customized Race/ethnicity Multi-race/ethnicity | 66 Participants | 74 Participants | 140 Participants |
| Race/Ethnicity, Customized Race/ethnicity Non-Hispanic White | 704 Participants | 684 Participants | 1388 Participants |
| Race/Ethnicity, Customized Race/ethnicity Other minority | 27 Participants | 13 Participants | 40 Participants |
| Race/Ethnicity, Customized Race/ethnicity Unknown race/ethnicity | 73 Participants | 83 Participants | 156 Participants |
| Sex/Gender, Customized Gender Female | 180 Participants | 181 Participants | 361 Participants |
| Sex/Gender, Customized Gender Male | 1036 Participants | 1030 Participants | 2066 Participants |
| Sex/Gender, Customized Gender Other | 1 Participants | 2 Participants | 3 Participants |
| Sex/Gender, Customized Gender Unknown | 6 Participants | 8 Participants | 14 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | 0 / 0 | 0 / 0 |
| other Total, other adverse events | 0 / 0 | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 | 0 / 0 |
Outcome results
Health Care System Hassles Scale
The primary outcome was the 16-item Health Care System Hassles Scale. Recognized as a measure of care coordination, the Hassles questionnaire lists problems that patients may encounter with their general healthcare, as opposed to their care experience with one specific visit or provider. The questionnaire prompts patients to indicate how much situations such as lack of information about why you've been referred to a specialist have been a problem, using a 5-point scale ranging from 0 -4. Ratings were dichotomized (0 = Not a problem at all vs. 1 = any level of problem indicated) and summed to yield a hassles count ranging from 0 to 16, with higher scores indicating more hassles.
Time frame: Baseline and 12 months' follow-up
Population: These data derive from two cross-sectional participant surveys at separate (i.e., baseline and follow-up) timepoints. The numbers of participants shown here exceed the numbers presented in the Baseline module because respondents from the surveys are two separate (i.e., independent) samples of participants. Sample sizes for each arm are smaller than reported in the participant flow module because not all survey responses received had valid primary outcome data for analysis.
| Arm | Measure | Group | Value (MEAN) |
|---|---|---|---|
| Toolkit Only | Health Care System Hassles Scale | Baseline | 5.20 units on a scale |
| Toolkit Only | Health Care System Hassles Scale | 12-month Follow-up | 4.78 units on a scale |
| Toolkit Plus Coaching | Health Care System Hassles Scale | Baseline | 4.71 units on a scale |
| Toolkit Plus Coaching | Health Care System Hassles Scale | 12-month Follow-up | 4.30 units on a scale |