Skip to content

Enhancing Mental Health Care by Scientifically Matching Patients to Providers' Strengths

Enhancing Mental Health Care by Scientifically Matching Patients to Providers' Strengths

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT02990000
Enrollment
288
Registered
2016-12-12
Start date
2017-11-06
Completion date
2020-03-15
Last updated
2020-07-30

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Mental Illness

Brief summary

Research has shown that mental health care (MHC) providers differ significantly in their ability to help patients. In addition, providers demonstrate different patterns of effectiveness across symptom and functioning domains. For example, some providers are reliably effective in treating numerous patients and problem domains, others are reliably effective in some domains (e.g., depression, substance abuse) yet appear to struggle in others (e.g., anxiety, social functioning), and some are reliably ineffective, or even harmful, across patients and domains. Knowledge of these provider differences is based largely on patient-reported outcomes collected in routine MHC settings. Unfortunately, provider performance information is not systematically used to refer or assign a particular patient to a scientifically based best-matched provider. MHC systems continue to rely on random or purely pragmatic case assignment and referral, which significantly waters down the odds of a patient being assigned/referred to a high performing provider in the patient's area(s) of need, and increases the risk of being assigned/referred to a provider who may have a track record of ineffectiveness. This research aims to solve the existing non-patient-centered provider-matching problem. Specifically, the investigators aim to demonstrate the comparative effectiveness of a scientifically-based patient-provider match system compared to status quo pragmatic case assignment. The investigators expect in the scientific match group significantly better treatment outcomes (e.g., symptoms, quality of life) and higher patient satisfaction with treatment. The investigators also expect to demonstrate feasibility of implementing a scientific match process in a community MHC system and broad dissemination of the easily replicated scientific match technology in diverse health care settings. The importance of this work for patients cannot be understated. Far too many patients struggle to find the right provider, which unnecessarily prolongs suffering and promotes health care system inefficiency. A scientific match system based on routine outcome data uses patient-generated information to direct this patient to this provider in this setting. In addition, when based on multidimensional assessment, it allows a wide variety of patient-centered outcomes to be represented (e.g., symptom domains, functioning domains, quality of life).

Detailed description

Background and Significance: Mental illness is an extraordinary and highly burdensome public health problem. Unfortunately, even for individuals who access mental health care (MHC), the care is too often substandard. Research has consistently demonstrated that approximately 10-15% of patients will deteriorate or experience harm during treatment. Further, when these rates are combined with no-change rates, only 40% or less of patients meaningfully recover. Importantly, treatment research has illuminated substantial variability in providers' outcomes. Simply put, the MHC provider impacts treatment outcomes, and stakeholders lack systematic access to valid and actionable information to optimize effective patient-provider matches. Without collecting and disseminating performance data, stakeholders lack vital information on which to base health care choices and personalize treatment. Conversely, there potentially is immense advantage to matching patients to providers based on scientific outcome data. Patients, stakeholders, researchers, and clinicians have all endorsed such applied knowledge transfer as a high priority. In response, the investigators have developed and piloted a technology to test this match concept and patient-centered health model. Prominent health care agencies have placed outcome/performance measurement at the center of core initiatives. The Institute of Medicine specifically recommends integrating provider performance data in treatment decision-making. Despite this rhetoric, 2 Cochrane Reviews combined could only identify 4 studies that addressed this question with minimal methodology standards; the results were mixed. Importantly, none involved a targeted dissemination intervention, and none involved MHC. Previous research, including our own, has empirically demonstrated substantial differences in projected treatment effect sizes depending on to which therapist a patient is referred. The key evidence gap is the need for a rigorous test of the effectiveness of a targeted MHC provider-performance dissemination intervention compared to standard/pragmatic referral and case assignment. Relatedly, the Patient-Centered Outcomes Research Institute (PCORI) has called for increased precision or personalized treatment, with a focus on tailoring. The match algorithm responds directly to this high priority call to customize care in a personal and evidence-based way. Specific Aims: The aim of this comparative effectiveness research (CER) is to test an innovative, scientifically informed patient-therapist referral match algorithm based on MHC provider outcome data. The investigators will employ a randomized controlled trial (RCT) to compare the match algorithm with the commonplace pragmatic referral matching (based on provider availability, convenience, or self-reported specialty). Psychosocial treatment itself will remain naturalistically administered by varied providers (e.g., psychologists, social workers) to patients with complex mental health concerns within a partner clinic network, Psychological and Behavioral Consultants (PsychBC). The investigators hypothesize that the scientific match group will outperform the pragmatic match group in decreasing patient symptoms and treatment dropout, and in promoting patient functional outcomes, outcome expectations, and care satisfaction, as well as patient-therapist alliance quality. Doing so will establish the match algorithm as a mechanism of effective patient-centered MHC. Methods: The investigators will compare the effectiveness of naturalistic MHC either with or without the scientific matching aid with a double blind, individual level RCT. The investigators will first conduct a baseline assessment of PsychBC therapists' (target enrollment N=44) performance (across at least 15 cases) to determine their strengths in treating 12 behavioral health domains measured by the primary outcome tool on which our match algorithm is based -- the Treatment Outcome Package (TOP). The TOP is already administered routinely in our partner network. Based on years of predictive analytic research, this tool classifies therapists as effective, neutral, or ineffective/harmful for each TOP domain. The blinded therapists will be crossed over conditions. Next, for the trial, new adult outpatients (target enrollment N=281) will be randomly assigned to the Match condition or case assignment as usual (typically based on pragmatic considerations, such as provider availability, convenience, or self-reported specialty). The only patient exclusion criterion will be people who are not the primary decision-maker for their care. Thus, patients will present with a multitude of problems across a spectrum of diagnoses. With therapist assignment as the only manipulation, participating therapists will treat patients fully naturalistically. Treatment outcomes will be assessed regularly through mutual termination or up to 16 weeks. Primary analyses will involve hierarchical linear modeling to examine comparative rates and patterns of change on the outcomes.

Interventions

BEHAVIORALScientific Match

We have developed an innovative, personalized Match System based on provider track records determined with a multidimensional outcomes tool - the Treatment Outcome Package (TOP). Specifically, patients are assigned to therapists with previously established strengths (i.e., being historically effective) in treating their primary problems (e.g., depression, anxiety).

Sponsors

Patient-Centered Outcomes Research Institute
CollaboratorOTHER
University at Albany
CollaboratorOTHER
Psychological and Behavioral Consultants
CollaboratorOTHER
Outcome Referrals, Inc.
CollaboratorINDUSTRY
University of Massachusetts, Amherst
Lead SponsorOTHER

Study design

Allocation
RANDOMIZED
Intervention model
PARALLEL
Primary purpose
HEALTH_SERVICES_RESEARCH
Masking
DOUBLE (Subject, Caregiver)

Eligibility

Sex/Gender
ALL
Age
18 Years to 70 Years
Healthy volunteers
No

Inclusion criteria

Inclusion: * Being 18-70 years of age * Being the primary, informed decision-maker for one's care * Willingness to be randomized to condition and to complete a few study-specific measures Exclusion: * Being under 18 or over 70 years of age * Not being responsible for one's own treatment decisions * Unwillingness to be randomized to condition and/or to complete a few study-specific measures

Design outcomes

Primary

MeasureTime frameDescription
Average Z-Scores for the Treatment Outcome Package-Clinical Scales (TOP-CS; Kraus, Seligman, & Jordan, 2005)Baseline and biweekly across 16 weeksThe TOP-Clinical Scales consist of 58 items assessing 12 symptom and functional domains (risk-adjusted for case mix variables assessed via 37 items on the companion TOP-Case Mix form, such as divorce, job loss, comorbidity): work functioning, sexual functioning, social conflict, depression, panic/somatic anxiety, psychosis, suicidal ideation, violence, mania, sleep, substance abuse, and quality of life. Global symptom severity was assessed by averaging the z-scores (i.e., standard deviation units relative to the general population mean) across the 12 clinical scales. Higher scores indicate greater impairment. Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the TOP-CS z-scores across all measurement occasions.

Secondary

MeasureTime frameDescription
Working Alliance Inventory-Short Form, Patient Version (WAI-SF-P; Tracey, & Kokotovic, 1989) Total ScoreBiweekly across 16 weeksThe WAI is the most widely used alliance measure, assessing patient-therapist agreement on the goals and tasks of treatment, and the quality of their relational bond. This 12-item short form assesses these dimensions from the patient's perspective, with higher scores indicating a more positive relationship (theoretical range = 12 to 84). Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the WAI total score across all measurement occasions.
Outcome Expectation (OE) Subscale of the Credibility/Expectancy Scale (CEQ; Devilly, & Borkovec, 2000)Biweekly across 16 weeksThe OE subscale of the CEQ is the most widely used and psychometrically sound measure of patients' expectations for the personal efficacy of treatment. The three OE items range from 1-9 or 0-100% (in 10 percentage point increments), with higher ratings indicating greater expectation for improvement. Given that the OE CEQ items are assessed on different scales, we re-scaled the items to the same metric before creating a total score (theoretical range = 3 to 27). Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the OE subscale across all measurement occasions.
Symptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999) Total ScoreBaseline and biweekly across 16 weeksGlobal psychological distress was assessed with the Symptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999), a 10-item, well validated and widely used self-report inventory that assesses psychological well-being. Total scores can range from 0 to 40, with higher scores indicating greater distress. Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the SCL-10 total score across all measurement occasions.
Early Treatment Discontinuation (i.e., Attending 2 or Fewer Treatment Sessions)Early treatment discontinuation/continuation at session 2Early treatment discontinuation was operationalized as a patient discontinuing treatment after 2 or fewer sessions, whereas early continuation was operationalized as attending 3 or more treatment sessions. For analyses, early treatment discontinuation was coded 1 and early continuation was coded 0.
Overall Provider Quality Subscale of the Treatment Outcome Package (TOP) Satisfaction ScaleAssessed after 16 weeks of treatment or at the point of naturalistic treatment termination, whichever comes soonerThe Overall Provider Quality subscale of the TOP Satisfaction Scale assesses the extent to which patients are satisfied with their mental health care provider. This subscale reflects the average of 4 items, with higher scores indicating greater satisfaction (theoretical range = 1 to 6).
Domain-Specific Impairment on the Most Elevated Domain of the Treatment Outcome Package-Clinical Scales (TOP-CS)Baseline and biweekly across 16 weeksThe TOP-CS consists of 58 items assessing 12 symptom and functional domains (risk-adjusted for case mix variables assessed via 37 items on the companion TOP-Case Mix form, such as divorce, job loss, comorbidity): work functioning, sexual functioning, social conflict, depression, panic/somatic anxiety, psychosis, suicidal ideation, violence, mania, sleep, substance abuse, and quality of life. Domain-specific impairment reflects each patient's scores on their most elevated problem domain (i.e., the domain most elevated at baseline). These scores were standardized z-scores (i.e., standard deviation units relative to the general population mean), with higher scores indicating greater impairment. Given that we examined change over the treatment period for this outcome (hierarchical linear model), we provide the average mean and standard deviation for the most elevated TOP domain across all measurement occasions. Note that this measure was positively skewed so we log-transformed it.

Countries

United States

Participant flow

Participants by arm

ArmCount
Pragmatic Match
Randomly assigned, by a case-assigning administrator, to naturalistic treatment with a pragmatically matched provider (control group)
119
Scientific Match
Randomly assigned, by a case-assigning administrator, to naturalistic treatment with a scientifically matched provider (experimental group) Scientific Match: We have developed an innovative, personalized Match System based on provider track records determined with a multidimensional outcomes tool - the Treatment Outcome Package (TOP). Specifically, patients are assigned to therapists with previously established strengths (i.e., being historically effective) in treating their primary problems (e.g., depression, anxiety).
99
Total218

Withdrawals & dropouts

PeriodReasonFG000FG001
Overall StudyFailed to provide data beyond baseline3634

Baseline characteristics

CharacteristicPragmatic MatchScientific MatchTotal
Age, Categorical
<=18 years
0 Participants0 Participants0 Participants
Age, Categorical
>=65 years
0 Participants0 Participants0 Participants
Age, Categorical
Between 18 and 65 years
119 Participants99 Participants218 Participants
Age, Continuous34.42 years
STANDARD_DEVIATION 11.55
33.33 years
STANDARD_DEVIATION 10.72
33.93 years
STANDARD_DEVIATION 11.17
Ethnicity (NIH/OMB)
Hispanic or Latino
3 Participants3 Participants6 Participants
Ethnicity (NIH/OMB)
Not Hispanic or Latino
116 Participants96 Participants212 Participants
Ethnicity (NIH/OMB)
Unknown or Not Reported
0 Participants0 Participants0 Participants
Race/Ethnicity, Customized
African American/Black
6 Participants7 Participants13 Participants
Race/Ethnicity, Customized
American Indian or Alaska Native
0 Participants0 Participants0 Participants
Race/Ethnicity, Customized
East Indian
0 Participants1 Participants1 Participants
Race/Ethnicity, Customized
Hispanic or Latino
3 Participants3 Participants6 Participants
Race/Ethnicity, Customized
Other
2 Participants0 Participants2 Participants
Race/Ethnicity, Customized
White
106 Participants87 Participants193 Participants
Region of Enrollment
United States
119 participants99 participants218 participants
Sex: Female, Male
Female
81 Participants66 Participants147 Participants
Sex: Female, Male
Male
38 Participants33 Participants71 Participants
Symptom Checklist-10 (SCL-10): Global Psychological Distress15.48 units on a scale
STANDARD_DEVIATION 7.93
16.08 units on a scale
STANDARD_DEVIATION 7.74
15.75 units on a scale
STANDARD_DEVIATION 7.83
Treatment Outcome Package-Clinical Scales (TOP-CS): General Impairment0.86 units on a scale
STANDARD_DEVIATION 0.78
1.04 units on a scale
STANDARD_DEVIATION 0.96
0.94 units on a scale
STANDARD_DEVIATION 0.87

Adverse events

Event typeEG000
affected / at risk
EG001
affected / at risk
deaths
Total, all-cause mortality
0 / 1190 / 99
other
Total, other adverse events
0 / 1190 / 99
serious
Total, serious adverse events
0 / 1190 / 99

Outcome results

Primary

Average Z-Scores for the Treatment Outcome Package-Clinical Scales (TOP-CS; Kraus, Seligman, & Jordan, 2005)

The TOP-Clinical Scales consist of 58 items assessing 12 symptom and functional domains (risk-adjusted for case mix variables assessed via 37 items on the companion TOP-Case Mix form, such as divorce, job loss, comorbidity): work functioning, sexual functioning, social conflict, depression, panic/somatic anxiety, psychosis, suicidal ideation, violence, mania, sleep, substance abuse, and quality of life. Global symptom severity was assessed by averaging the z-scores (i.e., standard deviation units relative to the general population mean) across the 12 clinical scales. Higher scores indicate greater impairment. Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the TOP-CS z-scores across all measurement occasions.

Time frame: Baseline and biweekly across 16 weeks

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchAverage Z-Scores for the Treatment Outcome Package-Clinical Scales (TOP-CS; Kraus, Seligman, & Jordan, 2005)0.57 units on a scaleStandard Deviation 0.8
Scientific MatchAverage Z-Scores for the Treatment Outcome Package-Clinical Scales (TOP-CS; Kraus, Seligman, & Jordan, 2005)0.56 units on a scaleStandard Deviation 0.82
Comparison: To account for the nested nature of the data (time points nested within patients nested within therapists), a 3-level hierarchical linear model was used to test the effect of condition (Scientific Match = 1; Pragmatic Match = 0) on weekly during-treatment change on the TOP-CS average z-scores. Given that higher TOP-CS z-scores indicate greater impairment, negative slopes indicate a weekly decrease in impairment during treatment (i.e., a better outcome or more improvement).p-value: 0.0295% CI: [-0.05, -0.03]3-level hierarchical linear model
Secondary

Domain-Specific Impairment on the Most Elevated Domain of the Treatment Outcome Package-Clinical Scales (TOP-CS)

The TOP-CS consists of 58 items assessing 12 symptom and functional domains (risk-adjusted for case mix variables assessed via 37 items on the companion TOP-Case Mix form, such as divorce, job loss, comorbidity): work functioning, sexual functioning, social conflict, depression, panic/somatic anxiety, psychosis, suicidal ideation, violence, mania, sleep, substance abuse, and quality of life. Domain-specific impairment reflects each patient's scores on their most elevated problem domain (i.e., the domain most elevated at baseline). These scores were standardized z-scores (i.e., standard deviation units relative to the general population mean), with higher scores indicating greater impairment. Given that we examined change over the treatment period for this outcome (hierarchical linear model), we provide the average mean and standard deviation for the most elevated TOP domain across all measurement occasions. Note that this measure was positively skewed so we log-transformed it.

Time frame: Baseline and biweekly across 16 weeks

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchDomain-Specific Impairment on the Most Elevated Domain of the Treatment Outcome Package-Clinical Scales (TOP-CS)0.27 units on a scaleStandard Deviation 0.24
Scientific MatchDomain-Specific Impairment on the Most Elevated Domain of the Treatment Outcome Package-Clinical Scales (TOP-CS)0.28 units on a scaleStandard Deviation 0.23
Comparison: To account for the nested nature of the data (time points nested within patients nested within therapists), a 3-level hierarchical linear model was used to test the effect of condition (Scientific Match = 1; Pragmatic Match = 0) on weekly during-treatment change on the log-transformed TOP-CS domain-specific z-scores. Given that higher z-scores indicate greater impairment, negative slopes indicate a weekly decrease in impairment during treatment (i.e., a better outcome or more improvement).p-value: 0.0195% CI: [-0.01, -0.006]3-level hierarchical linear model
Secondary

Early Treatment Discontinuation (i.e., Attending 2 or Fewer Treatment Sessions)

Early treatment discontinuation was operationalized as a patient discontinuing treatment after 2 or fewer sessions, whereas early continuation was operationalized as attending 3 or more treatment sessions. For analyses, early treatment discontinuation was coded 1 and early continuation was coded 0.

Time frame: Early treatment discontinuation/continuation at session 2

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Pragmatic MatchEarly Treatment Discontinuation (i.e., Attending 2 or Fewer Treatment Sessions)22 Participants
Scientific MatchEarly Treatment Discontinuation (i.e., Attending 2 or Fewer Treatment Sessions)22 Participants
Comparison: Multilevel logistic regression analysis with patients nested within therapists (Scientific Match = 1; Pragmatic Match = 0). Statistically significant odds ratios that are greater than 1 would indicate that patients in the Scientific Match Condition were more likely to discontinue treatment early, whereas odds ratios that are less than 1 would indicate the opposite.p-value: 0.48Multilevel logistic regression
Secondary

Outcome Expectation (OE) Subscale of the Credibility/Expectancy Scale (CEQ; Devilly, & Borkovec, 2000)

The OE subscale of the CEQ is the most widely used and psychometrically sound measure of patients' expectations for the personal efficacy of treatment. The three OE items range from 1-9 or 0-100% (in 10 percentage point increments), with higher ratings indicating greater expectation for improvement. Given that the OE CEQ items are assessed on different scales, we re-scaled the items to the same metric before creating a total score (theoretical range = 3 to 27). Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the OE subscale across all measurement occasions.

Time frame: Biweekly across 16 weeks

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchOutcome Expectation (OE) Subscale of the Credibility/Expectancy Scale (CEQ; Devilly, & Borkovec, 2000)18.12 units on a scaleStandard Deviation 5.45
Scientific MatchOutcome Expectation (OE) Subscale of the Credibility/Expectancy Scale (CEQ; Devilly, & Borkovec, 2000)19.15 units on a scaleStandard Deviation 5.3
Comparison: To account for the nested nature of the data (time points nested within patients nested within therapists), a 3-level hierarchical linear model was used to test the effect of condition (Scientific Match = 1; Pragmatic Match = 0) on weekly during-treatment change on the OE subscale of the CEQ. Given that higher OE scores indicate more optimistic expectations, positive slopes indicate a weekly increase in OE during treatment (i.e., a better outcome or more improvement).p-value: 0.4195% CI: [-0.17, 0.07]3-level hierarchical linear model
Secondary

Overall Provider Quality Subscale of the Treatment Outcome Package (TOP) Satisfaction Scale

The Overall Provider Quality subscale of the TOP Satisfaction Scale assesses the extent to which patients are satisfied with their mental health care provider. This subscale reflects the average of 4 items, with higher scores indicating greater satisfaction (theoretical range = 1 to 6).

Time frame: Assessed after 16 weeks of treatment or at the point of naturalistic treatment termination, whichever comes sooner

Population: Due to a relatively large amount of missing data for this measure (compared to other study measures), this was considered a completer analysis that involved only the patients who completed this posttreatment measure (N = 97).

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchOverall Provider Quality Subscale of the Treatment Outcome Package (TOP) Satisfaction Scale5.01 units on a scaleStandard Deviation 1.35
Scientific MatchOverall Provider Quality Subscale of the Treatment Outcome Package (TOP) Satisfaction Scale5.17 units on a scaleStandard Deviation 1.11
Comparison: Due to the nested nature of the data (patients nested within therapists), we used a two-level hierarchical linear model to test the effect of condition on provider satisfaction at posttreatment. Because higher values indicate more satisfaction, a positive condition effect would indicate that Scientific Match patients were more satisfied than Pragmatic Match patients, whereas a negative condition effect would indicate the opposite.p-value: 0.4495% CI: [-0.57, 1.31]2-level hierarchical linear model
Secondary

Symptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999) Total Score

Global psychological distress was assessed with the Symptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999), a 10-item, well validated and widely used self-report inventory that assesses psychological well-being. Total scores can range from 0 to 40, with higher scores indicating greater distress. Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the SCL-10 total score across all measurement occasions.

Time frame: Baseline and biweekly across 16 weeks

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchSymptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999) Total Score12.52 units on a scaleStandard Deviation 8.01
Scientific MatchSymptom Checklist-10 (SCL-10; Rosen, Drescher, Moos, & Gusman, 1999) Total Score12.06 units on a scaleStandard Deviation 7.7
Comparison: To account for the nested nature of the data (time points nested within patients nested within therapists), a 3-level hierarchical linear model was used to test the effect of condition (Scientific Match = 1; Pragmatic Match = 0) on weekly during-treatment change on the SCL-10 total score. Given that higher SCL-10 scores indicate greater psychological distress, negative slopes indicate a weekly decrease in impairment during treatment (i.e., a better outcome or more improvement).p-value: 0.0395% CI: [-0.3, -0.02]3-level hierarchical linear model
Secondary

Working Alliance Inventory-Short Form, Patient Version (WAI-SF-P; Tracey, & Kokotovic, 1989) Total Score

The WAI is the most widely used alliance measure, assessing patient-therapist agreement on the goals and tasks of treatment, and the quality of their relational bond. This 12-item short form assesses these dimensions from the patient's perspective, with higher scores indicating a more positive relationship (theoretical range = 12 to 84). Given that we examined change over the entire treatment period for this outcome (in a longitudinal hierarchical linear model), we provide the average mean and standard deviation for the WAI total score across all measurement occasions.

Time frame: Biweekly across 16 weeks

Population: All participants who were randomized to condition and completed at least one assessment after baseline (N = 218)

ArmMeasureValue (MEAN)Dispersion
Pragmatic MatchWorking Alliance Inventory-Short Form, Patient Version (WAI-SF-P; Tracey, & Kokotovic, 1989) Total Score66.75 units on a scaleStandard Deviation 13.35
Scientific MatchWorking Alliance Inventory-Short Form, Patient Version (WAI-SF-P; Tracey, & Kokotovic, 1989) Total Score68.44 units on a scaleStandard Deviation 12
Comparison: To account for the nested nature of the data (time points nested within patients nested within therapists), a 3-level hierarchical linear model was used to test the effect of condition (Scientific Match = 1; Pragmatic Match = 0) on weekly during-treatment change on the patient-rated WAI. Given that higher WAI scores indicate better quality therapeutic alliances, positive slopes indicate a weekly increase in alliance during treatment (i.e., a better outcome or more improvement).p-value: 0.6595% CI: [-0.33, 0.21]3-level hierarchical linear model

Source: ClinicalTrials.gov · Data processed: Feb 15, 2026