Evaluation of Peer Specialists on VA PACTs

The Patient Activation Measure (PAM) is a 13-item survey that measures an individual's perceived ability to manage his or her illness and health behaviors and act as an effective patient. It has been shown to be reliable, valid, sensitive to change and correlates with measures of improved self-management. Scores for this outcome range from Zero to One Hundred with higher scores indicating higher levels of patient activation (better outcome).

Time frame: Baseline, 6 months, 1 year

Population: Comparison across two conditions on PAM Total Score - PAM Total Score (0-100)

See Variable 5 above for details about adjustment. Since this variable this is a Veteran level variable, a General Linear Mixed Model (GSLMM) was used with PS specified as a random effect and Veteran age, race and gender. N's are number of Veterans

Time frame: across both years

Population: Number of Visits per Veteran

See Variable 5 above for details about adjustment. Since this variable this is a Veteran level variable, a General Linear Mixed Model (GSLMM) was used with PS specified as a random effect and Veteran age, race and gender. N's are number of Veterans

Time frame: 1st year only

Population: number of visits per Veteran

This adjusted workload variables took into consideration both the employment period (many PSs did not start immediately or may have left prior to the end of the 2 years) and weekly hours worked (varying from one hour to 40 hours per week). Visits during each PS's employment period were divided by the total number of hours worked, then multiplied by 40 to calculate adjusted values for operationalization above. Because this variable was significantly skewed, we used a log transformation to improve their distributional properties. Differences between intervention conditions were then compared with a series of Analyses of Covariance models with age, gender and race as covariates. Since these variables are measured at the PS level, the covariates were the average across the Veterans sesn by each PS (mean age, percent White and percent male). N's are number of Veterans

Time frame: one year and across both years

Population: Services Provided by each Peer Specialist

This adjusted workload variables took into consideration both the employment period (many PSs did not start immediately or may have left prior to the end of the 2 years) and weekly hours worked (varying from one hour to 40 hours per week). Visits during each PS's employment period were divided by the total number of hours worked, then multiplied by 40 to calculate adjusted values for operationalization above. Because this variable was significantly skewed, we used a log transformation to improve their distributional properties. Differences between intervention conditions were then compared with a series of Analyses of Covariance models with age, gender and race as covariates. Since these variables are measured at the PS level, the covariates were the average across the Veterans sesn by each PS (mean age, percent White and percent male). N's are number of Veterans

Time frame: one year, across two years

Population: Unique Veteran encounters

The Peer Fidelity Measure assesses: a) peer specialist services and b) peer specialist implementation. The first part has 5 domains of peer services critical to the VA's peer support model (e.g., being a role model that recovery is possible; share personal recovery story). The second has 7 domains of implementation factors shown to either help or hinder PS deployment (e.g., role clarity, support for PS at higher organizational levels, regular supervision). Each domain has 1-2 questions (responses ranging from 1= not at all through 5=Very much with higher scores indicating higher fidelity. Min Value=1 and Max value =5. The Peer Fidelity Measure will be administered to both Peer Specialists and their supervisors. Analyses looked at discrepancies (difference in difference) between Peer Specialists and their Supervisors at each time point. Min discrepancy score is -4 and Max discrepancy score is 4. (calculated as Peer Specialist minus Peer Supervisor score)

Time frame: 6 months, 1 year

Population: 6 months and 1 year

The Team Development Measure is a 31 item self-report survey that evaluates the degree to which a team has and uses the components needed for highly effective teamwork including cohesiveness, communication, role clarity, and goals and means clarity. All components min scores are zero % and maximum is 100%; higher percentages mean positive responses.

Time frame: Baseline, 6 months, 1 year

Population: number of site based leadership and supervisors who responded

The Satisfaction Index-Mental Health is a 12-item, unidimensional measure of patient satisfaction with care. It has been used with Veteran populations and has been shown to be valid, reliable, and sensitive to change in a sample of Veterans with mental illnesses being treated in primary care settings. It will be administered to Veterans who receive care from the Peer Specialists involved in the project. Minimum score is 12 and the maximum score is 72; higher scores mean more satisfaction.

Time frame: Baseline, 6 months, 1 year

Population: Veterans responding to survey

This variable represents count of days from time study at each site started (baseline) until first service was delivered.

Time frame: variable from baseline to time of first service delivered by Peer Specialists