Skip to content

Assessing the Effect of Distance Learning Vocational Rehabilitation on Employment Outcomes of Veterans With Psychiatric Illness and Histories of Legal Convictions

Assessing the Effect of Distance Learning Vocational Rehabilitation on Employment Outcomes of Veterans With Psychiatric Illness and Histories of Legal Convictions

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT03331354
Enrollment
136
Registered
2017-11-06
Start date
2019-05-01
Completion date
2023-05-30
Last updated
2024-06-28

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Legal History, Mental Illness, Substance Use Disorder, Unemployment

Keywords

employment, distance learning, incarceration

Brief summary

64,000 Veterans are released annually from jails and prisons. These Veterans have a weekly unemployment rate of up to 40-55%. However, many are unable to access traditional vocational rehabilitation, not to mention specialized vocational rehabilitation for those with felony histories. Distance learning may be effective in improving access to rehabilitation as well as improving employment outcomes. The Compass system was developed to incorporate both synchronous and asynchronous distance learning to provide effective services. This study will evaluate 150 Veterans with histories of legal convictions and mental illness and/or a substance use disorder. Veterans will be randomly assigned to either a basic vocational resources condition or the the Compass condition. In the basic condition, Veterans will be provided with basic information about where they can access vocational services and a paper version of a vocational reintegration manual, specifically the About Face Vocational Manual. Veterans assigned to the Compass condition will be given access to the online instruction through Videos, live chat features, and tele-health practice interviews with feedback. Veterans will be followed for 6 months. The primary outcomes are employment and interview skills.

Detailed description

At this time, there are over 131,000 Veterans in US prisons and over 50,000 in US jails. When discharged, these Veterans will be forced to cope with high rates of psychosocial and health issues including homelessness, divorce, mental illness, and infectious diseases. One of the most significant consequences of incarceration is a high rate of unemployment. Evaluations of employment find those with felony histories worked, on average, between 10% and 23% fewer hours than those without felony histories. These negative employment outcomes are caused by a combination of eroded skills, poor social connections, legal restrictions, and stigma. Though the VA offers a number of vocational rehabilitation and reintegration services, these services are typically not targeted towards Veterans with criminal histories. Also the programs have limitations restricting the range of Veterans that can be served. For example, Veterans living a great distance from a major medical center, rural Veterans, homeless Veterans, and Veterans without transportation may have difficulty accessing services. To reach the most Veterans, tele-health and distance learning methods must be developed to bring services to the Veterans rather than bring the Veterans to the services. Already well integrated into many educational classrooms, distance learning can be a very effective method of imparting training, skills, and information while mitigating many of the logistical limitations encountered by Veterans with histories of incarceration. To be successful distance learning should incorporate a number of different best practices. Distance learning should be engaging, avoiding long periods of reading. It should focus on small 'chunks' of information to improve learning and retention. Due to differences in learning, a multiple modality approach is most likely to be successful. Questions, short quizzes, and problem based activities with immediate feedback should be used to keep participants both engaged and to assess progress. An important aspect to effectively implementing distance learning is to provide blended learning or a hybrid between asynchronous learning, where the participant and teacher are not interacting in real-time, and synchronous learning, where the participant and teacher are interacting directly with each other either in person or across some type of medium. Used effectively, hybrid distance learning can bring a number of positives aspects to the learning environment, including the ability to review information and lessons, practice and role playing, more time to reflect on answers, and less pressure to respond in a group. Based on effective distance learning principles, the Compass system was developed. Compass builds on a previous pilot online system, the About Face Online System (AFOS), which placed a vocational manual into an online fillable format; however, though Veterans engaged the AFOS, a number of limitations were identified that limited Veterans' enthusiasm, including use of extended reading passages, no direct interaction with a person, and not enough focus on interviews. Compass uses distance learning best practices including the use of both synchronous and asynchronous learning. The asynchronous components of Compass use video and online content. Veterans are also quizzed at each step of the process on what responses should be given through a multiple choice method. Synchronous components of Compass include tele-health practice interviews, phone coaching sessions, and live-chat features that are used to assist Veterans tailor their information and improving their interview skills. This study is a four-year project to compare the effectiveness of the Compass system to basic resources. 150 Veterans with legal convictions and mental illness and/or substance use disorders will be followed for six months. Half will receive access to the Compass system and half will receive only basic resources (i.e. a hard copy vocational manual). Outcomes evaluated are employment and interview skills. The goals of the study are: 1. Compare rates of employment of Compass to those receiving basic resources. 2. Compare improvements in interviewing skills between those receiving an online program to those receiving basic resources. Hypotheses/expected results 1\) Veterans using Compass will have superior rates of employment and improved interviewing skills compared to those receiving basic services.

Interventions

BEHAVIORALDistant vocational learning

use of hybrid distance learning to facilitate successful employment outcomes

self-help manual

Sponsors

VA Office of Research and Development
Lead SponsorFED

Study design

Allocation
RANDOMIZED
Intervention model
PARALLEL
Primary purpose
TREATMENT
Masking
SINGLE (Outcomes Assessor)

Masking description

Outcomes assessors will be blinded to conditions

Intervention model description

Patients will be randomly assigned to either a distance learning program (COMPASS) or basic vocational services.

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes

Inclusion criteria

* mental illness or substance use disorder * history of a felony conviction or non-traffic related misdemeanor

Exclusion criteria

* cognitive impairment which prohibits active participation in study

Design outcomes

Primary

MeasureTime frameDescription
Competitive Employment Within Six Months of Random Assignment.6 monthsCompetitive Employment within 6 months of randomization. Competitive employment is defined as a paid position open to anyone, at least at minimum wage, and not a sheltered work position such as the VA's Compensated Work Therapy program. Additionally, day labor type activities were not counted as success.
Interviewing Skillsone monthChanges in Veterans scores on an interviewing rating form (the Veteran Interview Scale) were compared one month after entry into the study. Scores range from 0 to 30. Higher values are better.

Secondary

MeasureTime frameDescription
Change in Job Search Self-Efficacy30 daysChange in job-search efficacy scores were compared between systems at enrollment (point 1) and after 30 days using the systems (point 2). The Job Search Efficacy Scale was used (Cronbach's alpha= .93). Range 10 - 50; higher scores indicate more job search efficacy.

Countries

United States

Participant flow

Recruitment details

Recruitment occurred between 5/13/2019 and 4/28/2022 (during COVID). Recruitment was initially performed on site at the main hospital in VANTHCS (Dallas) but due to COVID, and with IRB approval, remote consenting was allowed.

Pre-assignment details

The procedures were to review with the Veteran enrollment criteria (inclusion and exclusion), then consent Veteran. After consent, a detailed history (including confirmation of criteria) was scheduled on a different date. If the Veteran did not, they were withdrawn. Of those consented but withdrawn, 12 had no legal history and 2 had no interest in employment. Additionally, 25 Veterans did not return after consenting for the detailed history. A total of 39 Veterans (28%) were not randomized.

Participants by arm

ArmCount
Self-help Resources
a self-help vocational manual Basic vocational services: self-help manual
43
Compass
a distant learning vocational program Distant vocational learning: use of hybrid distance learning to facilitate successful employment outcomes
40
Total83

Withdrawals & dropouts

PeriodReasonFG000FG001
Overall StudyFound employment before initiated active intervention04
Overall StudyLost to Follow-up33
Overall StudyWithdrawal by Subject13

Baseline characteristics

CharacteristicSelf-help ResourcesCompassTotal
Age, Continuous58.3 years
STANDARD_DEVIATION 8.1
55.3 years
STANDARD_DEVIATION 8.6
56.8 years
STANDARD_DEVIATION 8.5
Comorbid Substance Use Disorder and Mental Illness27 Participants24 Participants51 Participants
Depression Diagnosis15 Participants17 Participants32 Participants
Ethnicity (NIH/OMB)
Hispanic or Latino
2 Participants5 Participants7 Participants
Ethnicity (NIH/OMB)
Not Hispanic or Latino
41 Participants35 Participants76 Participants
Ethnicity (NIH/OMB)
Unknown or Not Reported
0 Participants0 Participants0 Participants
Months of incarceration lifetime67.9 Months
STANDARD_DEVIATION 91.9
58.4 Months
STANDARD_DEVIATION 77.2
63.8 Months
STANDARD_DEVIATION 84.8
PTSD15 Participants19 Participants34 Participants
Race (NIH/OMB)
American Indian or Alaska Native
0 Participants0 Participants0 Participants
Race (NIH/OMB)
Asian
0 Participants0 Participants0 Participants
Race (NIH/OMB)
Black or African American
38 Participants26 Participants64 Participants
Race (NIH/OMB)
More than one race
0 Participants0 Participants0 Participants
Race (NIH/OMB)
Native Hawaiian or Other Pacific Islander
0 Participants0 Participants0 Participants
Race (NIH/OMB)
Unknown or Not Reported
0 Participants0 Participants0 Participants
Race (NIH/OMB)
White
5 Participants14 Participants19 Participants
Region of Enrollment
United States
43 Participants40 Participants83 Participants
Sex: Female, Male
Female
5 Participants4 Participants9 Participants
Sex: Female, Male
Male
38 Participants36 Participants74 Participants
Substance Use Disorder39 Participants33 Participants72 Participants

Adverse events

Event typeEG000
affected / at risk
EG001
affected / at risk
deaths
Total, all-cause mortality
0 / 430 / 40
other
Total, other adverse events
0 / 430 / 40
serious
Total, serious adverse events
0 / 431 / 40

Outcome results

Primary

Competitive Employment Within Six Months of Random Assignment.

Competitive Employment within 6 months of randomization. Competitive employment is defined as a paid position open to anyone, at least at minimum wage, and not a sheltered work position such as the VA's Compensated Work Therapy program. Additionally, day labor type activities were not counted as success.

Time frame: 6 months

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Self-help ResourcesCompetitive Employment Within Six Months of Random Assignment.15 Participants
CompassCompetitive Employment Within Six Months of Random Assignment.25 Participants
p-value: =0.016Chi-squared
Primary

Interviewing Skills

Changes in Veterans scores on an interviewing rating form (the Veteran Interview Scale) were compared one month after entry into the study. Scores range from 0 to 30. Higher values are better.

Time frame: one month

Population: Due to COVID restrictions, not all Veterans could return to the VA to complete the second interview or did not have access to video connection to conduct the interview online.

ArmMeasureValue (MEAN)Dispersion
Self-help ResourcesInterviewing Skills1.0 Change in raw interview scoresStandard Deviation 4.6
CompassInterviewing Skills4.4 Change in raw interview scoresStandard Deviation 5.1
p-value: 0.008ANCOVA
Secondary

Change in Job Search Self-Efficacy

Change in job-search efficacy scores were compared between systems at enrollment (point 1) and after 30 days using the systems (point 2). The Job Search Efficacy Scale was used (Cronbach's alpha= .93). Range 10 - 50; higher scores indicate more job search efficacy.

Time frame: 30 days

Population: The number of participants in this evaluation was lower than number recruited. Participants needed to complete the job-search efficacy scale at the 30 day post group assignment point plus or minus 3 days. However, not all participants provided the data within the time constraints due to onsite restrictions due to COVID-19 and inability to access online data collection systems.

ArmMeasureValue (MEAN)Dispersion
Self-help ResourcesChange in Job Search Self-Efficacy1.7 score on a scaleStandard Deviation 6
CompassChange in Job Search Self-Efficacy1.2 score on a scaleStandard Deviation 5.7
p-value: 0.99ANCOVA
p-value: 0.99ANCOVA
Post Hoc

Association Between Percent of COMPASS Completed and Improvement in Interview Skills

The percent of the COMPASS program completed was evaluated to determine its association with improved interview scores.

Time frame: 30 days

Population: Due to COVID restrictions, not all Veterans could return to the VA to complete the second interview or did not have access to video connection to conduct the interview online.

ArmMeasureValue (MEAN)Dispersion
Self-help ResourcesAssociation Between Percent of COMPASS Completed and Improvement in Interview Skills48 Percent of program completedStandard Deviation 41
CompassAssociation Between Percent of COMPASS Completed and Improvement in Interview Skills47 Percent of program completedStandard Deviation 40
Comparison: This post-hoc analysis was performed on only the COMPASS group to determine the association between percent of the online system completed and change in interview scoresp-value: <0.001Pearson Correlation

Source: ClinicalTrials.gov · Data processed: Feb 4, 2026