Legal History, Mental Illness, Substance Use Disorder, Unemployment
Conditions
Keywords
employment, distance learning, incarceration
Brief summary
64,000 Veterans are released annually from jails and prisons. These Veterans have a weekly unemployment rate of up to 40-55%. However, many are unable to access traditional vocational rehabilitation, not to mention specialized vocational rehabilitation for those with felony histories. Distance learning may be effective in improving access to rehabilitation as well as improving employment outcomes. The Compass system was developed to incorporate both synchronous and asynchronous distance learning to provide effective services. This study will evaluate 150 Veterans with histories of legal convictions and mental illness and/or a substance use disorder. Veterans will be randomly assigned to either a basic vocational resources condition or the the Compass condition. In the basic condition, Veterans will be provided with basic information about where they can access vocational services and a paper version of a vocational reintegration manual, specifically the About Face Vocational Manual. Veterans assigned to the Compass condition will be given access to the online instruction through Videos, live chat features, and tele-health practice interviews with feedback. Veterans will be followed for 6 months. The primary outcomes are employment and interview skills.
Detailed description
At this time, there are over 131,000 Veterans in US prisons and over 50,000 in US jails. When discharged, these Veterans will be forced to cope with high rates of psychosocial and health issues including homelessness, divorce, mental illness, and infectious diseases. One of the most significant consequences of incarceration is a high rate of unemployment. Evaluations of employment find those with felony histories worked, on average, between 10% and 23% fewer hours than those without felony histories. These negative employment outcomes are caused by a combination of eroded skills, poor social connections, legal restrictions, and stigma. Though the VA offers a number of vocational rehabilitation and reintegration services, these services are typically not targeted towards Veterans with criminal histories. Also the programs have limitations restricting the range of Veterans that can be served. For example, Veterans living a great distance from a major medical center, rural Veterans, homeless Veterans, and Veterans without transportation may have difficulty accessing services. To reach the most Veterans, tele-health and distance learning methods must be developed to bring services to the Veterans rather than bring the Veterans to the services. Already well integrated into many educational classrooms, distance learning can be a very effective method of imparting training, skills, and information while mitigating many of the logistical limitations encountered by Veterans with histories of incarceration. To be successful distance learning should incorporate a number of different best practices. Distance learning should be engaging, avoiding long periods of reading. It should focus on small 'chunks' of information to improve learning and retention. Due to differences in learning, a multiple modality approach is most likely to be successful. Questions, short quizzes, and problem based activities with immediate feedback should be used to keep participants both engaged and to assess progress. An important aspect to effectively implementing distance learning is to provide blended learning or a hybrid between asynchronous learning, where the participant and teacher are not interacting in real-time, and synchronous learning, where the participant and teacher are interacting directly with each other either in person or across some type of medium. Used effectively, hybrid distance learning can bring a number of positives aspects to the learning environment, including the ability to review information and lessons, practice and role playing, more time to reflect on answers, and less pressure to respond in a group. Based on effective distance learning principles, the Compass system was developed. Compass builds on a previous pilot online system, the About Face Online System (AFOS), which placed a vocational manual into an online fillable format; however, though Veterans engaged the AFOS, a number of limitations were identified that limited Veterans' enthusiasm, including use of extended reading passages, no direct interaction with a person, and not enough focus on interviews. Compass uses distance learning best practices including the use of both synchronous and asynchronous learning. The asynchronous components of Compass use video and online content. Veterans are also quizzed at each step of the process on what responses should be given through a multiple choice method. Synchronous components of Compass include tele-health practice interviews, phone coaching sessions, and live-chat features that are used to assist Veterans tailor their information and improving their interview skills. This study is a four-year project to compare the effectiveness of the Compass system to basic resources. 150 Veterans with legal convictions and mental illness and/or substance use disorders will be followed for six months. Half will receive access to the Compass system and half will receive only basic resources (i.e. a hard copy vocational manual). Outcomes evaluated are employment and interview skills. The goals of the study are: 1. Compare rates of employment of Compass to those receiving basic resources. 2. Compare improvements in interviewing skills between those receiving an online program to those receiving basic resources. Hypotheses/expected results 1\) Veterans using Compass will have superior rates of employment and improved interviewing skills compared to those receiving basic services.
Interventions
use of hybrid distance learning to facilitate successful employment outcomes
self-help manual
Sponsors
Study design
Masking description
Outcomes assessors will be blinded to conditions
Intervention model description
Patients will be randomly assigned to either a distance learning program (COMPASS) or basic vocational services.
Eligibility
Inclusion criteria
* mental illness or substance use disorder * history of a felony conviction or non-traffic related misdemeanor
Exclusion criteria
* cognitive impairment which prohibits active participation in study
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Competitive Employment Within Six Months of Random Assignment. | 6 months | Competitive Employment within 6 months of randomization. Competitive employment is defined as a paid position open to anyone, at least at minimum wage, and not a sheltered work position such as the VA's Compensated Work Therapy program. Additionally, day labor type activities were not counted as success. |
| Interviewing Skills | one month | Changes in Veterans scores on an interviewing rating form (the Veteran Interview Scale) were compared one month after entry into the study. Scores range from 0 to 30. Higher values are better. |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Change in Job Search Self-Efficacy | 30 days | Change in job-search efficacy scores were compared between systems at enrollment (point 1) and after 30 days using the systems (point 2). The Job Search Efficacy Scale was used (Cronbach's alpha= .93). Range 10 - 50; higher scores indicate more job search efficacy. |
Countries
United States
Participant flow
Recruitment details
Recruitment occurred between 5/13/2019 and 4/28/2022 (during COVID). Recruitment was initially performed on site at the main hospital in VANTHCS (Dallas) but due to COVID, and with IRB approval, remote consenting was allowed.
Pre-assignment details
The procedures were to review with the Veteran enrollment criteria (inclusion and exclusion), then consent Veteran. After consent, a detailed history (including confirmation of criteria) was scheduled on a different date. If the Veteran did not, they were withdrawn. Of those consented but withdrawn, 12 had no legal history and 2 had no interest in employment. Additionally, 25 Veterans did not return after consenting for the detailed history. A total of 39 Veterans (28%) were not randomized.
Participants by arm
| Arm | Count |
|---|---|
| Self-help Resources a self-help vocational manual
Basic vocational services: self-help manual | 43 |
| Compass a distant learning vocational program
Distant vocational learning: use of hybrid distance learning to facilitate successful employment outcomes | 40 |
| Total | 83 |
Withdrawals & dropouts
| Period | Reason | FG000 | FG001 |
|---|---|---|---|
| Overall Study | Found employment before initiated active intervention | 0 | 4 |
| Overall Study | Lost to Follow-up | 3 | 3 |
| Overall Study | Withdrawal by Subject | 1 | 3 |
Baseline characteristics
| Characteristic | Self-help Resources | Compass | Total |
|---|---|---|---|
| Age, Continuous | 58.3 years STANDARD_DEVIATION 8.1 | 55.3 years STANDARD_DEVIATION 8.6 | 56.8 years STANDARD_DEVIATION 8.5 |
| Comorbid Substance Use Disorder and Mental Illness | 27 Participants | 24 Participants | 51 Participants |
| Depression Diagnosis | 15 Participants | 17 Participants | 32 Participants |
| Ethnicity (NIH/OMB) Hispanic or Latino | 2 Participants | 5 Participants | 7 Participants |
| Ethnicity (NIH/OMB) Not Hispanic or Latino | 41 Participants | 35 Participants | 76 Participants |
| Ethnicity (NIH/OMB) Unknown or Not Reported | 0 Participants | 0 Participants | 0 Participants |
| Months of incarceration lifetime | 67.9 Months STANDARD_DEVIATION 91.9 | 58.4 Months STANDARD_DEVIATION 77.2 | 63.8 Months STANDARD_DEVIATION 84.8 |
| PTSD | 15 Participants | 19 Participants | 34 Participants |
| Race (NIH/OMB) American Indian or Alaska Native | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Asian | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Black or African American | 38 Participants | 26 Participants | 64 Participants |
| Race (NIH/OMB) More than one race | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Native Hawaiian or Other Pacific Islander | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Unknown or Not Reported | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) White | 5 Participants | 14 Participants | 19 Participants |
| Region of Enrollment United States | 43 Participants | 40 Participants | 83 Participants |
| Sex: Female, Male Female | 5 Participants | 4 Participants | 9 Participants |
| Sex: Female, Male Male | 38 Participants | 36 Participants | 74 Participants |
| Substance Use Disorder | 39 Participants | 33 Participants | 72 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | 0 / 43 | 0 / 40 |
| other Total, other adverse events | 0 / 43 | 0 / 40 |
| serious Total, serious adverse events | 0 / 43 | 1 / 40 |
Outcome results
Competitive Employment Within Six Months of Random Assignment.
Competitive Employment within 6 months of randomization. Competitive employment is defined as a paid position open to anyone, at least at minimum wage, and not a sheltered work position such as the VA's Compensated Work Therapy program. Additionally, day labor type activities were not counted as success.
Time frame: 6 months
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Self-help Resources | Competitive Employment Within Six Months of Random Assignment. | 15 Participants |
| Compass | Competitive Employment Within Six Months of Random Assignment. | 25 Participants |
Interviewing Skills
Changes in Veterans scores on an interviewing rating form (the Veteran Interview Scale) were compared one month after entry into the study. Scores range from 0 to 30. Higher values are better.
Time frame: one month
Population: Due to COVID restrictions, not all Veterans could return to the VA to complete the second interview or did not have access to video connection to conduct the interview online.
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Self-help Resources | Interviewing Skills | 1.0 Change in raw interview scores | Standard Deviation 4.6 |
| Compass | Interviewing Skills | 4.4 Change in raw interview scores | Standard Deviation 5.1 |
Change in Job Search Self-Efficacy
Change in job-search efficacy scores were compared between systems at enrollment (point 1) and after 30 days using the systems (point 2). The Job Search Efficacy Scale was used (Cronbach's alpha= .93). Range 10 - 50; higher scores indicate more job search efficacy.
Time frame: 30 days
Population: The number of participants in this evaluation was lower than number recruited. Participants needed to complete the job-search efficacy scale at the 30 day post group assignment point plus or minus 3 days. However, not all participants provided the data within the time constraints due to onsite restrictions due to COVID-19 and inability to access online data collection systems.
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Self-help Resources | Change in Job Search Self-Efficacy | 1.7 score on a scale | Standard Deviation 6 |
| Compass | Change in Job Search Self-Efficacy | 1.2 score on a scale | Standard Deviation 5.7 |
Association Between Percent of COMPASS Completed and Improvement in Interview Skills
The percent of the COMPASS program completed was evaluated to determine its association with improved interview scores.
Time frame: 30 days
Population: Due to COVID restrictions, not all Veterans could return to the VA to complete the second interview or did not have access to video connection to conduct the interview online.
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Self-help Resources | Association Between Percent of COMPASS Completed and Improvement in Interview Skills | 48 Percent of program completed | Standard Deviation 41 |
| Compass | Association Between Percent of COMPASS Completed and Improvement in Interview Skills | 47 Percent of program completed | Standard Deviation 40 |