Suicide
Conditions
Keywords
Education, Suicide Prevention, Fidelity, Artificial Intelligence
Brief summary
Project WISE (Workplace Integrated Support & Education) includes developmental and pilot research to create an e-learning training in suicide safety planning enhanced with novel skill-building technologies that can be integrated into the routine workflow of nurses serving patients hospitalized for medical, surgical, or traumatic injury reasons. This study pilots an initial version of this eLearning training and collects data on the acceptability of the training and its components as well as engagement of nurses in the training. The evaluation will inform iterations of the training.
Interventions
BEHAVIORALeLearning Training in Suicide Safety Planning
The training includes a web-based didactic in suicide safety planning, interactive practice in counseling microskills with a chat bot, role-playing safety planning with a standardized patient, and reviewing automated feedback on safety planning counseling skills generated from a computer coding system.
Sponsors
National Institute of Mental Health (NIMH)
University of Washington
Study design
Allocation
NA
Intervention model
SINGLE_GROUP
Primary purpose
PREVENTION
Masking
NONE
Eligibility
Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes
Inclusion criteria
* Nurses working in acute or intensive care units at Harborview Medical Center
Exclusion criteria
\-
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Training Acceptability - System Usability Scale for Client Bot Emily | Once, immediately after engaging with each of the training technologies | The System Usability Scale, a self-report measure using a Likert-type rating scale, will assess acceptability of the two technologic training components: Client Bot Emily and Lyssn Advisor. Client Bot Emily is a virtual patient/chat bot with the persona of a suicidal patient. Nurses chat with Emily and practice skills of asking open-ended questions and making reflections about statements Emily makes. Lyssn Advisor is an online platform that automatically codes transcripts of audio or video recorded role-plays for counseling skills; nurses then log in to the platform to see their scores, which provides feedback on their counseling performance. Scores on the SUS range from 0-100, which higher scores indicating greater usability or acceptability. |
| Training Acceptability Self-Report - Post-Training | Immediately after completing the training | A 4-item self-report measure created for this study will assess satisfaction with all of the training components using a Likert-type scale of 0 = Not at all satisfied to 4 = Completely satisfied. |
| Training Acceptability Self-Report - 6-Month Follow-up | 6-months after completing the training | A 4-item self-report measure created for this study will assess satisfaction with all of the training components using a Likert-type scale of 0 = Not at all satisfied to 4 = Completely satisfied. |
| Training Engagement With Client Bot User Data - Post-Training | Immediately after participants indicate they have completing the training activities | Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Client Bot. The unit of measurement will be the number of participants who accessed the Client Bot during the training period. |
| Training Engagement With Lyssn Advisor User Data - Post-Training | Immediately after participants indicate they have completing the training activities | Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Lyssn Advisor. The unit of measurement will be the frequency of times participants visits the Lyssn Advisor webpage. |
| Training Engagement With Client Bot User Data - 6-Month Follow-up | 6-months after participants indicate they have completed the training activities | Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Client Bot. The unit of measurement will be the number of participants who logged on and interacted with the Client Bot after the training period and before completing the 6-month survey. |
| Training Engagement With Lyssn Advisor User Data - 6-Month Follow-up | 6-months after participants indicate they have completed the training activities | Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Lyssn Advisor. The unit of measurement will be the frequency of times participants visits the Lyssn Advisor webpage during the 6-month follow-up period. |
| Training Engagement Self-Report - Post-Training | Immediately after participants indicate they have completed the training activities | Investigators will collect self-reported completion of the training activities using a 4-item measure. Participants will report on a sliding scale from 0-100, what percent of each training activity they believe they completed. |
| Client Bot Training Engagement Self-Report - 6 Month Follow-up | 6-months after participants indicate they have completed the training activities | Participants will self-report whether or not they accessed any of the training technologies during the follow-up period. |
| Participant Retention | 6 Months after completing the training | Percent of participants retained throughout study follow-up |
| Training Acceptability - System Usability Scale for Lyssn Advisor | Once, immediately after engaging with each of the training technologies | The System Usability Scale, a self-report measure using a Likert-type rating scale, will assess acceptability of the two technologic training components: Client Bot Emily and Lyssn Advisor. Client Bot Emily is a virtual patient/chat bot with the persona of a suicidal patient. Nurses chat with Emily and practice skills of asking open-ended questions and making reflections about statements Emily makes. Lyssn Advisor is an online platform that automatically codes transcripts of audio or video recorded role-plays for counseling skills; nurses then log in to the platform to see their scores, which provides feedback on their counseling performance. Scores on the SUS range from 0-100, which higher scores indicating greater usability or acceptability. |
| Lyssn Advisor Training Engagement Self-Report - 6 Month Follow-up | 6-months after participants indicate they have completed the training activities | Participants will self-report whether or not they accessed any of the training technologies during the follow-up period. |
Countries
United States
Participant flow
Recruitment details
Nurses recruited from medical center via email, flyer, and unit manager notifications of the study. Recruitment period: November 1, 2021 - May 31, 2022
Participants by arm
| Arm | Count |
|---|---|
| Project WISE eLearning Training in Suicide Safety Planning eLearning Training in Suicide Safety Planning: The training includes a web-based didactic in suicide safety planning, interactive practice in counseling microskills with a chat bot, role-playing safety planning with a standardized patient, and reviewing automated feedback on safety planning counseling skills generated from a computer coding system. | 18 |
| Total | 18 |
Withdrawals & dropouts
| Period | Reason | FG000 |
|---|---|---|
| Overall Study | Data collection ended before participant reached 6 months | 1 |
| Overall Study | Other | 4 |
Baseline characteristics
| Characteristic | Project WISE eLearning Training in Suicide Safety Planning |
|---|---|
| Age, Continuous | 31.4 years STANDARD_DEVIATION 6 |
| Ethnicity (NIH/OMB) Hispanic or Latino | 1 Participants |
| Ethnicity (NIH/OMB) Not Hispanic or Latino | 16 Participants |
| Ethnicity (NIH/OMB) Unknown or Not Reported | 1 Participants |
| Race (NIH/OMB) American Indian or Alaska Native | 0 Participants |
| Race (NIH/OMB) Asian | 3 Participants |
| Race (NIH/OMB) Black or African American | 0 Participants |
| Race (NIH/OMB) More than one race | 0 Participants |
| Race (NIH/OMB) Native Hawaiian or Other Pacific Islander | 0 Participants |
| Race (NIH/OMB) Unknown or Not Reported | 1 Participants |
| Race (NIH/OMB) White | 14 Participants |
| Region of Enrollment United States | 18 participants |
| Sex: Female, Male Female | 17 Participants |
| Sex: Female, Male Male | 1 Participants |
Adverse events
| Event type | EG000 affected / at risk |
|---|---|
| deaths Total, all-cause mortality | 0 / 18 |
| other Total, other adverse events | 0 / 18 |
| serious Total, serious adverse events | 0 / 18 |
Outcome results
Primary
Client Bot Training Engagement Self-Report - 6 Month Follow-up
Participants will self-report whether or not they accessed any of the training technologies during the follow-up period.
Time frame: 6-months after participants indicate they have completed the training activities
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Client Bot Training Engagement Self-Report - 6 Month Follow-up | 3 Participants |
Primary
Lyssn Advisor Training Engagement Self-Report - 6 Month Follow-up
Participants will self-report whether or not they accessed any of the training technologies during the follow-up period.
Time frame: 6-months after participants indicate they have completed the training activities
Population: 13 nurses completed the 6-month follow-up survey and therefore reported on technology use during that period of time.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Lyssn Advisor Training Engagement Self-Report - 6 Month Follow-up | 6 Participants |
Primary
Participant Retention
Percent of participants retained throughout study follow-up
Time frame: 6 Months after completing the training
Population: 19 participants enrolled in the study; however, of these, 18 participants participated in some aspect of the study, including completed the baseline survey
| Arm | Measure | Group | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Participant Retention | Retained through the 6-month survey | 13 Participants |
| Project WISE eLearning Training in Suicide Safety Planning | Participant Retention | Retained through the 6-month role-play | 10 Participants |
Primary
Training Acceptability Self-Report - 6-Month Follow-up
A 4-item self-report measure created for this study will assess satisfaction with all of the training components using a Likert-type scale of 0 = Not at all satisfied to 4 = Completely satisfied.
Time frame: 6-months after completing the training
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - 6-Month Follow-up | Satisfaction with the didactic and demonstration | 3.2 score on a scale | Standard Deviation 0.8 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - 6-Month Follow-up | Satisfaction with Client Bot Emily | 1.5 score on a scale | Standard Deviation 1.2 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - 6-Month Follow-up | Satisfaction with the role-play practice | 3.5 score on a scale | Standard Deviation 0.5 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - 6-Month Follow-up | Satisfaction with the Lyssn Advisor feedback | 2.6 score on a scale | Standard Deviation 1 |
Primary
Training Acceptability Self-Report - Post-Training
A 4-item self-report measure created for this study will assess satisfaction with all of the training components using a Likert-type scale of 0 = Not at all satisfied to 4 = Completely satisfied.
Time frame: Immediately after completing the training
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - Post-Training | Satisfaction with the didactic and demonstration | 3.1 score on a scale | Standard Deviation 0.8 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - Post-Training | Satisfaction with Client Bot Emily | 1.1 score on a scale | Standard Deviation 1.1 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - Post-Training | Satisfaction with the role-play practice | 3.5 score on a scale | Standard Deviation 0.5 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability Self-Report - Post-Training | Satisfaction with the Lyssn Advisor feedback | 2.5 score on a scale | Standard Deviation 0.6 |
Primary
Training Acceptability - System Usability Scale for Client Bot Emily
The System Usability Scale, a self-report measure using a Likert-type rating scale, will assess acceptability of the two technologic training components: Client Bot Emily and Lyssn Advisor. Client Bot Emily is a virtual patient/chat bot with the persona of a suicidal patient. Nurses chat with Emily and practice skills of asking open-ended questions and making reflections about statements Emily makes. Lyssn Advisor is an online platform that automatically codes transcripts of audio or video recorded role-plays for counseling skills; nurses then log in to the platform to see their scores, which provides feedback on their counseling performance. Scores on the SUS range from 0-100, which higher scores indicating greater usability or acceptability.
Time frame: Once, immediately after engaging with each of the training technologies
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability - System Usability Scale for Client Bot Emily | 70.3 score on a scale | Standard Deviation 19.7 |
Primary
Training Acceptability - System Usability Scale for Lyssn Advisor
The System Usability Scale, a self-report measure using a Likert-type rating scale, will assess acceptability of the two technologic training components: Client Bot Emily and Lyssn Advisor. Client Bot Emily is a virtual patient/chat bot with the persona of a suicidal patient. Nurses chat with Emily and practice skills of asking open-ended questions and making reflections about statements Emily makes. Lyssn Advisor is an online platform that automatically codes transcripts of audio or video recorded role-plays for counseling skills; nurses then log in to the platform to see their scores, which provides feedback on their counseling performance. Scores on the SUS range from 0-100, which higher scores indicating greater usability or acceptability.
Time frame: Once, immediately after engaging with each of the training technologies
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Acceptability - System Usability Scale for Lyssn Advisor | 65.4 score on a scale | Standard Deviation 16.3 |
Primary
Training Engagement Self-Report - Post-Training
Investigators will collect self-reported completion of the training activities using a 4-item measure. Participants will report on a sliding scale from 0-100, what percent of each training activity they believe they completed.
Time frame: Immediately after participants indicate they have completed the training activities
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement Self-Report - Post-Training | Percent completion of didactic and demonstration | 94.3 percentage of completion | Standard Deviation 14.4 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement Self-Report - Post-Training | Percent completion of Client Bot Emily activity | 81.8 percentage of completion | Standard Deviation 18.1 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement Self-Report - Post-Training | Percent completion of role-play practice | 95.3 percentage of completion | Standard Deviation 11 |
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement Self-Report - Post-Training | Percent completion of Lyssn Advisor activity | 90.5 percentage of completion | Standard Deviation 12.2 |
Primary
Training Engagement With Client Bot User Data - 6-Month Follow-up
Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Client Bot. The unit of measurement will be the number of participants who logged on and interacted with the Client Bot after the training period and before completing the 6-month survey.
Time frame: 6-months after participants indicate they have completed the training activities
Population: 16 participants interacted with Client Bot Emily during the training period.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement With Client Bot User Data - 6-Month Follow-up | 0 Participants |
Primary
Training Engagement With Client Bot User Data - Post-Training
Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Client Bot. The unit of measurement will be the number of participants who accessed the Client Bot during the training period.
Time frame: Immediately after participants indicate they have completing the training activities
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Project WISE eLearning Training in Suicide Safety Planning | Training Engagement With Client Bot User Data - Post-Training | 16 Participants |
Primary
Training Engagement With Lyssn Advisor User Data - 6-Month Follow-up
Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Lyssn Advisor. The unit of measurement will be the frequency of times participants visits the Lyssn Advisor webpage during the 6-month follow-up period.
Time frame: 6-months after participants indicate they have completed the training activities
Population: Participant login to the Lyssn system after initial training was not able to be captured, therefore, the outcome data for this variable were not collected.
Primary
Training Engagement With Lyssn Advisor User Data - Post-Training
Data is collected from the technologic platform on whether and how often participants accessed the training technologies. Engagement is indicated by participants accessing the platform using their unique login and interacting with the webpage associated with the Lyssn Advisor. The unit of measurement will be the frequency of times participants visits the Lyssn Advisor webpage.
Time frame: Immediately after participants indicate they have completing the training activities
Population: We were unable to collect this data