Predictive Validity of VLaHHS
Conditions
Keywords
Virtual Laparoscopic Hiatal Hernia Simulator (VLaHHS), GS Residents
Brief summary
Part 3 Phase III of this protocol is the interventional portion and is the reason why only this Part is registered and reported within this record. The goal of this phase of the study is to establish the learning curve and predictive validity of the VLaHHS. The study population includes GS residents. The hypothesis is that the subject trained in VLaHHS will improve their skills compared to control with no training and show better transfer of skills on to an actual procedure.
Detailed description
The learning curve of VLaHHS will be established by training subjects in the task over extended period until they reach a plateau. The predictive validity will be established by comparing the training group with a control group with no training by testing their skills on a simulated surgical task using a crural repair silicone model and porcine fundoplication model. The experimental design is a between-subjects design with two groups to which participants will be randomly assigned: (1) Group 1 (Simulation Group): training with VLaHHS, (2) Group 2 (Control Group): no training. The Crural closure tasks of VLaHHS will be tested (10 subjects per task). Before the testing session begins, all participants will receive a guided, hands-on orientation to the task that is being tested. They will then take a pre-test in which they will be asked to perform the task once to mark their baseline performance (i.e. initialize their learner profile). For the training phase, participants in Group 1 will perform the tasks on VLaHHS for an hour a day for a maximum of no more than three weeks (3 weeks' x 5 days = 15 sessions). In each session of no more than an hour, subjects will repeat the task five times. Participants in Group 2 will continue with their normal residency training but will not participate in VLaHHS training at all. Two aspects of learning will then be assessed post-training: skill learning and transfer-of-training. For the Simulation Group, skill learning will be measured immediately following training (post-test) and again after two weeks to measure retention. For the Control Group, skill learning will be measured four weeks after orientation and again two weeks later to measure retention. Finally, immediately after post-test, transfer-of-training will be assessed using simulated crural repair or fundoplication model. The transfer study will be conducted either at the UT Southwestern (UTSW) Simulation Center or at the Artificial Intelligence and Medical Simulation (AIMS) Lab in south campus. Dependent measures for learning curve and retention will be the score computed from completion time and errors on the VLaHHS and the workload assessment measured using the NASA-TLX (Task Load Index) questionnaire after each session. For the transfer task, Subjects performance on the crural repair task will be video recorded and evaluated by a minimum of three experts using Global Assessment Tools for Intraoperative Laparoscopic Skills (GOALS) subjective evaluation method. The videotaping will focus only on subjects hand and any Identifying information such as subjects face will not be captured.
Interventions
For the training phase, participants in Group 1 will perform the tasks on VLaHHS for an hour a day for a maximum of 15 sessions over 3 weeks.
Sponsors
Study design
Intervention model description
Participants will be randomly assigned to 2 groups - simulation group & Control group
Eligibility
Inclusion criteria
* General Surgery (GS) residents
Exclusion criteria
* Residents other than GS * Participants who are not residents.
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Skill Level in Participants as Assessed by Completion Time | Baseline (at pre-test) | Dependent measures for learning curve will be assessed by completion time. |
| Skill Level in Participants Assessed by Numerical Performance Score on the VLaHHS | Baseline (at pre-test) | Dependent measures for learning curve will be assessed by numerical score computed based on performance on the VLaHHS. The performance was assessed based on the following metrics with possible scores in parenthesis: * Created Equidistant Sutures (0,3,5) * Smooth Tool Handling (0,3,5) * Respect for Tissue (0, 3, 5) * Created All Full Thickness Bites (0, 3, 5) * Performed Correct In-Out Sequence of suturing (0, 3, 5) * Did Not Collided with Esophagus (0, 3, 5) * Created Correct Amount of Knots (0, 3, 5) * Tightened All Knots (0,3,5) * Correctly Performed Slipknots (0, 3, 5). The final numerical score is the sum of all individual performance measures which can range from a minimum of 0 to a maximum of 45. Higher score denotes better performance. |
| Skill Level in Participants Assessed by NASA-TLX Questionnaire | Baseline (at pre-test) | Dependent measures for learning curve will be measured using the NASA-TLX questionnaire. The NASA Task Load Index (NASA-TLX) is a tool to subjectively assess cognitive and emotional load during a simulation. Students rate six dimensions: mental and physical demands, time pressure, performance, effort, and frustration. Each dimension is assessed on a scale of 0-10, with a possible total score range of 0 to 60. A higher value indicates a higher burden. |
| Skill Retention in Participants as Assessed by Completion Time | 2 weeks after post test | Dependent measures will be assessed by completion time of participants on the VLAHHS Crural repair task. |
| Skill Level in Participants Assessed by Numerical Performance Scale on the VLaHHS | 2 weeks after post test | Dependent measures for learning curve will be assessed by numerical score computed based on performance on the VLaHHS. The performance was assessed based on the following metrics with possible scores in parenthesis, * Created Equidistant Sutures (0,3,5) * Smooth Tool Handling (0,3,5) * Respect for Tissue (0, 3, 5) * Created All Full Thickness Bites (0, 3, 5) * Performed Correct In-Out Sequence of suturing (0, 3, 5) * Did Not Collided with Esophagus (0, 3, 5) * Created Correct Amount of Knots (0, 3, 5) * Tightened All Knots (0,3,5) * Correctly Performed Slipknots (0, 3, 5). The final numerical score is the sum of all individual performance measures which can range from a minimum of 0 to a maximum of 45. Higher score denotes better performance. |
| Skill Retention in Participants as Assessed by NASA-TLX Questionnaire | 2 weeks after post test | Dependent measures for learning curve will be measured using the NASA-TLX questionnaire. The NASA Task Load Index (NASA-TLX) is a tool to subjectively assess cognitive and emotional load during a simulation. Students rate six dimensions: mental and physical demands, time pressure, performance, effort, and frustration. Each dimension is assessed on a scale of 0-10, with a possible total score range of 0 to 60. A higher value indicates a higher burden. |
| Transfer of Skill in Participants as Assessed by Performance Score | Immediately post test (three weeks after pre-test) | This measure will be assessed using a performance score assessed using a modified tool that consists of Global Assessment Tools for Intraoperative Laparoscopic Skills (GOALS) domains and task-specific metrics. The individual assessment items and their possible scores are: 1. Depth perception (0,3,5) 2. Bimanual dexterity (0,3,5) 3. Efficiency (0,3,5) 4. Tissue handling (0,3,5) 5. Knowledge of procedure (0,3,5) 6. Flow of operation (0,3,5) 7. Instrument handling (0,3,5) 8. Bite size (0,3,5) 9. Knot tying (0,3,5) 10. Needle handling (0,3,5) 11. Crural repair closure (0,3,5) 12. Tissue bites (0,3,5) The total range for the transfer of skills score will be 0-60 with higher score indicating better performance. |
Countries
United States
Contacts
University of Texas Southwestern Medical Center
Participant flow
Pre-assignment details
Part 3 Phase III of this protocol is the interventional portion and is the reason why only this Part is registered and reported within this record. 2 subjects didn't complete screening
Baseline characteristics
| Characteristic | — |
|---|---|
| Age, Categorical <=18 years | 0 Participants |
| Age, Categorical >=65 years | 0 Participants |
| Age, Categorical Between 18 and 65 years | 6 Participants |
| Age, Continuous | 30 years |
| Ethnicity (NIH/OMB) Hispanic or Latino | 1 Participants |
| Ethnicity (NIH/OMB) Not Hispanic or Latino | 3 Participants |
| Ethnicity (NIH/OMB) Unknown or Not Reported | 0 Participants |
| Race (NIH/OMB) American Indian or Alaska Native | 0 Participants |
| Race (NIH/OMB) Asian | 0 Participants |
| Race (NIH/OMB) Black or African American | 2 Participants |
| Race (NIH/OMB) More than one race | 0 Participants |
| Race (NIH/OMB) Native Hawaiian or Other Pacific Islander | 0 Participants |
| Race (NIH/OMB) Unknown or Not Reported | 0 Participants |
| Race (NIH/OMB) White | 3 Participants |
| Region of Enrollment United States | 3 Participants |
| Sex: Female, Male Female | 1 Participants |
| Sex: Female, Male Male | 2 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | 0 / 3 | 0 / 3 |
| other Total, other adverse events | 0 / 3 | 0 / 3 |
| serious Total, serious adverse events | 0 / 3 | 0 / 3 |