Research With Clinical Staff in Stroke Rehabilitation
Conditions
Keywords
stroke, rehabilitation, neurology, digital health
Brief summary
Aims: Assess the usability of OnTrack Tools, a clinician facing interface to manage stroke survivors using the OnTrack rehabilitation system. Background: Arm disability is a common problem after stroke that can lead to loss of independence, it affects \ 450,000 people in the UK. Repetitive activity is critical for recovery but research shows people can struggle with intensity and keeping track of progress. The OnTrack system being developed at Imperial College London is a potential solution to this problem. Intervention: The OnTrack system consists of two software applications, OnTrack App - used by patients, and OnTrack Tools - used by clinicians. OnTrack Tools pulls data generated by the OnTrack App and enables the monitoring of clients' arm activity, and management of goals and educational content. The software is used to inform selfmanagement coaching by helping therapists understand more about how and when patients use their affected arm between treatment sessions. Design and methods: This study will assess the usability of the OnTrack Tools component of the system. The study will recruit stroke therapists from Imperial College Healthcare NHS Trust to provide feedback on the experience and usability of OnTrack Tools' graphical user interface (GUI). The study will be divided into three progressive cycles of testing, feedback and iteration. Each cycle will see participants individually completing specific tasks related to system navigation and the management of patients under simulation. Participants will complete outcome measures and take part in focus groups. Researchers will analyse and use the feedback to improve the GUI ready for the next testing cycle. Patient and public involvement: The project team includes a PPIE group of stroke survivors who oversee the project and help us with public facing documentation. They are members of the research team and are reimbursed for their time and travel, according to INVOLVE guidance. Dissemination: Results of the study will be written-up for technical reporting and publication. Participants will be provided with a summary of results at the end of the study. The study team will be providing general updates on the progress of the study via their social media channels (e.g. Twitter @OnTrackRehab @ImperialIGHI @HelixCentre).
Interventions
DEVICEOnTrack Tools
The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
Sponsors
Imperial College Healthcare NHS Trust
Imperial College London
Study design
Allocation
NA
Intervention model
SINGLE_GROUP
Primary purpose
OTHER
Masking
NONE
Intervention model description
This study aims to assess the usability of the OnTrack Tools GUI under simulation. The study follows up from a study of the OnTrack system that demonstrated the feasibility and acceptability of the patient-facing component of the system by stroke survivors and therapists. The design of this study was developed through a collaborative approach between the study researchers, patients, and front-line therapists. The OnTrack intervention is being developed by Imperial College, this usability study is part of the development process.
Eligibility
Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes
Inclusion criteria
* Adult (18 years old or over) Occupational Therapists and Physiotherapists (Band 4 to Band 8) working in the stroke wards at ICHT.
Exclusion criteria
* No
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| System Usability Scale (Phase 1) | Up to 60 days. | In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome. |
| System Usability Scale (Phase 2) | Up to 60 days | In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome. |
| System Usability Scale (Phase 3) | Up to 60 days. | In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome. |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Post-Study System Usability Questionnaire (PSSUQ) | Up to 60 days. | The PSSUQ (Post-Study System Usability Questionnaire is a 16-item standardized questionnaire. It is widely used to measure users' perceived satisfaction of a website, software, system or product at the end of a study. PSSUQ follows a 7-point Likert Scale (+ NA option). 1 is strongly agree and 7 is strongly disagree Results are calculated by averaging the scores from the 7 points of the scale. The PSSUQ has one overall score and 3 sub-scales, namely system usefulness, information quality, and interface quality scored as follows: Overall: the average scores of questions 1 to 16 System Usefulness (SYSUSE): the average scores of questions 1 to 6 Information Quality (INFOQUAL): the average scores of questions 7 to 12 Interface Quality (INTERQUAL): the average scores of questions 13 to 15 The lower the scores, the better the performance and the higher the perceived satisfaction. |
Countries
United Kingdom
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Therapists Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards.
OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below:
Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management. | 10 |
| Total | 10 |
Baseline characteristics
| Characteristic | Therapists | — |
|---|---|---|
| Age, Categorical <=18 years | 0 Participants | — |
| Age, Categorical >=65 years | 0 Participants | — |
| Age, Categorical Between 18 and 65 years | 10 Participants | — |
| Race and Ethnicity Not Collected | — | — Participants |
| Region of Enrollment United Kingdom | 10 participants | — |
| Sex: Female, Male Female | 5 Participants | — |
| Sex: Female, Male Male | 5 Participants | — |
Adverse events
| Event type | EG000 affected / at risk |
|---|---|
| deaths Total, all-cause mortality | 0 / 0 |
| other Total, other adverse events | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 |
Outcome results
Primary
System Usability Scale (Phase 1)
In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.
Time frame: Up to 60 days.
| Arm | Measure | Value (MEAN) |
|---|---|---|
| Therapists (Phase 1) | System Usability Scale (Phase 1) | 73.3 score on a scale |
Primary
System Usability Scale (Phase 2)
In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.
Time frame: Up to 60 days
| Arm | Measure | Value (MEAN) |
|---|---|---|
| Therapists (Phase 1) | System Usability Scale (Phase 2) | 78.3 score on a scale |
Primary
System Usability Scale (Phase 3)
In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.
Time frame: Up to 60 days.
| Arm | Measure | Value (MEAN) |
|---|---|---|
| Therapists (Phase 1) | System Usability Scale (Phase 3) | 77.1 score on a scale |
Secondary
Post-Study System Usability Questionnaire (PSSUQ)
The PSSUQ (Post-Study System Usability Questionnaire is a 16-item standardized questionnaire. It is widely used to measure users' perceived satisfaction of a website, software, system or product at the end of a study. PSSUQ follows a 7-point Likert Scale (+ NA option). 1 is strongly agree and 7 is strongly disagree Results are calculated by averaging the scores from the 7 points of the scale. The PSSUQ has one overall score and 3 sub-scales, namely system usefulness, information quality, and interface quality scored as follows: Overall: the average scores of questions 1 to 16 System Usefulness (SYSUSE): the average scores of questions 1 to 6 Information Quality (INFOQUAL): the average scores of questions 7 to 12 Interface Quality (INTERQUAL): the average scores of questions 13 to 15 The lower the scores, the better the performance and the higher the perceived satisfaction.
Time frame: Up to 60 days.
| Arm | Measure | Group | Value (MEAN) |
|---|---|---|---|
| Therapists (Phase 1) | Post-Study System Usability Questionnaire (PSSUQ) | Overall | 2.6 score on a scale |
| Therapists (Phase 1) | Post-Study System Usability Questionnaire (PSSUQ) | SYSUSE | 2.5 score on a scale |
| Therapists (Phase 1) | Post-Study System Usability Questionnaire (PSSUQ) | INFOQUAL | 2.7 score on a scale |
| Therapists (Phase 1) | Post-Study System Usability Questionnaire (PSSUQ) | INTERQUAL | 2.6 score on a scale |