Telemedicine
Conditions
Keywords
Qualitative, User, Computer Interface, quantitative, survey, telemedicine
Brief summary
Deployment of Secure Messaging (SM) in primary care and women's clinics throughout the Veteran Health System by 2011 was an implementation priority for the Secretary and Under Secretary for Health for FY11 under the VHA T21 initiative. Secure Messaging is in early phases of implementation, this eHealth tool requires thoughtful evaluation to promote the successful implementation and dissemination of this tool. The primary aim of this project is to describe Veterans' experiences when using the SM feature on MyHealtheVet (MHV). This project has local, VISN, and national impact on the implementation and sustainability of the SM feature on MHV through its qualitative and quantitative examination of users' experiences. Findings from this research explores why Veterans choose to, or not to, use the SM feature on MHV, identify facilitators and barriers, and examine if experiences differ by health literacy or computer literacy. In addition to the interview data, findings from the usability testing and the quantitative survey findings build knowledge about Veterans' experiences using the SM feature on MyHealtheVet. These data will inform systems improvements, educational approaches, and marketing strategies to increase adoption and long-term utilization among Veterans.
Detailed description
Project Background: Secure Messaging is a VHA implementation priority to improve Veteran access to care. Successful deployment of Secure Messaging will support improved access to care, and improved healthcare outcomes in the Veteran population. To support these initiatives, and the successful implementation of this health informatics tools in the VHA, this project is exploring Veterans' perspectives' about adopting Secure Messaging and their experiences using Secure Messaging to inform systems improvements, educational approaches, and marketing strategies. Objectives: The primary aim of this project is to describe Veterans' experiences when using the Secure Messaging feature on My HealtheVet (MHV). This research is designed to explore why Veterans choose to, or not to, use the Secure Messaging feature on MHV, identify facilitators and barriers, and examine if experiences differ by health literacy or computer literacy. In addition to the interview data, findings from the usability testing provide user data about Veterans' skills and patterns when using Secure Messaging. This study was extended to conduct a mail-in quantitative survey evaluation of Veterans experiences, preferences, purposes and perceived facilitators and barriers for using, or not using Secure Messaging. Methods: This is a prospective mixed-methods descriptive study. In Phase One: A purposive sampling was used to identify the sample of Veterans who have been Personally Authenticated for the Secure Messaging feature on My HealtheVet. Participants were recruited from two sites (Tampa n=18, Boston n=15). Phase 1 data collection procedures included: (1) surveys; (2) In-person interviews; (3) usability testing; (4) Secure Messaging secondary data collection; and (5) telephone interviews to complete study objectives. In Phase Two: Random sampling was used to collect mail-in survey data from up to 1,000 Veteran participants who have been personally authenticated to use secure messaging. Quantitative data will be summarized using descriptive statistics to describe sample characteristics, frequency counts and proportions. Study Status: The project team has completed data collection and analysis for Phase 1 and 2. Team is currently working on publications for dissemination.
Interventions
None listed
Sponsors
Study design
Eligibility
Inclusion criteria
* Individuals who have been Personally Authenticated for the SM feature on MHV and * who use SM independent of other caregivers, and * cognitive impairment that prevents use of a personal computer.
Exclusion criteria
* Unable or unwilling to provide informed consent.
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Usability of Secure Messaging | baseline | To determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task. |
| Secure Messaging Use and Content Patterns | 3 months | Extraction of secure messages over a three-month time frame to examine message content type, including: general, tests, medication, and appointments. |
| Frequency of Electronic Resource Use | baseline | Mail surveys examine Veterans frequency of electronic resource use. |
| Reasons for Using Secure Messaging Tool on My HealtheVet | baseline | Participants reported reasons for Using Secure Messaging tool on My HealtheVet |
| Benefits of Using Secure Messaging | baseline | Veterans report benefits of using Secure Messaging |
| Intention to Use Secure Messaging in the Future | baseline | Veteran respondent intention to use Secure Messaging in the future |
| Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table. | baseline | Veterans were asked to report if improvements to the secure messaging system would make the tool more useful for use in the future. |
| Veteran Need for Education Support for My HealtheVet and Secure Messaging Use. | baseline | Veterans were asked to report if they would like to have education and support using My HealtheVet and the Secure Messaging tool. |
Countries
United States
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Purposive Sampling Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas. | 33 |
| Random Sampling Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas. | 819 |
| Total | 852 |
Baseline characteristics
| Characteristic | Random Sampling | Total | Purposive Sampling |
|---|---|---|---|
| Age, Continuous | 62 years STANDARD_DEVIATION 13 | 60.75 years STANDARD_DEVIATION 12.5 | 59.5 years STANDARD_DEVIATION 12 |
| Ethnicity (NIH/OMB) Hispanic or Latino | 45 Participants | 47 Participants | 2 Participants |
| Ethnicity (NIH/OMB) Not Hispanic or Latino | 706 Participants | 734 Participants | 28 Participants |
| Ethnicity (NIH/OMB) Unknown or Not Reported | 68 Participants | 71 Participants | 3 Participants |
| Number of participants with annual income of $35,001 or more | 434 participants | 455 participants | 21 participants |
| Number of particpants with greater than or equal to high school education | 817 participants | 850 participants | 33 participants |
| Region of Enrollment United States | 819 participants | 852 participants | 33 participants |
| Sex: Female, Male Female | 107 Participants | 114 Participants | 7 Participants |
| Sex: Female, Male Male | 712 Participants | 738 Participants | 26 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | — / — | — / — |
| other Total, other adverse events | 0 / 0 | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 | 0 / 0 |
Outcome results
Benefits of Using Secure Messaging
Veterans report benefits of using Secure Messaging
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Benefits of Using Secure Messaging | Good communication tool | 619 participant |
| Purposive Sampling: Able to Complete Task | Benefits of Using Secure Messaging | Saves time | 590 participant |
| Purposive Sampling: Able to Complete Task | Benefits of Using Secure Messaging | Easy to use | 544 participant |
Frequency of Electronic Resource Use
Mail surveys examine Veterans frequency of electronic resource use.
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans. The purposive sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Everyday use of computer | 662 participants |
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Everyday use of internet | 653 participants |
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Use My HealtheVet a few times a month or less | 629 participants |
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Using secure messaging 6 months or longer | 499 participants |
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Use secure messaging at least once a year | 486 participants |
| Purposive Sampling: Able to Complete Task | Frequency of Electronic Resource Use | Use secure messaging at least once a month | 131 participants |
Intention to Use Secure Messaging in the Future
Veteran respondent intention to use Secure Messaging in the future
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Purposive Sampling: Able to Complete Task | Intention to Use Secure Messaging in the Future | 689 participant |
Reasons for Using Secure Messaging Tool on My HealtheVet
Participants reported reasons for Using Secure Messaging tool on My HealtheVet
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Completing medication refills | 546 participant |
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Medication questions | 313 participant |
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Managing appointments | 343 participant |
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Test results | 350 participant |
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Health related questions | 340 participant |
| Purposive Sampling: Able to Complete Task | Reasons for Using Secure Messaging Tool on My HealtheVet | Sensitive health topics | 67 participant |
Secure Messaging Use and Content Patterns
Extraction of secure messages over a three-month time frame to examine message content type, including: general, tests, medication, and appointments.
Time frame: 3 months
Population: This method of secondary data collection was conducted with the purposive sample of 33 Veterans in phase 1 of the study. The random sample of 819 Veteran survey respondents in phase 2 were not included in this method of data collection.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Secure Messaging Use and Content Patterns | General | 36 secure messages |
| Purposive Sampling: Able to Complete Task | Secure Messaging Use and Content Patterns | Test | 1 secure messages |
| Purposive Sampling: Able to Complete Task | Secure Messaging Use and Content Patterns | Appointment | 15 secure messages |
| Purposive Sampling: Able to Complete Task | Secure Messaging Use and Content Patterns | Medication | 10 secure messages |
| Purposive Sampling: Able to Complete Task | Secure Messaging Use and Content Patterns | Other: System Related not Content Related | 4 secure messages |
Usability of Secure Messaging
To determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task.
Time frame: baseline
Population: This user-testing method was conducted with the first purposive sample of 33 participants in phase 1 of the study. The random sample of 819 participants in phase 2 were not a part of the user-testing study method.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Formulate subject header | 18 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Send secure message | 30 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Use links within Secure Messaging | 33 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Log in to site | 30 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Open attachment | 33 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Open Secure Message | 33 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Navigate to My HealtheVet Site | 21 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Categorize message subject | 9 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Set User Preferences | 23 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Formulate a secure message | 33 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Choose secure message recipients | 32 participants |
| Purposive Sampling: Able to Complete Task | Usability of Secure Messaging | Check inbox | 33 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Open Secure Message | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Navigate to My HealtheVet Site | 10 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Log in to site | 2 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Set User Preferences | 8 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Check inbox | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Use links within Secure Messaging | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Formulate a secure message | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Open attachment | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Send secure message | 3 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Choose secure message recipients | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Categorize message subject | 0 participants |
| Purposive Sampling: Able to Complete Task With Difficulty | Usability of Secure Messaging | Formulate subject header | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Navigate to My HealtheVet Site | 2 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Send secure message | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Set User Preferences | 2 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Formulate a secure message | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Choose secure message recipients | 1 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Log in to site | 1 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Formulate subject header | 15 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Open Secure Message | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Use links within Secure Messaging | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Categorize message subject | 24 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Open attachment | 0 participants |
| Purposive Sampling: Not Able to Complete Task | Usability of Secure Messaging | Check inbox | 0 participants |
Veteran Need for Education Support for My HealtheVet and Secure Messaging Use.
Veterans were asked to report if they would like to have education and support using My HealtheVet and the Secure Messaging tool.
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Purposive Sampling: Able to Complete Task | Veteran Need for Education Support for My HealtheVet and Secure Messaging Use. | Reported need for education and support | 328 participant |
| Purposive Sampling: Able to Complete Task | Veteran Need for Education Support for My HealtheVet and Secure Messaging Use. | Report Veterans would benefit from education | 652 participant |
Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table.
Veterans were asked to report if improvements to the secure messaging system would make the tool more useful for use in the future.
Time frame: baseline
Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Purposive Sampling: Able to Complete Task | Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table. | 342 participant |