Skip to content

Veterans Experiences Using Secure Messaging

Veterans' Experiences Using Secure Messaging on MyHealtheVet

Status
Completed
Phases
Unknown
Study type
Observational
Source
ClinicalTrials.gov
Registry ID
NCT01382186
Enrollment
852
Registered
2011-06-27
Start date
2012-04-30
Completion date
2013-09-30
Last updated
2015-04-28

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Telemedicine

Keywords

Qualitative, User, Computer Interface, quantitative, survey, telemedicine

Brief summary

Deployment of Secure Messaging (SM) in primary care and women's clinics throughout the Veteran Health System by 2011 was an implementation priority for the Secretary and Under Secretary for Health for FY11 under the VHA T21 initiative. Secure Messaging is in early phases of implementation, this eHealth tool requires thoughtful evaluation to promote the successful implementation and dissemination of this tool. The primary aim of this project is to describe Veterans' experiences when using the SM feature on MyHealtheVet (MHV). This project has local, VISN, and national impact on the implementation and sustainability of the SM feature on MHV through its qualitative and quantitative examination of users' experiences. Findings from this research explores why Veterans choose to, or not to, use the SM feature on MHV, identify facilitators and barriers, and examine if experiences differ by health literacy or computer literacy. In addition to the interview data, findings from the usability testing and the quantitative survey findings build knowledge about Veterans' experiences using the SM feature on MyHealtheVet. These data will inform systems improvements, educational approaches, and marketing strategies to increase adoption and long-term utilization among Veterans.

Detailed description

Project Background: Secure Messaging is a VHA implementation priority to improve Veteran access to care. Successful deployment of Secure Messaging will support improved access to care, and improved healthcare outcomes in the Veteran population. To support these initiatives, and the successful implementation of this health informatics tools in the VHA, this project is exploring Veterans' perspectives' about adopting Secure Messaging and their experiences using Secure Messaging to inform systems improvements, educational approaches, and marketing strategies. Objectives: The primary aim of this project is to describe Veterans' experiences when using the Secure Messaging feature on My HealtheVet (MHV). This research is designed to explore why Veterans choose to, or not to, use the Secure Messaging feature on MHV, identify facilitators and barriers, and examine if experiences differ by health literacy or computer literacy. In addition to the interview data, findings from the usability testing provide user data about Veterans' skills and patterns when using Secure Messaging. This study was extended to conduct a mail-in quantitative survey evaluation of Veterans experiences, preferences, purposes and perceived facilitators and barriers for using, or not using Secure Messaging. Methods: This is a prospective mixed-methods descriptive study. In Phase One: A purposive sampling was used to identify the sample of Veterans who have been Personally Authenticated for the Secure Messaging feature on My HealtheVet. Participants were recruited from two sites (Tampa n=18, Boston n=15). Phase 1 data collection procedures included: (1) surveys; (2) In-person interviews; (3) usability testing; (4) Secure Messaging secondary data collection; and (5) telephone interviews to complete study objectives. In Phase Two: Random sampling was used to collect mail-in survey data from up to 1,000 Veteran participants who have been personally authenticated to use secure messaging. Quantitative data will be summarized using descriptive statistics to describe sample characteristics, frequency counts and proportions. Study Status: The project team has completed data collection and analysis for Phase 1 and 2. Team is currently working on publications for dissemination.

Interventions

None listed

Sponsors

US Department of Veterans Affairs
Lead SponsorFED

Study design

Observational model
COHORT
Time perspective
PROSPECTIVE

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes

Inclusion criteria

* Individuals who have been Personally Authenticated for the SM feature on MHV and * who use SM independent of other caregivers, and * cognitive impairment that prevents use of a personal computer.

Exclusion criteria

* Unable or unwilling to provide informed consent.

Design outcomes

Primary

MeasureTime frameDescription
Usability of Secure MessagingbaselineTo determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task.
Secure Messaging Use and Content Patterns3 monthsExtraction of secure messages over a three-month time frame to examine message content type, including: general, tests, medication, and appointments.
Frequency of Electronic Resource UsebaselineMail surveys examine Veterans frequency of electronic resource use.
Reasons for Using Secure Messaging Tool on My HealtheVetbaselineParticipants reported reasons for Using Secure Messaging tool on My HealtheVet
Benefits of Using Secure MessagingbaselineVeterans report benefits of using Secure Messaging
Intention to Use Secure Messaging in the FuturebaselineVeteran respondent intention to use Secure Messaging in the future
Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table.baselineVeterans were asked to report if improvements to the secure messaging system would make the tool more useful for use in the future.
Veteran Need for Education Support for My HealtheVet and Secure Messaging Use.baselineVeterans were asked to report if they would like to have education and support using My HealtheVet and the Secure Messaging tool.

Countries

United States

Participant flow

Participants by arm

ArmCount
Purposive Sampling
Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas.
33
Random Sampling
Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas.
819
Total852

Baseline characteristics

CharacteristicRandom SamplingTotalPurposive Sampling
Age, Continuous62 years
STANDARD_DEVIATION 13
60.75 years
STANDARD_DEVIATION 12.5
59.5 years
STANDARD_DEVIATION 12
Ethnicity (NIH/OMB)
Hispanic or Latino
45 Participants47 Participants2 Participants
Ethnicity (NIH/OMB)
Not Hispanic or Latino
706 Participants734 Participants28 Participants
Ethnicity (NIH/OMB)
Unknown or Not Reported
68 Participants71 Participants3 Participants
Number of participants with annual income of $35,001 or more434 participants455 participants21 participants
Number of particpants with greater than or equal to high school education817 participants850 participants33 participants
Region of Enrollment
United States
819 participants852 participants33 participants
Sex: Female, Male
Female
107 Participants114 Participants7 Participants
Sex: Female, Male
Male
712 Participants738 Participants26 Participants

Adverse events

Event typeEG000
affected / at risk
EG001
affected / at risk
deaths
Total, all-cause mortality
— / —— / —
other
Total, other adverse events
0 / 00 / 0
serious
Total, serious adverse events
0 / 00 / 0

Outcome results

Primary

Benefits of Using Secure Messaging

Veterans report benefits of using Secure Messaging

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskBenefits of Using Secure MessagingGood communication tool619 participant
Purposive Sampling: Able to Complete TaskBenefits of Using Secure MessagingSaves time590 participant
Purposive Sampling: Able to Complete TaskBenefits of Using Secure MessagingEasy to use544 participant
Primary

Frequency of Electronic Resource Use

Mail surveys examine Veterans frequency of electronic resource use.

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans. The purposive sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseEveryday use of computer662 participants
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseEveryday use of internet653 participants
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseUse My HealtheVet a few times a month or less629 participants
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseUsing secure messaging 6 months or longer499 participants
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseUse secure messaging at least once a year486 participants
Purposive Sampling: Able to Complete TaskFrequency of Electronic Resource UseUse secure messaging at least once a month131 participants
Primary

Intention to Use Secure Messaging in the Future

Veteran respondent intention to use Secure Messaging in the future

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureValue (NUMBER)
Purposive Sampling: Able to Complete TaskIntention to Use Secure Messaging in the Future689 participant
Primary

Reasons for Using Secure Messaging Tool on My HealtheVet

Participants reported reasons for Using Secure Messaging tool on My HealtheVet

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetCompleting medication refills546 participant
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetMedication questions313 participant
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetManaging appointments343 participant
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetTest results350 participant
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetHealth related questions340 participant
Purposive Sampling: Able to Complete TaskReasons for Using Secure Messaging Tool on My HealtheVetSensitive health topics67 participant
Primary

Secure Messaging Use and Content Patterns

Extraction of secure messages over a three-month time frame to examine message content type, including: general, tests, medication, and appointments.

Time frame: 3 months

Population: This method of secondary data collection was conducted with the purposive sample of 33 Veterans in phase 1 of the study. The random sample of 819 Veteran survey respondents in phase 2 were not included in this method of data collection.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskSecure Messaging Use and Content PatternsGeneral36 secure messages
Purposive Sampling: Able to Complete TaskSecure Messaging Use and Content PatternsTest1 secure messages
Purposive Sampling: Able to Complete TaskSecure Messaging Use and Content PatternsAppointment15 secure messages
Purposive Sampling: Able to Complete TaskSecure Messaging Use and Content PatternsMedication10 secure messages
Purposive Sampling: Able to Complete TaskSecure Messaging Use and Content PatternsOther: System Related not Content Related4 secure messages
Primary

Usability of Secure Messaging

To determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task.

Time frame: baseline

Population: This user-testing method was conducted with the first purposive sample of 33 participants in phase 1 of the study. The random sample of 819 participants in phase 2 were not a part of the user-testing study method.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingFormulate subject header18 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingSend secure message30 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingUse links within Secure Messaging33 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingLog in to site30 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingOpen attachment33 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingOpen Secure Message33 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingNavigate to My HealtheVet Site21 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingCategorize message subject9 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingSet User Preferences23 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingFormulate a secure message33 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingChoose secure message recipients32 participants
Purposive Sampling: Able to Complete TaskUsability of Secure MessagingCheck inbox33 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingOpen Secure Message0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingNavigate to My HealtheVet Site10 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingLog in to site2 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingSet User Preferences8 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingCheck inbox0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingUse links within Secure Messaging0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingFormulate a secure message0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingOpen attachment0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingSend secure message3 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingChoose secure message recipients0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingCategorize message subject0 participants
Purposive Sampling: Able to Complete Task With DifficultyUsability of Secure MessagingFormulate subject header0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingNavigate to My HealtheVet Site2 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingSend secure message0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingSet User Preferences2 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingFormulate a secure message0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingChoose secure message recipients1 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingLog in to site1 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingFormulate subject header15 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingOpen Secure Message0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingUse links within Secure Messaging0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingCategorize message subject24 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingOpen attachment0 participants
Purposive Sampling: Not Able to Complete TaskUsability of Secure MessagingCheck inbox0 participants
Primary

Veteran Need for Education Support for My HealtheVet and Secure Messaging Use.

Veterans were asked to report if they would like to have education and support using My HealtheVet and the Secure Messaging tool.

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureGroupValue (NUMBER)
Purposive Sampling: Able to Complete TaskVeteran Need for Education Support for My HealtheVet and Secure Messaging Use.Reported need for education and support328 participant
Purposive Sampling: Able to Complete TaskVeteran Need for Education Support for My HealtheVet and Secure Messaging Use.Report Veterans would benefit from education652 participant
Primary

Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table.

Veterans were asked to report if improvements to the secure messaging system would make the tool more useful for use in the future.

Time frame: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

ArmMeasureValue (NUMBER)
Purposive Sampling: Able to Complete TaskVeterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table.342 participant

Source: ClinicalTrials.gov · Data processed: Feb 4, 2026