Health Behavior, Telehealth
Conditions
Keywords
Behavioral Economics, Patient Portal, Social Proof, Endowment Effect, Less-is-better
Brief summary
The purpose of the current study is to test different email messages to determine the most effect way of promoting enrollment in Geisinger's patient portal, called myGeisinger.
Detailed description
Online patient portals are convenient tools that improve patient access to healthcare services while often reducing burden to both patients and providers. However, fewer than half of patients have enrolled in Geisinger's patient portal, myGeisinger. The purpose of the current study is to assess what kind of messaging improves the effectiveness of an email campaign targeted at enrolling patients into Geisinger's online patient portal, called myGeisinger. Currently, Geisinger sends an email every month to patients who have started but not completed the enrollment process (they have had an activation code generated but have not yet used that code to enroll). This study will A/B test 5 email messages to assess if they perform better than the current standard email message. Performance will be assessed based on whether patients open the email, click on the myGeisinger enrollment link, and enroll in myGeisinger. Statistical analyses will employ generalized linear models with a binary distribution and log-link function.
Interventions
Sponsors
Study design
Eligibility
Inclusion criteria
* Geisinger patients whose myGeisinger status is Pending, meaning an activation code has been generated for them, but they have not completed activation
Exclusion criteria
* Patients without email addresses on file * Patients who received emails from this monthly myGeisinger marketing campaign within the last 2 months
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 8-10 days post-intervention | Whether email was opened (yes / no) |
| Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 8-10 days post-intervention | Whether the link / button to start the activation process was clicked (yes / no) |
| Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 8-10 days post-intervention | Whether the patient enrolled in myGeisinger (yes / no) |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 8-10 days post-intervention | Whether email was opened (yes / no) |
| Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 32-35 days post-intervention | Whether email was opened (yes / no) |
| Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 8-10 days post-intervention | Whether the patient enrolled in myGeisinger (yes / no) |
| Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 8-10 days post-intervention | Whether the link / button to start the activation process was clicked (yes / no) |
| Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 32-35 days post-intervention | Whether the link / button to start the activation process was clicked (yes / no) |
| Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 32-35 days post-intervention | Whether the patient enrolled in myGeisinger (yes / no) |
Countries
United States
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Control A standard marketing message encouraging activation and describing the benefits of myGeisinger
Standard email: Email | 2,350 |
| Focused on Provider Communication A simple message focused on one benefit of myGeisinger: communicating easily with providers
Less-is-better: Email | 2,350 |
| Focused on Scheduling A simple message focused on one benefit of myGeisinger: scheduling and managing appointments online
Less-is-better: Email | 2,350 |
| Focused on Medical Information Access A simple message focused on one benefit of myGeisinger: accessing medical information, like test results
Less-is-better: Email | 2,350 |
| Social Proof A message similar to control, but including information about how many other patients are using myGeisinger
Social proof: Email | 2,350 |
| Endowment / Decision Staging A message similar to control, but framing myGeisinger as something that patients already have, and just need to take one more step to activate.
Endowment: Give patients the impression they already have the account, so they value it more.
Decision staging: Break down the process into multiple stages - having an account and activating that account- and giving the impression that they are almost there because the first stage is complete
Endowment / decision staging: Email | 2,349 |
| Total | 14,099 |
Baseline characteristics
| Characteristic | Total | Focused on Provider Communication | Focused on Scheduling | Focused on Medical Information Access | Social Proof | Control | Endowment / Decision Staging |
|---|---|---|---|---|---|---|---|
| Age, Categorical <=18 years | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants |
| Age, Categorical >=65 years | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants |
| Age, Categorical Between 18 and 65 years | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants |
| Race and Ethnicity Not Collected | 0 Participants | — | — | — | — | — | — |
| Region of Enrollment United States | 14099 participants | 2350 participants | 2350 participants | 2350 participants | 2350 participants | 2350 participants | 2349 participants |
| Sex: Female, Male Female | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants |
| Sex: Female, Male Male | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants | NA Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk | EG002 affected / at risk | EG003 affected / at risk | EG004 affected / at risk | EG005 affected / at risk |
|---|---|---|---|---|---|---|
| deaths Total, all-cause mortality | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 |
| other Total, other adverse events | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 | 0 / 0 |
Outcome results
Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether email was opened (yes / no)
Time frame: 8-10 days post-intervention
Population: Patients who were delivered an email (i.e. email did not bounce back) and for whom there was a record in the EHR 10 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 558 Participants |
| Less-is-better | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 1528 Participants |
| Social Proof | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 375 Participants |
| Endowment / Decision Staging | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 488 Participants |
Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether the patient enrolled in myGeisinger (yes / no)
Time frame: 8-10 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 10 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 41 Participants |
| Less-is-better | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 83 Participants |
| Social Proof | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 18 Participants |
| Endowment / Decision Staging | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 38 Participants |
Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether the link / button to start the activation process was clicked (yes / no)
Time frame: 8-10 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 10 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 134 Participants |
| Less-is-better | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 160 Participants |
| Social Proof | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 31 Participants |
| Endowment / Decision Staging | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 73 Participants |
Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether email was opened (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who were delivered an email (i.e. email did not bounce back) and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 591 Participants |
| Less-is-better | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 1626 Participants |
| Social Proof | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 402 Participants |
| Endowment / Decision Staging | Email Opened: Control vs. Less-is-better vs. Social Proof vs. Endowment | 512 Participants |
Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether email was opened (yes / no)
Time frame: 8-10 days post-intervention
Population: Patients who were delivered an email (i.e. email did not bounce back) and for whom there was a record in the EHR 10 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 524 Participants |
| Less-is-better | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 522 Participants |
| Social Proof | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 482 Participants |
Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether email was opened (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who were delivered an email (i.e. email did not bounce back) and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 568 Participants |
| Less-is-better | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 554 Participants |
| Social Proof | Email Opened: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 504 Participants |
Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether the patient enrolled in myGeisinger (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 55 Participants |
| Less-is-better | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 152 Participants |
| Social Proof | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 29 Participants |
| Endowment / Decision Staging | Enrollment: Control vs. Less-is-better vs. Social Proof vs. Endowment | 55 Participants |
Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether the patient enrolled in myGeisinger (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 54 Participants |
| Less-is-better | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 46 Participants |
| Social Proof | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 52 Participants |
Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether the patient enrolled in myGeisinger (yes / no)
Time frame: 8-10 days post-intervention
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 24 Participants |
| Less-is-better | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 28 Participants |
| Social Proof | Enrollment: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 31 Participants |
Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment
Whether the link / button to start the activation process was clicked (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 147 Participants |
| Less-is-better | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 188 Participants |
| Social Proof | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 34 Participants |
| Endowment / Decision Staging | Link Clicked: Control vs. Less-is-better vs. Social Proof vs. Endowment | 86 Participants |
Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether the link / button to start the activation process was clicked (yes / no)
Time frame: 32-35 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 32 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 57 Participants |
| Less-is-better | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 51 Participants |
| Social Proof | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 80 Participants |
Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access)
Whether the link / button to start the activation process was clicked (yes / no)
Time frame: 8-10 days post-intervention
Population: Patients who opened the intervention email and for whom there was a record in the EHR 10 days post-intervention.
| Arm | Measure | Value (COUNT_OF_PARTICIPANTS) |
|---|---|---|
| Control | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 45 Participants |
| Less-is-better | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 42 Participants |
| Social Proof | Link Clicked: Within Less-is-better (Provider Communication vs. Managing Appointments vs. Medical Information Access) | 73 Participants |