Skip to content

Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- UCLA Portal R/R Influenza RCT 3

Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- RCT 3

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT04533685
Enrollment
213773
Registered
2020-08-31
Start date
2020-09-01
Completion date
2021-04-01
Last updated
2022-10-25

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Influenza, Respiratory Tract Infections

Keywords

Vaccination, Reminder recall, Patient Portal

Brief summary

This trial is taking place in Los Angeles, CA among patients from primary care practices within the UCLA Health System. The study design is a 2x2x2 factorial design, nested in a parallel 2-arm trial. The parallel arms are control v. reminder letter (reminder messages sent via the patient portal, reminding participants of an overdue influenza vaccine) Nested within the reminder letter arm, we will have 3 additional components: * A direct scheduling link within the reminder letter enabling the patient to schedule an influenza vaccine only visit (direct scheduling link vs. no direct scheduling link). * A pre-commitment prompt (pre-commitment prompt vs. no prompt) asking about a patient's intention to get the influenza vaccination * A pre-appointment reminder, encouraging patients to ask for their influenza vaccine at their upcoming appointment (pre-appointment reminder encouraging influenza vaccination vs. standard pre-appointment reminder not mentioning influenza vaccination)

Detailed description

This trial is taking place in Los Angeles, CA among patients from primary care practices within the UCLA Health System, using 2x2x2 factorial design, nested in a parallel 2-arm trial. Sub-optimal vaccination rates are a significant problem in the U.S., despite their effectiveness in preventing morbidity and mortality from vaccine-preventable illness. For influenza specifically, annual epidemics of influenza cause substantial morbidity in the U.S. with up to 40,00-80,000 deaths/year and many hospitalizations, emergency and outpatient visits, and significant costs. Reminder/recall (R/R) messages, sent by phone, mail or other modality, can improve child and adult influenza vaccination rates. However, the majority of pediatric or adult primary care practices to not conduct R/R. Barriers are lack of finances, personnel, and algorithms to identify eligible patients. A technological breakthrough that might overcome these barriers involves patient portals-- secure, web-based communication systems, embedded within electronic health records (EHRs), for patients and providers to communicate with each other via email and the internet. Portals are used by about half of Americans and half of UCLA patients. This randomized controlled trial will assess the effectiveness of reminders messages, encouraging influenza vaccination, sent to patient portal users on increasing influenza vaccination rates within a health system by randomizing patients to two groups: 1) two-thirds of patients will receive reminder letters, 2) one-third will not receive reminders. Patients in the reminder arm will be further randomized (separately) for three additional components: 1) direct appointment scheduling, 2) pre-commitment prompts and 3) pre-appointment reminders. Direct scheduling: The convenience of scheduling an appointment for influenza vaccination may increase the likelihood that patients receive an influenza vaccination. Patients receiving reminders will be randomized to receive one of two types of reminder letters: 1) one half will receive flu vaccine reminder letters with a link to the MyChart direct appointment scheduling page and 2) one half will receive flu vaccine reminder message without the direct appointment scheduling link. Pre-commitment: Another potential influence on the decision to vaccinate is pre-commitment. Previous studies suggest that, upon being prompted, indicating an intention to do something increases the likelihood of following through. Patients will be randomized to one of two groups: 1) one half will receive pre-commitment prompt at the beginning of influenza vaccination season and 2) one half will not receive a pre-commitment prompt. The pre-commitment prompt asks whether the patient intends to receive influenza vaccine, and where and when they plan to get the vaccine. Pre-appointment flu reminders: Finally, a missed opportunities for vaccination occurs when patients are eligible for vaccination but are not offered a vaccine at their medical appointment. Pre-appointment reminders, sent in advance of an upcoming appointment, encouraging the patient talk to their doctor about influenza vaccination, may increase the likelihood of that patient receiving a vaccine. Patients will be randomized to one of two groups: 1) one half will receive modified pre-appointment reminders that mention influenza vaccination and 2) one half will receive the standard pre-appointment reminders for an upcoming appointment (no mention of influenza vaccination).

Interventions

BEHAVIORALPortal Reminders for Influenza Vaccination: Direct scheduling link

Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit

BEHAVIORALPortal Reminders for Influenza Vaccination: No direct scheduling link

Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)

Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination

BEHAVIORALPre-Appointment flu vaccine reminders

Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine

Sponsors

National Institute of Allergy and Infectious Diseases (NIAID)
CollaboratorNIH
University of California, Los Angeles
Lead SponsorOTHER

Study design

Allocation
RANDOMIZED
Intervention model
FACTORIAL
Primary purpose
HEALTH_SERVICES_RESEARCH
Masking
SINGLE (Subject)

Intervention model description

A 2x2x2 factorial design, nested within a parallel 2-arm trial.

Eligibility

Sex/Gender
ALL
Age
4 Months to No maximum
Healthy volunteers
No

Inclusion criteria

A patient within the UCLA Health System identified as a primary care patient per an internal algorithm.

Exclusion criteria

A patient within the UCLA Health System not identified as a primary care patient per an internal algorithm

Design outcomes

Primary

MeasureTime frameDescription
Number of Index Patients Who Received Annual Influenza Vaccine6 monthsReceipt of the annual influenza vaccination (between 8/1/20 - 4/1/21) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. The index patients must also be an active UCLA Health MyChart user (\>= 1 login over the last 12 months from 8/1/20, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis.

Countries

United States

Participant flow

Participants by arm

ArmCount
Direct Scheduling + Pre-commitment + Pre-appt Reminder
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine
17,848
Direct Scheduling + Pre-commitment
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination
17,842
Direct Scheduling + Pre-appt Reminder
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine
17,832
Direct Scheduling
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit
17,827
No Direct Scheduling + Pre-commitment + Pre-Appt Reminder
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine
17,821
No Direct Scheduling + Pre-commitment
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination
17,819
No Direct Scheduling + Pre-appt Reminder
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine
17,812
No Direct Scheduling
Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling for a flu vaccine appointment Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)
17,805
Control Arm
Participants will not receive any reminder/recall messages regarding influenza vaccination via the patient portal or other intervention components
71,167
Total213,773

Baseline characteristics

CharacteristicDirect Scheduling + Pre-commitment + Pre-appt ReminderDirect Scheduling + Pre-commitmentDirect Scheduling + Pre-appt ReminderDirect SchedulingNo Direct Scheduling + Pre-commitment + Pre-Appt ReminderNo Direct Scheduling + Pre-commitmentNo Direct Scheduling + Pre-appt ReminderNo Direct SchedulingControl ArmTotal
Age, Customized
18-64 years
13166 Participants13234 Participants13208 Participants13202 Participants13274 Participants13148 Participants13238 Participants13122 Participants52973 Participants158565 Participants
Age, Customized
<18 years
1556 Participants1561 Participants1535 Participants1547 Participants1511 Participants1535 Participants1546 Participants1576 Participants6071 Participants18438 Participants
Age, Customized
65+ years
3126 Participants3047 Participants3089 Participants3078 Participants3036 Participants3136 Participants3028 Participants3107 Participants12123 Participants36770 Participants
Primary Insurance Class
Commercial
12407 Participants12544 Participants12458 Participants12393 Participants12562 Participants12443 Participants12581 Participants12367 Participants49916 Participants149671 Participants
Primary Insurance Class
Group Health Plan
42 Participants38 Participants27 Participants37 Participants36 Participants49 Participants31 Participants42 Participants160 Participants462 Participants
Primary Insurance Class
International Payor
5 Participants4 Participants3 Participants3 Participants4 Participants5 Participants6 Participants5 Participants12 Participants47 Participants
Primary Insurance Class
Medi-Cal
280 Participants261 Participants270 Participants260 Participants247 Participants265 Participants263 Participants242 Participants1063 Participants3151 Participants
Primary Insurance Class
Medicare
2055 Participants1938 Participants2040 Participants2025 Participants1950 Participants2023 Participants1967 Participants2043 Participants7949 Participants23990 Participants
Primary Insurance Class
Other
223 Participants216 Participants217 Participants195 Participants220 Participants197 Participants190 Participants226 Participants888 Participants2572 Participants
Primary Insurance Class
Package Billing
1 Participants0 Participants1 Participants0 Participants0 Participants1 Participants1 Participants1 Participants0 Participants5 Participants
Primary Insurance Class
Self-pay
3 Participants2 Participants1 Participants2 Participants1 Participants2 Participants1 Participants3 Participants5 Participants20 Participants
Primary Insurance Class
Tricare
108 Participants106 Participants123 Participants121 Participants125 Participants120 Participants109 Participants117 Participants475 Participants1404 Participants
Primary Insurance Class
UCLA Managed Care
2688 Participants2700 Participants2662 Participants2760 Participants2648 Participants2683 Participants2623 Participants2723 Participants10566 Participants32053 Participants
Primary Insurance Class
Unknown
36 Participants33 Participants30 Participants31 Participants28 Participants31 Participants40 Participants36 Participants133 Participants398 Participants
Primary Language
English
17504 Participants17518 Participants17521 Participants17522 Participants17451 Participants17420 Participants17451 Participants17448 Participants69771 Participants209606 Participants
Primary Language
Other
192 Participants180 Participants166 Participants171 Participants231 Participants227 Participants198 Participants188 Participants800 Participants2353 Participants
Primary Language
Spanish
134 Participants133 Participants135 Participants122 Participants130 Participants157 Participants145 Participants155 Participants525 Participants1636 Participants
Primary Language
Uknown
18 Participants11 Participants10 Participants12 Participants9 Participants15 Participants18 Participants14 Participants71 Participants178 Participants
Race/Ethnicity, Customized
American Indian or Alaska Native
49 Participants53 Participants43 Participants46 Participants43 Participants34 Participants41 Participants47 Participants127 Participants483 Participants
Race/Ethnicity, Customized
Asian
1638 Participants1756 Participants1713 Participants1703 Participants1713 Participants1793 Participants1677 Participants1770 Participants6750 Participants20513 Participants
Race/Ethnicity, Customized
Black
826 Participants814 Participants821 Participants849 Participants837 Participants811 Participants787 Participants829 Participants3332 Participants9906 Participants
Race/Ethnicity, Customized
Hispanic or Latino
1802 Participants1840 Participants1828 Participants1877 Participants1894 Participants1857 Participants1883 Participants1868 Participants7400 Participants22249 Participants
Race/Ethnicity, Customized
Multiracial
526 Participants527 Participants500 Participants517 Participants522 Participants539 Participants476 Participants494 Participants2022 Participants6123 Participants
Race/Ethnicity, Customized
Not Hispanic or Latino
13227 Participants13081 Participants13272 Participants13271 Participants13164 Participants13235 Participants13111 Participants13221 Participants52663 Participants158245 Participants
Race/Ethnicity, Customized
Other
2449 Participants2491 Participants2456 Participants2472 Participants2475 Participants2439 Participants2509 Participants2465 Participants9796 Participants29552 Participants
Race/Ethnicity, Customized
Unknown
2620 Participants2677 Participants2597 Participants2534 Participants2637 Participants2528 Participants2686 Participants2540 Participants10406 Participants33279 Participants
Race/Ethnicity, Customized
White or Caucasian
9705 Participants9501 Participants9662 Participants9676 Participants9557 Participants9648 Participants9602 Participants9628 Participants38560 Participants115539 Participants
Sex/Gender, Customized
Female
10100 Participants10130 Participants10158 Participants10028 Participants10179 Participants10169 Participants10116 Participants10190 Participants40517 Participants121587 Participants
Sex/Gender, Customized
Male
7748 Participants7711 Participants7674 Participants7797 Participants7642 Participants7648 Participants7696 Participants7615 Participants30646 Participants92177 Participants
Sex/Gender, Customized
Other
0 Participants0 Participants0 Participants0 Participants0 Participants0 Participants0 Participants0 Participants1 Participants1 Participants
Sex/Gender, Customized
Unknown
0 Participants1 Participants0 Participants2 Participants0 Participants2 Participants0 Participants0 Participants3 Participants8 Participants

Adverse events

Event typeEG000
affected / at risk
EG001
affected / at risk
EG002
affected / at risk
EG003
affected / at risk
EG004
affected / at risk
EG005
affected / at risk
EG006
affected / at risk
EG007
affected / at risk
EG008
affected / at risk
deaths
Total, all-cause mortality
0 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 0
other
Total, other adverse events
0 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 0
serious
Total, serious adverse events
0 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 00 / 0

Outcome results

Primary

Number of Index Patients Who Received Annual Influenza Vaccine

Receipt of the annual influenza vaccination (between 8/1/20 - 4/1/21) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. The index patients must also be an active UCLA Health MyChart user (\>= 1 login over the last 12 months from 8/1/20, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis.

Time frame: 6 months

ArmMeasureValue (COUNT_OF_PARTICIPANTS)
Direct Scheduling + Pre-commitment + Pre-appt ReminderNumber of Index Patients Who Received Annual Influenza Vaccine6982 Participants
Direct Scheduling + Pre-commitmentNumber of Index Patients Who Received Annual Influenza Vaccine6988 Participants
Direct Scheduling + Pre-appt ReminderNumber of Index Patients Who Received Annual Influenza Vaccine6920 Participants
Direct SchedulingNumber of Index Patients Who Received Annual Influenza Vaccine6990 Participants
No Direct Scheduling + Pre-commitment + Pre-Appt ReminderNumber of Index Patients Who Received Annual Influenza Vaccine7002 Participants
No Direct Scheduling + Pre-commitmentNumber of Index Patients Who Received Annual Influenza Vaccine6999 Participants
No Direct Scheduling + Pre-appt ReminderNumber of Index Patients Who Received Annual Influenza Vaccine6945 Participants
No Direct SchedulingNumber of Index Patients Who Received Annual Influenza Vaccine6891 Participants
Control ArmNumber of Index Patients Who Received Annual Influenza Vaccine27645 Participants
Comparison: Comparing the risk of receiving an influenza vaccination95% CI: [1, 1.02]
Comparison: Comparing the risk of receiving an influenza vaccination95% CI: [0.98, 1.01]
Comparison: Comparing the risk of receiving an influenza vaccination95% CI: [1, 1.01]
Comparison: Comparing the risk of receiving an influenza vaccination95% CI: [0.99, 1.01]

Source: ClinicalTrials.gov · Data processed: Feb 4, 2026