Covid19, Flu, Human, Influenza, Human
Conditions
Keywords
Belief Updating, Preventive Care, Racial Disparity
Brief summary
The aim of the study is to identify what sender/signal combinations are most persuasive in encouraging low socioeconomic males living in the U.S. to take-up seasonal flu vaccination. The investigators plan to recruit male subjects and randomly assign them to four persuasion treatments: three of which vary dimensions of the sender of a medical recommendation (racial concordance and authority treatments) and one which varies the signal (standard vs. empathetic). Specifically, the investigators will show subjects videos of either Black or white actors/actresses providing scripted information on the flu vaccination. The investigators will randomize the race of the sender and if the subject is Black, also randomize the authority of the sender, with the actor portraying either a doctor or a layperson. In addition, the investigators will vary the script used in the experiment between one that acknowledges past injustices (indicated as an empathetic script hereafter) and one that does not (indicated as a standard script hereafter). The investigators will provide subjects a free flu shot coupon and elicit the price at which subjects would be willing to give up this coupon for a cash reward. Lastly, in light of the relevance of vaccination take-up in combating COVID-19 pandemic, the investigators will assess demand for information about a COVID-19 vaccine, with subjects invited to receive results of a safety and efficacy review from a trusted or standard source. The design requires the collection of baseline and endline surveys combined with administrative data from pharmacies about coupon redemption. The primary outcomes of interest are posterior beliefs about seasonal flu vaccination, demand and willingness-to-pay (WTP) for a free flu shot coupon, redemption of the coupon, and demand for information about a COVID-19 vaccine.
Detailed description
The investigators will recruit approximately 3350 African-American or Caucasian adult males with a high-school diploma or less. A pilot study, which ran during the 2019-20 flu season, recruited approximately 850 subjects, and a planned scale-up will recruit an additional 2500 subjects during the 2020-21 flu season. The investigators will oversample African American individuals, emphasizing low-income and minority men because these characteristics are correlated with lower relative take-up of flu vaccination. After informed consent is obtained, subjects will be asked about sociodemographic information (age, education, income and marital status), healthcare experience and past medical history, knowledge and beliefs about flu vaccination, and location of the nearest pharmacy. The investigators will then randomly assign the adult male subjects to videos which contain one of Black or white actors playing the role of either a doctor or a layperson as well as different scripts. The content of the infomercial will be the safety and effectiveness of adult seasonal flu vaccination. After the video, the investigators will obtain information on beliefs regarding vaccination, feedback on the video, attention to the video and willingness-to-pay for a flu shot coupon. The final baseline module will consist of a randomly assigned invitation to receive the results of an upcoming review of a COVID-19 vaccine, with subjects assigned to receive information from a trusted or standard source. The investigators will track flu coupon redemption, which is redeemable at most pharmacies nationwide.
Interventions
The investigators will show subjects videos of either Black or white male actors providing scripted information on the flu vaccination. The content of the video will be the safety and effectiveness of adult seasonal flu vaccination. The videos contain one of Black or white actors playing the role of either a doctor or a layperson as well as different scripts.
Sponsors
Study design
Eligibility
Inclusion criteria
* Age: See above. * Education: Less than a college degree. * Gender: Male. * Race: Caucasian or African American. * Miscellaneous: Has not received the flu shot in the current flu season yet. * Miscellaneous: Has sound on his device turned on.
Exclusion criteria
* Fast survey-taking: subjects who are among the 5% fastest in terms of total time spent on survey within race and treatment group. * Nonsense answers (those that do not have decipherable English) in the open text sections that suggest low effort. * Inconsistent responses to questions (such as being willing to give up $10 to receive a flu coupon but not $1). * Repeat survey takers as indicated by duplicate emails or IP addresses in survey data.
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Rating of Sender | This outcome was assessed during Baseline survey, which took approximately 20 minutes. | This is an inverse-covariance-weighted index comprised of responses to survey questions regarding: 1. whether the respondent was interested in further medical advice from the given sender (measured as a binary outcome); 2. whether the respondent trusted advice from the sender measured on a scale of 1 to 5; 3. and whether the respondent's assessment of the sender's qualification to provide medical advice measured on a scale of 1 to 5. It is standardized to a mean of 0 and standard deviation of 1. Scores less than 0 indicate lower ratings of the sender rated by participants in Arm A (described in each arm/group description) compared to the rating rated by participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate higher ratings of the sender by Arm A compared to by Arm B. For example, an index score of .18 indicates that participants in Arm A rate the sender 0.18 index (in standard deviation units) higher than those in Arm B. |
| Rating of Signal | This outcome was assessed during Baseline survey, which took approximately 20 minutes. | This is an inverse-covariance-weighted index comprised of responses to survey questions on: 1. recommending the video to friends and family measured on a scale of 0 to 10; 2. recommending the flu shot to friends and family measured on a scale of 0 to 10; 3. and the respondent's assessment of the extent to which the information contained in the video was useful measured on a scale of 1 to 5. It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate lower ratings of the signal rated by participants in Arm A (described in each arm/group description) compared to the rating rated by participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate higher ratings of the signal by Arm A compared to by Arm B. For example, an index score of 0.14 indicates that participants in Arm A rate the signal 0.14 index (in standard deviation units) higher than those in Arm B. |
| Signal Content Recall | This outcome will be assessed during Baseline survey, which takes approximately 20 minutes. | This is an inverse-covariance-weighted index comprised of responses to survey questions on: 1. whether age group for whom the flu vaccine is recommended (measured as a binary outcome); and 2. whether the flu shot contains the flu virus (recall of information discussed in the video) (measured as a binary outcome). It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate lower level of recalling signal content among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of recalling signal content among participants in Arm A compared to those in Arm B. For example, an index score of 0.02 indicates that participants in Arm A recall signal content 0.02 index (in standard deviation units) higher than those in Arm B. |
| Safety Beliefs | This outcome will be assessed during Baseline survey, which takes approximately 20 minutes. | This is an inverse-covariance-weighted index comprised of: 1. the point belief on the likelihood to contract the flu from the flu shot measured by a Likert scale and rescaled to have a support of -1 to 1. 2. the certainty measured with a balls and bins method and rescaled to have a support of -1 to 1. It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate a lower level of beliefs in the safety of flu vaccine among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of beliefs among participants in Arm A compared to those in Arm B. For example, an index score of -0.1 indicates that participants in Arm A hold such beliefs 0.1 index (in standard deviation units) lower than those in Arm B. |
| Coupon Interest | This outcome was assessed during Baseline survey, which took approximately 20 minutes. | This is an inverse-covariance-weighted index comprised of revealed preference measures of demand for a free flu shot coupon: 1. Willingness to pay (WTP) for the coupon measured as $0, $1, $2, $5, or $10 2. demand for information regarding locations to redeem the coupon measured as a binary outcome It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate a lower level of interest in a free flu shot coupon distributed after survey completion among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of interest among participants in Arm A compared to those in Arm B. For example, an index score of -0.01 indicates that participants in Arm A hold such interest -0.01 index (in standard deviation units) higher than those in Arm B. |
| (Posterior) Flu Vaccine Intent | This outcome was assessed after the video treatment during Baseline survey, which took approximately 20 minutes. | This is the respondent's likelihood to receive the flu vaccine before the end of the flu season. This was elicited on an 11-point Likert scale (0 extremely unwilling, 10 extremely willing) after the video message treatment. We re-scaled this outcome to have a scale of 0 to 1. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, an intent of 0.03 indicates that participants in Arm A are 0.03 units on a scale more likely to intent to take up the flu vaccine compared to those in Arm B. |
| COVID-19 Vaccine Intent | This outcome was assessed after the video treatment during Baseline survey, which took approximately 20 minutes. | This is the respondent's likelihood to take up the COVID-19 vaccine if made available free of charge. This was elicited on an 11-point Likert scale (0 extremely unwilling, 10 extremely willing) after the video message treatment. We re-scaled this outcome to have a scale of 0 to 1. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, an intent of 0.04 indicates that participants in Arm A are 0.04 units on a scale more likely to intent to take up the COVID-19 vaccine compared to those in Arm B. |
| Flu Vaccine Take-up | This outcome was assessed during the follow-up survey which was conducted at least two weeks after the initial baseline survey. | This is respondents' self-report in the follow-up survey on whether they or their family members had received the flu shot or redeemed the coupon since the intervention. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, 15.0 percentage points indicate that participants in Arm A are more likely to report that they and/or another household member received the flu vaccine by 15.p percentage points compared to those in Arm B. |
Countries
United States
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Black Participant-Concordant Sender-Expert Sender-Standard Signal Black participants who are assigned to a concordant-exper sender delivering a standard signal. | 415 |
| Black Participant-Concordant Sender-Lay Sender-Standard Signal Black participants who are assigned to a concordant-lay sender delivering a standard signal. | 430 |
| Black Participant-Discordant Sender-Expert Sender-Standard Signal Black participants who are assigned to a discordant-exper sender delivering a standard signal. | 417 |
| Black Participant-Discordant Sender-Expert Sender-Acknowledgement Signal Black participants who are assigned to a discordant-exper sender delivering a acknowledgement signal. | 410 |
| White Participant-Concordant Sender-Expert Sender-Standard Signal White participants who are assigned to a concordant-exper sender delivering a standard signal. | 614 |
| White Participant-Discordant Sender-Expert Sender-Standard Signal White participants who are assigned to a discordant-exper sender delivering a standard signal. | 607 |
| Total | 2,893 |
Baseline characteristics
| Characteristic | Black Participant-Concordant Sender-Lay Sender-Standard Signal | Black Participant-Concordant Sender-Expert Sender-Standard Signal | Total | White Participant-Discordant Sender-Expert Sender-Standard Signal | White Participant-Concordant Sender-Expert Sender-Standard Signal | Black Participant-Discordant Sender-Expert Sender-Acknowledgement Signal | Black Participant-Discordant Sender-Expert Sender-Standard Signal |
|---|---|---|---|---|---|---|---|
| Age, Continuous | 35.53023 years STANDARD_DEVIATION 6.219959 | 35.92048 years STANDARD_DEVIATION 6.717987 | 36.82613 years STANDARD_DEVIATION 6.742281 | 38.16474 years STANDARD_DEVIATION 6.760583 | 38.11401 years STANDARD_DEVIATION 6.773668 | 35.90488 years STANDARD_DEVIATION 6.857133 | 36.1247 years STANDARD_DEVIATION 6.46877 |
| Has Primary Care Provider | 178 Participants | 189 Participants | 1374 Participants | 323 Participants | 321 Participants | 171 Participants | 192 Participants |
| High School Completed | 380 Participants | 359 Participants | 2555 Participants | 533 Participants | 554 Participants | 355 Participants | 374 Participants |
| High School Not completed | 50 Participants | 56 Participants | 338 Participants | 74 Participants | 60 Participants | 55 Participants | 43 Participants |
| Insured | 251 Participants | 234 Participants | 1763 Participants | 391 Participants | 403 Participants | 239 Participants | 245 Participants |
| Married | 86 Participants | 71 Participants | 711 Participants | 186 Participants | 202 Participants | 77 Participants | 89 Participants |
| (Prior) Flu Vaccine Intent | 2.786047 units on a scale STANDARD_DEVIATION 3.324808 | 2.554217 units on a scale STANDARD_DEVIATION 3.243176 | 2.566886 units on a scale STANDARD_DEVIATION 3.228842 | 2.52883 units on a scale STANDARD_DEVIATION 3.237376 | 2.596091 units on a scale STANDARD_DEVIATION 3.146201 | 2.485366 units on a scale STANDARD_DEVIATION 3.147713 | 2.446043 units on a scale STANDARD_DEVIATION 3.307566 |
| (Prior) Likelihood of Contracting Flu | 2.072093 units on a scale STANDARD_DEVIATION 2.791414 | 2.342169 units on a scale STANDARD_DEVIATION 2.853683 | 2.476668 units on a scale STANDARD_DEVIATION 2.774967 | 2.912685 units on a scale STANDARD_DEVIATION 2.701415 | 2.760586 units on a scale STANDARD_DEVIATION 2.603112 | 2.304878 units on a scale STANDARD_DEVIATION 2.86659 | 2.143885 units on a scale STANDARD_DEVIATION 2.823905 |
| Race (NIH/OMB) American Indian or Alaska Native | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Asian | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Black or African American | 430 Participants | 415 Participants | 1672 Participants | 0 Participants | 0 Participants | 410 Participants | 417 Participants |
| Race (NIH/OMB) More than one race | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Native Hawaiian or Other Pacific Islander | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) Unknown or Not Reported | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Race (NIH/OMB) White | 0 Participants | 0 Participants | 1221 Participants | 607 Participants | 614 Participants | 0 Participants | 0 Participants |
| Region of Enrollment United States | 430 participants | 415 participants | 2893 participants | 607 participants | 614 participants | 410 participants | 417 participants |
| Sex: Female, Male Female | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants | 0 Participants |
| Sex: Female, Male Male | 430 Participants | 415 Participants | 2893 Participants | 607 Participants | 614 Participants | 410 Participants | 417 Participants |
| Subjective Flu Shot Cost | 42.74393 dollar STANDARD_DEVIATION 85.77928 | 43.91588 dollar STANDARD_DEVIATION 91.2157 | 33.56405 dollar STANDARD_DEVIATION 70.94346 | 25.02221 dollar STANDARD_DEVIATION 48.44235 | 25.28546 dollar STANDARD_DEVIATION 50.80593 | 33.8441 dollar STANDARD_DEVIATION 72.69948 | 38.14388 dollar STANDARD_DEVIATION 79.24301 |
| Subjective Health Status | 3.751163 units on a scale STANDARD_DEVIATION 1.003925 | 3.522892 units on a scale STANDARD_DEVIATION 1.009056 | 3.468372 units on a scale STANDARD_DEVIATION 1.030375 | 3.237232 units on a scale STANDARD_DEVIATION 0.9965605 | 3.21987 units on a scale STANDARD_DEVIATION 0.992071 | 3.653659 units on a scale STANDARD_DEVIATION 1.056843 | 3.642686 units on a scale STANDARD_DEVIATION 1.0069 |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk | EG002 affected / at risk | EG003 affected / at risk | EG004 affected / at risk | EG005 affected / at risk |
|---|---|---|---|---|---|---|
| deaths Total, all-cause mortality | 0 / 479 | 0 / 496 | 0 / 478 | 0 / 485 | 0 / 649 | 0 / 658 |
| other Total, other adverse events | 0 / 479 | 0 / 496 | 0 / 478 | 0 / 485 | 0 / 649 | 0 / 658 |
| serious Total, serious adverse events | 0 / 479 | 0 / 496 | 0 / 478 | 0 / 485 | 0 / 649 | 0 / 658 |
Outcome results
Coupon Interest
This is an inverse-covariance-weighted index comprised of revealed preference measures of demand for a free flu shot coupon: 1. Willingness to pay (WTP) for the coupon measured as $0, $1, $2, $5, or $10 2. demand for information regarding locations to redeem the coupon measured as a binary outcome It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate a lower level of interest in a free flu shot coupon distributed after survey completion among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of interest among participants in Arm A compared to those in Arm B. For example, an index score of -0.01 indicates that participants in Arm A hold such interest -0.01 index (in standard deviation units) higher than those in Arm B.
Time frame: This outcome was assessed during Baseline survey, which took approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Coupon Interest | -.0078177 index |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Coupon Interest | -.0827849 index |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Coupon Interest | .0280955 index |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Coupon Interest | -.0162865 index |
COVID-19 Vaccine Intent
This is the respondent's likelihood to take up the COVID-19 vaccine if made available free of charge. This was elicited on an 11-point Likert scale (0 extremely unwilling, 10 extremely willing) after the video message treatment. We re-scaled this outcome to have a scale of 0 to 1. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, an intent of 0.04 indicates that participants in Arm A are 0.04 units on a scale more likely to intent to take up the COVID-19 vaccine compared to those in Arm B.
Time frame: This outcome was assessed after the video treatment during Baseline survey, which took approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | COVID-19 Vaccine Intent | .0350147 units on a scale |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | COVID-19 Vaccine Intent | .009072 units on a scale |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | COVID-19 Vaccine Intent | .0544277 units on a scale |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | COVID-19 Vaccine Intent | .0881949 units on a scale |
Flu Vaccine Take-up
This is respondents' self-report in the follow-up survey on whether they or their family members had received the flu shot or redeemed the coupon since the intervention. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, 15.0 percentage points indicate that participants in Arm A are more likely to report that they and/or another household member received the flu vaccine by 15.p percentage points compared to those in Arm B.
Time frame: This outcome was assessed during the follow-up survey which was conducted at least two weeks after the initial baseline survey.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Flu Vaccine Take-up | -7.70997 percentage points |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Flu Vaccine Take-up | -01.39307 percentage points |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Flu Vaccine Take-up | -12.00413 percentage points |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Flu Vaccine Take-up | 14.96955 percentage points |
(Posterior) Flu Vaccine Intent
This is the respondent's likelihood to receive the flu vaccine before the end of the flu season. This was elicited on an 11-point Likert scale (0 extremely unwilling, 10 extremely willing) after the video message treatment. We re-scaled this outcome to have a scale of 0 to 1. The reported results of the outcome compare participants in Arm A and Arm B (described in each arm/group description). For example, an intent of 0.03 indicates that participants in Arm A are 0.03 units on a scale more likely to intent to take up the flu vaccine compared to those in Arm B.
Time frame: This outcome was assessed after the video treatment during Baseline survey, which took approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | (Posterior) Flu Vaccine Intent | .0263281 units on a scale |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | (Posterior) Flu Vaccine Intent | .0034755 units on a scale |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | (Posterior) Flu Vaccine Intent | .0268659 units on a scale |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | (Posterior) Flu Vaccine Intent | .0187403 units on a scale |
Rating of Sender
This is an inverse-covariance-weighted index comprised of responses to survey questions regarding: 1. whether the respondent was interested in further medical advice from the given sender (measured as a binary outcome); 2. whether the respondent trusted advice from the sender measured on a scale of 1 to 5; 3. and whether the respondent's assessment of the sender's qualification to provide medical advice measured on a scale of 1 to 5. It is standardized to a mean of 0 and standard deviation of 1. Scores less than 0 indicate lower ratings of the sender rated by participants in Arm A (described in each arm/group description) compared to the rating rated by participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate higher ratings of the sender by Arm A compared to by Arm B. For example, an index score of .18 indicates that participants in Arm A rate the sender 0.18 index (in standard deviation units) higher than those in Arm B.
Time frame: This outcome was assessed during Baseline survey, which took approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Rating of Sender | .1828917 index |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Rating of Sender | -.0750636 index |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Rating of Sender | .0997998 index |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Rating of Sender | -.5397662 index |
Rating of Signal
This is an inverse-covariance-weighted index comprised of responses to survey questions on: 1. recommending the video to friends and family measured on a scale of 0 to 10; 2. recommending the flu shot to friends and family measured on a scale of 0 to 10; 3. and the respondent's assessment of the extent to which the information contained in the video was useful measured on a scale of 1 to 5. It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate lower ratings of the signal rated by participants in Arm A (described in each arm/group description) compared to the rating rated by participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate higher ratings of the signal by Arm A compared to by Arm B. For example, an index score of 0.14 indicates that participants in Arm A rate the signal 0.14 index (in standard deviation units) higher than those in Arm B.
Time frame: This outcome was assessed during Baseline survey, which took approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Rating of Signal | .1387205 index |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Rating of Signal | -.0088105 index |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Rating of Signal | .1423725 index |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Rating of Signal | -.0806321 index |
Safety Beliefs
This is an inverse-covariance-weighted index comprised of: 1. the point belief on the likelihood to contract the flu from the flu shot measured by a Likert scale and rescaled to have a support of -1 to 1. 2. the certainty measured with a balls and bins method and rescaled to have a support of -1 to 1. It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate a lower level of beliefs in the safety of flu vaccine among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of beliefs among participants in Arm A compared to those in Arm B. For example, an index score of -0.1 indicates that participants in Arm A hold such beliefs 0.1 index (in standard deviation units) lower than those in Arm B.
Time frame: This outcome will be assessed during Baseline survey, which takes approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Safety Beliefs | -.0979564 index |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Safety Beliefs | -.027714 index |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Safety Beliefs | -.1065867 index |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Safety Beliefs | -.0242752 index |
Signal Content Recall
This is an inverse-covariance-weighted index comprised of responses to survey questions on: 1. whether age group for whom the flu vaccine is recommended (measured as a binary outcome); and 2. whether the flu shot contains the flu virus (recall of information discussed in the video) (measured as a binary outcome). It is standardized to a mean of 0 and standard deviation of 1. An index score of 0 is equal to the mean. Scores less than 0 indicate lower level of recalling signal content among participants in Arm A (described in each arm/group description) compared to the level among participants in Arm B (also described in each arm/group description). Scores greater than 0 indicate a higher level of recalling signal content among participants in Arm A compared to those in Arm B. For example, an index score of 0.02 indicates that participants in Arm A recall signal content 0.02 index (in standard deviation units) higher than those in Arm B.
Time frame: This outcome will be assessed during Baseline survey, which takes approximately 20 minutes.
Population: Arms/Groups are combined as described in each arm/group description in order to test hypotheses prespecified in the analysis plan as well as to measure the effect of the given intervention on the outcome among the group of participants in Arm A compared to Arm B. The intervention and Arms A and B are described in each arm/group description.
| Arm | Measure | Value (NUMBER) |
|---|---|---|
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - Black Participants | Signal Content Recall | -.0062555 index |
| Concordant (Arm A) vs. Discordant Expert Sender (Arm B) - White Participants | Signal Content Recall | .0193832 index |
| Acknowledgement (Arm A) vs. Standard Signal (Arm B) - Black Participants | Signal Content Recall | .0041984 index |
| Layperson Sender (Arm A) vs. Expert Sender (Arm B) - Black Participants | Signal Content Recall | .1166304 index |