Language Development
Conditions
Brief summary
After development of the Talk Stem Familia (TSF) smart-speaker application prototype, the study will evaluate the prototype's efficacy in a within-subjects pre-post design study. The sample will contain 50 parent-student/child dyads who will use the Alexa skill app for 6 weeks.
Detailed description
Participants will receive an Echo Dot device enabled with the application prototype using a research Amazon account created for each dyad. The Echo Dot devices will be preconfigured by project staff onto research Amazon accounts. Parents will come to one of several orientation sessions to obtain their device and set-up instructions; staff will provide follow-up phone support as needed. Usage data will show how much the device is used by each dyad. To ensure exposure to TSF, parents will be asked to engage at least 3 times per week; project staff will prompt parents bi-weekly (via text, email, device notification, phone) during the 6-week intervention to encourage usage and provide needed technical support.
Interventions
BEHAVIORALTalk STEM Familia app
The Talk STEM Familia app will be used to improve access to sound instruction in scientific academic vocabulary through the development of a technology-enhanced, culturally responsive smart-speaker tool that engages Latino families in culturally responsive academic language acquisition and practice in the home setting.
Sponsors
National Institute on Minority Health and Health Disparities (NIMHD)
Oregon Research Behavioral Intervention Strategies, Inc.
Study design
Allocation
NA
Intervention model
SINGLE_GROUP
Primary purpose
OTHER
Masking
NONE
Intervention model description
One-arm, single-group, feasibility study with parent/student dyads.
Eligibility
Sex/Gender
ALL
Age
8 Years to No maximum
Healthy volunteers
Yes
Inclusion criteria
* Latino parents and their children who are students in grades 3 through 6. * Parents have Spanish as primary home language. * Family has wi-fi in the home. * No age limits for parents. Their child must be in grades 3 through 6.
Exclusion criteria
* Parents and their children who are students in grade levels below grade 3 or above grade 6. * Parents do not have Spanish as primary home language. * Family does not have wi-fi in the home. * Children younger than 8 (or in grade levels below grade 3).
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Parent Academic Vocabulary Usage in Spanish | Baseline (pretest) and 6 weeks (posttest) | The Parent Academic Vocabulary Usage in Spanish measure includes 18 true/false questions testing student knowledge of correct usage of the 18 academic vocabulary words taught in the TSF app. |
| Student Academic Vocabulary Knowledge in English | Baseline (pretest) and 6 weeks (posttest) | The Student Academic Vocabulary Knowledge in English measure includes 18 multiple choice questions on the 18 words taught in the TSF app. The student chooses the correct word meaning from among four (4) possible responses. Students receive one point for each word correctly identified and points are summed across the 18 items. Scores can range from 0-18 and a higher score indicates greater vocabulary knowledge. |
| Parent Academic Vocabulary Knowledge in Spanish | Baseline (pretest) and 6 weeks (posttest) | The Parent Academic Vocabulary Knowledge in Spanish measure includes 18 multiple choice questions on the 18 words taught in the TSF app. The parent chooses the correct word meaning from among four (4) possible responses. Parents receive one point for each word correctly identified and points are summed across the 18 items. Scores can range from 0-18 and a higher score indicates greater vocabulary knowledge. |
| Student Academic Vocabulary Usage in English | Baseline (pretest) and 6 weeks (posttest) | The Student Academic Vocabulary Usage in English measure includes 18 true/false questions testing student knowledge of correct usage of the 18 academic vocabulary words taught in the TSF app. |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Student Engagement Instrument | Baseline (pretest) and 6 weeks (posttest) | The Student Engagement Instrument (SEI; Betts, Appleton, Reschly, et al., 2010) consists of three subscales (future aspirations and goals, 5 items, r = .80, family support for learning, 6 items, r = .79, and control and relevance of school work, 9 items, r = 70). The SEI scale for each item ranges from 1-Strongly disagree to 5- Strongly agree with 5 indicating greater self-efficacy (more positive). A sum score was computed for each subscale. For future aspirations the scores can range from 5 to 25 and a higher score indicates a more positive outcome; greater self-efficacy for future aspirations. For family support for learning the score can range from 6 to 30 and a higher scores indicates a more positive outcome; greater self-efficacy for family support for learning. For control and relevance of school work the scores can range from 9 to 45 and a greater score indicates a more positive outcome; greater self-efficacy for control and relevance of school work. |
| The Efficacy to Influence School-related Performance Subscale of the Parental Self-Efficacy Scale | Baseline (pretest) and 6 weeks (posttest) | The Efficacy to Influence School-related Performance subscale of the Parental Self-Efficacy Scale (PSES; Bandura, et al., 2001) (completed in Spanish) to measure useful factors that reflect parents' perceptions of whether they can influence their child's academic performance. The PSES consists of 8 items on a 9-point scale ranging from 1 = nothing to 9 = a great deal . The measure has an internal reliability of .87. A mean composite score was computed and the scores can range from 1 to 9 with a higher score indicating a more positive outcome; greater levels of self-efficacy. |
| Student Academic Language Learning Behaviors | Baseline (pretest) and 6 weeks (posttest) | The Student Academic Language Learning Behaviors measure includes 11 items asking students to estimate the frequency of discrete learning behaviors such as saying scientific words out loud in English and using scientific words in sentences. The measure uses a 4-point scale of frequency with 1 being Not at all and 4 being 3-4 times a week. A sum score for the 11 items was computed and the scores could range from 11 to 44. Higher scores indicate a more positive outcome; greater frequency of behaviors. |
| Parent Academic Enabling Behaviors | Baseline (pretest) and 6 weeks (posttest) | The Parent Academic Enabling Behaviors measure includes 13 items asking parents to estimate the frequency of their discrete academic enabling behaviors, such as helping their child learn the meaning of scientific words and using scientific words in a conversation with their child. The measure uses a 4-point scale of frequency with 1 being Not at all and 4 being 3-4 times a week. A sum score including all 13 items was computed and can range between 13 and 52. Higher scores indicate a more positive outcome; greater frequency of behaviors. |
Countries
United States
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Talk STEM Familia App This arm will test the feasibility of the Talk STEM Familia app to improve English language acquisition and family engagement and promote long-term educational and health outcomes among first- and second-generation Latino families.
Talk STEM Familia app: The Talk STEM Familia app will be used to improve access to sound instruction in scientific academic vocabulary through the development of a technology-enhanced, culturally responsive smart-speaker tool that engages Latino families in culturally responsive academic language acquisition and practice in the home setting. | 100 |
| Total | 100 |
Withdrawals & dropouts
| Period | Reason | FG000 |
|---|---|---|
| Overall Study | Withdrawal by Subject | 6 |
Baseline characteristics
| Characteristic | Talk STEM Familia App |
|---|---|
| Age, Categorical <=18 years | 50 Participants |
| Age, Categorical >=65 years | 0 Participants |
| Age, Categorical Between 18 and 65 years | 50 Participants |
| Race/Ethnicity, Customized Parent race/ethnicity African American/Black | 2 Participants |
| Race/Ethnicity, Customized Parent race/ethnicity American Indian or Alaskan Native | 1 Participants |
| Race/Ethnicity, Customized Parent race/ethnicity Euro American/Caucasian | 7 Participants |
| Race/Ethnicity, Customized Parent race/ethnicity More than one race | 28 Participants |
| Race/Ethnicity, Customized Parent race/ethnicity Prefer not to disclose | 12 Participants |
| Sex: Female, Male Parent participants Female | 44 Participants |
| Sex: Female, Male Parent participants Male | 6 Participants |
| Sex: Female, Male Student participants Female | 29 Participants |
| Sex: Female, Male Student participants Male | 21 Participants |
Adverse events
| Event type | EG000 affected / at risk |
|---|---|
| deaths Total, all-cause mortality | 0 / 0 |
| other Total, other adverse events | 0 / 0 |
| serious Total, serious adverse events | 0 / 0 |
Outcome results
Primary
Parent Academic Vocabulary Knowledge in Spanish
The Parent Academic Vocabulary Knowledge in Spanish measure includes 18 multiple choice questions on the 18 words taught in the TSF app. The parent chooses the correct word meaning from among four (4) possible responses. Parents receive one point for each word correctly identified and points are summed across the 18 items. Scores can range from 0-18 and a higher score indicates greater vocabulary knowledge.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx English learner parents
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Parent Academic Vocabulary Knowledge in Spanish | Pretest | 12.40 Number of correct responses | Standard Deviation 3.36 |
| Talk STEM Familia App | Parent Academic Vocabulary Knowledge in Spanish | Posttest | 13.58 Number of correct responses | Standard Deviation 3.11 |
p-value: 0.022t-test, 2 sided
Primary
Parent Academic Vocabulary Usage in Spanish
The Parent Academic Vocabulary Usage in Spanish measure includes 18 true/false questions testing student knowledge of correct usage of the 18 academic vocabulary words taught in the TSF app.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner parents.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Parent Academic Vocabulary Usage in Spanish | Pre-test | 14.08 percentage of correct responses | Standard Deviation 2.58 |
| Talk STEM Familia App | Parent Academic Vocabulary Usage in Spanish | Post-test | 15.03 percentage of correct responses | Standard Deviation 1.96 |
p-value: 0.002t-test, 2 sided
Primary
Student Academic Vocabulary Knowledge in English
The Student Academic Vocabulary Knowledge in English measure includes 18 multiple choice questions on the 18 words taught in the TSF app. The student chooses the correct word meaning from among four (4) possible responses. Students receive one point for each word correctly identified and points are summed across the 18 items. Scores can range from 0-18 and a higher score indicates greater vocabulary knowledge.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner students.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Student Academic Vocabulary Knowledge in English | Pretest | 9.36 Number of correct responses | Standard Deviation 3.71 |
| Talk STEM Familia App | Student Academic Vocabulary Knowledge in English | Posttest | 11.39 Number of correct responses | Standard Deviation 3.87 |
p-value: 0.003t-test, 2 sided
Primary
Student Academic Vocabulary Usage in English
The Student Academic Vocabulary Usage in English measure includes 18 true/false questions testing student knowledge of correct usage of the 18 academic vocabulary words taught in the TSF app.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner students.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Student Academic Vocabulary Usage in English | Pre-test | 12.14 percentage of correct responses | Standard Deviation 3.01 |
| Talk STEM Familia App | Student Academic Vocabulary Usage in English | Post-test | 13.48 percentage of correct responses | Standard Deviation 2.95 |
p-value: 0.016t-test, 2 sided
Secondary
Parent Academic Enabling Behaviors
The Parent Academic Enabling Behaviors measure includes 13 items asking parents to estimate the frequency of their discrete academic enabling behaviors, such as helping their child learn the meaning of scientific words and using scientific words in a conversation with their child. The measure uses a 4-point scale of frequency with 1 being Not at all and 4 being 3-4 times a week. A sum score including all 13 items was computed and can range between 13 and 52. Higher scores indicate a more positive outcome; greater frequency of behaviors.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner students.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Parent Academic Enabling Behaviors | Parent academic enabling behavior at pre-test | 18.24 score on a scale | Standard Deviation 7.45 |
| Talk STEM Familia App | Parent Academic Enabling Behaviors | Parent academic enabling behavior at post-test | 25.76 score on a scale | Standard Deviation 9.47 |
p-value: <0.001t-test, 2 sided
Secondary
Student Academic Language Learning Behaviors
The Student Academic Language Learning Behaviors measure includes 11 items asking students to estimate the frequency of discrete learning behaviors such as saying scientific words out loud in English and using scientific words in sentences. The measure uses a 4-point scale of frequency with 1 being Not at all and 4 being 3-4 times a week. A sum score for the 11 items was computed and the scores could range from 11 to 44. Higher scores indicate a more positive outcome; greater frequency of behaviors.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner students.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Student Academic Language Learning Behaviors | Student academic language learning behavior at pre-test | 23.53 score on a scale | Standard Deviation 7.65 |
| Talk STEM Familia App | Student Academic Language Learning Behaviors | Student academic language learning behavior at post-test | 27.01 score on a scale | Standard Deviation 8.51 |
p-value: <0.001t-test, 2 sided
Secondary
Student Engagement Instrument
The Student Engagement Instrument (SEI; Betts, Appleton, Reschly, et al., 2010) consists of three subscales (future aspirations and goals, 5 items, r = .80, family support for learning, 6 items, r = .79, and control and relevance of school work, 9 items, r = 70). The SEI scale for each item ranges from 1-Strongly disagree to 5- Strongly agree with 5 indicating greater self-efficacy (more positive). A sum score was computed for each subscale. For future aspirations the scores can range from 5 to 25 and a higher score indicates a more positive outcome; greater self-efficacy for future aspirations. For family support for learning the score can range from 6 to 30 and a higher scores indicates a more positive outcome; greater self-efficacy for family support for learning. For control and relevance of school work the scores can range from 9 to 45 and a greater score indicates a more positive outcome; greater self-efficacy for control and relevance of school work.
Time frame: Baseline (pretest) and 6 weeks (posttest)
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | Student Engagement Instrument | Family support pre-test | 25.18 score on a scale | Standard Deviation 3.88 |
| Talk STEM Familia App | Student Engagement Instrument | Future aspirations post-test | 21.73 score on a scale | Standard Deviation 2.76 |
| Talk STEM Familia App | Student Engagement Instrument | Relevance to schoolwork pre-test | 35.68 score on a scale | Standard Deviation 5.93 |
| Talk STEM Familia App | Student Engagement Instrument | Relevance to schoolwork post-test | 36.06 score on a scale | Standard Deviation 5.17 |
| Talk STEM Familia App | Student Engagement Instrument | Future aspirations pre-test | 21.78 score on a scale | Standard Deviation 2.94 |
| Talk STEM Familia App | Student Engagement Instrument | Family support post-test | 25.11 score on a scale | Standard Deviation 3.66 |
Comparison: The statistical analyses for the Student Self-Efficacy, in terms of type of statistical test, method, and the comments which we state within-subjects paired t-tests, are the same for each of the three subscales that make up Student Self-Efficacy (i.e., Relevance to schoolwork, Future aspirations, and Family support).p-value: 0.626t-test, 2 sided
Comparison: The statistical analyses for the Student Self-Efficacy, in terms of type of statistical test, method, and the comments which we state within-subjects paired t-tests, are the same for each of the three subscales that make up Student Self-Efficacy (i.e., Relevance to schoolwork, Future aspirations, and Family support).p-value: 0.909t-test, 2 sided
Comparison: The statistical analyses for the Student Self-Efficacy, in terms of type of statistical test, method, and the comments which we state within-subjects paired t-tests, are the same for each of the three subscales that make up Student Self-Efficacy (i.e., Relevance to schoolwork, Future aspirations, and Family support).p-value: 0.905t-test, 2 sided
Secondary
The Efficacy to Influence School-related Performance Subscale of the Parental Self-Efficacy Scale
The Efficacy to Influence School-related Performance subscale of the Parental Self-Efficacy Scale (PSES; Bandura, et al., 2001) (completed in Spanish) to measure useful factors that reflect parents' perceptions of whether they can influence their child's academic performance. The PSES consists of 8 items on a 9-point scale ranging from 1 = nothing to 9 = a great deal . The measure has an internal reliability of .87. A mean composite score was computed and the scores can range from 1 to 9 with a higher score indicating a more positive outcome; greater levels of self-efficacy.
Time frame: Baseline (pretest) and 6 weeks (posttest)
Population: Latinx, English-learner parents.
| Arm | Measure | Group | Value (MEAN) | Dispersion |
|---|---|---|---|---|
| Talk STEM Familia App | The Efficacy to Influence School-related Performance Subscale of the Parental Self-Efficacy Scale | Parental Self-Efficacy at pre-test | 7.26 score on a scale | Standard Deviation 1.19 |
| Talk STEM Familia App | The Efficacy to Influence School-related Performance Subscale of the Parental Self-Efficacy Scale | Parental Self-Efficacy at post-test | 7.62 score on a scale | Standard Deviation 1.08 |
p-value: 0.054t-test, 2 sided