Academic Support for Black Middle School Student Success in STEM
Conditions
Brief summary
Black students experience significant achievement gaps that contribute to underrepresentation in high paying STEM fields and disparity in health and economic outcomes. Effective middle-school interventions include exposure to culturally relevant STEM role models, instruction in academic behaviors and growth mindset, instruction in the academic vocabulary required to pass high stakes achievement tests, and support for family engagement. The goal of this proposal is to develop a media-enhanced technology that offers Black middle school students and their families a culturally responsive support tool for engaging in STEM learning in the home setting.
Detailed description
The feasibility test will consist of a 6-week intervention to assess the program's relevance, acceptability, cultural appropriateness, and potential for efficacy. The study will use a within-subjects pre-post design with 50 parent-student dyads to detect changes in student word knowledge, academic enabling behaviors, mindset, academic self-efficacy, and interest in STEM. Measures will also detect changes in parent word knowledge, use of AV words in the home, and self-efficacy with regard to AV use and academic support behaviors. Additionally, a post-test evaluation of consumer satisfaction, technology acceptability, and recommendations for modifications to the program will be administered to both students and their parents/guardians. Usage reports will be collected from the technology's backend system to measure frequency and duration of student and parent engagement with the technology components as well as numbers of correct/incorrect responses.
Interventions
OTHERTechnology-based educational intervention
Mobile app to deliver culturally responsive role modeling and evidence-based instruction (modeling, practice, feedback) in the academic vocabulary, behaviors, and mindset that underlie STEM success.
Sponsors
Oregon Research Behavioral Intervention Strategies, Inc.
National Institute on Minority Health and Health Disparities (NIMHD)
Study design
Allocation
NA
Intervention model
SINGLE_GROUP
Primary purpose
OTHER
Masking
NONE
Intervention model description
Mobile app to deliver culturally responsive role modeling and evidencebased instruction (modeling, practice, feedback) in the academic vocabulary, behaviors, and mindset that underlie STEM success.
Eligibility
Sex/Gender
ALL
Age
10 Years to No maximum
Healthy volunteers
Yes
Inclusion criteria
1. being the parent/guardian of a middle school student who identifies as Black/African American 2. having a smartphone or tablet
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Student Academic Vocabulary Word Meaning (SAVM) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SAVM will measure change in student vocabulary knowledge (multiple choice test of meaning). The multiple choice test is based on the assessment used in Beck et al. (1982) and McKeown et al. (1983) with middle school students. Scores were computed as the total percentage of vocabulary words correctly identified out of 72. Score could range from 0 to 100 and higher scores indicate greater levels of vocabulary knowledge. |
| Parent Academic Vocabulary Word Meaning (PAVM) | Baseline (pre-treatment) and 6 weeks (post-treatment) | PAVM will measure change in parent vocabulary knowledge (multiple choice test of meaning). The multiple choice test is based on the assessment used in Beck et al. (1982) and McKeown et al. (1983) with middle school students. Scores were computed as the total percentage of vocabulary words correctly identified out of 72. Score could range from 0 to 100 and higher scores indicate greater levels of vocabulary knowledge. |
| Student Academic Vocabulary Word Usage (SAVWU) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SAVWU will measure change in student ability to correctly use vocabulary words in sentence contexts. The sentence verification test is similar to the Test of Instructed Word Knowledge in Vocabulary used in the Apthorp et al. (2012) study of vocabulary learning in middle school. Scores were computed as the total percentage of vocabulary words correctly used in sentence context out of 72 items. Score could range from 0 to 100, and higher scores indicate greater levels of vocabulary words used correctly in a sentence. |
| Parent Academic Vocabulary Word Usage (PAVWU) | Baseline (pre-treatment) and 6 weeks (post-treatment) | PAVWU will measure change in parent ability to correctly use vocabulary words in sentence contexts. The sentence verification test is similar to the Test of Instructed Word Knowledge in Vocabulary used in the Apthorp et al. (2012) study of vocabulary learning in middle school. Scores were computed as the total percentage of vocabulary words correctly used in sentence context out of 72 items. Score could range from 0 to 100 and higher scores indicate greater levels of vocabulary words used correctly in a sentence. |
| Student Fixed Mindset (SFM) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SFM is a four-item survey measure of fixed mindset. Student responds to statements about their beliefs about learning and intelligence. The measure uses a 6-point scale. The item scores are averaged into a single scale and can range from 1 to 6, with higher values corresondeing to more fixed mindsets. The measure has demonstrated reliability (Yeager et al., 2016). |
| Student Academic Behaviors (SAB) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SAB is a five-item survey measure of academic behaviors strongly linked to student success. Students respond to questions about how frequently they engage in these behaviors (e.g., turn in assignments on time). The measure uses a 5-point scale (1 = strongly disagree, 5 = strongly agree) and a mean score was computed and could range from 1 to 5. Higher scores indicated greater levels of perceived academic learning behaviors., and has demonstrated reliability (Snipes \& Tran, 2016). |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Student Academic Vocabulary Usage Behaviors (SAVUB) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SAVUB will measure change in student use of SAV words (10 items). Items were adapted from: the Student Engagement Instrument (SEI; Betts, Appleton, Reschly, et al., 2010). Items used a 4-point response option (1 = not at all, 4 = 3-4 times per week) and a mean score and could range from 1 to 4. Higher scores indicated greater use of SAV words. |
| Parent Academic Vocabulary Usage Behaviors (SAVUB) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SAVUB will measure change in parent use of SAV words (10 items). Items were adapted from: the Student Engagement Instrument (SEI; Betts, Appleton, Reschly, et al., 2010). Items used a 4-point response option (1 = not at all, 4 = 3-4 times per week) and a mean score and could range from 1 to 4. Higher scores indicated greater use of SAV words. |
| Student Confidence in using AV words (SCAV) | Baseline (pre-treatment) and 6 weeks (post-treatment) | SCAV will measure student confidence in using SAV words (10 items). Items were adapted from the Efficacy to Influence School-related Performance subscale of the Parental Self-Efficacy Scale (PSES; Bandura, et al., 2001). Items were developed using procedures for developing self-efficacy scales (Bandura et al., 2001). Items used a 5-point response option (1 = not at all confident, 5 = extremely confident) and a mean score was computed and could range from 1 to 5. Higher scores indicated greater confidence using SAV words. |
| Parent Confidence in using AV words (PCAV) | Baseline (pre-treatment) and 6 weeks (post-treatment) | PCAV will measure parent confidence in using SAV words (10 items). Items were adapted from the Efficacy to Influence School-related Performance subscale of the Parental Self-Efficacy Scale (PSES; Bandura, et al., 2001). Items were developed using procedures for developing self-efficacy scales (Bandura et al., 2001). Items used a 5-point response option (1 = not at all confident, 5 = extremely confident) and a mean score was computed (alpha = .95) and could range from 1 to 5. Higher scores indicated greater confidence using SAV words. |
| Student Interest in choosing STEM careers (STEM) | Baseline (pre-treatment) and 6 weeks (post-treatment) | STEM will measure students' interest in STEM careers (4 items). Items were adapted from: the Student Engagement Instrument (SEI; Betts, Appleton, Reschly, et al., 2010) and the Efficacy to Influence School-related Performance subscale of the Parental Self-Efficacy Scale (PSES; Bandura, et al., 2001). Items used a 5-point response option (1 = not at all interested, 5 = extremely interested) and a mean score was computed and could range from 1 to 5. Higher scores indicated greater interest in using SAV words. |
| Student Technology Acceptance (STA) - Acceptability of Intervention (AIM) | 6-weeks after baseline (Post treatment) | Acceptability of Intervention Measure (AIM; 4-items) is a measure that often used in formative studies and are considered leading indicators of implementation success (Proctor et al., 2011; Bowen et al., 2009). Uses a 5-point response option, have demonstrated reliability, test-retest reliability, and shown to assess sensitivity to change (Weiner et al. 2017). A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater acceptability of the intervention. |
| Student Technology Acceptance (STA) - Intervention Appropriateness Measure (IAM) | 6-weeks after baseline (Post treatment) | Intervention Appropriateness Measure (IAM; 4-items) is a measure that often used in formative studies and are considered leading indicators of implementation success (Proctor et al., 2011; Bowen et al., 2009). Uses a 5-point response option, have demonstrated reliability, test-retest reliability, and shown to assess sensitivity to change (Weiner et al. 2017). A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater approriateness of the intervention. |
| Parent Technology Acceptance (PTA) - Acceptability of Intervention (AIM) | 6-weeks after baseline (post treatment) | Acceptability of Intervention Measure (AIM; 4-items) is a measure that often used in formative studies and are considered leading indicators of implementation success (Proctor et al., 2011; Bowen et al., 2009). Uses a 5-point response option, have demonstrated reliability, test-retest reliability, and shown to assess sensitivity to change (Weiner et al. 2017). A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater acceptability of the intervention. |
| Parent Technology Acceptance (PTA) - Intervention Approriateness Measure (IAM) | 6-weeks after baseline (post treatment) | Intervention Appropriateness Measure (IAM; 4-items) is a measure that often used in formative studies and are considered leading indicators of implementation success (Proctor et al., 2011; Bowen et al., 2009). Uses a 5-point response option, have demonstrated reliability, test-retest reliability, and shown to assess sensitivity to change (Weiner et al. 2017). A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater approriateness of the intervention. |
| Student Satisfaction with STEM-AIM Program | 6-weeks after baseline (post treatment) | Student satisfaction with the STEM-AIM program will be measured with 15 items that ask students to rate, on a 5-point Likert response scale, the degree to which the STEM-AIM features were helpful, useful, enjoyable, and met their expectations. A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater satisfaction with the program. |
| Parent Satisfaction with STEM-AIM Program | 6-weeks after baseline (post treatment) | Parent satisfaction with the STEM-AIM program will be measured with 15 items that ask parents to rate, on a 5-point Likert response scale, the degree to which the STEM-AIM features were helpful, useful, enjoyable, and met their expectations. A mean score will be computed and scores can range from 1 to 5. Higher scores indicate greater satisfaction with the program. |
Contacts
CONTACTDavid R Smith, PhD
PRINCIPAL_INVESTIGATORDavid R Smith, PhD
Oregon Research Behavioral Intervention Strategies, Inc.
Outcome results
None listed