Skip to content

Evaluation of an Enhanced Delivery Model for Go NAPSACC

A Hybrid Effectiveness-implementation Trial of Go NAPSACC: A Childcare-based Obesity Prevention Program

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT03938103
Enrollment
364
Registered
2019-05-06
Start date
2019-04-10
Completion date
2022-12-31
Last updated
2024-08-15

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Obesity

Keywords

preschool, child care centers, nutrition, physical activity, organizational readiness, behavior change, cost-effectiveness, implementation

Brief summary

This study will compare the effectiveness and cost of Basic and Enhanced delivery models for Go NAPSACC on child care centers' use of evidence-based nutrition and physical activity practices. Technical assistance (TA) coaches from Child Care Aware of Kentucky will lead delivery. Half of the TA coaches will deliver Go NAPSACC using the Basic model and the other half will deliver the program using the Enhanced model. It is hypothesized that the Enhanced model will result in greater use of evidence-based nutrition and physical activity practices and will also be more cost effective.

Detailed description

This research study will use a type 3 hybrid effectiveness-implementation design with a randomized controlled trial to evaluate the impact of Go NAPSACC when using basic vs enhanced implementation models (i.e., Basic Go NAPSACC vs. Enhanced Go NAPSACC). To evaluate impact, measures collected at baseline and post-intervention will be used to assess change in centers' use of evidence-based nutrition and physical activity practices. Cost of delivery will also be monitored throughout implementation. Study participants will include 28 TA coaches from Child Care Aware of Kentucky and 97 child care centers from 7 regions of central Kentucky. ORIGINAL RECRUITMENT: First, TA coaches will attend an orientation session where they will be introduced to the research study and their roles both as study participants and implementation partners. If they agree to participate, they will be asked to sign consent. TA coaches will then be trained on how to introduce the research study to child care centers using provided recruitment materials. They will be instructed to target these efforts toward a randomly selected list of centers (drawn from their current caseload) provided by the research team. Coaches will be responsible for gauging initial interest of centers, and relaying that information to the research team. Research staff will follow up directly with all centers who express initial interest to confirm eligibility and interest, review study details, and answer questions. Once a center director's eligibility and interest is confirmed, the research team will work with the director to recruit a randomly selected 3-4-year-old classroom teacher and at least three 3-4-year-old children from that classroom. RELAUNCH RECRUITMENT: TA coaches will attend a re-orientation session where they will be informed of modifications to the study due to the pandemic restrictions. For the first two waves, TA coaches will be instructed to inform their previously enrolled centers of the modifications to the study. They will be provided with materials to inform centers and relay any relevant information about their centers to the research staff. Research staff will follow-up directly with all previously enrolled centers who are currently open. The research study staff will review study details, confirm interest, and answer any questions. Once a center director's interest is confirmed, the staff will work with the director to recruit two randomly selected preschool classroom teachers. Wave 3 TA coaches will be informed of modifications to study and follow a similar protocol to the original recruitment steps as measurement wasn't complete at the time of the pause due to the pandemic. The TA coaches will use provided recruitment materials and will be instructed to target these efforts toward a randomly selected list of centers (drawn from their current caseload) provided by the research team. Coaches will be responsible for gauging initial interest of centers, and relaying that information to the research team. Research staff will follow up directly with all centers who express initial interest to confirm eligibility and interest, review study details, and answer questions. Once a center director's eligibility and interest is confirmed, the research team will work with the director to recruit two randomly selected preschool classroom teachers. ORIGINAL BASELINE MEASURES: Several measures will be collected at baseline on centers, children, directors, teachers, and TA coaches using a combination of observation, physical assessments, and self-report surveys. Most measures will be collected during a 1-day site visit conducted with each center by a trained research team member. Measures will assess centers' use of evidence-based nutrition and physical activity practices, children's dietary intakes and physical activity while at child care, and children's height and weight. Demographic information will be captured through surveys completed by parents, directors, teachers, and TA coaches. Implementation context will be captured through surveys completed by directors, teachers, and TA coaches. RELAUNCH BASELINE MEASURES: Several measures will be collected at baseline on centers, directors, teachers and TA coaches using online self-report surveys. All measures will be collected using the Qualtrics online survey tool. For TA coaches, measures will assess demographics information, implementation context, and COVID-19 impact. For center directors, measures will assess demographics, center demographics, implementation context, COVID-19 impact, and nutrition and physical activity practices. For preschool teachers, measures will assess demographics, implementation context, and nutrition and physical activity practices. RANDOMIZATION: Once all baseline measures with centers are scheduled, TA coaches will be randomly assigned to either deliver Basic or Enhanced Go NAPSACC with their enrolled centers. For Wave 3, once all online baseline measures are completed, TA coaches will be randomly assigned to either deliver Basic or Enhanced Go NAPSACC with their enrolled centers. INTERVENTION ARMS: Go NAPSACC is a suite of online tools designed to help child care programs improve their nutrition and physical activity practices. TA coaches will support centers' use of Go NAPSACC using either a Basic or Enhanced implementation model. TA coaches assigned to Basic Go NAPSACC will participate in 2 two hour-long training sessions and a homework assignment. Training sessions will cover the role of child care programs in shaping children's eating and physical activity behaviors, Go NAPSACC's 5-step improvement, and the tools available for child care programs and TA coaches to support their work. Additionally, coaches will have an online check-in meeting 1 month post-training to answer any remaining questions/concerns. TA coaches assigned to Enhanced Go NAPSACC will participate in 2 two hour long and 2 hour-long training sessions and a homework assignment. In addition to the topics listed above, trainings will also introduce elements unique to the enhanced implementation model. During implementation, these TA coaches will also participate in monthly conference calls and 2-3 one-on-one coaching sessions with a Go NAPSACC specialist . For centers receiving Basic Go NAPSACC, center directors will be invited by their TA coach to register for Go NAPSACC accounts. The director will receive a 1-hour orientation from their TA coach on how to use Go NAPSACC's online tools and resources. Once trained, the director will complete 2 cycles of Go NAPSACC's 5-step improvement process focusing on child nutrition and physical activity. A cycle of Go NAPSACC includes completing nutrition and physical activity self-assessments, choosing at least 6 goals (3 goals per self-assessment), creating an action plan for each goal, working to implement the action plans drawing from the tips and materials resource library, and logging progress and completion of goals. Each cycle will take approximately 6 months to complete. At the end of the 12 months, the director will retake the self-assessments on child nutrition and physical activity. Throughout the 12 months, the director will receive brief monthly check-ins from their TA coach. TA coaches will log their implementation activities using the TA Activity Log in Go NAPSACC. For centers receiving Enhanced Go NAPSACC, center directors will work with their TA coach to identify an implementation team that will contribute to Go NAPSACC efforts. Before starting Go NAPSACC, the team will work with their TA coach to conduct an assessment of their center's needs, capacity, and resources. A needs assessment survey will be completed by various center staff and scored by the TA coach. Summarized results will be presented and discussed with the team to identify priority issues the team would like extra support from the TA coach as they work through Go NAPSACC. Once this needs assessment is complete, the team will begin using Go NAPSACC and with support from their TA coach will create a 12-month plan to guide their Go NAPSACC efforts. Similar to those assigned to Basic Go NAPSACC, the team will complete 2 cycles of the 5-step improvement process focusing on nutrition and physical activity. They will follow the same steps described above. Additionally, the team will receive brief check-ins with tailored support from their TA coach. Further, their TA coach will host 2-3 one-hour meetings with different centers from the same region so that teams can reflect on their efforts and share lessons learned. TA coaches will be asked to log all of their implementation activities using the TA Activity Log in Go NAPSACC. REFRESHER INTERVENTION TRAINING SESSIONS: For Waves 1 and 2, Basic TA coaches will have 2 hour and a half long online refresher training sessions. The first training session will cover a refresher on the 5-step process, the provider and consultant online tools, and timeline updates. The second session will focus on providing support remotely and on how Go NAPSACC best practices may be impacted by pandemic restrictions. Enhanced coaches will have a 2-hour training session focused on a reminder of the big picture of the Enhanced support approach, the updated timeline, leadership team formation, the readiness check, and providing support remotely. Regular monthly meetings will be used to further refresh on topics relevant to Enhanced support approach and how best practices could be impacted by pandemic restrictions. POST-INTERVENTION MEASURES: Measures will be repeated following 12 months of Go NAPSACC participation. Data collection procedures will be the same as those described in relaunch baseline measures. In addition, trained research staff will complete phone interviews with a random selection of TA coaches to gather feedback about their experiences implementing Go NAPSACC. Phone interviews will also be completed with randomly selected center directors and when relevant, members of the implementation teams.

Interventions

BEHAVIORALEnhanced Go NAPSACC

In the Enhanced delivery model, TA coaches will help centers create an implementation team and conduct a needs assessment to identify organizational strengths and challenges. TA coaches will also provide an orientation to Go NAPSACC and its online tools and help the team develop a plan to guide their Go NAPSACC efforts. The team will then work through 2 cycles of Go NAPSACC over 12 months. During each cycle (6 months), centers will take self-assessments on nutrition and physical activity, choose 6 goals (3 from each), create action plans, and take action to achieve their chosen goals. Throughout this 12-month period, TA coaches will provide monthly check-ins incorporating tailored support based on the results from the needs assessment. They will also organize 2-3 meetings among teams from different centers to reflect and share lessons learned.

BEHAVIORALBasic Go NAPSACC

In the Basic delivery model, TA coaches will provide an orientation to Go NAPSACC and its online tools to the center director. The director will then work 2 cycles of Go NAPSACC over 12 months. During each cycle (6 months), centers will take self-assessments on nutrition and physical activity, choose 6 goals (3 from each), create action plans, and take action to achieve their chosen goals. Throughout this 12-month period, TA coaches will provide monthly brief check-ins.

Sponsors

National Heart, Lung, and Blood Institute (NHLBI)
CollaboratorNIH
University of Kentucky
CollaboratorOTHER
Child Care Aware of Kentucky
CollaboratorOTHER
University of North Carolina, Chapel Hill
Lead SponsorOTHER

Study design

Allocation
RANDOMIZED
Intervention model
PARALLEL
Primary purpose
PREVENTION
Masking
SINGLE (Outcomes Assessor)

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
Yes

Inclusion criteria

TA Coaches * Must either be a Quality coach or a Health and Safety coach * Must be able to read and speak English Child Care Centers * Must be a part of a participating TA coach's current caseload * Have no plans to close in the coming year * Serve at least lunch to the children * Not serve special needs children exclusively Child Care Providers * Teacher must be the lead teacher in a preschool classroom * Center directors and teachers must be able to read and speak English

Exclusion criteria

Child Care Centers * Serve special needs children exclusively * Serve only non-English speaking families

Design outcomes

Primary

MeasureTime frameDescription
Mean Nutrition Environment ScoreMeasures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)Each center's nutrition environment was assessed using the Environment and Policy Assessment and Observation- Self Report (EPAO-SR), a self-report measure filled out through online surveys by child care center directors and preschool classroom teachers. In addition, directors upload a month of menus and policy handbooks, which are reviewed and scored by a trained staff members. An overall nutrition environment score will be derived with scores ranging from 0-3, where higher scores indicate better (more supportive) nutrition environments.
Mean Physical Activity Environment ScoreMeasures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)Each center's physical activity environment was assessed using the Environment and Policy Assessment and Observation- Self Report (EPAO-SR), a self-report measure filled out through online surveys by child care center directors and preschool classroom teachers. In addition, directors upload policy handbooks, which were reviewed by a trained staff member. An overall physical activity environment score was derived with scores ranging from 0-3, where higher scores indicate better (more supportive) physical activity environments.

Secondary

MeasureTime frameDescription
Percent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteWithin 3 months of starting intervention and again within 12 months of initiating interventionChild nutrition self-assessment scores are captured on the Go NAPSACC website when a center director completed a self-assessment at the start and end of an improvement cycle. Completing self-assessments is an intervention component that may, or may not, be used by centers. Each self-assessment item is rated on a 1-4 point scale, where higher points indicate closer compliance with best practices, with a score of 4 indicating meets best practice. Scores are then computed as percent of best practices met (range 0 to 100%). Self-assessment data will be extracted using the Go NAPSACC Child Nutrition Self-Assessment Report pulled immediately post-intervention.
Percent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteWithin 3 months of starting intervention and again within 12 months of initiating interventionChild physical activity self-assessment scores are captured on the Go NAPSACC website when a center completed a self-assessment at the start and end of an improvement cycle. Completing self-assessments is an intervention component that may, or may not, be used by centers. Each self-assessment item is rated on a 1-4 point scale, where higher points indicate closer compliance with best practices, with a score of 4 indicating meets best practice. Scores are then computed as percent of best practices met (range 0 to 100%). Self-assessment data will be extracted using the Go NAPSACC Child Physical Activity Self-Assessment Report pulled immediately post-intervention.
Contextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsMeasures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)Mean total EPAO-SR scores (percent best practices met) for centers starting with high or low contextual setting support reported by directors. Director report of contextual support was assessed using baseline surveys. Specifically, Fernandez's consolidated framework for implementation research (CFIR) inner setting measure was used to assess Culture, Culture Stress, Culture Effort, Implementation Climate, Leadership Engagement, Information access, and Available Resources. Scores from theses sub-scales were averaged to create a composite inner setting score. To assess the impact of baseline inner setting score and intervention group on nutrition and physical activity environment best practice scores, composite inner setting scores were classified as high or low using a median split. This high/low indicator of contextual support was included as interaction term in analysis models (i.e. Time \[baseline-followup\] \* Intervention Group \[basic-enhanced\] \* Context level\[high-low\]).
Contextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsMeasures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)Mean total EPAO-SR scores (percent best practices met) for centers starting with high or low contextual setting support reported by staff. Staff report of contextual setting support was assessed using baseline surveys. Specifically, Fernandez's consolidated framework for implementation research (CFIR) inner setting measure was used to assess Culture, Culture Stress, Culture Effort, Implementation Climate, Leadership Engagement, Information access, and Available Resources. Scores from theses sub-scales were averaged to create a composite inner setting score. To assess the impact of baseline inner setting score and intervention group on nutrition and physical activity environment best practice scores, composite inner setting scores were classified as high or low using a median split. This high/low indicator of contextual support was included as interaction term in analysis models (i.e. Time \[baseline-followup\] \* Intervention Group \[basic-enhanced\] \* Context level\[high-low\]).
Cost of Implementation for Enhanced and Basic ModelsMeasures collected throughout the 1 year intervention periodCosts of implementation per center include TA coaches time and any resources required to train and support centers for 12 months. Cost tracking used the TA Activity Log to capture TA coaches' time and a supplemental log of additional costs (e.g., mileage, printing). These data were combined to calculate the average cost per center for implementing Go NAPSACC. Final amounts are expressed as cost (dollar $) per center.
Number of Centers That Created a Go NAPSACC Website AccountMeasures collected 3-12 weeks prior to start of intervention (Baseline)The number of participating centers will be captured by the Go NAPSACC website and extracted using the Go NAPSACC registration report. The registration report documents all child care centers that have completed registration and created a Go NAPSACC account. Creation of an account will be used to define participation/adoption.
Go NAPSACC Core Program Components: TA Coach Held Cross-Center MeetingsMeasures collected during the 1 year intervention period.TA coaches in the ENHANCED implementation arm were asked to hold 3 cross-center meeting during the 1 year intervention. These meeting could be online or in-person, but were intended to include directors from all centers the TA coach served. The study interventionist and project manager tracked each meeting. These data were used to calculate the percentage of prescribed implementation activities completed.
Go NAPSACC Core Program Components: TA Coach Complete LogsMeasures collected during the 1 year intervention period.TA coaches were asked to log implementation activities and contacts with each center in the TA Activity Log through the Go NAPSACC website. Information for analysis was extracted from the website using the TA Activity Report.
Go NAPSACC Core Program Components: TA Coach Training AttendanceMeasures collected during the 1 year intervention period.TA coaches were asked to attend trainings with the study interventionist. The study interventionist and project manager tracked attendance at each training session. TA coaches in the BASIC arm were asked to attend three training sessions, while TA coaches in the ENHANCED arm were asked to attend 6 sessions. Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of prescribed implementation activities completed.
Go NAPSACC Core Program Components: TA Coach Attended Check-ins With Study TeamMeasures collected during the 1 year intervention period.TA coaches were asked to attend group check-ins with the study interventionist. The study interventionist and project manager tracked attendance at each group check-in. TA coaches in the BASIC arm were asked to attend one group check-in, while TA coaches in the ENHANCED arm were asked to attend 12 group check-ins and 3 one-on-one check-ins with study interventionist Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of prescribed implementation activities completed.
Go NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsMeasures collected during the 1 year intervention period.Completion of these Go NAPSACC program components was captured using the TA activity log in Go NAPSACC website and tracking data maintained by the study interventionist and project manager. These data serve as indicators of fidelity. In the TA Activity Log all coaches document their implementation activities for each center they serve. Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of a TAs centers completing the prescribed implementation activities.
Go NAPSACC Core Program Components Completed by CentersMeasures collected during the 1 year intervention period.Number of Go NAPSACC core program components completed was captured by the Go NAPSACC website and extracted using the Detailed Activity Report. These data serve as indicators of fidelity. The Detailed Activity report captures centers' completion of key steps in the improvement process (completion of a self-assessments and creation/completion of action plans). For this study, centers were expected to complete a cycle of the improvement process for Nutrition and one for Physical Activity, including all key steps.

Countries

United States

Participant flow

Pre-assignment details

Childcare centers are clustered within TA coaches. TA coaches delivered part of the intervention and served as the unit of randomization. Information used to quantify aspects of each center was collected from the TA coach, directors, and staff. To clearly represent the groups of people recruited within each arm three periods are defined below. Periods do not reflect a time element for this study, but the three groups of people measured for center-level data (unit).

Participants by arm

ArmCount
Enhanced Go NAPSACC
Go NAPSACC implemented with the Enhanced delivery model
207
Basic Go NAPSACC
Go NAPSACC implemented with the Basic delivery model
157
Total364

Baseline characteristics

CharacteristicEnhanced Go NAPSACCTotalBasic Go NAPSACC
Age, Continuous38.69 years
STANDARD_DEVIATION 12.47
38.29 years
STANDARD_DEVIATION 12.18
37.77 years
STANDARD_DEVIATION 11.81
Ethnicity (NIH/OMB)
Hispanic or Latino
3 Participants13 Participants10 Participants
Ethnicity (NIH/OMB)
Not Hispanic or Latino
199 Participants340 Participants141 Participants
Ethnicity (NIH/OMB)
Unknown or Not Reported
5 Participants11 Participants6 Participants
Race (NIH/OMB)
American Indian or Alaska Native
1 Participants2 Participants1 Participants
Race (NIH/OMB)
Asian
0 Participants0 Participants0 Participants
Race (NIH/OMB)
Black or African American
24 Participants48 Participants24 Participants
Race (NIH/OMB)
More than one race
5 Participants7 Participants2 Participants
Race (NIH/OMB)
Native Hawaiian or Other Pacific Islander
1 Participants2 Participants1 Participants
Race (NIH/OMB)
Unknown or Not Reported
3 Participants15 Participants12 Participants
Race (NIH/OMB)
White
173 Participants290 Participants117 Participants
Region of Enrollment
United States
207 Participants364 Participants157 Participants
Sex: Female, Male
Female
201 Participants353 Participants152 Participants
Sex: Female, Male
Male
5 Participants6 Participants1 Participants

Adverse events

Event typeEG000
affected / at risk
EG001
affected / at risk
deaths
Total, all-cause mortality
0 / 2070 / 157
other
Total, other adverse events
0 / 2070 / 157
serious
Total, serious adverse events
0 / 2070 / 157

Outcome results

Primary

Mean Nutrition Environment Score

Each center's nutrition environment was assessed using the Environment and Policy Assessment and Observation- Self Report (EPAO-SR), a self-report measure filled out through online surveys by child care center directors and preschool classroom teachers. In addition, directors upload a month of menus and policy handbooks, which are reviewed and scored by a trained staff members. An overall nutrition environment score will be derived with scores ranging from 0-3, where higher scores indicate better (more supportive) nutrition environments.

Time frame: Measures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)

Population: The unit of analysis for this outcome is center-level nutrition environment score, derived from surveys completed by directors and staff at each center. Survey responses from directors and staff must be combined to compute the nutrition environment score for a center, therefore the number of participants analyzed is the number of centers in each arm, not the total number of directors and staff.

ArmMeasureGroupValue (MEAN)Dispersion
Enhanced Go NAPSACCMean Nutrition Environment ScoreBaseline1.88 score on a scaleStandard Deviation 0.24
Enhanced Go NAPSACCMean Nutrition Environment ScoreFollow-Up2.06 score on a scaleStandard Deviation 0.23
Basic Go NAPSACCMean Nutrition Environment ScoreFollow-Up2.08 score on a scaleStandard Deviation 0.26
Basic Go NAPSACCMean Nutrition Environment ScoreBaseline1.98 score on a scaleStandard Deviation 0.27
p-value: 0.101Mixed Models Analysis
Primary

Mean Physical Activity Environment Score

Each center's physical activity environment was assessed using the Environment and Policy Assessment and Observation- Self Report (EPAO-SR), a self-report measure filled out through online surveys by child care center directors and preschool classroom teachers. In addition, directors upload policy handbooks, which were reviewed by a trained staff member. An overall physical activity environment score was derived with scores ranging from 0-3, where higher scores indicate better (more supportive) physical activity environments.

Time frame: Measures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)

Population: The unit of analysis for this outcome is center-level physical activity environment score, derived from surveys completed by directors and staff at each center. Survey responses from directors and staff must be combined to compute the physical activity environment score for a center, therefore the number of participants analyzed is the number of centers in each arm, not the total number of directors and staff.

ArmMeasureGroupValue (MEAN)Dispersion
Enhanced Go NAPSACCMean Physical Activity Environment ScoreBaseline1.26 score on a scaleStandard Deviation 0.27
Enhanced Go NAPSACCMean Physical Activity Environment ScoreFollow-Up1.50 score on a scaleStandard Deviation 0.34
Basic Go NAPSACCMean Physical Activity Environment ScoreBaseline1.33 score on a scaleStandard Deviation 0.32
Basic Go NAPSACCMean Physical Activity Environment ScoreFollow-Up1.50 score on a scaleStandard Deviation 0.32
p-value: 0.383Mixed Models Analysis
Secondary

Contextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention Effects

Mean total EPAO-SR scores (percent best practices met) for centers starting with high or low contextual setting support reported by directors. Director report of contextual support was assessed using baseline surveys. Specifically, Fernandez's consolidated framework for implementation research (CFIR) inner setting measure was used to assess Culture, Culture Stress, Culture Effort, Implementation Climate, Leadership Engagement, Information access, and Available Resources. Scores from theses sub-scales were averaged to create a composite inner setting score. To assess the impact of baseline inner setting score and intervention group on nutrition and physical activity environment best practice scores, composite inner setting scores were classified as high or low using a median split. This high/low indicator of contextual support was included as interaction term in analysis models (i.e. Time \[baseline-followup\] \* Intervention Group \[basic-enhanced\] \* Context level\[high-low\]).

Time frame: Measures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)

Population: The unit of analysis for this outcome is center-level, derived from surveys completed by directors at each center. The sample size is the number of centers randomized to each study arm.

ArmMeasureGroupValue (MEAN)Dispersion
Enhanced Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: Low Contextual30.17 percentage of best practices metStandard Deviation 8.25
Enhanced Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: High Contextual32.31 percentage of best practices metStandard Deviation 7.09
Enhanced Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: Low Contextual37.20 percentage of best practices metStandard Deviation 9.09
Enhanced Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: High Contextual40.07 percentage of best practices metStandard Deviation 10.33
Basic Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: Low Contextual35.88 percentage of best practices metStandard Deviation 8.66
Basic Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: High Contextual36.94 percentage of best practices metStandard Deviation 7.72
Basic Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: Low Contextual30.11 percentage of best practices metStandard Deviation 8.42
Basic Go NAPSACCContextual Setting (Director Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: High Contextual41.47 percentage of best practices metStandard Deviation 9.07
Secondary

Contextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention Effects

Mean total EPAO-SR scores (percent best practices met) for centers starting with high or low contextual setting support reported by staff. Staff report of contextual setting support was assessed using baseline surveys. Specifically, Fernandez's consolidated framework for implementation research (CFIR) inner setting measure was used to assess Culture, Culture Stress, Culture Effort, Implementation Climate, Leadership Engagement, Information access, and Available Resources. Scores from theses sub-scales were averaged to create a composite inner setting score. To assess the impact of baseline inner setting score and intervention group on nutrition and physical activity environment best practice scores, composite inner setting scores were classified as high or low using a median split. This high/low indicator of contextual support was included as interaction term in analysis models (i.e. Time \[baseline-followup\] \* Intervention Group \[basic-enhanced\] \* Context level\[high-low\]).

Time frame: Measures collected 3-12 weeks prior to start of intervention (Baseline) and 1-8 weeks post-12-month intervention (Follow-up)

Population: The unit of analysis for this outcome is center-level, derived from surveys completed by staff at each center. Survey responses from staff are combined to compute the contextual score for a center, therefore the number of participants analyzed is the number of centers in each arm, not the total number of staff.

ArmMeasureGroupValue (MEAN)Dispersion
Enhanced Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: High Contextual31.74 percentage of best practices metStandard Deviation 8.35
Enhanced Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: High Contextual37.56 percentage of best practices metStandard Deviation 10.12
Enhanced Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: Low Contextual30.75 percentage of best practices metStandard Deviation 7.19
Enhanced Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: Low Contextual39.74 percentage of best practices metStandard Deviation 9.49
Basic Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: Low Contextual37.96 percentage of best practices metStandard Deviation 7.72
Basic Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: High Contextual34.13 percentage of best practices metStandard Deviation 8.58
Basic Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsBaseline: Low Contextual34.15 percentage of best practices metStandard Deviation 8.11
Basic Go NAPSACCContextual Setting (Staff Report) - Impact of Center Culture, Implementation Climate, Leadership Engagement, Available Resources, and Information Access at Baseline on Intervention EffectsFollow-up: High Contextual39.63 percentage of best practices metStandard Deviation 10.63
Secondary

Cost of Implementation for Enhanced and Basic Models

Costs of implementation per center include TA coaches time and any resources required to train and support centers for 12 months. Cost tracking used the TA Activity Log to capture TA coaches' time and a supplemental log of additional costs (e.g., mileage, printing). These data were combined to calculate the average cost per center for implementing Go NAPSACC. Final amounts are expressed as cost (dollar $) per center.

Time frame: Measures collected throughout the 1 year intervention period

Population: The sample size is the number of centers randomized to each study arm.

ArmMeasureValue (MEAN)Dispersion
Enhanced Go NAPSACCCost of Implementation for Enhanced and Basic Models154.77 U.S. Dollars ($)Standard Deviation 154.2
Basic Go NAPSACCCost of Implementation for Enhanced and Basic Models94.10 U.S. Dollars ($)Standard Deviation 143.53
Secondary

Go NAPSACC Core Program Components Completed by Centers

Number of Go NAPSACC core program components completed was captured by the Go NAPSACC website and extracted using the Detailed Activity Report. These data serve as indicators of fidelity. The Detailed Activity report captures centers' completion of key steps in the improvement process (completion of a self-assessments and creation/completion of action plans). For this study, centers were expected to complete a cycle of the improvement process for Nutrition and one for Physical Activity, including all key steps.

Time frame: Measures collected during the 1 year intervention period.

Population: For this outcome only childcare centers that completed registration in the Go NAPSACC website system were analyzed. As presented in outcome #3, 40 of 55 centers from the enhanced arm and 38 of 42 centers in the basic arm created an account in the Go NAPSACC website. These outcomes could only be computed for the 78 centers (40 + 38) with accounts.

ArmMeasureGroupValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Action Plan13 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Created Action Plan21 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed First Self-Assessment27 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Created Action Plan23 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete Second Self-Assessment10 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete First Self-Assessment24 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete Third Self-Assessment2 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Third Self-Assessment2 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Completed Action plan11 Number of Centers
Enhanced Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Second Self-Assessment13 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Completed Action plan5 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Second Self-Assessment7 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Third Self-Assessment0 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Created Action Plan20 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed Action Plan11 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete First Self-Assessment20 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete Third Self-Assessment0 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersNutrition: Completed First Self-Assessment22 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Complete Second Self-Assessment4 Number of Centers
Basic Go NAPSACCGo NAPSACC Core Program Components Completed by CentersActivity: Created Action Plan14 Number of Centers
Secondary

Go NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation Components

Completion of these Go NAPSACC program components was captured using the TA activity log in Go NAPSACC website and tracking data maintained by the study interventionist and project manager. These data serve as indicators of fidelity. In the TA Activity Log all coaches document their implementation activities for each center they serve. Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of a TAs centers completing the prescribed implementation activities.

Time frame: Measures collected during the 1 year intervention period.

Population: TA coaches was the unit of analysis. For each TA coach, the percent of centers completing each outcome was computed. The TA coaches in the BASIC arm of the intervention did not have their centers: form leadership teams, complete a readiness check, or select priority areas for change. These tasks were only completed by TA coaches using the enhanced delivery model (Enhanced Go NAPSACC arm).

ArmMeasureGroupValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsAttended Orientation meeting75.6 % of Centers averaged by TA coach
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsCompleted 9 or more Monthly Check-ins during 1 year intervention period19.1 % of Centers averaged by TA coach
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsCompleted Readiness check69.5 % of Centers averaged by TA coach
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsSelected Priority Areas for change58.1 % of Centers averaged by TA coach
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsRegistered on Go NAPSACC website71.4 % of Centers averaged by TA coach
Enhanced Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsFormed Leadership Team91.7 % of Centers averaged by TA coach
Basic Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsCompleted 9 or more Monthly Check-ins during 1 year intervention period12.2 % of Centers averaged by TA coach
Basic Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsRegistered on Go NAPSACC website85.6 % of Centers averaged by TA coach
Basic Go NAPSACCGo NAPSACC Core Program Components: Percent of a TA Coaches Centers Completing Implementation ComponentsAttended Orientation meeting76.9 % of Centers averaged by TA coach
Secondary

Go NAPSACC Core Program Components: TA Coach Attended Check-ins With Study Team

TA coaches were asked to attend group check-ins with the study interventionist. The study interventionist and project manager tracked attendance at each group check-in. TA coaches in the BASIC arm were asked to attend one group check-in, while TA coaches in the ENHANCED arm were asked to attend 12 group check-ins and 3 one-on-one check-ins with study interventionist Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of prescribed implementation activities completed.

Time frame: Measures collected during the 1 year intervention period.

Population: TA coach check-in attendance was computed then summarized for each study arm.

ArmMeasureValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components: TA Coach Attended Check-ins With Study Team83.6 percentage of check-ins attended
Basic Go NAPSACCGo NAPSACC Core Program Components: TA Coach Attended Check-ins With Study Team96.2 percentage of check-ins attended
Secondary

Go NAPSACC Core Program Components: TA Coach Complete Logs

TA coaches were asked to log implementation activities and contacts with each center in the TA Activity Log through the Go NAPSACC website. Information for analysis was extracted from the website using the TA Activity Report.

Time frame: Measures collected during the 1 year intervention period.

Population: TA coaches who completed activity logs within Go NAPSACC website were counted as completing activity logs. TA coaches who provided no log of activities were counted as having incomplete logs.

ArmMeasureValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components: TA Coach Complete Logs57.1 percentage of TA coaches completing logs
Basic Go NAPSACCGo NAPSACC Core Program Components: TA Coach Complete Logs92.3 percentage of TA coaches completing logs
Secondary

Go NAPSACC Core Program Components: TA Coach Held Cross-Center Meetings

TA coaches in the ENHANCED implementation arm were asked to hold 3 cross-center meeting during the 1 year intervention. These meeting could be online or in-person, but were intended to include directors from all centers the TA coach served. The study interventionist and project manager tracked each meeting. These data were used to calculate the percentage of prescribed implementation activities completed.

Time frame: Measures collected during the 1 year intervention period.

Population: Cross center meetings were only completed by TA coaches (n=14) using the enhanced delivery model (Enhanced Go NAPSACC arm). The TA coaches in the BASIC arm of the intervention (n=13) did not conduct cross-center meetings. Therefore the Basic Arm is not included in analysis.

ArmMeasureValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components: TA Coach Held Cross-Center Meetings49.6 percent of cross-center meet held by TA
Secondary

Go NAPSACC Core Program Components: TA Coach Training Attendance

TA coaches were asked to attend trainings with the study interventionist. The study interventionist and project manager tracked attendance at each training session. TA coaches in the BASIC arm were asked to attend three training sessions, while TA coaches in the ENHANCED arm were asked to attend 6 sessions. Based on their prescribed implementation model (basic or enhanced), these data were used to calculate the percentage of prescribed implementation activities completed.

Time frame: Measures collected during the 1 year intervention period.

Population: TA coach attendance at trainings was computed and summarized over coaches in each arm.

ArmMeasureValue (NUMBER)
Enhanced Go NAPSACCGo NAPSACC Core Program Components: TA Coach Training Attendance83.3 percentage of trainings attended
Basic Go NAPSACCGo NAPSACC Core Program Components: TA Coach Training Attendance96.2 percentage of trainings attended
Secondary

Number of Centers That Created a Go NAPSACC Website Account

The number of participating centers will be captured by the Go NAPSACC website and extracted using the Go NAPSACC registration report. The registration report documents all child care centers that have completed registration and created a Go NAPSACC account. Creation of an account will be used to define participation/adoption.

Time frame: Measures collected 3-12 weeks prior to start of intervention (Baseline)

Population: Centers recruited and randomized

ArmMeasureValue (COUNT_OF_UNITS)
Enhanced Go NAPSACCNumber of Centers That Created a Go NAPSACC Website Account40 Centers
Basic Go NAPSACCNumber of Centers That Created a Go NAPSACC Website Account38 Centers
Secondary

Percent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC Website

Child nutrition self-assessment scores are captured on the Go NAPSACC website when a center director completed a self-assessment at the start and end of an improvement cycle. Completing self-assessments is an intervention component that may, or may not, be used by centers. Each self-assessment item is rated on a 1-4 point scale, where higher points indicate closer compliance with best practices, with a score of 4 indicating meets best practice. Scores are then computed as percent of best practices met (range 0 to 100%). Self-assessment data will be extracted using the Go NAPSACC Child Nutrition Self-Assessment Report pulled immediately post-intervention.

Time frame: Within 3 months of starting intervention and again within 12 months of initiating intervention

Population: Only 49 centers (27 + 22) completed the first nutrition self-assessment. Centers without a nutrition self-assessment in the Go NAPSACC website system were not analyzed. At follow-up 13 of 27 centers from Enhanced arm and 7 of 22 centers from basic arm completed the nutrition self-assessment.

ArmMeasureGroupValue (NUMBER)
Enhanced Go NAPSACCPercent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteBaseline49.4 percentage of best practices met
Enhanced Go NAPSACCPercent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteFollow-up63.2 percentage of best practices met
Basic Go NAPSACCPercent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteBaseline47.6 percentage of best practices met
Basic Go NAPSACCPercent of Nutrition Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteFollow-up52.4 percentage of best practices met
Secondary

Percent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC Website

Child physical activity self-assessment scores are captured on the Go NAPSACC website when a center completed a self-assessment at the start and end of an improvement cycle. Completing self-assessments is an intervention component that may, or may not, be used by centers. Each self-assessment item is rated on a 1-4 point scale, where higher points indicate closer compliance with best practices, with a score of 4 indicating meets best practice. Scores are then computed as percent of best practices met (range 0 to 100%). Self-assessment data will be extracted using the Go NAPSACC Child Physical Activity Self-Assessment Report pulled immediately post-intervention.

Time frame: Within 3 months of starting intervention and again within 12 months of initiating intervention

Population: Only 44 centers (24 + 20) completed the first physical activity self-assessment. Centers without a physical activity self-assessment in the Go NAPSACC website system are not analyzed. At follow-up 10 of 24 centers in the enhanced arm and 4 of 20 centers from the Basic arm completed the physical activity self-assessment.

ArmMeasureGroupValue (NUMBER)
Enhanced Go NAPSACCPercent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteBaseline31.8 percentage of best practices met
Enhanced Go NAPSACCPercent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteFollow-up60.0 percentage of best practices met
Basic Go NAPSACCPercent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteBaseline34.4 percentage of best practices met
Basic Go NAPSACCPercent of Physical Activity Best Practices Met Computed From Self-assessments Completed on Go NAPSACC WebsiteFollow-up28.3 percentage of best practices met

Source: ClinicalTrials.gov · Data processed: Mar 1, 2026