Skip to content

Assessing Performance on Speech Tasks Via Crowdsourced Participants

AMYWEB Validation Studies: Assessing Performance on Speech Tasks Via Crowdsourced Participants

Status
Terminated
Phases
Unknown
Study type
Observational
Source
ClinicalTrials.gov
Registry ID
NCT05298501
Acronym
AMYWEB
Enrollment
1034
Registered
2022-03-28
Start date
2022-04-05
Completion date
2022-07-08
Last updated
2024-01-31

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Cognitive Impairment, Mild Cognitive Impairment

Brief summary

The purpose of the study is to examine the properties of the Automatic Story Recall Test (ASRT) and its parallel variants, as well as letter fluency and category fluency cognitive tests. Tests will be completed in crowdsourced populations, to derive normative data, and examine test properties in demographically diverse and cognitively impaired participants recruited and tested online.

Detailed description

The AMYWEB study will validate speech tasks developed by NOVOIC in different population samples, including normative samples, samples recruited for enhanced demographic diversity, and participants with reported cognitive impairment. Participants will be research volunteers recruited online and via crowdsourcing platforms. Six rounds of recruitment will be completed, evaluating different parallel variants of the Automatic Story Recall Task (ASRT), and fluency tasks. During each recruitment round participants will complete a speech test battery and questionnaires during one assessment (Baseline). Speech tasks will be recorded and later analyzed on Novoic's technology platform. All assessments will be fully online and remote.

Interventions

OTHERNo intervention/exposure

No interventions/exposures will be administered or evaluated

Sponsors

Novoic Limited
Lead SponsorINDUSTRY

Study design

Observational model
OTHER
Time perspective
CROSS_SECTIONAL

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum

Inclusion criteria

* First language must be English * Residing in the USA * Willing to participate in a study investigating speech and dementia * Able to provide informed consent * Access to personal computing device that is capable of audio and video recording, and able to connect to the internet Since key research questions are focused primarily on older-age speech and cognition, initial recruitment will be focused on older adult age brackets, which may be extended to younger adulthood if the desired sample sizes are not attained.

Exclusion criteria

* No formal

Design outcomes

Primary

MeasureTime frameDescription
Age, sex, and education adjusted normative scores for the Automatic Story Recall Task (ASRT) test variants derived via linear regression analysis.BaselineParticipants will complete a story recall task (ASRT), which will be administered in triplets (3x stories) with immediate and delayed recall assessed. Six different test phases, recruiting different participant samples, will be completed in which six parallel ASRT triplets will be separately evaluated. Normative data will be generated for each test triplet.

Secondary

MeasureTime frameDescription
Age, sex, and education adjusted normative scores for the category fluency task performance derived via linear regression analysis.BaselineDuring two of the study phases, participants will complete category fluency tests (participants will be asked to name as many Animals or Vegetables as they can within one minute).
Age, sex, and education adjusted normative scores for the letter fluency task performance derived via linear regression analysis.BaselineDuring two of the study phases, participants will complete letter fluency tests (participants will be asked to say as many words as they can think of beginning with the letters F or S).
The effect of demographic differences on task performance will be evaluated via linear regression analysis.BaselineThe effects of age, sex, education and ethnicity on cognitive outcome measures will be evaluated for all cognitive tasks separately.
Demographic and cultural biases will be examined via group or pairwise comparison of transcription error rate and scoring errors on a simple reading task.BaselineIn data from a simple reading task evaluated in phases 1 and 2 of the study, transcription errors and automated scoring metrics will be evaluated alongside key demographic variables to test for cultural and demographic biases in automated transcription and scoring.
Normative data will be derived for shorter variants of the ASRT test battery derived via linear regression analysis.BaselineAge, sex, and education adjusted normative scores for shorter test batteries established in the same way as the primary outcome for each distinct ASRT story triplet, using data from: 1 immediate recall, 2 immediate recalls, 3 immediate recalls, 3 immediate + 1 delayed recall, 3 immediate + 2 delayed recalls.
Area under the curve (AUC) of the receiver operating characteristic (ROC) curve of the binary classifier distinguishing between the MCI sample and the normative sample using as input the speech elicited during cognitive tasks.BaselineCase control comparison of task performance between participants with AMYWEB-MCI and the AMYWEB-Normative population
Area under the curve (AUC) of the receiver operating characteristic (ROC) curve of the binary classifier distinguishing between depressed and non-depressed participants using as input the speech elicited during cognitive tasks.BaselineAll participants will complete the Participant Health Questionnaire (PHQ-8) self-report measure, alongside cognitive assessment. Participants will be separated into low depressive symptomatology (PHQ-8 scores\<10), and high depressive symptomatology (PHQ-8 score\>=10) groups.
The agreement between the PHQ-8 and the corresponding regression model predicting depressive symptomatology from speech data elicited during tasks will be evaluated.BaselineAll participants will complete the Participant Health Questionnaire (PHQ-8) self-report measure, alongside cognitive assessment. A continuous predictor of PHQ-8 score from speech data will be derived and covariation with continuous PHQ-8 scores will be evaluated.
Performance differences in parallel ASRT variant tasks will be examined via task-wise comparison.BaselineThe distribution of test scores across parallel ASRT variants will be evaluated.

Countries

United Kingdom

Outcome results

None listed

Source: ClinicalTrials.gov · Data processed: Feb 5, 2026