Skip to content

A Blinded, Self-control Trial to Evaluate an Artificial Intelligence Based CAD System for Diabetic Retinography

A Blinded, Self-control Trial to Evaluate an Artificial Intelligence Based CAD System for Diabetic Retinography

Status
Completed
Phases
NA
Study type
Interventional
Source
ClinicalTrials.gov
Registry ID
NCT03973762
Enrollment
1081
Registered
2019-06-04
Start date
2019-05-31
Completion date
2020-08-15
Last updated
2020-11-03

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Diabetic Retinopathy

Keywords

Diabetic Retinography, CAD

Brief summary

To evaluate the safety and performance of an innovative artificial intelligence based Computer-Aided Diagnosis(CAD) system for diabetic retinography, Retinal images of patients with diabetes mellitus or diabetic retinopathy(DR) were collected retrospectively. All images were graded by a retinal specialists expert panel and the CAD device using the International Clinical Diabetic Retinopathy severity scale criteria. Investigator responsible for DR grading by CAD system is blinded to the DR grading results from the expert panel. Finally, DR grading results of the CAD system and experts were compared using sensitivity and specificity.

Detailed description

1. Retinal images were collected retrospectively according to the following inclusion/exclusion criterion: Inclusion Criterion: Clinical history of diabetes mellitus or diabetic retinopathy; Fully Gradable Images; around 45° field which covers optic disc and macula; complete patient identification information; Exclusion Criterion: incomplete patient identification information; 2. DR grading by expert panel At first, retinal images are graded by three experts independently, then they met for a consensus meeting to discuss cases without initial agreement. If they can't achieve consensus, a final decision is made by the principal investigator. Experts give a grading of both DR and Diabetic Macular Edema (DME) for each image according to the International Clinical Diabetic Retinopathy severity scale criteria and hard exudates around optic disc. 3. Blinding and DR grading by CAD system Before DR grading by CAD system, a randomized identification(ID) is assigned to each retinal image, which ensures that investigator responsible for CAD system operation is masked to the expert panel grading result. Both DR and DME grading is generated by the CAD system and the results are exported. 4. Unblinding Finally, all data are unblinded and results of the CAD system are compared to the results of human grading, which is considered the gold standard, using measures as sensitivity and specificity;

Interventions

DEVICEDR Grading with CAD

A CAD system is used to make DR grading.

OTHERDR Grading by expert panel

DR Grading by expert panel

Sponsors

Peking University People's Hospital
CollaboratorOTHER
Beijing Tongren Hospital
CollaboratorOTHER
Chinese PLA General Hospital
CollaboratorOTHER
Peking Union Medical College Hospital
Lead SponsorOTHER

Study design

Allocation
NON_RANDOMIZED
Intervention model
PARALLEL
Primary purpose
DIAGNOSTIC
Masking
SINGLE (Investigator)

Masking description

Investigator responsible for CAD system operation is masked to the expert panel grading result.

Intervention model description

This trial aims to evaluate the diagnostic performance of a CAD system for retinal images; And DR grading by clinicians is used as the golden standard.

Eligibility

Sex/Gender
ALL
Healthy volunteers
No

Inclusion criteria

* Clinical history of diabetes mellitus or diabetic retinopathy; * Fully Gradable Images; * around 45° field which covers optic disc and macula; * complete patient identification information;

Exclusion criteria

* incomplete patient identification information

Design outcomes

Primary

MeasureTime frameDescription
Se and Sp under investigation target 3through study completion,an average of four months1.investigation target 3: Negative: DR grading of 0 or 1; Positive: DR grading of 2 or higher; After completion of DR grading by expert panel and CAD system, results of the CAD system were compared to the results of human grading, which is considered the gold standard, using measures as sensitivity(Se) and specificity(Sp).

Secondary

MeasureTime frameDescription
Se and Sp under investigation target 1/2/4/5through study completion,an average of four monthsinvestigation target 1: Negative : DR grading of 0 ; Positive : DR grading of 1 or higher; investigation target 2: Negative : DR grading of 0,1 or 2 ; Positive : DR grading of 3 or higher; investigation target 4: Negative : no clinically significant DME; Positive : clinically significant DME; investigation target 5: Negative : no clinically significant DME and DR grading of 0, 1 or 2 ; Positive : clinically significant DME or DR grading of 3 or higher; After completion of DR grading by expert panel and CAD system, results of the CAD system were compared to the results of human grading, which is considered the gold standard, using measures as sensitivity(Se) and specificity(Sp).

Countries

China

Outcome results

None listed

Source: ClinicalTrials.gov · Data processed: Feb 4, 2026