Skip to content

Safe and Explainable AI

SAFE AND EXPLAINABLE AI-ENABLED DECISION MAKING FOR PERSONALIZED CLINICAL DECISION SUPPORT

Status
Recruiting
Phases
Unknown
Study type
Observational
Source
ClinicalTrials.gov
Registry ID
NCT06694181
Enrollment
300000
Registered
2024-11-19
Start date
2025-11-29
Completion date
2028-11-01
Last updated
2026-02-25

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Artifical Inteligence, Breast Cancer, Cardiology, Sepsis

Brief summary

While current AI technology is suitable for automating some repetitive clinical tasks, technical challenges remain in solving critical and gainful problems in the domains of patient and disease management. The proposed research seeks to address issues in medical AI, such as integrating medical knowledge effectively, making AI recommendations explainable to clinicians, and establishing safety guarantees.

Interventions

OTHERAI-PERSONALIZED CLINICAL DECISION SUPPORT

AI-ENABLED DECISION MAKING FOR PERSONALIZED CLINICAL DECISION SUPPORT

Sponsors

Abramson Cancer Center at Penn Medicine
Lead SponsorOTHER

Study design

Observational model
CASE_ONLY
Time perspective
RETROSPECTIVE

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
No

Inclusion criteria

Cardiology 18 years of age and older, admitted to any of the Penn Medicine hospitals from 2017 to the present. Sepsis 18 years of age at the time of presentation to an emergency department or admission to any Penn Medicine hospital from July 1, 2017, onward will be eligible as this represents the population at risk for acquiring sepsis Oncology 18 years of age and older with a diagnosis of invasive breast cancer (Stage 1-4) in the Penn Cancer registry

Exclusion criteria

All prediction models will exclude patients under the age of 18 from their patient data sets. Cardiology Patients whose primary admission diagnosis was cardiac arrest Sepsis Those with pre-existing limitations on life-sustaining therapy will be excluded because their eligibility for sepsis definitions, care received, and outcomes, may be significantly and variably affected by pre-existing limitations on care. Oncology There are no other exclusions.

Design outcomes

Primary

MeasureTime frameDescription
Neurosymbolic Learning AlgorithmsPrototype and develop new learning algorithms; 18 months. Benchmark and evaluate the learning algorithms; 24 months. Publish research results; 24 monthsDevelop and evaluate novel algorithms for training neurosymbolic models. We will develop data- and compute-efficient algorithms for end-to-end training of neurosymbolic models. This task will reduce the burden on clinician experts to provide fine-grained labels on voluminous EHR data.
Explanation MethodsPrototype and develop new explanation algorithms; 18 months. Derive certified guarantees for explanations; 18 months. Benchmark and evaluate the explanation algorithms; 24 months. Extend certificates to new properties and tasks; 30 months. PublWe will develop new explainable AI techniques that come with verifiable guarantees. These guarantees will enable trust and transparency in AI at a fundamental level.
Methods for Safety GuaranteesPrototype and develop new rule learning algorithms; 30 months. Scale rule learning algorithms to larger data settings; 36 months. Incorporate new primitives to express complex rules; 36 months. Implement rule learning algorithms on baseline tasksWe will develop new algorithms that can scalably extract complex logical rules governing safety within the data that have statistical guarantees. These techniques will be rooted in statistical analysis and assist users in identifying out of distribution data and detecting anomalies.

Countries

United States

Contacts

CONTACTHaideliza Soto Calderon
haideliza.soto-calderon@pennmedicine.upenn.edu215-220-9425
CONTACTNicholas Bishop
nicholas.bishop@pennmedicine.upenn.edu

Outcome results

None listed

Source: ClinicalTrials.gov · Data processed: Feb 27, 2026