Structural Heart Abnormality, Structural Heart Disease
Conditions
Keywords
artificial intelligence, transthoracic echocardiogram, magnetic resonance imaging
Brief summary
The HEART-AI (Harnessing ECG Artificial Intelligence for Rapid Treatment and Accurate Interpretation) is an open-label, single-center, randomized controlled trial, that aims to deploy a platform called DeepECG at point-of-care for AI-analysis of 12-lead ECGs. The platform will be tested among healthcare professionals (medical students, residents, doctors, nurse practitioners) who read 12-lead ECGs. In the intervention group, the platform will display the ECHONeXT structural heart disease (SHD) scores in randomized patients to help doctors prioritize transthoracic echocardiography (TTEs) or magnetic resonance imaging (MRI) and reduce the time to diagnosis of structural heart disease. Also, this platform will display the DeepECG-AI interpretation which detects problems such as ischemic conditions, arrhythmias or chamber enlargements and acts an improved alternative to commercially available ECG interpretation systems such as MUSE. Our primary objective is to assess the impact of displaying the ECHONeXT interpretation on 12-lead ECGs on the time to diagnosis of Structural Heart Disease (SHD) among newly referred patients at MHI. We will compare the time interval from the initial ECG to SHD diagnosis by transthoracic echocardiogram (TTE) or magnetic resonance imaging (MRI) between patients in the intervention arm (where ECHONeXT prediction of SHD and TTE priority recommendation are displayed) and patients in the control arm (where ECHONeXT prediction and recommendation are hidden). The main secondary objective is to evaluate the rate of SHD detection on TTE or MRI among newly referred patients. We also aim to assess the delay between the time of the first ECG opened in the platform and the TTE or MRI evaluation among newly referred patients at high or intermediate risk of SHD. By integrating an AI-analysis platform at the point of care and evaluating its impact on ECG interpretation accuracy and prioritization of incremental tests, the HEART-AI study aims to provide valuable insights into the potential of AI in improving cardiac care and patient outcomes.
Detailed description
The HEART-AI (Harnessing ECG Artificial Intelligence for Rapid Treatment and Accurate Interpretation) study primarily aims to assess the effect of displaying the ECHONeXT interpretation on the time interval from the initial ECG to the rate of Structural Heart Disease (SHD) diagnosis on transthoracic echocardiograms or magnetic resonance imaging. We will achieve this by comparing the time between the first ECG and diagnosis of SHD on TTE or MRI between the intervention group, where the ECHONeXT interpretation is displayed to users, and the control group, where it is not displayed, thereby quantifying the influence of AI-supported diagnostics on clinical decision-making and patient management strategies. For the purpose of the study, SHD will be defined as presence of any of the following on TTE or MRI: * LVEF ≤ 45% * Mild, moderate or severe RV Dysfunction * The presence of one or multiple valvulopathies in this list: * Moderate-to-severe pulmonary regurgitation * Moderate-to-severe tricuspid regurgitation * Moderate-to-severe mitral regurgitation * Moderate-to-severe aortic regurgitation * Moderate-to-severe aortic stenosis * Moderate or severe pericardial effusion (Tamponade or any effusion \> 1 cm) * LV wall thickness ≥ 1.3 cm * Apical cardiomyopathy * Pulmonary hypertension as defined using the systolic pressure of the pulmonary artery greater or equal to 25 mm Hg on TTE.
Interventions
OTHERECHONEXT
ECHONEXT Artificial intelligence algorithm
Sponsors
Montreal Heart Institute
Study design
Allocation
RANDOMIZED
Intervention model
PARALLEL
Primary purpose
DIAGNOSTIC
Masking
NONE
Eligibility
Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
No
Inclusion criteria
* Users 1. Users who are providing clinical care and who read ECGs as part of their practice. 2. Users who have provided informed consent to participate in the study. 3. Users who have completed the required training on the use of the DeepECG platform. ECG 1. 12-lead ECGs recorded during the study period at the Montreal Heart Institute. 2. ECGs of adequate technical quality for interpretation, as determined by the recording software and visual inspection. Patients 1\. Patients aged 18 years or older Additional Inclusion criteria for the randomization part of the study 1. Outpatients or patients who presented at the ambulatory emergency department. The location will be determined according to the ECG where it was recorded which is entered by the ECG technician. These locations will be included for the eligibility of the randomization: a. locations\_to\_keep = \['21\_URGENCE AMBULATOIRE', '1\_CARDIOLOGIE GENERALE', 17\_CLINIQUE D'ARYTHMIE\] 2. New patients without a prior formal evaluation by a cardiologist or internal medicine specialist for suspected or provisionally identified cardiac conditions, including: 1. Arrhythmia 2. Heart Failure 3. Coronary Artery Disease 4. Valvular Heart Disease 5. Cardiomyopathy 6. Other cardiac conditions 3. Patients with previous TTE or MRI: 1. Have no documented history of any cardiac condition 2. No transthoracic echocardiogram or MRI in the last 24 months (from any center)
Exclusion criteria
Users 1\. Users who are unable to commit to the duration of the study (approximately 1 month minimum) or adhere to the study protocol. Additional
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Assess the effect of displaying the ECHONeXT interpretation on the time to diagnosis of Structural Heart Disease (SHD) | 18 months | Time interval from the first ECG opened in the platform to SHD diagnosis on TTE or MRI, calculated as: Date of SHD diagnosis on TTE - Date of access of the first ECG where an ECHONeXT interpretation was available and a user consulted the ECG |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Assess the effect of displaying the ECHONeXT interpretation on the rate of SHD diagnosis on TTE | 18 months | Diagnosis of SHD (Yes/No) on TTE |
| Evaluate the effect of displaying the ECHONeXT interpretation on the delay between the ECG and the TTE evaluation for patients at high or intermediate risk of SHD | 18 months | Delay between the time of the first ECG opened in the platform and the TTE calculated as: Date of TTE evaluation - Date of access of the first ECG where an ECHONeXT interpretation was available and a user consulted the ECG |
| Assess the agreement of the users with the ECG-AI algorithm's interpretations | 18 months | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on thumbs up on the platform. |
| Determine the acceptability and usability of the DeepECG platform in clinical practice based on the end-of-study survey | 18 months | Questions of the end-of-study survey on the usability and appreciation of the DeepECG platform and the ECHONeXT interpretation |
| Determine the primary endpoint stratified according to the presence of a previous TTE > 24 months or no previous TTE (brand new patients) | 18 months | Questions answer on the pre-ECG questionnaire |
Other
| Measure | Time frame | Description |
|---|---|---|
| Describe the agreement of the user with the ECG-AI algorithm's interpretation in the two subgroups. | 18 months | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation Agreement is defined as the user clicking on thumbs up on the platform. |
| Evaluate the effect of displaying the ECHONeXT interpretation on the delay between the ECG and the TTE evaluation, by subgroups defined by the risk level of SHD (low/ intermediate/ high) | 18 months | Delay between the time of the first ECG opened in the platform and the TTE calculated as: Date of TTE evaluation - Date of access of the first ECG where an ECHONeXT interpretation was available, and a user consulted the ECG |
| Describe the engagement of users and the overall utilization of the DeepECG platform algorithm in the clinical setting | 18 months | Number of ECGs accessed per user Number of days per user with at least 1 ECG accessed using the platform over total number of days the user is in the study (i.e. has access to the platform). |
| Sensitivity and specificity of ECHONeXT to detect SHD on TTE | 18 months | Assess the sensitivity and specificity of ECHONeXT to detect SHD on TTE |
| Evaluate the model performance after applying continual learning | 18 months | We will re-train the DeepECG models using examples that were downvoted by users or that users bookmarked in addition to the previous ECGs that were used for training the model. Model performance will be compared using the DeLong test for the AUC and AUPRC before and after retraining the model. Users will not be exposed ot this new model. |
| Compare the TTE priority classification assigned by the user between the intervention and the control group | 18 months | TTE priority classification (A, B, C, D, E, etc.) assigned by the user on the post-ECG questionnaire to the first ECG recording where an ECHONeXT interpretation was available and a user consulted the ECG |
| Compare the TTE priority classification assigned by the user between the intervention and the control group stratified by location (emergency vs outpatient | 18 months | TTE priority classification (A, B, C, D, E, etc.) assigned by the user on the post-ECG questionnaire to the first ECG recording where an ECHONeXT interpretation was available and a user consulted the ECG. |
| Review additional qualitative feedback and insights captured after reading an ECG | 18 months | Narrative description put in the other field of the post-ECG questionnaire |
| Assess the agreement of the user with the ECG-AI algorithm's interpretations according to practice type, number of years in practice, age of user and familiarity with AI tools (based on end of study questionnaire) | 18 months | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on thumbs up on the platform. |
| Describe the agreement of the user with the ECG-AI algorithm's interpretation according to the diagnosis category of the ECG-AI (ischemic, arrythmia, chamber enlargement, structural heart disease, other) | 18 months | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on thumbs up on the platform. |
Countries
Canada
Outcome results
None listed