Skip to content

ROTEM Interpretation AI vs Experts

Artificial Intelligence Versus Expert Interpretation of ROTEM: A Prospective Study of Agreement and Clinical Decision-Making

Status
Not yet recruiting
Phases
Unknown
Study type
Observational
Source
ClinicalTrials.gov
Registry ID
NCT07502950
Acronym
ROTEMAI
Enrollment
400
Registered
2026-03-31
Start date
2026-09-01
Completion date
2027-07-01
Last updated
2026-03-31

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Agreement, Coagulopathy, Thromboelastography

Keywords

ROTEM, thromboelastography, coagulopathy

Brief summary

This prospective multicenter observational study aims to evaluate the agreement between artificial intelligence (AI)-based interpretation and expert interpretation of rotational thromboelastometry (ROTEM) findings in clinically relevant settings. ROTEM is widely used to guide hemostatic therapy in perioperative and critically ill patients, but its interpretation is complex and subject to interobserver variability. The primary objective is to determine whether AI-based interpretation achieves agreement comparable to variability between expert clinicians. Secondary objectives include comparison of interpretation time, assessment of consistency of AI outputs, and evaluation of potential differences in clinical decision-making. ROTEM datasets will be independently assessed by multiple expert anesthesiologists and by an AI-based model using standardized input. Agreement between methods and variability of interpretation will be analyzed. The study aims to determine whether AI-assisted interpretation could serve as a reliable decision-support tool and reduce variability in ROTEM-guided clinical practice.

Detailed description

This prospective multicenter observational study is designed to evaluate the agreement between artificial intelligence (AI)-based interpretation and expert interpretation of rotational thromboelastometry (ROTEM) findings, with a focus on clinical decision-making in critically ill patients. ROTEM is a point-of-care viscoelastic method providing real-time information on coagulation, including clot formation, strength, and fibrinolysis. It is widely used to guide targeted hemostatic therapy in trauma, major surgery, and critical care. However, interpretation of ROTEM findings is complex and requires clinical expertise. Interobserver variability among clinicians may lead to inconsistent therapeutic decisions. Although algorithm-based approaches have been introduced, their implementation remains variable. Artificial intelligence (AI) has the potential to standardize interpretation by integrating multiple ROTEM parameters and generating consistent recommendations. Previous studies have shown that machine learning models can predict clinical outcomes or transfusion requirements based on viscoelastic data. However, evidence on agreement between AI-based interpretation and expert interpretation, particularly in real-world clinical decision-making, remains limited. The primary objective of this study is to determine whether AI-based interpretation achieves a level of agreement comparable to inter-expert variability in ROTEM interpretation. This study does not assume a single gold standard; instead, it evaluates agreement between methods, reflecting real-world clinical practice. Secondary objectives include: * comparison of interpretation time between AI and expert clinicians, * assessment of consistency (intra-method variability) of AI compared to inter-expert variability, * evaluation of potential impact on clinical decision-making, including identification of coagulation abnormalities and proposed treatment strategies. ROTEM measurements will be collected and presented in a standardized format, including graphical and numerical outputs. Each dataset will be independently evaluated by multiple expert anesthesiologists. The same datasets will be interpreted repeatedly by an AI-based large language model using a predefined standardized prompt, with multiple independent runs to assess intra-model variability. For each ROTEM dataset, both experts and AI will assess: * presence of a coagulation disorder, * dominant underlying abnormality, * appropriate therapeutic intervention, * and recommended treatment dose. Agreement between experts and AI, as well as inter-expert agreement, will be analyzed using appropriate statistical methods for categorical and continuous variables (e.g., kappa statistics and intraclass correlation coefficients). Time required for interpretation will also be recorded and compared. This study is not designed to determine the absolute correctness of interpretation, but to quantify agreement and variability between human experts and AI. By identifying clinically relevant discrepancies, the study aims to evaluate whether AI-assisted interpretation may serve as a reliable decision-support tool and reduce variability in ROTEM-guided hemostatic management.

Interventions

OTHERLarge Language Model (LLM) artificial intelligence assesment

The thromboelastography record will be assessed by LLM based artificial intelligence.

Sponsors

Masarykova Nemocnice v Usti nad Labem, Krajska Zdravotni a.s.
Lead SponsorOTHER

Study design

Observational model
OTHER
Time perspective
PROSPECTIVE

Eligibility

Sex/Gender
ALL
Age
18 Years to No maximum
Healthy volunteers
No

Inclusion criteria

Adult patients (age ≥18 years) * ROTEM analysis performed using a ROTEM Sigma device as part of routine clinical care * Availability of complete ROTEM output (graphical and numerical data) * ROTEM measurement obtained in a clinical context where assessment of coagulation status is indicated (e.g., perioperative setting, trauma, or critical illness)

Exclusion criteria

* ROTEM measurements performed using the HEPTEM channel * Incomplete or missing ROTEM data preventing standardized evaluation * ROTEM measurements obtained under non-standardized or technically unreliable conditions

Design outcomes

Primary

MeasureTime frameDescription
Agreement between AI-based and expert interpretation of ROTEM findingsUp to 24 hours after ROTEM measurement (time required for interpretation and data recording).Agreement between artificial intelligence (AI)-based interpretation and expert interpretation of ROTEM findings will be assessed and compared to inter-expert agreement. Agreement will be evaluated for predefined clinical decision outputs, including: * presence of coagulation disorder (yes/no), * identification of dominant coagulation abnormality (categorical), * selection of therapeutic intervention (categorical), * and recommended treatment dose (continuous). Agreement will be quantified using appropriate statistical methods for categorical and continuous data (e.g., Cohen's/Fleiss' kappa and intraclass correlation coefficients).

Secondary

MeasureTime frameDescription
Interpretation timeUp to 24 hours after ROTEM measurement.Time required for interpretation of ROTEM findings by expert clinicians compared to AI-based interpretation. For experts, time will be measured from presentation of the ROTEM result to completion of responses. For AI, time will be measured from submission of the standardized query to completion of output generation.
Consistency of interpretation (intra-method variability)Up to 24 hours after ROTEM measurementVariability of AI-based interpretation across repeated independent runs will be assessed and compared with inter-expert variability. Consistency will be evaluated for all predefined outputs (diagnosis, treatment, dosing).
Proportion of clinically discordant decisionsUp to 24 hours after ROTEM measurementProportion of cases in which AI-based interpretation differs from expert interpretation in clinically relevant outputs, including: * disagreement in diagnosis of coagulation disorder, * disagreement in selected treatment strategy, * or clinically relevant difference in recommended dose.
Inter-expert agreementUp to 24 hours after ROTEM measurementAgreement between individual expert clinicians in interpretation of ROTEM findings will be evaluated to define baseline interobserver variability and provide a reference for comparison with AI-based interpretation.

Outcome results

None listed

Source: ClinicalTrials.gov · Data processed: Apr 1, 2026