Skip to content

ChatGPT v.s. Human in Writing a Preoperative Visit Sheet

Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians

Status
UNKNOWN
Phases
Unknown
Study type
Observational
Source
ClinicalTrials.gov
Registry ID
NCT05945004
Enrollment
120
Registered
2023-07-14
Start date
2023-08-01
Completion date
2023-09-01
Last updated
2023-07-14

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

Preoperative Care

Brief summary

The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are: * Can large language models read clinical records and make preoperative visit sheets same as physicians? * Can physicians distinguish preoperative visit sheets made by physicians and models? Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively. A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.

Interventions

OTHERChatGPT-4

Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets.

Subjects' clinical records will be read by clinicians to write preoperative visit sheets.

Sponsors

Tsinghua University
CollaboratorOTHER
Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.
Lead SponsorINDUSTRY

Study design

Observational model
COHORT
Time perspective
CROSS_SECTIONAL

Eligibility

Sex/Gender
ALL
Healthy volunteers
No

Inclusion criteria

* Any as records are generated using ChatGPT-4.

Exclusion criteria

* Any as records are generated using ChatGPT-4.

Design outcomes

Primary

MeasureTime frameDescription
Familiarity to human writingEach record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates not written by human and 1 indicates written by human.
Satisfaction for clinical useEach record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.

Outcome results

None listed

Source: ClinicalTrials.gov · Data processed: Feb 4, 2026