Performance of the ChatGPT on the Certification Test for Mental Health Management: Factorial design

Performance of the ChatGPT (Generative Pretrained Transformer-4) on the Certification Test for Mental Health Management: Factorial design - Performance of the ChatGPT (Generative Pretrained Transformer-4) on the Certification Test for Mental Health Management

Status

Active, not recruiting

Phases

Unknown

Study type

Interventional

Source

JPRN

Registry ID

JPRN-UMIN000053582

Enrollment

204

Registered

2024-02-09

Start date

2024-01-29

Completion date

Unknown

Last updated

2026-06-29

For informational purposes only — not medical advice. Sourced from public registries and may not reflect the latest updates. Terms

Conditions

None listed

Interventions

Tuned prompt condition In this condition, prompts to the LLM are developed by using techniques to get better answers to the examination, which were reported in prompt engineering. The techniques incl

Eligibility

Sex/Gender

All

Inclusion criteria

Inclusion criteria: Multiple-choice questions for the Type I, Type II, and Type III exams and essay questions for the Type I exam of the Certification Test for Mental Health Management, by the Osaka Chamber of Commerce and Industry, conducted from 2018 to 2023. A total of four exams from each type will be included in the study: Type I exams from the 27th, 29th, 31st, and 33rd; Type II and Type III exams from the 31st to 34th. Each exam has 50 multiple-choice questions. A scoring committee grades essay questions.

Exclusion criteria

Exclusion criteria: N/A

Design outcomes

Primary

Measure	Time frame
Scores for multiple-choice and essay questions of the Certification Test for Mental Health Management	—

Countries

Japan

Contacts

Public ContactMako Iida

Graduate School of Medicine, The University of Tokyo Department of Mental Health

idamako@m.u-tokyo.ac.jp+81-3-5800-9621

Outcome results