Continuing Medical Education Physician Continuing Professional Development Artificial Intelligence Based Assessment of Professional Competence Education, Medical, Continuing Artificial Intelligence Educational Measurement Professional Competence Clinical Competence Reproducibility of Results Pilot Projects
Conditions
Interventions
Licensed physician participants use the CLICS platform to complete at least three AI mediated structured Clinical Learning Episodes. Each qualifying episode requires at least 15 minutes of engagement,
Experimental Behavioral
CLICS Platform
Sponsors
Somkiat Wattanasirichaigoon, M.D. (Individual Sponsor and Principal Investigator)
Eligibility
Sex/Gender
All
Age
18 Years to 100 Years
Inclusion criteria
Inclusion criteria: Role C Physician Participants 1. Licensed physician with a valid license issued by the Medical Council of Thailand 2. Currently engaged in clinical practice 3. Able and willing to use the CLICS platform and complete at least three qualifying Clinical Learning Episodes 4. Provides electronic informed consent before participation Role D Expert Auditors 1. Licensed physician in the relevant medical specialty 2. At least five years of clinical experience after specialty qualification 3. Affiliated with the relevant Royal College or professional specialty organization 4. Provides electronic informed consent before participation 5. Completes the required calibration workshop and meets the predefined auditor reliability standard
Exclusion criteria
Exclusion criteria: Role C Physician Participants 1. Physician license suspended revoked or currently under formal disciplinary restriction 2. Unable or unwilling to complete the minimum required Clinical Learning Episodes 3. Direct supervisory dependent or other relationship with an investigator that may affect voluntary participation 4. Unable or unwilling to provide informed consent Role D Expert Auditors 1. Personal supervisory or direct professional conflict with an assigned physician participant 2. Direct financial interest in the CLICS platform or study outcomes 3. Failure to complete the calibration workshop 4. Failure to achieve the predefined inter rater reliability threshold during calibration
Design outcomes
Primary
| Measure | Time frame |
|---|---|
| Agreement between AI and Expert Auditor PIS 7 composite scores After completion of expert assessment for all selected Clinical Learning Episodes PIS 7 composite scores ranging from 0 to 100 independently assigned to the same Clinical Learning Episode by the AI system and a matched specialty Expert Auditor | — |
Secondary
| Measure | Time frame |
|---|---|
| Agreement between AI and Expert Auditor scores for individual PIS 7 domains After completion of expert assessment for all selected Clinical Learning Episodes Scores ranging from 0 to 5 for each of the seven PIS 7 domains independently assigned by the AI system and a matched specialty Expert Auditor,AI scoring test retest reliability After completion of repeat AI scoring for the selected Clinical Learning Episodes Two independently generated PIS 7 composite scores for the same Clinical Learning Episode produced by the AI system in separate scoring sessions,Physician PIS 7 score progression After each qualifying Clinical Learning Episode and at study completion PIS 7 composite scores ranging from 0 to 100 recorded for each physician across sequential qualifying Clinical Learning Episodes,Physician satisfaction and perceived utility After completion of the required Clinical Learning Episodes Participant responses to a structured satisfaction and perceived utility questionnaire using predefined rating scale items,Socratic Examination Mode activation and subsequent pass outcome At Socratic Examination Mode activation and after the subsequent Clinical Learning Episode System recorded activation of Socratic Examination Mode and pass or fail status of the subsequent qualifying Clinical Learning Episode | — |
Countries
Thailand
Contacts
Public ContactSomkiat Wattanasirichaigoon
Continuing Medical Education Center, Medical Council of Thailand
Outcome results
None listed