Malignant Melanoma
Conditions
Keywords
artificial intelligence, diagnostic accuracy, clinical desicion supportive tool
Brief summary
Dermalyzer is a device intended to be used as a decision support system for assessing cutaneous lesions suspected of being melanomas. The input from the device is not intended to be used as the sole source of information for diagnosis. Intended to be used by medical professionals. The service does not provide any other diagnosis. The study is a pre-marketing, prospective, confirmatory, first in clinical setting, pivotal multi-centre, non-interventional clinical investigation to evaluate the clinical safety, performance and benefit of Dermalyzer in patients with cutaneous lesions where malignant melanoma (MM) cannot be ruled out. Primary objective: The primary objective of the investigation is to determine the diagnostic precision of the device; to answer at which level the AI tool Dermalyzer can identify malignant melanomas among cutaneous lesions that are assessed in clinical use due to any degree of malignancy suspicion. Secondary objectives: A) To evaluate usability and applicability in clinical praxis of Dermalyzer by users (medical professionals), B)To gain an increased knowledge and understanding of how digital tools enhanced co-artificial intelligence can assist physicians with the right support for an earlier diagnosis of malignant melanoma. Exploratory objective: To explore health economic aspects of improved diagnosis support Methods: The subjects will be included from around 30 primary care centers in Sweden. If the subject's lesion(s) is suspected of melanoma or melanoma cannot be ruled out, the subject is asked to participate in the investigation. The investigator examines the subject's lesion(s) and makes the clinical assessment of the subject lesion(s) based on established clinical decision algorithms The investigator takes dermoscopy images according to standard of care and archives the image(s) according to clinical routine. The investigator decides on action, based on his or her MM suspicion (excision at the primary care center or referral for excision or referral to a dermatologist for further assessment). The investigator takes images of the lesion(s) again, this time with a mobile phone, containing the AI software, connected to a dermatoscope, and follows the on-screen instructions. The image is processed by the AI and the results are visible on the screen within seconds. The investigator records how he considers that the degree of suspicion of MM (higher vs lower) would have been affected by the AI SW result if it had been the governing body for the treatment. At study follow-up, the final tumor diagnosis from the histopathology results (melanoma/non melanoma) or by dermatologist assessment (if stated as undoubtedly benign), the degree of agreement between the true final diagmosis and the outcome of the AI decision support is determined, and the diagnostic accuracy in distinguishing melanoma from non-melanoma, in terms of sensitivity and specificity as well the positive and predictive value. The corresponding comparison is performed from the examining investigators estimated clinical degree of suspicion. The clinical investigation will collect information from the users, how participating users (investigators at the site) experience the usability of the AI decision support and attaching applications, from short surveys including the validated System Usability Scale.
Detailed description
Background: Malignant melanoma is a worldwide health issue of concern, of increasing incidence. Early melanoma detection is crucial for survival and prognosis. Dermalyzer is a device intended to be used as a decision support system for assessing cutaneous lesions suspected of being melanomas, based on artificial intelligence (AI), often referred to as machine learning. The input from the device is not intended to be used as the sole source of information for diagnosis. Intended to be used by medical professionals. The service does not provide any other diagnosis. Study aims/objectives: Primary objective: The primary objective of the investigation is to determine the diagnostic precision of the device; to answer at which level the AI tool Dermalyzer can identify malignant melanomas among cutaneous lesions that are assessed in clinical use due to any degree of malignancy suspicion. Secondary objectives: A) To evaluate usability and applicability in clinical praxis of Dermalyzer by users (medical professionals), and B) To gain an increased knowledge and understanding of how digital tools enhanced co-artificial intelligence can assist physicians with the right support for an earlier diagnosis of malignant melanoma. Exploratory objective: To explore health economic aspects of improved diagnosis support Exploratory endpoints Materials & methods: The subjects will be included from around 30 primary care centers in Sweden. If the subject's lesion(s) is suspected of melanoma or melanoma cannot be ruled out, the subject is asked to participate in the investigation. The investigator examines the subject's lesion(s) and makes the clinical assessment of the subject lesion(s) based on established clinical decision algorithms (such as Chaos & clues, 3- or 7-point checklist, or the ABCDE concept) of whether there is a suspicion of MM, according to the usual clinical routine (also includes very low suspicion of MM but cannot be completely dismissed). The investigator takes dermoscopy images according to standard of care and archives the image(s) according to clinical routine. The investigator decides on action, based on his or her MM suspicion (excision at the primary care center or referral for excision or referral to a dermatologist for further assessment). If the subject has agreed to participate in the investigation, the investigator indicates in the CRF the clinical suspicion level of MM, and decided action. The investigator takes images of the lesion(s) again, this time with a mobile phone, containing the IMD AI SW, connected to a dermatoscope, and follows the on-screen instructions. The image is processed by the AI SW and the results are visible on the screen within seconds. A unique auto generated code number is also presented. The code number is registered on the enrollment log and in the CRF. The investigator records how he considers that the degree of suspicion of MM (higher vs lower) would have been affected by the AI SW result if it had been the governing body for the treatment. When the subject has been fully examined and receives the final tumor diagnosis from the histopathology/PAD results or dermatologist assessment (melanoma/non melanoma), the degree of agreement between the PAD and the outcome of the AI SW decision support is calculated with the Kappa-analysis and the diagnostic accuracy to be able to distinguish melanoma from non-melanoma in the form of sensitivity and specificity as well the positive and predictive value. The corresponding comparison is performed from the examining investigators estimated clinical degree of suspicion, as well as the diagnostic accuracy when both the PAD and the AI decision support are wigheted together (ei in cases where the investigator and the decisions support are in agreement in their assessment). The clinical investigation will collect information from the users, how participating users (investigators at the site) experience the usability of the AI SW decision support and attaching applications, from short surveys including the validated System Usability Scale.
Interventions
To evaluate the diagnostic accuracy of the Dermalyzer device to detect melanoma among cutaneos skin lesions by dermoscopy.
Sponsors
Study design
Eligibility
Inclusion criteria
* Patients ≥18 years * Patients attending a primary care facility with at least 1 suspicious skin lesion where malignant melanoma cannot be ruled out. * Willingness and ability to provide informed consent.
Exclusion criteria
* Cutaneous lesions that are considered as benign by the investigator and thus not subject for further clinical investigation * Cutaneous lesions in areas that are not suitable for dermoscopy imaging * Cutaneous lesions in areas with any form of scarring of tissue due to injury * Damaged or injured non intact skin where the cutaneous lesion is located * Individuals with skin type V and VI according to the Fitzpatrick scale (darker brown or black coloured skin) * Cutaneous lesions in areas covered by tattoos * Cutaneous lesions in abundantly hairy skin areas (provided the the area cannot be shaved freely from the hair to allow clear view for the dermatoscope) * Images where the entire lesion is not inside the photo * Images that are out of focus
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| Diagnostic Accuracy to Detect Melanoma | 12 months | The number of correctly classified skin lesions by the Dermalyzer (melanoma vs not melanoma), as compared with the result of the standard diagnostic procedure (dermatologist assessment and histoptahologic analysis). |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| Instrument Usability of the Device | Secondary measurement variable data was collected after baseline primary data inclusion was ended in Feb 2022, and completeted within 3 months from that. | User experience and perception of the Dermalyzer, in the form of System Usability Scale, to evaluate the usability and applicability in clinical praxis. The validated scale conists of 10 Likert scale based questions (scored 1-5 points), reflecting different aspects of usability, such as easiness to use, complexity, inconsistensy, understandability, etc. It summurizes in a score ranging from 0 - 100 points, where a high score reflects good usability properties. |
Countries
Sweden
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| Primary Care Patients With Melanoma Suspicious Skin Lesion(s) Patients seeking primary care, having one or more skin lesion that the primary care physician cannot by certainty can rule out as being a possible melanoma. | 228 |
| Total | 228 |
Withdrawals & dropouts
| Period | Reason | FG000 |
|---|---|---|
| Overall Study | Lost to Follow-up | 3 |
Baseline characteristics
| Characteristic | Primary Care Patients With Melanoma Suspicious Skin Lesion(s) |
|---|---|
| Age, Continuous | 56 years |
| Clinical suspicion degree of melanoma (asssessed by examining physician) High degree of suspicion of melanoma | 51 Participants |
| Clinical suspicion degree of melanoma (asssessed by examining physician) Low degree of suspicion, but cannot exclude melanoma. | 177 Participants |
| Race/Ethnicity, Customized Skin type 1: Pale skin, easily burns, never tans, often blond or red hair (assessed by physician) | 19 participants |
| Race/Ethnicity, Customized Skin type 2: Fair skin, easily burns, seldom tans (assessed by physician) | 145 participants |
| Race/Ethnicity, Customized Skin type 3: Darker white skin, sometimes burns, easily tans (assessed by physician) | 52 participants |
| Race/Ethnicity, Customized Skin type 4: Light brown skin, seldom burns, always tans (assessed by physician) | 12 participants |
| Region of Enrollment Sweden | 228 participants |
| Sex: Female, Male Female | 125 Participants |
| Sex: Female, Male Male | 103 Participants |
Adverse events
| Event type | EG000 affected / at risk |
|---|---|
| deaths Total, all-cause mortality | 0 / 231 |
| other Total, other adverse events | 0 / 231 |
| serious Total, serious adverse events | 0 / 231 |
Outcome results
Diagnostic Accuracy to Detect Melanoma
The number of correctly classified skin lesions by the Dermalyzer (melanoma vs not melanoma), as compared with the result of the standard diagnostic procedure (dermatologist assessment and histoptahologic analysis).
Time frame: 12 months
Population: Patients with some degree ov melanoma suspsicion raised by the examining primary care physician.
| Arm | Measure | Group | Value (NUMBER) |
|---|---|---|---|
| Diagnostic Accuracy of Dermalyzer to Detect Melanoma | Diagnostic Accuracy to Detect Melanoma | True positives | 20 number of skin lesions |
| Diagnostic Accuracy of Dermalyzer to Detect Melanoma | Diagnostic Accuracy to Detect Melanoma | False positives | 92 number of skin lesions |
| Diagnostic Accuracy of Dermalyzer to Detect Melanoma | Diagnostic Accuracy to Detect Melanoma | False negatives | 1 number of skin lesions |
| Diagnostic Accuracy of Dermalyzer to Detect Melanoma | Diagnostic Accuracy to Detect Melanoma | True negatives | 140 number of skin lesions |
Instrument Usability of the Device
User experience and perception of the Dermalyzer, in the form of System Usability Scale, to evaluate the usability and applicability in clinical praxis. The validated scale conists of 10 Likert scale based questions (scored 1-5 points), reflecting different aspects of usability, such as easiness to use, complexity, inconsistensy, understandability, etc. It summurizes in a score ranging from 0 - 100 points, where a high score reflects good usability properties.
Time frame: Secondary measurement variable data was collected after baseline primary data inclusion was ended in Feb 2022, and completeted within 3 months from that.
Population: Primary care physicians that took part in the recruitment and inclusion of patients (study participants) in the trial.
| Arm | Measure | Value (MEDIAN) |
|---|---|---|
| Diagnostic Accuracy of Dermalyzer to Detect Melanoma | Instrument Usability of the Device | 75 SUS score points |