Focus of Study = Medical Writing
Conditions
Keywords
medical writing, reporting, randomized controlled trial
Brief summary
Introduction: Inadequate reporting is a frequent cause of waste of research. For example, essential information for evaluating the risk of bias such as the method of randomization is lacking in 75% of published randomized controlled trials (RCTs), and over 30% of reports do not provide sufficient details to allow replication of the treatment evaluated in the trial in clinical practice. To overcome this issue, the CONSORT statement, an evidence-based, minimum set of recommendations for reporting RCTs was developed in 1996. These guidelines have since been updated in 2001 and more recently in 2010. In addition, extensions to the main CONSORT statement have been developed to give additional guidance for RCTs with specific designs (eg cluster), data (eg harm), and interventions (eg nonpharmacologic treatments). Many journals endorse the CONSORT statement. Some journals provide recommendations to authors to follow the CONSORT guidelines and some editors enforce the use of the CONSORT guidelines by requesting authors to submit a checklist in either the submission or acceptance stage. Nevertheless, inadequate reporting remains. Our objective is to evaluate the impact of the CONSORT based online writing tool on the completeness of reporting.
Detailed description
Context Inadequate reporting is a frequent cause of waste of research. For example, essential information for evaluating the risk of bias such as the method of randomization is lacking in 75% of published randomized controlled trials (RCTs), and over 30% of reports do not provide sufficient details to allow replication of the treatment evaluated in the trial in clinical practice. To overcome this issue, the CONSORT statement, an evidence-based, minimum set of recommendations for reporting RCTs was developed in 1996. These guidelines have since been updated in 2001 and more recently in 2010. In addition, extensions to the main CONSORT statement have been developed to give additional guidance for RCTs with specific designs (eg cluster), data (eg harm), and interventions (eg nonpharmacologic treatments). Many journals endorse the CONSORT statement. Some journals provide recommendations to authors to follow the CONSORT guidelines and some editors enforce the use of the CONSORT guidelines by requesting authors to submit a checklist in either the submission or acceptance stage. Nevertheless, inadequate reporting remains. Hypothesis We hypothesize that to improve reporting, the CONSORT guidelines must be implemented at the stage of the writing of the manuscript instead of at the stage of journal submission or peer review process. We developed a CONSORT based online writing tool to improve the completeness of reporting. This tool focuses on some domains of the methods section of a 2-arm parallel group randomized controlled trial evaluating pharmacologic or nonpharmacologic treatment. Objective Our objective is to evaluate the impact of the CONSORT based online writing tool on the completeness of reporting. Methods Study design: We will perform a split-manuscript randomized controlled trial, adapted from the split-body design. We will consider 6 domains of the methods section: trial design, randomization, blinding, participants, interventions, and outcomes. The unit of randomization will be the domain and the allocation ratio 1:1. Each study participant will receive the experimental intervention (the tool) for 3 of the 6 domains and the control intervention (no tool) for thther 3 domains. Participants: Masters and doctoral students Intervention: The use of the online writing tool for writing the methods section of an article from an RCT protocol. Comparator: The writing the methods section of an article from an RCT protocol with no specific support. Primary outcome: The primary outcome will be the average score for completeness of reporting. Number of participants expected: 40
Interventions
The writing tool contained the main CONSORT item and extension items for non pharmacological treatments along with bullet points indicating key elements to report from the explanation and elaboration publications of the CONSORT. Participants were also instructed to detail information they felt important to report but that was not available in the study protocol they were provided.
The control tool simply provided the domain or section heading with a space too write. Similar to for the experimental intervention, participants were to indicate information they felt important to report but unavailable in the provided study protocols.
Sponsors
Study design
Eligibility
Inclusion criteria
* Adults * Masters or doctoral students
Exclusion criteria
* not in the field of medical research * not adults * no masters or doctoral level education
Design outcomes
Primary
| Measure | Time frame | Description |
|---|---|---|
| The Primary Outcome Will be the Average Score for Completeness of Reporting on a Scale of 0-10. | one time measure after a four-hour writing session | Completeness of reporting will be determined according to a grading rubric individualized to each study protocol, 0 being the lowest and 10 the highest |
Secondary
| Measure | Time frame | Description |
|---|---|---|
| The Score for Completeness of Reporting for Blinding | one time measure after a four-hour writing session | on a scale from 0 to 10, 0 being the lowest and 10 the highest |
| The Score for Completeness of Reporting for Participants | one time measure after a four-hour writing session | on a scale from 0 to 10, 0 being the lowest and 10 the highest |
| The Score for Completeness of Reporting for Interventions | one time measure after a four-hour writing session | on a scale from 0 to 10, 0 being the lowest and 10 the highest |
| The Score for Completeness of Reporting for Randomization | one time measure after a four-hour writing session | The score for completeness of reporting (0-10) for the manuscript section randomization, 0 being the lowest and 10 the highest |
| The Score for Completeness of Reporting for Trial Design | one time measure after a four-hour writing session | on a scale from 0 to 10, 0 being the lowest and 10 the highest |
| Average Score for Completeness of Reporting of Essential Elements | one time four hour writing session | Completeness of reporting scores calculated based on essential elements to report, on a scale from 0 to 10, 0 being the lowest and10 the highest |
| The Score for Completeness of Reporting for Outcomes | one time measure after a four-hour writing session | on a scale from 0 to 10, 0 being the lowest and 10 the highest |
Countries
France
Participant flow
Participants by arm
| Arm | Count |
|---|---|
| All Participants | 41 |
| Total | 41 |
Baseline characteristics
| Characteristic | All Participants |
|---|---|
| Age, Continuous | 29 years |
| Comfortable with English | 26 Participants |
| Education doctoral students | 14 participants |
| Education masters students | 27 participants |
| Experience writing RCTs | 7 Participants |
| Familiar with guidelines Familiar with guidelines | 24 participant |
| Familiar with guidelines Not familiar with guidelines | 17 participant |
| Frequency reading RCTs More than once a year | 30 Participants |
| Frequency reading RCTs once a month | 6 Participants |
| Frequency reading RCTs Once a week | 5 Participants |
| Previously involved in RCTs | 18 Participants |
| Sex: Female, Male Female | 24 Participants |
| Sex: Female, Male Male | 17 Participants |
| Taught about RCTs | 38 Participants |
Adverse events
| Event type | EG000 affected / at risk | EG001 affected / at risk |
|---|---|---|
| deaths Total, all-cause mortality | — / — | — / — |
| other Total, other adverse events | 0 / 0 | 0 / 0 |
| serious Total, serious adverse events | 0 / 41 | 0 / 41 |
Outcome results
The Primary Outcome Will be the Average Score for Completeness of Reporting on a Scale of 0-10.
Completeness of reporting will be determined according to a grading rubric individualized to each study protocol, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Primary Outcome Will be the Average Score for Completeness of Reporting on a Scale of 0-10. | 7.1 units on a scale | Standard Deviation 1.2 |
| Writing With no Specific Support, Control Arm | The Primary Outcome Will be the Average Score for Completeness of Reporting on a Scale of 0-10. | 5.0 units on a scale | Standard Deviation 1.6 |
Average Score for Completeness of Reporting of Essential Elements
Completeness of reporting scores calculated based on essential elements to report, on a scale from 0 to 10, 0 being the lowest and10 the highest
Time frame: one time four hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | Average Score for Completeness of Reporting of Essential Elements | 7.8 units on a scale | Standard Deviation 1.6 |
| Writing With no Specific Support, Control Arm | Average Score for Completeness of Reporting of Essential Elements | 6.4 units on a scale | Standard Deviation 2.3 |
The Score for Completeness of Reporting for Blinding
on a scale from 0 to 10, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Blinding | 6.9 units on a scale | Standard Deviation 2.4 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Blinding | 6.2 units on a scale | Standard Deviation 2.3 |
The Score for Completeness of Reporting for Interventions
on a scale from 0 to 10, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Interventions | 7.1 units on a scale | Standard Deviation 1.5 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Interventions | 5.3 units on a scale | Standard Deviation 2 |
The Score for Completeness of Reporting for Outcomes
on a scale from 0 to 10, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Outcomes | 6.1 units on a scale | Standard Deviation 2.1 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Outcomes | 6.4 units on a scale | Standard Deviation 3 |
The Score for Completeness of Reporting for Participants
on a scale from 0 to 10, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Participants | 6.7 units on a scale | Standard Deviation 2 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Participants | 4.5 units on a scale | Standard Deviation 2.4 |
The Score for Completeness of Reporting for Randomization
The score for completeness of reporting (0-10) for the manuscript section randomization, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Randomization | 8.4 units on a scale | Standard Deviation 2.4 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Randomization | 4.6 units on a scale | Standard Deviation 2.9 |
The Score for Completeness of Reporting for Trial Design
on a scale from 0 to 10, 0 being the lowest and 10 the highest
Time frame: one time measure after a four-hour writing session
| Arm | Measure | Value (MEAN) | Dispersion |
|---|---|---|---|
| Online Writing Tool, Experimental Arm | The Score for Completeness of Reporting for Trial Design | 8.1 units on a scale | Standard Deviation 2.3 |
| Writing With no Specific Support, Control Arm | The Score for Completeness of Reporting for Trial Design | 2.7 units on a scale | Standard Deviation 1.9 |