Peer Review History

Original SubmissionJune 7, 2024
Decision Letter - Laura Sbaffi, Editor, Cleva Villanueva, Editor

PDIG-D-24-00231

Real-world patterns in remote longitudinal study participation: a study of the Swiss Multiple Sclerosis Registry

PLOS Digital Health

Dear Dr. Daniore,

Thank you for submitting your manuscript to PLOS Digital Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Digital Health's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript within 60 days Sep 21 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at digitalhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pdig/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Cleva Villanueva, M.D., Ph.D.

Guest Editor

PLOS Digital Health

Journal Requirements:

1. Please send a completed 'Competing Interests' statement, including any COIs declared by your co-authors. If you have no competing interests to declare, please state "The authors have declared that no competing interests exist". Otherwise please declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests:"

2. We note that you have indicated that there are restrictions to data sharing for this study. For studies involving human research participant data or other sensitive data, we encourage authors to share de-identified or anonymized data. However, when data cannot be publicly shared for ethical reasons, we allow authors to make their data sets available upon request. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

Before we proceed with your manuscript, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., a Research Ethics Committee or Institutional Review Board, etc.). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. You also have the option of uploading the data as Supporting Information files, but we would recommend depositing data directly to a data repository if possible.

Please update your Data Availability statement in the submission form accordingly.

3. Please provide separate figure files in .tif or .eps format.

For more information about figure files please see our guidelines:

https://journals.plos.org/digitalhealth/s/figures

https://journals.plos.org/digitalhealth/s/figures#loc-file-requirements

Additional Editor Comments (if provided):

To revise your manuscript according to the reviewer's comments and the journal guidelines of PLOS Digital Health, here is a detailed plan for each section:

Methods

Make the Section more Compact:

Review each paragraph and sentence to eliminate redundancy.

Use concise language and remove any unnecessary details.

Consider using bullet points or subheadings for clarity.

Addressing Factors Affecting the Model:

Underhoused Persons: Acknowledge the potential impact of underhoused individuals not completing follow-up surveys and how this might bias the results.

Hospitalized or Institutionalized Persons: Discuss the implications of participants being in hospitals or other facilities on survey completion rates.

Timing of SMSR Completion: Clarify whether the SMSR is completed at the time of MS diagnosis or if it includes participants diagnosed over a prolonged period. Discuss how MS treatments over time could affect the study results.

Managing Death or De-registration Events:

Explain how the departure of 41 patients due to death or de-registration was handled in the analysis.

Clarify whether these patients were classified as low retention or lower response than the median and how their data were treated.

Justification for K-means Clustering Method:

Provide a rationale for choosing the K-means clustering method.

Compare it with other clustering methods such as Robust and Sparse K-means or weighted K-means, or justify why these methods were not used.

Details on Unsupervised Clustering Methods:

Include more information about the unsupervised clustering methods and results.

Add the elbow method graphical representation in the supplemental information.

Validation of Clustering Analysis:

Explain any validation methods used for the unsupervised clustering analysis.

Discuss how the large sample size and multi-year span of the data were leveraged for validation.

Results

Improving Figure 3:

Make the figure more readable by increasing the size of the text.

Consider reformatting or redesigning the figure for better clarity.

References

Consistent Formatting:

Ensure all references are formatted according to the journal's guidelines.

Use a consistent style for all references, including punctuation, capitalization, and order of information.

Supporting Information

Table of Contents:

Create a table of contents for the supporting information section, following the journal's submission guidelines.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Digital Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

--------------------

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

--------------------

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

--------------------

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Digital Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

--------------------

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The content of the paper is quite interesting and relevant for long term retention in remote longitudinal studies. The main claims of the paper were made clear and a great amount of evidence was included in the paper. Please check the journals guidelines of submission again, for instance; in-text sources are supposed to be listed in brackets, Figures are supposed to be titled Fig, Headings and spacing needs to be changed accordingly, page numbering & line numbering is missing etc. An example sheet is provided on the official website of PLOS Digital Health. I wonder whether it is possible to reduce the method section a little bit to make it more compact. Figure 3 is hard to read, maybe it can be displayed in a better way (letters are quite small). Formatting between References 1-9 and 10 ff. is different. Supporting Information needs a table of content at the end of the manuscript (an example can also be found in the submission guidelines).

Reviewer #2: This is a study examining participant retention in a longitudinal Multiple Sclerosis study. The authors used baseline characteristics from an online survey to determine factors associated with participant retention and performed an unsupervised clustering analysis. The results of the analyses are not novel, as highlighted by the authors in the discussion. However, the results are important and add to the existing literature on this topic and does explore this topic in a longitudinal study that is of clinical importance in Switzerland.

1) The models fail to account for several important clinical and social economic variables that are potential confounders that could impact survey completion rates. For example, underhoused persons may not receive the follow up surveys and thus be less likely to complete surveys. Persons admitted to hospital or other facility may also be less likely to complete the surveys. Is the SMSR completed at time of diagnosis of MS? Or are there participants who have had a diagnosis of MS for a prolonged period of time? If so, what are the implications of MS treatments on the study results? Does the survey data contain any information about these and other factors that may explain reasons for reduced survey completion rates? If so, this should be included in the models. If not, the authors should explain in the discussion section how these confounders may influence their results.

2) How do the methods manage death or de-registration events in the analyses? Though only 41 patients left the SMSR by death/de-registration, the authors do not comment how these events were treated in the analyses. Were these patients all classified as low retention or lower response than median? This should be explicitly described by the authors.

3) Why was the K-means clustering method chosen? Other clustering methods (ie. Robust and Sparse K-means, weighted K-means) may prove more advantageous in this dataset given the type of variables included. The authors should consider comparing other clustering methods in the analysis or provide a justification for the K-means methodology used.

4) The authors provide limited information about the unsupervised clustering analysis methods and results. The elbow method graphical representation could be included in the supplemental information for example. Was there any validation of the unsupervised clustering analysis? Presumably with such a large sample size spanning multiple years, validation methods could be performed.

--------------------

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

--------------------

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Attachments
Attachment
Submitted filename: 20240829_Rebuttal_Letter.pdf
Decision Letter - Laura Sbaffi, Editor, Cleva Villanueva, Editor

Real-world patterns in remote longitudinal study participation: a study of the Swiss Multiple Sclerosis Registry

PDIG-D-24-00231R1

Dear Paola Daniori,

We are pleased to inform you that your manuscript 'Real-world patterns in remote longitudinal study participation: a study of the Swiss Multiple Sclerosis Registry' has been provisionally accepted for publication in PLOS Digital Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow-up email from a member of our team. 

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact digitalhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Digital Health.

Best regards,

Cleva Villanueva, M.D., Ph.D.

Guest Editor

PLOS Digital Health

***********************************************************

The manuscript is accepted for publication in PLOS Digital Health because the authors appropriately addressed all the reviewers' comments and questions and made the necessary revisions

Reviewer Comments (if any, and for reference):

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .