Peer Review History

Original SubmissionSeptember 4, 2019
Decision Letter - Virginia E. Pitzer, Editor, Konstantin B. Blyuss, Editor

Dear Dr Varghese,

Thank you very much for submitting your manuscript 'Estimating a novel stochastic model for within-field disease dynamics of banana bunchy top virus via approximate Bayesian computation' for review by PLOS Computational Biology. Your manuscript has been fully evaluated by the PLOS Computational Biology editorial team and in this case also by independent peer reviewers. The reviewers appreciated the attention to an important problem, but raised some substantial concerns about the manuscript as it currently stands, mostly regarding the justification and details of the particular methodology used to address the problem at hand. While your manuscript cannot be accepted in its present form, we are willing to consider a revised version in which the issues raised by the reviewers have been adequately addressed. We cannot, of course, promise publication at that time.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

Your revisions should address the specific points made by each reviewer. Please return the revised version within the next 60 days. If you anticipate any delay in its return, we ask that you let us know the expected resubmission date by email at ploscompbiol@plos.org. Revised manuscripts received beyond 60 days may require evaluation and peer review similar to that applied to newly submitted manuscripts.

In addition, when you are ready to resubmit, please be prepared to provide the following:

(1) A detailed list of your responses to the review comments and the changes you have made in the manuscript. We require a file of this nature before your manuscript is passed back to the editors.

(2) A copy of your manuscript with the changes highlighted (encouraged). We encourage authors, if possible to show clearly where changes have been made to their manuscript e.g. by highlighting text.

(3) A striking still image to accompany your article (optional). If the image is judged to be suitable by the editors, it may be featured on our website and might be chosen as the issue image for that month. These square, high-quality images should be accompanied by a short caption. Please note as well that there should be no copyright restrictions on the use of the image, so that it can be published under the Open-Access license and be subject only to appropriate attribution.

Before you resubmit your manuscript, please consult our Submission Checklist to ensure your manuscript is formatted correctly for PLOS Computational Biology: http://www.ploscompbiol.org/static/checklist.action. Some key points to remember are:

- Figures uploaded separately as TIFF or EPS files (if you wish, your figures may remain in your main manuscript file in addition).

- Supporting Information uploaded as separate files, titled Dataset, Figure, Table, Text, Protocol, Audio, or Video.

- Funding information in the 'Financial Disclosure' box in the online system.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see here

We are sorry that we cannot be more positive about your manuscript at this stage, but if you have any concerns or questions, please do not hesitate to contact us.

Sincerely,

Konstantin B. Blyuss

Guest Editor

PLOS Computational Biology

Virginia Pitzer

Deputy Editor

PLOS Computational Biology

A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately:

[LINK]

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Referee report on: PCOMPBIOL-D-19-01505

It is not clear what the network is. How many nodes, how many links, what is the degree distribution? Is this a fully spatial network, apart from the long-range transmission? Do patches separated by dirt tracks define nodes? Are all adjacent patches considered as neighbours? Would be useful to see some summary statistics of this spatial network.

Data on which the parameter estimation has been done is never presented, plotted or analysed. I would expect that at least some of the paper presents and analyses this data.

Why are there no comparisons between the true data and model output? Would like to see how output from the models with the best parameters compares to the true data.

The simulation seem to be a discrete time simulation with an arbitrary update windows, so how do you compare abstract time to real time that it is present in the real data? Is the abstract time-step set to some real time like day or week or so on? It is never mentioned over what time window has the plantation been observed and some plots of how the number of infected patches evolved in time.

See my comment about the lack of analysis of the data on which the inference is based on.

At some point the authors talk about SI model but their model is SIS.

What is the initial condition for the simulation?

Nodes are sometimes referred to as patches then subsections and other versions, can there be some consistency?

Supplementary material in my opinion is more important than some of the figures in the paper. These essentially try to make a case that the model is good/valid. I would move this to the main part of the paper and would make a better case that the model is valid by comparing model output to existing data over the whole period of collection. Or by devising a test whereby one divides the existing data in “used for inference” and “used for validation” and tests performed over different such divisions to validate the model properly.

So the role of the vector is simply the long-range infection?

I am not sure if the choice of statistics is the best for comparing data to simulation.

First, I would like to see the data. Is it simply, time, patch, status? Is there seasonality in the collected data?

For reproducibility purposes is the code available on Github? What about the data?

Line 114: over a range of plantation

Line 132-133: what do the authors mean by “the new BBTV

model does not estimate for an initial seed node”? Do they mean that their model is not able to infer the initial seed?

Line 191: I think it should be /pi(\\phi) not \\phi(x) in the integral

Line 315: In the sentence “Fig 6 provides a posterior infectivity forecast for all subsections over a 6-month period” what does “subsections” refer to? Is this each node/patch?

Line 363-364: “if subsections 20 to 34 (in grey) were cleared” – is this equivalent o removing nodes?

Line 408-410: again this is not an SI model, in epidemiology this is an SIS model.

Line 468-472: what ranges of values can formula 2 take and what value means good fit versus bad fit?

Reviewer #2: Review of “Estimating a novel stochastic model for within-field disease dynamics of banana

bunchy top virus via approximate Bayesian computation” by Varghese et al. (PCOMPBIOL-D-19-01505)

This paper describes the development and fitting of a stochastic SIS model of banana bunchy top virus (BBTV) to some novel data from a plantation in Australia. The model is fitted to the available data using ABC-MCMC. The underlying disease dynamics involve an intermediate aphid vector, however data on aphid populations are unknown, and instead the authors simplify the underlying model to look at aggregate probabilities of localised transmission and long-range transmission between “nodes” in a network, where each node corresponds to a group of plants in spatially contiguous areas. This approach has the advantage of not having to model the aphid vector dynamics, at the cost of modelling at quite a course spatial level. They extend their model to use different transmission and recovery probabilities in different seasons (summer/winter) in order to try to assess the impact of weather / temperature etc. on the transmission dynamics.

The results suggest some marginal impact of season on localised transmission potential, and negligible impact of season on long-range transmission and recovery.

Overall I think the paper looks fine. It’s a relatively straightforward application of ABC methodology to a novel data set, and would be of interest to the readers of the journal call. The authors state a “significant” impact of season on localised transmission potential, but I think that the approximate posteriors overlap a lot here and so I might argue that the effect is not that “significant”. In my opinion there also needs to be more discussion of the ABC tolerance used in the ABC-MCMC, and what impact that might have made on the results as well. Perhaps subtle differences are being masked by the approximations introduced in the ABC, and this warrants further discussion. Another discussion point could be whether the use of a combined metric might be averaging out some of the information in the data,.

Minor remarks:

Abstract (and elsewhere): I think that technically the authors are using an SIS model, not an SI model per se, because there are transitions back to the S class (and hence why they observe endemic equilibriums in their forecasts).

L57, L94: Sometimes there are capital letters in e.g. “North-Eastern” (L94) but other times lower-case letters e.g. “south-east” (L57). These should be consistent throughout the manuscript.

L128: Sentence beginning, “Secondly, ….” does not read well. Suggest a re-write to clarify what the authors mean.

L144: “rogueing” should be “roguing”.

L160: The figure citations in the text are all out by one (and throughout the rest of the manuscript). This line should read “Fig. 1” and not “Fig. 2”, and this carries through the paper.

Equation 4: Should this have a 1/n outside the sum?

L242: Some more exposition about how the authors figured out which summary measures were informative would be interesting. What criteria did they use?

L245: It might be worth clarifying in the notation that S1 is specified for each time point (all the other summary measures are explicitly stated to be at time point t, except the first).

P13: How many replicates simulations were used to generate the estimate in equation 4? This should be stated somewhere.

Fig 4: It looks like the plot in the bottom-right has had its axes flipped compared to the other plots. Is this correct?

P21: Why did the authors choose to remove the grey squares? Why these and not any other squares? Possibly Fig 8 might be more informative if the differences were mapped, rather than the absolute values.

L384: “...their priori...” doesn’t make sense.

L411: Here the authors use “MCMC-ABC” but elsewhere they use “ABC-MCMC”.

Reviewer #3: See attachment

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: No: no data seen or even plotted

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Attachments
Attachment
Submitted filename: Review_PCOMPBIOL-D-19-01505.pdf
Revision 1

Attachments
Attachment
Submitted filename: Response to Reviewers_Submission.docx
Decision Letter - Virginia E. Pitzer, Editor, Konstantin B. Blyuss, Editor

Dear Mr. Varghese,

Thank you very much for submitting your manuscript "Estimating a novel stochastic model for within-field disease dynamics of banana bunchy top virus via approximate Bayesian computation" for consideration at PLOS Computational Biology. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. Reviewers 1 and 3 have suggested accepting your manuscript for publication as is. Reviewer 2 has mentioned a few additional very minor issues that they would like to ask you to sort out, and once this is done, they would not need to review the paper again, and the paper can then be accepted for publication.

Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. 

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Konstantin B. Blyuss

Guest Editor

PLOS Computational Biology

Virginia Pitzer

Deputy Editor

PLOS Computational Biology

***********************

A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately:

[LINK]

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: I thank the authors for addressing all my comments.

I am happy to recommend the paper for publication.

Reviewer #2: Review of “Estimating a novel stochastic model for within-field disease dynamics of banana

bunchy top virus via approximate Bayesian computation” by Varghese et al. (PCOMPBIOL-D-19-01505)

This is a review of a revised version of the above manuscript. I thank the authors for taking the time to consider and act on the comments from the first review. In my opinion, the manuscript is now much improved and clearer as to the intent, novelty and limitations of the study. As such I think it is suitable for publication, subject to a few minor amends as highlighted below.

One point is that there are now a lot of figures. I appreciate that the authors have moved some figures from the Supplementary Information to the main paper in response to some comments from the other reviewers. However, I think the balance has shifted a bit too far. For example, Fig. 7 is effectively the diagonals of Fig. 8, and as such I would remove Fig. 7 and just reference Fig. 8. I would also put all the MCMC convergence plots into the Supp Mat (e.g. Figs 9 and 10). Also, Fig 11 is a sensitivity analysis type plot and I think it should be in Supp Mat also.

There is also no Fig. 12 as far as I can see, so again, please take care with figure numbering.

Minor remarks:

Abstract, L33: I don’t think the “predict for” is correct here. Would suggest something like:

“Our models can be used to quantify the effects of …. BBTV spread, and can be used to predict high-risk areas in this plantation.”

L131: Should probably reference the exact GIS software used.

L281: Should probably be \\rho(S(x), S(y)) to be consistent with previous paragraph applying the distance metric to summary measures.

L297-300: Please make it clear that these are summed across all time points. This is not highlighted in the text until the following page, and I think it would help clarity to make this explicit here.

Table 1: Should the summer and winter be j = 0 and j = 1 respectively (not j = 1 and j = 2)?

L431: This is interesting, but I disagree slightly with the author’s interpretation. To my mind, what they have done is conduct a sensitivity analysis around what would happen to the posterior marginal Cis if they were to change the tolerance. They suggest that since the CIs don’t change much, then the “chosen tolerance value is reasonable for our application”. I might suggest that what they’ve done is assess the relative impacts of small changes, rather than the absolute impacts. I would suggest rewording this to something along the lines of, “small changes to the tolerance do not seem to impact on the approximate posterior uncertainties here, and so we decide to keep with our initial choice of tolerance.”

This also relates to my earlier question (apologies for not making this clear in the first review), that a choice of an aggregated discrepancy measure might average out some information in the data (an alternative is to use multiple distance metrics around each summary measure, each with a different tolerances e.g. Ratmann et al. 2009).

L592: “Significant” seasonality?

Reviewer #3: Whilst I am not fully convinced that the network model considered is more complex than the spatial models I referenced in my original review, I do believe that this work makes a nice contribution to applying ABC to epidemic models. I have no further comments to raise.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: Yes

Reviewer #2: None

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, PLOS recommends that you deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/ploscompbiol/s/submission-guidelines#loc-materials-and-methods

Revision 2

Attachments
Attachment
Submitted filename: Response to Reviewers_v2.docx
Decision Letter - Virginia E. Pitzer, Editor, Konstantin B. Blyuss, Editor

Dear Mr. Varghese,

We are pleased to inform you that your manuscript 'Estimating a novel stochastic model for within-field disease dynamics of banana bunchy top virus via approximate Bayesian computation' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Konstantin B. Blyuss

Guest Editor

PLOS Computational Biology

Virginia Pitzer

Deputy Editor

PLOS Computational Biology

***********************************************************

Formally Accepted
Acceptance Letter - Virginia E. Pitzer, Editor, Konstantin B. Blyuss, Editor

PCOMPBIOL-D-19-01505R2

Estimating a novel stochastic model for within-field disease dynamics of banana bunchy top virus via approximate Bayesian computation

Dear Dr Varghese,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Laura Mallard

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .