Peer Review History

Original SubmissionDecember 30, 2021
Decision Letter - Thomas Tischer, Editor

PONE-D-21-40982Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in HungaryPLOS ONE

Dear Dr. Merész,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please note that we have only been able to secure a single reviewer to assess your manuscript. We are issuing a decision on your manuscript at this point to prevent further delays in the evaluation of your manuscript. Please be aware that the editor who handles your revised manuscript might find it necessary to invite additional reviewers to assess this work once the revised manuscript is submitted. However, we will aim to proceed on the basis of this single review if possible.  The reviewer requests a more in-depth discussion of the studies premise, results and the associated literature. Could you please revise the manuscript?

Please submit your revised manuscript by Sep 08 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Thomas Tischer

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting piece of work that adds to the literature on determinants of access to medicines in a particular setting (Hungary) - thank you for working in this area and preparing your manuscript for publication. My main reservations rest with a) the lacking description of the decision-making process in Hungary that would elucidate what could potentially be changed and how; b) the partial contextualisation within the broader literature on determinants of coverage decisions; and c) the need for a more nuanced discussion of the lessons learned (is the article really advocating for managed entry agreements for all new medicines? at least the issue of administrative burden, transparency and cost containment should be discussed). Please see the following comments for more detail on suggested changes.

Abstract

The independent variables need to be more clearly named. The "need for legilative change to reimburse" is not clear without the context of the Hungarian reality that only comes in the main text. Part of the conclusions (the recommendaitons) does not appear equivalently in the main text. The recommendations should consider feasibility (see general comments above).

Introduction

When references to the literature are made (e.g. lines 46-61), it is not clear if you refer to all literature examining the relation between endogenous/exogenous factors and reimbursement decisions or only literature on Hungary. This is important to do very clearly, because there is quite a bit of research on what influences reimbursement decisions in different health systems, which is not captured in the introduction but is important for context. Please add a more comprehensive summary of available evidence (in general and in HUngary in particular) to also help set up a discussion of what this study adds later in the manuscript.

Lines 67-71: how is this different from the distinction you make in lines 62-67? The existence of RSA?

Lines 76-77: please justify the assessment of the usefulness of IFR (you will need to explain better what they are and how they fit in the HUngarian reimbursement system)

Generally for the introduction: Please provide an overall description of how reimbursement of new mediicnes works in Hungary (one paragraph, not very long) that you can use as a basis for details brought up and used in the methodology (such as need for legislative change or IFRs). This is necessary for understanding your paper and how it fits/what it adds better. You could also add a figure if helpful.

Methods

Generally, information on Managed Entry Agreements is not publicly available, but you seem to have at least some in Hungary. Please makes this clear early on tin the methods.

Lines 107-116: please check redundancy with the introduction. If you end up providing a foundational description as suggested above, you can be shorter in the methods when it comes to the definition of your variables.

Lines 123-124: this is not the place for a funding statement of your work, should be moved to the peripherals of the manuscript.

Lines 144-145 "however, this variable was recorded...200 million HUFs". This needs further explanation.

Line 152: "changing the reimbursement technique" - what does this mean? might be solved with a better description of processes in the intro as suggested above.

Results

Lines 188-192: the logic of what is in the table and what is reported only is not always clear. Is the year of submission an independent variable?

Discussion

Lines 198-200: you should not bring in new potential independent variables to discard at this point, this should be done earlier. Also perhaps spend a few words in the introduction to discuss how you categorise endogenous and exogenous parameters.

Line 203: I would argue that this is rather an attempt to explore the association in a quantitative way rather than quanitfying the association

Lines 205-210: as int he introduction, unclear if the contrast here is to literature on these issues in general or only literature on Hungary.

213-214: Please clarify this and link to a fundamental description of decision-making processes in Hungary.

Lines 232-237: this needs further explanation (what is the new law on/what does it say-how does it change the situation)

The limitations of the study need to be discussed in further detail, including the chosen methodology and the adequacy of the independent variables. Why this article is of interest beyond Hungary should be substantiated further.

Conclusions

The recommendations in the abstract do not appear in the main text (see also comment above). The potential targets (meaning legislative change and more MEAs?) should be justified in more detail.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Dear Reviewer,

We would like to thank you for your valuable insights and we hope that our responses address your reservations. Let us know if there is anything else to adjust on the manuscript.

Best wishes,

The Authors

Attachments
Attachment
Submitted filename: Response.pdf
Decision Letter - Vasileios Kallinterakis, Editor

Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in Hungary

PONE-D-21-40982R1

Dear Dr. Merész,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Vasileios Kallinterakis

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: No

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: This research study is indeed very interesting and is conducted in a rigorous scientific way. However, in order to be published, the manuscript requires heavy editing to make the story flow better and ensure good use of the English language.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Formally Accepted
Acceptance Letter - Vasileios Kallinterakis, Editor

PONE-D-21-40982R1

Association of Exogenous Factors with the Access to Innovative Pharmaceutical Products in Hungary

Dear Dr. Merész:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Vasileios Kallinterakis

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .