Peer Review History

Original SubmissionAugust 5, 2022
Decision Letter - Antonina Luca, Editor

PONE-D-22-22035Assessing the risks of treatment in Parkinson disease psychosis: an in-depth analysisPLOS ONE

Dear Dr. Nahab,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 03 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Antonina Luca, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

"This work was supported by ACADIA pharmaceuticals (San Diego, CA) and the National Institutes of Health (NIH) (University of California San Diego Clinical and Translational Science Award grant number UL1TR001442). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

"This work was supported in part by ACADIA pharmaceuticals (San Diego, CA) and the National Institutes of Health (NIH) (University of California San Diego Clinical and Translational Science Award grant number UL1TR001442). 

The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

The funding providers had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: General Main Issues:

1. Comparing treated patients to untreated patients may be biased for several reasons. Most importantly, those with treatment differ in the severity of the symptoms and disease that lead to confounding by the indication, etc.

2. Very small sample size limits the generalizability of the study.

3. Insufficient/inappropriate variable use in the Mortality analyses (more details in the method section).

4. Lack of any sensitivity analyses to mitigate unmeasured confounding.

1. Abstract:

Overall, the abstract is structured and informative about the study’s objectives and results.

2. Introduction:

• In general, it would be beneficial if the authors discuss the result of previous studies on the association of pimavanserin with mortality and how their study is different and bring more insights.

• Lines 6-7. Authors included pimavanserin as an antipsychotic with a “low affinity for dopaminergic D2 receptors”, although it does not have an affinity, as explained later in the abstract.

3. Method:

Line5. It would be helpful if the authors explained why they did exclude the patients with primary psychiatric diagnoses or atypical parkinsonism.

Line7. It is unclear if the authors restricted the cohort to new users of pimavanserin and quetiapine and how they defined the “combination” class. Did the “combination” class include only patients with concomitant use of pimavanserin and quetiapine or also those with previous exposure and discontinuation? New users may be at higher risk of acute events than prevalent users (depletion of susceptibles). Authors should include more information regarding how they classified the treated group.

Line13. There is no explanation why the authors included “levodopa equivalent daily dose.” Did they consider it as a proxy for the severity of parkinsonism? Medication is not a way to assess disease severity in PDP. There are forms of PD that don’t respond to medication (and thus, levodopa might not be used). Patients with severe hallucinations/psychosis symptoms may use lower doses of levodopa.

Line15. Include more information on “common general medical conditions” definitions.

Line16. How will laboratory values be helpful to this study? If they are already included “common general medical conditions.”

Line17. By including the variable “at any time during the study period,” how did they handle the time-varying confounders?

3.1. Statistical Analyses:

Line7. Duration of exposure is a significant variable that has been overlooked in the regression model for mortality rate.

4. Result:

I would suggest authors refer to the related table at the end of each paragraph. The order of the result section is very confusing, and it is not aligned with the order in the method section and the study's objective. I would suggest authors to reorganize this section.

Line1. The numbers are reported without any percentage.

5. Discussion:

Overall, the authors did a good job with the discussion.

Reviewer #2: this is a nicely written and useful study. However, there are some questions that require answers and some modifications needed. You need to discuss how the patients classified as PDP were diagnosed. You list no criteria. You fail to state who made the dx of PD or PDP. I assume you have data on less than half the subjects because these data were not routinely obtained, which is fine, but bespeaks the weakness of your data. Since your subjects were identified via a visit to any UCSD facility, it is quite possible that some patient were dxd with PD by a PA somewhere, given a dx of PD and carries that dx into a UCSD emergency room, which is then engraved in stone forevermore. Similarly for PD psychosis.

In some sense this may not matter since the real goal here is to see whether pim or quetiapine increase mortality. There is a major oversight in your discussion of weaknesses, which is that you have no idea of how the various antipsychotics were chosen. presumably enough different providers were involved that it may not matter, but it could be that only the severely psychotic patients got quetiapine, or only the ones with poor sleeping. The study looked only at quetiapine vs pim, but other similar studies have included the other antipsychotics used, such as olanzapine and risperidone. Why were they not included?

Table 1 should be labelled as data obtained at admission to the study (first assessed visit).

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Nov. 3, 2022

We thank the PLOS ONE reviewers for their time reviewing and thoughtful feedback for our manuscript entitled, “Assessing the risks of treatment in Parkinson disease psychosis: an in-depth analysis”, which has strengthened our paper. We have provided point-by-point responses to the reviewers’ comments below.

Reviewer #1:

General Main Issues:

1. Comparing treated patients to untreated patients may be biased for several reasons. Most importantly, those with treatment differ in the severity of the symptoms and disease that lead to confounding by the indication, etc.

Response: We acknowledge that there may be inherent biases in comparing treated to untreated patients. We have added the following sentences to acknowledge this issue in the limitations section (also in response to Reviewer 2’s comment #4):

“…we could not determine why one antipsychotic agent was chosen over another. Thus, we acknowledge that between-group differences may exist in psychosis severity or symptoms that could affect whether antipsychotic medication was prescribed, or which agent was prescribed.”

2. Very small sample size limits the generalizability of the study.

Response: We agree that the relatively small sample size limits generalizability of the study and have added the following sentence to the Discussion limitations paragraph:

“We acknowledge the small sample size as a limitation to the generalizability of our findings.”

3. Insufficient/inappropriate variable use in the Mortality analyses (more details in the method section).

Response: In our current analysis, we have included age, sex, last visit LEDD, and dementia diagnosis as pre-specified covariates. These were chosen based on literature review given that dementia has a strong association with increased mortality in this cohort. The reviewer’s thoughtful comment regarding LEDD as a covariate is addressed in detail below.

4. Lack of any sensitivity analyses to mitigate unmeasured confounding.

Response: Unfortunately, given the study design, information about age of disease onset, and motor severity was not available for all patients, so although these clinical factors have been associated with increased mortality in PD (see: Xu et al., Acta Neurologica Scandinavica 2014; Lo et al., Archives of Neurology, 2009), we were unable to include them as covariates. Due to our relatively small sample size – a limitation that we have added to our Discussions paragraph – we limited the number of covariates included to the ones that were most clinically relevant.

2. Introduction:

In general, it would be beneficial if the authors discuss the result of previous studies on the association of pimavanserin with mortality and how their study is different and bring more insights.

Response: We have added the following sentences regarding previous studies about pimavanserin’s association with mortality in the introduction, and the new information that our study adds:

“Larger observational cohort studies have found varying results regarding pimavanserin’s association with mortality in PD. One study demonstrated among people not residing in long-term care facilities, pimavanserin users had decreased mortality compared to users of other antipsychotics [10]. However, another study found among residents of long-term care facilities that pimavanserin users had higher mortality compared to non-users [11].” We also clarified that in this study, we had the ability to perform individual chart review to extract details about our population.

We further elaborate on this topic in the Discussion.

• Lines 6-7. Authors included pimavanserin as an antipsychotic with a “low affinity for dopaminergic D2 receptors”, although it does not have an affinity, as explained later in the abstract.

Response: We thank the reviewer for noticing this inconsistency and have corrected this. The sentence now reads:

“Direct PDP treatment is limited to the few antipsychotic medications that have low affinity for dopaminergic D2 receptors to avoid worsening parkinsonian symptoms; these include quetiapine and clozapine, which have traditionally been used to treat PDP.”

3. Methods:

Line 5. It would be helpful if the authors explained why they did exclude the patients with primary psychiatric diagnoses or atypical parkinsonism.

Response: We have clarified by adding the following sentences:

“We excluded patients with primary psychiatric diagnoses (including bipolar disorder, schizophrenia, schizotypal disorder, and depression with psychotic features), since these “may have drug-induced or tardive parkinsonism related to antipsychotic medication use. We excluded patients with atypical parkinsonism (e.g., multiple system atrophy, progressive supranuclear palsy, drug-induced parkinsonism, vascular parkinsonism), since pimavanserin is only FDA-approved for use in people with PDP.”

Line 7. It is unclear if the authors restricted the cohort to new users of pimavanserin and quetiapine and how they defined the “combination” class. Did the “combination” class include only patients with concomitant use of pimavanserin and quetiapine or also those with previous exposure and discontinuation? New users may be at higher risk of acute events than prevalent users (depletion of susceptibles). Authors should include more information regarding how they classified the treated group.

Response: We thank the reviewer for this comment. We have clarified in the paragraph regarding medication exposure by adding the following:

“The combination group included patients that had exposure to both pimavanserin and quetiapine during the study period, but these two agents were not necessarily taken at the same time. Patients who may have been exposed to antipsychotic medications and discontinued them before the study period were included in the untreated group.”

We have acknowledged the lack of information regarding medication exposure duration as a limitation in this study.

Line13. There is no explanation why the authors included “levodopa equivalent daily dose.” Did they consider it as a proxy for the severity of parkinsonism? Medication is not a way to assess disease severity in PDP. There are forms of PD that don’t respond to medication (and thus, levodopa might not be used). Patients with severe hallucinations/psychosis symptoms may use lower doses of levodopa.

Response: We have clarified that LEDD was included as a covariate since dopaminergic therapy may increase risk of psychosis, and have added the following supportive references:

Forsaa EB, Larsen JP, Wentzel-Larsen T, Goetz CG, Stebbins GT, Aarsland D, Alves G. A 12-year population-based study of psychosis in Parkinson disease. Archives of Neurology. 2010 Aug 1;67(8):996-1001.

Zhu, Kangdi, et al. "Risk factors for hallucinations in Parkinson's disease: results from a large prospective cohort study." Movement Disorders 28.6 (2013): 755-762.

Line 15. Include more information on “common general medical conditions” definitions.

Response: We have clarified the medical conditions that were searched using ICD-10 codes included cardiovascular disease, chronic kidney disease, diabetes mellitus type 2, hypertension, hyperlipidemia, and hypercoagulability.”

Line 16. How will laboratory values be helpful to this study? If they are already included “common general medical conditions.”

Response: We have clarified that we added laboratory values as an objective measure of these conditions.

Line 17. By including the variable “at any time during the study period,” how did they handle the time-varying confounders?

We have clarified that medical exposure/condition variables were defined as any exposure during the study period, and we have rephrased the manuscript accordingly. For the continuous covariates, we examined the average effect over the study period. While time-varying covariates are usually considered in longitudinal data analysis or survival data analysis, but due to the limitation of our study design, it is not feasible to perform survival analysis and we examined mortality as a binary outcome instead. We acknowledged in the Limitations that we were unable to perform this kind of analysis.

3.1. Statistical Analyses:

Line7. Duration of exposure is a significant variable that has been overlooked in the regression model for mortality rate.

Response: We agree with the reviewer that exposure duration is an important variable. However, since the study design was a retrospective review, unfortunately, there was no way to extract this information from the medical records. We acknowledge this is a major limitation to the study.

4. Results:

I would suggest authors refer to the related table at the end of each paragraph. The order of the result section is very confusing, and it is not aligned with the order in the method section and the study's objective. I would suggest authors to reorganize this section.

Response: We thank the reviewer for the feedback. We have reorganized the methods and results section to be more congruent and clearer and placed the tables at the end of each paragraph.

Line1. The numbers are reported without any percentage.

Response: We have added the percentages to the first paragraph of the Results section, which now reads,

“Using our inclusion/exclusion criteria, the sample included 2,994 PD patients – 352 (11.8%) with psychosis. Of these 352 PDP patients, 66 (18.8%) were untreated (did not receive antipsychotics), 34 (9.7%) received pimavanserin, 147 (41.8%) received quetiapine in the outpatient setting, and 68 (19.3%) received combination therapy, thus 315 patients were included in the analyses.”

Reviewer #2: This is a nicely written and useful study. However, there are some questions that require answers and some modifications needed.

1. You need to discuss how the patients classified as PDP were diagnosed.

You list no criteria.

Response: We thank the reviewer for raising this point. We have clarified that patients were diagnosed with PD and psychosis based on ICD-10 code. For patients who were prescribed antipsychotic medications, individual chart review was performed to ascertain that the medication was prescribed for psychosis (i.e., rather than for sleep or mood) and those without psychosis were excluded.

2. You fail to state who made the dx of PD or PDP. I assume you have data on less than half the subjects because these data were not routinely obtained, which is fine, but bespeaks the weakness of your data. Since your subjects were identified via a visit to any UCSD facility, it is quite possible that some patient were dxd with PD by a PA somewhere, given a dx of PD and carries that dx into a UCSD emergency room, which is then engraved in stone forevermore. Similarly for PD psychosis. In some sense this may not matter since the real goal here is to see whether pim or quetiapine increase mortality.

Response: Unfortunately, data regarding the provider who made the diagnosis of PD or PDP was not available for all subjects given the retrospective nature of the study. Many patients - but not all - were treated by a movement disorders neurologist. We acknowledge this is a limitation to our study and have added this point to our limitation paragraph. However, as the reviewer mentioned, this limitation would unlikely differ between the treated and untreated groups.

4. There is a major oversight in your discussion of weaknesses, which is that you have no idea of how the various antipsychotics were chosen. presumably enough different providers were involved that it may not matter, but it could be that only the severely psychotic patients got quetiapine, or only the ones with poor sleeping.

Response: We thank the reviewer for bringing this weakness to our attention. We have added this as a limitation to our Discussion.

5. The study looked only at quetiapine vs pim, but other similar studies have included the other antipsychotics used, such as olanzapine and risperidone. Why were they not included?

Response: The sample size of PDP patients taking other antipsychotics was small (n=9 treated with clozapine and other antipsychotics during the study period) - though we did not include these other agents as monotherapy in our search query). We have added to the manuscript:

“We did not include other atypical antipsychotic medications, e.g., risperidone or olanzapine, in our search query since these and other antipsychotics with D2 dopaminergic blocking mechanism of action are generally avoided in PD given their propensity to exacerbate parkinsonian symptoms.”

Olanzapine specifically is not recommended for treatment of PDP by the International Parkinson and Movement Disorders Society evidenced-based treatment review due to “unacceptable risk of motor deterioration” (Seppi et al. 2019).

6. Table 1 should be labeled as data obtained at admission to the study (first assessed visit)

Response: We have clarified in the Table 1 title and in the manuscript text that this data is the baseline information from the first assessed visit.

Thank you,

Fatta B. Nahab, M.D., FAAN

Department of Neurosciences

University of California San Diego

9500 Gilman Drive, Mailcode: 0886

La Jolla, CA 92093

fnahab@health.ucsd.edu

Attachments
Attachment
Submitted filename: response_to_reviewers_3_nov_22_LL_KL.doc
Decision Letter - Antonina Luca, Editor

Assessing the risks of treatment in Parkinson disease psychosis: an in-depth analysis

PONE-D-22-22035R1

Dear Dr. Fatta B. Nahab,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Antonina Luca, MD, PhD

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Antonina Luca, Editor

PONE-D-22-22035R1

Assessing the risks of treatment in Parkinson disease psychosis: an in-depth analysis

Dear Dr. Nahab:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Antonina Luca

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .