Peer Review History
| Original SubmissionAugust 31, 2020 |
|---|
|
PONE-D-20-27239 Dutch tenants at risk of eviction: Identifying predictors of eviction orders PLOS ONE Dear Dr. Edwards, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Both qualified reviewers liked your research but raised valid concerns. Please try to address their concerns as much as you can. Particularly, you have not explored enough your data. Although it is difficult to establish a rigorous causality test, it should be feasible to estimate more models with different predictors to see how your current findings change, as reviewer 2 suggested. Also a p value of 0.1 is often considered significant too and you certainly can include those variables whose coefficients are statistically significant at the 10% level or better. Please submit your revised manuscript by Jan 09 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Shihe Fu, Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please ensure you have provide a copy of all questionnaires used in your study as supporting information files. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This paper utilizes a sample of 344 tenants who were at risk of eviction due to rent arrears in five Dutch cities interviewed using a structured questionnaire to test ten potential risk factors for evictions. Multiple logistic regression analyses are applied on the tenants’ personal information and the tenants’ situation at the notice of eviction risk and six months after the notice. The authors conclude that the amount of rent arrears was a strong predictor for receiving an eviction order, and single tenants, tenants who had already been summoned to appear in court were more likely to receive an eviction order. The authors believe that these results can contribute to identifying households at risk of eviction at an early stage, and help to develop targeted interventions to prevent evictions. Overall, this is an interesting research work and carries immediate real-life application potentials. However, there are several major weaknesses in the current version of this paper. First, the survey design. The sample size is not big, but this is not a very big issue. The more important issue is the representativeness of the samples. The authors need to provide more justifications on the interview was scientifically designed, and the interviewees were not chosen with systematic bias. For example, since the interviewees enrolled in the survey on voluntary basis rather than by force, there is high possibility that only those tenants with low self-assessment of eviction risks would choose to join the research. Thus, the analysis on such groups of interviewees may produce biased findings. Second, the empirical design. What so far observed and discussed by the authors is just correlation but not causality. Correlation helps little in delivering policy recommendation. Since the data is one-shot cross-section data, it may suffer high risks of self-selection and endogeneity when attempting to discover causality relationship. These problems are hard to address but not incurable. There are several econometric tools to address them. The authors may carefully consider them. Third, the model. Too few controls are included in the regression models. I suppose several variables such as ethnic backgrounds, immigrant or not and years of immigration, the ratio of rent in household monthly income, and regional dummies should enter in the model. The work also needs several robustness checks, i.e., checking the consistency of the findings in different model setup and alternative use of key variables. Fourth, the generality. PLOS ONE is an international journal, the authors should put more justifications on why a case study of Dutch may be interested to international audiences, or what international readers can learn from this work. Finally, contributions and innovations. The authors should make more attempts on highlighting what new insights this paper could offer to readers. The findings such as “the amount of rent arrears was a strong predictor for receiving an eviction order”, is well predicted and not surprised at all. The readers need to know something that they could not imagine themselves but need to be informed from researchers. Reviewer #2: The authors have a fine idea to explore some potential risk factors predicting whether or not tenants receive an eviction order. In particular, they use the logistic regression model to determine which factor (variable) significantly affects the probability of tenants receive an eviction order. The authors conclude that the amount of rent arrears, whether tenants are single, and phase in eviction process are strong predictors for eviction orders. While the topic is of interest, I do have some concerns that should be addressed and discussed in the paper. 1. While 495 tenants were included in the study at T0, only 71% (353) of tenants were tracked at T1, which may cause a selection bias issue. For example, as you mentioned in line 294-296 (Page 13), tenants who have had a court hearing may not want to continue to participate in an interview. Therefore, I suggest that you can use the Probit or Logit model to investigate which factors affect the response rates for follow-up interview at T1. In addition, you can also test whether significant differences exist between the respondents with and without information about eviction for the ten predictors. 2. You conducted a backward stepwise logistic regression analysis to discard the statistically insignificant variables, one by one. However, I am afraid that the results based on the model you used may be misleading. Smith (2018) uses a Monte Carlo simulation model to demonstrate that some predictors that have causal effects on the dependent variable may happen be statistically insignificant and therefore are discarded, while nuisance predictors may be coincidentally significant. Plus, the larger the number of potential predictors, the stepwise regression analysis is less effective. From the perspective of econometrics, variables should be included in a model based on theoretical grounds rather than the size of their t-values. If variables that truly belong in the model are omitted, the estimated coefficients of the existing explanatory variables would be biased. (Wooldridge 2006) Based on the reasons mentioned above, I suggest that you can choose variables from a priori knowledge, then use the logistic regression model to determine which variables are significant and which are not. 3. When you try to explain the results shown in Table 2, you mainly show that how the odds ratios (OR) of receiving an eviction order change when predictors (such as household composition) change. I think that you can also show the marginal effects of receiving an eviction order at the means for all available predictors, because a marginal effect of a predictor shows how do predicted probabilities change as the predictor changes 1-unit, which would be easier to understand for audience. 4. You can try to use other functional forms when you run the logistic regression. For example, I suggest that you can transform some variables such as the total household income in the last month and the total amount of respondents’ current rent arrears using the natural logarithm transformation. 5. You can try to do subsample regression to explore heterogeneity among different groups. For example, you can divide the whole sample into group of one-person household and group of multi-person household. Some more detailed comments while reading the paper: -Figure 1: You’d better use a vector image (such as SVG, eps, wmf,emf), because vector images can be enlarged to any size without appearing pixelated. -Page 10: The last sentence (line 226-228) on Page 10 is unclear to me. “The final model was used to calculate the risk of 227 receiving an eviction order as a result of combinations of two predictors, controlling for the 228 other predictors in the models.” Could you explicitly point out the names of the two predictors you mentioned? -Figure 2 and 3: Please show the confidence interval of variables in Figure 2 and 3. References: Smith, Gary. "Step away from stepwise." Journal of Big Data 5.1 (2018): 32. Wooldridge JW. Introductory econometrics: a modern approach. 3rd ed. Mason: Thompson; 2006. p. 94–7. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Dutch tenants at risk of eviction: Identifying predictors of eviction orders PONE-D-20-27239R1 Dear Dr. Edwards, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Shihe Fu, Ph.D. Academic Editor PLOS ONE P.S. I am very sorry for your loss of your coauthor Professor Manfred te Grotenhuis. Please accept my deepest condolences. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: My concerns have been addressed and I have no further comments. But I would like to receive information on how other reviewers judge the revision. Reviewer #2: The authors have addressed all the issues I raised. Therefore I accept this paper without further comments. Congratulations. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: ZHEJIN ZHAO |
| Formally Accepted |
|
PONE-D-20-27239R1 Dutch tenants at risk of eviction: Identifying predictors of eviction orders Dear Dr. Edwards: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Shihe Fu Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .