Peer Review History
| Original SubmissionSeptember 24, 2024 |
|---|
|
PONE-D-24-42689Deep learning with satellite images enables high-resolution income estimation: a case study of Buenos AiresPLOS ONE Dear Dr. Abbate, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ============================== Please ensure to address specific comments on the model sensitivity to various parameters including vegetation, satellite data inherent issues such as cloud cover, temporal data influence, architechture comparisons, model calibration and validation issues. ============================== Please submit your revised manuscript by Jan 09 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Krishna Prasad Vadrevu, Ph.D Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, we expect all author-generated code to be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse. 3. We noted in your submission details that a portion of your manuscript may have been presented or published elsewhere. “As mentioned in the cover letter, an earlier version of this manuscript has been published in L CLEI 2024 conferences. Some figures of the methodology are fairly similar, as some of the decisions from such section remain the same. Nevertheless, all the results have been updated as there where many changes in the methodology, and the results are much more presice due to these updates. Furhtermore, many subsections of results have been added as the models have been tested much further than the earlier discussion manuscript.” Please clarify whether this [conference proceeding or publication] was peer-reviewed and formally published. If this work was previously peer-reviewed and published, in the cover letter please provide the reason that this work does not constitute dual publication and should be included in the current manuscript. 4. We note that you have indicated that there are restrictions to data sharing for this study. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Before we proceed with your manuscript, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., a Research Ethics Committee or Institutional Review Board, etc.). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. You also have the option of uploading the data as Supporting Information files, but we would recommend depositing data directly to a data repository if possible. We will update your Data Availability statement on your behalf to reflect the information you provide. 5. We note that Figures 1, 2, 3, 4, 5, 6, 7, 8, 9 11, 13 and 14 in your submission contain map/satellite images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission: 1. You may seek permission from the original copyright holder of Figures 1, 2, 3, 4, 5, 6, 7, 8, 9 11, 13 and 14 to publish the content specifically under the CC BY 4.0 license. We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text: “I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.” Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission. In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].” 2. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only. The following resources for replacing copyrighted map figures may be helpful: USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/ The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/ Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/ Landsat: http://landsat.visibleearth.nasa.gov/ USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/# Natural Earth (public domain): http://www.naturalearthdata.com/ [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The article proposes a novel and effective application area for satellite imagery, offering significant and impactful outcomes in this context. The EfficientNetV2 architecture was selected due to its ability to deliver high performance despite a relatively low number of parameters, making it an efficient choice. However, the lack of a detailed comparison with alternative architectures can be considered a point open to critique. Although this high resolution allows for the creation of more detailed income maps, it should be noted that the generalization capacity of the study may be limited due to its reliance on non-public data available only for specific years. The training, validation, and test sets were separated by considering the different characteristics of urban areas. However, low-density population regions were excluded from the analysis, which may make it challenging to generalize the results to the entire population base. In this context, although the article presents a highly innovative method, further work is needed on generalization, model explainability, and ethical dimensions. There is no reference from the year 2024 among the sources cited in the article. The references cover works published between 2010 and 2023. This could be considered a point to evaluate in terms of potential gaps or limitations in the coverage of the most current literature. In terms of potential enhancements, I suggest considering alternative measures for assessing income inequality and poverty indicators. For example, Theil Index and Atkinson Index could provide additional perspectives on income inequality, capturing variations and sensitivities that may complement the Gini coefficient analysis. Furthermore, alternative poverty measures, such as Absolute and Relative Poverty Rates, Headcount Index, and Poverty Gap Index, may offer a more comprehensive view of poverty depth and distribution characteristics. Incorporating these could broaden the analytical scope and contribute to a richer interpretation of the data. While these measures are explained in your analysis, I would recommend providing further elaboration to enhance their clarity and impact. A more detailed breakdown of how each indicator—such as the 90/10 and 50/10 Ratios for capturing disparities across income segments, the Gini Coefficient for summarizing overall inequality, and the FGT indices (FGT(0), FGT(1), and FGT(2)) for measuring poverty dimensions—uniquely contributes to understanding inequality and poverty would enrich readers' grasp of the study’s analytical depth and context. There are no issues with the language usage or visuals in the article. Reviewer #2: Deep learning with satellite images enables high-resolution income estimation: a case study of Buenos Aires While the study effectively demonstrates the use of deep learning and satellite imagery for income estimation and provides valuable insights, I have some concerns that, if addressed, could strengthen the work further. Major comments The training relies on the census and survey data from 2010, which may not fully capture current or latest economic conditions. Since the model performance depends on similarities between training and prediction areas; fine-tuning is required for new regions. The claim that the model can predict income for different years without updated data feels like a stretch. While it might catch long-term trends, incorporating short-term factors like inflation or employment changes would likely improve accuracy over time. More justification including explanations are required on this specific aspect. Other Uncertainties: The model seems to lean heavily on visual features for predicting income, but this could overlook key socio-economic factors like migration. This might lead to biased results, especially in similar-looking/or developing neighborhoods. In addition, the model's sensitivity to times of day, vegetation, shadows, or the satellite’s angle suggests that external conditions can also affect model predictions. Thus, the errors associated with the image data and subsequent image processing too can affect the results. In particular, if using any temporal data, the errors can add up. Temporal constraints: The methodology has limited ability to detect short-term economic fluctuations; the model primarily captures structural and spatial variations. It is not clear how short-term fluctuations can be captured. Images: The authors used an approach that combines multiple image sizes (e.g., 50x50m and 200x200m) which improves context but could introduce noise. More explanation may be provided as to how the noise was reduced. Broad results: Results are sensitive to urban patterns in Buenos Aires and might not generalize well to different cities. In essence, the model developed can be highly local. Since the model is trained on data from Buenos Aires, there’s a risk of overfitting. Authors mention that the model can be applied to other cities, but might be overlooking some critical differences between cities—like cultural, economic, or geographical factors. Including more localized training data for each region could boost the accuracy. I suggest the authors elaborate on the discussion part on how the model can be fine-tuned to apply to other regions. Minor comments Abstract may be clarified to include specific time periods or intervals of the study. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-24-42689R1Deep learning with satellite images enables high-resolution income estimation: a case study of Buenos AiresPLOS ONE Dear Dr. Abbate, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Nov 23 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Beata Calka, PH.D. Academic Editor PLOS ONE Journal Requirements: 1. If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. 2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: Deep learning with satellite images enables high-resolution income estimation: a case study of Buenos Aires : round 2 review comments The authors have made significant changes from the original submission. They have done a great job answering all the initial questions I raised, and I am satisfied with the level of detail provided. The introduction of the concept of permanent income and expanding on image noise reduction adds further clarity to the study. The addition of newer sections, especially Sections 7 and 8, strengthens the manuscript and makes it more robust and well-rounded. The authors outline a general framework with the potential to generate per capita income estimates applicable to different regions, and they clearly describe the limitations and steps needed to adapt the model across varying contexts. The inclusion of replication scripts and access to model weights is appreciated. Within the scope of this study, focused on Buenos Aires, I am satisfied with the results. I believe the manuscript is now ready to be accepted for publication pending a few minor revisions that I outline below. Minor Suggestions 1. In Table 3 the title "Hyperparameter Configurations" seems misleading, as the table shows high-level model settings (e.g., image size, bands, years) rather than true hyperparameters like learning rate, batch size, input, activation function or number of layers etc.. I suggest renaming it to "Model Configurations and Mean Squared Error…" or something similar. Figures: 1. For “Figure 1”: In “6. Results” for the ‘example income deciles map built with images from 2013’, including a scale bar, north arrow and coordinates would be ideal for understanding the spatial context since this is the first introduction of the study area. If feasible, including an earlier figure that outlines the study area with map of Argentina featuring Buenos Aires would improve readability and spatial context particularly with readers that are not familiar with the region 2. For “Figure 2” – including a north arrow and the suffix for latitude and longitude would make the map more visually appealing 3. I suggest using a consistent symbol for meters throughout the manuscript. As is stands, ‘m’ is used in the manuscript. However ‘mts’ is used in Figure 3 and parts of manuscript interchangeably. 4. “Figure 5” should include a scalebar, north arrow, and coordinates suffixes. In essence, each image must be self explantory on its owns 5. “Figure 7” “a” seems cut off at the bottom or is a text label that is missing? Inclusion of scalebar, coordinates, and suffixes would be help to compare images side by side. 6. “Figure 10” I suggest including R2 value in figure caption or image subplots ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Deep learning with satellite images enables high-resolution income estimation: a case study of Buenos Aires PONE-D-24-42689R2 Dear Dr. Abbate, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Beata Calka, PH.D. Academic Editor PLOS ONE |
| Formally Accepted |
|
PONE-D-24-42689R2 PLOS One Dear Dr. Abbate, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS One. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Beata Calka Academic Editor PLOS One |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .