Peer Review History
| Original SubmissionOctober 13, 2021 |
|---|
|
PONE-D-21-32688A QUBO Formulation for EigencentralityPLOS ONE Dear Dr. Akrobotu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by May 26 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Gábor Vattay, PhD, DSc Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section. 3. Thank you for stating the following in the Acknowledgments Section of your manuscript: “Research presented in this article was supported by the Laboratory Directed Research and Development (LDRD) program of Los Alamos National Laboratory (LANL) under project number 20200056DR. LANL is operated by Triad National Security, LLC, for the National Nuclear Security Administration (NNSA) of the U. S. Department of Energy (contract no. 89233218CNA000001). TJ acknowledges support from the U.S. Department of Energy (DOE) through a quantum computing program sponsored by the Los Alamos National Laboratory (LANL) Information Science & Technology Institute. This research was also supported by the U. S. Department of Energy (DOE) National Nuclear Security Administration (NNSA) Advanced Simulation and Computing (ASC) program at LANL. We acknowledge the ASC program at LANL for use of their Ising D-Wave 2000Q quantum computing resource. Quantum resources from the IBM-Q Hub are also acknowledged. Assigned: Los Alamos Unclassified Report LA-UR-21-24030. We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: “This research was supported by the U.S. Department of Energy (DOE) National Nuclear Security Administration (NNSA) Advanced Simulation and Computing (ASC) program at Los Alamos National Laboratory (LANL). This research has been funded by the LANL Laboratory Directed Research and Development (LDRD) and ASC program. SMM, CFAN, and PDA were funded by LANL LDRD. TEJ was funded by the U.S. Department of Energy (DOE) through a quantum computing program sponsored by the Los Alamos National Laboratory (LANL) Information Science & Technology Institute. Assigned: Los Alamos Unclassified Report LA-UR-21-24030. LANL is operated by Triad National Security, LLC, for the National Nuclear Security Administration of U.S. Department of Energy (Contract No. 89233218NCA000001). http://www.lanl.gov The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.” Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: N/A Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The paper presents an approach for identifying a given number of nodes with the highest eigencentrality scores using quantum hardware. The paper presents a QUBO formulation of the problem that can be solved on quantum hardware such as quantum annealers and gate-based quantum computers. Experimental analysis shows the proposed approach manages to find the most central node and the top 5 most central nodes according to eigencentrality scores, as well as correctly rank all nodes for graphs up to 16 nodes. The paper is interesting and deals with the important problem of identifying the most central nodes in a network. I think the core contribution presented in the work (a QUBO formulation for identifying a given number of nodes with the highest eigencentrality scores) is important and the experiments indicate that the approach performs well (on small graphs) when compared to the baseline classical approach. However, I think the current manuscript has some major issues that need to be addressed. 1. Claims are not clear enough - What exactly is the problem being solved? The text, in some places, seems to focus on the problem of computing eigencentrality scores or at least is not clear enough on what the problem being solved. For example, "we lay the foundation for the calculation of eigenvector centrality using quantum ...." or "Eigenvector centrality as a QUBO problem" is different than a formulation that identify the top N most central users. While it can be run repeatedly to generate ranking, this is a much more complex procedure, and still does not actually compute the scores but the ranking. This seems to also impact the presentation of the approach: instead of a clear problem definition, the paper presents the original problem of eigencentrality calculation and transforms it into a different problem that can be formulated using QUBO. I think the paper would benefit from a clear problem definition (i.e., identifying a given number of most central users) and then a QUBO formulation that solves this problem. - As there is no clear problem definition, the paper also does not provide a clear statement on the connection between the proposed solution and the problem being solved. For example, it is not clear if the optimal solution for the QUBO formulation (assuming it is found) is guaranteed to be the optimal solution for the problem (i.e., the given number of most central nodes) or is a heuristic approach that seems to work well in practice (see related points on Proposition 1 and Claim 1 below). 2. No sufficient theoretical support for proposed approach and claims: - No proof for proposition 1, and there isn't a more general proof for the case of \\tau > 1 (which seems to be formulated in Claim 1). The paper mentions the authors were able to "verify for proposition 1 (with \\tau >= 1) for ..." however these are empirical results and not a proof. - There are no theoretical results on sufficient/optimal selection of P values (the Lagrange multiplier). This is also related to the previous point as I was surprised that proposition 1 does not include any conditions on the P values (e.g., is it still correct when P_0 or P_1 are equal to zero?). Also, there is no principled explanation/justification for the values used in the experiments. 3. The empirical support could be strengthened and some important details on the experiments should be clarified: - As mentioned earlier, many results are only verified experimentally and not theoretically. Since all the graphs used are very small and in a limited range of values, it is not clear how the results will change as graphs become larger (e.g., should the P_0 and P_1 values used remain the same?). While the limited size is justified by the hardware limitations, larger graphs could potentially be tested on simulators. - The paper mentions that in some graphs there was a need for multiple runs to capture global minimum. How many runs were used and how was it determined if the global minimum was captured or additional runs are needed? - Why is there no result (or "-") in the "top 5 most central nodes" for QA in the BA(50,5) graph? - The paper should list and cite the concrete algorithms being used and not just the libraries, e.g., which algorithm (that is implemented in NetworkX) is used for computing EC? which classical optimization algorithm (that is implemented in SciPy) was used? - It was not clear to me what claim is supported by the analysis of the performance of SciPy in Table 2 (related to point (1) above) Minor points: - Text refers to section numbers (e.g., "Section 2") but the sections do not have numbers - Figures are listed in the paper but appear at the end - First sentence in Conclusion is not clear: "We have formulated and shown a QUBO problem for .... is possible". Reviewer #2: This is an interesting work. Honestly, I am not familiar to the topic of centrality and its application in graph. In this sense, the manuscript gives a brief and sound overview. The structure of the paper looks reasonable. My only comment is that there is a lack of the discussion regarding the noise during the simulations. A suggested revision can be focused on (1) presenting/comparing the data/results from both noise-free and noise-model simulator, as well as how both of them are compared to the data from real devices, and (2) if the noise is overwhelming and altering the some observations, then is there any error-mitigation can be applied to improve the results. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
A QUBO formulation for top-τ eigencentrality nodes PONE-D-21-32688R1 Dear Dr. Akrobotu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Gábor Vattay, PhD, DSc Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: N/A Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Minor comment: - It is not entirely clear to me from the authors' answers if the results reported (e.g., in Table 1) are after running greedy steepest descent. If that is the case, it should be clearly stated before the results are presented. Reviewer #2: All my comments have been addressed by authors' revision. I thus have no further comments, and recommend its publication in PLOS ONE ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-21-32688R1 A QUBO formulation for top-τ eigencentrality nodes Dear Dr. Akrobotu: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Gábor Vattay Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .