Peer Review History
| Original SubmissionAugust 11, 2023 |
|---|
|
PONE-D-23-25721Development of an Automated Human Scent Olfactometer and its Use to Evaluate Detection Dog Perception of Human ScentPLOS ONE Dear Dr. Aviles-Rosa, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Nov 27 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Tommaso Lomonaco, Ph.D Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section. 3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. Additional Editor Comments: Dear Authors, please ready carefully the points raised by the reviewers. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: No ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is an excellent paper which describes the use of Automated Human Scent Olfactometer for evaluating detection dog perception of human scent. It is highly evaluated that authors addressed the unveiled research question; what the main constituent of the human scent that detection dogs are utilizing to locate a person. I believe the developed system shown in this paper will pave the ways to solve the research question. So, I recommend this paper should be published after minor considerations. Major points 1) As for the AHSO system, I have a simple question on the influence of the humidity trap which removes excess water on chemical components and/or human scent, because there are water soluble gases in breath and from skin surface. For example, the dermal emission of ammonia is known to cause unpleasant body odor. So, please discuss on this point. 2) Line 1278-1284: Authors described the volatiles of breath origin are the main constituent of human scent. I can agree to this statement based on the results in these experiments. However, the breath gases and skin volatiles were well mixed and served for dogs after removing excess water in this system. In actual environment, dogs near the ground may not be exposed to a combination of both volatiles of breath and skin origin, because the diffusion of these gases can be different. So, authors should add the limitation on this point. Minor points 1) Abstract: please describe the “HS” in full spelling. 2) L60-61: As described above, volatile inorganic compounds such as ammonia and hydrogen sulfide are also contribute to human scent. Reviewer #2: 1. The manuscript “Development of an Automated Human Scent Olfactometer and its Use to Evaluate Detection Dog Perception of Human Scent”, authored by Dr. Aviles-Rosa et al., describe the authors efforts to try to determine “what constitutes human scent from a detection dog perspective”. In short, it is an experimental attempt to train dogs to forget about their natural tendency to use discrimination in favor of generalization when tracking something, humans in this case (Moser AY et al., doi: 10.3390/ani9090702). The research problem, however, conveys an extremely difficult question to answer for us humans, because dogs have the uncanny ability to discriminate one human from another even if they are genetically identical, eat the same food, and have lived all their lives under the same environment, as has been solidly demonstrated with monozygotic twins (Pinc L et al., doi: 10.1371/journal.pone.0020704). It means that, for the authors to be able to find the scent information used by dogs to identify any and all human beings as a single species (as they do to find surviving earthquake victims, for instance), the scientists would have to use many human subjects to try to represent, at the very least, a minimal approximation to the smell that dogs track when looking for any and all humans instead of a single individual within Homo sapiens. This shortcut is serious because the study is severely underpowered. Dogs do generalize very easily a particular scent like that of a person infected by SARS-CoV-2, and are able to identify any human infected by it from within many healthy individuals in a fraction of a second and under a wide variety of circumstances. That is easy for them, because in nature canids survive by discriminating the scent of their specific pray even if it is part of large herd, and it makes them extraordinarily efficient at discriminating. In this study, the authors tried to train dogs to do the opposite, i.e., to identify any individual from the human herd of 8 billion individuals. Although dogs and many other animals identify any human scent as generically “human” since very early in life, they always discriminate between them, and using only a handful of human volunteers to train them might fail to let the dogs know what the researcher want from them. Beyond power, the authors did not use the appropriate methodology to train the dogs to tell the trainer when they were generalizing for the human scent and when they were discriminating one human from another (see below). And finally, the 4 experiments were not sufficient to answer the research question, and generated conflicting results that the authors were unable to explain in their quite extensive Discussion. These methodological flaws prevent the publication of this piece of work in PLOS ONE. 2. Experiment 1 was designed to determine if 2 dogs “can successfully be trained to identify the headspace from the chamber that held the human volunteer (n = 10) and discriminate it from the headspace of both distractor chambers and various distractor odors including personal hygiene products”. The researchers achieved the first goal (i.e., both dogs were trained to identify which one of three chambers was holding the human volunteer) but failed to train both dogs to discriminate between three empty chambers after erasing the odor of the human volunteer (see “Control group” in Fig. 1). Contrary to the author’s interpretation (line 845-847: “This indicates […] that dogs were responding to the presence of these human specific volatiles”), the result of Experiment 1 tells me that the dogs recurred to false-positive indications when all three chambers where empty, a virtually constant problem when dogs are trained to detect the odor instead of its source. 3. Experiment 2 involved 5 experienced search and rescue (SAR-certified) dogs “to test if [they] were able to identify the headspace of the chamber containing the human volunteer in the olfactometer”. Only 5 of 8 SAR-certified dogs were trained successfully to do the scent work with the apparatus. All 5 performed almost flawlessly and detected the presence of human odor (apparatus) or of an actual human being (barrels) correctly 85% and 92% of the time, respectively. The 7% difference was not significant, demonstrating that SAR dogs are equally adept at finding the source of human scent directly (barrel) or indirectly (apparatus), and that the apparatus designed by the researchers was efficient for the specific task of carrying the scent of the human subject occupying the chamber. If the procedure to eliminate human odor from the apparatus was efficient, the results of Experiment 2 also suggest that failure in Control Tests during Experiment 1 depended on the dogs’ training. 4. Experiment 3 was made with 6 new dogs that had failed certification as explosive detectors (the authors re-trained these dogs with the apparatus). The goal was to “understand what was the main constituent of human scent dogs were utilizing to make a response”, which was also the main objective of the study. Experiment 3 involves too many scenting scenarios, but all of them fulfill one of three scent sources: the whole target or its odor (one of 4 human volunteers), a part of the target or its odor (breath, or an article scented with a human’s axilla, foot, torso, hair, or their combination), or no target at all (blanks). As an additional confusing variable (for the canines), the authors did not inform the dogs when their alerts were correct in a significant fraction of the trial. Figure 7 shows that the probability of alert went from higher to lower (>) in this direction: first, the target (one human in the chamber) > second, the positive control (a different human in the chamber) > third, the breath of the targeted human > any other odor taken from the human source. The difference between the target and the positive control shows that the dogs were discriminating one human from another instead of generalizing for all humans, and the difference between human breath and the other sources of human odor suggest that no odor was present for the dogs. Among several explanations for such results, two seem to be the most probable: one, contrary to human’s breath, the apparatus did not carry to the dogs the odor taken from humans’ skin, and two, the training was inadequate to teach the dogs to alert when scenting the odor of any human, independently of the volatile organic compounds presented to them. These results do not support the author’s conclusion that breath is the “key component” used by dogs to scent-find a human being, and it led to Experiment 4. 5. Experiment 4 included the same 6 dogs from Experiment 3 but only 2 human volunteers, and the authors did not reward the dogs at all (one dog refuse to work under this unrewarding conditions). The main objective was to compare the correct alert rate to a human inside the chamber with the same subject inside the chamber respiring into a scuba equipment, thus eliminating breath from the scent information. The 5 remaining dogs alerted correctly only 50% of the time when breath was not part of the scent information, and the authors thought that it confirmed the hypothesis that breath was the key component of human scent used by dogs to identify us. My interpretation of the data is that breath provided the dogs with part of the scent information they were sniffing for, and eliminating it decreased their performance proportionately. Also, it has been demonstrated that eliminating reward affects negatively the dogs’ performance, as was evident in Experiments 3 and 4 as the scent tasks became more demanding: Cimarelli G et al., doi: 10.1007/s10071-020-01425-9; and Peiris PL et al., doi: 10.1002/jeab.790. Next, I will enumerate minor observations to the manuscript, followed by my comment in red font: 6. Line 61: Different attempts have been made to characterize human scent utilizing different analytical techniques and sensors (30–39) but none of these attempts included the use of detection dogs. This sentence does not consider relevant research in the area (reviewed by Angle et al., doi: 10. 3389/fvets.2016.00047). 7. Line 99: The PTFE tubing from each olfactometer was connected to an odor port. IR beam sensors were located at the front of each port. Please define any abbreviation the first time you use it in the manuscript (Poly Tetra Fluoro Ethylene, or Teflon® tubing). The same rule applies to all other abbreviations, like HS, IR, PVC, RH, RO, etc. For instance, human scent (HS) is used first in the abstract, and many-times thereafter before being described in line 169. 8. Line 98: Figure 1. A. The schematic of the Automated Human Scent Olfactometer (AHSO). B. A picture of the dog interface. Line 98 contains the texto of Figure 1, but Figure 1 has not been cited yet. Therefore, it appears again in line 149. 9. Line 103: acrylic chamber.shows a schematic of the AHSO. This sentence in line 103 makes no sense and is not separated from the text of Figure 1. 10. Line 174: The beginning of a trial was marked with a trial initiation tone. Lines 177 & 178: If dogs alerted to the correct port, the computer program marked the response with a “bleep” sound and the experimenter reinforced the alert with a treat. I suppose these tones and sounds were audible to the dog, but it is better if the authors make it clear. 11. The authors opted to log-transform the data to apply parametric statistics instead of analyzing actual data with non-parametric statistics. Log-transforming the data helps them to find statistical differences, but the number of dogs is so small that it makes such parametric analysis hardly reliable. They should use non-parametric tools for the statistical analysis of untransformed data. 12. Most experts believe that hundreds of human volunteers are required to validate this kind of data, with the argument that dogs quickly learn by memory the odor of each of the human participants. The dogs knew when the authors changed the human subject, and it took them just a couple of exposures the discriminate between the very small number of human volunteers. There is no way for the authors to know if incorrect alerts did obey to the dogs discriminating between the different volunteers. 13. The paper is written in a very confusing order. The first 3 figures and table appear suddenly without any citation to them whatsoever. 14. The paper is extremely long. The Methods could be shortened significantly if, instead of describing each experiment by separate, the author put together the aspects common to all four experiments and then, in a single paragraph, point to their individual characteristics. The Discussion must be shortened to just 4-5 paragraphs. It is not necessary to try to explain every conflicting result with speculation, but to focus on the actual methodological problems and their solutions for future research. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Yoshika Sekine Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Development of an Automated Human Scent Olfactometer and its Use to Evaluate Detection Dog Perception of Human Scent PONE-D-23-25721R1 Dear Dr. Aviles-Ros, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Tommaso Lomonaco, Ph.D Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for revising the manuscript following my comments. I did not find any concerns about dual publication, research ethics or so. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No ********** |
| Formally Accepted |
|
PONE-D-23-25721R1 PLOS ONE Dear Dr. Aviles-Rosa, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Tommaso Lomonaco Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .