Peer Review History
| Original SubmissionJuly 5, 2023 |
|---|
|
PONE-D-23-19191Assessing the validity of the zero-velocity update method for sprinting speedsPLOS ONE Dear Dr. Hoogkamer, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ============================== ACADEMIC EDITOR:Both Reviewers recognized the effort made by the Authors in prodicing methodological update with respect to ZUPT approach. Moreove,r the quality of the manuscript is overall good. However, some major concerns have to be addressed in order to render the manuscript suitable for publication. ============================== Please submit your revised manuscript by Sep 21 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Andrea Tigrini, Ph.D. Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ 3. We note that Figure 1 in your submission contain copyrighted images. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright. We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission: 1. You may seek permission from the original copyright holder of Figure 1 to publish the content specifically under the CC BY 4.0 license. We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text: “I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.” Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission. In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].” 2. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only. Additional Editor Comments: Both Reviewers recognized the effort made by the Authors in prodicing methodological update with respect to ZUPT approach. Moreover the quality of the manuscript is overall good. However some major concerns have to be addressed in order to render the manuscript suitable for publication. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The paper analyzes the estimation of stride length and cumulative path using foot-mounted inertial sensors during sprinting and adopting a method based on the zero-velocity assumption. Congratulations to the authors, the study is really interesting. In general, the paper has a high-quality English language and the results are clearly presented, but further analyses should be added and discussed. Introduction 1. This study is focused on the estimation of the stride length/cumulative distance, thus I would suggest to stress in the very first part of the introduction the importance of the estimation of stride length and the foot displacement during running. 2. In line 42 where the zero-velocity assumption is introduced I suggest to cite the following paper: I. Skog, P. Handel, J. -O. Nilsson and J. Rantakokko, "Zero-Velocity Detection—An Algorithm Evaluation," in IEEE Transactions on Biomedical Engineering, vol. 57, no. 11, pp. 2657-2666, Nov. 2010, doi: 10.1109/TBME.2010.2060723. 3. The authors correctly assessed that the displacement estimation with a zero-velocity update (ZUPT) has been highly validated during walking. Examples of accurate ZUPT detectors should be mentioned: - I. Skog, P. Handel, J. -O. Nilsson and J. Rantakokko, "Zero-Velocity Detection—An Algorithm Evaluation," in IEEE Transactions on Biomedical Engineering, vol. 57, no. 11, pp. 2657-2666, Nov. 2010, doi: 10.1109/TBME.2010.2060723. - R. Rossanigo, M. Caruso, F. Salis, S. Bertuletti, U. Della Croce and A. Cereatti, "An Optimal Procedure for Stride Length Estimation Using Foot-Mounted Magneto-Inertial Measurement Units," 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Lausanne, Switzerland, 2021, pp. 1-6, doi: 10.1109/MeMeA52024.2021.9478604. - A. Peruzzi, U. Della Croce and A. Cereatti, "Estimation of stride length in level walking using inertial measurement unit attached to the foot: A validation of the zero velocity assumption", Journal of Biomechanics, vol. 44, pp. 1991-1994, 2011. 4. Please split into two parts the issues of the estimation of foot displacement during sprinting: a) issues related to the hardware (full scale, sample frequency, and various IMU specifications), b) issues related to the inertial data processing (drift, unclear zero-velocity periods). Please briefly provide the findings of the cited relevant literature in terms of accuracy and validity of ZUPT method(s) always assessing the declared errors. 5. The sampling frequency used in this study seems to be only 1600 Hz in the introduction, please revise this point. Methods- IMU analysis 1. The authors estimated stride lengths following Potter et al, 2019. Please briefly mention how this method works, in particular the zero-velocity instant selection. How was the stance phase detected? The stationary points are the minima of the angular velocity: did you use the angular velocity magnitude? Did the definition of stride length use all the three foot displacement components? 2. The study by Potter et al, 2019 is cited as [10] but I think it is [12]. Please revise the citations. Results 1. Please add how many strides per runner you analyzed. 2. The validation was conducted with respect to the stride length/cumulative distance provided by the cameras. Please provide the mean and standard deviation of these reference values. 3. To provide complete results, please add the errors in m and not only percentage errors. 4. The obtained errors were analyzed with respect to the running speed. You calculated the running speed exploiting the calculated distance from IMUs and the duration. I suggest to use the running speed provided by your reference, or at least to clarify the errors in terms of stride speed with respect to the reference values calculated from the cameras. 5. The errors on stride length are only evaluated for the last stride. Why? Please provide the stride-by-stride errors. 6. Figure 2: please use the same range of y-axis. 7. Figure 3: please add ‘∼’ before the reference cumulative distance. Please use the same legend as Figure 2 to distinguish the subjects. 8. Figure 4: this figure shows the average running speed calculated at each ∼5m-distance traveled. a. Please provide a similar figure but showing a point for each stride speed. b. To understand the accuracy in the estimation of running speed, add in the same plot the stride speed calculated with the cameras. c. Is a similar speed pattern during the 70m-sprint shown for each subject? Does the literature confirm that the maximal speed is recorded between 20m and 70m and not at the last stride? 9. Simple linear regression results: please consider to provide a plot showing the stride length errors vs stride speeds. Discussion 1. Please clarify that you used a zero-velocity detector only based on angular velocities and other detectors can be used to try to improve the results. I suggest again the following detectors to cite, which can be considered also for the comparison of the errors with respect to level walking: a. I. Skog, P. Handel, J. -O. Nilsson and J. Rantakokko, "Zero-Velocity Detection—An Algorithm Evaluation," in IEEE Transactions on Biomedical Engineering, vol. 57, no. 11, pp. 2657-2666, Nov. 2010, doi: 10.1109/TBME.2010.2060723. b. R. Rossanigo, M. Caruso, F. Salis, S. Bertuletti, U. D. Croce and A. Cereatti, "An Optimal Procedure for Stride Length Estimation Using Foot-Mounted Magneto-Inertial Measurement Units," 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Lausanne, Switzerland, 2021, pp. 1-6, doi: 10.1109/MeMeA52024.2021.9478604. 2. Please improve the comparison of your errors with respect to the cited relevant literature in terms of stride length and cumulative distance. 3. Please add a conclusive recommendation on the suggested IMU specifications to use. To reach good results, the choice of full scale must be a trade-off between the resolution and the saturation issue. 4. Line 265: the sentence ‘this method … does not require any information about IMU orientation in space’ is misleading. The sensor axes do not have to be aligned with the anatomical ones, but you need to estimate the foot orientation to remove the gravity contribution. 5. Please stress the limitations of this study. For example, the sample frequency of the reference cameras is 240 Hz, thus very lower than the IMU sample frequency: which is the minimal detectable difference in m? Reviewer #2: This paper describes a study within a longstanding effort to use only shoe-mounted inertial measurement units to track stride characteristics. The study specifically extends the application to high-speed sprinting (6-9+ m/s) and uses higher-performance IMUs in comparison to prior research. The authors do an analysis by the conventional ZUPT method and show that its results appear better than the latest alternative effort that used less high-performance sensors. This study appears to be well-executed and I have confidence that the algorithm was implemented correctly and the processing done properly. The study is contextualized well within the field and the Methods are reasonably well-described. The results appear reasonable and consistent with the authors' expectations and the predictions of the field, but establishing a proof-in-practice that this system can work for sprinting applications. Overall it is a good study. I do have a variety of specific comments below that I request the authors to address, to add clarity, improve comprehensiveness, or make adjustments to the interpretation. ---------------------------- Notes on the data set: 1) It contains raw data from all the IMUs, as well as data of tracked stride characteristics from the cameras and stride counts. But it does not include the stride results processed from IMU data, which would be necessary to remake the plots and statistics as reported. I suggest the authors consider another table, similar to the "Kinovea" file, with those results from the IMUs so that readers can further interrogate the results without having to remake the entire process and hope they matched the algorithm perfectly. 2) A brief overview document would be helpful, describing what is in each file and how they relate. ---------------------------------------------------------------------------- Specific Comments (Line numbers referring to the PDF supplied for review): lines 54-57: I suggest also adding a mention of sampling rate limitations in this introductory paragraph. lines 79-84: the last part of this sentence doesn't quite make clear what the authors of [14] did. Can you rework the part starting with "then"? Table 1: It would be good to include sex, age and if available, estimated maximum speed, for each runner. Lines 138-140: Using high-g only when the low-g accelerometer saturated: good idea, I was hoping to see this taken into consideration. But, the two accelerometers have different sampling rates, and the high-g accelerometer's rate is not matched to the gyroscope. It would be helpful to the reader if there were a description of how this asynchrony was handled. Lines 143-145: Detection of stationary periods is a critical, and difficult-to-define, step. Please expand on the details of the customized algorithm for that, or provide a reference (is it the other Potter paper?) line 151: I was briefly confused by the parenthetical statement here "(i.e., ∼20, ∼50 and !70 meters)", because I thought it meant 20, 50 and 70 were used as the reference values. A re-reading clarified that the real data were used, but the authors may with to adjust phrasing to avoid confusion. Lines 159-160: Using the IMU-derived stride duration, defined from the stationary periods, can introduce uncertainty if the stationary period is not defined by a "sharp" event. For example, if there is an extended stationary period, then the time when one stride changes to another is not precise. The authors should define the time more precisely than the current text does, perhaps in conjunction with the expansion requested above regarding the detection of the stationary period. Line 165ff: Please clarify what exactly the raters were looking for. For example: location of the toe during an extended period of ground contact; or, position of the IMU at its lowest point; or... whatever else formally defined the raters; instructions. line 178: Alpha level was set to 0.05: What statistics did this apply to? Slope of the regression? Bias term? Limits of the Bland-Altman analysis (e.g. 95% = 1-alpha)? Please include that info for the reader. Lines 182, 195, 186, 187, 190: are the (value +/- number) terms (mean +/- SD)? Please state. Lines 192-5: I know the results are in Table 3, but it would also help the reader here if you would summarize in words the nature of the effects of speed and body mass. As I read the table, I think it means something like "speed had a negative effect and mass had a positive effect on most forms of error." (but the authors get to straighten that out). See also the comment on Table 3. Table 3: The Table is highly informative and valuable. But it needs a little more information to help with interpretation, e.g. in the caption or the column headings. Specifically, the units associated with Beta need to be stated: are they [percentage per m/s] and [percentage per kg]? Something else? Above all, I suggest the authors make sure that if a reader looks at any given number in that table, a specific interpretation is unmistakably clear. Lines 226-8: the final sentence is an overstatement; it's true that the results in this study appear better (lower error) than the results of the de Ruiter study, but with different people and no head-to-head comparison, I'd say this result "suggests" but does not "demonstrate" the superiority of this paper's method/sensor. Lines 239-240 ff: this section provides indirect evidence, not exactly a "find"-ing (see line 239). As above, it is observational rather than a direct comparison of saturated vs. unsaturated signals. It is all valid commentary, but presentation of the claim should be softened. Line 250: I'm curious as to why you could not quantify what percentage of data were lost due to saturation. Shouldn't any signal value exactly equal to the maximum reading indicate saturation? If this refers to the later comments in lines 254-8, I suggest moving that commentary up. Lines 259-262ff: This section argues for practical relevance. I agree that the results look good overall, especially in the context of this field. But in sports where there's about 1.5% difference across an entire championship heat (e.g. times 9.89-10.15 s in NCAA D-1 men's 100 m final), it's unclear what can be learned from a tool with the demonstrated precision. Some additional context and commentary on strengths, uses and limitations would be valuable here. Training perhaps? Perhaps the authors might (optionally) comment on test-retest reliability to support such a thing. Other uses? Figure 2: The data presented here are very helpful for interpretation. But, the arrangement of the horizontal axis ticks is rather disorienting, since they are sort of between the different subfigures. I suggest moving them onto the zero line within each figure, or perhaps adding a full grid or a vertical-only grid and box outline for each subfigure. As I look at the data here, the importance of the sensitivity analyses becomes clearer. The authors may wish to expand on the details of the sensitivity to speed. In particular: the conclusion currently presented is that these trends are only a minor effect, and while I don't disagree, the trend as shown does suggest that if used at higher speeds in future testing, the error may become increasingly negative. It's probably worth pointing that out, e.g. in the section where the authors already recommend even higher ranges in future sensors. Figure 3: I suggest adding to the caption (or elsewhere in the Methods) the specific definition of the limits of agreement (95%?). ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Assessing the validity of the zero-velocity update method for sprinting speeds PONE-D-23-19191R1 Dear Dr. Hoogkamer, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Andrea Tigrini, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): The paper was consistently updated and deserves to be pubished. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: Thank you for addressing the comments. I have only one new comment, which relates to the Limits of Agreement analysis in Figure 2. A typical LOA plots the Difference between two measurement methods on the vertical axis, vs. the Mean of those two methods on the horizontal axis. In the figure as presented, it is Difference vs. Reference. I can see reasons for this decision and for my part will leave it to the authors' discretion if that is the form they want to present; but I just wanted to point out that it is nonstandard. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-23-19191R1 PLOS ONE Dear Dr. Hoogkamer, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Andrea Tigrini Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .