Peer Review History
| Original SubmissionSeptember 23, 2019 |
|---|
|
PONE-D-19-26758 Affect and exertion during aerobic exercise: Examining changes using automated facial expression analysis and continuous experiential self-report. PLOS ONE Dear Mrs. Timme, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. We would appreciate receiving your revised manuscript by Jan 06 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Dominic Micklewright, PhD CPsychol PFHEA FBASES FACSM Academic Editor PLOS ONE Journal requirements: 1. When submitting your revision, we need you to address these additional requirements. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. * In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for inviting me to review ‘Affect and exertion during aerobic exercise: Examining changes using automated facial expression analysis and continuous experiential self-report.’ The primary aim of this study was to examine continuous changes in single facial actions of the whole face at various exercise intensities. The authors concluded that affective valence and perceived exertion can be captured using automated facial action analysis. This study uses novel methods and technology to assess changes in facial actions during exercise. I commend the authors on doing this innovative project and obtaining substantial participant numbers. Overall, I found the paper quite hard to read due to superlative words and lack of information provided about the methods. At present, the work is not accessible to non-specialists because of this, and improvements need to be made to make it more comprehensible. I think this will also make the implications of this project more obvious to the reader. I have provided specific line-by-line comments, as well as two general comments below: - Please provide the raw data as supplementary material (not video but the numbers produced from the video analysis (i.e. percentage changes in different facial actions)). - Please provide more detail about the methods used. It is a good opportunity to provide a methods section that others can use to do further research, and in a journal such as PLOS ONE I would expect some more detail on this. At present your methods could not be replicated by the reader in future research. Abstract - Page 2, Line 2-6 – This sentence is quite hard to read and long. Clarity of your point may be made better by reducing words or splitting into two sentences. - Page 2, Line 21 – Not sure about using (e.g.) in brackets as part of a flowing sentence. Maybe find a better way to write this? Introduction - Page 4, Line 2-6 – Why have you chosen ventilatory threshold and respiratory compensation threshold for these? Also, both need a reference. - Page 5, Line 9 – I am not sure I agree with the comment that biometric data is more unobtrusive. I think videoing someone’s face and facial analysis in general is just as obtrusive; it is just different than techniques researchers have traditionally used before. I think it is more powerful, but not more unobtrusive. Would like to see this statement rectified. - Page 6, Line 7 – FEMG should be fEMG - Page 6, Line 11 – I don’t think you need to add an abbreviation for facial feature tracking as FFT. It wasn’t done in the original paper, isn’t commonly abbreviated and you don’t talk about it much after this. - Page 7, Line 18 – That first statement is quite strong, and I believe there are more than two processes that have been used. Maybe tone it down a bit and just say, “the most commonly used are…” - Throughout introduction (and the whole paper), you use facial action, facial expression and facial configurations interchangeably. I would just choose one, in your case it seems to be facial actions (especially considering you define why you are using this, which is good), and be consistent throughout. - Generally, I am not sure about the structure of the introduction. The reader must read through nearly eight pages of background information before you get to the project aim. I think that some of this background content is of minor consequence to the rest of the paper, quite repetitive and could be made significantly briefer. You want the reader to get straight into the sections that are really related to the content of your paper, like parts of 1.3 and all of 1.4. For example, the following sections don’t really relate strongly to the paper and could be removed or shortened significantly: o Page 3, Section 1 – except for the definition of affect on lines 8-12 o Page 4, Section 1.1 o Page 6, Paragraph 4 o Page 7, Paragraph 1 and 2 Method and materials - Page 10, Line 1 – the use of the term modern is unnecessary. It is just software. - Page 10, Line 4 – what do you define as fit? Do you have any information on training history or sports played? Did you perform any baseline cycling assessments? - Page 10, Section 2.2 – Can you report participant height and weight? - Page 10, Line 7 – Why was the video quality poor? - Page 10, Line 8 – What happened in the environment to cause this? - Page 10, Line 10 – “after one minute of baseline measurement” Baseline measurement of what? - Page 10, Line 10-12 - A reference for the power output selection would be good. - Page 10, Line 13-15 – “If a participant reached 300 watts the final phase involved pedaling at this level for two minutes, thus the maximum duration of the exercise was 26 minutes.” Why did you do this? How many participants completed the final stage without reaching volitional exhaustion? - Page 10, Line 17-19 – Why did only half of participants have heart rate monitors? - Page 11, Section 2.3.3 – I think this would be a really good section for a diagram showing the points on the face or a technical schematic of how the software works. - Page 11, Section 2.3.3 – I think it would be good to have at least two cameras to pick-up different face angles. Is there a reason why you didn’t implement this? Do you think this affected the data you obtained during higher intensities when the head can drop? I think it is also important to know the distance the camera was to the face, an idea of head to camera angle, if it was adjusted for different participants height on the bike etc. - Page 12, Section 2.3.3 – I think you need to describe more about the time each video frame was analysed for (i.e. milliseconds, seconds, batched into bigger 10 second blocks). At present it is not clear exactly how this was done. - Page 12, Section 2.3.3 – What is threshold analysis? - Page 12, Section 2.4 – So the participants knew the purpose of the video camera? I have a bit of an issue with this as I think this substantially changes how a person reacts to the video camera. Please address this as a limitation in your discussion. Might also be worth adding a reference for this manipulation of facial action when the participant knows their expression is being monitored. For example, this reference: Philippen P, Bakker F, Oudejans R, Canal-Bruland R. The Effects of Smiling and Frowning on Perceived Affect and Exertion While Physically Active. J Sport Behav. 2012;35(3):337-352. Results - Page 14, Line 13 – You are introducing some commentary and interpretation into your results, which I would suggest removing or putting in your discussion - Page 14, Lines 17-19 - Based upon the fact that HR was only recorded for half participants and they only reached a mean HR of 174.61 and that RPE was 19 with an SD over 1 which suggests a large number of participants reported RPE well below maximum, I really don’t think you can say that for this age group they reached maximum capacity. Please alter statement. - The image quality and clarity of Figure 1 is poor and does not convey the point that I can see you want to get across very well. Maybe think of an alternative way to represent this data? Discussion and conclusion - Page 23, Line 11 – you refer to the “aerobic exercise” here. This I the first time you refer to it as this, which is a bit odd. Maybe better to keep it consistent to what you said in the introduction, such as an incremental test. - Page 23, Line 13 –you use e.g. mid-sentence again. Will flow better if written as for example or something similar in the sentence structure. - Page 26, Section 4.6 – Generally, you don’t report any of the limitations that this study appears to have in your limitations section. Some of the main ones I have noted above are the fact participants knew the purpose of the video cameras so could change expressions, you didn’t obtain HR for all participants so cannot determine if they did actually reach the intensities you aimed for, and the final exercise intensity was absolute and fixed to 300W. Please rectify. - Page 26, Lines 7-9 – This is a strong statement. I would just tone it down a bit… - Page 26, Lines 10-11 – I like this section and agree with what you are saying, but I don’t feel the methods section you have provided in this paper would allow this research to be expanded upon by others. I think an improved methods section could be the strength of this paper - General comment throughout discussion and conclusion– You discuss that mouth open and draw drop are the “face of exertion”. I don’t disagree with this statement per say, and yes, it is shown in your results. However, I feel you need to more strongly note that as RPE increases, someone is likely to be breathing heavier, and therefore the jaw drops and mouth opens. At present you don’t really discuss this in any detail, which I feel is an oversight in the interpretation of your findings. Reviewer #2: Review of manuscript PONE-D-19_26758 submitted to PLOS ONE S. Timme, R. Brand. Affect and exertion during aerobic exercise: Examining changes using automated facial expression analysis and continuous experiential self-report. In this study, facial expressions during aerobic exercise were recorded at fixed time intervals using an algorithm to detect specific facial actions and identify them as actions units defined within the Facial Action Coding System (FACS). These expressions were related to subjective ratings of positive or negative affective state as well as ratings of perceived exertion. Covariations between facial expressions and subjective ratings were analyzed using multilevel regression or trend analysis, allowing investigation of these relationships at the level of individual participants. The rationale behind this study is clear, the statistical analyses are sophisticated, and the manuscript is well written. I agree with the authors that a better insight in the exerciser's affective state and subjective feelings of exertion may contribute to stimulating people to engage in further pleasurable physical exercise. Although the results of this study seem clear, I have a few comments, questions, or (generally minor) concerns. 1. On pp. 6-7, and in the remainder of this manuscript, emphasis is laid on facial actions as indices of affective states or specific emotions. However, facial actions may also be related to perceptual, motivational, attentional, or cognitive processes (see, for example, studies mentioned in reference 58 of the current manuscript; see also Overbeek et al., 2014, Stekelenburg & van Boxtel, 2001). Although in the current study a lot of different facial actions were measured it seems as if the authors a priori consider these actions as indices of emotional processes whereas within FACS individual actions units strictly do not refer to specific emotions. 2. Although the current software used for analyzing facial actions indeed detected elementary facial actions as indicated in Table 1, it is remarkable that one of these actions ("smile") does not represent an elementary action but a combination of actions (AU6, check raiser; AU12, lip corner puller). This combination is generally interpreted as signifying a smile. I find this confusing since emotions are strictly not measured in the current study. On p. 25, it is said that in this study smile was associated with a negative affective valence. In line 12 on this page, it is erroneously suggested that the detection of AU6 is synonymous with the occurrence of a smile. 3. Figure 2 illustrates relevant facial actions which were observed during the current physical exertion task. I find these examples somewhat confusing since for the reader it may be difficult to associate them with an aerobic exercise task. But particularly the illustration of jaw drop is confusing since this facial expression also depicts AU's 6 and 12 which are generally considered to represent happiness, suggesting that this person is overtly laughing. I have shown this picture to several colleagues asking them to indicate what they saw. They reported to see an overtly laughing person. 4. On p. 23, it is defended that nose wrinkle need not be specifically related to disgust and that it may also be indicative of other emotions. However, in this respect studies are mentioned which have been performed in infants. I am afraid that facial expressions of infants cannot directly be compared with those of adults. 5. Later on this page, it is concluded that mouth open and jaw drop are highly correlated with perceived exertion but that this does not agree with results from an EMG study which would suggest that perceived exertion during physical tasks is mainly linked with corrugator activity. This brings me to the general question whether discrepancies between different studies may (at least partially) be related to studying either aerobic or anaerobic exercise. This distinction is not really discussed in this manuscript. When suggesting on p. 26, third paragraph, that future studies should include a wider ranger of sports to assure a higher generalizability of the current results, I wonder whether types of anaerobic exercise shouldn't also be included. Minor points - P. 7, line 3: "action" > "actions" - P. 9, line 10: "action" > "actions" - P. 11, line 11: "Logitech HD Pro C920" > "Logitech HD Pro C920 webcam" - P. 19, footnote to Table 2: "in less number of parameters" > "in a smaller number of parameters" References Overbeek, T.J.M, van Boxtel, A., & Westerink, J.H.D.M. (2014). Respiratory sinus arrhythmia responses to cognitive tasks: Effects of task factors and RSA indices. Biological Psychology, 99, 1-14. Stekelenburg, J.J., & van Boxtel, A. (2001). Inhibition of pericranial muscle activity, respiration, and heart rate enhances auditory sensitivity. Psychophysiology, 38, 629-641. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Affect and exertion during incremental physical exercise: Examining changes using automated facial action analysis and experiential self-report. PONE-D-19-26758R1 Dear Dr. Timme, We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements. Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication. Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. With kind regards, Dominic Micklewright, PhD CPsychol PFHEA FBASES FACSM Academic Editor PLOS ONE |
| Formally Accepted |
|
PONE-D-19-26758R1 Affect and exertion during incremental physical exercise: Examining changes using automated facial action analysis and experiential self-report. Dear Dr. Timme: I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. For any other questions or concerns, please email plosone@plos.org. Thank you for submitting your work to PLOS ONE. With kind regards, PLOS ONE Editorial Office Staff on behalf of Professor Dominic Micklewright Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .