Peer Review History
| Original SubmissionApril 16, 2020 |
|---|
|
PONE-D-20-10944 Dynamics in typewriting performance reflect mental fatigue during real-life office work PLOS ONE Dear Dr. Lorist, Thank you for submitting your manuscript to PLOS ONE. Two experts commented on your manuscript. As you can see from the reviews, both referees found the general topic addressed in your manuscript interesting and they have a number of nice things to say about the study. At the same time, they have some remarkably constructive and excellently detailed suggestions how to further improve the paper. The comments speak for themselves, but it is obvious that one reoccurring theme is the need for more specificity regarding the hypotheses and a more systematic presentation of the statistics/results. While this will require some extra efforts, I consider it worthwhile. Hence, we invite you to submit a revision of the manuscript that addresses the remaining points together with a cover letter that contains point-by-point replies. Some additional editorial comments are added below. Best regards,Michael B. Steinborn, PhDAcademic Editor We would appreciate receiving your revised manuscript by Jun 25 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Michael B. Steinborn, PhD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information. 3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. Additional Editor Comments: line 111-220methods/statistics: statistical terms (M, SD, F, p, etc.) should be written in italics line 251-262a distinctive feature is that the typing task requires self-paced responding (using the inter-key interval to index reaction time). Under these conditions, individuals are highly vulnerable to occasional lapses (or blocks) of performance and this tendency might also increase with time on task. This has important theoretical consequences as the time on task effect is not due to a tonic slowdown of performance speed but originates from an increase in the number of these short-term depletion (or lapses) in performance (which add to the mean performance). Individuals during a mental blockade might be entirely unable to process any information until the mental blockade dissipates, which can only be demonstrated with advanced performance measurement methods, using distributional analysis. My own work is relevant with this regard (Steinborn & Huestegge, 2016) as we have set a methodological benchmark of how to measure these effects accurately in performance settings [Steinborn, M. B., & Huestegge, L. (2016). A walk down the lane gives wings to your brain: Restorative benefits of rest breaks on cognition and self-control. Applied Cognitive Psychology, 30(5), 795-805. doi:10.1002/acp.3255]. While I would not demand further analysis of typical speed variability (i would welcome it, however), I would appreciate if the authors could address this point in the revised version of the manuscript. line 273-285backspace key to index erroneous behavior. In my opinion, this is a highly interesting point that should be given somewhat more weight in the discussion. As most of the research is using reaction-time based paradigms where it is not possible to correct an error, the present study uses a natural setting where an error is completely relevant to the task and where correction is not only enabled but naturally invited by the nature of the task. I suggest elaborating this point a bit further, if possible, as it would increase the impact of the present study. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This paper examines the effect of time-of-week, time-of-day, and time-on-task on type writing performance in a natural setting, using a sample of about 50 participants. Type writing performance was measured using typing speed (inter key interval) and error correction (backspace) as dependent measures. It was hypothesised that the development of task-related mental fatigue (time on task) is modulated by time of week (early weekdays better than late weekday) and time of day (afternoon times better than morning times). It seems that the results support the hypothesis although some aspects of the results are not completely clear to me at the moment. My evaluation is positive, and I have a few comments that might be considered in the revision. #1 Theory It is clear to me that the authors are the "top experts" in that field of research on mental fatigue. I am therefore very much inclined to believe most of what is stated in the introduction. Apart from that, there are some points that could be explained in more detail or with more precision. For example, the underlying processes that are assumed to produce the performance variations at different time scale, over the week or with time on task, could be specified with a bit more precision. In other words, the rationale for expecting interactions between these variables on the relevant performance measures could be explained further. On the other hand, the manuscript is relatively concise at present and the might be little room to include too much detail, so I only ask (as an interested reader) whether the authors could elaborate a bit more on the underlying cognitive mechanisms of mental fatigue in the introduction and also in the discussion. #2 Hypotheses / Statistics The hypotheses are so far well formulated, however, they could be more systematically presented with respect to all relevant main effects and interactive effects on performance. Regarding the statistics, I suggest including a table that contains all main and interaction effects on performance. At the moment, I did not fully understand all aspects of the results and I therefore would appreciate if this information is more systematically presented in the revised manuscript. #3 Results Although the authors are interested in some more specific effects, I would appreciate if they could provide a full model of all main and interaction effects on both performance measures (typing speed, and error correction). For example, there are expected main effects of the factor "time of week", of the factor time of day, and also on "time on task", then three two-way interactions and one three-way interaction, resulting in seven relevant statistical effects. A more integrative presentation of these results would certainly improve the current manuscript. #4 self-report state Performance is evidently influenced by momentary states within the individual. Given the evidence of relationships between subjective engagement to a task and objective performance, I wonder whether self-report measures are available for the present research, and if so, whether they could deliver additional information. For example, the dundee stress state questionnaire (DSSQ, Matthews et al., 2002; Langner et al., 2010) seems to be the proper instrument to assess these aspects but other instruments might also do well with this regard. I would appreciate if the authors could give a short opinion or outlook on the possibilities of assessing engagement and to elaborate somewhat more deeply on potential limitations with this regard in the present study [top references: [Langner, R. et al. (2010). Mental fatigue and temporal preparation in simple reaction-time performance. Acta Psychologica, 133(1), 64-72. doi:10.1016/j.actpsy.2009.10.001; Matthews, G. et al. (2002). Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry. Emotion, 2(4), 315-340. doi:10.1037//1528-3542.2.4.315]. #5 minors and typoes line 165-168, table 1 table according to APA rules, provide sufficient information as notes line 170-end of results F values should be rounded up (2,97924 to 3.0) line 185-190, figure 1 if possible, the results should be presented not separately but in one figure so that the reader can evaluate the main and interactive effects of the results simultaneously. At present, the results are distributed across separated figures which makes it difficult to understand the whole picture line 349, references check typos Reviewer #2: Background: The study examines how mental fatigue, measured by markers of typewriting performance for speed and accuracy, changes over different time scales during regular office work. To this end, the authors aimed to: 1. provide a proof-of-principle regarding two formerly identified markers of typewriting performance 2. investigate changes in typewriting performance over different time scales As a result, differences in typewriting performance were found for the different time scales under investigation. These differences resemble those found in an earlier study, where a direct link between typewriting performance and mental fatigue was established. Evaluation: Overall, my evaluation is positive, especially if a few points are further clarified. Except for a few minor exceptions, the manuscript is a pleasurable read. The document is formally well written, mostly to the point and adequate in length. A few less strong points regard the elaboration of the effective mechanism under investigation and the statistical reporting. I believe there is potential for improvement with this regard. My detailed comments are outlined below. Please note that my comments are aimed at further improving the manuscript, and are not meant to criticize the authors' work. 1. Theory The predictions would benefit from further elaboration. While it is understood that the proof-of-principle character of the study somewhat mitigates this point, it is so far not clear what exactly is predicted for either of the different time-scales. Thus, the reported results for performance for either time-scale might point to an effect of mental fatigue, they might, however, also be somewhat unrelated to mental fatigue and caused by additional factors. I would therefore expect the authors to provide further clarity regarding their expectations for each outcome measure and time-scale. 2. Statistical reporting The statistical reporting part lacks a systematic and comprehensive overview of the reported outcome measures. Given this lack, it is thus far not possible to readily understand either the main effects or the interactions found for typewriting performance. Statistics should thus be systematically described in tables, reporting all main and interaction effects. A detailed table of complete results as well as some sort of reporting of the compiled data (means, standard deviations, ... for all days and time-scales seperately as well as combined) would also greatly improve the readers' ability to comprehend the reported results. 3. Methods - potential trade-off between speed and accuracy As it stands, typewriting markers for speed and accuracy are not measured independently of each other and might thus be confounded. A faster typing speed might result in more necessary backstrokes to correct a mistake. Similarly, more mistakes and thus more (potentially rather fast) backstrokes might lead to an enhanced typing speed. Given the design of the study, both these effects would not be correctly reflected by the current measures. While I understand that an independent measurement might be difficult to achieve, I suggest the authors should provide some further analysis of how this problem might affect the found results. - sample bias The comparatively large drop-out ratio appears problematic in regards to a potential sample bias, especially given the rather strict criteria of more than 45 minutes of uninterrupted work for at least 30 times a week. Several potential solutions come to mind and are highly recommened to provide further clarity regarding this point: - reconsider the strict criteria or give a more comprehensive explanation for its choice - discuss potential effects from excluding a large portion of the sample, especially regarding the potential that mental fatigue might might be more pronounced in the dropped-out participants (thus leading to a smaller amount of unterinterrupted work) Line comments: line 107 (theory): "... expected that typing performance would ..." This hypothesis would especially benefit from further clarification, particularly since no overall measure of performance is given and therefore no possible way to judge whether hypothesis will be approved or rejected if speed and accuracy fail to change in the expected dimension line 112-120 (methods - participants): please provide a more detailed description of the work the participants carry out and on what exactly is typed by them (predominantly email, research articles, ...) line 118 (methods - participants): please clarifiy what is meant by continous typing line 134-136 (methods - typing performance): it is not easily understood how the series of average values are generated, please provide some more details on this line 146-147 (methods - procedure): please explain the nature of the feedback in more detail. It might also be beneficial to discuss the implications of the given feedback on performance and the given results, if any effect is expected line 205 (results - day-of-week): given that most people work less hours on Fridays, performance on Friday afternoons might lack data points. I suggest to provide more comprehensive and complete results to understand how potential effects like these were treated. line 311 (discussion): Given that mental fatigue was measured only on weekdays, but might also occur on Saturdays and Sundays, such a general conclusion might be exagerated to a certain degree. Thus, "baseline" measurement on Mondays might not reflect a true baseline for mental fatigue. line 329 (discussion): typo "lead", should read "led" line 333 (discussion): typo "subtitle", should read "subtle" line 336-337 (discussion): please explain in greater detail how the presented results point to information about the amount of hours employees can or should work Figure 2: please note what is indicated by confidence intervals ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Dynamics in typewriting performance reflect mental fatigue during real-life office work PONE-D-20-10944R1 Dear Dr. Lorist, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Michael B. Steinborn, PhD Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors did a good job in the revision. The manuscript improved considerably. I can recommend it in the present form. Reviewer #2: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
| Formally Accepted |
|
PONE-D-20-10944R1 Dynamics in typewriting performance reflect mental fatigue during real-life office work Dear Dr. Lorist: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Michael B. Steinborn Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .