Peer Review History

Original SubmissionDecember 23, 2024
Decision Letter - Alberto Greco, Editor

Dear Dr. Stuldreher,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The reviewers highlighted the need for greater clarity in defining participant groups and the methodology, The novelty of the study should also be better claimed, distinguishimg between attentional engagement and interpersonal connection. Additionally, the manuscript should improve the discussion on the relationship between physiological synchrony and self-reported engagement. Please prepare a major revision accordingly, following the reviewers’ detailed comments.

Please submit your revised manuscript by Mar 22 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Alberto Greco

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that Figure 1 includes an image of a participant in the study. 

As per the PLOS ONE policy (http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research) on papers that include identifying, or potentially identifying, information, the individual(s) or parent(s)/guardian(s) must be informed of the terms of the PLOS open-access (CC-BY) license and provide specific permission for publication of these details under the terms of this license. Please download the Consent Form for Publication in a PLOS Journal (http://journals.plos.org/plosone/s/file?id=8ce6/plos-consent-form-english.pdf). The signed consent form should not be submitted with the manuscript, but should be securely filed in the individual's case notes. Please amend the methods section and ethics statement of the manuscript to explicitly state that the patient/participant has provided consent for publication: “The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these case details”. 

If you are unable to obtain consent from the subject of the photograph, you will need to remove the figure and any other textual identifying information or case descriptions for this individual.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously? -->?>

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available??>

The PLOS Data policy

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English??>

Reviewer #1: Yes

Reviewer #2: Yes

**********

Reviewer #1:  Understanding audience engagement using physiological signals and synchronization is an interesting topic. However, I found the manuscript challenging to follow.

Comments:

• In the abstract, “investigated how well it distinguished between these groups of participants” is unclear because the groups were not previously defined. It seems the grouping is based on personal or professional relationships with the speaker, but this is not explicitly stated. Additionally, some participants could have both types of relationships.

• The statements “We compare the outcomes to results” and “Unlike analyses using individual’s EDA, analyses with inter-subject correlations do not require contextual event information” are unclear and need clarification.

• It seems that the main finding is that EDA synchrony is not effective at detecting attentional engagement but is better at capturing a kind of “empathy” or relationship with the speaker. I suggest reflecting this more consistently throughout the paper, including the title. The results for engagement detection appear to be secondary in the analysis and are also not very positive.

• Have the authors considered analyzing the correlation of the tonic component of EDA?

• Section 2.6.2 suggests that the correlation of the SCRs (a more accurate term would be “phasic component”) was computed. However, subsequent sections about correlation analysis refer to participants’ EDA. Were raw EDA and phasic EDA correlations computed? Please clarify this.

• I question the practical use of a system designed to capture the type of relationship (personal or professional) an audience member has with the speaker. It is uncommon to give a lecture primarily to family and friends. Please elaborate on the potential applications of this system.

• I have not used EdaMove 4, but the statement about it being a “high quality” wearable seems unnecessary and unsupported by the data presented.

• ISC-EDA was never defined. Initially, I thought ISC referred to the correlation, but since it was computed using the phasic component, it was labeled SCR. However, these terms appear to differ. It is unclear what SCR represents in the text, tables, and figures, as it does not seem to correspond to the phasic component of EDA for an individual.

• I initially thought the correlation was computed between the speaker and the participants, but it seems to be inter-subject. Furthermore, it appears that the correlation was performed within-group (same group) and between-group (other group). However, these groupings were not defined in the text and are not intuitive. This aspect of the manuscript was particularly difficult to follow.

• The statement “when we refer to inter-subject correlations, we refer to this participant-to-group metric” is confusing because the terms are used later in the text as if they represent different concepts: “The inter-subject correlations and participant-to-group inter-subject correlations.” The manuscript, especially the methodology, needs significant improvement to provide greater clarity.

Reviewer #2:  This study investigates physiological synchrony in electrodermal activity (EDA) as a real-time marker of attentional engagement in a real-life lecture setting. Results show that both physiological synchrony and individual EDA can differentiate between participant groups and detect engaging events but do not reliably align with self-reported engagement.

The study is overall well-executed and the analyses are comprehensive and detailed. Nevertheless, I believe that the novelty and contribution to the field may be not sufficient for a publication (as detailed below). A more detailed framing highlighting the novelty of this study may be useful to reach publication standards.

INTRODUCTION:

- MAJOR: The Introduction could be further expanded and elaborated.

- MAJOR: The overall novelty of this study should be highlighted more, as (at the current state) it does not seem to bring a significant contribution to the field.

- MAJOR: A general aim should be presented before specific research questions.

- MINOR: Please clarify the role and meaning of peripheral measures, before explaining how they actually relate to attentional engagement.

METHODS:

- MINOR: Is there any particular reasons why the Bluetooth connection of the majority of heart rate sensors failed and not EDA sensors? This could be useful for future research as well.

- MAJOR: The event "pictures of Radboud colleagues" is used in self-report questionnaires but is not reported in events of interest. Could you specify the timing of this event? Was it used during the signal analysis? The analysis in 2.6.5 should be repeated on this event expecting opposite results compared to the brother's picture.

- MINOR: In Procedure: "attending professors leaving the room" -> "left"

- MAJOR: Since the EDA signal is often varying in time trajectory according to individual differences, what do the authors think about using lag-based measures, such as cross-correlation?

- MINOR: The acronym "ISC-EDA" is never explicitly defined in the main text.

- MINOR: Please define more details in the classification approach described t the end of paragraph 2.6.5.

- MINOR: 2.6.6; also this analysis should be clarified.

- MINOR: Analyses of self-report questionnaires are not specified in the Methods.

- MINOR: A public version of the dataset should be made available, at least for the Reviewers (there is a specific option in OSF). Until now, it was possible to access it only as contributor.

RESULTS:

- MINOR: "highest physiological synchrony with yields 69%" -> "which"

- MINOR: "Figure 2 shows that participants that have a personal relationship with the speaker have significantly..." is actually Figure 3.

DISCUSSION:

- MAJOR: Please discuss the absence of a relation between physiological synchrony and self-report measures in light of Gashi et al.'s [12] results.

- MAJOR: most results (except for the event detection) are about the SCR and not ISC-EDA. Showing that the phasic component of EDA is related to attentional engagement is not an overwhelming result, so the novelty of this study should be highlighted more clearly.

- MINOR: Fig. 4, low panels: adding a boxplot or violin plot to the points could be useful to visualize the results.

**********

what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.

Revision 1

Dear Dr. Greco,

We would like to thank you and the reviewers for your work and feedback on our mansucript. It helped us to improve the manuscript considerably. Below are the detailed point-by-point responses to the reviewers, but overall, the most important changes are:

- Clarification of the added value of the current work in the Introduction and Discussion.

- Clarification of the methods and terminology used.

- Clarifying the rationale of the participants groups – we explain that this classification was used to operationalize expected differences in attentional engagement (in this case, due to the stronger or weaker personal connection with the speaker).

- We discuss the relation between self-report and physiological synchrony more elaborately.

Furthermore, we obtained written permission from the people who can be recognized in the picture, to publish the picture.

On behalf of all authors,

Best regards,

Ivo Stuldreher

Attachments
Attachment
Submitted filename: Response to reviewers.docx
Decision Letter - Alberto Greco, Editor

Monitoring audience engagement using electrodermal activity during an inaugural lecture

PONE-D-24-58554R1

Dear Dr. Stuldreher,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Alberto Greco

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions??>

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously? -->?>

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available??>

The PLOS Data policy

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English??>

Reviewer #1: Yes

Reviewer #2: Yes

**********

Reviewer #1: I want to thank the authors for properly addressing my comments and suggestions. The manuscript is a better product.

Reviewer #2: All my comments were adequately addressed. Many parts of the manuscript were modified accordingly, or choices were properly justified.

I would like to thank the authors for their thorough work on improving this manuscript.

Only a couple minor (grammatical) issues persist in section 2.6.5, and should be corrected before publication:

"personal group on the basis on responses" -> "basis OF responses"

"would be done by picking the the Npersonal participants" -> remove one THE

**********

what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy

Reviewer #1: No

Reviewer #2: Yes:  Francesco Bossi

**********

Formally Accepted
Acceptance Letter - Alberto Greco, Editor

PONE-D-24-58554R1

PLOS ONE

Dear Dr. Stuldreher,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Alberto Greco

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .