Peer Review History

Original SubmissionMarch 24, 2023
Decision Letter - Lucas Smith, Editor

Dear Dr Hebron,

Thank you for submitting your manuscript entitled "Alpha closed-loop auditory stimulation modulates waking alpha oscillations and sleep onset dynamics in a phase-dependent manner in humans" for consideration as a Research Article by PLOS Biology.

Your manuscript has now been evaluated by the PLOS Biology editorial staff as well as by an academic editor with relevant expertise and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. After your manuscript has passed the checks it will be sent out for review. To provide the metadata for your submission, please Login to Editorial Manager (https://www.editorialmanager.com/pbiology) within two working days, i.e. by Apr 04 2023 11:59PM.

If your manuscript has been previously peer-reviewed at another journal, PLOS Biology is willing to work with those reviews in order to avoid re-starting the process. Submission of the previous reviews is entirely optional and our ability to use them effectively will depend on the willingness of the previous journal to confirm the content of the reports and share the reviewer identities. Please note that we reserve the right to invite additional reviewers if we consider that additional/independent reviewers are needed, although we aim to avoid this as far as possible. In our experience, working with previous reviews does save time.

If you would like us to consider previous reviewer reports, please edit your cover letter to let us know and include the name of the journal where the work was previously considered and the manuscript ID it was given. In addition, please upload a response to the reviews as a 'Prior Peer Review' file type, which should include the reports in full and a point-by-point reply detailing how you have or plan to address the reviewers' concerns.

During the process of completing your manuscript submission, you will be invited to opt-in to posting your pre-review manuscript as a bioRxiv preprint. Visit http://journals.plos.org/plosbiology/s/preprints for full details. If you consent to posting your current manuscript as a preprint, please upload a single Preprint PDF.

Feel free to email us at plosbiology@plos.org if you have any queries relating to your submission.

Kind regards,

Luke

Lucas Smith, Ph.D.

Associate Editor

PLOS Biology

lsmith@plos.org

Revision 1
Decision Letter - Lucas Smith, Editor

Dear Dr Hebron,

Thank you again for your patience while your manuscript "Alpha closed-loop auditory stimulation modulates waking alpha oscillations and sleep onset dynamics in a phase-dependent manner in humans" was peer-reviewed at PLOS Biology. It has now been evaluated by the PLOS Biology editors, an Academic Editor with relevant expertise, and by several independent reviewers.

In light of the reviews, which you will find at the end of this email, we would like to invite you to revise the work to thoroughly address the reviewers' reports.

While the reviewers agree that the study is interesting, they have raised a number of important concerns that would need to be addressed before further consideration at PLOS Biology. The reviewers highlight that the writing is currently quite dense and inaccessible, and that the manuscript would need to be substantially revised to provide further context, justifications, explanations, and clarifications. We think that addressing these points is important to make the manuscript more accessible to the broad readership of PLOS Biology. In addition to thoroughly revising the writing of the study, it will be essential to thoroughly address the methodological issues raised by Reviewer 3, in order to add support to the conclusions of the study.

Given the extent of revision needed, we cannot make a decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is likely to be sent for further evaluation by all or a subset of the reviewers

We expect to receive your revised manuscript within 3 months. Please email us (plosbiology@plos.org) if you have any questions or concerns, or would like to request an extension.

At this stage, your manuscript remains formally under active consideration at our journal; please notify us by email if you do not intend to submit a revision so that we may withdraw it.

**IMPORTANT - SUBMITTING YOUR REVISION**

Your revisions should address the specific points made by each reviewer. Please submit the following files along with your revised manuscript:

1. A 'Response to Reviewers' file - this should detail your responses to the editorial requests, present a point-by-point response to all of the reviewers' comments, and indicate the changes made to the manuscript.

*NOTE: In your point-by-point response to the reviewers, please provide the full context of each review. Do not selectively quote paragraphs or sentences to reply to. The entire set of reviewer comments should be present in full and each specific point should be responded to individually, point by point.

You should also cite any additional relevant literature that has been published since the original submission and mention any additional citations in your response.

2. In addition to a clean copy of the manuscript, please also upload a 'track-changes' version of your manuscript that specifies the edits made. This should be uploaded as a "Revised Article with Changes Highlighted" file type.

*Re-submission Checklist*

When you are ready to resubmit your revised manuscript, please refer to this re-submission checklist: https://plos.io/Biology_Checklist

To submit a revised version of your manuscript, please go to https://www.editorialmanager.com/pbiology/ and log in as an Author. Click the link labelled 'Submissions Needing Revision' where you will find your submission record.

Please make sure to read the following important policies and guidelines while preparing your revision:

*Published Peer Review*

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. Please see here for more details:

https://blogs.plos.org/plos/2019/05/plos-journals-now-open-for-published-peer-review/

*PLOS Data Policy*

Please note that as a condition of publication PLOS' data policy (http://journals.plos.org/plosbiology/s/data-availability) requires that you make available all data used to draw the conclusions arrived at in your manuscript. If you have not already done so, you must include any data used in your manuscript either in appropriate repositories, within the body of the manuscript, or as supporting information (N.B. this includes any numerical values that were used to generate graphs, histograms etc.). For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5

*Blot and Gel Data Policy*

We require the original, uncropped and minimally adjusted images supporting all blot and gel results reported in an article's figures or Supporting Information files. We will require these files before a manuscript can be accepted so please prepare them now, if you have not already uploaded them. Please carefully read our guidelines for how to prepare and upload this data: https://journals.plos.org/plosbiology/s/figures#loc-blot-and-gel-reporting-requirements

*Protocols deposition*

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Thank you again for your submission to our journal. We hope that our editorial process has been constructive thus far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Lucas

Lucas Smith, Ph.D.

Senior Editor

PLOS Biology

lsmith@plos.org

------------------------------------

REVIEWS:

Reviewer #1: Summary:

In a series of experiments using closed-loop auditory stimulation on awake adult humans, the authors explore the physiological effects of targeting alpha oscillations as measured at two different electrode sites (Pz, Fz, referenced to mastoid). The topic is interesting and timely, given recent interest in closed loop stimulation, and adds several pieces of information that will be helpful to others wishing to causally manipulate these higher frequency brain oscillations. While not definitive, the results are consistent with a phase-reset model of brain stimulation, and suggest some effects of manipulating alpha-band oscillations.

The paper is extremely dense and must be deciphered, in part owing to its complex nature and in part owing to the structure and presentation of the work. There are many places in which the work could better convey the results and the authors' ideas more clearly and powerfully, and there are some places in which methods details and particularly justifications for design and analytic choices are needed (see suggestions).

There is some theoretical backing for the work, though the framing is largely exploratory. There is room to better integrate the work with existing literature and ideas about how sound affects brain activity and the nature and roles of alpha oscillations. Given the journal's evaluation criteria, it might be better-suited to a specialized journal.

Major:

- the abstract and title ("alpha closed-loop auditory stimulation modulates (...) sleep onset dynamics in a phase-dependent manner in humans" ) as well as various statements of the findings ("we have shown the functional significance of this approach, during the transition to sleep") generates high expectation that the authors were able to successfully influence sleep onset. However, it seems that one of the stimulation conditions just prevented subjects from getting into deeper sleep as compared with the other stimulation condition, or sham. While this series of studies represents a valuable foray into causally manipulating alpha and trying to observe the physiological responses, the set up seems to detract from these efforts and makes the claim of results seem overstated.

- Density/readability suggestions:

a) There are about 5 "experiments" split over 3 "studies". The first encompasses experiments 1 and 2 (labelled as such), the second experiments 3 and 4 (also labelled), and the third study seems to have a fifth experiment (not called experiment 5?). The reader would have an easier time following this structure with a bit of an orientation as to the overall plan and goals and what each investigation looks at in the introduction, as well as consistent use of naming (like using 'experiment 5' for the last one).

b) The rationale and meaning of some of the analyses is not always clearly explained when they are at first encountered, which in this methods-at-end format is already in the Results. For example, it was hard to follow why ISI is looked at in theta and sigma bands, and I did not understand why and on what basis the Pz and Fz were selected and followed through the various experiments.

c) The article body has 8 large compound figures, many of which are made of smaller subplots - some as many as 47 (Figure 8) with a half-page of caption. Some of the plots are quite specialized and are likely to be unfamiliar graphic representations to many readers. I would suggest to select main questions of interest and move some of the other plots to Supplementary material, and/or find some way to more globally summarize the patterns in large numbers of similar subplots

d) Related, the figures could use more interpretable names / labels. There is quite some deciphering to be done for example to figure out how Figure 6. A, B, C, i - iv in Experiment 3 at Fz relate to similar plots for Exp 4 at Pz.

- As the authors acknowledge, auditory evoked responses occur in response to sound and have a similar topography. There is considerable literature on the existence of an entrainment mechanism of auditory networks close to this frequency band (generally very slightly lower, like 4-9 Hz, though without hard boundaries). It was unclear to me to what degree the authors were able to separate an alpha modulation from a passing an AEP that might be composed of a normal evoked response and some addition from ongoing alpha oscillations through the band-pass filter, and how phase-resetting might be separated from a process of progressive entrainment. Is there some way of distinguishing these possibilities in these data?

- Why are the phase locking-values in Exp 2 and particularly Exp 1 so much lower using the hd-EEG system than with the ecHT device? (e.g., mean for Exp 1: 0.84 vs. 0.54) It is explained that the difference is because of the differences in EEG montages; however, evidence does not seem to be presented. Can the authors confirm by running the analysis on a re-referenced version of whichever set of electrodes is closest to Mastoid vs. Fz in their cap?

- Nap studies usually occur in the afternoon, for reasons relating to circadian rhythm and propensity to sleep. Why was Study 3 conducted in the morning, when subjects are most likely farthest from sleep? (Related, why were normal, healthy, well-rested subjects falling asleep in a few minutes with their eyes closed in the morning while loud clicks were played in Study 3?)

- More details and clarifications are needed as regards methods and justifications for design choices. For example, what was the justification for 80 dB (presumably SPL) sound presentation? This is considered quite loud for auditory experiments. How were the stimulation phases selected? (pre-peak 330 decrees, post-peak 60 degrees, etc.)

- More information is needed as regards sleep scoring - which system was used? Was the scorer blinded? (someone is acknowledged for scoring them and there is some discussion of finer-grained measures)

- Why PLV and PLI? If PLI zero phase was discarded, does that mean PLV is potentially contaminated by volume conduction artifacts? Is that was is referred to when the authors describe relative sensitivity to type 1 and type 2 errors? Note that the meanings of these connectivity metrics is not referred to in the discussion; it is not clear what these analyses (and having included two measures) adds.

- Have the authors considered how changes in strength of the oscillations at different regions may have impacted the connectivity metrics (and their conclusions)?

- How were sample sizes decided upon, which differ quite a bit between the experiments? (Justification/power analysis)

- Why did the authors decide to analyze connectivity in sensor space rather than source space (i.e., brain), which might have been more informative and is quite possible using hd-EEG?

- This paper format has results before methods. Keeping in mind that the reader does not yet have in mind the Methods details at time of reading the results, it would help to have a few more methods details included in the results, for example that there is to be post-peak and post-trough stimulation in Study 3, what electrode or electrodes are considered in the hd-EEG analysis, what the time window is for connectivity analysis following stimulation was, or what the analytic basis for statements like "phase-locking was highly accurate across experiments, greatest around locations targeted" are (in brief). What are the "locations targeted" here? Does this mean the scalp locations? Does it mean Fz and Pz separately? Why both?

- The explanation for using Fz vs Pz could use more explanation, and a stronger connection to extent literature on alpha origins and roles. The methods section says only "frontal and parietal regions of interest (ROI) were defined a priori" - but how/why/based on what?

- In Exp 1, targeting Fz, an alpha-CLAS phase effect on power of alpha oscillations was found; this was not found for Pz, although a modulation of alpha power was found; the authors conclude that the effects of alpha-CLAS on alpha power and frequency are location-specific - what does this mean in terms of underlying anatomy? Why Fz and Pz to begin with?

- How far were the phases of Fz from those stimulated on Pz? What is the phase offset between these two scalp locations, and is it predictable or random?

- Frequency differences - pg 10 - missing from this analysis is some indication of the degree to which a clear alpha peak is observed in each of these channels. This is important because theta-band activity is found just below the alpha band range, and is often not clearly distinguished from it. Sigma band activity related to spindles also only becomes clear and 'peaky' in N2. Theta is also stronger in frontal midline regions. There should be some discussion of how clearly the authors' analysis is getting at alpha as opposed to theta and sigma.

- Is R2 = 0.97 in Fig 4 correct? Please explain in "Statistical Analyses" how this measure is computed here, as there are several methods (see https://jonlefcheck.net/2013/03/13/r2-for-linear-mixed-effects-models/), and (briefly) how it should be interpreted

- Why are different referencing strategies used across the studies and what are the potential effects on the reported results?

- Fig 4A: the red to blue color scale is usually used to indicate a divergent scale where the two colors have opposite meanings. Here, blue is closer to 0, red is farther away, and white is at some arbitrary point in between (0.2). I suggest to use a continuous scale for easier interpretation.

- In some places, it is hard to follow the logic in the Results section; for example, the relative meanings of the "frequency difference" and "change in frequency difference" analyses presented in Figure 4 were not clear.

- If alpha phase-dependent auditory stimulation influences the effect of sound on the brain through a process of inhibition (or put another way, relative cortical excitability), why did the authors not explicitly investigate the amplitude of cortical evoked auditory responses by alpha phase? Would the absence of an amplitude difference in the AEPs count against this theory?

-

Revision 2

Attachments
Attachment
Submitted filename: response_to_reviewers.docx
Decision Letter - Lucas Smith, Editor

Dear Dr Hebron,

Thank you for your patience while we considered your revised manuscript "Alpha closed-loop auditory stimulation modulates waking alpha oscillations and sleep onset dynamics in a phase-dependent manner in humans" for publication as a Research Article at PLOS Biology. This revised version of your manuscript has been evaluated by the PLOS Biology editors and the Academic Editor who is fully satisfied by the changed made in the revision.

Based on our Academic Editor's assessment of your revision, we are likely to accept this manuscript for publication. However, before we can editorially accept your study, we need you to address the following data and other policy-related requests.

**EDITORIAL REQUESTS:

1) TITLE: We would like to suggest a minor change to the title, which we think will make it more broadly accessible and will highlight the approach developed here. If you agree, we suggest it be changed to something like:

'A closed-loop auditory stimulation approach to selectively modulate alpha oscillations in the human brain.'

or maybe

'A closed-loop auditory stimulation approach selectively modulates alpha oscillations and sleep onset dynamics in humans'

Happy for you to optimize further....

2) ETHICS STATEMENT: Thank you for including an ethics statement in your methods section. Please update this to include the approval number for the protocol approved by the University of Surrey Ethics Committee.

3) DATA and CODE: Thank you for providing the data and code related to your study on github. I took a look at this, and for some reason had a tough time finding the relevant data and code (I see some files related to Fig 1). Can you ensure that this has all relevant underlying data and code related to your manuscript? Please also update the Readme file to include a few more details about what the files are and how they relate to your manuscript. And as a last request, we ask that you generate a DOI for this dataset, to ensure its permanence. You can do that via zenodo (see: https://docs.github.com/en/repositories/archiving-a-github-repository/referencing-and-citing-content)

As you address these items, please take this last chance to review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the cover letter that accompanies your revised manuscript.

We expect to receive your revised manuscript within two weeks.

To submit your revision, please go to https://www.editorialmanager.com/pbiology/ and log in as an Author. Click the link labelled 'Submissions Needing Revision' to find your submission record. Your revised submission must include the following:

- a cover letter that should detail your responses to any editorial requests, if applicable, and whether changes have been made to the reference list

- a Response to Reviewers file that provides a detailed response to the reviewers' comments (if applicable, if not applicable please do not delete your existing 'Response to Reviewers' file.)

- a track-changes file indicating any changes that you have made to the manuscript.

NOTE: If Supporting Information files are included with your article, note that these are not copyedited and will be published as they are submitted. Please ensure that these files are legible and of high quality (at least 300 dpi) in an easily accessible file format. For this reason, please be aware that any references listed in an SI file will not be indexed. For more information, see our Supporting Information guidelines:

https://journals.plos.org/plosbiology/s/supporting-information

*Published Peer Review History*

Please note that you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. Please see here for more details:

https://blogs.plos.org/plos/2019/05/plos-journals-now-open-for-published-peer-review/

*Press*

Should you, your institution's press office or the journal office choose to press release your paper, please ensure you have opted out of Early Article Posting on the submission form. We ask that you notify us as soon as possible if you or your institution is planning to press release the article.

*Protocols deposition*

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please do not hesitate to contact me should you have any questions.

Sincerely,

Lucas

Lucas Smith, Ph.D.

Senior Editor

lsmith@plos.org

PLOS Biology

Revision 3

Attachments
Attachment
Submitted filename: response_to_reviewers.docx
Decision Letter - Lucas Smith, Editor

Dear Dr Hebron,

Thank you for the submission of your revised Research Article "A closed-loop auditory stimulation approach selectively modulates alpha oscillations and sleep onset dynamics in humans" for publication in PLOS Biology and thank you for addressing our last editorial requests in this revision. On behalf of my colleagues and the Academic Editor, Simon Hanslmayr, I am pleased to say that we can in principle accept your manuscript for publication, provided you address any remaining formatting and reporting issues. These will be detailed in an email you should receive within 2-3 business days from our colleagues in the journal operations team; no action is required from you until then. Please note that we will not be able to formally accept your manuscript and schedule it for publication until you have completed any requested changes.

**Please note: as discussed over email, I have updated your 'data availability statement' to include the Zenodo DOI that you generated for the data and code provided on github. Please do take a quick look at this change to make sure everything is accurate.

Please take a minute to log into Editorial Manager at http://www.editorialmanager.com/pbiology/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production process.

PRESS

We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with biologypress@plos.org. If you have previously opted in to the early version process, we ask that you notify us immediately of any press plans so that we may opt out on your behalf.

We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/.

Thank you again for choosing PLOS Biology for publication and supporting Open Access publishing. We look forward to publishing your study. 

Sincerely, 

Luke

Lucas Smith, Ph.D.

Senior Editor

PLOS Biology

lsmith@plos.org

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .