Peer Review History

Original SubmissionApril 13, 2022
Decision Letter - Alastair Smith, Editor

PONE-D-22-10991Re-assessing the role of culture on the visual orientation perception of the rod and frame testPLOS ONE

Dear Dr. Willey,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 18 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Alastair Smith

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.  Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this informatio

3. Please note that according to our submission guidelines (http://journals.plos.org/plosone/s/submission-guidelines), outmoded terms and potentially stigmatizing labels should be changed to more current, acceptable terminology. To this effect,  “Caucasian” should be changed to “white” or “of [Western] European descent” (as appropriate).

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study addressed cross-cultural differences in perception, specifically in visual perception, by using a visuospatial task that assesses the person's ability to align a rod to true vertical (gravity) or identify the direction of the rod when surrounded by a distracting tilted frame. The manuscript is generally well written, but there are a few concerns.

1. The authors can still enrich their Introduction with information on how culture influences attentional processes (direct attention to focal objects or contexts), and on the type of processing (analytical or holistic) different cultures prefer.

2. In the Results section, when referring to "Others", it would be useful to include what is meant by that. It is not certain whether the authors included this information in the included appendix of the questionnaire.

3. Also for "Others", it would make it easier for the reader if the gender distribution is specified for this group as well at each analysis trial.

4. For generational data, it is not clear how long the 1st generation Americans or the non-US citizens have been in the USA. It is possible that the time of their stay may influence the extent to which they were affected by the culture they are exposed to.

5. Line 223: it is not clear what is meant by " and interestingly since it was in the "wrong" direction of ethnicity".

6. Lines 239, 240. This is a run-on sentence.

7. The figures are not numbered. They should be.

8. In the figure on generation effects (I assume it is Figure 8), the authors should include number of subjects (n).

9. It would be worth adding how sex hormones influence performance on visuospatial tasks either in the Introduction or Discussion to delineate any gender effects.

Reviewer #2: This is a short and interesting study but some elements, which are overall minor in my opinion, should be improved before it can get published. Below are my point-by-point comments about the paper.

Line 83. Is there a justification for using a 3D version of the RFT here? Is it because it may increase the effect size and therefore be more sensitive to detect cultural variations?

Line 83. How is culture operationalised and tested? Is culture tested in different countries? (one discovers that this is not the case when reading the paper, but this should be prepared). Is there a justification/good reason for testing culture only within the US? One may refer to studies which found that cultural effects are smaller/decrease for Asians living in the US, or Amercians living in Asia (e.g., Kitayama,Duffy,Kawamura, and Larsen, 2003)

Line 84. The meaning of "to anticipate" here is difficult to grasp. I had to read the sentence twice to understand its meaning. It was not clear to me, at first, that this was a preview of all the findings of the study.

Line 111. Lack of clarity, the sentence suggests that there were three conditions (-18°, 0°, 18°), with 6 trials each. Is this correct? If yes, could this be said explicitly?

Line 158. A description of how culture is defined, in subsequent analyses, would be useful. In addition, given that culture is the main IV in this study, it is important to provide specific information about the questions asked to the participants in order to classify them.

Line 166. Who are the 137 participants who do not identify as EA or Caucasian? How is Caucasian actually defined? Does it mean white skin? What about participants of mixed origins, are they other? We are given little information about the main IV of the study, and this is problematic.

Line 179. Does Ethnicity only have two levels? What about the 'other' group shown on the graphs? What does it mean exactly?

Line 190. Although the main effect of ethnicity is not significant, there may be a trend there. Same comment as below.

Line 195. The main effect of Frame suggests that overall performance varied across males and females. Were RTs measured, in ordre to check for possible engagement effects? (i.e., longer RTs, coupled with better overall performance and lower illusion size?)

Line206. How is a second generaion Asian defined? Is it enough to have one (out of 4) grandparents of Asian decent to be considered a 2nd-generation Asian?

Line 314. This conclusion is somewhat surprising. A number of analyses suggest that the performance of the two cultural groups differ. In fact, there is no strong evidence for an absence of difference. the fact that the difference does not go in the direction predicted by what is called the 'culture theory' (making it sound as though there is only one possible account for cultural effects), does not necessarily mean that there is no effect. Rather, it may mean that if the effect shown here actually exists (and one cannot really decide one way or another), it cannot be accounted for by the social organisation theory.

Line 373. The discussion feels short, with no attempt to account for the cultural effect observed in the study, and little discussion about the gender effect observed.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

The responses to reviews are uploaded in a separate file.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Alastair Smith, Editor

PONE-D-22-10991R1Re-assessing the role of culture on the visual orientation perception of the rod and frame testPLOS ONE

Dear Dr. Liu,

Thank you for submitting your revised manuscript to PLOS ONE. Both reviewers are satisfied that their comments have been addressed, although you will see that Reviewer #1 has a couple of remaining points that are worth considering. I would like to invite you to address these in a minor revision. If I am satisfied that they have been appropriately handled then we may not require another round of reviews (although, of course, this cannot be guaranteed).

Please submit your revised manuscript by Nov 12 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Alastair D. Smith

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have addressed my previous comments, but I have a few more for this revised manuscript.

Overall, I feel that cultural studies should include participants within their cultural habitat for comparisons sake, rather than including participants of different generations in a country different than their own. Having said that, this is no implication to the significance of this study.

1. In the updated abstract, please use "white Western Europeans", rather than "white" participants, because at this point of the manuscript, the term has not been defined yet.

2. Page 5, lines 89-90: Please put the reference [9] after the 2D computerized test, not in line 90 citation [9, 10].

3. I feel that the authors included too many comments and even reference citations in the Results sections (3.1.1 SV Bias; 3.2.3 Generational Data); it is better to just report the findings in the Results section, and then leave the explanations for the Discussion section.

4. Why is the number of participants for Generational Data different in 3.1.2 and 3.2.3?

5. The authors state that they cannot offer an explanation for their paradoxical findings which contradicted their hypothesis and those from a previous study [Reference 6] that reported that East Asians were more prone to larger errors on the RFT, in comparison to their Western counterparts. Unexpectedly, other results also indicate that later generation Americans, which are quite immersed in American culture, displayed greater biases than the 1st generation Americans or non-citizens.

Whether methodology differences might have affected the results, specifically the RFT protocol, is not clear. Unlike Reference 6, participants in this study stood on a foam block while aligning the rod to vertical. This might be worth looking into.

Reviewer #2: I find that the revised version of the manuscript adequately addresses all the issues raised during the review.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

Reviewer #1: The authors have addressed my previous comments, but I have a few more for this revised manuscript.

Overall, I feel that cultural studies should include participants within their cultural habitat for comparisons sake, rather than including participants of different generations in a country different than their own. Having said that, this is no implication to the significance of this study.

1. In the updated abstract, please use "white Western Europeans", rather than "white" participants, because at this point of the manuscript, the term has not been defined yet.

Thanks, abstract was edited per the suggestion.

2. Page 5, lines 89-90: Please put the reference [9] after the 2D computerized test, not in line 90 citation [9, 10].

Fixed, reference moved per the suggestion.

3. I feel that the authors included too many comments and even reference citations in the Results sections (3.1.1 SV Bias; 3.2.3 Generational Data); it is better to just report the findings in the Results section, and then leave the explanations for the Discussion section.

We edited these sections to move some of the commentary from the Results section into the Discussion section, which helped to reduce redundancy.

4. Why is the number of participants for Generational Data different in 3.1.2 and 3.2.3?

Section 3.1 describes data from all the participants who completed the alignment rod and frame task. Section 3.2 describes the data from the subset of participants who also completed the rod and frame discrimination task.

5. The authors state that they cannot offer an explanation for their paradoxical findings which contradicted their hypothesis and those from a previous study [Reference 6] that reported that East Asians were more prone to larger errors on the RFT, in comparison to their Western counterparts. Unexpectedly, other results also indicate that later generation Americans, which are quite immersed in American culture, displayed greater biases than the 1st generation Americans or non-citizens.

Whether methodology differences might have affected the results, specifically the RFT protocol, is not clear. Unlike Reference 6, participants in this study stood on a foam block while aligning the rod to vertical. This might be worth looking into.

Thank you. We have revised our discussion per your suggestion, as follows (lines 425 – 437):

In our experiment, all participants were in control of the rotation in the alignment RFT. This should have produced the best possible performance of the white males. However, our data showed the opposite, that East Asian males performed slightly better than white males. Also, in our study, white participants got worse in their discrimination abilities across generations, while their Asian counterparts did not change. We do not have an explanation why our data contradicted theirs or, more generally, why we could not replicate their results. Apparently, our virtual reality experiment was different from theirs using a physical RFT apparatus. Our participants also stood on a foam mattress while performing the RFT. It is unclear whether this methodologic difference could be responsible for the different results. However, as noted above, we have replicated the frame effects similar in magnitude to those found in other studies using the physical apparatus and a 3D virtual RFT. Regardless, these methodological issues are worth looking into. But it seems fair to say that the earlier cultural effects may not be as robust as previously thought.

Reviewer #2: I find that the revised version of the manuscript adequately addresses all the issues raised during the review.

Attachments
Attachment
Submitted filename: Response to Reviewers_3.docx
Decision Letter - Alastair Smith, Editor

Re-assessing the role of culture on the visual orientation perception of the rod and frame test

PONE-D-22-10991R2

Dear Dr. Liu,

Thank you for submitting your revised manuscript. I am satisfied that the amendments you made adequately address the final comments and am, therefore, pleased to formally accept your submission for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Alastair D. Smith

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Formally Accepted
Acceptance Letter - Alastair Smith, Editor

PONE-D-22-10991R2

Re-assessing the Role of Culture on the Visual Orientation Perception of the Rod and Frame Test

Dear Dr. Liu:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr Alastair Smith

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .