Peer Review History
| Original SubmissionMay 20, 2020 |
|---|
|
PONE-D-20-13468 Incidental vocabulary learning with subtitles in a new language: Orthographic markedness and number of exposures PLOS ONE Dear Dr. Pérez Serrano, Thank you for submitting your manuscript to PLOS ONE. Two experts have now reviewed your manuscript. As you will see from their comments, both reviewers found merit in your research but also raised a number of questions that you will need to carefully take into consideration before the manuscript is ready for publication. The authors should pay particular attention to the relationship between their design and incidental learning, an issue which might require collecting new data. In sum, i am happy to invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Aug 10 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, José A Hinojosa, Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Thank you for stating the following in the Acknowledgments Section of your manuscript: 'This study was partially supported by grants RED2018-102615-T and PGC2018-097145-B-I00 from the Spanish Government, and H2019/HUM-5705 from the Comunidad de Madrid.' We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 'The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.' [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Comments on manuscript Incidental vocabulary learning with subtitles in a new language: Orthographic markedness and number of exposures I like the paper and the idea is interesting, but the experiment suffers from several problems that need to be improved before publication. The easy path would be running a second better controlled experiment. The procedure does not correspond to an incidental learning situation. Usually, exposures to linguistic stimuli are made through a single modality. In the case subtitled films, this is done by image, sound and text. In this case images (landscapes) were used, but they did not contain references to linguistic material. What then was the function of the images? It could have been done with text and audio only. The authors showed the target words by text, instead of the entire utterance that would be the logical choice. In this way participants' attention is now drawn to these words, so that learning is no longer incidental. The number of exposures and the spelling characteristics (pseudoword vs. nonword) are not manipulated through the items. There are very few items per condition. Only F1 is given. The tasks used for the assessment only measure recall and recognition but not semantic and orthographic integration. There are no examples of the materials: Do the sentences form a coherent text or are they unrelated sentences? Reviewer #2: This is a study simulating foreign vocabulary learning. The authors focus on the orthographic markedness of the new words and the number of exposures. The results reveal that both factors have a role on learning. The study uses a novel approach, consisting of the conjoint exposure to written and auditory information during learning, and may have practical implications for the field of second language acquisition. Thus, it has potential interest for the readers of PlosOne. I have several concerns, however, that preclude the publication of the manuscript in its present form. I list them in chronological order: Ecological experimental paradigm: The authors state that their paradigm mimicks incidental vocabulary learning in naturalistic learning contexts. Concretely, they compare the paradigm used here with watching television or videos with subtitles. This similarity is evidenced by the title of the paper “Incidental vocabulary learning with subtitles in a new language”. I do not agree, however, with this comparison. It seems to me that this procedure does not mimic ecological incidental vocabulary learning. In my opinion, being exposed to an audiotape that has not any relationship with a series of images (landscapes) that are displayed on the screen, where a single word in an unknown language is presented, is not very ecological. This is rather an artificial situation, different from watching films with subtitles, where the auditory and the visual messages are integrated. Therefore, the autors should temper their claims about the ecological nature of the paradigm. I wonder why the authors didn’t use a more realistic situation, in which the content of the soundtrack is integrated with the content of the visual scenes. I would like to know also why they didn’t present the written novel word (pseudoword or nonword) embedded in the Spanish sentence, as a way to facilitate the integration of its meaning. Participants: More information about the linguistic profile of the participants is needed. Considering that they are majoring in modern languages, they probably know several languages other than Spanish. Furthermore, they may have a high proficiency level in some of them. This information is relevant for two reasons. On the one hand, it has been demonstrated that bilinguals have a greater facility to acquire vocabulary in an unknown language than monolinguals (Kaushanskaya and Marian, 2009). This might explain the good performance observed in the recognition task (at least in the 4-8 exposures conditions). On the other hand, it is relevant to know if the letter combinations that are not allowed in Spanish (illegal bigrams) are legal combinations in any other of the languages spoken by the participants. If that is the case, this might have reduced the difference between pseudowords and nonwords for some participants. Materials/Procedure: -The number of items in each condition is very low. This is a 2x3 design, including a total amount of 12 words. This means that there are only 2 items per condition. I am aware that participants in this type of experiments cannot learn many new words, but this does not justify such a small number of items. In my opinion, this is the main limitation of the study. The authors might have used a more extensive training procedure, as other authors have done. Alternatively, they might have manipulated the frequency of exposure in a between-participants design. -The results obtained here with such a small number of items may be restricted to this particular set of stimuli. The authors have to carry out a by-items analysis to examine if the effects can be generalized over items. This analysis has to be included in the paper, together with the by-participants analysis. -All the participants were presented with the same 4 novel words in the 1, 4 and 8 exposures conditions. I wonder why the authors didn’t counterbalance the set of words included in these three conditions across participants. This would have been the most suitable approach to avoid any potential confounding effect due to differences in the difficulty to learn the novel word forms. -As a filler task, the authors used a N-back working memory task, where participants had to indicate if a given letter was presented 2 trials before. I wonder why the authors didn’t use a non-linguistic task (e.g., a N-back task where participants had to indicate if a given picture was presented “n” trials before). A task involving letters may interfere with the following recall and recognition tasks, decreasing performance. -The way in which the recall and recognition tasks were conducted was not the most appropriate. In the procedure used here, the recall of each word was followed by its recognition. In each trial of the recognition task, participants were presented with the correct word and with another word from the experimental setting (lure). Especially in the initial trials, this procedure involves an additional exposure to the words (the lures) before participants are asked to recall them in a subsequent recall trial. This may produce either facilitation or interference effects during recall. Such effects would be avoided if a two-steps procedure was used. Concretely, there should be a recall phase of all the items followed by a recognition phase of all the items. I would like to know why the authors didn’t choose this procedure, which is more common in this field of research. -The numbers included in the design and stimuli section (page 14) are rather confusing. The authors state that the soundtracks of each of the two videos consisted of 28 sentences in Spanish containing a total of 12 targets. I don’t understand where these numbers come from. There are 12 targets, 4 of which are presented once, 4 of which are presented 4 times and 4 of which are presented 8 times. If I am not wrong, this makes a total number of 52 sentences. -I would like the authors to include an appendix with the experimental sentences, or at least a table with some example sentences. -In sum, the rationale for the above methodological choices has to be provided and the limitations above mentioned should be acknowledged in the paper. Results: Recall and recognition accuracy are presented as percentages of errors. I would prefer that variable to be named “percentage of errors”, or “error rate”, not “recall/recognition accuracy”. Discussion: -According to the authors, the results demonstrate that words containing language unspecified letter combinations are better learned than words that are orthographically marked. However, this is not a general pattern. This is true only for recall, but not for accuracy in word recognition. The authors also state that the learning of pseudowords increases linearly with repetitions, while this is not the case for nonwords. Again, this is only true for recall. Exposure produces an advantage in recognition for both pseudowords and nonwords. The summary of the results has to reflect these differences between recall and recognition. -The authors have to discuss in depth those differences. In fact, the paper cited in the manuscript (Vander Beken and Brysbaert) reports an impairment in recall, but not in recognition (a true-false judgment test), for texts studied in L2 in comparison to L1. Apart from citing that paper, possible reasons for the different pattern of results between recall and recognition should be provided. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Incidental vocabulary learning with subtitles in a new language: Orthographic markedness and number of exposures PONE-D-20-13468R1 Dear Dr. Pérez Serrano, The reviewers were satisfied with your responses to their previous concerns. Thus, we’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, José A Hinojosa, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: (No Response) Reviewer #2: (No Response) ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: (No Response) Reviewer #2: (No Response) ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: (No Response) Reviewer #2: (No Response) ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: (No Response) Reviewer #2: (No Response) ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors did a very good job in this revised version, including a new experiment, and I recommend publication. Reviewer #2: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Ana Marcet Reviewer #2: No |
| Formally Accepted |
|
PONE-D-20-13468R1 Incidental vocabulary learning with subtitles in a new language: Orthographic markedness and number of exposures Dear Dr. Pérez Serrano: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. José A Hinojosa Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .