Peer Review History
| Original SubmissionMay 27, 2022 |
|---|
|
PONE-D-22-15213Effects of vocabulary test announcement prior to reading a glossed text on reading behaviors and vocabulary acquisition: An eye movement studyPLOS ONE Dear Dr. Kweon, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. All of the reviewers and I see the value of your research and recognize the contribution it can make to the field. However, Reviewers 1 and 3 highlight some serious concerns, which I share. Some of the reviewers concerns are provided in supplementary files. Please carefully consider all of the points that the reviews have made, both within the PLOS ONE system and in the uploaded documents. All concerns should be addressed in the resubmission of your manuscript. Please submit your revised manuscript by Sep 01 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Kathy Conklin, PhD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files. 3. Please change "female” or "male" to "woman” or "man" as appropriate, when used as a noun (see for instance https://apastyle.apa.org/style-grammar-guidelines/bias-free-language/gender). 4. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability. Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is an interesting study that explored how test announcement prior to reading would moderate the impact of glossing on learning of form and meaning of target words. The authors employed eye-tracking technology to measure the amount of attention driven to the in-text as well as text-margin target words, and their glosses. The learning was assessed in terms of form and meaning recognition and recall abilities. The results revealed that test announcement did not have significant impact on reading comprehension, but promoted attention to the text-margin target words and form recall scores. While this study certainly points out a meaningful gap in the literature and provides pedagogical insights on how to better utilize glosses in L2 reading instruction, there are issues that should be addressed to be considered for publication in the journal. More detailed comments are provided below. p. 3 Before explaining incidental and intentional learning here, I would recommend authors to briefly review and clarify the relationship between implicit/explicit language learning and incidental/intentional language learning. Plus, it is not that we can simply equate incidental learning as implicit learning. For instance, we do sometimes look up in a dictionary to search a meaning of an unknown word, while reading for pleasure with no liabilities. “However, during incidental vocabulary learning, frequent exposure to language input may take a long time to be connected to the acquisition of the vocabulary, the wrong meaning of words may be learned, if the learner is not provided with correct cues to help retrieve the meanings of unknown words from context.” >> citation please. p. 4 This section reviews only a few glossing studies in the context of incidental learning. - Hulstijn et al., 1996 - Ko, 2012 - Yanagisawa et al., 2020 (meta-analysis) - Kang et al., 2020 - Choi, 2016 Why is that? There is an extensive amount of research on the impact of glossing on incidental vocabulary learning, and I'm curious why the authors reviewed only these studies.. Plus, given that one of the purposes of this study was to prove if glossing indeed promotes attention to the glossed words (as well as the glosses), they would want to review more eye-tracking studies on glossing (that is, under the no-test-announcement condition, not just Choi (2016) and Kang t al. (2020). In the first paragraph of 2.2, Please provide more detailed explanation on the cognitive/ pedagogical mechanism in which glosses can promote incidental vocabulary learning. p. 5 2.3 This section reads like a patchwork, loosely listing the studies without a clear logical sequence. I would recommend the authors to make this section more organic and logical, demonstrating how they synthesize the methodological aspects and the findings of the reviewed studies for readers. "Many studies have quantified the glossing effect in incidental vocabulary learning, whereas relatively fewer studies seem to be done on the effect of glosses in the context of intentional vocabulary learning (cf. Ko, 1995; Montero Perez et al., 2018; Peters, 2007; Peters et al., 2009; Zuo, 2021)." >> Why do the authors think is the case? p. 6-7 Another a bit awkward transition.. The authors should make this section more condensed, synthesized, and logical. (e.g., Further, Furthermore, Afterwards, ….) This issue pertains to the manuscript as a whole, and in particular this section (pp. 6-7). p. 9 4.3.1. This is good information on the reading text, but please additionally add the lexical coverage (2K and 3K?) as well as readability index. "The Turkish names of the characters were changed to English names to make it easier for participants to read. For example, ‘Hikmet’ was replaced by ‘Hudson’, and ‘Halil’ was replaced by ‘Morgan’." >> Please add explanation for this with proper citations 4.3.2. "The reason that pseudowords were used as the target words is that the subject's prior vocabulary knowledge may affect the experimental results." >> Add citation please. More importantly, why were these particular words chosen? Please provide the conditions. For instance, why didn’t the authors control the part of speech of the target words? What about their task-essentialness (that is, were they important in successful reading comprehension)? p. 10 4.3.4. Why not form recognition? Given this was an input-based learning activity, I'd like to know why the authors did not measure form recognition. In the form recall test, what prompt was given? Were the participants provided with meanings? Or just 16 blanks? Or were the blanks provided within meaningful context? Please provide a sample item to help readers' understanding. 4.3.5 Please add more detailed information on the RC questions, not just their formats. For example, what dimensions of RC was measured? Main idea/ detailed information/ true-not true informaation/ finding synonyms/ etc. Also, what was the rationale for including two different types of RC questions? More importantly, were they allowed to refer back to the reading text while answering the questions? Or they had to rely on their memory? Why? What was the reliability? I would recommend the authors to share the text and the RC questions as appendix or supplementary item. p. 11 4.5. Without detailed information on the short-answer RC questions, this scoring method seems not very useful. p. 12 4.6. Please add information on how the raw eye-movement data were trimmed before conducting statistical analysis. For example, how were the outliers treated/ filtered out? Also, what statistical anslysis was used? Please provide detailed information on how the pre-processed eye-movement data were analyzed. Also, how were the different reading times across participants handled? This section lack too much important information that is necessary to replicate this study, so I would suggest extensive revision here. 5.1.1. d > 0.001 ??? >> d < 0.001 p. 13 “An independent-samples t-test was performed to analyze whether the time…” >> This exact wording is too repetitive. Results >> The results p. 15 The 2nd and the 3rd paragraphs are very repetitive and redundant. The authors would want to focus on interpreting the results in this section. Plus, there are studies that used eye-tracking technology to examine if glossing works. Were the target words necessary for comprehension? The authors would want to consider the task-essentialness of the target words. That is, if the target words didn’t matter (especially adjectives or adverbs), they could have felt only little need (Laufer and Hulstijn’s Involvement Load Hypothesis) to know the meaning of the target words. p. 16 "The difference between these results and ours might have occurred because recall and recognition (i.e., of forms) involve different cognitive efforts." >> Please elaborate more on this. "Our results reveal that vocabulary test announcement can affect which type of vocabulary knowledge can be acquired." >> I'm not sure if I can understand this part. The authors may want to revise it. "That is, test announcement can help the students to encode forms of new words, but that additional cognitive resources will be required to map forms to meanings of encoded words, or to consolidate form-meaning association of the encoded words." >> Glossing in and of itself, promotes learning of word meanings. Previous studies overall showed that glossing promotes learning of word meanings, rather than forms. To be more specific, when glossing is not provided, readers tend to inspect the text more intensively to infer the meaning of the unknown word, especially if the word is important in comprehension. When glossing is provided, they do not feel the need to search for the meaning, as the gloss is right there, and hence have no or even negative impact on learning word forms. Perhaps additional demands induced by the TA could have compensated this relatively weak/inhibitory impact of glossing on learning of word forms. The authors should review more studies on the impact of glossing on learning of word forms, and not to mention, Laufer and Hulstijn's Involvement Load Theory. w "We presented fruitful findings on and implications of test announcement prior to reading a glossed text in vocabulary acquisition." >> The authors would want to revise this sentence, especially the word choice "Fruitful." "Information about the type of vocabulary test might have changed the type of vocabulary that the participants learned." >> I am not very suer if the word "type" is recommendable. The authors would want to reconsider this term throughout the manuscript to enhance clarity. The authors would want to use the past tense when reporting what they DID or FOUND in this study throughout the methodology, results, and discussion sections. Reviewer #2: The researchers were able to address the research problem and discuss aspects of research from several parties. This was clear from the several procedures used to verify the glossing of immediate knowledge and delayed ones. Where the research problem emerged and an attempt to show the research gap in this research. The researchers proceeded scientifically in presenting the research ideas in all parts of the research. The researchers also used an academic language free of linguistic errors. The language used in presenting the previous related studies was relatively accurate and complete to the extent that it satisfies what is required in presenting opinions, facts, and previous results. Reviewer #3: Comments on “Effects of vocabulary test announcement prior to reading a glossed text on reading behaviors and vocabulary acquisition: An eye movement study” Some snapshots in the following cannot be displayed. Please refer to the attached file. The paper is in general well written. The research was carefully designed and the use of eye-tracking method is innovative. There are a number of issues, however, that need to be considered by the researchers. 1. Concerning form / meaning distinction It is good that the researchers, based on previous studies, went a step further to measure the effect of test announcement on form recall and meaning recall. The researchers, however, did no review literature about the form / meaning distinction in L2 vocabulary learning. Since form / meaning are key constructs in the research, there need to be more discussions about them in the literature review. 2. In the research, there are three ROIs. What are the reasons of setting three ROIs for each target word? Please state the rationale. Isn’t the bottom margin-target word a part of the gloss? 3. Why are there F2 words and F4 words? The frequency of the target words is not a variable in this research. 4. What are the purposes of carrying out a meaning recall test and a meaning recognition test? Please justify this. 5. Was the form recall test more like a memory test instead of a vocabulary learning test? 6. The scoring method for the meaning recall test can be improved since it seemed to be more flexible compared with the form recall test. The researchers are encouraged to try: 0 – incorrect; 1 – partially correct; 2 – correct. 7. Another issue is about the reading comprehension questions. Are they related to the target words? Explanations are needed in the manuscript. 8. Are the target words important for the comprehension of the text? This is to be explained in the research design. 9. Test announcement is one step to initiate L2 learners’ noticing of the target word in reading. Whether the words are retained or not depends largely on the learner’s subsequent processing of the words, esp. depth of processing. As the researchers reviewed in the manuscript, a number of studies have been done on the effect of test announcement on L2 vocabulary learning, it is suggested that in future research the researchers focus more on processing depth and the mechanisms leading to differential learning outcomes of word form / meaning. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: ALHARBI BADER Reviewer #3: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
Effects of announcing a vocabulary test before reading a glossed text on reading behaviors and vocabulary acquisition: An eye-tracking study PONE-D-22-15213R1 Dear Dr. Kweon, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Kathy Conklin, PhD Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-22-15213R1 Effects of announcing a vocabulary test before reading a glossed text on reading behaviors and vocabulary acquisition: An eye-tracking study Dear Dr. Kweon: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Professor Kathy Conklin Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .