Peer Review History
| Original SubmissionJune 2, 2021 |
|---|
|
PONE-D-21-18244 Number Transcoding in Bilinguals - A Transversal Developmental Study. PLOS ONE Dear Dr. Lachelin, Thank you for submitting your manuscript to PLOS ONE. I have sent it to two expert reviewers and have now received their comments back. As you can see at the bottom of this email, both reviewers think that the topic is interesting and noted the unique sample investigated. I concur with these points. However, the reviewers also raise several major comments. Notably, reviewer #1 is concerned with the theoretical framework of the study, which they do not find appropriate. The reviewer also has a number of suggestions for improvement. Reviewer #2 has major concerns regarding the analytic strategy and therefore suggests a reworking of the analyses. The reviewers have been very thorough and I will not reiterate here their specific points. Because I still see merit in your manuscript, I invite you to submit a revised version of the manuscript that addresses all the points raised during the review process. Note, however, that the revisions suggested by the experts are substantial and that I will send the manuscript back to the original reviewer. Please know that submission of a revision does not guarantee that your manuscript will be accepted. Please submit your revised manuscript by Sep 16 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jérôme Prado Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for stating the following financial disclosure: The first author is supported by the Luxembourg National Research Fund (FNR) (PRIDE/15/10921377) Please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." If this statement is not correct you must amend it as needed. Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. 3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide. 4. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option. 5. Please ensure that you refer to Figure 2 and 3 in your text as, if accepted, production will need this reference to link the reader to the figure. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer #1: The manuscript describes two number transcoding tasks – reading aloud and matching – done in two languages (German, French), in different age groups, in bilingual individuals. The study found two main effects: (1) An advantage of German (L1) over French (L2); and (2) Difficulty in French numbers above 60 relative to smaller numbers, presumably due to their vigesimal structure (e.g. 74 = soixante-quatorze, sixty-fourteen). These results are in good agreement with several previous investigations of verbal numbers and with common number processing models. The study design is good and the analyses are generally appropriate. I would therefore like to see this study published in PLOS ONE. My main concern is that in my opinion, the manuscript itself should be considerably improved. It seems to me that some serious fundamental rewriting is needed here, after which I will gladly recommend the article for publication. Major comments 1. The theoretical framing is poor, unfocused and sometimes incorrect. I do not refer to the important/impact of the study, because this is not a publication criterion in PLOS ONE. However, irrespectively of the question impact, the manuscript should still interpret the result in terms of relevant theory. - There is no reference to relevant cognitive models of number processing, although there are quite a few of those (McCloskey; Dehaene & Cohen; Butterworth & Cipolotti; Dotan & Friedmann; in a way, also Huber, Nuerk, & Willmes; and more). - The topic of this article is number transcoding, but for some reasons the authors chose to dedicate much of the theoretical discussions to other issues, which are only vaguely related – ANS, arithmetic, and language. Perhaps the two most extreme examples for this is that (1) the first page of the manuscript (!!) is simply irrelevant – except the last few lines, it talks mostly about ANS and brain regions, two topics that are only vaguely related to the article’s main point. (2) The first sentence in the abstract is simply incorrect. It says that the study examined the “analogic, verbal, and visual symbolic codes”, but the “analogic code” (ANS) was not really examined here. - Similarly, the selection of cited literature seems a bit odd throughout most of the manuscript (but in the Discussion it is good). There is a lot of published work on transcoding, but the article ignores much of this literature and cites literature from other domains, which is less relevant or hardly relevant. There is no citation at all of many relevant works by researchers who did a lot of theoretical work on transcoding, e.g., Michael McCloskey, Carlo Semenza, Margaret Delzaer, Marie-Pascal Noël, Xavier Seron, Laurent Cohen and more – including works that specifically addressed the base-10 vs base-20 issue. Even when talking about arithmetic, there are additional studies that specifically examined the role of the verbal structure of numbers and could be cited (e.g., Campbell & Clark, 1992; Gonzalez & Kolers, 1982; Noël & Seron, 1997). On few occasions, the manuscript cited general language literature as a reference to number-specific phenomena, e.g. references [49] [52]. I would prefer seeing citation of studies more specific to numbers. 2. The article’s main theoretical question requires the comparison of base-10 versus base-20 verbal numbers. To operationalize this, the authors took the French numbers above 60 as reflecting the base-20 system. This does not seem justified. In French, the syntactic structure of verbal numbers in the 60’s and 80’s is congruent with both systems (b10 and b20). Only numbers in the 70’s and 90’s are clear examples for base-20 syntax. I would guess that if you focus only on the 70’s and 90’s, your results will actually improve. Also, perhaps you may even be able to show that the 80’s are as easy as the smaller numbers – this could be a nice control for an artefact of number size (as opposed to syntactic structure, the effect you’re actually interested in). The manuscript seems to assume that numbers in the 80’s are cognitively represented as “20 times 4 plus X”, e.g., 83=20x4+3. Presumably, the reason is that the French word for 80 is “quatre-vingt”, “four-twenty” (although this is not explained explicitly). Although this argument has been made in past studies, it is not convincing at all – “quatre-vingt” is very likely to be one lexicalized value, even if its etymology is 20x4. If there is empirical evidence showing that 80 is represented in a decomposed manner in the relevant population, please cite it. If not, please remove this claim, or at least present it as an unsupported hypothesis. Note that even if you view 80 as decomposed 20x4, this still does not mean that the numbers 81-89 are in base-20, because the issue of 80 vs. 20x4 concerns only the tens word, not the way it is composed with the ones word. 3. The theoretical interpretation in the discussion is not convincing and should be improved. (a) The theoretical interpretation in lines 560-575 seems incorrect in several ways. - Lines 560-562: this is not in good agreement with commonly-accepted cognitive models of number production (e.g. McCloskey et al 1986). Phonologically, both “quatre-ving” and “dix-sept” are probably single lexical entries so these are two words, not four. I am not sure this was tested in French, but certainly you cannot claim the opposite as if it was a fact. - Even if we assume that French 97 requires activating 4 lexical entries, it is still not clear why the cost should be attributed specifically to interference (and not, for example, to the effort arising from the need to retrieve more words). - Lines 566-568, reference [58]: the example is completely irrelevant, and in this context, even a bit misleading. Of course, some cognitive interference effects exist. But it doesn’t mean that this is the case for numbers too. Especially since numerous studies show fundamental dissociations between the production mechanisms of number words and non-number words. (b) Lines 576-598, 623-629: it seems strange to interpret your findings according to the ADAPT model, because ADAPT is a model for number writing (verbal-to-arabic transcoding), and the task here is reading (arabic-to-verbal transcoding). You can use models of number reading instead. I don’t think this should disturb you because you don’t really rely on any particularity of the ADAPT model, you merely rely on the well-accepted, widely-supported distinction between lexical processing and syntactic processing in numbers. What your data shows is probably a phenomenon that was shown in many previous studies: numbers with complicated syntactic structure are harder to process than syntactically-simple numbers, and syntactic ability develops with age. I think it would be more appropriate to frame your claim in these more-general terms, rather than present it as if the results support a particular cognitive model – I don’t think they do. If I were you, I would just drop the interpretation in lines 560-575, stick with the second interpretation, and present the results as evidence for a syntactic-complexity effect (a conceptual replication of several previous studies), and for the development of syntactic abilities with age. But needless to say, this is of course totally your decision. Either way, I think that the manuscript will benefit from using the terminology “number syntax”. Although sometimes vague, this is standard terminology (certainly more standard than “transparency of power”) and it seems appropriate for your research question. (c) Lines 613 seem like a vague mixture of several phenomena/issues. I found it more confusing than clarifying. - Lines 613-614: your findings do not seem to be about language switching, but about familiarity with language. While I agree that language switching is probably relevant, I find this analogy more blurring than clarifying. At least discuss the difference between the two phenomena. - 619-620: the encoding complex model makes very specific assumptions about the types of information coded in language-specific way (in particular arithmetic facts). The language effect you have found doesn’t seem to support these assumptions – it merely shows that language, and familiarity with language, matters. Frankly, this effect is a bit trivial, and pretty much agrees with any number-processing model I am aware of. (d) Lines 630-638: your data doesn’t seem to support working-memory effects in any way. Certainly, difficulty in lexical retrieval does not necessarily imply a WM issue. 4. In the results section, some of the statistical analyses are described dryly, without any meaning/interpretation. Please add their theoretical implication. E.g. in p.15, the precise pattern of interactions with age seem to strengthen your theoretical claim about a progression of learning – why not say it explicitly right away? Especially in the summary paragraphs (lines 406-410, 495-503) I would expect that the text doesn’t just talk about factors and effects but also say something about the cognitive implications. Even when the results are interpreted, this is sometimes done separately from the result. E.g. the analyses of both tasks start by saying that all double interactions were significant, but these interactions are explained only later in the text. Please fix: unite each result with its interpretation. The comparison of the two tasks doesn’t seem to have any theoretical relevance and should probably be deleted (or at least pushed down to somewhere less central in the text). As far as I understand, there is no theoretical reason to assume that the performance in the two tasks would be similar, and we don’t learn any insights from this comparison. 5. Some of the terminology used in the manuscript is imprecise, non-standard or incorrect. - “Language of math acquisition” is a confusing and imprecise term. You did not manipulate the language of acquisition (=learning), you manipulated the language in which the experiment was done. But I certainly agree that the reason for this effect is likely to be LM1 vs. LM2. - The first task is neither “a production task” nor “number naming”, it’s reading aloud (it includes both visual input and verbal production). The second task would be better described not as a recognition task, but as a matching task. - “Transparency of power” is not a standard term in the number transcoding literature, so please explain it before using it for the first time. Perhaps avoid using it in the abstract. - When saying the performance is better in condition X, say better than what (e.g. p. 17 line 407) - The inversion in German is not between tens and units, it is between tens and ones (“units” = digits, “ones” = words). - “Verbal” and “visual symbolic” codes – the verbal code is symbolic too. - Lines 579-581: there is a confusion here between two meanings of the term “semantic”. In the ADAPT model (and in other models, e.g. McCloskey’s), “semantic” often refers to a central abstract representation of the number. The number size effect refers to semantics as the quantity associated with the number via the ANS. These are two completely different things. - “Analogic code” is a correct/acceptable term for ANS, but it is not standard. “Approximate” would be a more standard terminology 6. I would recommend using linear mixed model instead of ANOVA. It is more reliable, and also might improve your statistical results. 7. The quality of writing should be improved. - The manuscript should undergo an English language review. - The text is too long, please write more concisely. Just to give a few examples: (1) The issue of French>60 examines transparency of power is explained too many time. (2) The first paragraph in the results section can be cut into a short sentence. But there are many more. (3) The text describing the analyses with (p. 16) and without (p.15) z-scored are redundant and tiring. You can write the text once, and say you got essentially the same results with and without z-scores (with results of both ANOVAs in a table). Similarly, fig. 6 is redundant and can be removed. Same issue for recognition task. But I emphasize that these are just examples, please write the whole text more concisely. - Minor comments 1. The statistical analyses are described in detail, which is excellent, but because there are quite a few of them, I would recommend moving them to the results section. I completely lost track of the analyses while reading, and it was very hard to relate specific results to specific analyses. 2. Fig. 3 – the Y axis label says RT instead of accuracy 3. Fig. 4 – instead of o60 and u60, perhaps write something clearer, e.g. >60, <60 4. Lines 344/355 – I think there is an unintended paragraph break here. 5. There are quite a lot of ANOVA results. Consider putting them all in table/s instead of in the text – it will cut the text shorter and could make it easier to find the relevant stats. 6. Lines 344-351: to show that the German and French trends are different with respect to >60 vs <60, here would be the correct place to talk about the Size x Language interaction. 7. Line 390: how many 4-syllable numbers are there? Also, as far as I know, the relevant measure for word length is typically assumed to be the number of phonemes, not the number of syllables (Nickels & Howard, 2004, Cognitive Neuropsychology). 8. The particularity of the German language (tens-ones inversion) should be mentioned earlier on in the text. 9. All figures: measurement units “millisec” should be written only on axis label, not in the figure caption. 10. The introduction and discussion mention a transparency-of-power analysis for numbers above 70 but I think I didn’t see it in the results section, did I miss it? 11. Line 556: as far as I can see this is incorrect - the base-20 cost was not independent of age, it decreased with age (even if it existed to some extent in all age groups). 12. The reference to ADAPT in line 577 is incorrect, [60] instead of [64]. Please double check all references. 13. Lines 180-182: this claim does not seem correct – at least, this is not the common assumption for how number transcoding works. Certainly, you cannot base this claim on reference [52] not from the number domain. Reviewer #2: In this study, the French and German transcoding abilities of children in Luxembourg, who are taught in German in primary school and in French in secondary school, were measured in different age groups. The Luxembourgish multilingual background makes this an interesting group to study. However, the study has several shortcomings. First, it is difficult to draw any definite conclusions without a comparison group, because language characteristics, age and educational experience are all confounded with each other. The difficulties of French are elaborated upon in much detail, but the German system is barely discussed and it even looks like a section on this has been removed (with the appropriate references still present in the reference list), giving the impression that German is much easier than French while in reality the picture is more nuanced than that. But most problematic, the analyses are messy, both in the terminology that was used (‘groups of contrasts’), in the analysis plan and presentation of the results, and in fact I’d argue that ideally these data require a mixed effects model, not an ANOVA. This means that a reanalysis is necessary and at present it isn’t possible to review the results in detail. Perhaps with a thorough reanalysis that also includes monolingual control groups it would be possible to draw conclusions but for now I have to recommend to reject the paper. I explain all this (and some more comments) in more detail below. line 44-46: ‘Since multilinguals are outnumbering monolinguals across the globe [12],the question of how numbers are processed and transcoded in different languages is of crucial importance.’ Why? Undeniably there are a lot of multilinguals but that fact doesn’t necessarily make this particular research question crucially important. Please either remove or explain the relevance of the research question for all those multilinguals. This is a bit related to the discussion, see also later. If this is fundamental study that is perfectly fine, but don't pretend it also has immediate applications or benefits. line 75-78: This section would benefit from a clearer explanation of the different counting systems in German and French for those unfamiliar with those languages. Now the base-10 vs 20 is highlighted, but first I’d argue that the base 20 system in French is only visible for the 80s and 90s and not below (or else 62 would be 3x20+2 which is not the case). I’d say that the true base 20 starts at 80, as the 60’s follow the regular base 10 system and the 70’s are neither (as they are 60+10, 60+11 etc). And then there are the irregular number words for 11-16. Line 77 ‘only eighty decades are vigesimal’ probably supposed to mean ‘only the decade 80’? Note by the way that also languages like English and French are not as transparent as Chinese in the base 10 system. If they were, a number like 60 in French would be ‘six dix’ (six ten) instead of ‘soixante’. And please also elaborate on differences between the French and German counting system. The explanation of the base 10 vs 20 system is very elaborate but the decade unit inversion in German is barely mentioned, so short that I doubt whether a reader who is unfamiliar with languages that have this inversion even understands what it is. And what where the results from references [18] and [51]? And I wanted to recommend some more papers on this phenomenon but I already found a few in the reference list without referencing to them in the text [65-67]. Was this part deliberately taken away to give the simplified impression that French numbers are always more difficult than German numbers? Decade unit inversion makes transcoding more difficult. This could become especially visible in the The ADAPT model of number processing is mentioned in the discussion but perhaps this could be already done in the introduction, with an integrated approach discussing the difficulties of all languages. p. 4 line 82. ‘Analogously’ but what follows is not analogously, it is in contrast. The present study – Please, for a complete picture, describe what language children in Luxembourg speak before going to school. Luxembourgish, German, French? Many children speak Luxembourgish, that is highly similar to German, right? This may especially be relevant if parents stimulate number activities. I see that it follows in the methods section- a lot of different languages and French was excluded. Please elaborate on these choices and potential effects of this choice. In fact, the children with French as native language may form a very interesting group (although a bit small in size if there is age variation) to disentangle L1 from ML1 influences. p.8 I understand how numbers below 60 are a purer indication of an effect of language of math acquisition (although confounded with decade-unit inversion) but this doesn’t stop at 60, sure numbers above 60 are also affected by this, not just by an effect of transparency of power. 70 makes much more sense than 60 though, because in French only 70 and above cannot be transcribed by merely writing the numbers that you hear, the numbers in the 60s can. It is stated that the analyses were also performed with the cut-off at 70 but were there any relevant differences? Furthermore, the study makes an attempt to identify effects related to the language structure and effects related to language of acquisition but the two are confounded while a control group is lacking. Any effect in favor of German can be due to L1/math language or to language structure. It would be helpful to compare the results to monolingual French and German control groups (and as mentioned above, the native French speaking children in Luxembourg), not just to mention this in the discussion but actually add those groups. Design and statistical analyses: it’s not explained what was done with separate stimuli. How were aggregate scores determined? Why not run a mixed effects model instead of ANOVA? The afex package that was used can handle that as well and you can estimate the effects more precisely because it can also handle random slopes across participants (and items). Not taking that into account can lead to alpha inflation. Similarly for accuracy, which is bounded by 0% and 100%, ANOVA typically gives the wrong results, often spurious significant results but p-values can also be too low. Especially when values are close to the lower or upper boundary (which is the case with these very high accuracy rates close to ceiling) because ANOVA requires unbounded data. You need a model for proportional data such as a binomial mixed effects model in that case. See for instance Jaeger, T. F. (2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of memory and language, 59(4), 434-446. But also for the RT data a huge benefit of a mixed effects model is that you can enter all stimuli separately and you don’t need to calculate averages per condition, thus making maximal use of the available information. Do note though that mixed effects models aren’t easy, and should be carried out appropriately with sufficient knowledge, or else the results may be off as well. Analysis plan: explain the dependent variable. Why speak of ‘groups of contrasts’ instead of just ‘contrast’? Moreover, I’m a bit confused about the terminology here because a contrast is applied to compare the levels of a single variable in a pre-specified way. For example, if you have 4 groups, comparing group A and B to group C and D, and then comparing group C to group D, that would be a planned contrast. In the context of the present paper, the term contrast seems to apply to just the main effect of a single variable (with only two levels). There is no need to specify all this. A three- or four-way ANOVA automatically gives the effect of each variable, and given that for most variables there are only two levels, this effect automatically tests if these two levels differ. No contrast necessary. Only age has four groups so here a contrast could theoretically be applied, but this is not specified. You do need to explain in the analysis plan which interactions you are going to test and how you are planning to proceed if the interaction is significant. It is a common procedure if one interaction is significant, to decompose this interaction by going back one level, so if an interaction of A*B is significant you test the simple effect of B for each level of A. Or if A*B*C is significant, test interaction A*B at all levels of C. p.13 why include an analysis with so many interaction terms if you ignore the results of those interactions anyway? You only look at one main effect. Note that many of the interactions are actually significant, meaning you can’t interpret a main effect, but you have to proceed with caution. Significant higher order interactions mean that the pattern is more complicated than any of the lower order interactions (or main effects) can capture, so their results can’t be interpreted isolated from the rest. It would make more sense to decompose this significant four-way interaction by a series of follow up analyses: first three-way interactions, then two-way, as mentioned above. Along the way this automatically captures all the intended other effects (of language, number size, type of task and age). Then some inconsistencies like in line 332 ‘Finally, the triple interaction between age group, language and number size was significant for RT and CR’. But the discussion says (line 556): ‘The results reveal that the cost entailed by processing base-20 numbers is independent of age and the associated degree of language.’ But it’s not independent of age, it becomes weaker over time, that’s what the three-way interaction showed. The cost did not disappear entirely but it did wane. Line 670 ‘Our results have practical implications’, this looks forced. What follows is very general ‘linguistic factors have to be taken into account when instructing and evaluating children’. That may be true but it doesn’t follow from this study, it may be more relevant then to look at international comparisons: does Luxembourg drop in rankings after children switch to French? Then I’d see the issue, but in this study, how bad is it if someone is a few milliseconds slower in writing down a certain number word? And if it is bad, how can a teacher take this into account when instructing and evaluating children and aren’t they doing that already? Please specify the practical implications of this particular study (or argue that this is a fundamental study and as such there are no practical implications, which is perfectly acceptable by the way. Not every study has practical implications). Minor points p. 3 line 47-48: ‘The simplest declination corresponding to bilingualism’. What is declination supposed to mean here? Is it form perhaps? p. 4 line 80 unusual use of ‘peers’, peers are children from the same environment, commonly classmates in a school context, not children from different countries. P. 6 line 121 what is LM-? The language in which mathematics was not learned? Please define. Correct terminology is two-way or three-way interaction, not double or triple. Line 659: ‘It is, however, noteworthy that math education extended for one year longer in LM2 (7 years of primary education) than in LM1 (6 years of secondary education), which might help to balance the frequencies in both languages.’ This only makes sense if the words primary and secondary were reversed. But it may help to explain the Luxembourgish situation in a bit more detail in the introduction. [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-21-18244R1Number transcoding in bilinguals - a transversal developmental studyPLOS ONE Dear Dr. Lachelin, Thank you for submitting your revised manuscript to PLOS ONE. I have sent it back to the two expert reviewers who evaluated the first version. As you will see below, both reviewers are quite positive about the changes you made to the manuscript and think that it has considerably improved. I agree with them. Both reviewers, however, suggest a number of additional changes that may improve the manuscript further. I will not detail here the different points as the reviewers are very thorough in their evaluations. But I do encourage you to take into account these suggestions in another round of revision. Please submit your revised manuscript by Feb 18 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jérôme Prado Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer #1: 1. The authors added a discussion of theoretical models, following my request. This is big improvement. In the discussion section, the theoretical relation with the model is good in my opinion (see only minor comments below). In contrast, the presentation of models in the introduction still feels a bit out-of-context. I didn’t expect a general summary of theoretical models of number transcoding, but a more concrete explanation of how these issues are related with the present study. 2. Lines 104-105: why are 70’s a particular case? 3. Line 107: I did not understand the Belgian Wallonia dialect, perhaps elaborate. The 80’s are same as in France-French, but what’s the difference? Do they say septante and nonante? 4. Lines 268-269, line 341: was z-scoring done separately for each age group? 5. Fig. 1 seems to me unnecessary. It could be easily explained in the text. For your consideration. 6. Lines 296-301: you wrote precisely which conditions will be compared, this is excellent, but please write also the specific predictions. Don’t leave it to the reader to guess. 7. The model description in lines 304-310 is confusing. You talk about what you did and what you intended to, going back and forth between the two. Perhaps just write what your model actually was. Then, if you want, you can tell about additional things you tried but failed (personally I feel this is neither needed nor common, but it’s up to you). This should be an extremely simple paragraph to read, but I found myself having to re-read it. Similar issues in lines 346-351. 8. The statistics is not sufficiently ordered / detailed. I will not go through each analysis, because there are many of them. I only provide examples here, but please fix these issues in all analyses, not just the examples I give here: - Define the LMM variables fully and explicitly. E.g. was age a categorical or numerical factor? If categorical, specify the levels. Were Subject and Item defined as random factors (they should have been)? Which variables were within/between subjects? - Write statistical results either in a table or in the text, no need for both. For example lines 312-319 vs. Table 1. Lines 353-356 can be simply deleted. - When talking about follow-up analyses, write what the statistical test was and its result. E.g. line 314, lines 326-327, and more (which statistical test does the z stand for? You use it a lot, perhaps you wrote somewhere in methods but I can’t remember all the details). - When the variable had 2 possible values, or for 2 x 2 interactions, describe the direction of the results in the text (e.g. lines 312-319, effects of Number Size and Size-Language interaction, and the info is missing in several other places too). - For each analysis, I’d recommend presenting the interesting effect first, and the unimportant/trivial/boring effects later. You sometimes start with the boring one, and this is… well… a bit boring. - Linear mixed models: how was the p-value computed? There are number of ways to do this in LMM, explain which one was used. - Perhaps also explain Table 1, 3rd column. Degrees of freedom are typically integer. I know that in some cases they may be floating point, but it may be a good idea to say something about why this happened or what they mean. - Use standard terminology to describe the LMM. E.g., say random factor (with or without random slopes) instead of other terminology, e.g. in lines 375-376, which I admit I did not understand. - When relevant (e.g. in follow-up analyses), specify whether the p values are one-tailed or two-tailed. 9. Line 343-344: interesting and important point. But please explain why this is important. 10. Line 302: I assume that when analyzing reaction times, you removed the incorrect-response trials? This should be the case, as incorrect trials cannot be expected to exhibit the same RTs. Same issue in the matching task. 11. Lines 397-403 – the statistics is not written clearly, and I suspect it’s also not optimal. You write that the hypothesis on language of acquisition was not supported, but I was not convinced this is correct. I suspect that if you analyze all age groups together, of course limiting to numbers < 60, you will get a significant effect. Certainly, I wouldn’t present it as if the effect existed only in 5th grade and nothing at all for older ages (line 439). You have very nice data, no reason to undermine it. This is also a more-general issue about follow-up analyses: you don’t have to run t-test (or whatever similar test it was) on small portions of the data. Why not just run LMM on the relevant subset of data? 12. The detailed analyses in the annex are interesting. I think it would be nice if mentioned them very briefly in the main text – perhaps just say the main conclusions and reference the annex. When I read the previous manuscript version I was worried about these issues, other readers may feel the same and you have good answers. Also, some of the things you wrote in the response to review, which were correct and important in my opinion, may be added to the annex (currently it’s stats and data, without much conclusions). E.g., lines 507-509 may be a relevant place to mention this. 13. Line 492 claims that number matching is transcoding from verbal to visual. This is incorrect. You can’t know which transcoding direction the participants use in a number matching task. 14. Please write in supplementary material files which task they refer to. 15. Line 493-494: the finding that the transparency of power effect on z-scored RTs remains stable across age is interesting. However, you did not say which data supports it. In my opinion, the critical analysis that supports it is the absence of triple interaction in the z-scored data. So if you want to reach this conclusion, you should mention the triple interaction issue in the results section (maybe even move this z-scored analyses into the main text). 16. Line 497-515: I think you propose an interesting idea – that the difficulty in 70-99 may arise either from syntactic complexity or from morphological-retrieval complexity of these numbers. However, I was not convinced by your claim that the former interpretation necessarily relates to ADAPT and the latter necessarily relates to Dotan & Friedmann. I think that both models can accommodate both interpretations. 17. The idea of proactive interference (line 515) seems far-fetched. Retrieving 4 morphemes instead of 2 may be difficult for several different reasons, I am not sure I see a reason to point specifically at PI. In any case, Campbell’s and De Visscher’s studies on multiplication talk about a scenario quite different – not interference of single words because they are numerous, but of multi-word multiplication exercise because they are similar. The analogy seems to me more misleading than illuminating. 18. Line 543: presenting number reading as a form of free recall, or the matching task as a form of familiarity judgment, seems far-fetched and perhaps even misleading. I totally agree with you that the tasks have some resemblance, in the sense that the former two require unlimited retrieval, whereas the latter two require verification (lines 544-548). But you can say just that, no need to imply that the tasks are more identical than they really are. 19. Lines 576+: another limitation may be that it’s hard to disentangle language of math acquisition from an alternative interpretation that assumes intrinsic differences between German and French (“French is just harder”). Reviewer #2: I read a revised version of the manuscript and first I applaud the authors for the endeavor to greatly rewrite the work including a complete change of the analyses. That is a large step that undoubtedly took quite some time but it is definitely a large improvement. I noted that reviewer 1 is much more knowledgeable than me on the theoretical details. It looks like that improved a lot too but reviewer 1 is probably much better able than me to judge that (if also rereviewing the manuscript). I do still have some remaining questions, mostly about the analyses. p. 4-5 for the reader unfamiliar with those languages it would be helpful to give an example in words, not just in formula of 10*x+y (and also define x and y). You do this for French now but not for German (I’d also give the example both in the original language and its counterpart in English). I also doubt if ‘transparency of power’ is the best term. It sounds nice/interesting but it’s only the names of the tens that are affected, not the hundreds or thousands (admittedly, it returns for tens of thousands, but still). So isn’t it just ‘transparency of tens/decades’? Line 173 ‘These results support the above-mentioned TCM stating that precise numbers are encoded in a language dependent format [63].’ I was under the impression that the results mentioned above all related to studies that offered math in a verbal format to find differences in language of presentation. For instance, the text speaks of for instance ‘problems presented in the LM+’. But if this is the case, the conclusion above cannot be drawn. The use of a verbal context means we can’t know if the precise numbers (by the way, does ‘precise numbers’ refer to exact quantities or symbolic numbers?) are stored in a language-dependent or -independent format. Line 177 ‘However, they agree with recent reports from the bilingualism literature that academic knowledge acquired in one language is not (or difficultly) transferable to the other language [55].’ That is a bold statement! That basically says I can’t use the knowledge I learn in English in my native language? Luckily this is not true. This study says that there is a switch cost between languages in math problem solving. A switch cost in mathematics is quite far away from this conclusion that in general academic knowledge learned in one language is not transferable to the other language! Together it would be nice to see a better paragraph explaining the present research question to earlier knowledge. What is it that we don’t know and how does study contribute to filling that gap? Line 212: The two tasks might thus reveal a somewhat different result pattern, as already observed in Van Rinsveld et al. [69]. Please elaborate on how. Present study: I said this before, when describing the population also describe the mother tongue of the children and a bit more of the language background in Luxembourgh besides language in the classroom. Specifically it is relevant to know and possibly not widely known by the audience that Luxembourgish strongly resembles German. So one may argue that for the 70 German- and Luxembourgish speaking children, LM1 and L1 are (virtually) identical in terms of number words, whereas for the other 27 this isn’t the case. That means there are two linguistically very diverse groups of participants. It would at least be relevant to know at what age the immigrant children had started learning German and French. This information is also relevant because in the way the study is framed now, the youngest age group wouldn’t be able to do the task in French at all because they wouldn’t know it yet. But they do. But how well? And to what degree can all results be explained by just very poor proficiency in one group that hasn’t properly been taught French at all? Line 265. There are 2 sets of 5 practice and 14 test stimuli but the experiment lasted 45 minutes. That sounds extremely long for this task. If this test was part of a larger test battery please mention the context. Line 242 still makes the cut at 60 instead of 70. (there are no 14 numbers above and 14 below 60 in the set by the way. There are 4 from each decade). Also explain this decision to leave out the 60 numbers earlier than the results section (it’s not a result, it’s a methodological choice). Line 285. Have you considered post-error slowing (the ‘oops’ effect)? It may be wise to remove RTs after an error too. Could you give some descriptive statistics? Like M and SD of RT/accuracy per task, broken down by the relevant factors, so by age group, language and number size. 306 we aimed to model the individual variability, ideally considering individual differences (i.e. Subject) and age group (i.e. Age) related differences. Furthermore, we aimed to model per-item variability (i.e. Item), particularly related to language. I’m a bit confused here on what exactly you did especially with age group. Is this about random intercepts or random slopes? Slopes for what? And you modeled age group as a fixed effect already so you can’t add a random effect for it too, so it makes sense that that didn’t work. So what did the model syntax look like exactly? It sounds like it was something like RT~Age*Language*Number Size + (1|Subject) + (1+language|Item)? Or also (1+language|Subject)? If not, why no random slope for language per subject given that you say you run a maximal model? Nd could you tell which method you used to obtain p-values? Conditional F-tests with Kenward-Roger or Satterthwaite corrected degrees of freedom probably? Lines 314, 325 and also in later sections. Specify how you did your follow-up analyses when applicable (and what were the resulting statistics)? Explain what kind of analysis (the same?) on what kind of subset of the data. I see no more F tests but z-scores, if these are Wald tests from mixed effects models, those aren’t very reliable. Line 347 and beyond, what do you mean that the model did not fit? Do you mean that it did not converge? Why specifically drop age here, it seems the most relevant factor? I also learned that dropping a random slope is the very very last thing one should try as it greatly reduces p-values (so it inflates significant findings). https://academic.oup.com/esr/article/35/2/258/5306121. Now non-convergence can be a beast but other solutions to solve it do exist. This is what I learned to try, in this order: – Most recent package versions (particularly lme4)? – Center instead of standardize (or vice versa) cont. predictors – Increase number of iterations – Restart model fitting from previous (unconverged) estimates – Different optimizer(s); compare estimates from many different optimizers; (compare to) brms model (Bayesian model) - Simplify your model, Barr et al.: remove: (a) random correlations (b) random intercepts (c) random slopes; last resort, try to avoid that! By the way, alternatively I could also imagine leaving accuracy out altogether because of its ceiling effects. Line 358 in order to explain the interaction language * number size you give the results for French but also give the contrasting results for German (I guess no sig difference? But I shouldn’t need to guess.)? You need them both to understand the interaction. p. 17 I’m a bit surprised that the language difference is so weak given the highly significant effect in table 3 and also the large differences in the figures. Is this correct? The analyses with only 4 syllable words made me wonder how to count syllables in French reliably given that so many of them are silent. If I look it up there seems to be consensus that silent e’s at the end of a word don’t count as syllables meaning that many words are one syllable shorter. Concerning this language difference in the verbal to visual task: isn’t German also easier in the sense of at which point you can already eliminate multiple choice options on the go? If you hear ‘vierund…’ you can already exclude the +1/-1 and the +11/-11 answers, leaving only two possible options halfway through the word. For French, specifically for the large numbers, hearing ‘quatrevingt…’ may still leave 3 or 4 options open halfway through the word. Minor points Line 151. comparable results than for problems presented --> comparable results to problems presented. Also in line 194. Line 161/ who had either learned arithmetic in English or Spanish --> who had learned arithmetic in either English or Spanish. Line 227 switches to French (LM2) after the 7th grade --> after 6th grade or in 7th grade. Line 358 says ‘40s and ‘40s instead of ‘50s. Quite some typos in the supplementary table with written out number words like ‘soixantetroi’, ‘siebenndneunzig’, etc. [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
PONE-D-21-18244R2Number transcoding in bilinguals - a transversal developmental studyPLOS ONE Dear Dr. Lachelin, Thank you for submitting your revised manuscript to PLOS ONE. I have sent it back to the original reviewers. You can see their feedback below and attached (for reviewer #2's comments). As you can see, reviewer #1 is happy with your revisions and has no further comment. Reviewer #2, however, raises one important statistical point that you need to consider before the manuscript can be considered for publication. I would thus encourage you to address the reviewer's comment (as well as the reviewer's other minor points) in another round of revision. Please submit your revised manuscript by May 15 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jérôme Prado Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer #1: All my comments have been addressed. I just found one typo -- line 378, “suject” should be “subject”. Reviewer #2: (No Response) [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.
|
| Revision 3 |
|
PONE-D-21-18244R3Number transcoding in bilinguals - a transversal developmental studyPLOS ONE Dear Dr. Lachelin, Thank you for submitting your manuscript to PLOS ONE. I have sent it to a reviewer of the previous version. As you will see below, the reviewer is still not satisfied with the way you dealt with the statistical analysis. I will give you a final opportunity to respond to the reviewer, either by modifying your analyses in ways suggested by the reviewer or by explaining why you chose another analysis strategy. I will make a decision upon receiving your revised manuscript and response letter. Please submit your revised manuscript by Aug 11 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jérôme Prado Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: No ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: Unfortunately, the one important point that I made the previous time was not solved. The previous time I recommended to redo the analyses with the inclusion of random slopes. The authors tried this but it looks like they immediately removed most of them upon a singular fit error, without trying other approaches. Now I know that singular fit errors can be very difficult. But removing random slopes is exactly the strategy that Barr et al. explain to avoid at all cost. This is in the reference I sent the previous time (Barr, Levy, Scheepers, & Tily, 2013, page 276) and I explained elaborately in the previous review and in the papers I recommended so I won’t repeat myself here. Alpha inflation is thus still a potential problem. Barr et al. give plenty of alternative options that should be tried first, on p.276. Follow these steps, or give an argumentation of why these steps were not taken. Hopefully the results will still be more or less the same and then it is only a minor revision. But it could also be a major revision depending on what happens. I’m also still missing the coding scheme that was used. Was it sum to zero coding (= effect coding) coding, or dummy coding (= treatment coding)? The contrast matters for the correct interpretation of the main effects. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 4 |
|
Number transcoding in bilinguals - a transversal developmental study PONE-D-21-18244R4 Dear Dr. Lachelin, Thank you for this last version of your manuscript. I carefully read the manuscript and your detailed response to reviewer #2. In my opinion, you adequately answered the statistical issue raised by the reviewer. I am therefore pleased to provisionally accept your manuscript for publication in PLOS ONE. Note that it will only be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Jérôme Prado Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-18244R4 Number transcoding in bilinguals - a transversal developmental study Dear Dr. Lachelin: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Jérôme Prado Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .