For languages other than English there is a lack of empirical evidence about the cognitive profile of students entering higher education with a diagnosis of dyslexia. To obtain such evidence, we compared a group of 100 Dutch-speaking students diagnosed with dyslexia with a control group of 100 students without learning disabilities. Our study showed selective deficits in reading and writing (effect sizes for accuracy between d = 1 and d = 2), arithmetic (d≈1), and phonological processing (d>0.7). Except for spelling, these deficits were larger for speed related measures than for accuracy related measures. Students with dyslexia also performed slightly inferior on the KAIT tests of crystallized intelligence, due to the retrieval of verbal information from long-term memory. No significant differences were observed in the KAIT tests of fluid intelligence. The profile we obtained agrees with a recent meta-analysis of English findings suggesting that it generalizes to all alphabetic languages. Implications for special arrangements for students with dyslexia in higher education are outlined.
Citation: Callens M, Tops W, Brysbaert M (2012) Cognitive Profile of Students Who Enter Higher Education with an Indication of Dyslexia. PLoS ONE 7(6): e38081. doi:10.1371/journal.pone.0038081
Editor: Kevin Paterson, University of Leicester, United Kingdom
Received: February 14, 2012; Accepted: April 30, 2012; Published: June 13, 2012
Copyright: © 2012 Callens et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was made possible by an Odysseus research grant from the Government to Marc Brysbaert. For further details, see: http://www.fwo.be/Odysseusprogramma-huidige-detail.aspx?ID=fcdcbebe-d2a3-46c3-8393-f2e820b24664. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
An increasing number of students with dyslexia enter higher education, most likely due to better assessment, guidance and remediation in primary and secondary education –. This creates a need for information about the characteristics of these students and the best ways to support them. Higher education differs significantly from primary and secondary school. At this age education is no longer compulsory and students have a much wider range of options (certainly compared to primary education, which in most countries is inclusive, with nearly all children given the same curriculum). Therefore, dyslexic students entering higher education can be expected to be a select group, with better than average coping skills and possibly less comorbidity (for the issue of comorbidity in dyslexia, see –).
Still, there is a need for scientific evidence about the cognitive profile of students with dyslexia in higher education, particularly for non-English speaking countries. There are a number of manuals about adult dyslexia and dyslexia in higher education (e.g. –), which contain valuable information for students with dyslexia and their counselors and tutors, but they mainly base their information and recommendations on clinical and educational practice and they focus on the state of affairs in English-speaking countries.
Because of the scarcity of scientific data, at present there are no generally-accepted guidelines, regulations, and standards for compensatory measures. Instead, the clinical experience of the local office of disability services and their considerations tend to prevail . As a result, the special arrangements differ between institutes and are not appreciated by all lecturers. In the absence of theoretical and empirical evidence for the efficacy of such measures lecturers fear that reading disabled students could be beneficiaries of needless exceptions, which create extra work and may be unfair to the other students. Exceptionally, some even doubt whether students with a diagnosis of dyslexia belong in higher education, questioning their cognitive skills and work attitude. Given the current situation, these reactions are not completely without grounds. Sparks and Lovett –, for instance, found that offices of disability services in American colleges often give learning disability certificates without empirical justification, and that these certificates tend to be popular when they are linked to course exemptions in colleges with foreign-language requirements.
In the present paper we first discuss what is known about the cognitive profile of students with dyslexia in American and British higher education. Then, we discuss the reasons why generalization to other countries is not straightforward, and we present the data of a new study addressing the limitation.
The Cognitive Profile of Students with Dyslexia in Higher Education: Evidence from English
A first series of studies in the 1990s – addressed the question whether individuals with dyslexia continued to have problems with reading and spelling in adulthood, or whether remediation, teaching and reading practice in primary and secondary education were able to bridge the initial gap. They had a strong focus on reading and spelling and did not take into account other functions such as memory, attention, planning, and organization. These studies all came to the conclusion that dyslexia is an enduring problem with remaining suboptimal performance for reading and writing in dyslexic university students.
A particularly interesting study was published in the UK by Hatcher, Snowling, and Griffiths , because it investigated a broader range of skills. The authors compared the cognitive skills of 23 university students with dyslexia and 50 controls matched on verbal and non-verbal abilities. Participants completed 17 tasks assessing literacy (reading and writing), processing skills (perceptual speed, memory span, and arithmetic), phonological skills (spoonerisms and rapid naming), verbal fluency, verbal abilities (vocabulary test), non-verbal abilities (Raven matrices), and self-reported problems in attention and organization. Surprisingly, the students with dyslexia performed worse on all but the two tasks of general cognitive abilities (Wechsler Adult Intelligence Scale Vocabulary and Raven Matrices). They showed significant deficits in reading and writing and in reading-related phonological processes. Additionally, their processing rate was overall slower and their short-term memory spans were shorter. The students with dyslexia also had poorer arithmetic performance. Dyslexic students further reported more problems with memory (“I easily forget about what has been said”), attention (“I lose track in required reading”), effort (“I do not work to my potential”), affect (“I am sensitive to criticism”), and – less so – organizing and activating (“I have difficulty getting organized and started”). Based on these results, Hatcher et al.  doubted about the generality of the statement that higher education students with dyslexia have compensated for their problems.
Surprisingly, Hatcher et al.’s  rather pessimistic conclusion was not followed by other studies of the same standards. Subsequent studies again involved small numbers of tasks and small numbers of participants, making it difficult to obtain reliable estimates of the overall cognitive profile of dyslexic students in higher education –. A further step forward was made when Swanson and Hsieh  published the results of a meta-analysis. By applying such an analysis, researchers can distill a coherent pattern out of a multitude of heterogeneous, small-scale studies. Swanson and Hsieh’s meta-analysis was based on 52 published articles (but surprisingly without Hatcher et al.  and 776 comparisons of participants with reading disabilities versus participants without reading disabilities. An additional advantage of meta-analyses is that the results are communicated as effect-sizes. Swanson and Hsieh used Cohen’s d statistic. This is a standardized measure with very much the same interpretation as a z-score . As a rule of thumb, d-values larger than.5 have practical value and d-values larger than.8 point to a substantial difference between the groups. These effect sizes make it easy to translate research findings to the counseling practice. In contrast, individual studies have a tendency to focus on the statistical significance of their effects, often overlooking issues of power and practical importance.
Table 1 summarizes the findings reported in the meta-analysis of Swanson and Hsieh  as effect sizes (d) of differences between participants with reading disabilities and participants without reading disabilities. Positive values indicate poorer performance of participants with dyslexia; negative values indicate better performance of this group. For comparison purposes, we also include the data of Hatcher et al.  expressed as effect sizes. The convergences between both studies are clear. The top problems of adults with dyslexia are, not surprisingly: writing, reading, and phonological processing (non-word naming and spoonerisms, which involve exchanging the first sounds of two words, e.g., turning “Terry Wogan” into “Werry Togan”). The effect sizes are mostly larger than 1. In addition, reading disabled adults seem to be poorer in retrieving verbal information from long-term memory, either because this information has been processed less frequently or because of an additional weakness in individuals with dyslexia. One of the most robust findings in cognitive psychology is the (word) frequency effect, the finding that the efficiency of information processing depends on the number of times the information has been processed before (e.g. ). There was also poorer performance on arithmetic. This finding has recently been confirmed – and linked to the fact that arithmetic operations often depend on verbal fact retrieval, in particular for multiplication. This would explain why the difference between individuals with dyslexia and controls is larger for multiplication than for subtraction .
On the positive side, there were no differences of practical significance for general intelligence, problem solving/reasoning, cognitive monitoring, perceptuo-motor skills, auditory and visual perception, social and personal skills, personality, and neuropsychological measures (such as EEG patterns). Dyslexics slightly outperformed controls in visuo-spatial memory and tended to be rated more favorably by third persons than controls.
All in all, Swanson and Hsieh’s  analysis paints a rather clear picture of the strengths and weaknesses of adults with dyslexia. Still, two caveats should be kept in mind. The first is that meta-analyses involve a combination of very heterogeneous studies, with varying degrees of methodological rigor. This is particularly a concern when the number of studies on which an effect size has been calculated is rather small. Then, the presence or absence of an effect could be due to a single unrepresentative study involving a less valid test or a less representative participant sample. This issue is known as the apples-and-oranges problem in meta-analyses . Although the convergence between Swanson and Hsieh  and Hatcher et al.  is reassuring in this respect, one would feel more confident if the picture were confirmed in an independent series of studies given to the same groups of participants. The second caveat with respect to Swanson and Hsieh’s  conclusions is that they are almost entirely based on English-speaking adults. Only 5% of the data were from non-English studies. Below we discuss two reasons why generalization to other languages/countries is not straightforward.
Factors that may Prevent Generalization to other Languages
A first factor that may hinder the generalization of English findings to other languages, such as Dutch, is that languages differ in the difficulty of the letter-sound mappings. This feature has been linked to the time children need for reading acquisition – and also to the prevalence of dyslexia (; see also  and  for a discussion of the ways in which English differs from other languages and what impact this may have for dyslexia). Readers of languages with inconsistent mappings need more time to reach ceiling performance and also have higher chances of not succeeding. There are two types of mapping: from letters to sounds and from sounds to letters (particularly important for correct spelling but also involved in word reading; ). Alphabetical languages differ in the degree of complexity of these mappings – with English consistently being the most opaque for both directions, and Dutch more towards the transparent end of the continuum (the extent depending on the specific measure used).
In the absence of empirical evidence, it is not clear what to expect as a result of the language differences in letter-sound mappings. On the one hand, one could imagine that dyslexia would be less of a problem in a transparent language; on the other hand, someone with dyslexia in a transparent language may on average have a stronger deficit than someone with dyslexia in an opaque language (if indeed differences in prevalence of dyslexia because of language transparency exist).
Another factor that may limit the findings of Table 1 to English-speaking countries is the organization of the education system in different countries. In general, British-inspired education is characterized by ability-based selection at the entry together with a commitment to bring the selected candidates to a successful completion (the master-apprentice model). In many other countries, however, there are no hard entrance criteria for higher education, and selection occurs as part of the curriculum. In Belgium, for instance, everyone who has completed secondary education, is entitled to start whatever type of higher education they want (except for medicine and dentistry, where an additional entrance exam must be passed). As a result, the number of students starting higher education tends to be higher and completion rates are lower. In particular, the first year is considered as a selection year with less than half of the student succeeding. Classes in the first year, therefore, tend to be plenary lectures before large groups, and exams often are multiple choice.
Needless to say, ability-based admission criteria are likely to have implications for the cognitive profiles of the students, certainly in the first year of education. For instance, the observation that Swanson and Hsieh  and Hatcher et al.  found no differences in general intelligence or problem solving between students with and without reading problems may be a consequence of the fact that British and American universities select their students on the basis of SAT-scores (US) and A-levels (UK). Indeed, Lovett and Sparks  noticed that a discrepancy between general intelligence and reading skills in American university students with reading disabilities is often due to average text reading skills combined with above-average IQ. Such a pattern might be a direct consequence of the admission criteria. As these criteria are not present in Belgium, students with quite different IQ-scores can start the same degree and there is no built-in guarantee that students who present themselves with a diagnosis of dyslexia have the same abilities as students without such an assessment. On the other hand, because students with a reading disability know of the selection taking place in the first year of higher education, they may be less inclined to start a degree that is perceived as demanding, given the chances of failure.
The Cognitive Profile of Students with Dyslexia in Higher Education: Evidence from Non-English Speaking Countries
As stated before, literature on dyslexia in young adults who do not have English as mother tongue, is limited. In addition, in line with the first studies in English, they all focused on weaknesses rather than on the full pattern of strengths and weaknesses. Reid, Szczerbinski, Iskierka-Kasperek, and Hansen  ran a study in Polish on 15 dyslexic university students and 15 control students. As primary deficits they reported inferior word reading rate, pseudoword reading rate and text reading (both speed and accuracy). Spelling accuracy was also significantly lower. In relation to the underlying causes of dyslexia the authors observed impaired rapid automatized naming (pictures, colors, letters and digits) and phonological difficulties on a timed sound deletion task. However, group differences on spoonerism accuracy/time and sound deletion accuracy only approached significance. Similar results were found in a French study by Szenkovits and Ramus . Students with dyslexia (N = 17) performed worse than a control group on a text reading task when a combined time and accuracy measure was reported (but see Bruyer and Brysbaert  for difficulties with such combined measures). Orthographic skills were also significantly lower. Moreover, a combined RAN (colors, digits and letters) score revealed impaired automatized naming and working memory. Students with dyslexia also displayed phonological deficits. Wolff  examined Swedish university students (N = 40) on a range of reading, writing and phonological skills tasks. Significant differences with large effect sizes were reported for several tasks: spoonerisms, non-word reading and writing (time and accuracy), exception word spelling, and orthographic skills (time and accuracy).
The above studies agree with the English studies showing that difficulties in reading and writing and phonological impairments persist into adulthood. However, none addressed abilities beyond reading and writing. Furthermore, they were all characterized by small sample sizes, making it dangerous to interpret the effect sizes.
A New Study
Given the limitations of the available evidence, we decided to run a new study, which would enable us to compare the American-British profile (Table 1) to the Belgian profile. In order to do things properly, we took into account the following methodological considerations.
A problem with small-scale studies for applied research is the large confidence intervals around the obtained statistics, certainly in between-groups designs involving the comparison of two samples of individuals. Only recently have researchers become sensitive to the power problem related to small-group comparisons (e.g –). The smaller the samples, the larger the difference between the groups at population level must be before it can be found reliably in an empirical study. As a rule of thumb, to assess effect sizes as small as d = .4, one requires two groups of 100 participants (Figure 1). Samples of this size also result in reasonably small confidence intervals, so that the observed effect sizes can be trusted and compared to those from the English studies (Table 1).
This figure shows the power of a study with two independent groups as a function of sample size for different levels of effect size (assuming that alpha, 2-tailed, is set at.05). For a small effect size (d = .2) we would need two samples of 393 participants to yield a power of 80%. This means that there is 80% chance of finding a significant difference between the groups, given that an effect of this size exists at the population level. For a medium effect size (d = .5) we would need two samples of 64 participants to achieve this level of power. For a large effect size (d = .8) we need 26 participants per group.
To further improve the relevance of our study for offices of disability studies, we ran the study on the first 100 students who were entitled to special educational support on the basis of dyslexia by a learning disability support office in the city of Ghent (Belgium) and who were willing to take part in our study. For each student we then looked for a control student matched on age, gender, and field of study. The local support office serves Ghent University as well as other colleges of higher education (including technical colleges), meaning that we could examine a wide range of students.
Two hundred first-year undergraduate students of higher education participated in the study, both students of professional bachelors (in colleges for higher education) and academic bachelors (in some colleges for higher education and in university). They all attended higher education in Ghent, one of the major cities of Flanders (the Northern, Dutch-speaking half of Belgium) and had just graduated from secondary school. The group consisted of 100 students diagnosed with dyslexia and a control group of 100 students with no known neurological or functional deficiencies. All had normal or corrected-to normal vision and were native speakers of Dutch. Students were paid for their participation. The study followed the ethical protocol of Ghent University, meaning that students gave informed consent and were informed that they could stop at any time if they felt they were treated incorrectly.
The students with dyslexia had been diagnosed prior to our study by trained diagnosticians in accordance with the definition of SDN (Stichting Dyslexie Nederland [Foundation Dyslexia Netherlands] ). Because of the ongoing debate about the origin of dyslexia, the SDN uses a purely descriptive definition of dyslexia. In their guidelines dyslexia is defined as an impairment characterized by a persistent problem in learning to read and/or write words or in the automatization of reading and writing. The level of reading and/or writing has to be significantly lower than what can be expected based on the educational level and age of the individual. Finally, the resistance to instruction has to be confirmed by looking at the outcome of remedial teaching. Remedial teaching is considered adequate when it meets the requirements as stated in the “response to instruction” model  or the “response to intervention’ model . Also, the SDN definition requires ensuring that the reading and writing impairment cannot be attributed to external and/or individual factors such as socio-economic status, cultural background or intelligence. Students entering higher education in Ghent are assessed anew by the local support office (vzw Cursief) if their previous assessment is older than three years. All students with dyslexia had (sub) clinical scores (<pc 10) on a word reading test  and/or, pseudo word reading test  and/or word spelling test . These tests are addressed further in the text. All students with dyslexia had received individual tutoring in primary or secondary education for a period of minimum 6 months by either a speech-therapist or a remedial teacher.
All students with dyslexia who applied for special facilities at the local support office in the academic year 2009–2010 were asked to participate in the study until we had a total of one hundred. To find a group of 100 participants with dyslexia who completed the full study, we had to approach an initial cohort of some 120 students. Of these 120 students a small number of students chose not to cooperate once the study was explained to them. A few more students were lost because they failed to show up at appointments.
When recruiting the subjects we tried to reflect the inflow in the first year of higher education as much as possible. Matching criteria for the control students were therefore restricted to field of study, gender and age. Because one of the goals of our project is to see how dyslexic students succeed in higher education compared to their peers and to assess the impact of their disability on their study skills we matched them on field of study. We did add age and gender as matching criteria to construct homogenous groups. To recruit the control students we used different methods. We asked the students with dyslexia for several names of fellow classmates who would be interested in participating. Amongst these names we selected someone at random. In case the dyslexic student failed to deliver any names (which was the case for about 50% of the participants), we recruited them ourselves by means of electronic platforms or the guidance counselors of the institution in question. Table 2 contains the general information on the two groups: mean age, gender, professional bachelor v. academic bachelor students, fields of study and the educational level of the parents.
The socio-economical level of the parents was not a matching criteria but no difference was found between the two groups in socio-economical level based on the educational level of the mother [χ2(3) = 4.855, p = .183] and father [χ2(3) = 2.634, p = .452]. Educational levels were: lower secondary education, higher secondary education, post secondary education either at university or a college for higher education.
Cognitive Measures and Tests Administered
In the following section, we group the tests as a function of cognitive skill. Although this is not 100% how the assessment happened (which was battery-based), it makes it easier to compare our data to those of Swanson and Hsieh  and Hatcher and colleagues . Most cognitive skills were assessed with validated and widely used Dutch-language screening instruments. We used the Dutch version of the Kaufman Adolescent and Adult Intelligence Test  and an established test battery for diagnosing dyslexia in young adults . We tried to obtain converging evidence from a second test designed to measure the same skill when no data about reliability and validity were available. In particular, we compared the data to the IDAA or Interactive Dyslexia Test Amsterdam-Antwerp, a test battery that at the time of our testing was being normed and validated .
The American KAIT, developed in 1993 by A.S. Kaufman and N.L. Kaufman, was translated by Dekker, Dekker, and Mulder in 2004 and norms were collected on a standardization sample in the Netherlands and Flanders. The main goal of the KAIT is to evaluate analytic intelligence in individuals from 14 to 85 years. In our study the complete version was administered. It consists of 10 subtests categorized into two types of intelligence: fluid and crystallized intelligence. The crystallized scale consists of 4 subtests: Word Definitions, Double Meanings, Auditory Comprehension, and Famous People (for more information see below). It reflects how well a person has learned concepts and knowledge that are part of one’s cultural and scholar context. It is influenced by verbal conceptual development and education. The fluid intelligence scale gives an indication of the person’s potential and flexibility to solve new problems, either verbal or non-verbal. The 6 subtests are Symbol Learning, Logical Reasoning, Secret Codes, Block Patterns, Delayed Auditory Memory, and Delayed Symbol Learning (for more information see below). The combination of fluid and crystallized IQ results in a total IQ-score. All three scores have a mean of 100 and a standard deviation of 15 points. Psychometric information can be found in Table 3.
We used the KAIT instead of the Wechsler Adult Intelligence Scale III  to avoid retest effects. Many students with dyslexia had been tested previously with the WISC or the WAIS as part of their assessment. Other reasons for choosing the KAIT were the less rigorous time constraints, which we considered an advantage for students with learning disabilities, and the inclusion of two subtests of delayed memory, namely Delayed Symbol Learning and Delayed Auditory Memory. Both subtests are considered valid measures of long term memory capacities.
We also administered the GL&SCHR, a Dutch reading and writing test battery for (young) adults . This test includes many of the tasks frequently administered in dyslexia assessment (e.g. ). There are three tests specifically designed to evaluate reading and writing skills, namely Word Spelling, Proofreading, and Text Reading (for more information see below). Seven additional tests focus on associated language deficits such as phonological processing, rapid naming, short term memory and working memory, morphology, and vocabulary (for more information see below). Information about reliability can be found in Table 4. For different subtests different methods were used, namely KR20, Guttman split-half, and a test-retest correlation.
The IDAA or Interactive Dyslexia Test Amsterdam-Antwerp  is a new diagnostic instrument for the diagnosis of dyslexia in secondary school children and students in higher education. It is a test battery developed by The University of Amsterdam, Lessius College for Higher Education (Antwerp), and Muiswerk for the screening of young adults. It focuses on core skills of reading and writing such as automatized word recognition, decoding at lexical and sublexical level, and orthographic and phonological competence. The individual administration is fully computer controlled. The battery consists of six subtests. The first one is a questionnaire that assesses print exposure in Dutch and English. Next, phonological skills are evaluated with a reversal task where the participant has to state whether the second orally presented nonword is the reversal of the first (e.g. rol-lor). Then, four tests focus on orthographical skills : flash reading in Dutch, flash typing in Dutch, flash typing of nonwords in Dutch, and flash typing in English. In these tasks participants are presented with a word or nonword for 200 ms followed by a mask (###). Depending on the task the participant has to identify whether the target item was a word or nonword, or type in the word/nonword. As the names indicate, this is done both for Dutch and English. As this instrument is still in development and copyright protected, the results can only be used as validation criterion for other measures.
Finally, we also administered some standard tests for reading and calculation problems, used in the Dutch-speaking countries, such as word and nonword reading tests, and a standard arithmetic test. All in all, the following cognitive functions were assessed.
In this test from the GL&SCHR, a text is presented in printed form and at the same time read out by the computer. Afterwards, the participant has to answer questions about the text. These questions rely on either literal comprehension or deductive knowledge.
A classic word reading test in the Dutch-speaking countries is the EMT [One Minute Test] . Parallel-form reliability ranges from.89 to.97 in various studies, whereas test-retest reliability lies between.82 and.92. For more psychometric information about the EMT we refer to the test’s manual. The list consists of 116 words of increasing difficulty printed in four columns. The participant has to read aloud as many words as possible in one minute trying to minimize reading errors. Raw scores are obtained for the total number of words read, the number of errors made, and the number of words read correctly.
English word reading.
We also administered an English version of the EMT, namely the One Minute Test or OMT . Validity and reliability data of the OMT have been collected by Kleijen, Steenbeek-Planting, and Verhoeven . Test-retest reliability varies between 0.87 and 0.92. This test is in all aspects comparable to the Dutch EMT, except that English words are presented instead of Dutch ones.
In this test from the GL&SCHR participants are asked to read aloud a Dutch text which becomes increasingly difficult. Substantial errors (e.g. addition/substitution/omission of letters, syllables and/or words) and time consuming errors (e.g. repeating a word/sentence, spelling a word aloud) are registered as well as the total reading time.
Silent text reading.
The test that was used -“Hoe gevaarlijk is een Tekenbeet? [How Dangerous Can a Tick Be?]”- is part of a screening instrument published by Henneman, Kleijnen, and Smits . It provides an indication of silent reading speed and the ability to retain information. There are no norms for Flanders. So, we made use of the raw scores. To obtain further information about the validity of the test, we looked at the correlation with the EMT word reading test in our sample. A Pearson correlation coefficient of.66 (N = 200) was found. The silent reading test works as follows. Participants are instructed to read a text of 1023 words in silence, taking into account that they will have to write a short summary afterwards. During reading participants have to indicate the word they just read when a signal is given after one, two, and three minutes. Afterwards, the average number of words read per minute is calculated. The written summary is evaluated based on measures of content, structure and syntax but the results of these analyses are beyond the scope of the present paper .
The standard Dutch nonword reading test is De Klepel . The parallel-forms correlation varies between.89 and.95. In various studies, the results of the Klepel correlate between.74 and.91 with those of the EMT. For more psychometric information about the Klepel we refer to the test’s manual. The test contains 116 nonwords that follow the Dutch grapheme-phoneme correspondence rules. Administration and scoring are identical to the EMT.
Word spelling was measured with two tests of the GL&SCHR: Word Spelling and Proofreading. In the Word Spelling test participants write down 30 words dictated by means of an audio file with a 3 seconds interval. Afterwards they are given the opportunity to correct their answers. Half of the words follow the Dutch spelling rules; the other half are exception words (involving inconsistent sound-letter mappings that must be memorized). Participants are also asked to rate how certain they feel about each answer (certain, almost certain, uncertain). There is a score for the number of correct responses, one for the number of words written during dictation (speed of writing), and one total weighted score where the certainty per item is taken into account. When a correct answer is given and the participant is certain, the weighted item score is 5. When the word is spelled correctly but the participant is uncertain the score is only 2. The difference between the raw score and the weighted score can be considered as a measure of meta-cognitive knowledge –. In the Proofreading test participants are given 20 sentences in which they have to correct possible spelling mistakes and rate their certainty per item. Two scores are given: one for the total number of correct responses and a weighted score (see Word Spelling).
English word spelling.
Given the importance of English in higher education, we also included an English word dictation test. We used a standardized English test for word spelling: the WRAT-III English Word Dictation . The internal consistency coefficients for the English age groups 17–18 and 19–24 are both.90. For more information on validity and reliability in English we refer to the manual. Because this test has not yet been validated for bilinguals with Dutch as mother tongue, we calculated the Pearson correlation with the English flash typing test of the IDAA (r = 0.72; N = 200). The test was administered according to the guidelines in the English manual. The examiner says a word, uses it in a significant context, and repeats the word. The participant writes it down. The test consists of 42 words.
Because higher education involves academic language, we also administered an advanced spelling test (AT-GSN [General Test for Advanced Spelling in Dutch]), developed and used at the University of Leuven . This test has been used in a number of scientific studies –. Further information about the validity was obtained by correlating the scores with those of the Word Spelling test of the GL&SCHR (r = .79) and with the Dutch flash typing test of the IDAA (r = .70). The test consists of 12 paragraphs with exception words and challenging spelling rules (e.g. for the verbs). The correct use of capitals and punctuation marks is also taken into account. The score is the total number of errors made.
Morphology and syntax.
In this subtest of the GL&SCHR 20 sentences are presented, in which the participant has to identify the syntactical or grammatical errors. The same principles as in the Proofreading test are applied. The total score gives the number of correct answers, whereas the weighted score takes into account the certainty of the participant about the answer given.
Speed of processing.
To measure the participants’ speed of processing, we used the CDT or Cijfer Doorstreep Test [Digit Crossing Test] . This is a standardized Dutch test to detect attentional deficits and measure the speed and accuracy of processing in a task of selective attention involving task-switching. It is one of the 23 tests of the DVMH [Differential Aptitude Tests for Middle and Higher Level], a test battery published in 2003 by Dekker and De Zeeuw . This test battery was developed according to Carroll’s  Three Stratum Model in order to assess a large variety of cognitive skills such as verbal and numerical reasoning, attentional skills and language skills. The test – retest reliability scores vary between 0.79 and 0.95. The test can be administered from 14 years up to 80. There are 960 digits from 0 to 9 presented in 16 columns. Students have three minutes to underline as many fours and to cross out as many threes and sevens as possible. Scores for working pace (total numbers of items processed), concentration (total number of correct items), number of target errors, number of missed target digits and percentage of errors are obtained.
Phonological awareness was tested with 2 subtests from the GL&SCHR: Spoonerisms and Reversals. In the Spoonerisms test the first letters of two orally presented words must be switched (e.g., Harry Potter becomes Parry Hotter). Accuracy and speed (measured with a stop-watch) are measured. In the Reversals test participants have to judge if two spoken words are reversals or not (e.g. rac-car). Again, accuracy and speed (measured with a stop-watch) are measured.
In the RAN test of the GL&SCHR participants are asked to rapidly name letters, digits, colors, or objects presented one-by-one on a computer screen (4 tests). The participant determines the pace by pressing the Enter button. Accuracy and speed are measured.
We used the Tempo Test Rekenen (TTR; ), a Dutch standardized test for mental calculations. It is designed to examine the rate at which participants mentally perform simple mathematical operations (single and double digits). There are five lists, consisting of additions, subtractions, multiplications, divisions below 100, and a random sequence of all four operations. Participants are given one minute per list to solve as many problems as possible. The score per subtest is the number of items minus the number of errors made.
The scores for crystallized IQ, fluid IQ and total IQ of the KAIT give us measures of general intelligence.
We used three tests to evaluate this language function: Vocabulary from the GL&SCHR and Definitions and Double Meanings from the KAIT. In the Vocabulary test participants are asked to find the low frequency word for which a definition is given (e.g., the Dutch equivalents of anonymous or simultaneous). In the Definitions test the participant has to find a word based on a number of letters given and a short description of the word (e.g., “A dark color :.r.n”). In the Double Meanings test the participant has to find a word that is in some way connected to two word pairs (e.g., the connection between biology-body and jail-lock is the target word cell).
To obtain information about the participants’ non-verbal long-term memory, we used the Famous People test of the KAIT. In this test pictures of famous people are shown and participants have to name the person (e.g., Ghandi).
Three subtests for fluid intelligence of the KAIT  were used to evaluate this cognitive skill: Symbol Learning, Logical Reasoning, and Secret codes. In the Symbol Learning test, the participant has to remember and reproduce series of symbols in different sentence-like combinations. In the Logical Reasoning test, information is given about the relative location of a number of items (people or animals). By logical reasoning the participant has to infer the location of a target item. In the Secret Codes test three or four items are given a unique code consisting of different parts. Based on these codes the participant has to infer which codes new target items should get.
Short-term memory span.
The GL&SCHR contains a short-term memory test for phonemes and non-verbal shapes (which must be drawn), and a test in which participants have to reproduce randomly presented series of letters or digits in ascending order. The participant is placed in front of a computer screen. After pressing the enter button the participant sees and hears a series of items presented one item per 2 seconds. At the end of each series the participant has to reproduce the items remembered. The number of items within a series increases steadily.
The GL&SCHR contains a short-term memory test for objects. Administration is identical to the short term memory spans test of the GL&SCHR described in the previous section.
The Auditory Memory Test of the KAIT is a delayed memory task in which questions have to be answered about a text that was read out at the beginning of the administration of the KAIT (see the Auditory Comprehension Test discussed below).
Visual-spatial memory was tested with two subtests of the KAIT: Delayed Symbol Learning, and Block Patterns. The Delayed Symbol Learning test is a delayed retention task of the symbols used in the Symbol Learning test. In the Block Patterns test a yellow-black pattern has to be reproduced with cubes.
The Auditory Comprehension test of the KAIT comprises the presentation of short audio fragments about which the experimenter asks content questions. The participant has to provide an answer.
The complete test protocol was administered during two sessions of about three hours each. The protocol was divided into two counterbalanced parts. The order of tests in part one and two was fixed and chosen to avoid succession of similar tests. There was a break halfway each session. If necessary, students could take additional breaks. Students with dyslexia started with part one or two according to an AB-design. Their control student always started with the same part. All tests were administered individually by three test administrators according to the manuals guidelines. The test administrators were the two first authors and a test psychologist. To standardize administration each administrator read the manuals of the tests, had a practice session, and followed three sessions of the starting administrator. Testing occurred in a quiet room with the test administrator seated in front of the student.
To improve comparison with Table 1, results are given as Cohen’s d effect sizes (derived from parametric or non-parametric tests, see below). In line with the English studies (Table 1), the sign of the d-values was adapted so that positive d-values represent better performance of the controls and negative values better performance of the students with dyslexia. All data were first checked on normality and equality of variance between groups (dyslexic group and control group). When the constraints for parametric statistics were satisfied, means were compared using a Student’s t-test. Otherwise, the data were analyzed with the non-parametric Mann-Whitney-U test and converted into the appropriate d-value by means of the equation given in Field (, p. 530 on how to transform a U-value into an r-statistic) and an equation to derive the d-value from the r-statistic. Values of the t-statistics and U-statistics are not given, as these can be calculated from the d-scores. Table 5 shows performances of students with dyslexia on literacy skills in comparison with their non-dyslexic peers. For variables that were analyzed using with a t-test, confidence intervals for the effect sizes could be calculated with the use of the ESCI-CIdelta program . In Table 6 the results of phonological skills and processing skills are listed. In Table 7 results on general intelligence measures are reported.
With respect to the literacy skills (Table 5), the following results stand out:
- As in English speaking individuals, the deficiency of students with dyslexia tends to be worse in the writing tests than in the reading tests. In particular, the Word Spelling test of the GL&SCHR and the Sentence Dictation (AT-GSN) resulted in large effect sizes (d ≈ 2).
- Deficiencies in spelling are similar at the word level (d = 2) and at the sentence level (d = 2.1).
- Dutch word reading (d = 1.97) seems to be more affected in students with dyslexia than nonword reading (d = 1.57), possibly because the former involved more instances of inconsistent spelling-sound mappings.
- For our group of students in higher education deficiencies in reading and writing are not more pronounced in a second language (English) than in the first language. In English word reading the same pattern in effect sizes was found for the percentage of errors and the number of words read as in Dutch.
- Reading deficiencies are most pronounced in speed (1.60< d <1.90). Smaller but still substantial effect sizes were found for percentage of number of errors made (d ≈.80).
- Text comprehension was nearly equivalent for both groups (d = .4) when the text was read aloud, and better than expected on the basis of the reading scores.
- The differences on the IQ test are negligible and particularly caused by definitions to words (d = .75), although there is also a small difference for the recognition of famous persons (d = .35). There are no differences in fluid intelligence (d = .1).
- Students with dyslexia tend to be slower than controls in processing speed as measured with the CDT(d = .6), and a small effect size can be noted for the percentage of errors (d = .35).
- Except for phonological short-term memory (d = .71), memory spans are quite comparable (0.28< d <.45).
- There is considerable dyslexia cost for arithmetic (d≈1), which tends to be larger for divisions (d = 1) and multiplications (d = .90) than for subtractions (d = .61).
- There is a non-negligible cost (d >1.3) for phonological processing. This cost again is largely due to the speed of processing, and less to the accuracy of processing.
- Dyslexics are slower at naming letters, digits and colors, but not at naming objects (d = .2).
Finally, to facilitate comparison with English, Table 8 includes our results together with those of Swanson and Hsieh  and Hatcher et al. . In particular, the correspondence with Swanson and Hsieh is impressive. The Pearson correlation between both sets is r = .94 (N = 11, p<.001). The correlation with Swanson and Hsieh is lower if we also include the text comprehension difference of the present study (d = .5) and correlate it with the reading comprehension difference reported by Swanson and Hsieh (d = 1.2). Then the correlations drops to r = .74 (N = 12). However, this comparison is not really justified, because in our text comprehension test the text was additionally read out by the computer. Correlation is lower with Hatcher and colleagues , partly because of a lack of data in that study on aspects where students with dyslexia show good performance. The correlation coefficient is.67 and reaches significance (p<.05).
We designed this study to obtain an empirically based cognitive profile of students with dyslexia in higher education in a language other than English. We started from the tests we thought worthwhile, making sure those of Hatcher et al.  were included. Shortly after data collection began, Swanson and Hsieh  published their meta-analysis, providing us with an even more complete image of English-speaking students.
Despite the differences in language and educational context, our findings are remarkably similar to those in English: The pattern of strengths and weaknesses of students with reading disabilities is very much the same in Dutch as in English (Table 8). This is good news, because it means that the profile is likely to be applicable to all alphabetical languages. Also, different educational systems do not seem to play an important role in defining which students with dyslexia enter higher education.
A further important conclusion from our findings is that the data agree very well with the traditional definition of dyslexia as a combination of normal intelligence with deficient reading and writing. This definition has been questioned in recent years, because it has proven difficult to find the discrepancy in all individuals. Researchers have disagreed about whether this has theoretical consequences for the relationship between reading/writing skills and other abilities, or whether it is simply a consequence of the notoriously low correlations one is bound to find for difference scores of highly correlated variables (e.g. ). Our data leave little doubt that, as a group, dyslexics entering higher education show exactly the profile predicted by the traditional definition of dyslexia, even though at an individual level the difference scores may show large variability. As such, our findings reinforce a similar, tentative conclusion reached by Swanson and Hsieh .
The affirmation of the traditional definition of dyslexia shows that some lecturers’ doubts about the existence of isolated reading disabilities in combination with normal intelligence are unjustified. For the group we tested, we found – just like the authors before us – a pattern of results that is extremely hard to obtain on the basis of deficient general abilities, motivation, or outright malingering. Although we cannot exclude the possibility that one or two of the students who refused to take part in our study did so because they wanted to play the system, our results emphatically testify that the vast majority of students entering higher education with a diagnosis of dyslexia are the same as the other students, except for a language-related deficiency that arguably hurts them most during the school years when they have to rapidly acquire and produce a lot of new information in written form.
At the same time, it is important to keep in mind that, although the differences are not large, all test scores tended to be lower for the students with dyslexia than for the controls. When looking at the full cognitive profile of students with dyslexia, it cannot be denied that there is a quite consistent deficiency on a wide range of tasks, predominantly those involving speed of processing and retrieval of verbal information from long term memory. It would be good if students with dyslexia were properly informed about this extra challenge they are facing. The most prominent example of such a “hidden” cost is the extra time they need for mental calculations (total of operations: d = 1), arguably because of the extra effort to retrieve arithmetic facts from memory (see the triple code model ). This additional deficit was not mentioned by many students, but is likely to cause problems in courses involving the calculation of many elementary arithmetic operations (e.g., the calculation of a standard deviation in a course of statistics).
Sometimes it has been hypothesized that successful individuals with dyslexia have fully compensated for their reading and writing difficulties . Hatcher et al.  raised doubts about this possibility, and our data confirm this to some extent, although the picture is much less pessimistic. What is encouraging is the finding that students with dyslexia tended to perform equally good on the text comprehension test, in which the text was additionally read out by the computer (see also their good scores on the auditory comprehension test). This suggests the usefulness of text-to-speech arrangements, although ideally we would have more data on this aspect, directly comparing text comprehension with and without text-to-speech assistance.
A further interesting finding of our study is that the effect sizes are not larger for tests based on sentences than for tests based on individual words (word reading d = 1.87, text reading d = 1.29; word writing d = 2.05, text writing d = 2.10). This agrees with the descriptive definition of SDN  arguing that the impairment in reading and spelling can be measured at the word level. Our data indicate that tests of reading and writing at the word level are enough to make a valid diagnosis. This is valuable information for diagnosticians, as it leads to a substantial time gain.
Finally, our findings have clear implications for guidelines about special arrangements. We think the following arrangements are incontestable:
- It is clear that students with dyslexia have a specific and pervasive problem with reading and writing. This means that they are entitled to arrangements that help them with these particular deficiencies, such as text-to-speech software (also during exams) and the use of spellcheckers and word completion software when spelling errors are likely to lead to lower marks (e.g., for essay-type questions).
- Students with dyslexia are at a disadvantage under time constraints, meaning that situations should be avoided in which they are likely to suffer more (e.g., exams and tests with strict time limits). This does not mean that students with reading disabilities should be given extended deadlines for all tasks (e.g., for the submission of essays and lab reports, which can be planned well in advance), but it does entail that they are denied a fair chance if they have to complete an exam in the same time as their peers.
- Many students with dyslexia have a pervasive problem with mathematical tables. This should be taken into account when an exam strongly relies on them (e.g., for problem solving, where different alternatives have to be tried out). This problem can easily be solved by allowing students to use a calculator.
- Finally, there is scope for better feedback to the students themselves. It is important for them to know of the limitations they are confronted with, so that they can prepare themselves well and insist on having the arrangements outlined above. A better knowledge of their limitations may also help them not to overestimate their abilities. One cannot deny that the average performance of the dyslexics on nearly all tests tended to be lower than that of controls. Although these differences often are too small to justify special arrangements, students with reading disability should know about these differences, so that they can better organize their studies. For instance, many institutes of higher education nowadays provide their students with ways to spread the burden (e.g., by studying part-time or distributing the exams over extra sessions). It may be an idea to discuss these options with students (and their parents), certainly when their test performances are below average, so that they can prepare themselves better in the light of the specific difficulties they will be confronted with.
The above (minimal) arrangements are easy to implement if they are part of the general organization of exams, certainly with the current availability of text-to-speech software and text writing software with built-in spellcheckers. Additionally, these measures are so specifically tailored to the proven needs of students with dyslexia that they are unlikely to be contested or misused. To our knowledge there is no evidence that text-to-speech software, spellcheckers, and a few extra hours for exams are any good in compensating for a lack of knowledge, deficient intellectual abilities, or missing achievement motivation. However, our results strongly suggest that they will make a significant difference for students with dyslexia.
The authors thank Valérie Van Hees and Charlotte De Lange from Cursief for their help in the study and the recruitment of participants. They also thank Joke Lauwers for her assistance in testing the participants, and Annemie Desoete for helpful suggestions.
Conceived and designed the experiments: MC WT MB. Performed the experiments: MC WT. Analyzed the data: MC WT MB. Contributed reagents/materials/analysis tools: MC WT MB. Wrote the paper: MC WT MB.
- 1. Hadjikakou K, Hartas D (2008) Higher education provision for students with disabilities in Cyprus. Higher Education 55: 103.119
- 2. Madriaga M, Hanson K, Heaton C, Kay H, Newitt S (2010) Confronting similar challenges? Disabled and non-disabled students’ learning and assessment experiences. Studies in Higher Education 35: 647.658
- 3. Landerl K, Moll K (2010) Comorbidity of learning disorders: prevalence and familial transmission. Journal of Child Psychology and Psychiatry 51: 287.294
- 4. Pieters S, De Block K, Scheiris J, Eyssen M, Desoete A (2012) How common are motor problems in children with a developmental disorder: rule or exception? Child: Care, Health and Development 38: 139.145
- 5. Yoshimasu K, Barbaresi WJ, Colligan RC, Killian JM, Voigt RG (2010) Gender, Attention-Deficit/Hyperactivity Disorder, and Reading Disability in a Population-Based Birth Cohort. Pediatrics 126: 788.795
- 6. Du Pré EA, Gilroy DE, Miles TR (2008) Dyslexia at College. NY : Routledge.
- 7. Farmer M, Riddick B, Sterling CM (2002) Dyslexia and Inclusion. Assessment and Support in Higher Education. London: Whurr Publishers Ltd.
- 8. Wolf LE, Schreiber HE, Wasserstein J (2008) Adult Learning Disorders: Contemporary Issues (A Neuropsychologist’s Handbook). NY: Psychology Press.
- 9. Sparks RL, Lovett B (2009) College Students With Learning Disability Diagnoses Who Are They and How Do They Perform? Journal of Learning Disabilities 42: 494.510
- 10. Sparks RL, Lovett B (2009) Objective Criteria for Classification of Postsecondary Students as Learning Disabled Effects on Prevalence Rates and Group Characteristics. Journal of Learning Disabilities 42: 230.239
- 11. Everatt J, Bradshaw MF, Hibbard PB, Lages M (1997) Visual processing deficits and dyslexia. Perception 26: 1330.1330
- 12. Felton RH, Naylor CE, Wood FB (1990) Neuropsychological profile of adult dyslexics. Brain and Language 39: 485.497
- 13. Lefly DL, Pennington BF (1991) Spelling-errors and reading fluency in compensated adult dyslexics. Annals of Dyslexia 41: 143.162
- 14. Hatcher J, Snowling MJ, Griffiths JM (2002) Cognitive assessment of dyslexic students in higher education. British Journal of Educational Psychology 72: 199.133
- 15. Ransby MJ, Swanson HL (2003) Reading comprehension skills of young adults with childhood diagnoses of dyslexia. Journal of Learning Disabilities 36: 538.555
- 16. Trainin G, Swanson HL (2005) Cognition, metacognition and achievement of college students with learning disabilities. Learning Disability Quarterly 28: 264.272
- 17. Swanson HL, Hsieh CJ (2009) Reading Disabilities in Adults: A Selective Meta-Analysis of the Literature. Review of educational Research 79: 1362.1390
- 18. Brysbaert M (2011) Basic statistics for psychologists. London: Palgrave Macmillan.
- 19. Keuleers E, Diependaele K, Brysbaert M (2010) Practice effects in large-scale visual word recognition studies: a lexical decision study on 14,000 Dutch mono- and disyllabic words and nonwords. Frontiers in Psychology.
- 20. De Smedt B, Boets B (2010) Phonological processing and arithmetic fact retrieval: evidence from developmental dyslexia. Neuropsychologia 48: 3973.3981
- 21. Göbel SM, Snowling MJ (2010) Number-processing skills in adults with dyslexia. Quarterly Journal of Experimental Psychology 63: 1361.1373
- 22. Sharpe D (1997) Of Apples and Oranges, File Drawers and Garbage: Why Validity Issues in Meta-analysis Will Not Go Away. Clinical Psychology Review 17: 881.901
- 23. Hanley JR, Masterson J, Spencer LH, Evans D (2004) How long do the advantages of learning to read a transparent orthography last? An investigation of the reading skills and reading impairment of Welsh children at 10 years of age. Quarterly Journal of Experimental Psychology 57: 1393.1410
- 24. Seymour PHK, Aro M, Erskine JM (2003) Foundation literacy acquisition in European orthographies. British Journal of Psychology 94: 143.174
- 25. Ziegler JC, Goswami U (2005) Reading acquisition, developmental dyslexia, and skilled reading across languages: A psycholinguistic grain size theory. Psychological Bulletin 131: 3.29
- 26. Lindgren SD, De Renzi E, Richman LC (1985) Cross-national comparisons of developmental dyslexia in Italy and the United-States. Child Development 56: 1404.1417
- 27. Landerl K, Wimmer H, Frith U (1997) The impact of orthographic consistency on dyslexia: A German-English comparison. Cognition 63: 315.334
- 28. Share DL (2008) On the anglocentricities of current reading research and practice: The perils of overreliance on an “Outlier” orthography. Psychological Bulletin 134: 584.615
- 29. Stone GO, Vanhoy M, VanOrden GC (1997) Perception is a two-way street: Feedforward and feedback phonology in visual word recognition. Journal of Memory and Language 36: 337.359
- 30. Borgwaldt S, Hellwig F (2004) Onset entropy matters: Cross-linguistic sound-spelling analyses and empirical validation. Australian Journal of Psychology 56: 106.107
- 31. Van den Bosch A, Content A, Daelemans W, De Gelder B (1994) Measuring the Complexity of Writing Systems. Journal of Quantitative Linguistics 1: 178.188
- 32. Lovett BJ, Sparks RL (2010) Exploring the Diagnosis of “Gifted/LD”: Characterizing Postsecondary Students With Learning Disability Diagnoses at Different IQ Levels. Journal of Psycho-educational Assessment 28: 91.101
- 33. Reid AA, Szczerbinski M, Iskierka-Kasperek E, Hansen P (2006) Cognitive Profile of Adult Developmental Dyslexics: Theoretical Implications. Dyslexia 13: 1.24
- 34. Szenkovits G, Ramus F (2005) Exploring dyslexics’ phonological deficit I: Lexical versus sublexical and input versus output processes. Dyslexia 11: 253.268
- 35. Bruyer R, Brysbaert M (2011) Combining speed and accuracy in cognitive psychology: Is the Inverse Efficiency Score (IES) a better dependent variable than the mean Reaction Time (RT) and the Percentage of Errors (PE)? Psychologica Belgica 51: 5.13
- 36. Wolff U (2009) Phonological and Surface Subtypes among University Students with Dyslexia. International Journal of Disability, Development and Education 59: 73.91
- 37. Campbell JID, Thompson VA (2002) More power to you: Simple power calculations for treatment effects with one degree of freedom. Behavior Research Methods, Instruments, & Computers 34: 332.337
- 38. Faul F, Erdfelder E, Lang AG, Buchner A (2007) G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 39: 175.191
- 39. Stichting Dyslexie Nederland (2008) Diagnose dyslexie. Brochure van de Stichting Dyslexie Nederland. Herziene versie. Bilthoven: Stichting Dyslexie Nederland.
- 40. Vaughn S, Fuchs LS (2003) Redefining learning disabilities as inadequate response to instruction: The promise and potential problems. Learning Disabilities Research & Practice 18: 137.146
- 41. Haager D, Klinger J, Vaughn S (2007) Evidence-Based Reading Practices for Response to Intervention. Baltimore, London, Sydney: Paul H. Brookes Publishing Co.
- 42. Brus B, Voeten M (1991) Eén-minuut-test vorm A en B, schoolvorderingstest voor de technische leesvaardigheid bestemd voor groep 4 tot en met 8 van het basisonderwijs. Verantwoording en handleiding. Lisse: Swets & Zeitlinger.
- 43. van den Bos K, Spelberg H, Scheepsma A, de Vries J (1999) De klepel vorm A en B, een test voor leesvaardigheid van pseudowoorden. Verantwoording, handleiding, diagnostiek en behandeling. Lisse: Swets & Zeitlinger.
- 44. De Pessemier P, Andries C (2009) Test voor Gevorderd Lezen en Schrijven. Antwerpen-Apeldoorn : Garant.
- 45. Dekker R, Dekker PH, Mulder JL (2004) Kaufman Adolescent and Adult Intelligence Test – Nederlandstalige Versie: Handleiding. PITS: Leiden.
- 46. Van der Leij A, Bekebrede JI, Geudens A, Schraeyen K, Schijf GM (2012) Interactieve Dyslexietest Amsterdam- Antwerpen [Interactive Dyslexia Test Amsterdam-Antwerp] : handleiding. Uithoorn : Muiswerk Educatief. In press.
- 47. Wechsler Dv (2001) WAIS-III, Nederlandstalige bewerking, technische handleiding. Lisse: Swets & Zeitlinger.
- 48. Kleijnen R, Loerts M (2006) Protocol Dyslexie Hoger Onderwijs. Antwerpen/Apeldoorn: Garant Uitgeverij.
- 49. Kleijen R, Steenbeek-Planting E, Verhoeven L (2008) Toetsen en Interventies bij Dyslexie in het Voortgezet Onderwijs. Nederlands en Moderne Vreemde Talen. Antwerpen/Apeldoorn: Garant Uitgeverij.
- 50. Henneman K, Kleijnen R, Smits A (2004) Protocol Dyslexie Voortgezet Onderwijs : Deel 2 - Signalering, diagnose en begeleiding. KPC Groep, Expertisecentrum Nederlands, Werkverband Opleidingen Speciaal Onderwijs.
- 51. Tops W, Callens M, Van Cauwenberghe E, Adriaens J, Brysbaert M (2012) Beyond spelling: the writing skills of students with dyslexia in higher education. Annals of Dyslexia: In press.
- 52. Desoete A, Roeyers H (2002) Off-line metacognition. A domain-specific retardation in young children with learning disabilities? Learning Disability Quarterly 25: 123.139
- 53. Wilkinson GS (1993) Wide Range Achievement Test. Jastak Assessment.
- 54. Ghesquière P (1998) Algemene toets gevorderde spelling van het Nederlands (AT-GSN) : Verantwoording en handleiding. Rapport van een specialisatiejaar: Onderzoek AT-GSN-dictee. Unpublished bachelor thesis, University Leuven, Leuven, Belgium.
- 55. Gauderis K, Heirman E, Vandenhoof T (2004) Normering van AT-GSN, TTR en CDR-5 bijleerlingen van het zesde jaar Algemeen Secundair Onderwijs [Standardisation of AT-GSN, TTR and CDR-5 among sixth-year students in General Secondary Education]. Unpublished bachelor thesis, University College Arteveldehogeschool, Ghent, Belgium.
- 56. Vanderswalmen R, Vrijders J, Desoete A (2010) Metacognition and spelling performance in college students. In A Efklides & P Misailidi (Eds.). Trends and Prospects in Metacognition Research. Springer: New York, 367–394.
- 57. Dekker R, Mulder JL, Dekker PH (2007) De ontwikkeling van vijf nieuwe Nederlandstalige tests. PITS: Leiden.
- 58. Dekker R, De Zeeuw J (2003) DVMH: Differentiële Vaardighedentests voor Midden en Hoger Niveau. PITS: Leiden.
- 59. Carroll JB (1993) Human Cognitive Abilities. A Survey of Factor-Analytic Studies. Cambridge: Cambridge University Press.
- 60. de Vos T (1992) Tempo Test Rekenen. Amsterdam: Pearson Education.
- 61. Field A (2005) Discovering Statistics using SPSS. London: SAGE Publications Ltd.
- 62. Cumming G, Finch S (2001) A primer on the understanding, use and calculation of confidence intervals based on central and noncentral distributions. Educational and Psychological Measurement 61: 530.572
- 63. Cotton SM, Crewther DP, Crewther SG (2005) Measurement error: Implications for diagnosis and discrepancy models of developmental dyslexia. Dyslexia 11: 186.202
- 64. Dehaene S, Piazza M, Pinel P, Cohen L (2003) Three parietal circuits for number processing. Cognitive Neuropsychology 20: 487.506
- 65. Snowling MJ (2000) Dyslexia (2nd ed.). Oxford: Blackwell.