Figures
Abstract
Background
With India preparing for the next decennial Census in 2021, we compared the disability estimates and data collection methodology between the Census 2011 and the most recent population-level survey for India and its states, to highlight the issues to be addressed to improve robustness of the disability estimates in the upcoming Census.
Methods
Data from the Census 2011 and from two complementary nationally representative household surveys that covered all Indian states with the same methodology and survey instruments–the District-Level Household Survey-4 (DLHS-4, 2012–2013) and the Annual Health Surveys (AHS three rounds, 2010–11, 2011–12 and 2012–13) were used. Data from DLHS-4 and AHS 2012–13 round were pooled to generate estimates for the year 2012–13. Data collection methodology between the sources was compared, including the review of definitions of each type of disability. The overall, mental, visual, hearing, speech, and movement disability rate (DR) per 100,000 population were compared between the sources for India and for each state, and the percent difference in the respective rates was calculated. We explored the reliability of these estimates comparing yearly data from the AHS for three successive rounds.
Results
Survey data were collected through proxy reporting, however, it is not entirely clear whether the data were proxy- or self-reported or a mix of both in the Census. The overall DR was 25.1% higher in the Census (2,242; 95% CI 2,241–2,243) than the survey (1,791; 95% CI 1,786–1,797) per 100,000 population, with the state-level difference ranging from -64% in Tamil Nadu to 107% in Sikkim state. Despite both sources using nearly similar definitions for overall disability and disability by type, the difference in DR was 125.5%, 54.2%, -25.7%, -19.7%, and 21.9% for hearing, speech, mental, movement, and visual DR, respectively. At the state-level, the difference in disability-specific estimates ranged from -84% to 450%. The extent of variations in the disability-specific estimates in AHS successive rounds ranged from -25% to 929% at the state-level.
Conclusions
There is momentum globally towards building disability measurement that is consistent with the data required for monitoring of the Sustainable Development Goals to ensure robust estimation of disability. The current estimates from the Census and surveys seem much lower than would be expected at the population level. We make recommendations that India needs to take serious note of in order to improve the validity and reliability of India’s disability estimates.
Citation: Dandona R, Pandey A, George S, Kumar GA, Dandona L (2019) India’s disability estimates: Limitations and way forward. PLoS ONE 14(9): e0222159. https://doi.org/10.1371/journal.pone.0222159
Editor: Stefano Federici, Università degli Studi di Perugia, ITALY
Received: March 25, 2019; Accepted: August 22, 2019; Published: September 6, 2019
Copyright: © 2019 Dandona et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: This study used data from the Census 2011, District-level Household Survey-4, and the Annual Health Surveys which are available at the following links: http://www.censusindia.gov.in/2011census/population_enumeration.html; http://rchiips.org/obtainingdata.html; https://data.gov.in/keywords/annual-health-survey.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The global commitment for the 2030 Agenda for Sustainable Development recognizes the promotion of the rights, perspectives and well-being of persons with disabilities in line with the Convention of the Rights of Persons with Disabilities (CRPD) towards a more sustainable and inclusive world [1–3]. According to the World Report on Disability released in 2011, nearly 15% of the world’s population lived with some form of disability, of whom 2–4% experienced significant difficulties in functioning [4]. It also highlighted that the prevalence of disability was on the rise due to ageing populations and the higher risk of disability in older people as well as the global increase in chronic health conditions [4]. The World Report was based on best available prevalence data from the World Health Surveys, country reported Census and survey data, and data from the Global Burden of Disease (GBD) Study [4]. The GBD Study provides estimates for disability on an on-going basis from more than 350 diseases/conditions in 195 countries from 1990 onward using a variety of data sources including disease/condition specific clinical and self-reported surveys [5]. One of the key recommendations of the World Report was for the nations to improve disability data collection, as major shortcomings of the national disability prevalence data were highlighted, in particular underestimation and lack of comparability [4, 6]. The recent United Nations Flagship Report on Disability and Development 2018 also highlights the need to significantly increase the availability of high-quality, timely and disaggregated data by disability as one of the major requirements to monitor progress made for persons with disabilities [1]. This need for availability of relevant data is in line with the CRPD which calls on States Parties to collect appropriate information, including statistical and research data, to enable them to formulate and implement policies related to the Convention [2].
Disability is complex and multi-faceted, with some of its roots in society and culture [7]. Therefore, counting disability is a challenge, and various issues in disability measurement between and within countries due to varying definitions, data collection systems, age range and populations included are known [8–12]. To address these challenges, globally there is a momentum towards building disability measurement that is consistent with the Sustainable Development Goals which outline the major goals of policy formulation and program planning with the aim to promote participation of persons with disabilities in all aspects of life [13]. Advances such as the United Nation’s Washington Group Statistics short set (WGSS) are being made to ensure the comparability of disability estimates in the Censuses and household surveys globally, as the WGSS is consistent with interactional understanding of disability, i.e. disability resulting from the interaction of an individual with a health condition or impairment with the environment, for instance as in the International Classification of Functioning, Disability and Health [6, 14–16].
As is in most developing countries, India uses the disability estimates from the Census to inform policy and programs for persons with disabilities [17–21]. In the most recent Census of 2011, disability information became more detailed and important, and included information on a wide range of disabilities [21, 22]. According to this latest Census 2011, 2.2% of the Indian population had disability [20, 21]. Disability data in India are also available from large-scale population surveys such as the National Sample Survey, District-Level Household Survey-4, the Annual Health Survey, and the World Health Survey [23–28]. A previous comparison noted wide variations in the disability estimates from the Census 2001 and the National Sample Survey of persons with disabilities conducted in 2002 [27, 29], and the need for more qualitative studies on disability has been argued. As India prepares for the next decennial Census in the context of its commitment to SDGs and CRPD, we aim to provide a review of the disability estimates for India and its states from the Census 2011 and the most recent population-level survey estimates for disability in the current decade. In the background of the above stated need for high-quality data on disability, it is important to understand the variations across the data sources in India in order to provide a consistent and reliable information to formulate and implement policies for people with disability and to monitor trends in the prevalence of disabilities. Therefore, this paper aims to highlight the extent of variation in the disability estimates, and the methodological and definition related issues between the data sources that provide disability estimates for India for all age groups, and to recommend ways in which these variations could be minimized to reliably monitor the trends in disability over time.
Methods
The data sources used for this analysis are shown in Table 1. The latest decennial population Census of 2011 [21] aimed to provide a complete coverage of all persons with disabilities for all ages in all states of India by including all types of disabilities listed under the Persons with Disability Act, 1995 and the National Trust Act, 1999 [30, 31]. The other data sources in the current decade that provided data in public domain on disability for all age groups were two complementary nationally representative household surveys–the District-Level Household Survey-4 (DLHS-4, 2012–2013) and the Annual Health Survey (AHS, 2010–11, 2011–12 and 2012–13) [23–26]. DLHS was conducted by the International Institute for Population Sciences with an oversight by the Ministry of Health and Family Welfare, Government of India whereas the AHS was implemented by the Office of Registrar General of India. Both these surveys were done in coordination with the same methodology and survey instruments. DLHS-4 was conducted in all Indian states except the nine states that were covered by the AHS, which included the states of Bihar, Chhattisgarh, Jharkhand, Madhya Pradesh, Odisha, Rajasthan, Uttar Pradesh, Uttarakhand, and Assam [32]. Additionally, the AHS was also a panel survey in which the households surveyed in the baseline round (2010–11) were followed in the 1st (AHS 2011–12) and 2nd (AHS 2012–13) updation rounds [24–26].
We assessed the data collection methodologies across the data sources to document the universe of population covered, who provided the data on disability at the household level (head of the household or the individual member with disability), and we reviewed the key questions that were asked to document disability. A detailed review of the definitions of disability–overall and by each type–was done for the Census 2011 and household surveys. We reviewed the Census and the survey manuals to understand the operationalisation of the disability related questions [33, 34]. The types of disability assessed included mental, visual, hearing, speech, movement, multiple, and others.
We calculated the disability rate (DR) as the number of people with disability per 100,000 population from each data source. The overall DR and that by each type of disability was compared between the data sources to assess the validity of these estimates. We pooled the data from DLHS-4 and AHS round 2 (same survey time period as DLHS-4) to generate the DR for India for 2012–13 from household survey. We report the DR estimates for India and for each state from all the data sources, including the percent difference in the respective rates between the data sources. For India DR, we report the rate without the states/Union Territories of Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep as data for these were not available from the household surveys. As the state of Telangana was created in 2014 out of Andhra Pradesh, data for the states of Andhra Pradesh and Telangana were separated by their districts in Census 2011 to produce separate DR for these two states for its comparison with household surveys. Furthermore, as three rounds of AHS data were available over a period of three years, we compared the overall DR and that by type within the subsequent rounds of the AHS in the nine states to explore the reliability of these estimates.
All analyses were done in STATA V.13.0 (StataCorp, College Station, Texas, USA) and Microsoft Excel 2016. As this analysis was based on secondary data available in public domain without personal identifiers, no ethics approval was needed.
Results
Data collection methods
Population universe.
The Census collected data from individuals residing in “normal”, “institutional” and “houseless” households, whereas the household surveys collected data from individuals residing in “normal” households. Both the data sources captured information for all ages.
Type of respondent.
Table 2 documents the respondent for the disability information across the data sources. In Census 2011, the questions on disability were asked from one member of the household during the population enumeration phase. The Census manual states that every possible effort is to be made to seek information on disability from the person with disability herself/himself, if she/he was present at the time of Census and was able to provide information. However, it is not possible to know what proportion of the data were proxy and self-reported. In the household surveys, the information on disability was collected from the head of the household or an adult respondent. Therefore, disability data was collected through proxy reporting in the surveys, however, it is not entirely clear whether the data were proxy-reported or self-reported or a mix of both in the Census 2011.
Questions to document disability.
The Census 2011 had a screening question before asking for the type of disability whereas the surveys had only a single question to document disability (Table 2). Both Census and survey manuals provided instructions to the interviewers to explain to the respondent the actual purpose of the question and emphasize that the information on the number and type of disability would help the government in planning for the welfare of the people with disability. The Census manual in addition mentions that this information will help in taking adequate measures to provide equal opportunities in education and employment for people with disabilities, and will help in making public transportation, health services accessible to them. Even though the AHS question is phrased as “any form of disability” without specifically using the terms “physical or mental disability”, the operationalization of the question appears to be similar to the Census question as the survey manual instructs the interviewer to find out from the respondent if any member is suffering from any physical or mental disability.
Overall disability
Both the data sources used nearly similar definition for overall disability in which disability is defined as a certain physical or mental impairment that resulted in restricted movement or senses or activity (S1 Table). The DR in Census 2011 (2,241.9; 95% CI 2,241.1–2,242.8) per 1,000 population was 25.1% higher than that in the surveys in 2012–13 (1,791.4; 95% CI 1,785.9–1,796.9) as shown in Table 3. Substantial variations at the state level were seen in DR between the sources ranging from -64% in Tamil Nadu to 107% in Sikkim (Fig 1 and S2 Table). The DR increased in the successive rounds of AHS in all the nine states with no specific pattern emerging by each state (Table 4). The DR increase in the states of Chhattisgarh and Rajasthan was nearly 4 times high between AHS baseline and round 1 than between AHS rounds 1 and 2, while an opposite pattern was seen in Odisha.
*Andhra Pradesh and Telangana were separated by the districts in the Census 2011. †Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). ‡Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Movement disability
Both the data sources considered movement disability irrespective of the use of a walking aid (S1 Table). The survey clearly states that any temporary limitation in the movement was not classified as movement disability, however this is not very clear in the Census. The Census definition included example of routine movement activities but the survey did not.
The movement DR was 19.7% lower in the Census 2011 (451.9; 95% CI 451.5–452.3) than the household survey (562.5; 95% CI 559.4–565.6, Table 3). Movement disability accounted for 20.2% and 31.4% of all disability in the Census and surveys, respectively. The difference in movement DR between the sources ranged from -51% in Tripura to 204% in Sikkim (Fig 2 and S2 Table). The movement DR increased across the successive rounds of AHS in all states except Uttar Pradesh and Uttarakhand (Table 4). The movement DR increased more between the AHS baseline and round 1 than between the AHS rounds 1 and 2 in the states of Assam (17 times) and Chhattisgarh (4 times) while an opposite pattern was seen in Odisha (6 times).
*Andhra Pradesh and Telangana were separated by the districts in the Census 2011. †Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). ‡Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Visual disability
In both the data sources (S1 Table), individuals were considered with visually disabled based on their presenting vision (with corrective measure if in use). Furthermore, in the Census it is mentioned that the respondents were asked to count fingers from a distance of 10 feet in good day light to ascertain blurred vision but it is not clear if this was performed on all household members or only those who complained of visual disability. The Census also states that persons with night blindness or colour blindness only were not considered as having visual disability while the surveys do not mention anything specifically. One-eyed people were not considered as having visual disability in either source.
The visual DR was estimated to be 21.9% higher in the Census (421.4; 95% CI 421.0–421.8 than the household survey (345.8; 95% CI 342.4–348.2, Table 3). Visual disability accounted for 18.8% and 19.3% of all disability in the Census and survey, respectively. The difference in visual DR between the sources ranged from -84% in Tamil Nadu to 103% in Uttar Pradesh followed by Uttarakhand (98%) (Fig 3 and S2 Table). Visual DR declined more between AHS rounds 1 and 2 than between AHS baseline and round 1 (Table 4) in Odisha (-11.6% vs -2.7%), Uttar Pradesh (-11.7% vs -8.4%), and Uttarakhand (-10.4% vs -1.0%). In the remaining AHS states, visual DR increased across successive rounds and the range of increase varied substantially from Chhattisgarh (6.9 times) to Bihar (1.5 times).
*Andhra Pradesh and Telangana were separated by the districts in the Census 2011. †Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). ‡Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Hearing disability
Both the data sources considered hearing disability irrespective of the use of hearing aid, and persons with hearing disability in one ear were not considered as having disability in either data source (S1 Table). A person born with hearing disability who was also unable to speak (deaf and mute) was considered as having multiple disabilities in the Census; the survey does not categorically mention anything about persons who were both deaf and mute.
The hearing DR was 125.5% higher in the Census (425.9; 95% CI 425.5–426.3) than the survey (188.9; 95% CI 187.1–190.7, Table 3). Hearing disability accounted for 19.0% and 10.5% of the total disability in the Census and survey, respectively. The difference in hearing DR between the sources ranged from -67% in Nagaland to 436% in Uttar Pradesh (Fig 4 and S2 Table). The hearing DR declined between AHS baseline and round 1 in Uttar Pradesh (18.7%), while it declined between AHS rounds 1 and 2 in Odisha (-30.2%) and Uttarakhand (-13.2%) (Table 4). The increase in hearing DR was more between AHS baseline and round 1 than AHS rounds 1 and 2 in Rajasthan (128.6% vs 11.6%) Madhya Pradesh (16.4% vs 3.5%), and Chhattisgarh (48.3% vs 27.0%).
* Andhra Pradesh and Telangana were separated by the districts in the Census 2011. † Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). ‡ Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Mental disability
The Census definition of mental disability was more comprehensive than the survey though both the data sources aimed to cover mental retardation and mental illness (S1 Table). The survey did not differentiate between mental retardation and mental illness for documentation whereas the Census did. The survey definition stated that persons who show sign of mental fatigue or dependency on others due to old age will not be considered as having mental disability, whereas it appears that the Census may have included them under this category of disability. It is interesting to note that the Census clearly states that people/students who are slow learners or with delayed development are not necessarily mentally retarded.
The mental DR was 25.7% lower in the Census (183.9; 95% CI 183.6–184.2) than the survey (247.4; 95% CI 245.3–249.4; Table 3). Mental disability accounted for 8.2% and 13.8% of all disability in the Census and survey, respectively. Across the states, the percent difference in mental DR between data sources ranged from -56% in Telangana to 26% in Sikkim (Fig 5 and S2 Table). Within the AHS rounds, mental DR increased in all states except Uttarakhand and Uttar Pradesh (Table 4). The increase in mental DR was higher between AHS baseline and round 1 than between AHS rounds 1 and 2 in Chhattisgarh (3 times), Madhya Pradesh (3.5 times) and Rajasthan (2.7 times), while it was higher in rounds 1 and 2 in Odisha (8 times), Assam (8 times) and Bihar (1.8 times).
* Andhra Pradesh and Telangana were separated by the districts in the Census 2011. † Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). ‡ Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Speech disability
Speech disability was assessed for persons aged 3 years and more in both the sources. The definition of speech disability was more or less similar between the two sources with the only difference being that the survey also included articulation defects along with stammering (S1 Table).
The speech DR was higher in the Census 2011 (169.9; 95% CI 169.7–170.1) by 54.2% than the surveys (110.2; 95% CI 108.8–115.5, Table 3). Speech disability accounted for 7.6% and 6.1% of the total disability in the Census and survey, respectively. The difference in speech disability between the sources ranged from -43% in Punjab to 300% in Maharashtra (Fig 6 and S2 Table). The speech DR increased between AHS baseline and round 1 (Table 4) and the range of increase varied substantially from Bihar (13.9%) to Odisha (116.9%). Between the AHS rounds 1 and 2, the speech DR declined in Odisha (-18.9%) and Rajasthan (-14.2%).
*Only for ages 3 years and above. †Andhra Pradesh and Telangana were separated by the districts in the Census 2011. ‡ Includes pooled data from the District Level Household Survey-4 (2012–13) and Annual Health Survey 2nd updation round (2012–13). § Data not available in the household survey for Delhi, Gujarat, Jammu and Kashmir, Dadra and Nagar Haveli, Daman and Dui, and Lakshadweep.
Multiple disability
The definition of multiple disability was similar in the Census and survey (S1 Table). The multiple DR was 10.3% higher in the Census (176.0; 95% CI 175.7–176.2) than the survey (159.5; 95% CI 157.9–161.2; Table 3). The difference in multiple DR between the sources ranged from -76% in Tamil Nadu to 198% in Kerala (S1 Fig and S2 Table). Between AHS baseline and round 1 (Table 4), the multiple DR increased in Chhattisgarh (30.4%), Madhya Pradesh (12.0%) and Uttar Pradesh (8.3%) but declined in Odisha (-25.1%) and Assam (-23.6%). The multiple DR increased in Odisha (8.5%) but declined in Assam (-22.2%) and Uttar Pradesh (-6.9%) between AHS rounds 1 and 2.
Other disability
A person with autism was considered as having other disability in Census while the survey does not mention this specifically (S1 Table). The other DR was 133% higher in the Census (412.8; 95% CI 412.4–413.2) than the surveys (177.2; 95% CI 175.4–178.9; Table 3). The difference in other DR between the sources ranged from -77% in Tamil Nadu to 450% in Madhya Pradesh (S2 Fig and S2 Table). Across all AHS states there was significant increase in other DR between AHS rounds 1 and 2 and ranged from 929% in Odisha to 24% in Chhattisgarh (Table 4).
Discussion
We found the overall disability estimate for India to be 25.1% higher in the Census than in the household survey, and the rates for all types of disabilities except for the movement and mental disabilities were higher in the former than the latter. The proportion contribution of the different types of disabilities to the overall disability rate also varied between the data sources. The significant variations in the rates by state between the data sources and between the AHS rounds further highlighted the issues with the reliability of these estimates.
Though the difference in the overall DR was only 25% between the Census and household survey, this difference for hearing DR was 125% and that for mental and speech DR was -26% and 54%, respectively. At the state-level, the variations in disability-specific estimates ranged from -84% to 450%. As the time gap between data collection for the two sources was a maximum of 3 years, such large variations in the disability-specific rates are unexplainable only based on real change over time in the number of people experiencing disability. Similarly, we found wide variations in the yearly estimates of disability in the successive rounds of AHS which used the same definition of disability with neither migration nor actual change over time is likely to explain the extent of these variations seen ranging from -25% to 929% at the state-level across the AHS rounds. We discuss the potential reasons for these variations based on the review undertaken for this assessment.
With nearly similar definitions and operationalisation of the disability questions in the field in both the data sources, one would have expected similar rates across the sources. However, the Census recorded a higher rate than the survey for visual (22%), speech (54%), and hearing (125%) DR, whereas the survey recorded higher rates for movement (20%) and mental (26%) DR. This range of the variations in DR suggests further issues with the documentation of disability despite nearly similar definitions. We took a deep dive into the visual and hearing disabilities and compared these with the GBD Study estimates for the year 2011 to assess the validity of these estimates [35]. The visual DR in the Census was 421 per 100,000 population and was 345.8 in the survey with nearly similar definition of visual disability, except that the Census mentions checking for blurred vision but the process for it is not entirely clear. The GBD Study reported blindness prevalence estimate for India at 803 people per 100,000 population in 2011, which is nearly double of that reported as visual disability in the Census 2011. Furthermore, the GBD Study estimated severe vision loss prevalence at 762 people per 100,000 population in addition to blindness. The hearing DR was reported at 183.9 and 247.4 per 100,000 population in the Census and survey, respectively; and the GBD study estimated the prevalence rate of hearing loss (including severe, profound and complete hearing loss) at 514 people per 100,000 population [35]. In addition to these, moderate hearing loss prevalence in the GBD study was estimated at 2,704 people per 100,000 population. The Census and surveys that are not disability-focused are known to underestimate the true prevalence of disability because of limited space and time for any specific topic, or insufficient scope to collect data on different dimensions of disability [36–38]. Furthermore, this comparison of estimates with the GBD study may also highlight underestimation due to the absence of disease/condition-specific methodology in these sources. For example, the visual DR estimates for GBD study are derived from population-based blindness and visual impairment surveys and health records in India with standard clinical definitions of blindness and visual impairment based on eye examination [39], whereas the Census and DLHS/AHS surveys are based mainly on the proxy reporting of disability. Despite the evidence of varied reporting by proxy method in the health domain [40–45], most large-scale surveys and the Censuses use the proxy method to document disability based on the assumption that one household adult member will provide the same information as his/her household member, which may result in underestimation of disability [40, 46]. Recent evidence from India and Cameroon also suggests that there is less overlap between people who self-report a disability and those who are identified by clinical examination for visual, hearing and musculoskeletal functioning, and recommended measurement of disability at population level using both self-report and clinical examination [47]. Disability prevalence for adults 18 years or more of age has been previously reported at 24.9% for India from the World Health Survey, which again highlights the underestimation of disability prevalence in the two data sources.[29] The extent of variations in DR between the sources clearly suggest an urgent need to review the questions and methodology of data collection in the upcoming Census.
In addition to the above, we also found enormous state-wide variations in the rates of various disabilities between the Census and survey which could possibly be attributed to two reasons. First, the quality of data collection in the Census and surveys across the states could have resulted in measurement error. Several quality issues around data collection methods, skills and capacity of interviewers who collect data, and wording of questions have been highlighted for large-scale data collection in India, including the Census and household surveys, as a major reason for poor comparability of data across the various data sources [22, 48, 49]. For the Census 2011, absent or proxy interviewers who collected data on 1.2 billion people in just 20 days has been previously highlighted [22]. Second, these wide variations at the state-level may also reflect the way respondents interpret and respond to questions which may result in a systematic measurement error [14]. The social context and cultural circumstances around disability are known to influence it’s reporting [8]. For the Census 2011, underestimation of disability due to the social stigma despite the Census having run a campaign around accurately reporting disabilities has been previously highlighted [22]. Furthermore, the large variations seen in the yearly estimates of disability in the successive rounds of AHS raise further concerns about the validity and reliability of these estimates highlighting issues around how the questions were operationalized, how the respondents interpreted questions, how able and willing the respondents were to provide correct answers, and how accurately the answers were coded and classified [50]. Given these issues, the comparison of disability rates across the Indian states using these data may not be appropriate [37]. These findings suggest that prioritization is needed to better understand the validity and reliability of the questions used in the upcoming Census to document disability in India at the state-level to revise the questionnaire as necessary to obtain more robust disability estimates [51, 52].
Furthermore, in the Indian Rights of Persons with Disabilities Act (RPDA) 2016, persons with disabilities are categorised into three groups—with benchmark disability, with disability, and with disability having high support needs [18]. It is not clear how these categories are arrived at as neither of the two data sources collected data that allows for such details, thereby, further undermining the framing of policy and programs for people with disability in India [53]. The conceptual and definitional variability not only has an immediate impact on disability estimates, but may contribute in the long run to inconsistent or insufficient policy solutions and, may negatively impact the lives of those experiencing disability [54]. The WGSS approach has been incorporated into the United Nations principles and recommendations for the Censuses [55], and has been intensively tested in many countries [14, 56]. The WGSS relies on self-reporting wherein the respondent is not required to term him/herself as having disability, and participation restriction is documented related to seeing, hearing, locomotion, mental function, self-care and communication [16]. This approach does not use the term ‘disability’ in attempting to estimate the disability prevalence, given how stigma filled it may be and given the multitude of meanings people may attribute to this word [7]. In 2016, the WGSS was designated as the preferred method to use with the SDGs to number the world’s population of people with a disability by a group of leading UN agencies, civil society actors, and independent experts [57]. It is important to note that despite the several limitations of the WGSS including difficulty in developing questions that can elicit internationally comparable data [7, 57], it is a validated tool that can provide a quick, effective, and inexpensive way to generate disability data for governments, civil society, and research [57]. The WGSS has not been widely used in India. Two studies with relatively small sample sizes have highlighted issues related to documenting accurate disability data with the WGSS, and have called for the need for testing of the WGSS in India at a larger scale [47, 58]. With the extent of underestimation, validity and reliability issues highlighted in the disability estimates of Census 2011, the Indian government should initiate a dialogue with the relevant stakeholders within and external to the government to deliver estimates that are globally comparable and locally relevant to inform program planning for people with disabilities [38, 59]. Importantly, the context provided to the respondent for operationalisation of the questions for data collection also needs to be considered carefully to ensure that the prevalence is neither under or over-estimated [7].
In conclusion, with India having ratified the CRPD and being committed to SDGs, there is an urgent need to improve the disability estimates as well as an opportunity in the upcoming decennial Census of 2021, which India cannot afford to miss.
Supporting information
S1 Table. Definition of disability type in the Census 2011 and household surveys 2012–13.
https://doi.org/10.1371/journal.pone.0222159.s001
(DOCX)
S2 Table. Comparison of disability rates for the Indian states between the Census 2011 and household surveys (HH survey) 2012–13.
https://doi.org/10.1371/journal.pone.0222159.s002
(DOCX)
S1 Fig. Percent difference in multiple disability rate* between the Census 2011† and household survey 2012–2013‡ § for each Indian state.
https://doi.org/10.1371/journal.pone.0222159.s003
(DOCX)
S2 Fig. Percent difference in other disability rate* between the Census 2011† and household survey 2012–2013‡ § for each Indian state.
https://doi.org/10.1371/journal.pone.0222159.s004
(DOCX)
References
- 1.
United Nations. Disability and Development Report: Realizing the Sustainable Development Goals by, for and with persons with disabilities New York: United Nations, 2018.
- 2.
United Nations. Convention on the Rights of Persons with Disabilities [A/RES/61/106] [cited 2019 22 July]. https://www.un.org/development/desa/disabilities/resources/general-assembly/convention-on-the-rights-of-persons-with-disabilities-ares61106.html.
- 3.
United Nations. The Sustainable Development Goals [cited 2019 22 July]. https://www.un.org/sustainabledevelopment/sustainable-development-goals/.
- 4.
World Health Organization and World Bank. World Report on Disability. Manila: World Health Organization, 2011.
- 5. Murray CJ, Barber RM, Foreman KJ, Abbasoglu Ozgoren A, Abd-Allah F, Abera SF, et al. Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition. Lancet (London, England). 2015;386:2145–91. Epub 2015/09/01. pmid:26321261
- 6. Kostanjsek N, Good A, Madden RH, Üstün TB, Chatterji S, Mathers CD, et al. Counting disability: global and national estimation. Disability and rehabilitation. 2013;35:1065–9. pmid:23725494
- 7. Mont D. Measuring health and disability. Lancet 2007;369:1658–63. Epub 2007/05/15. pmid:17499607
- 8.
Mont D. Measuring disability prevalence: Special Protection, World Bank; 2007.
- 9. Loeb ME, Eide AH, Mont D. Approaching the measurement of disability prevalence: the case of Zambia. ALTER-European Journal of Disability Research/Revue Européenne de Recherche sur le Handicap. 2008;2:32–43.
- 10. Barbotte E, Guillemin F, Chau N. Prevalence of impairments, disabilities, handicaps and quality of life in the general population: a review of recent literature. Bulletin of the World Health Organization. 2001;79:1047–55. pmid:11731812
- 11.
United Nations. United Nations Disability Statistics Compendium. New York: United Nations 1990.
- 12. O’Donovan MA, Good A. Towards comparability of data: using the ICF to map the contrasting definitions of disability in Irish surveys and census, 2000–2006. Disability and rehabilitation. 2010;32 Suppl 1:S9–16. Epub 2010/09/18. pmid:20846074
- 13.
United Nations. Sustainable Development Goals: United Nations; [cited 2019 1 March]. https://sustainabledevelopment.un.org/.
- 14. Madans JH, Loeb M. Methods to improve international comparability of census and survey measures of disability. Disability and rehabilitation. 2013;35:1070–3. Epub 2012/10/02. pmid:23020151
- 15. Madans JH, Loeb ME, Altman BM. Measuring disability and monitoring the UN Convention on the Rights of Persons with Disabilities: the work of the Washington Group on Disability Statistics. BMC public health. 2011;11 Suppl 4:S4. Epub 2011/06/03. pmid:21624190
- 16.
Washington Group on Disability Statistics. Short set of disability questions. 2016 [cited 2019 22 July]. http://www.washingtongroup-disability.com/washington-group-question-sets/short-set-of-disability-questions/.
- 17.
The Department of Empowerment of Persons with Disabilities. Ministry of Social Justice and Empowerment, Government of India.,. Welcome to our site: Government of India; [cited 2019 1 March]. http://disabilityaffairs.gov.in/content/.
- 18.
Ministry of Law and Justice, Government of India. The rights of persons with disabilities Act, 2016. New Delhi: Government of India; 2016.
- 19.
Ministry of Social Justice and Empowerment, Government of India. The National Policy for Persons with Disabilities. In: Disabilities DoEoPw, editor. New Delhi: Government of India; 2006.
- 20.
Ministry of Statistics and Programme Implementation. Disabled Persons in India: A statistical profile 2016. New Delhi: Social Statistics Divison, Ministry of Statistics and Programme Implementation, Government of India, 2016.
- 21.
Office of Registrar General & Census Commissioner of India. Census 2011 New Delhi: Ministry of Home Affairs; 2013 [cited 2018 July 20]. http://censusindia.gov.in/.
- 22.
Social Cops. A step-by-step guide to the 2011 Census: its successes, failures and questions 2015 [cited 2019 27 February]. https://blog.socialcops.com/intelligence/data-stories/step-step-guide-2011-census-successes-failures-questions/.
- 23.
District level household & facility survey (Reproductive & child health project) (DLHS-4) 2012–14 Mumbai: International Institute for Population Sciences; [cited 2018 July 20]. http://www.rchiips.org/DLHS-4.html.
- 24.
Office of the Registrar General & Census Commissioner, Ministry of Home Affairs, Government of India. India Annual Health Survey New Delhi, India: Office of the Registrar General & Census Commissioner; 2010–11.
- 25.
Office of the Registrar General & Census Commissioner, Ministry of Home Affairs, Government of India. India Annual Health Survey New Delhi, India: Office of the Registrar General & Census Commissioner; 2011–12.
- 26.
Office of the Registrar General & Census Commissioner, Ministry of Home Affairs, Government of India. India Annual Health Survey New Delhi, India Office of the Registrar General & Census Commissioner; 2012–13 [cited 2018 11 October].
- 27.
National Sample Survey Organization. Disabled persons in India, NSS 58th Round (July-December 2002). New Delhi: Ministry of Statistics and Programme Implementation, Government of India, 2003.
- 28. Mitra S, Sambamoorthi U. Disability prevalence among adults: estimates for 54 countries and progress toward a global estimate. Disability and rehabilitation. 2014;36:940–7. Epub 2013/08/22. pmid:23962193
- 29. Mitra S, Sambamoorthi U. Disability estimates in India: What the census and NSS tell us. Economic and political weekly. 2006:4022–6.
- 30.
The Persons with Disabilities (Equal Opportunities, Protection of Rights and Full Participation) Act, 1995, Gazette of India (Extra-Ordinary) 2016 [cited 2018 July 20]. http://thenationaltrust.gov.in/upload/uploadfiles/files/Persons%20with%20Disability%20Act%201995.pdf.
- 31.
The National Trust Act 1999 (No. 44 of 1999) New Delhi: Ministry of Scoial Justice & Empowerment; [cited 2018 July 20]. http://thenationaltrust.gov.in/upload/uploadfiles/files/National%20Trust%20Act%20-%20Englsih.pdf.
- 32.
Annual health survey bulletin 2010–11 New Delhi: Office of Registrar General & Census Commissioner, Ministry of Home Affairs, Government of India. http://www.censusindia.gov.in/vital_statistics/AHSBulletins/files/AHS%20bulletinppt.pdf.
- 33.
Office of the Registrar General & Census Commissioner India. Instruction Manual for Updating of Abridged Houselist and Filling up of the Household Schedule: Government of India; 2011 [cited 2019 15 July]. http://censusindia.gov.in/2011-Documents/Updating%20of%20Abridged%20Houselist-English.pdf.
- 34.
Office of the Registrar General & Census Commissioner India. The Annual Health Survey—Interviewer Manual. Government of India; 2011.
- 35.
Institute for Health Metrics and Evaluation. GBD Compare. Seattle, Washington: IHME; 2019 [cited 2019 1 March]. https://vizhub.healthdata.org/gbd-compare/.
- 36.
Subedi M. Challenges to measure and compare disability: A methodological concern 1. State, Society and Health in Nepal: Routledge India; 2018. p. 134–51.
- 37. Saikia NBJ, Jasilionis D, Shkolnikov VM. Disability divides in India: evidence from the 2011 census. PloS one. 2016;11:e0159809. pmid:27490469
- 38. White C. An update to measuring chronic illness, impairment and disability in national data sources. Health statistics quarterly. 2009;42:40–53.
- 39. Bourne RRA, Flaxman SR, Braithwaite T, Cicinelli MV, Das A, Jonas JB, et al. Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. The Lancet Global health. 2017;5:e888–e97. Epub 2017/08/07. pmid:28779882
- 40. Todorov A, Kirchner C. Bias in proxies’ reports of disability: data from the National Health Interview Survey on disability. American Journal of Public Health. 2000;90:1248. pmid:10937005
- 41. Rothman ML, Hedrick SC, Bulcroft KA, Hickam DH, Rubenstein LZ. The validity of proxy-generated scores as measures of patient health status. Medical care. 1991;29:115–24. Epub 1991/02/01. pmid:1994145
- 42. Mathiowetz NA, Groves RM. The effects of respondent rules on health survey reports. Am J Public Health. 1985;75:639–44. Epub 1985/06/01. pmid:4003628
- 43. Bassett SS, Magaziner J, Hebel JR. Reliability of proxy response on mental health indices for aged, community-dwelling women. Psychology and aging. 1990;5:127–32. Epub 1990/03/01. pmid:2317291
- 44. Oksuzyan A, Sauer T, Gampe J, Hohn A, Wod M, Christensen K, et al. Is Who you Ask Important? Concordance Between Survey and Registry Data on Medication Use Among Self- and Proxy-Respondents in the Longitudinal Study of Aging Danish Twins and the Danish 1905-Cohort Study. The journals of gerontology Series A, Biological sciences and medical sciences. 2018. Epub 2018/06/21. pmid:29924318
- 45. Tennant A, Badley EM, Sullivan M. Investigating the proxy effect and the saliency principle in household based postal questionnaires. Journal of epidemiology and community health. 1991;45:312–6. Epub 1991/12/01. pmid:1839034
- 46. Shields M. Proxy reporting of health information. Health reports. 2004;15:21–33. Epub 2004/06/24.
- 47. Mactaggart IKH, Murthy GVS, Oye J, Polack S.,. Measuring Disability in Population Based Surveys: The Interrelationship between Clinical Impairments and Reported Functional Limitations in Cameroon and India. PLOS ONE. 2016;11:e0164470. pmid:27741320
- 48.
Agrawal A, Kumar V. How reliable are India’s official statistics?: EastAsiaForum: Economics, Politics and Public Policy in East Asia and the Pacific; 2012 [cited 2019 27 February]. http://www.eastasiaforum.org/2012/04/06/nagaland-s-demographic-somersault-how-reliable-are-india-s-official-statistics/.
- 49. Borkotoky K, Unisa S. Indicators to examine quality of large scale survey data: an example through district level household and facility survey. PLoS One. 2014;9:e90113. Epub 2014/03/07. pmid:24598760
- 50. Brault MW. Review of changes to the measurement of disability in the 2008 American Community Survey. US Census Bureau. 2009;14.
- 51. Andresen EM, Fitch CA, McLendon PM, Meyers AR. Reliability and validity of disability questions for US Census 2000. American Journal of Public Health. 2000;90:1297. pmid:10937013
- 52. Kuruvilla S, Joseph A. Identifying disability: comparing house-to-house survey and rapid rural appraisal. Health policy and planning. 1999;14:182–90. pmid:10538721
- 53.
Ministry of Social Justice and Empowerment, Government of India. Scheme for Implementation of Rights of Persons with Disabilities Act, 2016. Government of India; 2019 [cited 2019 1 March]. http://disabilityaffairs.gov.in/content/page/sipda.php.
- 54. Sabariego C, Oberhauser C, Posarac A, Bickenbach J, Kostanjsek N, Chatterji S, et al. Measuring Disability: Comparing the Impact of Two Data Collection Approaches on Disability Rates. International journal of environmental research and public health. 2015;12:10329–51. Epub 2015/08/27. pmid:26308039
- 55.
United Nations Department of Economic and Social Affairs. Principles and Recommendations for Population and Housing Censuses (Revision 2) Statistical papers Series M No. 67/Rev.2. New York: Statistics Division United Nations, 2008.
- 56. Schneider M. The difference a word makes: responding to questions on ‘disability’ and ‘difficulty’ in South Africa. Disability and rehabilitation. 2009;31:42–50. Epub 2009/02/06. pmid:19194809
- 57. Groce NE, Mont D. Counting disability: emerging consensus on the Washington Group questionnaire. The Lancet Global health. 2017;5:e649–e50. Epub 2017/06/18. pmid:28619216
- 58. Mopari R, Garg B, Puliyel J, Varughese S. Measuring disability in an urban slum community in India using the Washington Group questionnaire. Disability and health journal. 2019;12:263–8. Epub 2018/10/28. pmid:30366789
- 59. Jeffery R, Singhal N. Measuring disability in India. Economic and Political Weekly. 2008:22–4.