Friday, 7 April 2017

Overcoming data challenges in tracking India’s health and nutrition targets

Health,MDG,Nutrition,SDG,World Health Day 2017

Overcoming data challenges in tracking India’s health and nutrition targets

In May 2016, the Health Secretaries of the States and Union Territories of India gathered in the capital and issued “The Delhi Commitment on Sustainable Development Goals for Health”. Among others, the document acknowledged the need to invest in health data collection, analysis and research so that these can properly inform government policies and strategies necessary to address the various challenges facing India’s healthcare. Such commitment is imperative, given that the success of global SDGs over the next 15 years will largely depend on India’s performance. Measuring progress closely to ensure mid-course corrections when needed should be key to India’s health strategy. To examine the issues related to insufficient, district-level data for customised and evidence-based planning, the Observer Research Foundation organised a panel discussion in July 2016, bringing together experts in the field. This paper builds on the key themes discussed by the panel, and from these, draws policy lessons for the road ahead.

About the author

Oommen C Kurian is Fellow, Public Health, at the Observer Research Foundation. He is a researcher trained in economics and community health at the Jawaharlal Nehru University, New Delhi. His research interests include health policy issues, among them, the use of large datasets to analyse health trends and explore workable solutions to the issues confronting the sector. He has previously worked with Oxfam India, Action Aid India, Centre for Enquiry into Health and Allied Themes (CEHAT), Office of the Commissioners of the Supreme Court (Right to Food Case), Centre for Women’s Development Studies (CWDS), Centre for Social Medicine & Community Health (CSMCH), JNU, and Women’s Studies Programme, JNU. He wishes to acknowledge two anonymous referees for their valuable inputs on an early draft of this paper.
“The time spent by the field worker, especially auxiliary nurse midwives, on maintaining various registers and records ranges from 20-30 percent of the total working time. This naturally cuts down the time available for field work.” – 1979, India[1]

Introduction

Health information gathering is a key component of any working health system. However, this function is weak in low and lower middle-income countries, which are perennially plagued by problems of having data that are not only poor in quality but also inadequate for properly informing health policy.[2]  Data capture is often seen as an additional burden on the already scarce human resources, which further weakens implementation capacity.
In the case of India, this systemic weakness has long been identified and acknowledged by the government.  The National Health Policy of 2002 recognised the dire need for systematic and scientific population health statistics.[3] Initial assessments have identified several key issues such as lack of information on non-communicable diseases and injuries, dearth of primary data on causes of death, lack of private health sector numbers, and insufficient data at the district level.[4] India’s achievements with health data remain limited, considering that it has been a pioneer among developing countries in establishing data systems: the National Sample Surveys (NSS) was initiated in 1950, and the Sample Registration System, in the 1960s.[5]
In such a fragmented landscape, government ministries are often left with no choice but to depend on different and incompatible datasets. For example, key central ministries disagreed on whether India was on-track in achieving crucial targets of the Millennium Development Goals (MDG). A case in point is MDG 5, whose target was reduction of maternal mortality ratio (MMR) by three-quarters between 1990 and 2015. While the numbers published by the health ministry (MoHFW)[6] indicated that India will achieve this goal, the Ministry of Statistics (MoSPI) was less optimistic.[7]  It turned out, however, that their respective estimations were based on two separate sets of numbers.
In early 2016, around 200 countries agreed in principle on a global indicator framework as a starting point for the 2030 Agenda and the SDGs. The 17 goals and 169 targets of the SDG framework are complemented by 230 indicators, which is a five-fold jump from the MDGs’ 48 indicators. The MoSPI and NITI Aayog are in the process of integrating the SDGs into national planning processes and finalising the national indicator framework.[8]
Nevertheless, MoSPI suggests that India currently has the capacity to produce data for only 23 out of the 230 SDG indicators. According to officials, with additional investments, India can perhaps produce data for systematically tracking some 50-60 indicators. [9] For the same reason, it will be a huge challenge to identify measurable indicators for tracking national health goals aligned to the SDG goals.[10] NITI Aayog had set itself a deadline of end-2016 for finalising a set of indicators to monitor progress across national development goals.
It is widely accepted that the MDG framework of vertical goals has contributed to the current fragmented approaches to development.[11] The SDG framework tried to overcome this anomaly by introducing a broader set of goals. Tracking these goals is going to be a daunting challenge for governments, international agencies, as well as national statistical offices. To understand the huge regional, inter- and intra-state disparities better in order to remedy them, large amounts of new information will be required.  Indeed, a ‘data revolution’ is needed in terms of making disaggregated data publicly available if India is aiming to achieve—or get anywhere near—the ambitious SDG targets related to health, including those on nutrition.[12]  The following sections offer four recommendations to streamline and build on the existing national statistical infrastructure to facilitate such a data revolution.

Recommendation 1: Transform Civil Registration and Vital Statistics (CRVS) systems to achieve universal coverage.

A Civil Registration System (CRS) can be considered complete if it covers at least 90 percent of all live births and deaths taking place within a country or area.[13] India has made considerable improvement over the last decade in terms of its Civil Registration and Vital Statistics (CRVS) systems coverage (See Table 1). The National Population Policy 2000 had set the goal of achieving universal birth registration by the year 2010.  However, the coverage is not yet enough where the data at the national level can be used to inform decision making. Still, as of 2013, there are 28 States/UTs where the coverage of birth registration is more than 90 percent, and 17 States/UTs where the coverage of death registration is more than 90 percent.[14]
Box 1: The significance of CRVS systems for the health system
Unlike other sources of vital statistics such as censuses and household surveys, the data from Civil Registration and Vital Statistics (CRVS) systems permit the production of statistics on population dynamics, health, and inequities in service delivery on a continuous basis for the country as a whole and for local administrative subdivisions. This provides more accurate information and the ‘denominator’ for assessing progress with plans across sectors for improving economic growth and reducing poverty. Accurate vital statistics and the ability to monitor and respond to causes of death and disability underpin many global targets, including new commitments to universal health coverage and tackling the global epidemic of non-communicable diseases.
Information on the cause of death, when disseminated through vital statistics, can (i) improve the allocation of resources in health services; (ii) provide early insights into trends in disease prevalence so that health officials can design prevention or intervention strategies; (iii) provide more accurate estimates of maternal mortality than are available from other sources; and (iv) reveal unusual patterns of deaths by cause that point to the need for timely interventions.
The overall level of birth registration in India was 85.5 percent in 2013, and according to official sources, 17 States/UTs have achieved the target of 100-percent birth registration, as of 2013. However, there are sharp inter-state differences, and if the two most populous and poorest performing States (Bihar and Uttar Pradesh) are excluded from the analysis, the level of registration of births rises to 96.8 percent.  Similarly, the level of registration of deaths was at 70.9 percent in 2013; and as of 2013, 11 States/UTs have achieved the target of 100-percent registration of deaths. Repeating the exercise and excluding Bihar and UP from the analysis, the level of registration of deaths reaches 85.2 percent. Overall, only eight States/UTs have achieved the target of 90-percent in both birth and death registrations, as of 2013.[15]
Table 1: Civil Registration and Vital Statistics (CRVS) systems coverage in India
Children under 5 years whose birth was registered (%)Level of Registration of Births
StateNFHS 4 2015-16NFHS 3 2005-06CRS 2013
UrbanRuralTotalTotalTotal
West Bengal97.396.796.975.892.8
Uttarakhand81.874.276.738.476.6
Tripura96.889.991.674.491.4
Telengana89.976.582.9NA100
Tamil Nadu98.598.298.385.8100
Sikkim98.698.498.585.779.9
Puducherry99.298.799NA100
Meghalaya89.278.479.843.3100
Manipur74.859.764.830.4100
Maharashtra95.894.695.180100
Madhya Pradesh92.278.481.929.784.1
Karnataka9594.994.958.396
Haryana9494.394.271.7100
Goa98.99998.994.7100
Bihar64.560.360.75.857.4
Assam97.493.894.24397.7
Andhra Pradesh90.179.982.7NA98.5
A & N Islands97.298.497.9NA95.8
Source: NFHS-4 state factsheets, CRS 2013 Report
According to the latest available CRS data (2013), the share of rural areas in total infant deaths registered is only 33.1 percent. While this may suggest under-reporting in the rural areas, it could also be because deaths are registered at the place of death rather than residence. The share of overall male birth registration is 53 percent and female birth registration is 47 percent. Similarly, male deaths registered is 58 percent of total and female deaths, 42 percent, showing considerable difference.[16] State-wise figures on sex-disaggregated proportions of registered births and deaths are given in Table 2.
Table 2: Sex-wise Registered Births and Deaths of Major States (in’000), 2013
1
Source: http://www.censusindia.gov.in/2011-Documents/CRS_Report/CRS_Report2013.pdf
Experts emphasise that further research is needed to determine the extent to which such gender-based differentials in registration numbers represent a rela­tively low probability of registration for women and/or true sex differences in fertility or mortality levels themselves.[17] While previous NFHS rounds have reiterated rural-urban differences in birth registration, gender-based differences are not seen across the country, barring some states. [18] An assessment of the quality of CRS data conducted in 2014 found that Rajasthan under-registered female births. [19]  Inequities based on income also remains a major constraint in achieving birth registration coverage, as Graph 1 clearly shows.
Graph 1: Birth registration of children under 5 years, by wealth quintile
2
Source: http://www.unescapsdd.org/files/documents/PUB_APPJ-Vol-29-No-1.pdf
In 2014, India announced a ‘Vision 2020’ plan towards achieving universal registration of births and deaths by 2020. However, given the trends in the low-performing states, this goal appears unlikely to be achieved with the current efforts.  The key strategies include dissemination of a physician’s manual for improving cause-of-death reporting. In addition, a standardised web-based software application has been developed in order to avoid different packages being used across states. [20] Another transformational initiative is the National Population Register (NPR), an electronic database of more than 1 billion residents of the country. The process of removing duplicates from the database and assigning unique identity numbers is underway.  An initiative has also been launched to integrate the population register with the civil registration system. [21]
CRS has been in operation in India for a long time, and carries the legacies of the colonial rule.  The diversity within the system often comes in the way of cross-coordination. A study by the United Nations Population Fund (UNFPA) in 2013 showed that as administrative systems differed considerably across India prior to independence, the timing of its introduction and the modality has also varied across space. Despite some uniformity after the introduction of the Registration of Births and Deaths Act in 1969, the actual registration is done by officials in the state governments from diverse departments. [22] Most of these officials have different primary roles, and registration of births and deaths often receives a low priority. It is observed that although interdepartmental committees exist at the state level, they are often ineffectual, adversely affecting the completeness and quality of the CRVS system. [23]
Box 2: Who registers births and deaths in India?
The Chief Registrars of births and deaths in 19 States and two UTs are from the Health Department; in 10 States and two UTs are from the Planning, Economics & Statistics Department; in one State (Kerala), from the Panchyat Department; and in the remaining two UTs, with the Local Administration and Revenue Department.  The district-level authorities are mainly divided among District Collectors/District Magistrate (in nine States and one UT); Chief Medical Officers/District Medical and Health (11 States and two UT); District Statistical/ Planning Officers (in four States and one UT); and Deputy Director/Assistant Director (Panchayat) in one State and one UT; and others in remaining States/UT. At the Rural level, the registration work is entrusted to the officials of Panchayat Department in 15 States and three UTs; Health Department in seven States and four UTs; Revenue Department in three States; Education Department in two States and Police Department in one State and one UT.
The Sample Registration System (SRS), which provided mortality statistics for national and state-level MDG tracking was introduced in the 1960s to overcome the deficiencies of the CRS. Over the years, the SRS expanded substantially, and by 2013 it covered a population of about 7.5 million.[24] It has piloted verbal autopsy procedures and reported national summaries of causes of death as part of the Million Deaths Study,[25] which, in turn, have produced morbidity burden estimates far greater than previously believed. This system is not without its shortcomings, though. For example, a recent study based on SRS found that in Rajasthan, 27 percent of female deaths were being missed, suggesting underreporting.[26]  The CRS system collects limited data on socio-economic status, and SRS does not collect it at all. Moreover, unit-level records of SRS are not made available for researchers. [27]
However, the current focus on entrenched interim measures like SRS cannot take away from the need for universalisation of civil registration through adequate “legal, budgetary, and administrative support”.[28] Expansion of the CRS system, including collection of socio-economic data of the deceased remains the single most important goal for improving India’s health statistics infrastructure. Emphasis needs to be put on Bihar and Uttar Pradesh, which considerably pull down the national average for coverage. Steps are needed to improve the quality of data on causes of death collected through verbal autopsy. Fragmentation in the system needs to be overcome, and there must be interdepartmental coordination at the state level. Further, options should be explored to collect data on socioeconomic background as part of SRS and enhance the sample to produce district-level estimates across socio-economic categories.
In 2011 the Commission on Information and Accountability for Women’s and Children’s Health, led by the World Health Organization (WHO), had made 10 recommendations around timely, reliable and accessible health information and data.[29] India was one of the six countries in the South-East Asian region of WHO to make a commitment to implement the 10 recommendations of the Commission. By 2014, eight of the 11 countries in the region had conducted comprehensive assessments of their CRVS systems.[30]  However, WHO still has to succeed in pushing the Government of India to conduct the CRVS assessment at the earliest.[31]

Recommendation 2: Streamline existing national surveys in a way that will improve disaggregated tracking of national goals.

Given the incomplete coverage of CRVS, large-scale, population-based household surveys play an invaluable role in providing health and nutrition information in India.[32]  Reviews have shown that population-based surveys are used extensively to gather information on fertility, mortality, family planning, maternal and child health, and some other aspects of health, nutrition and healthcare in India.[33]
The latest round of the National Family Health Survey (NFHS 2015-16), for the first time in its history, gives district-level estimates. NFHS will now repeat every three years according to plans, and will no doubt help overcome some of India’s health and nutrition data bottlenecks. NFHS 4 replaces the annual health survey (AHS) and district-level household and facility survey (DLHS) – two major sources of health data at the district level during the MDG era.[34]However, as DLHS is the only database so far which has health system-level variables, village-level characteristics and household characteristics, an appraisal may be necessary to determine how such gap would be filled, in the absence of DLHS. The unavailability of regular, good-quality data remains a constraint in the country’s health and nutrition policy. This has an impact on the nature of policy discussions as well, which often remain an exchange of polarised views, uninformed by numbers.
The National Sample Survey (NSS)—set up in 1950 to bridge the large gaps in statistical data needed for planning and policy formulation—still does not give reliable district-level estimates for most indicators. Health-related data that are collected by NSS through what is commonly known as ‘central sample’ data, are a major source for policy research in the country. [35] Many experts fear that over the last two decades, developments like cuts in staff strength, change in recruitment practices, and the creation of a ‘centralised’ Subordinate Statistical Service have resulted in a shortfall of experienced field investigators, which may have compromised the quality of data being collected by the NSSO.[36]   The data are regularly analysed and put in the public domain by MoSPI, and unit-level data made available for a fee. However, considerable resources are also spent to collect what is known as the ‘state sample’, which covers at least a matching number of respondents in each state. Pooling of central and state samples will enhance the policy relevance of NSS data, as these can then be used to arrive at district-level estimates. There have been discussions around pooling of NSS data, though nothing concrete has happened around the idea.[37]
Data availability for major determinants of health like nutrition is severely limited, too. A review of sources of nutrition data in India conducted by the International Food Policy Research Institute (IFPRI) in 2015 identified serious data gaps.[38]  One of the major areas of action identified by the exercise was to prioritise nutrition as a development indicator.  It also recommended the establishment of a reliable system for periodic data-driven updates on the state of nutrition in India. Meanwhile, the Global Nutrition Report’s India country profile highlighted significant gaps including that of timeliness of data.[39] Time series data are not available for core indicators and comparability remains a major challenge, as reference group inconsistencies in child anthropometry within surveys- affects the flexibility of analysis. NFHS, for example, had looked at children under the ages of 4, 3 and 5 for round 1, 2 and 3 respectively. With the National Nutrition Monitoring Bureau (NNMB) having been shut down in 2015, there is a need to take concrete steps towards nutrition monitoring; the NNNB was a major source of data on dietary intake and nutritional status.[40]
In this context, modifying existing surveys in terms of the data collected and their frequency is a policy imperative if India is to have a comprehensive set of health and nutrition indicators to continuously track its health and nutrition targets. Some new variables will need to be tracked. For example, household food insecurity (HFI), a key determinant of stunting in poor Indian children, is not routinely measured by large-scale demographic surveys.[41] A Food Insecurity Experience Scale (FIES) is now being piloted in the Comprehensive National Nutrition Survey (CNNS) conducted by UNICEF and the Ministry of Health and Family Welfare.[42] After testing for the scale’s validity and reliability, it can be added to national surveys to effectively track food security.

No comments:

Post a Comment