An analysis of NIH funding in 1996 found that the strongest predictor of funding, disability-adjusted life-years (DALYs), explained only 39% of the variance in funding. In 1998, Congress requested that the Institute of Medicine (IOM) evaluate priority-setting criteria for NIH funding; the IOM recommended greater consideration of disease burden. We examined whether the association between current burden and funding has changed since that time.
We analyzed public data on 2006 NIH funding for 29 common conditions. Measures of US disease burden in 2004 were obtained from the World Health Organization's Global Burden of Disease study and national databases. We assessed the relationship between disease burden and NIH funding dollars in univariate and multivariable log-linear models that evaluated all measures of disease burden. Sensitivity analyses examined associations with future US burden, current and future measures of world disease burden, and a newly standardized NIH accounting method.
In univariate and multivariable analyses, disease-specific NIH funding levels increased with burden of disease measured in DALYs (p = 0.001), which accounted for 33% of funding level variation. No other factor predicted funding in multivariable models. Conditions receiving the most funding greater than expected based on disease burden were AIDS ($2474 M), diabetes mellitus ($390 M), and perinatal conditions ($297 M). Depression ($719 M), injuries ($691 M), and chronic obstructive pulmonary disease ($613 M) were the most underfunded. Results were similar using estimates of future US burden, current and future world disease burden, and alternate NIH accounting methods.
Citation: Gillum LA, Gouveia C, Dorsey ER, Pletcher M, Mathers CD, McCulloch CE, et al. (2011) NIH Disease Funding Levels and Burden of Disease. PLoS ONE 6(2): e16837. doi:10.1371/journal.pone.0016837
Editor: Joseph Ross, Yale University School of Medicine, United States of America
Received: September 17, 2010; Accepted: January 3, 2011; Published: February 24, 2011
Copyright: © 2011 Gillum et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by NIH/NCRR/OD UCSF-CTSI grant KL2 RR024130. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The National Institutes of Health (NIH) is the largest public funder of biomedical research worldwide , , with a budget that has grown from $11.9 billion in 1996 to $28.5 billion in 2006 . In the mid-1990s, Congress and the public raised concerns that disease-specific funding allocations by the NIH failed to adequately reflect burden of disease and incorporate public input . In response, Congress requested that the Institute of Medicine (IOM) assess the NIH funding apportionment processes. In its 1998 report, Scientific Opportunities and Public Needs: Improving Priority Setting and Public Input at the National Institutes of Health, the IOM recommended improved tracking of disease-specific funding and development of a new priority-setting process .
A landmark study comparing disease burden to NIH funding levels was published in 1999 . For 29 common conditions, the study examined a variety of measures of societal burden, recognizing that none by itself completely captures relative impacts of diseases. Disease incidence and prevalence were unrelated to funding, while mortality and years of life lost (YLLs) weakly correlated with funding. Disability-adjusted life years (DALYs)—a measure that estimates the equivalent number of healthy years lost due to disability or early death , —were more strongly predictive. Using DALYs as the best single predictor, only 39% of the variance in NIH funding could be explained. The prior analysis was limited to evaluation of univariate predictors, and did not attempt to evaluate whether funding aligned with other measures of disease burden. The NIH Reform Act of 2006 re-emphasized the NIH's role in identifying research to meet public health challenges, and mandated submission of a biennial report to Congress regarding disease-specific funding amounts . There has been no recent comprehensive study of US disease burden and NIH funding, and an analysis of only one of its institutes has been performed .
To determine whether the NIH has developed processes that better align funding with burden, we assessed the correlation between NIH funding and burden of disease, and compared results with those reported 10 years ago . We also considered other potential predictors of funding and assessed the association of NIH funding with estimates of future and global disease burden.
In a cross-sectional study, we compared measures of US and world disease burden and sociopolitical factors from 2004 to NIH funding levels in 2006. The study design was modeled on methods previously established , which used 1994 burden data and 1996 NIH funding to reflect an expected lag in availability of data on disease burden. Each disease was defined using pre-specified sets of International Classification of Diseases, 9th revision, Clinical Modification (ICD-9) codes, which were applied to public sources of information on disease burden .
Amounts of NIH funding for disease categories were obtained directly from the NIH for the year 2006 (Table 1). These estimates were annually consolidated from figures supplied by individual NIH Institutes and Centers (http://www.nih.gov/news/fundingresearchareas.htm) . In 2006 and prior years, NIH Institutes and Centers categorized spending in a variety of manners to satisfy diverse reporting requirements, and calculated condition-specific total funds in a non-mutually exclusive manner. Thus, funding for a particular trial or biomarker could have been attributed to multiple conditions.
Data denoting disease burden were collected from multiple sources (Table 1). First, world and North American disease-specific data were obtained from the Global Burden of Disease (GBD) Project the World Health Organization (WHO) , , . We used GBD's North American data for US estimates. The GBD systematically collects timely disease-specific epidemiologic information and models missing data to estimate a variety of measures of burden , . We used 2004 GBD estimates because they were likely to be the most recent publicly available data at the time decisions were made for the 2006 funding cycle. No other centralized, systematic source of broad national disease-specific burden estimates was identified.
We evaluated five disease burden categories from the GBD: incidence, prevalence, mortality, YLLs, and DALYs . YLLs for each disease were calculated by totaling the differences between life expectancy and age at death. DALYs were estimated based on YLL and on standardized weighting schemes for disability applied to those surviving with disease , . GBD estimates for the US were based on analyses of comprehensive death certificate data, national incidence estimates, and a systematic review of published epidemiological studies.
To evaluate other estimates of disease burden, we used 2004 US inpatient and outpatient healthcare databases categorized by diagnosis, each of which includes large samples with weights to generate nationally representative estimates (Supporting Table S1). The number of hospital discharges, total length of stay, and mean hospital charges for disease-specific principal diagnoses were derived from the National Inpatient Sample (NIS) . The number of visits to emergency departments and outpatient hospital clinics were derived from the National Hospital Ambulatory Care Survey (NHAMCS) and the National Ambulatory Care Survey (NAMCS) . In both NIS and NHAMCS, community hospitals were defined as non-federal, short-stay hospitals , .
Public interest could also influence funding levels through lobbying efforts, additional funding support from private foundations, or by directly stimulating the interest of investigators, and this could influence funding levels. To begin to assess the influence of public interest, we determined the number of disease-specific newspaper articles published in the top 10 US newspapers with highest distribution, as well as broadcast television news reports from national networks, using disease-specific keyword searches of LexisNexis News  and Vanderbilt Television News Archive . To estimate the influence of specific interest group advocacy, the total US disease-specific charity revenue was similarly calculated for public charities receiving more than $500,000 in public support .
Scientific productivity in a given area could stimulate further interest from researchers and the NIH, and could result in targeted funding. As surrogate measures of scientific productivity, we tallied the number of disease-specific patents submitted  and articles published and listed in PubMed  in the 10 medical journals with the highest impact factor scores using key word searches .
The relationship between 2006 NIH funding levels and 2004 US disease burden metrics was designated the a priori primary analysis. All predictor and outcome variables were log-transformed to reduce positive skew.
Univariate linear regression was first performed to replicate the prior study design . This approach was preferred to correlation to allow for adjustment and to acknowledge that funding level was the dependent variable to be predicted. Expected funding levels in 2006 were calculated with correction for the log-transformation by applying measures of disease burden to fitted models predicting funding , . To account for inflation, the actual and expected funding levels for 1996 were inflated to 2006 dollars . Standard, forward stepwise multivariable linear regression analysis included all variables of disease burden, including those with p<0.05 in the final model. We did not evaluate interactions. F-statistics were used to estimate differences in explanatory power (significant if p<0.05). A separate forward stepwise multivariable model was constrained so that diseases with no burden would receive zero funding, mimicking a theoretical funding process that determines allocations proportional to the disease burden. For this model, we defined the dependent variable as the ratio of dollars to DALYs for each of the included conditions. Separate multivariable models included measures of public interest and scientific productivity. In additional sensitivity analyses, we evaluated the association of funding levels with worldwide disease burden in 2004, and with projections for 2015 and 2030 for both the US and worldwide . A final analysis evaluated whether a new NIH accounting method for disease-specific funding introduced in 2007 produced different results. Explanatory power of the models was estimated with adjusted R2 values; an adjusted R2 value was also determined for the analysis of 1996 funding levels using data derived from this prior publication. The Stata statistical package (Version 10, College Station, Texas) was used for all analyses.
In 2006, the total NIH budget was $28.5 billion, with $11.9 billion devoted to the 29 included conditions. Disease funding ranged from $17 million (M) for peptic ulcer disease and otitis media, to $2902 M for AIDS, with a median of $335 M (±standard deviation $537 M; Table 1). Other metrics from the GBD (Table 1); US inpatient, emergency room, and outpatient (Supporting Table S1); and public interest and scientific opportunity (Supporting Table S2) varied by disease.
In the univariate analysis, NIH funding was most strongly associated with burden of disease measured in DALYs (p = 0.001; Table 2). YLLs (p = 0.03), inpatient hospital discharges (p = 0.05), and total hospital days (p = 0.02) were also associated with funding levels.
In standard multivariable analysis, DALYs was the only significant predictor of NIH funding level retained in the final model, so the analysis became univariate. In 2006, the degree of correlation between NIH funding and disease burden as measured by DALYs alone was less than in 1996: Only 33% of NIH funding variance was explained in 2006 compared to 39% in 1996. Differences between actual and expected funding based on burden of disease in DALYs were estimated for 2006 and compared to 1996 funding levels (Table 3; Figure 1). Depression received the least funding compared to expected, and AIDS the most, consistent with findings from 1996. Relative to expected funding, AIDS, diabetes, and perinatal conditions were the three diseases with the largest amounts of funding, while depression, injuries, and COPD received the least funding (Table 3). The largest positive 10-year gains in actual NIH funding relative to expected were AIDS (+$809 M), perinatal conditions (+$420 M), and diabetes (+$193 M); by contrast, injuries (−$578 M), depression (−$541 M), chronic obstructive pulmonary disease (−$512 M), and ischemic heart disease (−$459 M) decreased most sharply (Figure 1).
A comparison of differences between actual and expected funding values as predicted by DALYs burden alone in 1996 (light blue) and 2006 (navy). Negative values reflect actual funding dollars less than expected and positive values represent actual funding dollars more than expected.
In standard multivariable regression models including measures of public interest and scientific productivity, the total charity revenue for a given disease in 2006 (p = 0.04) was also predictive of funding in addition to DALYs (p = 0.006). A model including both variables explained 41% of the variation in NIH funding levels.
In multivariable models constrained to require that diseases resulting in no burden of illness receive no NIH funding (equivalent to requiring an intercept of zero-zero in the regression line, expressed in the dashed line of Figure 2), expected funding amounts were generally similar to those found with the unconstrained multivariable model (Table 3; Figure 3).
The solid line represents the results of a traditional multivariable analysis, showing the relationship between US disease-specific DALYs burden and actual 2006 NIH funding dollars. The dashed line projects NIH funding levels in a similar multivariable model that requires that a disease with no burden receives no funding (constrained model). Though the models produce similar results, several diseases that would be considered overfunded in one model are considered underfunded in the other. For example, cervical cancer appears to be overfunded relative to the dashed line, while it is underfunded relative to the solid one.
Determinations of actual funding relative to expected funding were generally similar among separate analytic models predicting funding levels from disease burden measures. Univariate results are based on DALYs alone (navy), the only variable retained in a stepwise forward multivariable model. A traditional multivariable model including public interest variables (grey-blue) retained only DALYs and total charity revenue in the model. A constrained multivariable (light blue) model required an intercept of zero-zero to impose a requirement that conditions with no burden received no funding and retained DALYs, total number of US hospital discharges, and mean charge per hospitalization in 2004.
To determine if NIH funding might better correlate with world or future disease burden, we performed sensitivity analyses with global measures and future projections (2015 and 2030), all derived from the GBD project (Supporting Table S3). When restricted to global measures, mortality (p = 0.05) and DALYs (p = 0.001) were predictive of funding in univariate analyses (adjusted R2 values 0.11 and 0.30), but only DALYs were retained in all the multivariable models of both global measures and future predictions. Correlation of funding with disease burden was not improved when data utilizing new NIH accounting methods was used (adjusted R2 = 0.27) compared to prior methods (adjusted R2 = 0.34) applied to 2007 data, the first year for which the new methods were available.
In the 10 years since an initial assessment of the correlation of NIH funding with disease burden  and an IOM report recommending new NIH funding priority-setting criteria , NIH funding is no better aligned with US disease burden. Furthermore, diseases that were previously funded more than expected–such as AIDS, breast cancer, and diabetes–continue to receive funding greater than predicted by burden of disease, while most conditions that were previously underfunded remain underfunded. Adding measures of disease burden to the model and constraining it to assure that diseases with no burden would receive no funding minimally affected the overall relationship between burden and funding. Neither global nor future disease burden were more closely related to NIH funding, and newly implemented NIH disease-specific accounting practices did not improve the correlation.
Although the IOM report on NIH funding recommended ongoing assessment of alignment of NIH funding with disease burden, it also recognized other important criteria for setting funding priorities . These criteria included research quality, scientific innovation and opportunity, portfolio diversification, and infrastructure building. Other experts have proposed a similar framework to guide funding decisions . Additional factors to consider may include transmissibility or population risk, collateral benefits to disease control, and public interest. Given these other potential contributors to decision-making about disease funding, perfect alignment with DALYs or any other measure of disease burden would not be expected.
It is unclear why particular conditions remain under- or overfunded relative to disease burden. The difficulty of attributing basic science research—a large portion of the NIH portfolio—to individual diseases complicates implementation of any disease-based allocation process ; however, some discrepancies are particularly dramatic. Spending for AIDS research, the disease with greatest funding compared to expected, may be justified due to the potential threat associated with its spread, to past successes in treating and even eliminating other infectious diseases, and to a greater burden in lower income countries. However, AIDS funding remained greater than predicted even when worldwide and projected burden were considered, and strong political influences may be important in maintaining high levels of funding in the US. Also, congressionally-mandated research support for rare illnesses may explain greater funding for some diseases with little burden , , . Conditions typically associated with substance use or mental health diagnoses tended to be underfunded (e.g., lung cancer, chronic obstructive pulmonary disease, alcoholism, and depression). Charity revenue, used as a proxy for disease-specific interest-group advocacy, was associated with funding levels and may have contributed through lobbying efforts or by providing collateral support for research and training to encourage NIH submissions in specific disease areas. The availability of proven cost-effective interventions (e.g., tobacco-related prevention strategies)  may also influence funding since development of new interventions may be unnecessary when effective strategies have already been identified .
Over the 10-year interval, funding for several conditions notably increased compared to expected. For example, the National Institute of Allergy and Infectious Diseases initiated a concerted response to bioterrorism following the terrorist attacks on Sept. 11, 2001, anthrax incidents, and severe acute respiratory syndrome (SARS) outbreak in 2002, and this may have augmented support for pneumonia-related research . Conversely, the relative funding increase for perinatal conditions appears primarily due to a 55% reduction in associated DALYs over the last decade since funding increases over the same period paralleled overall growth in the NIH budget . Finally, an increase in relative funding for diabetes research may have been precipitated by Congressional actions in 1997 requiring development of a comprehensive diabetes research plan and allocating $150 million to a new funding program for Type I Diabetes Research .
Lack of improvement in alignment between funding and disease burden may not indicate neglect of the 1998 IOM recommendations by the NIH; there are several other possible explanations. First, basic science research has consistently accounted for 55% of NIH spending and it is difficult to credit specific disease for much of this research, contributing uncertainty to the analysis and reducing correlations between funding levels and disease burden. Second, NIH funds committed at the time of the 1998 IOM publication could not be redistributed until their associated projects were completed, sometimes five or more years later; as a result, reallocations would be delayed for several years. Third, the distribution of funding among NIH Institutes is determined by Congress and incorporates input from NIH itself, scientists, health care providers, and special interest groups. Thus, fiscal and political constraints likely additionally tempered the NIH's ability to implement the IOM recommendations. Finally, without regard to overall disease funding alignment, substantial financing ($1.8 billion, 6.3% 2006 NIH budget) was invested in the creation of three new centers (National Institution for Biomedical Imaging and Bioengineering, Center for Complementary and Alternative Medicine, and National Center for Minority Health and Health Disparities) , establishment of the cross-cutting Roadmap Initiatives , and expanded emphasis on career training awards .
The NIH has recently taken steps to integrate more effectively the IOM priority-setting criteria. In 2007, the Division of Program Coordination, Planning, and Strategic Initiatives (DPCPSI) was established for the purposes of identifying scientific opportunities, public health challenges, and scientific knowledge gaps, and to improve portfolio analysis and priority-setting . In 2009, a more consistent and transparent system for the tracking of disease-based funding was launched. Also, as part of the NIH's $10.4 billion allocation in the American Recovery & Reinvestment Act, $400 million will be dedicated to comparative effectiveness research that specifically evaluates the effects of clinical management on comprehensive public health outcomes such as mortality, morbidity, and quality of life .
Our study has several limitations. First, the accounting of disease funding in 2006 by NIH is not standardized nor is the reliability known . However, no alternative source of information is publicly available and historical and new accounting methods yielded similarly poor correlations with burden. Second, we did not evaluate other sources of federal, nonprofit, and industry funding. Conditions well-funded by organizations other than the NIH may justify a corresponding decrease in NIH funding . However, other sources of federal funding–The Centers for Disease Control and Prevention, Agency for Healthcare Research and Quality, and the Food and Drug Administration–distributed only 3.3% of all Department of Health and Human Services dollars dedicated to life sciences research in 2006. Similarly, the total life science research dollars spent by the Department of Defense and Department of Veterans Affairs was equivalent to less than 7% of the total amount disbursed by the NIH , . Thus, the total dollars spent on complementary projects by other federal institutions does not fully explain the poor correlation between disease burden and NIH funding. Although biomedical and pharmaceutical industry research funding in the United States was 1.6 times the amount allocated by the NIH in 2006, fully 49% was dedicated to supporting clinical trials less likely to have a widespread public health benefit . Unfortunately, funding by disease for these sectors is not available, except for limited therapeutic areas , and no such figures exist for private foundations. Third, global estimates of disease burden from the WHO GBD are uncertain due to incompleteness and bias, particularly in low-income countries . However, these estimates are the best available and are particularly accurate for the US. Fourth, to permit comparisons to the prior study and to make the study feasible, many diseases and conditions funded by the NIH were omitted from our analysis. Still, an assessment of the responsive of NIH to prior recommendation was central to our study and power would not be expected to dramatically impact our findings. Fifth, the prior analysis utilized estimates for world market economies , while we used North American numbers. The data we used better approximates US burdens, strengthening our conclusions, but could affect the assessment of interval change. Since we found a poorer correlation with funding than previous estimates, this did not impact our conclusions. Finally, none of the measures of disease burden individually or collectively fully captures the health and economic cost of these conditions. A better metric might capture the true societal cost of disease through a comprehensive assessment of total healthcare costs and a valuation of both deaths and DALYs .
Overall, funding levels today are less well aligned with DALYs compared to 10 years ago, suggesting that the IOM's 1998 priority-setting recommendations have not been implemented effectively. Accounting for other measures of disease burden did not substantially improve alignment. As a recipient of substantial governmental support, clear articulation of the rationale for NIH spending may be expected by Congress and the public, and a lack of clear alignment with measures of public burden could encourage special interests to further erode the scientific independence of NIH or to raise questions about its management. The use of more consistent accounting methods for disease funding, more comprehensive measures of burden and future risk that include impact on health and expenditures, and the timely dissemination of benchmarks on the alignment of disease burden to funding could help to make NIH funding priorities more rationale and transparent.
Additional Measures of Disease Burden for 29 Conditions.
Public Interest and Other Measures for 29 Conditions.
World and Future Disability-Adjusted Life-Years as Predictors of NIH Disease-Specific Funding in Fiscal Year 2006.
Conceived and designed the experiments: LAG ERD MP CDM SCJ. Analyzed the data: LAG SCJ. Contributed reagents/materials/analysis tools: LAG CEM SCJ. Wrote the paper: LAG SCJ. Acquisition of data: LAG CG CDM SCJ. Critical revision for intellectual content: LAG ERD MP CDM CEM SCJ. Study Supervision: SCJ LAG. Obtained funding: LAG.
- 1. Moses H 3rd, Dorsey ER, Matheson DH, Thier SO (2005) Financial anatomy of biomedical research. JAMA 294: 1333–1342.
- 2. European Science Foundation (2007) Present status and future strategy for medical research in Europe. European Science Foundation, www.esf.org, accessed October 28, 2008.
- 3. NIH Office of Budget NIH appropriations history by institute and center. Office of Budget, Office of the Director, National Institutes of Health, Department of Health and Human Services, http://officeofbudget.od.nih.gov/UI/AppropriationsHistoryByIC.htm, accessed May 5, 2008.
- 4. Institute of Medicine (1998) Scientific opportunities and public needs: Improving priority setting and public input at the NIH. National Institutes of Health Priority Setting Committee, Institute of Medicine. National Academy Press, http://www.nap.edu, accessed March 1, 2008.
- 5. Gross CP, Anderson GF, Powe NR (1999) The relation between funding by the National Institutes of Health and the burden of disease. N Engl J Med 340: 1881–1887.
- 6. Morrow RH, Bryant JH (1995) Health policy approaches to measuring and valuing human life: conceptual and ethical issues. Am J Public Health 85: 1356–1360.
- 7. Murray CJL (1996) Rethinking DALYs. In: Murray CJL, Lopez AD, editors. The global burden of disease. Cambridge: Harvard School of Public Health on behalf of the World Health Organization and the World Bank. pp. 1–98.
- 8. National Institutes of Health Reform Act of 2006.
- 9. Nahin RL (2005) Identifying and pursuing research priorities at the National Center for Complementary and Alternative Medicine. FASEB J 19: 1209–1215.
- 10. World Health Organization (2006) Global burden of disease: Cause Category and ICD-9 Codes.: World Health Organization. The World Bank Group, http://www.dcp2.org/pubs/GBD/3/Table/3.A2, accessed February 8, 2008.
- 11. National Institutes of Health (2008) Estimates of funding for various diseases, conditions, research areas. National Institutes of Health, Department of Health and Human Services, http://www.nih.gov/news/fundingresearchareas.htm, accessed May 16, 2007.
- 12. Lopez AD (2005) The evolution of the Global Burden of Disease framework for disease, injury and risk factor quantification: developing the evidence base for national, regional and global public health action. Global Health 1: 5.
- 13. Lopez AD, Mathers CD, Ezzati M, Murrary CJL, Jamison DT (2006) Global burden of disease and risk factors. New York: Oxford University Press.
- 14. World Health Organization (2008) The global burden of disease: 2004 update. Geneva, Switzerland: WHO Press.
- 15. Murray CJ, Lopez AD (1997) Global mortality, disability, and the contribution of risk factors: Global Burden of Disease Study. Lancet 349: 1436–1442.
- 16. Murray CJL, Lopez AD, Harvard School of Public Health, World Health Organization, World Bank (1996) The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge, MA: Harvard University Press.
- 17. Healthcare Cost and Utilization Project (2008) HCUPnet: National statistics on hospital stays. Agency for Healthcare Research and Quality, http://hcupnet.ahrq.gov/, accessed December 15, 2007.
- 18. National Center for Health Statistics (2008) Ambulatory health care data: National Ambulatory Medical Care Survey (NAMCS). Centers for Disease Control and Prevention, US Department of Health and Human Services, http://www.cdc.gov/nchs/about/major/ahcd/ahcd1.htm, accessed November 29, 2007.
- 19. Agency for Healthcare Research and Quality (2005) Introduction to the HCUP Nationwide Inpatient Sample (NIS), http://www.hcupus.ahrq.gov/db/nation/nis/NIS_Introduction_2005.jsp Introduction 2005.jsp, accessed May 1, 2008.
- 20. National Center for Health Statistics (2008) Ambulatory health care data: National Hospital Ambulatory Medical Care Survey (NHAMCS). Centers for Disease Control and Prevention, US Department of Health and Human Services, http://www.cdc.gov/nchs/about/major/ahcd/ahcd1.htm, accessed November 29, 2007.
- 21. LexisNexis News (2008) ed: Reed Elsevier Inc, http://www.lexisnexis.com, accessed June 5, 2008.
- 22. Vanderbilt Univeristy (2008) Vanderbilt Television News Archive. http://tvnews.vanderbilt.edu/, accessed July 15, 2008.
- 23. Charity Navigator (2006) Your guide to intelligent giving, www.charitynavigator.com, accessed August 14, 2008.
- 24. United States Patent and Trademark Office (2008) USPTO patent full-text and image database: patent applications. United States Patent and Trademark Office, http://patft.uspto.gov/, accessed July 11, 2008.
- 25. National Center for Biotechnology Information (2008) PubMed Central. US National Library of Medicine, http://www.ncbi.nlm.nih.gov/sites/entrez/, accessed August 7, 2008.
- 26. Saha S, Saint S, Christakis DA (2003) Impact factor: a valid measure of journal quality? J Med Libr Assoc 91: 42–46.
- 27. Bradu D, Mundlak Y (1970) Estimation of lognormal linear models. Journal of the American Statistical Association 65: 198–211.
- 28. Goldberger AS (1968) The interpretation and estimation of Cobb-Douglas functions. Econometrica 36: 464–472.
- 29. Friedman MS (2008) The Inflation Calculator. S. Morgan Friedman, http://www.westegg.com/inflation/, accessed November 11, 2008.
- 30. Mathers CD, Loncar D (2006) Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 3: e442.
- 31. Lichtenberg FR, American Enterprise Institute for Public Policy Research (1999) The allocation of public funds for biomedical R&D. Washington, D.C.: AEI Press.
- 32. National Institutes of Health (1993) Cost-savings resulting from NIH research support. 2nd ed. NIH Publication 93-3109. Rockville, MD.
- 33. Food and Drug Administration (2008) Clinical studies of safety and effectiveness of orphan products. Research project grant (RO1). RFA-FD08-001. U.S. Food and Drug Administration, U.S. Department of Health and Human Services, http://grants.nih.gov/grants/guide/rfa-files/RFA-FD-08-001.html, accessed November 1, 2008.
- 34. Food and Drug Administration (2008) Office of Orphan Products Development. U.S. Food and Drug Administration, http://www.fda.gov/orphan/, accessed November 1, 2008.
- 35. NIH Office of Rare Diseases (2008) National Institutes of Health, Department of Health and Human Services, http://rarediseases.info.nih.gov/, accessed November 1, 2008.
- 36. Ad Hoc Committee on Health Research Relating to Future Intervention Options (1996) Investing in health research and development. Geneva: World Health Organization.
- 37. Katz DA, Muehlenbruch DR, Brown RL, Fiore MC, Baker TB (2004) Effectiveness of implementing the agency for healthcare research and quality smoking cessation clinical practice guideline: a randomized, controlled trial. J Natl Cancer Inst 96: 594–603.
- 38. National Institute of Allergy and Infectious Diseases (2006) Fiscal Year 2007 Budget Justification. http://www3.niaid.nih.gov/about/overview/budget/PDF/fy07 justification.pdf, accessed Nov. 1, 2008.
- 39. Gitterman DP, Hay WW Jr (2008) That sinking feeling, again? The state of National Institutes of Health pediatric research funding, fiscal year 1992–2010. Pediatr Res 64: 462–469.
- 40. NIH Almanac (2008) National Institute of Diabetes and Digestive and Kidney Illnesses — Mission and history. http://www.nih.gov/about/almanac/organization/NIDDK.htm, accessed Jan. 12, 2009.
- 41. National Institutes of Health (2009) NIH Institutes, Centers and Offices. National Institutes of Health, Department of Health and Human Services, http://www.nih.gov/icd/index.html, accessed April 27, 2009.
- 42. NIH Office of Budget (2009) NIH Common Fund/Roadmap. Office of Budget, Office of the Director, National Institutes of Health, Department of Health and Human Services, http://officeofbudget.od.nih.gov/ui/2008/Final%20Roadmap.pdf, accessed April 27, 2009.
- 43. National Institutes of Health (2008) NIH career award funding 1998–2007. Office of Research Information Systems, National Institutes of Health, Department of Health and Human Services, http://report.nih.gov/NIH_Investment/PDF_sectionwise/NIH_Extramural_DataBook_PDF/NEDB%20CAREER%20DEVELOPMENT.pdf, accessed April 27, 2009.
- 44. National Institutes of Health (2007) NIH director selects Dr. Alan M. Krensky as NIH deputy director for the Office of Portfolio Analysis and Strategic Initiatives (OPASI) National Institutes of Health, Department of Health and Human Services, http://www.nih.gov/news/pr/jan2007/opasi-25.htm, accessed May 5, 2009.
- 45. National Institute of Neurological Disorders and Stroke (2009) Grant opportunities in comparative effectiveness research. National Institutes of Health, Department of Health and Human Services, http://www.ninds.nih.gov/recovery/arra-funding/go-cer.htm, accessed May 5, 2009.
- 46. Varmus H (1999) Evaluating the burden of disease and spending the research dollars of the National Institutes of Health. N Engl J Med 340: 1914–1915.
- 47. National Science Foundation (2007) Federal funds for research and development: Fiscal years 2004–06. NSF 07-323. John E. Jankowski, project officer.: National Science Foundation, Division of Science Resources Statistics, http://www.nsf.gov/statistics/nsf07323/pdf/tab3.pdf, accessed May 1, 2008.
- 48. Department of Veterans Affairs (2006) Fiscal Year 2006 performance and accountability report: consolidated financial statements. Washington D.C.: Department of Veterans Affairs, Office of Management. pp. 285–290.
- 49. Burns L, ArchstoneConsulting (2009) The biopharmaceutical sector's impact on the U.S. economy: analysis at the national, state, and local levels. Stamford, CT: Archstone Consulting. 18 p.
- 50. Dorsey ER, Vitticore P, De Roulet J, Thompson JP, Carrasco M, et al. (2006) Financial anatomy of neuroscience research. Ann Neurol 60: 652–659.
- 51. Mathers CD, Salomon JA, Ezzati M, Begg S, Lopez AD (2006) Sensitivity and uncertainty analyses for burden of disease and risk factor estimates. Global burden of disease and risk factors. New York: Oxford University Press. pp. 399–426.
- 52. Johnston SC, Rootenberg JD, Katrak S, Smith WS, Elkins JS (2006) Effect of a US National Institutes of Health programme of clinical trials on public health and costs. Lancet 367: 1319–1327.