The efficiency of routine infant immunization services in six countries: a comparison of methods.

Published on Jan 8, 2020in Health Economics Review
· DOI :10.1186/S13561-019-0259-1
Nicolas A. Menzies11
Estimated H-index: 11
Christian Suharlim4
Estimated H-index: 4
+ 1 AuthorsLogan Brenzel7
Estimated H-index: 7
Abstract Background Few studies have systematically examined the efficiency of routine infant immunization services. Using a representative sample of infant immunization sites in Benin, Ghana, Honduras, Moldova, Uganda and Zambia (316 total), we estimated average efficiency levels and variation in efficiency within each country, and investigated the properties of published efficiency estimation techniques. Methods Using a dataset describing 316 immunization sites we estimated site-level efficiency using Data Envelopment Analysis (DEA), Stochastic Frontier Analysis (SFA), and a published ensemble method combining these two approaches. For these three methods we operationalized efficiency using the Sheppard input efficiency measure, which is bounded in (0, 1), with higher values indicating greater efficiency. We also compared these methods to a simple regression approach, which used residuals from a conventional production function as a simplified efficiency index. Inputs were site-level service delivery costs (excluding vaccines) and outputs were total clients receiving DTP3. We analyzed each country separately, and conducted sensitivity analysis for different input/output combinations. Results Using DEA, average input efficiency ranged from 0.40 in Ghana and Moldova to 0.58 in Benin. Using SFA, average input efficiency ranged from 0.43 in Ghana to 0.69 in Moldova. Within each country scores varied widely, with standard deviation of 0.18–0.23 for DEA and 0.10–0.20 for SFA. Input efficiency estimates generated using SFA were systematically higher than for DEA, and the rank correlation between scores ranged between 0.56–0.79. Average input efficiency from the ensemble estimator ranged between 0.41–0.61 across countries, and was highly correlated with the simplified efficiency index (rank correlation 0.81–0.92) as well as the DEA and SFA estimates. Conclusions Results imply costs could be 30–60% lower for fully efficient sites. Such efficiency gains are unlikely to be achievable in practice – some of the apparent inefficiency may reflect measurement errors, or unmodifiable differences in the operating environment. However, adapted to work with routine reporting data and simplified methods, efficiency analysis could triage low performing sites for greater management attention, or identify more efficient sites as models for other facilities.
  • References (43)
  • Citations (0)
📖 Papers frequently viewed together
2 Citations
75 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Correa NuñezH-Index: 1
#2Andrés CamiloH-Index: 1
El analisis de eficiencia en el sector agropecuario se basa a menudo en modelos de soporte para la toma de decisiones porque orientan sobre cuales son los principales factores de produccion y dan lineamientos para resolver los problemas evidenciados. En esta investigacion se caracterizaron los sistemas de produccion porcicolas mediante la metodologia de analisis por agrupamientos, se seleccionaron 50 variables cualitativas y se construyeron 9 indices que miden el grado de tecnificacion de las gr...
1,564 CitationsSource
#1Nicolas A. Menzies (Harvard University)H-Index: 11
#2Christian Suharlim (Harvard University)H-Index: 4
Last. Stephen Resch (Harvard University)H-Index: 23
view all 6 authors...
Evidence on immunization costs is a critical input for cost-effectiveness analysis and budgeting, and can describe variation in site-level efficiency. The Expanded Program on Immunization Costing and Financing (EPIC) Project represents the largest investigation of immunization delivery costs, collecting empirical data on routine infant immunization in Benin, Ghana, Honduras, Moldova, Uganda, and Zambia. We developed a pooled dataset from individual EPIC country studies (316 sites). We regressed ...
5 CitationsSource
#1Fangli Geng (Harvard University)H-Index: 3
#2Christian Suharlim (Harvard University)H-Index: 4
Last. Nicolas A. Menzies (Harvard University)H-Index: 11
view all 5 authors...
7 CitationsSource
#1Laura Di Giorgio (UW: University of Washington)H-Index: 2
#2Mark Moses (UW: University of Washington)H-Index: 10
Last. Abraham D. Flaxman (UW: University of Washington)H-Index: 58
view all 30 authors...
Background Since 2000, international funding for HIV has supported scaling up antiretroviral therapy (ART) in sub-Saharan Africa. However, such funding has stagnated for years, threatening the sustainability and reach of ART programs amid efforts to achieve universal treatment. Improving health system efficiencies, particularly at the facility level, is an increasingly critical avenue for extending limited resources for ART; nevertheless, the potential impact of increased facility efficiency on ...
14 CitationsSource
#1Laura Di Giorgio (UW: University of Washington)H-Index: 2
#2Abraham D. Flaxman (UW: University of Washington)H-Index: 58
Last. Christopher Margono (UW: University of Washington)H-Index: 162
view all 8 authors...
Low-resource countries can greatly benefit from even small increases in efficiency of health service provision, supporting a strong case to measure and pursue efficiency improvement in low- and middle-income countries (LMICs). However, the knowledge base concerning efficiency measurement remains scarce for these contexts. This study shows that current estimation approaches may not be well suited to measure technical efficiency in LMICs and offers an alternative approach for efficiency measuremen...
4 CitationsSource
#1Cara Bess Janusz (OPS: Pan American Health Organization)H-Index: 10
#2Carlos A Castañeda-Orjuela (National University of Colombia)H-Index: 36
Last. Stephen Resch (Harvard University)H-Index: 23
view all 7 authors...
a b s t r a c t Background: Many countries have introduced new vaccines and expanded their immunization programs to protect additional risk groups, thus raising the cost of routine immunization delivery. Honduras recently adopted two new vaccines, and the country continues to broaden the reach of its program to adolescents and adults. In this article, we estimate and examine the economic cost of the Honduran routine immunization program for the year 2011. Methods: The data were gathered from a p...
20 CitationsSource
#1Ketevan GoguadzeH-Index: 6
#2Ivdity ChikovaniH-Index: 9
Last. George GotsadzeH-Index: 13
view all 7 authors...
Abstract Objective Available estimates on how much it costs to provide routine immunization services are out-dated. This study attempts to address gaps in evidence by evaluating the total economic and unit costs of delivering routine immunization (RI) services in Moldova as part of a multi-country study on the costs and financing of routine immunization (EPIC). Methods This cross-sectional study is based on a multistage stratified random sample of fifty primary health care facilities. Data on in...
15 CitationsSource
#1Daniel MaceiraH-Index: 1
#2Ketevan GoguadzeH-Index: 6
Last. George GotsadzeH-Index: 13
view all 3 authors...
Abstract Objective This paper identifies factors that affect the cost and performance of the routine immunization program in Moldova through an analysis of facility-based data collected as part of a multi-country costing and financing study of routine immunization (EPIC). Methods A nationally representative sample of health care facilities (50) was selected through multi-stage, stratified random sampling. Data on inputs, unit prices and facility outputs were collected during October 3rd 2012–Jan...
6 CitationsSource
#1Logan Brenzel (BMGF: Bill & Melinda Gates Foundation)H-Index: 7
#2Darwin Young (UNC: University of North Carolina at Chapel Hill)H-Index: 7
Last. Damian Walker (BMGF: Bill & Melinda Gates Foundation)H-Index: 12
view all 3 authors...
Abstract Background Few detailed facility-based costing studies of routine immunization (RI) programs have been conducted in recent years, with planners, managers and donors relying on older information or data from planning tools. To fill gaps and improve quality of information, a multi-country study on costing and financing of routine immunization and new vaccines (EPIC) was conducted in Benin, Ghana, Honduras, Moldova, Uganda and Zambia. Methods This paper provides the rationale for the launc...
31 CitationsSource
#2Xiao Xian HuangH-Index: 3
Last. Bradford D. GessnerH-Index: 46
view all 7 authors...
Abstract Background Existing tools to evaluate costs do not always capture the heterogeneity of costs at the facility level. This study seeks to address this issue through an analysis of determinants of health facility immunization costs. Methods A statistical analysis on facility routine delivery and vaccine costs was conducted using ordinary least squares regression. Explanatory variables included the number of doses administered; proportion of time spent by facility staff on immunization; ave...
15 CitationsSource
Cited By0