Estimation of vaccination coverage from electronic healthcare records; methods performance evaluation - A contribution of the ADVANCE-project

Published on Sep 18, 2019in PLOS ONE2.776
· DOI :10.1371/journal.pone.0222296
Toon Braeye4
Estimated H-index: 4
(University of Hasselt),
Vincent Bauchau8
Estimated H-index: 8
+ 5 AuthorsKaatje Bollaerts9
Estimated H-index: 9
(Katholieke Universiteit Leuven)
Introduction The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines, using existing electronic healthcare record (eHR) databases in Europe. Part of the data in such sources is missing due to incomplete follow-up hampering the accurate estimation of vaccination coverage. We compared different methods for coverage estimation from eHR databases; naive period prevalence, complete case period prevalence, period prevalence adjusted for follow-up time, Kaplan-Meier (KM) analysis and (adjusted) inverse probability weighing (IPW). Methods We created simulation scenarios with different proportions of completeness of follow-up. Both completeness independent and dependent from vaccination date and status were considered. The root mean squared error (RMSE) and relative difference between the estimated and true coverage were used to assess the performance of the different methods for each of the scenarios. We included data examples on the vaccination coverage of human papilloma virus and pertussis component containing vaccines from the Spanish BIFAP database. Results Under completeness independent from vaccination date or status, several methods provided estimates with bias close to zero. However, when dependence between completeness of follow-up and vaccination date or status was present, all methods generated biased estimates. The IPW/CDF methods were generally the least biased. Preference for a specific method should be based on the type of censoring and type of dependence between completeness of follow-up and vaccination. Additional insights into these aspects, might be gained by applying several methods.
  • References (30)
  • Citations (0)
📖 Papers frequently viewed together
4 Authors (Jerome I. Tokars, ..., Carrie Reed)
4 Citations
1 Citations
5 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
2 CitationsSource
#1Noelia LópezH-Index: 1
#2Aureli Torné (University of Barcelona)H-Index: 26
Last. Nuria PeruleroH-Index: 1
view all 7 authors...
A new nonavalent human papillomavirus (HPV) vaccine that includes genotypes 6/11/16/18/31/33/45/52/58 has been recently approved in Spain. A previous study has shown that attributable fraction of HPV related diseases in Spain is consistent with that reported in European and global studies. The aim of the present study was to estimate the annual direct costs associated to the following HPV-related diseases: genital warts, high grade precancerous lesions and cancer of cervix, vulva, vagina, anus a...
1 CitationsSource
#1Chen Stein-Zamir (HUJI: Hebrew University of Jerusalem)H-Index: 11
#2Avi Israeli (HUJI: Hebrew University of Jerusalem)H-Index: 14
ABSTRACTBackground and aims: Routine childhood vaccinations schedules recommend that children receive the vaccine doses at specific ages. Vaccination coverage data are conventionally reported by the up-to-date method. We aimed to assess vaccination timeliness by the age-appropriate method and compare with the up-to-date vaccination coverage. Methods: Assessment of age-appropriate and up-to-date vaccination coverage among children born in Israel in 2009 and followed to age 48 months (national rep...
5 CitationsSource
#1Tarik Derrough (ECDC: European Centre for Disease Prevention and Control)H-Index: 5
#2Kate Olsson (ECDC: European Centre for Disease Prevention and Control)H-Index: 1
Last. Lucia Pastore-Celentano (ECDC: European Centre for Disease Prevention and Control)H-Index: 3
view all 8 authors...
Immunisation Information Systems (IIS) are computerised confidential population based-systems containing individual-level information on vaccines received in a given area. They benefit individuals directly by ensuring vaccination according to the schedule and they provide information to vaccine providers and public health authorities responsible for the delivery and monitoring of an immunisation programme. In 2016, the European Centre for Disease Prevention and Control (ECDC) conducted a survey ...
9 CitationsSource
#1L. Fonteneau (InVS: Institut de veille sanitaire)H-Index: 11
#2M. Ragot (InVS: Institut de veille sanitaire)H-Index: 3
Last. Daniel Lévy-Bruhl (InVS: Institut de veille sanitaire)H-Index: 34
view all 4 authors...
Abstract Background Sources of data used in France to routinely monitor vaccination coverage, such as the Child Health Certificates and school surveys, allow reliable estimations, but data are not made available with long delays. To rapidly identify recent changes, we have explored the feasibility and relevance of using vaccine reimbursement data. Methods We used the Permanent Sample of Beneficiaries, a representative sample of the National Health Insurance Information System, which contains dat...
10 CitationsSource
23 CitationsSource
#1Tinne Lernout (University of Antwerp)H-Index: 10
#2Heidi Theeten (University of Antwerp)H-Index: 19
Last. Pierre Van Damme (University of Antwerp)H-Index: 50
view all 7 authors...
Abstract Achieving high vaccination coverage is a necessary, but not a sufficient indicator of the quality of a vaccination programme, in terms of control and prevention of childhood infectious diseases. For optimal protection of infants, timeliness of vaccination is increasingly recognized as another important target. The aim of this study was to assess the timeliness of measles-mumps-rubella (MMR) and diphtheria-tetanus-pertussis (DTP) vaccination in infants in Flanders (Belgium), and to ident...
36 CitationsSource
126k Citations
#1Meghan A. Baker (Harvard University)H-Index: 13
#2Michael Nguyen (CBER: Center for Biologics Evaluation and Research)H-Index: 7
Last. Tracy A. Lieu (Harvard University)H-Index: 59
view all 5 authors...
Abstract Background The Post-Licensure Rapid Immunization Safety Monitoring (PRISM) program is the immunization safety monitoring component of FDA's Mini-Sentinel project, a program to actively monitor the safety of medical products using electronic health information. FDA sought to assess the surveillance capabilities of this large claims-based distributed database for vaccine safety surveillance by characterizing the underlying data. Methods We characterized data available on vaccine exposures...
20 CitationsSource
#1Aggrey KenyH-Index: 2
#2Paul G. Biondich (IU: Indiana University)H-Index: 23
Last. Martin C. Were (IU: Indiana University)H-Index: 15
view all 4 authors...
Background and Purpose: Timely, simultaneous and combined vaccination is important to protect children from common infectious diseases. In a large health care delivery system in Western Kenya, we examined the adequacy and quality of data within the electronic health record (EHR) to assess the feasibility of developing a clinical decision support system to improve childhood vaccination uptake and coverage. Methods: The study evaluated vaccination information collected and stored in an EHR between...
2 CitationsSource
Cited By0
PURPOSE: Base de Datos para la Investigacion Farmacoepidemiologica en Atencion Primaria (BIFAP) is a population based database administered by the AEMPS (Spanish Agency for Medicines) of longitudinal electronic medical records (EMR) of patients attended in primary care. Its main purpose is to serve as source of information for independent studies on drug safety and support of medicines regulation activities. This article aim is to describe the characteristics of BIFAP, how to access the database...
#1Toon Braeye (University of Hasselt)H-Index: 4
#2Hanne-Dorthe Emborg (SSI: Statens Serum Institut)H-Index: 23
Last. C McGee (University of Surrey)H-Index: 1
view all 15 authors...
Abstract Background The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public–private collaboration aiming to develop and test a system for rapid benefit-risk monitoring of vaccines using existing healthcare databases in Europe. We estimated vaccine coverage from electronic healthcare databases as part of a fit-for-purpose assessment for vaccine benefit-risk studies. Methods A retrospective dynamic cohort study was conducted through a distributed network a...