- Open Access
Evaluating the neonatal BCG vaccination programme in Ireland
Archives of Public Health volume 74, Article number: 28 (2016)
The aim of this study was to compare the cost effectiveness of the current Irish programme of universal BCG vaccination of infants versus a programme which considered selectively vaccinating high risk infants using decision analytical modelling.
The efficacy of the BCG vaccine was re-evaluated to inform a decision analytical model constructed to follow a birth cohort of vaccinated and unvaccinated infants over a 15 year time horizon. The number of life years gained (LYG) was the primary outcome measure and this was compared to the net cost of the vaccination strategies.
In the base case analysis, the incremental cost effectiveness ratios (ICERs) for the universal strategy and selective strategy vs no vaccination were €204,373/LYG and €143,233/LYG respectively. When comparing the incremental difference in moving from the universal to the selective strategy, the selective strategy costs €1,055,692 less per 4.8 life years lost per birth cohort. One way sensitivity analyses highlighted that a move from the universal to the selective strategy was particularly sensitive to the estimate of vaccine efficacy against deaths, the cost of administering the vaccine and the multiplier used to apportion risk of contracting tuberculosis. Probabilistic analysis suggested that a move from a universal based strategy to a selective based strategy could be deemed cost effective (probability of cost effectiveness is 76.8 %).
The results of the study support the protective effect of the BCG vaccine in infants and quantified the cost effectiveness of the current BCG vaccination strategy and the decremental difference in moving to a selective strategy. This analysis highlights that the additional protection offered by the universal vaccination strategy is small compared to that of the selective strategy. Consideration should therefore be given to the implementation of a selective vaccination strategy, and diverting resources to improve TB case management and control.
As the incidence of TB continues to decline in high and middle income countries and because of the conflicting data on its protective efficacy, a valid and pressing question is whether BCG vaccination should be discontinued or targeted at certain groups, known to have a higher risk of contracting infection. The International Union Against Tuberculosis and Lung Diseases (IUATLD) recommends that routine vaccination be discontinued when the average annual notification rate of sputum smear positive pulmonary TB is 5 per 100,000 population or less during the previous 3 years .
As well as the IUATLD criteria, there are additional considerations, such as economic analysis and societal preference, which should be addressed when deciding to modify or stop a universal BCG programme. Ireland and Portugal remain the only countries in Western Europe implementing universal BCG vaccination programmes. France revised its approach to the use of the BCG vaccine, firstly in 2004, when revaccination with BCG ceased  and then in 2007 when routine vaccination of all school children ceased and a more targeted approach to vaccination was introduced . The national policy in Finland was changed in 2005, whereby the universal vaccination policy was changed to a targeted approach of high risk infants . Likewise in the UK, a review and revision of the BCG vaccination policy lead to the implementation of a selective vaccination strategy of high risk groups in favour of the universal schools programme which had been in place since the 1950s. Some countries with low rates of TB, such as Sweden and Switzerland, discontinued their universal BCG vaccination strategies many years ago . Japan has also reappraised the value of routine BCG vaccination in the prevention of TB . These policy differences are mainly related to differences in opinion about the efficacy of the vaccine and local variations in TB epidemiology.
In 2012 the National Immunisation Advisory Committee (NIAC) commenced an economic analysis of the existing universal BCG vaccine programme in Ireland. The aim of the assessment was to examine the cost effectiveness of the current BCG vaccination programme of infants using revised estimates of vaccine efficacy and to quantify the incremental difference in moving to a selective based strategy, which identified and vaccinated high risk infants only. The process and results of this assessment are presented.
Prior to commencing the evaluation, the scope of the analysis was agreed with an expert advisory group. The base-case parameters for the model were established and the most appropriate data inputs were collected for the model.
The analysis was undertaken from the perspective of the Health Service Executive (HSE), i.e., the healthcare payer. Therefore only direct medical costs were included in the evaluation. Costs associated with productivity changes due to parental time off work were included in a separate scenario analysis.
For the universal BCG strategy, it is assumed that a birth cohort of infants (n = 72,410) is vaccinated with a coverage rate of 80 % (of the birth cohort). The size of the birth cohort in this analysis (n = 72,410) is based on the population estimates in Ireland for 2011.
For the selective strategy, the target group of high-risk children was estimated to be 11.7 % of the birth cohort with a coverage rate of 44 %. The definition of “high-risk’” was infants with at least one parent from a high TB incidence country (≥ 40 cases per 100,000 persons) and was based on information taken from the “Growing up in Ireland” study which showed that 10.7 % of fathers and 12.7 % of mothers of the infant cohort (born between December 2007 and May 2008) were born in Eastern Europe, Africa and the “Rest of the World”-regions which could be considered areas of high TB endemnicity .
The children in the high risk group are assumed also to have a risk of TB which is three times (x3) higher than the 88.3 % of children in the remaining low-risk group. This assumption is based data provided in the HPSC Report on the Epidemiology of Tuberculosis . The overall incidence is a weighted average between the two groups, and thus the increased risk in the high risk group is matched by a decreased risk in the remainder of the population.
It is assumed that the vaccine would be administered to the neonates before they reach 3 months of age and would be delivered in the community setting.
A decision analytic model was constructed to follow a birth cohort of vaccinated and unvaccinated individuals from birth over a 15 year period. The model is based on a series of health states (i.e., pulmonary TB, extrapulmonary TB, meningeal TB and death) that an individual can occupy at a given point in time and it is run in annual cycles. The model estimates the number of cases of pulmonary TB, extrapulmonary TB and TB meningitis averted in the birth cohort of 72,410 infants. Age-specific background mortality was based on life tables from the Irish Central Statistics Office . The number of life years gained (LYG) from the vaccination programmes was the primary health outcome measure, and these were compared to the net cost i.e., the additional cost of universal or selective vaccination minus the expected savings from reduced use of healthcare resources, due to a reduction in the burden of TB disease. The model was fitted with local cost, resource use and epidemiological data.
In the evaluation, cases of pulmonary TB, extrapulmonary TB, and meningeal TB are always initially managed as inpatients, and this reflects current clinical practice in Ireland. TB meningitis can lead to long term complications (hearing loss, focal neurological deficits, development delay, epilepsy) which are also incorporated into the analysis. The analysis was performed in MS Excel 2010.
The vaccination strategies were compared to no vaccination, i.e., BCGuniversal vs BCGno vaccination and BCGselective vs BCGno vaccination, before comparing the incremental difference in moving from a universal strategy to a selective strategy.
Several systematic reviews to date conclude that BCG vaccination of infants is very effective in preventing miliary TB and TB meningitis in children . One meta-analysis conducted in the USA  provided evidence for a protective effect of the BCG vaccine against pulmonary TB, TB deaths, TB meningitis, laboratory confirmed TB cases and disseminated TB. In 1995 Colditz and colleagues (13) reviewed the results of 5 randomised control trials and 11 case control studies. They estimated the protective effect of the BCG vaccine for preventing pulmonary TB, TB deaths, TB meningitis, laboratory confirmed TB cases and disseminated TB. Trunz and colleagues  re-evaluated BCG efficacy against childhood TB meningitis and miliary TB by adding seven more published investigations to earlier meta-analyses of published case-control studies [10, 11]. A total of 18 case-control studies provided revised estimates of efficacy for TB meningitis and miliary TB, which are similar to earlier published estimates [10, 11, 13].
In Ireland, the Health Protection Surveillance Centre (HPSC) documents all cases of notified TB. In addition to documenting cases, other information such as age, gender, local health office/county, country of birth, BCG vaccination status, presence of BCG scar, and treatment outcome is recorded. It therefore serves as a reliable source to estimate the effectiveness of the BCG vaccination in the Irish population. To this end, a retrospective evaluation of TB cases, stratified according to BCG status from the years 2002 to 2011 was conducted. The analysis was fitted in R (version 2.15.2) to combine this Irish data with data from Colditz  and Trunz . Resulting risk ratios provide estimates of vaccine efficacy for the Irish population aged 0-15 years strengthened by international estimates. A forest plot of the results is shown (Fig. 1), illustrating the impact different data sources have on the revised combined estimates.
Not all local health offices report their BCG vaccine uptake rates to the HPSC. The mode of delivery also varies across the country with approximately 75 % of all BCG vaccinations being performed in local health offices and the remainder (25 %) being done in maternity hospitals (National Immunisation Office (NIO), personal communication). For the purposes of the current study, it was assumed that the vaccine uptake in the base case analysis would be approximately 80 % for the universal strategy and was varied by 75–95 % in the sensitivity analysis. These figures were based on expert clinical opinion (from the NIO) and the latest HPSC immunization statistics .
For the selective strategy, it was assumed that the vaccine uptake in the base case analysis would be approximately 44 % and was varied by 38–50 % in the sensitivity analysis. These figures were based on experience from France , where, following a change in their vaccination schedule to a selective based strategy, reported uptake rates of lower magnitude than those experienced for the universal strategy. Experience from other low incidence countries, showed similar evidence for a reduced uptake rate for a selective based strategy, e.g., Sweden reported a vaccine uptake rate of less than 2 % in 1976 a year after changing to a selective based strategy .
Incidence of childhood TB
In the southern area of Ireland, a universal neonatal BCG vaccination was offered in Cork up to 1972 when a decision was taken to discontinue the vaccine for a variety of reasons. This small cohort, together with the information provided by the HPSC, therefore provided a reliable source to estimate the incidence of childhood TB in a non-vaccinated Irish population. Annualized incidence rates were calculated for each TB health state, for each year between 0 and 15 years, and these were used as the basis to build the model. In a separate scenario analysis, which examined the effect of the vaccine up to 25 years, annualized incidence rates from those aged 16–25 years were used (Table 1).
There were no recorded deaths due to TB in the 0–15 year old population, so a case fatality rate (CFR) of 0.8 % (based on UK Surveillance data from 2001 to 2010, compiled by the Health Protection Agency, UK ) was applied.
Long term complications of TB meningitis
There is a wide range of possible long-term sequelae following meningitis and the analysis is restricted to four main complications: hearing loss, developmental delay, focal neurological deficits andepilepsy. The probability of these events occurring was derived from published studies.
In 1964, Todd and Neville  estimated the incidence of hearing loss and epilepsy attacks. They combined the results of their own study with those of Wasz-Hockert & Donner , Lorber , Voljavec et al. , Pohitonova  and Lapides . From these 6 studies they combined information on the incidence of sequelae in 855 children who had survived an attack of meningeal TB. The estimates for hearing loss and epilepsy attacks were 7 and 7.6 % respectively. Lorber  estimated the incidence of cognitive impairment at 50 %. Schoeman  estimated that focal neurological deficits occurred in 25 % of cases analysed. The probabilities of long-term complications of meningitis were varied by +/−20 % in the sensitivity analysis.
Resource use data
Cost estimates are explained in terms of healthcare resource use (i.e., vaccination costs and direct medical costs) and unit cost data.
Vaccination cost estimates were obtained from the NIO of the HSE. The cost of vaccination includes the cost of the vaccine as well as the cost of administration of the vaccine. The vaccine ingredient costs are calculated as 80 or 50 % of the cost of distributed vaccine in 2012 for the universal and selective strategies respectively (Personal communication with NIO). The cost of administration is based on an administration fee of €27.75 and €50 per infant, for the universal strategy and selective strategies respectively. The higher fee for the selective strategy reflects the difficulty that may be present in identifying those at high risk. Changes to the administration fee are explored in the sensitivity analysis.
Direct medical costs
Due to the lack of published Irish cost data, and the time constraints with conducting specific micro-costing studies, an assessment of resource use items associated with diagnosis and treatment of each of the health states (pulmonary TB, extrapulmonary TB and TB meningitis) were obtained by the evaluation team with local clinical experts. The costs associated with contact tracing per primary case of TB and diagnosing and treating 50 % of those contacts for latent TB were added to the direct medical costs of pulmonary TB, extrapulmonary TB and TB meningitis. Costs of contact tracing and latent TB are based on 9.4 contacts per TB case and are shown in Table 2. The costs of managing the long-term sequelae of meningitis were also included and the overall cost shown in Table 2. A comprehensive list of resource utilisation and unit cost data used to estimate direct medical costs of latent TB, pulmonary TB, extrapulmonary TB, TB meningitis and long term sequelae of meningitis are provided in Additional files 1, 2, 3, 4 and 5 respectively.
Unit cost data
Unit costs for inpatient procedures were obtained from 2010 Diagnosis Related Group (DRG) data provided by the National Casemix Unit of the HSE . Unit costs for tuberculin skin tests were obtained from the Finance department of a local university teaching hospital (St. James’s Hospital, Dublin). Costs of antimicrobial therapy were obtained from the Pharmacy department of St. James’s Hospital Dublin. Every effort was made to incorporate Irish unit cost data. However, where data were not available it was adapted from the UK. UK costs were converted to euro using the exchange rate (€1.18) published by the Central Bank of Ireland and all costs were inflated to 2012 euro, using the consumer price index for health inflationary unit (105.6).
The model uses the incidence rate of severe adverse events (1 in 1000) reported in the summary of product characteristics for the BCG vaccine . Following review of all local reports [26–33] as well as international reports [34–36] published in the literature, none of the reports indicate that the rate is higher than this. The estimate of 1 in 1000 is applied only in the first year for the cohort as the literature indicates that the median onset of adverse effects ranges from 30 days to 4 months [32–35]. This rate is varied in the sensitivity analysis from > 1/10,000 to < 1/100 which is within the rates reported in the summary of product characteristics .
The analytic time frame of the study was fifteen years in the base case analysis given the current paucity of data on the duration of vaccine protection beyond this time .
The main outcome measure in the analysis was cost per LYG.
An annual discount rate of 5 % was applied to both costs and consequences in the economic model, consistent with Guidelines for the Conduct of Economic Evaluations in Ireland .
One-way sensitivity analysis was undertaken for the base case analysis. Ranges for the parameter values used are shown in Table 2.
Probabilistic sensitivity analysis
A probabilistic sensitivity analysis was also conducted whereby all parameters were varied simultaneously. One thousand simulated combinations of the parameters were drawn and for each of these combinations a cost per LYG was estimated.
Long term effect of vaccination
A scenario analysis was conducted which examined the effect of vaccination up to 25 years. To do this, incidence data was gathered from those aged 16 to 25 years from non-vaccinated and vaccinated cohorts respectively and rates of vaccine efficacy against the TB health states (Protective effect: 0.55 95 % CI 0.31 to 0.77) and against TB death (Protective effect: 0.44 95 % CI−0.22 to 0.70) were applied .
Vaccinating a birth cohort-the societal perspective
A scenario analysis was conducted whereby the indirect costs due to TB were included in the analysis. This analysis included the value of work lost per week  for a parent of a child with TB or an adverse event due to vaccination. This was based on the work of Roberts et al., , which stated that 42 % of parents would take time off work and an assumption that the number of work days lost is four.
Baseline costs and effects
In the base case scenario, the model estimates the number of cases of pulmonary TB, extrapulmonary TB and TB meningitis averted in a birth cohort of 72,410 infants under the three scenarios (Table 3).
For the universal strategy, the total cost of the BCG vaccine, including an administration fee of €27.75 per dose, would be approximately €1.7 million per year for a birth cohort of 72,410 infants. For the selective strategy, the total cost of the BCG vaccine, including an administration fee of €50 per dose, would be approximately €280,207 per year. The vaccine ingredient costs are calculated as 80 or 50 % of the cost of distributed vaccine in 2012 for the universal and selective strategies respectively.
The cost of diagnosing and treating TB disease was estimated to decrease by €848,199 and €160,945 in the universal and selective vaccinated cohorts respectively due to cost savings from avoided TB disease among the vaccinated cohorts (Table 4).
The costs of treating adverse events due to vaccination were also estimated at €134,161 and €10,607 for the universal and selective strategies respectively.
Baseline incremental cost-effectiveness ratios
The base case ICERs, when comparing the universal and selective vaccination strategies to not vaccinating are €204,373/LYG and €143,233/LYG respectively. When comparing the incremental difference in moving from the universal to the selective strategy, the selective strategy costs €1,055,692 less per 4.8 life years lost per birth cohort (Table 5).
The main drivers of uncertainty in the model for the analysis of the incremental difference in going from a universal strategy to a selective strategy were as follows (Fig. 2);
Vaccine efficacy against deaths
When this parameter was varied by its 95 % CI estimates, it resulted in the selective strategy costing €1,055,692 less with 1.4 and 6.2 life years lost for the lower and upper CIs, respectively.
Cost of vaccine administration
When this parameter was varied by its 95 % CI estimates, it resulted in the selective strategy loosing 4.83 life years and costing €259,182 and €1,475,670 less for the lower and upper CIs, respectively.
When a risk of x2 is apportioned to the high risk population the selective strategy costs €1,012,728 less with a loss of 5.2 life years. When a risk of x8 is apportioned to the high risk population the selective strategy costs €1,270,508 less with a loss of 2.9 life years.
Probabilistic sensitivity analysis
A probabilistic analysis was run (1,000 simulations) and the incremental difference for selective versus universal is shown in Fig. 3 (i.e., universal at the origin) with a 90 % confidence ellipse depicted. The distribution of 1000 simulations shown in Fig. 3 shows 76.8 % of simulations occur below the willingness to accept threshold of at least €90,000/LYL in the South West quadrant.
Long term effect of vaccination - Incremental cost-effectiveness ratios
When the model incorporates the effect of the vaccine on TB health states over 25 years, the ICERs for the universal and selective based strategies compared to not vaccinating are €167,878/LYG and €108,449/LYG respectively.
Vaccinating a birth cohort-the societal perspective
When the model incorporates the indirect costs of parents time off work, due to a TB related illness or a vaccine related adverse event, the ICERs for the universal and selective based strategies compared to not vaccinating are €204,966/LYG and €143,468/LYG respectively, which are comparable to the ICERs calculated in the base case analysis. A similar trend was observed to the base case analysis when moving from a universal to a selective based strategy.
The results of this economic evaluation suggest that both the universal BCG vaccination programme and the targeted strategy of selectively vaccinating high-risk neonates in Ireland would not be considered cost effective compared to not vaccinating. When compared to the universal programme, the targeted (or selective) strategy is substantially less expensive but demonstrates marginally less health gain (4.8 life years). Assuming however, that people demand twice the amount of money to relinquish one unit of health, compared to the amount they are willing to pay to gain an extra unit of health , the probabilistic analysis indicates that a move from a universal based strategy to a selective based strategy could be deemed acceptable.
While TB incidence has fallen dramatically in Western Europe and the US over the last century it remains a public health burden of global concern. Historically, Ireland has had high rates of TB compared with other countries in Western Europe but rates have been falling and it is now considered a low-burden country. However, public concern about TB remains. Results from our re-evaluation of vaccine efficacy confirm the protective effect of the vaccine in the local population, as demonstrated through studies conducted in Ireland in the late 80’s and early 90’s [43–52]. The addition of our estimates of vaccine efficacy to previously published systematic reviews and meta-analyses adds to the literature on the efficacy of BCG vaccine, an area which has been under-served and remains controversial. While decisions in this area have been largely taken in Europe, these questions remain to be considered in low resource countries with poor health infrastructures. The efficacy data presented, which combines data from a country with a previously high prevalence of TB to that of the international literature, will be a helpful and useful addition for economic analysis in those settings.
Decrementally cost-effective medical interventions
With healthcare expenditures growing at a significant rate, decision makers struggle with reconciling their finite budgets with the reimbursement of innovative medical technologies, be they vaccines, pharmaceuticals or diagnostics. In such situations, cost-saving alternatives may become attractive, even if they come with reduced benefits. The theory is that limited benefits could be sacrificed for substantial resource savings, thus permitting reallocation to higher value alternatives. TB control is an area where this might be an appropriate approach, especially in low-burden countries. Targeting vaccinations to high-risk groups would allow re-allocation of resources into more robust TB screening and treatment programs. Less expensive, lower quality innovations are ubiquitous in other markets but have not been described in the health care sector to any great extent. However, Nelson and colleagues  systematically identified and quantified decrementally cost-effective health care innovations, for instance, those where the monetary savings had to be large enough to justify the associated QALY loss, i.e., those in the southwest quadrant of the cost-effectiveness plane. To do this they conservatively designated an intervention as decrementally cost-effective if it saved at least $100,000 for each QALY lost. This was based on the existing available data which suggested that people ‘demand’ 2 to 6 fold more per QALY lost than they are willing to ‘pay’ for each QALY [42, 54]. On the basis of this, results from our study would suggest that to move from a universal vaccination strategy to a selective based strategy saves approximately €218,692 per life year lost. Indeed, assuming a willingness to accept threshold of twice the willingness to pay threshold, the probability of such a policy change being cost effective is in the region of 77 %. This finding will be of interest to other health-care systems who are transitioning from a TB high-burden to a TB low-burden society in an era of evidence-based health policy decision making. For policy makers in Ireland, an appropriate next step would be to consider the practical elements of implementing and conducting such a vaccination policy, as successful TB control in low burden countries requires efforts to identify the high risk groups among the population and engage them in screening. This must happen along with rigorous implementation of treatment strategies for cases such as directly observed therapy (DOTs), along with active case finding through contract tracing, to ensure that the health system is able to diagnose and manage cases, regardless of risk factors, as early as possible. Indeed, in order to identify the most optimal and efficient programme to use in the Irish healthcare system, it would be prudent to compare the cost effectiveness of a screening and treatment programme vs a programme of vaccination. However, the current TB control programme would have to be standardised nationally, in order that such an evaluation could make a meaningful contribution to aid the decision maker.
Adopting such a change in vaccination policy also raises some ethical implications. It is likely that there will be an increase in TB cases as a result of changing from universal to selective vaccination in Ireland. It is important therefore that the message is communicated clearly so as to maintain public trust in the vaccination programme. A clearly communicated definition and rationale for classifying high and low risk infants would also be needed in order to target the correct infants and to help gain consent from parents for vaccination of their children.
Strengths and limitations / Assumptions used
Identifying the target group for selective vaccination
For the purposes of this analysis, target group of high risk infants for vaccination were assumed to be those whose families have immigrated from high-incidence countries. In Ireland this is likely to be the largest group of “at risk” infants and data from the Growing Up in Ireland study  was used to help quantify this parameter. There will be considerable uncertainty with the figure used here (11.7 % of the birth cohort) as data from some local health offices around the Dublin area showed that for the latter half of 2012 and early 2013, there was considerable variation in the proportion of high risk infants (out of all those vaccinated) brought for BCG vaccination. These figures ranged from 11.8 % in some areas to 47.6 % in other areas (NIO, personal communication). These figures were, however, highly dependent on the clinic location and it is likely that the higher figures will be over estimates. Other age groups not considered in the analysis were children between the ages of one to 16, who were previously unvaccinated, and came from “high risk” families, as were previously unvaccinated under 16 year olds, who were born or lived for prolonged periods in a high endemic area, as it was difficult to quantify these groups. However they are not considered to be the largest “high-risk” group.
Quality of life
This study did not incorporate a quality of life measurement into the analysis. There is currently a paucity of data in the literature on the quality of life in children, probably due to the absence of an appropriate quality of life instrument. As stipulated in the recent NICE clinical guideline on tuberculosis , a study is needed to ascertain quality-of-life score estimates from those with TB (both active disease and latent infection), including adverse treatment effects, using an appropriate quality-of-life instrument. Cost-effectiveness estimates in the form of QALYs would be more comparable with cost-effectiveness estimates from other assessments of vaccines and could assist in improving economic decision-making throughout TB care. However, the incorporation of LYG as the outcome measure does facilitate its comparison with assessments conducted previously by this group (e.g., PCV7 , HPV , Hepatitis B  and rotavirus ).
The results of the analysis are subject to some uncertainty. One way sensitivity analysis indicates that the ICERs are sensitive to the estimate of vaccine efficacy against deaths. This is in keeping with the evidence from the literature. There is also uncertainty associated with the multiplier which apportions a level of risk to the targeted (i.e., selective) population. In the absence of any definitive evidence on the level of risk in the selective population, the assumption is based on the TB rates in the foreign born population relative to the indigenous population.
The results of the current study (i) support the protective effect of the BCG vaccine in infants and (ii) suggest that a move from the universal to a selective based strategy could be considered decrementally cost-effective and may offer an opportunity to improve the efficiency of health resource allocation, whereby the resources saved could be applied to specific areas targeted in the national TB control and prevention programme. The results of this study will be of interest to those who are tasked with resource planning and will serve as a beneficial case study for those emerging economies with limited health resources, who are working towards lowering the incidence of TB in their country.
BCG, Bacillus Calmette–Guérin; DOTs, directly observed therapy; DRG, diagnosis related group; HPSC, Health Protection Surveillance Centre; HPV, Human Papillomavirus; HSE, Health Service Executive; ICER, incremental cost effectiveness ratio; IUATLD, International Union Against Tuberculosis and Lung Disease; LYG, life year gained; NIAC, National Immunisation Advisory Committee; NIO, National Immunisation Office; PCV, Pneumococcal Conjugate Vaccine; QALY, quality adjusted life year; TB, tuberculosis
International Union Against Tuberculosis and Lung Disease. Criteria for discontinuation of vaccination programmes using Bacille Camille Guerin (BCG) in countries with low prevalence of tuberculosis. Tuber Lung Dis. 1994;75:179–80.
Levy-Bruhl D. Prospects for the BCG vaccination programme in France. Euro Surveill. 2006;11(3):11–4.
Bruhl DL, Paty MC, Antoine D, Bessette D. Recent changes in tuberculosis control and BCG vaccination policy in France. Euro Surveill. 2007;12(9):E070913.
Salo EP. BCG in Finland: changing from a universal to a selected programme. Euro Surveill. 2006;11(3):18–20.
Romanus V, Svensson A, Hallander HO. The impact of changing BCG coverage on tuberculosis incidence in Swedish-born children between 1969 and 1989. Tuber Lung Dis. 1992;73(3):150–61.
Rahman M, Sekimoto M, Takamatsu I, Hira K, Shimbo T, Toyoshima K, Fukui T. Economic evaluation of universal BCG vaccination of Japanese infants. Int J Epidemiol. 2001;30(2):380–5.
Growing up in Ireland Study. National Longitutinal Study of Children. Dublin 2, Ireland: Dept of Health & Children; 2010.
Health Protection Surveillance Centre. Epidemiology of Tuberculosis in Ireland 2009. 2012.
Central Statistics Office (Ireland). Irish Life Tables No 15 (2005-2007). 2009.
Rodrigues LC, Diwan VK, Wheeler JG. Protective effect of BCG against tuberculous meningitis and miliary tuberculosis: a meta-analysis. Int J Epidemiol. 1993;22(6):1154–8.
Colditz GA, Berkey C, Mosteller F. Efficacy of BCG vaccination of newborns and infants in the prevention of tuberculosis; a meta-analysis. Pediatrics. 1995;96:29–35.
Trunz BB, Fine P, Dye C. Effect of BCG vaccination on childhood tuberculous meningitis and miliary tuberculosis worldwide: a meta-analysis and assessment of cost-effectiveness. Lancet. 2006;367(9517):1173–80.
Colditz GA, Brewer TF, Berkey CS, Wilson ME, Burdick E, Fineberg HV, Mosteller F. Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature. JAMA. 1994;271(9):698–702.
Immunisation Uptake Statistics. [http://www.hpsc.ie/A-Z/VaccinePreventable/Vaccination/ImmunisationUptakeStatistics/]. Accessed 20 Apr 2016.
Rossignol L, Guthmann J, Kernéis S, Aubin-Auger I, Lasserre A, Chauvin P, Pelat C, Hanslik T, Lévy-Bruhl D, Blanchon T. Barriers to implementation of the new targeted BCG vaccination in France: a cross sectional study. Vaccine. 2011;29(32):5232–7.
UK Health Protection Agency. Tuberculosis Update. 2013.
Todd RM, Neville JG. The Sequelae of Tuberculous Meningitis. Arch Dis Child. 1964;39:213–25.
Wasz-Höckert O, Donner M. Results of the treatment of 191 children with tuberculous meningtis in the years 1949-1954. Acta Paediatr. 1963;141:7.
Lorber J. Long-term follow-up of 100 children who recovered from tuberculous meningitis. Pediatrics. 1961;28:778–91.
Voljavec BF, Orton SP, Corpe RF. Tuberculous meningitis; prognosis and treatment. Am Rev Respir Dis. 1959;80:388–97.
Pohitonova MP. The present and future position in the treatment of tuberculous meningitis in children. World Med. 1960;27:189.
Lapides MI. Clinical features, treatment and prophylaxis of rediual psychic disturbances after tuberculous meningitis in children. World Med. 1962; 31: 67.
Schoeman WJ, Burger M, van Zyl F, Fertig G, van Rensburg AJ, Springer P, Donald P. Long term follow up of childhood tuberculosis meningitis. Dev Med Child Neurol. 2002;44:522–6.
Health Service Executive (HSE) Ireland. Ready Reckoner of acute hospital inpatient activity and costs (summarised by DRG) relating to 2010 costs and activity. Casemix Unit 2012.
Statens Serum Institute. Summary of Product Characteristics BCG Vaccine SSI. 2007.
Irish Medicines Board. Drug Safety Newsletter vol. 17th. 2003.
Irish Medicines Board. BCG Vaccine SSI – Retrospective Review of Serious Local Adverse Reactions. In: Drug Safety Newsletter vol. 21st. 2006.
Irish Medicines Board. BCG Vaccine - Update. In: Drug Safety Newsletter. vol. 24th. 2007.
Irish Medicines Board. BCG Vaccine SSI –Update. In: Drug Safety Newsletter. 2008.
Irish Medicines Board. BCG Vaccine. In: Drug Safety Newsletter vol. 38th. 2010.
Irish Medicines Board. BCG Vaccine SSI and Severe Local Reactions. In: Drug Safety Newsletter. 2011.
Bolger T, O' Connell M, Menon A, Butler K. Complications associated with the bacille Calmette Guérin vaccination in Ireland. Arch Dis Child. 2006;91:594–7.
McCarthy P, Mullane D, Horgan M. A study of Bacillus Calmette-Guerin (BCG) related lymphadenitis occurrence and management in the paediatric population of Cork University Hospital. Cork: Department of Paediatrics, University College Cork; 2012. Unpublished Report.
Teo S, Smeulders N, Shingadia D. BCG vaccine-associated suppurative lymphadenitis. Vaccine. 2005;23:2676–9.
Turnbull F, McIntyre P, Achat H. National Study of Adverse Reactions after Vaccination with Bacille Calmette-Guerin. Clin Infect Dis. 2002;34:447–53.
Dommergues M, de La Rocque F, Guy C. Local and regional adverse reactions to BCG-SSI® vaccination: A 12-month cohort follow-up study. Vaccine. 2009;27(50):6967–73.
Sterne JA, Rodrigues LC, Guedes IN. Does the efficacy of BCG decline with time since vaccination? Int J Tuberc Lung Dis. 1998;2(3):200–7.
Health Information Quality Authority. Guidelines for the Economic Evaluation of Health Technologies in Ireland. Dublin, Ireland: 2010.
Aronson NE, Santosham M, Comstock GW, Howard RS, Moulton LH, Rhoades ER, Harrison LH. Long-term efficacy of BCG vaccine in American Indians and Alaska Natives: a 60-year follow-up study. JAMA. 2004;291(17):2086–91.
Central Statistics Office (Ireland). Average Earnings Per Week (Euro) by Sex, Year and Broad Industrial Sector for 2006. 2006.
Roberts JA, Cumberland P, Sockett PN, Wheeler J, Rodrigues LC, Sethi D, Roderick PJ. The study of infectious intestinal disease in England: socio-economic impact. Epidemiol Infect. 2003;130(1):1–11.
O’Brien B, Gertsen K, Willan A, Faulkner A. Is there a kink in consumers' threshold value for cost-effectiveness in health care? Health Econ. 2002;11(2):175–80.
Kelly P, McKeown D, Clancy L. Neonatal BCG vaccination in Ireland: evidence of its efficacy in the prevention of childhood tuberculosis. Eur Respir J. 1997;10(3):619–23.
Stinson J, Kelly P, Howell F, Clancy L. National tuberculosis survey (1986). Ir Med J. 1988;81(1):7–10.
McKeown D, Kelly P, Clancy L. National TB survey (1991): preliminiary analysis for the Republic of Ireland. Eur Respir J. 1993;6(Suppl 17);248S.
Warde C. Policy on BCG vaccination: a review. In. Edited by Dublin EHB; 1988.
Johnson H. Neonatal BCG policy and childhood tuberculosis in the Republic of Ireland. Commun Dis Rep CDR Rev. 1993;3(9):R132–4.
Connolly K, Murphy C. A school outbreak of tuberculosis. Ir Med J. 1987;80(12):415.
Briscoe D, Gill D. Tuberculosis in a children's hospital. Ir J Med Sci. 1987;156(2):51–3.
Shannon A, Kelly P, Lucey M, Cooney M, Corcoran P, Clancy L. Isoniazid resistant tuberculosis in a school outbreak: the protective effect of BCG. Eur Respir J. 1991;4(7):778–82.
O'Sullivan M, Burke M. A teenage tuberculosis cluster. Epi Insight. 2001;2(3):2.
Gaensbauer JT, Vandaleur M, O’Neil M, Altaf A, Ní Chróinín M. BCG protects toddlers during a tuberculosis outbreak. Arch Dis Child. 2009;94(5):392–3.
Nelson AL, Cohen JT, Greenberg D, Kent DM. Much Cheaper, Almost as Good: Decrementally Cost-Effective Medical Innovation. Ann Intern Med. 2009;151:662–7.
Carthy T, Chilton S, Covey J, Hopkins L, Jones-Lee M, Loomes G. On the contigent valuation of safety and the safety contingent valuation - the cv/sc 'chained' approach. J Risk Uncertain. 1998;17:187–213.
NICE Clinical Guideline 117. Tuberculosis. Clinical diagnosis and management of tuberculosis, and measures for its prevention and control. Developed by the National Collaborating Centre for Chronic Conditions and the Centre for Clinical Practice at NICE. Issue date: March 2011.
Tilson L, Usher C, Butler K, Fitzsimons J, O'Hare F, Cotter S, O'Flanagan D, Johnson H, Barry M. Economic evaluation of a universal childhood pneumococcal conjugate vaccination strategy in Ireland. Value Health. 2008;11(5):898–903.
Usher C, Tilson L, Olsen J, Jepsen M, Walsh C, Barry M. Cost-effectiveness of human papillomavirus vaccine in reducing the risk of cervical cancer in Ireland due to HPV types 16 and 18 using a transmission dynamic model. Vaccine. 2008;26(44):5654–61.
Tilson L, Thornton L, O’Flanagan D, Johnson H, Barry M. Cost effectiveness of hepatitis B vaccination strategies in Ireland: an economic evaluation. Eur J Public Health. 2008;18(3):275–82.
Tilson L, Jit M, Schmitz S, Walsh C, Garvey P, McKeown P, Barry M. Cost effectiveness of universal rotavirus vaccination in reducing rotavirus gastroenteritis in Ireland. Vaccine. 2011;29(43):7463–73.
The authors wish to acknowledge the contribution of data on contact tracing by Dr. Mary O’Meara (HSE East) and discussions with Dr. Patrick Gavin (Childrens University Hospital Dublin 1); Dr. Paul Kelly; Professor Joe Keane & Mr. Colm Mc Donald (St. James’s Hospital Dublin) and Ms. Christine Yearsley (Mater Misericordiae University Hospital, Dublin).
Unconditional funding was received from the National Immunisation Advisory Committee for conducting this study.
Availability of data
The data supporting the conclusions of this article are included within the article and its additional files.
CU, RA and SS coordinated the study and CW participated in its design. JK, DO’F, JO’D, KC, BC, KB and MB helped with data interpretation and with drafting the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Resource utilisation and unit cost data for the direct cost estimate for an episode of latent TB (LTBI). (PDF 93 kb)
Resource utilisation and unit cost data for the direct cost estimate for an episode of pulmonary TB. (PDF 113 kb)
Resource utilisation and unit cost data for the direct cost estimate for an episode of extrapulmonary TB. (PDF 122 kb)
Resource utilisation and unit cost data for the direct cost estimate for an episode of TB Meningitis (PDF 123 kb)
Cost of long term complications of meningitis (PDF 109 kb)
About this article
Cite this article
Usher, C., Adams, R., Schmitz, S. et al. Evaluating the neonatal BCG vaccination programme in Ireland. Arch Public Health 74, 28 (2016). https://doi.org/10.1186/s13690-016-0141-0
- BCG vaccine
- Paediatric tuberculosis
- Vaccine efficacy
- Cost effectiveness
- Neonatal vaccination