Skip to main content
Download PDF

Innovative use of data sources: a cross-sectional study of data linkage and artificial intelligence practices across European countries

Archives of Public Health volume 78, Article number: 55 (2020) Cite this article

Abstract

Background

The availability of data generated from different sources is increasing with the possibility to link these data sources with each other. However, linked administrative data can be complex to use and may require advanced expertise and skills in statistical analysis. The main objectives of this study were to describe the current use of data linkage at the individual level and artificial intelligence (AI) in routine public health activities, to identify the related estimated health indicators (i.e., outcome and intervention indicators) and health determinants of non-communicable diseases and the obstacles to linking different data sources.

Method

We performed a survey across European countries to explore the current practices applied by national institutes of public health, health information and statistics for innovative use of data sources (i.e., the use of data linkage and/or AI).

Results

The use of data linkage and AI at national institutes of public health, health information and statistics in Europe varies. The majority of European countries use data linkage in routine by applying a deterministic method or a combination of two types of linkages (i.e., deterministic & probabilistic) for public health surveillance and research purposes. The use of AI to estimate health indicators is not frequent at national institutes of public health, health information and statistics. Using linked data, 46 health outcome indicators, 34 health determinants and 23 health intervention indicators were estimated in routine. The complex data regulation laws, lack of human resources, skills and problems with data governance, were reported by European countries as obstacles to routine data linkage for public health surveillance and research.

Conclusions

Our results highlight that the majority of European countries have integrated data linkage in their routine public health activities but only a few use AI. A sustainable national health information system and a robust data governance framework allowing to link different data sources are essential to support evidence-informed health policy development. Building analytical capacity and raising awareness of the added value of data linkage in national institutes is necessary for improving the use of linked data in order to improve the quality of public health surveillance and monitoring activities.

Peer Review reports

Background

The availability of administrative data generated from different sources is increasing. The possibility to link these data sources with other databases offers unique opportunities to answer those research questions, which require a large sample size or detailed data on hard-to-reach populations. This methodology link available information from different sources and can generate evidence at population level with a high level of external validity and relevance for policy making [1]. Over an extensive period, data linkage ensures a high statistical power, thereby reducing methodological issues relating to attrition, recall bias and lost-to-follow up [2]. This technique also allows performing more detailed stratified analyses of subgroups according to age, or specific geographical regions, and providing rapid access to data collected in a standardized format [3,4,5].

The value of any surveillance system ultimately depends on timely and reliable information [6]. There are several data sources, which are used for public health surveillance, for example, health interviews and examination surveys, diseases-specific registries, epidemiological cohort studies, hospital discharge data, health insurance claims, mortality database, etc. Traditional data sources (e.g., health interview and examination surveys, disease-specific registries, etc.) and administrative data sources (e.g., hospital discharge, health insurance claims, causes of mortality data, etc.) complement each other and can increase the completeness and comprehensiveness of health information by taking into account various dimensions of health and risk factors influencing health status directly and indirectly.

Linking various data sources improves the completeness and comprehensiveness of information to guide health policy process, effective patient care and health services management [7]. Data linkage is an important technique that connects detailed information about individuals or entities from different data sources to enrich or create new data source. This methodology potentiate the capacity to study disease burden and progression, risk factors, care pathways and long-term outcomes for public health research and health surveillance [1]. Many countries have already invested in data linkage to improve their health information system [8], but there are wide differences in capacity across European countries to perform data linkage in routine. However, linked administrative data can be complex to use and may require advanced expertise and skills in statistical analysis [9]. Generating efficiently comparable and timely health information across European Union (EU), European Economic Area (EEA) and other European countries requires skills and expertise in performing data linkage and applying AI to estimate health indicators. Artificial intelligence (AI), also known as machine intelligence, is a branch of computer science that aims to imbue software with the ability to analyze its environment using either predetermined rules and search algorithms, or pattern recognizing machine learning models, and then make decisions based on those analyses [10]. Machine learning is an application of AI and is often applied for the diagnosis of certain medical conditions as well as outcome prediction and prognosis evaluation with high precision [11].

We explored the differential use of data linkage in routine health monitoring based on the latest developments in new methods and analysis across European countries. This study was carried out under the InfAct (Information for Action) project [12] which is a joint action of Member States aiming to develop a more sustainable EU health information system through improving the availability of comparable, robust and policy-relevant health status data and health system performance information. InfAct gathers 40 national health authorities from 28 Member States (MSs). This study is part of a work package (WP9) focused on innovation in health information system (i.e., using data linkages and/or AI) to improve public health surveillance and health system performance for health policy development. The main objectives of this study were 1. to describe the current use of data linkage at the individual level and AI techniques applied in routine public health activities, 2. to identify the relevant health indicators (i.e., outcome and intervention indicators) estimated and health determinants of non-communicable diseases and 3. to identify that what are the obstacles to linking different data sources in routine public health surveillance and research.

Methodology

We performed the following steps to achieve the objectives of this study:

Literature search

We reviewed the existing literature published on the use of data linkage and AI (i.e., one technique of AI is machine learning) for health status monitoring using PubMed on Dec. 1, 2018. We included in our search peer-reviewed articles, systematic reviews and published reports in English language. The search strategies are reported in additional file 1. Based on this review, we identified different data sources used for data linkage, the use of artificial intelligence [AI]), health outcome and intervention indicators and determinants of health (Additional file 2). This was not an exhaustive search and it was performed only to identify any pre-existing questionnaire or relevant information that could be used for the development of our survey on the current practices in innovative use of data sources across European countries.

Definition of innovative use of data sources

We developed the definition of “innovative use of data sources” in the context of public health and health information system activities and defined as:

  • The linkage of different data sources (health surveys and/or disease-specific or population-based registries and/or national cohort and/or clinical research datasets and/or administrative data and/or electronic health records and/or X-data sources i.e., information on determinants of health and can include data on various exposures [Additional file 2]) with each other using linkage technology and/or

  • The use of AI either applied to linked data or to an individual data set,

allowing a better understanding of what determines population health or to promote the efficiency of the health system and guide decision making at different geographical levels, or at another categorization parameter level.

Development of the web-based survey

We developed a questionnaire and requested information from European countries on the data sources used for linkage, general characteristics of the data linkage, use of AI to estimate health indicators, related health outcomes and intervention indicators estimated and health determinants of non-communicable diseases. We reported these results according to three levels of using data linkage or AI in routine public health activities across European countries: 1. Advanced (i.e., those who use data linkage or AI in routine to estimate health indicators), 2. In Progress (i.e., those for whom the deployment of these innovative techniques [i.e., data linkage or AI] is still underway and expect to integrate these techniques in the next 5 years), and 3. Not yet (i.e., those for which the use of these techniques is not foreseen yet).

Survey participants were also asked to report at least three health indicators, which are related to priority medical conditions in their country. We adopted the Euro-REACH Framework (i.e., it is a project based on an international collaboration to improve access to health care data through cross-country comparisons) [13] to classify the identified health outcome indicators, determinants of health and intervention indicators under the following categories: health outcome indicators (1. Health characteristics, 2. Mortality, 3. Human function and quality of life and 4. Life expectancy and well-being), determinants of health (1. Physical environment, 2. Socioeconomic and environment, 3. Health behavior and life style and 4. Biological /metabolic parameters) and intervention indicators (1. Prevention, 2. Promotion and 3. Others). We also asked specific information on the objective of estimation of health indicators (i.e., for public health monitoring, scientific research [clinical, epidemiology, public health], both), status of their use (i.e., was used, currently in use or could be produced in future) and level of estimation (i.e., national, sub-national, metropolitan, at all levels). If the same health indicator was reported more than once either as being estimated currently or to be estimated in future by different countries, we counted those health indicators once. The web-based questionnaire was developed using the Lime Survey tool by the Data lab of Santé Publique France. The questionnaire included both closed and open-ended questions (i.e., 20 questions). This questionnaire was reviewed by a group of experts on health information systems in their country and was revised according to their feedback before the launch of the survey. The web-based version of the questionnaire was pretested by the co-authors (SME, RH and RG) from the national public health institutes of Austria, France and Lithuania respectively, to check the clarity of the questions and contents.

The survey participants were the partners of the InfAct project and/or national representatives, experts, health information advisors in their countries, employed by their government, national institutes of public health, health information and statistics institutes or research departments of the universities.

The invitation email with an electronic link to the questionnaire was sent on April 1, 2019, to the identified representatives in 31 European countries [28 EU-MSs + 2 EEA (Iceland and Norway) + Others (Serbia)] and they were asked to complete the survey in four weeks (i.e., April 30, 2019). For the United Kingdom, data were provided separately by three countries England, Scotland and Wales but counted as one member state. The first reminder was sent via-email one month after the survey launch, on May 3, 2019, and the second reminder another two weeks later, on May 23, 2019. The abbreviations of the member countries and the names of the survey respondents are reported in the additional file 3.

Study outcomes

The main outcomes of this study were the current data linkage and AI practices and related health indicators estimated in routine public health activities across European countries. A descriptive analysis of the web-based questionnaire results was performed using Microsoft Excel.

Results

Literature search

We reviewed 137 citations from PubMed and four reports from the following organizations: OECD (Organization for Economic Co-operation and Development) [14], Euro-REACH [15], HBM4EU (Human Biomonitoring for Europe) [16], EUROCISS (European Cardiovascular Indicators Surveillance Set) [17], to develop this questionnaire (Fig. 1).

Fig. 1
figure 1

Flow diagram of studies using linked data and artificial intelligence for health status monitoring to develop a survey on identifying various data linkage practices across European countries in 2019. *To be more specific for AI techniques, we looked for studies using machine learning techniques (i.e., one type of AI technique) more often used for health status monitoring

Full size image

Survey results

The survey results include the countries response, use of data linkage in routine public health activities, use of AI in routine public health activities, health indicators estimated using linked data and main obstacles to linking different data sources. All survey respondents have validated these results.

  1. i.

    Countries response

Twenty-nine countries (i.e., EU MSs 27 + EEA 1 [Norway] + Others 1 [Serbia]) participated in the survey with a response rate of 94% (29/31). Hungary, Iceland and Northern Ireland did not participate.

  1. ii.

    Use of data linkage in routine public health activities

Our survey results highlight that 24 European countries perform data linkage in their routine public health activities. These countries link administrative data such as EHRs (Electronic Health Records), mortality data, and disease specific registries whereas six of them (Cyprus, Italy, Poland, Portugal, Spain and Slovakia) are also developing this technique further to link with other types of data sources (i.e., demographic data, domestic/leisure accidents data, congenital anomalies registry). Ireland and Latvia have ongoing initiatives of data linkage (Table 1).

Table 1 Use of data linkage for routine public health activities in European countries in 2019
Full size table

Three countries (Greece, Luxembourg and Romania) have not yet planned to integrate data linkage in their routine public health activities. The following reasons were mentioned by some countries for not having institutionalized data linkage: lack of a public health institution, which should collect and govern the health related data, data linkage is not part of the health agenda, lack of commitment from the ministry of health, lack of resources to establish a national health information system, the institutional complexity of the Ministry of Health and strict laws and regulations, which hinder data linkage with different data sources.

Objectives of data linkage

Data linkage can be performed in routine for different objectives such as for health status monitoring, health system performance, health policy development or for scientific research (i.e., public health, epidemiology or clinical) purposes. Our results showed that data linkage was performed for health status monitoring in 20 countries (BE, CY, CZ, DE, DK, EE, ES, FI, FR, HR, IT, LT, MT, NL, PT, SI, SK, SRB, SW, UK (SC, WL), for health policy development in 13 (AT, BE, BG, DK, EE, FR, MT, NL, NO, PL, SK, SW, UK (SC, WL) and for scientific research (public health, epidemiological and clinical) purposes in 13 (BE, CZ, DE, DK, EE, ES, FI, FR, NL, PT, SI, SW, UK (ENG, SC, WL). Finland, Spain, Sweden and Scotland also perform data linkages to identify population risk factors. In Sweden, data linkage is also used to monitor compliance with national treatment guidelines to improve health care quality.

Data sources used for linkage

Our results showed that 24 European countries, who perform data linkage in routine, use most frequently the five following types of data sources: health-related administrative data sources, non-health related administrative data sources, disease-specific registries, national health surveys, population-based epidemiological cohort and clinical trials (Additional file 4). These data sources are linked with each other in different combinations and some examples of the various combinations used across member countries, are reported in additional file 5. These countries perform data linkage based on the following information: social security number, patient unique identification number, person unique pseudonymous identifier, encrypted personal identification number, citizen or national identification number. In some countries, for instance in Ireland, the lack of unique patient identifier number, limits the potential to link with different data sources.

General characteristics of linked dataset

Our results showed that among 24 European countries who perform data linkage in routine, 17 do linkage at national level (Table 2). France, Portugal and Scotland do data linkage both at national and sub-national levels. Denmark, Germany, Norway and Sweden do data linkage at all levels. 23 countries either perform the deterministic type of linkage (12 countries) or a combination of deterministic and probabilistic linkage (11 countries). In 16 out of 24 countries, linked data is available and is used in routine. In 12 out of 24 countries, the register owner (i.e., who governs the data register) provides the approval to access linked data. In 15 out of 24 countries, the accessibility to linked data is in routine or permanent whereas, in 13 countries, the accessibility could be ad-hoc or at intermittent basis depending on the project. In 15 out of 24 countries, linked data do not operate in real-time (i.e., integrate the updated information with minimum delay in time). In 19 out of 24 countries, linked data are flexible to integrate new variables.

Table 2 General characteristics of linked datasets in European countries in 2019
Full size table

There are ongoing projects to integrate data linkage (i.e., in next five years) as part of this technology in their routine public health activities in following European countries: Austria, Cyprus, Czech Republic, Ireland, Italy, Latvia, Norway, Poland, Portugal, and Spain.

  1. iii.

    Use of artificial intelligence (AI) in routine public health activities

The use of AI is not frequent across European countries (Table 3). Only five countries have reported applying the following techniques in routine public health activities: machine learning (Denmark, Finland, Sweden, and UK-Wales), natural language processing (Finland, Sweden, and UK-Wales), Markov decision process (Finland), support vector machine (Finland, UK-Wales), data mining (Finland) and TSP [Travelling Salesman Problem] modelling (Norway). Denmark can apply these techniques not only at national level but also at metropolitan level.

Table 3 Use of artificial intelligence in routine public health activities in European countries in 2019
Full size table

There are ongoing projects to integrate the use of AI in routine public health activities in the next five years in following countries: Croatia, Czech Republic, France, Germany, Norway, Portugal, and Spain. The objectives of these initiatives are for epidemiological research and surveillance of non-communicable and communicable disease estimating the prevalence and prediction of incidences of certain health conditions at various geographical levels.

Two countries mentioned that due to lack of human resources (Lithuania) and capacities/skills (Republic of Serbia) within their public health institutes, AI techniques are not applied in routine public health activities.

Some European countries also mentioned the use of classical statistical techniques without the use of AI (Table 3).

  1. iv.

    Health indicators estimated using linked data

Using linked data, the majority of European countries estimate the following health indicators:

Health outcome indicators

Participants were asked to select at least three health conditions and to report the related health outcome indicators, which are most important for public health in their country. Using linked data, 46 health outcome indicators related to the following seven health conditions were reported from 22 countries: cardiovascular (14), neurodegenerative disease (6), maternal and perinatal health (6), diabetes (6), suicide/trauma/injury (7), cancer (6) and hepatic failure (1) (Additional file 6). The main objectives to estimate these indicators were for public health monitoring and research purposes. The level of estimation was mainly at national and sub-national levels. These 46 health outcome indicators were classified according to the following categories: 1. health characteristics, 2. mortality, 3. human function and quality of life and 4. life expectancy and well-being. For example for the first category, Czech Republic, France, Lithuania, Sweden and Wales, use linked data in routine public health surveillance to estimate the incidence and prevalence of diabetes (Additional file 6).

Health determinants

Participants were also asked to report the corresponding determinants of the identified health conditions. 34 health determinants related to various health conditions were reported by 15 member states (Table 3.2). These determinants are related to the physical environment (12), socioeconomic status and the environment (10), health behavior and lifestyle (6) and biological and metabolic parameters (3) (Additional file 7). These determinants were used to measure the potential associations between these risk factors and health conditions for public health monitoring and research purposes. These determinants can be stratified by age, sex, socioeconomic status and by area of residence. For example in England and Wales, in relation to the physical environment, the proximity of fast food outlets from areas of residence is used to measure its potential association with chronic health conditions such as adiposity and obesity. This variable can be stratified by the area of residence (Additional file 7).

Health intervention indicators

Participants were asked to report at least three health intervention indicators under three categories (i.e., prevention, promotion, others) corresponding to the given health conditions which are most important for public health in their country. Using linked data, 23 health intervention indicators related to the following six health conditions were reported from 17 member states: maternal and perinatal health (7), cancer (6), diabetes (4), cardiovascular (2), neurodegenerative disease (2), suicide/trauma/injury (1) and lower/upper respiratory infections (1), (Additional file 8). The main objectives to estimate these indicators were to guide the health policy process, public health monitoring and for research. These intervention indicators are estimated mainly at national and sub-national levels and currently are in use. For example in Sweden, one of the estimated intervention indicator relates to preventive therapy, the number of diabetic patients counselled by a nurse to avoid complications (Additional file 8).

  1. v.

    Main obstacles to linking different data sources

The majority of European countries we surveyed identified the following main obstacles associated with the implementation and the use of data linkage and advanced statistics: 1. The complex laws and data protection regulations, which block linkage between different data sources with a deterministic approach (legal), 2. Lack of human resources and capacities/skills within national institutes of public health and health information statistics (technical), 3. Lack of governance of health information (data governance) and 4. Limited resources to support the health information infrastructure (organization and structural).

Discussion

The results of this study showed the variability in the use of data linkage and AI at national institutes of public health, health information and statistics across European countries. The majority of countries use data linkage in routine by applying either deterministic or a combination of two types of linkages (i.e., deterministic & probabilistic) for public health surveillance and research purposes. The use of a universal unique identifier, social security number or unique pseudonymous identifier is common to applying deterministic linkage technique among European countries. The use of AI is less common to estimate health indictors at national public health institutes. Across European countries, using data linkage, 46 health outcome indicators related to seven health conditions, 34 related to determinants and 23 health intervention indicators were reported. Some initiatives are ongoing as pilot projects to test these techniques to improve health surveillance and to guide health policy development. Four main obstacles to linking different data sources have been identified by the European experts.

A systematic review has shown that data linkage is used in the field of perinatal health for both health surveillance and research purposes in European countries [8]. Several other studies have shown that linkage is used to explore various dynamics of population health such as social care, psychotic disorders, multi-morbidity, diabetes, obesity, mental health, cardiovascular, antibiotic use and Alzheimer using data linkage with different types of administrative data sources (both related to health and non-health) [7, 18,19,20,21,22,23,24,25,26,27,28,29,30]. For the surveillance of cancer, data linkage not only provides the opportunity to improve the population-based screening [31] but it also helps to detect different types of cancer recurrence [32] and to evaluate the socio-economic status of patients with cancer (e.g., return to work) [33]. Linked data also allows evaluating the health interventions at various levels of the population [34]. The diversity and the volume of health information have been increasing rapidly and push to discover new parameters to improve population health with innovative approaches. In that context, some initiatives have been launched at national level to create health data hub/platform to be used for research and to guide the policy development process [35, 36].

As for AI, there are some studies available which have discussed the advantages of using this technology for early detection and diagnosis of certain medical conditions, for treatment, as well as for outcome prediction and prognosis evaluation with a high level of precision [11, 37] but the use of AI at population level to estimate and predict health indicators remains limited [38]. Furthermore, this technique also permits exploring underlying unobserved trends and patterns in large datasets without priori hypothesis.

Our results highlighted that a few member countries have achieved the most advanced levels of data linkage by linking health information (i.e., clinical, biobanks/laboratory tests, genetics) with non-health population data sources and registers of education, occupation, housing quality, air pollution, criminal statistics and transport/road accidents, etc. These innovative linkages offer the exceptional opportunities to enrich information, investigate non-health determinants and to perform high quality epidemiological research, health surveillance, to guide health policies to improve population health. These innovative linkages are especially relevant and of high value when considering health-in-all policies approaches. However, the majority of European countries have not reached that level of use in data linkage and AI and underlined main obstacles associated with the implementation and the use of data linkage and AI. These are related to legal, technical and data governance issues as well as organizational and structural aspects.

To address these issues and to increase the uptake of innovative and high-performance technologies in public health activities, we propose the following recommendations: A. Legal aspects: 1. More flexible data governance frameworks to support data linkage of different data sources should be encouraged [39], 2. Specific mandates to ensure data availability/access/capture and safe storage should be an integral part of a national/regional health information system, 3. Differences in the implementation and interpretation of the EU-GDPR (General Data Protection Regulations) and additional national regulations should be mapped and if possible harmonized across EU-MSs [40]; B. Technical aspects: 4. More collaborations and partnerships should be encouraged to build up capacities for using new health information related technologies, to share new methods, skills, experiences and data for comparative research studies among EU national institutes of public health, health information and statistics; C. Data  governance, 5. Initiatives to strengthen national health information infrastructure should be encouraged; D. Organizational and structural aspects, 6. Ministries of health and research from European countries should provide their support (i.e., financial and political) for the development of integrated national health data hubs/data platforms to strengthen the national health information infrastructure.

There are a few limitations in this study. First, our study may not have a complete coverage of data linkage practices within countries. The current linkages reported by national institutes of public health, health information and statistics we surveyed may differ from those conducted by other research institutes in that country which we did not cover in the survey. This might influence the results of this study. Second, we acknowledge that there are other innovative methods exist such as use of data clouds or blockchain. However, these methods are not frequently used for routine public health surveillance and research purposes. Third, we limited the response burden of health indicators to three priority health conditions. Therefore, our results do not constitute an exhaustive list of health indicators that are used in the country to inform policy and practice. It may limit the number of health indicators being estimated using linked data and advanced statistics. Nevertheless, this survey provides the latest overview of current practices in data linkage and AI in European countries and highlights the related obstacles in using these technologies for routine public health activities.

Conclusions

To our knowledge, this is the first study, which provides the information on current practices of data linkage and AI use at national institutes of public health, health information and statistics across European countries. Our results highlight that the majority of countries have integrated data linkage in their routine public health activities but few use AI. The European countries who are advanced in using both techniques i.e., data linkage and AI, could guide others by an exchange of their experiences and examples of good practices. A sustainable national health information system and flexible data governance frameworks to link different data sources are essential to support evidence-based practices for health policy development. Building analytical capacity and raising awareness of the added value of data linkage in national institutes of public health, health information and statistics is necessary for increasing the use of linked data in order to improve the quality of public health surveillance and monitoring activities. The recommendations we have put forth could ultimately contribute to strengthening national health information systems in Europe and would facilitate moving towards the establishment of an integrated EU- Health Information System.

Availability of data and materials

Not applicable.

Abbreviations

AI:

Artificial Intelligence

EU:

European Union

EEA:

European Economic Area

MSs:

Member States

InfAct:

Information for Action i.e., a joint action of Member States to establish a sustainable European health information system

WP:

Work Package

Euro-REACH:

It is an international collaboration to improve access to health care data through cross-country comparisons

OECD:

Organization for Economic Co-operation and Development

HBM4EU:

Human Biomonitoring for Europe

EUROCISS:

European Cardiovascular Indicators Surveillance Set

PCA:

Principal Component Analysis

GDPR:

General Data Protection Regulations

References

  1. Harron K, Dibben C, Boyd J, Hjern A, Azimaee M, Barreto ML, Goldstein H. Challenges in administrative data linkage for research. Big Data Soc. 2017;4(2):2053951717745678.

    Article  Google Scholar 

  2. Ferrante A: The Use of Data-Linkage Methods in Criminal Justice Research: http://www5.austlii.edu.au/au/journals/CICrimJust/2009/3.html. Criminal Justice 2009.

  3. GF R: Administrative and claims records as sources of health care cost data. Med Care 2009, 47(7 Suppl 1).

  4. Charlton RA, Neville AJ, Jordan S, Pierini A, Damase-Michel C, Klungsøyr K, Andersen A-MN, Hansen AV, Gini R, Bos JHJ, et al. Healthcare databases in Europe for studying medicine use and safety during pregnancy. Pharmacoepidemiol Drug Saf. 2014;23(6):586–94.

    Article  Google Scholar 

  5. Thygesen LC, Ersbøll AK. When the entire population is the sample: strengths and limitations in register-based epidemiology. Eur J Epidemiol. 2014;29(8):551–8.

    Article  Google Scholar 

  6. WHO: Public Health Surveillance: https://www.who.int/topics/public_health_surveillance/en/.

  7. Lloyd K, McGregor J, John A, Craddock N, Walters JT, Linden D, Jones I, Bentall R, Lyons RA, Ford DV, et al. A national population-based e-cohort of people with psychosis (PsyCymru) linking prospectively ascertained phenotypically rich and genetic data to routinely collected records: overview, recruitment and linkage. Schizophr Res. 2015;166(1):131–6.

    Article  Google Scholar 

  8. Delnord M, Szamotulska K, Hindori-Mohangoo AD, Blondel B, Macfarlane AJ, Dattani N, Barona C, Berrut S, Zile I, Wood R, et al. Linking databases on perinatal health: a review of the literature and current practices in Europe. Eur J Pub Health. 2016;26(3):422–30.

    Article  CAS  Google Scholar 

  9. Bradley CJ, Penberthy L, Devers KJ, Holden DJ: Health Services Research and Data Linkages: Issues, Methods, and Directions for the Future. Health Services Research 2010, 45(5p2):1468–1488.

  10. Techopedia: What is Artificial Intelligence: https://www.techopedia.com/definition/190/artificial-intelligence-ai. 2020.

  11. Jha S, Topol EJ. Adapting to artificial intelligence: radiologists and pathologists as information specialists. JAMA. 2016;316(22):2353–4.

    Article  Google Scholar 

  12. Joint Action on Health Information: https://www.inf-act.eu/. 2018.

  13. EuroREACH: EuroREACH Framework: http://hdn.euhs-i.eu/performance/frameworks/euroreach-framework. 2013.

  14. OECD: Health at Glance (OECD Indicators): https://www.health.gov.il/PublicationsFiles/HealthataGlance2017.pdf. 2007.

  15. Navigator HD: EuroREACH Framework: http://hdn.euhs-i.eu/performance/frameworks/euroreach-framework. 2013.

  16. HBM4EU: Linking HBM, health surveys and registers: https://www.hbm4eu.eu/deliverables/. 2018.

  17. Eurociss: Cardiovascular Indicators Surveillance Set: https://ec.europa.eu/health/ph_projects/2000/monitoring/fp_monitoring_2000_frep_10_en.pdf. 2000.

  18. Lyons RA, Jones KH, John G, Brooks CJ, Verplancke J-P, Ford DV, Brown G, Leake K. The SAIL databank: linking multiple health and social care datasets. BMC Medical Informatics and Decision Making. 2009;9(1):3.

    Article  Google Scholar 

  19. Tuppin P, Rudant J, Constantinou P, Gastaldi-Menager C, Rachas A, de Roquefeuil L, Maura G, Caillol H, Tajahmady A, Coste J et al: Value of a national administrative database to guide public decisions: From the systeme national d'information interregimes de l'Assurance Maladie (SNIIRAM) to the systeme national des donnees de sante (SNDS) in France. 2017(0398–7620 (Print)).

  20. Chan Chee C, Chin F, Ha C, Beltzer N, Bonaldi C. Use of medical administrative data for the surveillance of psychotic disorders in France. BMC Psychiatry. 2017;17(1):386.

    Article  Google Scholar 

  21. Rodgers Se Fau - Bailey R, Bailey R Fau - Johnson R, Johnson R Fau - Poortinga W, Poortinga W Fau - Smith R, Smith R Fau - Berridge D, Berridge D Fau - Anderson P, Anderson P Fau - Phillips C, Phillips C Fau - Lannon S, Lannon S Fau - Jones N, Jones N Fau - Dunstan FD et al: Health impact, and economic value, of meeting housing quality standards: a retrospective longitudinal data linkage study Public Health Research 2018.

  22. Violán C, Foguet-Boreu Q, Hermosilla-Pérez E, Valderas JM, Bolíbar B, Fàbregas-Escurriola M, Brugulat-Guiteras P, Muñoz-Pérez MÁ. Comparison of the information provided by electronic health records data and a population health survey to estimate prevalence of selected health conditions and multimorbidity. BMC Public Health. 2013;13(1):251.

    Article  Google Scholar 

  23. Fuentes S, Cosson E, Mandereau-Bruno L, Fagot-Campagna A, Bernillon P, Goldberg M, Fosse-Edorh S, Group C-D. Identifying diabetes cases in health administrative databases: a validation study based on a large French cohort. International Journal of Public Health. 2019;64(3):441–50.

    Article  Google Scholar 

  24. Orriols L, Delorme B, Gadegbeku B, Tricotel A, Contrand B, Laumon B, Salmi L-R. Lagarde E, on behalf of the Crg: prescription medicines and the risk of road traffic crashes: a French registry-based study. PLoS Med. 2010;7(11):e1000366.

    Article  Google Scholar 

  25. Mason KE, Pearce N, Cummins S. Associations between fast food and physical activity environments and adiposity in mid-life: cross-sectional, observational evidence from UK biobank. Lancet Public Health. 2018;3(1):e24–33.

    Article  Google Scholar 

  26. Cleland B, Wallace J, Bond R, Black M, Mulvenna M, Rankin D, Tanney A. Insights into antidepressant prescribing using open health data. Big Data Research. 2018;12:41–8.

    Article  Google Scholar 

  27. Gabet A, Danchin N, Puymirat E, Tuppin P, Olié V. Early and late case fatality after hospitalization for acute coronary syndrome in France, 2010–2015. Archives of Cardiovascular Diseases. 2019;112(12):754–64.

    Article  Google Scholar 

  28. Williamson EDS, Morris S, Clarke CS, Thomas M, Evans H, et al. Risk of mortality and cardiovascular events following macrolide prescription in. Rhinology. 2019;57(4):252–60.

    CAS  PubMed  Google Scholar 

  29. Hopkins CWE, Morris S, Clarke CS, Thomas M, Evans H, Little P, et al. Antibiotic usage in chronic rhinosinusitis: analysis of national primary care. Rhinology. 2019;6(10):136.

    Google Scholar 

  30. Ponjoan AG-OJ, Blanch J, Fages E, Alves-Cabratosa L, et al. How well can electronic health records from primary care identify Alzheimer's. Clin Epidemiol. 2019;11:509–18.

    Article  Google Scholar 

  31. Májek O, Anttila A, Arbyn M, van Veen E-B, Engesæter B, Lönnberg S. The legal framework for European cervical cancer screening programmes. Eur J Pub Health. 2018;29(2):345–50.

    Article  Google Scholar 

  32. Hassett MJ, Uno H, Cronin AM, Carroll NM, Hornbrook MC, Ritzwoller D. Detecting lung and colorectal Cancer recurrence using structured clinical/administrative data to enable outcomes research and population health management. Med Care. 2017;55(12):e88–98.

    Article  Google Scholar 

  33. Kiasuwa-Mbengi RL, Nyaga V, Otter R, de Brouwer C, Bouland C. The EMPCAN study: protocol of a population-based cohort study on the evolution of the socio-economic position of workers with cancer. Archives of Public Health. 2019;77(1):15.

    Article  Google Scholar 

  34. Lyons RA, Turner S, Lyons J, Walters A, Snooks HA, Greenacre J, Humphreys C, Jones SJ. All Wales injury surveillance system revised: development of a population-based system to evaluate single-level and multilevel interventions. Injury Prevention. 2016;22(Suppl 1):i50–5.

    Article  Google Scholar 

  35. Health FMo: Health Data Hub: https://www.health-data-hub.fr/?lang=en. 2019.

  36. Government W: Welsh Government takes innovative approach to policy making in Wales: https://www.swansea.ac.uk/press-office/news-archive/2019/welshgovernmenttakesinnovativeapproachtopolicymakinginwales.php. 2019.

  37. Patel VL, Shortliffe EH, Stefanelli M, Szolovits P, Berthold MR, Bellazzi R, Abu-Hanna A. The coming of age of artificial intelligence in medicine. Artif Intell Med. 2009;46(1):5–17.

    Article  Google Scholar 

  38. Flaxman AD, Vos T. Machine learning in population health: opportunities and threats. PLoS Med. 2018;15(11):e1002702.

    Article  Google Scholar 

  39. 2020 C: Data Protection and Artificial Intelligence: https://edps.europa.eu/data-protection/our-work/subjects/artificial-intelligence_en.

  40. EPRS: How the General Data Protection Regulation changes the rules for scientific research: https://www.europarl.europa.eu/RegData/etudes/STUD/2019/634447/EPRS_STU(2019)634447_EN.pdf. 2019.

Download references

Acknowledgements

We acknowledge the kind support of Jessica Gane (Data Department, Santé Publique France) for developing the web-based survey. We specially acknowledge Jean-Claude Desenclos and Yann Le Strat for their kind support in developing the survey questionnaire.

We acknowledge the following partners who contributed to complete this survey: Bulgaria: Raina Nikolova (Public Health Institute), Croatia: Ivan Pristaš (CIPH, Cyprus: Vasos Scoutellas (Public health institute), Czech Republic: Šárka Daňková, Jiří Jarkovský (Institute of health information and statistics of Czech Republic), Denmark: Mette Bjerrum Koch (Danish Health data authority), Maja Bæksgaard Jørgensen (Statens Institute for Folkesundhed), Estonia: Eleri Lapp (MoSH), Finland (Mike Gissler (THL), Germany: Angelika Schaffrath Rosario (RKI), Greece: Spyridon Goulas (Governmental Health Insurance Organization), France: Jennifer Zeitlin (INSERM U1153), Sandrine Fosse (Santé Publique France [SPF]), Laure Carcaillon-Bentata, (SPF), Valérie Olie (SPF), Louis-Marie Paget (SPF), Viet Nguyen-Thanh (SPF), Ireland: Sheona Gilsenan (DoH), Italy: Brigid Unim (ISS), Latvia: Janis Misins (CDPC), Luxembourg: Anne-Charlotte Lorcy (Health Directorate), Malta: Neville Calleja (MFH), Norway: Heidi Lyshol (Norwegian Institute of Public Health), Inger Johanne Bakken (Norwegian Directorate of Health, Poland: Jakub Adamski (MoH), Piotr Nowosielski (MoH), Portugal: Paulo Nogueira (DGS), Martin José (Public Health Institute), Carlos Dias (Public health Institute), Romania: Silviu Radulescu (Public Health Institute), Serbia: Maja Krstic (Batut), Slovakia: Jan Cap (National Health Information Centre), Sweden: Hanne Lobosco (MoH), Rosita Claesson Wigand (Public Health Agency of Sweden), Jenny Börlin (Public Health Agency of Sweden), England: Robert Aldridge (Institute of Health Informatics, University of London), Scotland: Ian Grant (National Statistics Department) and Wales: Ronan Lyons (University of Swansea).

Disclaimer

This article presents independent research. The views expressed are those of the authors and not necessarily those of the Carlos III Institute of Health.

Funding

This research has been carried out in the context of the project ‘801553 / InfAct’, which has received funding from the European Union’s Health Programme (2014–2020).

Marie Delnord is funded by a Marie Sklodowska-Curie Action Individual Fellowship, GA No 795051.

Author information

Authors and Affiliations

  1. Department of Non-Communicable Diseases and Injuries, Santé Publique France, 12 rue du Val d’Osne, 94415, Saint-Maurice, France

    Romana Haneef, Michel Vernay, Emmanuelle Bauchet & Anne Gallay

  2. Epidemiology and public health, Sciensano, Brussels, Belgium

    Marie Delnord & Herman Van Oyen

  3. Health information centre, Institute of hygiene, Vilnius, Lithuania

    Rita Gaidelyte

  4. Department of public health, Ghent University, Ghent, Belgium

    Herman Van Oyen

  5. Institute of research and information for health economics, Paris, France

    Zeynep Or

  6. National Centre for Epidemiology & CIBERESP, Carlos III Institute of Health, Madrid, Spain

    Beatriz Pérez-Gómez

  7. Department of Cardiovascular, Endocrine-metabolic Diseases and Aging, National Institute of Health, Rome, Italy

    Luigi Palmieri

  8. National Institute for Public Health and the Environment (RIVM), Bilthoven, The Netherlands

    Peter Achterberg & Mariken Tijhuis

  9. National Institute of Public Health (NIJZ), Ljubljana, Slovenia

    Metka Zaletel

  10. The Austrian National Public Health Institute (Gesundheit Österreich GmbH, GÖG), Vienna, Austria

    Stefan Mathis-Edenhofer

  11. Institute of Health Information and Statistics of the Czech Republic, Prague, Czech Republic

    Ondřej Májek

  12. Institute of Biostatistics and Analyses, Faculty of Medicine, Masaryk University, Brno, Czech Republic

    Ondřej Májek

  13. The Norwegian Directorate of Health, Oslo, Norway

    Håkon Haaheim

  14. Finnish Institute for Health and Welfare (THL), Helsinki, Finland

    Hanna Tolonen

Authors
  1. Romana Haneef
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marie Delnord
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michel Vernay
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emmanuelle Bauchet
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rita Gaidelyte
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Herman Van Oyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zeynep Or
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Beatriz Pérez-Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Luigi Palmieri
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Peter Achterberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Mariken Tijhuis
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Metka Zaletel
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Stefan Mathis-Edenhofer
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Ondřej Májek
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Håkon Haaheim
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Hanna Tolonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Anne Gallay
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceived and designed the survey: RH EB MV AG. Performed the study: RH AG. Analyzed the data: RH. Analysis of the data and interpretation of the results: RH AG. Contributed to the writing of the manuscript: All authors contributed to the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Romana Haneef.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

All authors gave the consent for publication.

Competing interests

H. Van Oyen is one of the co-authors of this paper and the editor of “Archives of Public Health”. All other authors declare that they have no competing interests related to the work.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

It is a doc. Word file. It describes the search strategies used to identify citations related to data linkage and machine learning technique used for health status monitoring.

Additional file 2.

It is a doc. Word file. It describes the definitions of different data sources used for data linkage for health surveillance and research purposes.

Additional file 3.

It is a doc. Word file and include a table describing the names of survey respondents, their institutes and email addresses.

Additional file 4.

It is a doc. Word file and describes different data sources used for linkage across European countries in 2019.

Additional file 5.

It is a doc word file and describes examples of different combinations of data linkage across European countries in 2019.

Additional file 6.

It is a doc. Word file and describes examples of health outcome indicators estimated using linked data across European countries in 2019.

Additional file 7.

It is a doc. Word file and describes examples of health determinants identified using linked data across European countries in 2019.

Additional file 8.

It is a doc. Word file and describes examples of health intervention indicators estimated using linked data across European countries in 2019.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Haneef, R., Delnord, M., Vernay, M. et al. Innovative use of data sources: a cross-sectional study of data linkage and artificial intelligence practices across European countries. Arch Public Health 78, 55 (2020). https://doi.org/10.1186/s13690-020-00436-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13690-020-00436-9

Keywords

Archives of Public Health

ISSN: 2049-3258