- Open Access
Differences between health technology assessment topics in high- and middle-income countries: a scoping review
Archives of Public Health volume 79, Article number: 225 (2021)
The Health Technology Assessment (HTA) has encountered different issues and challenges over the last two decades. The main purpose of this research is to review the issues and challenges in high- and middle-income countries through reviewing studies related to the HTA.
The HTA area literature of different countries was collected from 2009 to 2020 and analyzed using scoping review, based on Scopus and WoS databases.
Given the fact that the HTA is practically done in high- and middle-income countries, the results of reviewing the studies and articles of countries reveal that high-income countries seek to increase the participation of stakeholders and enhance the transparency of processes, policy-making, and regulation of the HTA, as well as the systematization of various participant institutions in this area. Middle-income countries, on the other hand, are mostly involved in raising awareness, training and skill development of HTA-related staff, institutionalizing the concept of HTA, and allocating appropriate resources for effective and safe decision-making in their health system.
The problem of incoordination between stakeholders (participant institutions) in the HTA, and thereby, problems in decision-making were found in many of the studied reports and articles. Thus, one of the useful efforts to be made by different countries to maintain the integrity of this system would be the process of involving all members of this system and the formation of a healthy ecosystem in the HTA.
The significance of the health sector has been highlighted more than ever in recent years due to the increased threats of infectious and non-communicable diseases. In particular, with the onset of the COVID-19 pandemic in 2020, the area of health has turned into a priority for the world. The importance of this issue can be realized by considering the cost overrun of the healthcare and treatment area, as well as the per capita cost in this area. Data released on the costs of healthcare and treatment in various countries around the world indicate the rise of these costs more than the economic growth of countries. On the other hand, the increasing advancement of technologies in the world has led to the emergence of several technological solutions to solve healthcare-related problems. The industry and its major communication and information technologies have nowadays totally changed both the service sector and the world of production. This especially applies to the health sector where the Internet of things, cloud computing, and big data technologies have revolutionized the healthcare system and its entire ecosystem, leading it toward health care measures . Technological solutions appear as an important stimulus in reducing the challenges of epidemics. However, the use of these solutions requires building trust and transparency for the effective management of health care requirements , which will be associated with a growing trend in the significance of technologies in the healthcare sector.
The importance of health technology assessment (HTA) will apparently increase in the future due to the multiplicity of technological choices and the breadth of usable technologies in the field of health and treatment. This implies that relying on HTA results allows achieving more efficient and effective solutions by generating knowledge and optimizing the decisions of policymakers and experts. However, making decisions, especially regarding the choice of expensive technologies, needs to be evidence-based given the scarcity of resources in the health sector . This has led many countries to consider a mechanism for the rational introduction and the use of these technologies to, on one hand, control the costs, prevent their excessive rise, and optimally allocate these budgets, and on the other hand, to prevent the involvement of technologies with low safety and low effectiveness. HTA seems to be the most common tool to achieve this goal in many developed countries.
HTA is in fact a set of techniques designed to help decision-makers to incorporate technology in influencing the health of countries . According to the definition by the World Health Organization (WHO) , HTA a systematic approach to evaluating the characteristics, effects, and impacts of technologies or policy interventions.
Reviewing the literature in this field, it can be concluded that the field of HTA has a very broad literature, indicating that it has considerably affected the generation of knowledge, dissemination, politics, behavior, or especially health promotion of countries [6, 7].
Murphy et al., 1998 suggested that the goal of all HTA research should focus on the generation of knowledge and the creation of findings that would help policymakers and stakeholders. HTA research findings directly affect the decision-making institutions and indirectly help to improve the quality of clinical practice in the national health system .
HTA is used as a tool to improve evidence-based policy-making and decision-making in many studies . According to a report by the WHO, a shortage of qualified human resources was the main obstacle in many countries to the implementation of the process and the use of HTA since most countries lacked an academic or training program to build the HTA implementation capacity .
Mathew  mentions that most HTA reports are limited to examining the efficiency, safety, and cost-effectiveness of technology and some of them also address moral, legal, and social issues. However, HTA reports should also ideally cover other decision-making components. The integration of the desired technology into the current health system, the stability required to provide the health technology needed for all eligible individuals, the waiting time range for the technology to work or fail, the degree of novelty of the technology and new knowledge capacity influencing the decisions, and measuring the potential impact of rejecting this technology are generally some examples in this regard.
The HTA-based decisions can indeed pave the road only if there is already some kind of universal health coverage and the decision-makers are willing and able to use the HTA process by their health care systems. This is used as a model by many European countries, and some related institutions have been developed to guide the government in making decisions regarding the provision or non-provision of national health services accordingly.
Through a review of the literature in the field of HTA, this paper seeks to find out the issues and challenges faced by HTA studies in different countries. According to the methodology described in the second section of the article, a scoping review approach was used to explore and expand the evidence and map, and summarize the results of various articles published about different countries, which were extracted and analyzed from two databases and the reports of the WHO. The analysis results are provided in the third part (Results) of this article. Finally, the discussion and conclusion of the article will be presented in the fourth section.
In this research, the scoping review approach is used based on the framework developed by Arksey and O’Malley, which outlines a rigorous way of transparency enabling replication of the search strategy and increasing the reliability of the study findings ..
A “scoping review” refers to a quick review of key concepts in a particular research topic, aiming at finding the main sources and different types of evidence concerning that topic. This review focuses on evidence and relies on summarizing and describing an existing or emerging field of research .
This research has conducted in 2021 and summarizes and maps HTA studies conducted in different countries from 2009 to 2020. This period of years was chosen since HTA studies conducted before 2009 were in preliminary stages in most countries without relying on data. Our aim was to find out about the issues and challenges faced by different countries in the study of HTA in this period of time. The scoping review method can help to find such evidence to answer the research question. However, these studies will enter a new paradigm with the emergence of new challenges, especially with the emergence of the COVID-19 pandemic at the beginning of 2020, and countries will encounter new and different issues in HTA. Thus, new evidence will definitely emerge in the HTA of countries in the coming years and far more new questions will arise in this area of study. Accordingly, one of the topics for future research could be that “How HTA studies will vary since 2020 with the advent of COVID-19 pandemic in comparison with previous courses?
The online Scopus and WoS databases were searched using the Boolean operators of keywords, i.e. “health” or “health assessment” or “assessment” and “technology” and “health” or “technology assessment”. In the next stage, keywords of “European”, “Asia”, “Latin America”, and “Africa” were added to the HTA and searched in each of the two databases. The main search strategy was “Health Technology Assessment”, in addition to the names of countries that published HTA studies, which were used in the search field. The search was first set to the “Title” and “Keyword” fields. The results identified a large number of articles with often little relation to the research question. Thus, the search was set to the “Abstract” field in the next step and the output provided a more limited and relevant database. Finally, the texts of the articles were excluded and only 23 articles remained to answer the research question. The research flowchart was drawn based on the PRISMA flowchart (Fig. 1). Also the number of articles published in the field of health technology assessment during the last two decades is shown in Fig. 2.
Inclusion criteria for articles
The first step of the search retrieved 3349 articles, 1229 of which were excluded due to duplication. The titles and abstracts were the exclusion criteria of articles in the second stage. Accordingly, articles with irrelevant titles and abstracts were omitted from the review (two reviewers, review the articles and those in which both reviewers agreed to remove them were excluded). In the next stage, full texts of the articles were read to remove those that did not examine HTA in the countries. There were also articles among the reviewed studies that evaluated HTA in a very small part of a country, such as a disease in a clinic, or examined HTA in a ward of a hospital; thus, such irrelevant articles were also excluded due to incorrect generalization to the results. Since the HTA studies were generally reviewed in all parts of each country, only the texts of articles were selected that examined the general HTA in that country. Moreover, the texts of some articles were not available.
The criterion for data extraction from countries was determined by designing a checklist consisting of the name of the country, level of per capita income, year of study, subject and challenge of HTA, data collection method, and obtained findings. Classification of the countries based on per capita income levels helped to identify the issues and challenges in middle- and high-income countries in terms of HTA studies. The data collection method describes the methods for obtaining HTA information in different countries. Finally, the results were extracted from those drawn by countries for HTA. In the data extraction table, a column is presented with the title of suggestions from each source for future trends in HTA. The latest report of the WHO concerning the HTA of high- and middle-income countries was also used in extracting the national data .
Over the past decades, health sectors in many countries have come to the need for introducing new methods of HTA and meeting the relevant demands. This important issue is also seen in the process of articles published in this area during the last two decades.
HTA is primarily performed and used in high- and middle-income countries since it requires a lot of resources. Hence, HTA cannot be used and made in many countries (including the African countries) due to low income levels and lack of the required resources. As a result, these countries do not own a health technology system and no data are found from them in the reports of the WHO. Accordingly, high-income countries have the most published documents in this area (Figs. 3 and 4).
According to the WHO report in 2015 , countries use HTA for various goals based on their income levels. In this regard, apart from the reports by the WHO, the issue of HTA has been addressed extensively in a variety of the reviewed studies from various perspectives and aspects around the world.
According to the articles reviewed in this study and the conclusion made from the reports by the WHO regarding countries, it can be argued that the major recommendations of most researches are that the HTA should follow clearer and more explicit methods and report the results containing certain standards. For example, our review study revealed that the results reported by the reviewed articles covered a range of topics, as shown in Table 1.
On the other hand, according to the reviews made in this study and as previously reflected in the reports of WHO, the focus on improving HTA processes is through higher participation of the stakeholders, increasing the transparency of processes, and optimizing the resource allocation in most high-income countries. In middle-income countries (Latin America), however, the focus is mostly on increasing the capacity building and standardization of methods/development of guidelines.
For example, Italy has set some processes aiming at managing legislations in the pharmaceutical industry, medical services and equipment, and service location, as well as controlling the providers of personal services and coverage-related policies. In Mexico, on the other hand, studies have focused on implementing strategies to update the table and catalog of essential supplies of the healthcare sector as a supervisory tool and to ensure the establishment of adequate and necessary criteria for safety, and effectiveness. At the same time, they seek the efficiency and development of a resource coding system, standardization of technology purchasing policies, and optimization of government resources. This, in turn, reveals the difference in priorities between developed and developing countries.
On the other hand, these studies present some recommendations to overcome the challenges faced by countries in implementing the HTA system, as summarized in Table 2.
The WHO categorizes the challenges of Asian countries in establishing an HTA system as follows :
The first challenge is that economic data are generally not available locally. The second and perhaps the most important challenge is that most health systems in Asian countries lack enough trained personnel to perform robust economic analyses. Although this shortcoming is fixed rapidly, there are still concerns about the impact of stakeholders on understanding, interpretation, and use of economic analyses, which can result in undesirable consequences. Thus, the third challenge would be the unfamiliarity of decision-makers with accurate differences in economic analyses, which will cause a delay in the use of appropriate health technologies.
To further explain these results, an example of our analysis is provided in Table 3. The classification of countries based on middle- and high-income ones is derived from the World Bank country classifications by income level .Footnote 1 According to the table, most high-income countries are engaged in issues such as policy-making and optimal decision-making in HTA, integrating the involved institutions, and increasing the knowledge and skills in this area. In contrast, middle-income countries are generally involved in topics of raising awareness and learning from the experiences of developed countries, optimal resource allocation due to lack of resources, and establishing centralized and integrated institutions in this regard. These results are summarized in Table 4.
Despite varying health systems around the world, this study tried to provide a list of the most important challenges ahead of countries in the establishment of an HTA system, which can serve as a guiding checklist for policymakers and stakeholders in this field. Table 4 summaries the main findings of this research about the analysis of articles and reports on the HTA in different countries.
In this study, the HTA-related literature was comprehensively reviewed in the countries that published and analyzed the relevant reports. The documents published since 2009 in this area were collected and analyzed by referring to Scopus and WoS databases, as well as the reports of the WHO. The literature reviewed in this research reflected that the search strategy was designated and implemented to identify various characteristics of the HTA in different countries. Although the included articles met the inclusion criteria to evaluate the HTA in countries in the scope of our study, our research does not reflect the experiences and evidence of HTA in different health sectors.
The scoping review is used to map or configure a set of evidence; thus, our research was focused on studies indicating the “diversity” of evidence in the HTA of different countries with no in-depth concentration on the optimal choice and applicability of the HTA evidence in countries.
The role of the public and the government in the HTA of many countries seemed to be highlighted in reviewing the studies in countries, while the major role belonged to financing and budgeting. The countries in both groups encountered different challenges in HTA. In both groups, however, HTA was identified as an essential tool to improve the management of scarce resources in the health sector.
The dilemma of incoordination and segregation of participant institutions was found in the HTA process associated with resulting problems in decision-making in many of the reviewed reports and articles. It can probably be concluded that one of the useful efforts to be made by different countries to maintain the integrity of this system would be to involve all members of this system and form a health ecosystem in the HTA. As such, a large number of active actors (patients, doctors, nurses, companies and government agencies, suppliers, etc.) will develop their connections and communications with foreign actors to solve different challenges of this ecosystem.
Furthermore, the rapid growth of digital technologies (such as Big Data technologies) causes the health system of middle-income countries to face huge changes and transformations while makes the high-income countries move toward creating strategic innovation frameworks in the health ecosystem .
Availability of data and materials
Data available within the article or its supplementary materials.
1GNI per capita Group July 2020 Low Income < 1036 Lower-Middle Income 1036–4045 Upper-Middle Income 4046–12,535 High Income > 12,535 Source: World Bank 2020
Health Technology Assessment
World Health Organization
Aceto G, Persico V, Pescapé A. Industry 4.0 and health: internet of things, big data, and cloud computing for healthcare 4.0. Journal of industrial information. Integration. 2020;18:100129. https://doi.org/10.1016/j.jii.2020.100129.
Kumar MS, Raut RD, Narwane VS, Narkhede BE. Applications of industry 4.0 to overcome the COVID-19 operational challenges. Diabetes Metab Syndr: Clin Res Rev. 2020;14(5):1283–9. https://doi.org/10.1016/j.dsx.2020.07.010.
Boos N. Health care technology assessment and transfer.
Culyer AJ. Health economics and health technology assessment. Medicine. 2018;46(7):379–82. https://doi.org/10.1016/j.mpmed.2018.04.002.
World Health Organization. Global survey on health technology assessment by national authorities: Main findings. 2015. Retrieved from https://www.who.int/publications/i/item/9789241509749.
Hanney S, Buxton M, Green C, Coulson D, Raftery J. An assessment of the impact of the NHS Health Technology Assessment Programme. 2007. https://doi.org/10.3310/hta11530.
Oortwijn W, Determann D, Schiffers K, Tan SS, van der Tuin J. Towards integrated health technology assessment for improving decision making in selected countries. Value Health. 2017;20(8):1121–30. https://doi.org/10.1016/j.jval.2017.03.011.
Wild C, Stricka M, Patera N. Guidance for the development of a national HTA-strategy. Health Policy Technol. 2017;6(3):339–47. https://doi.org/10.1016/j.hlpt.2017.06.006.
Mathew JL. Health technology assessment in Asia: food for thought. Int J Technol Assess Health Care. 2019;35(6):413–5. https://doi.org/10.1017/S0266462319000801.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. https://doi.org/10.1080/1364557032000119616.
Munn Z, Peters MD, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):1–7. https://doi.org/10.1186/s12874-018-0611-x.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8(5):336–41. https://doi.org/10.1016/j.ijsu.2010.02.007.
France G. Health technology assessment in Italy. Int J Technol Assess Health Care. 2000;16(2):459–74. https://doi.org/10.1017/S0266462300101102.
Mayat TK, et al. A receptivity study of Alexandra Hospital’s new healthcare delivery model-healthcare redesigned. NUS: Chua Thian Poh Community Leadership Center; 2019.
Williams A, Cookson R. Equity in health. Handb Health Econ. 2000;1:1863–910. https://doi.org/10.1016/S1574-0064(00)80048-7.
Perleth M, Busse R. Health technology assessment in Germany: status, challenges, and development. Int J Technol Assess Health Care. 2000;16(2):412–28. https://doi.org/10.1017/S0266462300101072.
Abd Rahim KN, Kamaruzaman HF, Dahlui M, Puteh SE. From evidence to policy: economic evaluations of healthcare in Malaysia: a systematic review. Value Health Reg Issues. 2020;21:91–9. https://doi.org/10.1016/j.vhri.2019.09.002.
Shafie AA, Chandriah H, Yong YV, Puteh SE. Health technology assessment and its use in drug policy in Malaysia. Value Health Reg Issues. 2019;18:145–50. https://doi.org/10.1016/j.vhri.2019.03.003.
Ozieranski P, McKee M, King L. The politics of health technology assessment in Poland. Health Policy. 2012;108(2–3):178–93. https://doi.org/10.1016/j.healthpol.2012.10.001.
Maynard A, McDaid D. Evaluating health interventions: exploiting the potential. Health Policy. 2003;63(2):215–26. https://doi.org/10.1016/S0168-8510(02)00068-4.
Menon D, Stafinski T. Health technology assessment in Canada: 20 years strong. Value Health. 2009;12:S14–9.
Addo R, Hall J, Haas M, Goodall S. The knowledge and attitude of Ghanaian decision-makers and researchers towards health technology assessment. Soc Sci Med. 2020;250:112889. https://doi.org/10.1016/j.socscimed.2020.112889.
Battista RN. Expanding the scientific basis of health technology assessment: a research agenda for the next decade. Int J Technol Assess Health Care. 2006;22(3):275–80. https://doi.org/10.1017/S0266462306051130.
Banta D, Jonsson E, Childs P. History of the international societies in health technology assessment: International Society for Technology Assessment in health care and health technology assessment international. Int J Technol Assess Health Care. 2009;25(S1):19–23. https://doi.org/10.1017/S0266462309090369.
Surgey G, Chalkidou K, Reuben W, Suleman F, Miot J, Hofman K. Introducing health technology assessment in Tanzania. Int J Technol Assess Health Care. 2020;36(2):80–6. https://doi.org/10.1017/S0266462319000588.
Oortwijn WJ, Vondeling H, van Barneveld T, van Vugt C, Bouter LM. Priority setting for health technology assessment in the Netherlands: principles and practice. Health Policy. 2002;62(3):227–42. https://doi.org/10.1016/S0168-8510(02)00037-4.
Yang Y, Tian K, Bai G, Zhu X, Yang Y, Yu X, et al. Health technology assessment in traditional Chinese medicine in China: current status, opportunities, and challenges. Glob Health J. 2019;3(4):89–93. https://doi.org/10.1016/j.glohj.2019.11.002.
Chen Y, Banta D, Tang Z. Health technology assessment development in China. Int J Technol Assess Health Care. 2009;25(S1):202–9. https://doi.org/10.1017/S0266462309090643.
Mäkelä M, Roine RP. Health technology assessment in Finland. Int J Technol Assess Health Care. 2009;25(S1):102–7. https://doi.org/10.1017/S0266462309090497.
Koch P, Schilling J, Läubli M, Mitscherlich F, Melchart D, Bellucci S. Health technology assessment in Switzerland. Int J Technol Assess Health Care. 2009;25(S1):174–7. https://doi.org/10.1017/S0266462309090606.
Liu G, Wu EQ, Ahn J, Kamae I, Xie J, Yang H. The development of health technology assessment in Asia: current status and future trends. Value Health Reg Issues. 2020;21:39–44. https://doi.org/10.1016/j.vhri.2019.08.472.
Kalo Z, Igarashi A, Jakab I, Gilardino RE. ISPOR GLOBAL GROUPS: USE OF MCDA IN HTA, COVERAGE AND REIMBURSEMENT DECISION-MAKING: EXPERIENCE AND INSIGHTS FROM EMEA, LATIN AMERICA AND ASIA-PACIFIC. In: ISPOR Europe 2019; 2019.
Nanyonjo A, Counihan H, Siduda SG, Belay K, Sebikaari G, Tibenderana J. Institutionalization of integrated community case management into national health systems in low-and middle-income countries: a scoping review of the literature. Glob Health Action. 2019;12(1):1678283. https://doi.org/10.1080/16549716.2019.1678283.
Jain B, Hiligsmann M, Mathew JL, Evers SM. Analysis of a small group of stakeholders regarding advancing health technology assessment in India. Value Health Reg Issues. 2014;3:167–71. https://doi.org/10.1016/j.vhri.2014.04.006.
Schnell-Inderst P, Mayer J, Lauterberg J, Hunger T, Arvandi M, Conrads-Frank A, et al. Health technology assessment of medical devices: what is different? An overview of three European projects. Z Evidenz, Fortbild und Qualität im Gesundheitswesen. 2015;109(4–5):309–18. https://doi.org/10.1016/j.zefq.2015.06.011.
Fleurette F, Banta D. Health technology assessment in France. Int J Technol Assess Health Care. 2000;16(2):400–11. https://doi.org/10.1017/S0266462300101060.
Lehoux P, Roncarolo F, Silva HP, Boivin A, Denis JL, Hébert R. What health system challenges should responsible innovation in health address? Insights from an international scoping review. Int J Health Policy Manag. 2019 Feb;8(2):63–75. https://doi.org/10.15171/ijhpm.2018.110.
World Bank. New World Bank country classifications by income level: 2020–2021. 2020. Retrieved from: https://blogs.worldbank.org/opendata/new-world-bank-country-classifications-income-level-2020-2021
Ghazinoory S, Nasri S, Dastranj R, Sarkissian A. “Bio to bits”: the millennium ecosystem assessment (MA) as a metaphor for big data ecosystem assessment. Inform Technol Peopl. 2021. ahead-of-print No. ahead-of-print . https://doi.org/10.1108/ITP-08-2020-0579.
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Ethics approval and consent to participate
Ethics approval was not required since the data is available to the public domain.
Consent for publication
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: The fourth author's name has been updated from “Ehsan Zandi” to “Mohammand Ehsan Zandi”.
About this article
Cite this article
Ghazinoory, S., Majidi, B., Nasri, S. et al. Differences between health technology assessment topics in high- and middle-income countries: a scoping review. Arch Public Health 79, 225 (2021). https://doi.org/10.1186/s13690-021-00754-6
- Health technology assessment
- Scoping review
- High- and middle-income countries