Plos One
7 de outubro de 2020
credit to the image on top: Ana Kova @ Nature
Enoch J. Abbey, Conceptualization, Formal analysis, Methodology, Writing — original draft,1 Banda A. A. Khalifa, Conceptualization, Writing — original draft,2 Modupe O. Oduwole, Conceptualization, Writing — original draft,1,2 Samuel K. Ayeh, Conceptualization, Formal analysis, Methodology,1 Richard D. Nudotor, Conceptualization, Writing — original draft,3 Emmanuella L. Salia, Conceptualization, Project administration, Writing — original draft,2,4 Oluwatobi Lasisi, Conceptualization, Writing — original draft,5 Seth Bennett, Formal analysis, Methodology,6 Hasiya E. Yusuf, Writing — original draft,4 Allison L. Agwu, Supervision, Writing — review & editing,#1,4,‡* and Petros C. Karakousis, Supervision, Writing — review & editing
Key Messages:
- Our study underscores the GHS index report conclusion that no country seems fully prepared to tackle an emerging public health emergency threat.
- The discrepancy between the GHS index ranking and the actual response of countries based on COVID-19 performance indicators likely indicates that the GHS index may have underestimated the level of preparedness of some countries while overestimating that of others.
- The expert panel should consider reassessing the GHS index frequently, including the potential incorporation of the effect of leadership in subsequent reports, since this appears to have contributed to the successful responses observed in countries like New Zealand and South Korea.
- Finally, country’s response to prior health threats should be incorporated into developing future GHS index reports.
Abstract
The ongoing COVID-19 pandemic has devastated many countries with ripple effects felt in various sectors of the global economy. In November 2019, the Global Health Security (GHS) Index was released as the first detailed assessment and benchmarking of 195 countries to prevent, detect, and respond to infectious disease threats. This paper presents the first comparison of Organization for Economic Cooperation and Development OECD countries’ performance during the pandemic, with the pre-COVID-19 pandemic preparedness as determined by the GHS Index. Using a rank-based analysis, four indices were compared between select countries, including total cases, total deaths, recovery rate, and total tests performed, all standardized for comparison. Our findings suggest a discrepancy between the GHS index rating and the actual performance of countries during this pandemic, with an overestimation of the preparedness of some countries scoring highly on the GHS index and underestimation of the preparedness of other countries with relatively lower scores on the GHS index.
Background
The outbreak of the novel coronavirus disease (COVID-19), caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has been described as the greatest global health threat of the century. First discovered in Wuhan, China in late 2019, the infection was declared a pandemic by the World Health Organization in March 2020. As of June 29, 2020, there are over 10·2 million confirmed cases of COVID-19 globally [ 1]. Despite remarkable efforts by global health agencies and governments, the number of new infections is projected to grow in the coming months [ 1]. The pandemic has also claimed many lives, with over 450,000 deaths recorded globally [ 1].
The COVID-19 pandemic has significantly impacted healthcare systems with rippling effects in various sectors of the global economy. Frontline healthcare workers who come in direct contact with patients are at increased risk of being infected with SARS-CoV-2. Overall healthcare delivery to the general population has been affected by the staggering increase in the demand for medical supplies, reduced in-person medical visits, and shortages of medical protective gear [ 2]. In addition to the health implications, efforts to control the pandemic have led to massive lockdowns (stay-at-home orders) and social distancing guidelines, causing substantial financial losses for individuals, businesses, governments, and threatened recessions in some countries [ 2]. In many countries, the capital market sectors have been affected, and there have been disruptions to the global supply chain.
The world is intricately interconnected through the movement of people and trade across borders, facilitating the spread of infectious diseases, and posing serious risks to global health. Therefore, it is imperative that countries are able to promptly identify and respond to catastrophic public health emergencies. The Global Health Security (GHS) index is the first comprehensive assessment of countries’ preparedness of countries for outbreaks like COVID-19. The GHS index project was conducted by the Nuclear Threat Initiative (NTI), the Johns Hopkins Center for Health Security (JHU), and the Economist Intelligence Unit (EIU) to thoroughly evaluate the health security and related capabilities of 195 countries that are Parties to the International Health Regulations (2005) [ 3].
In 2019, a panel of 21 experts from 13 countries developed an elaborate and comprehensive framework to assess a country’s ability to avert and mitigate outbreaks. The international panel of experts scored each of the 195 countries and classified them as ‘most prepared’ (score ≥ 66.7), ‘more prepared’ (33.4 to 66.6) and ‘least prepared’ (0 to 33.3) [ 3]. The GHS index is based on 6 categories, 34 indicators, and 85 sub-indicators. The six categories comprise prevention, detection and reporting, rapid response, health system, compliance with international norms, and risk environment [ 3]. Findings from the evaluation revealed that none of the countries is fully prepared for an infectious disease outbreak or a pandemic, with a global average score of ~40 out of 100 [ 3], underscoring critical gaps in outbreak and epidemic/pandemic preparedness that must be urgently addressed. The average GHS index score among the 60 high-income countries was ~50, indicating a weak collective pandemic preparedness. The United States (US), United Kingdom (UK), Netherlands, Australia, and Canada ranked in the top 5 countries on the GHS index, with scores of 83.5, 77.9, 75.6, 75.5, and 75.3, respectively. Recently, the GHS index has been used to assess the preparedness of countries to handle the novel COVID-19 pandemic and thus far demonstrates suboptimal levels of preparedness for all countries assessed. However, the top 5 countries as ranked by the GHS index are among the worst-hit countries by COVID-19, with a high number of cases and mortalities [ 1].
The Organization for Economic Cooperation and Development (OECD) is currently a 37-member association, which is in the process of adding Costa Rica as its 38 thnation [ 4, 5]. It comprises wealthy nations that have both high energy consumption and high gross domestic products. Headquartered in France, members jointly contribute to 80% of global trade and investment [ 6]. The OECD is influential in supporting non-member nations with resources to improve economies, while also monitoring economies and the ability of states to fight poverty.
The objective of this study is to evaluate the utility of the GHS index in predicting the current responses of 36/37 OECD countries, for which data are available, to the COVID-19 pandemic.
Methodology
Study population
Participating countries used for this analysis include OECD member countries [ 7], each of which was assessed for inclusion. COVID-19 data are reported on a daily basis for all countries, with the exception of tests/ thousand people, which are available on a weekly basis for the following countries: Netherlands, Spain, Sweden, Ireland, and Germany. France was excluded from the analysis due to absent data on tests/ thousand people. Thirty-six countries were included in the analysis.
Data collection
We collected country-level data on the preparedness to prevent, detect and respond to infectious disease threats using the Global Health Security (GHS) index available from https://www.ghsindex.org/ [ 8]. Data relating to COVID-19 cases, deaths, recoveries, and number of tests were obtained from https://ourworldindata.org/coronavirus-testing (a collaborative effort between the researchers at the University of Oxford and a non-profit organization, Global Change Data Lab) [ 9] and https://github.com/CSSEGISandData/COVID-19 (a COVID-19 data repository by the Center for Systems Science and Engineering at Johns Hopkins University) [ 10] for May 15, 2020.
Statistical analysis
Our variables of interest included both the raw and standardized total number of COVID-19 cases, deaths, tests performed, and recoveries as of May 15, 2020. We estimated a modified recovery rate as the ratio of the total number of recoveries to the total number of cases for each country (total recoveries/ total cases * 100%), as timelines and dates for the first incident cases were not readily available. The 36 countries were rank-ordered based on the total number of cases/ million and the total number of deaths/ million from the lowest to the highest, with each assigned a score ranging from 1 to 36. The 36 countries were also rank-ordered based on the total tests per thousand people and recovery rate, with the highest recovery rate and tests per thousand assigned a score of 1, and the lowest recovery rate and tests per thousand assigned a rating of 36. The cumulative score involving all four variables of interest were equally weighted for each criterion. This was done by calculating the average rank for the cumulative score and then to contrive their final multi-criteria rankings. Using this approach, the lowest cumulative score has the lowest multi-criteria rank and the highest aggregate score has the highest multi-criteria rank. A lower rating reflects relatively better performance, and Spearman’s rank correlation was determined between the GHS index and the commutative ranking. All statistical analyses were performed using STATA (Statistical Data Analysis Package version 16.0 IC, College Station, TX-USA).
Results
- The US ranks highest in preparedness, with a score of 83.5, a five-point difference from the next country, the UK. The US ranks highest in four out of six areas: prevention, detection, health system capacity, and compliance with international norms.
- Luxembourg ranks at the 67 thposition in the global ranking, with an overall score of 43.8.
- The 20 highest ranked countries are mostly OECD members, except for Thailand (6 th) and Malaysia (18 th) ().
Table 1
Country (ranked) Overall Score Prevention of the emergence or release of pathogens Early detection & reporting for epidemics of potential international concern Rapid response to and mitigation of the spread of an epidemic Sufficient & robust health system to treat the sick and protect health workers Commitments to improving national capacity, financing and adherence to norms Overall risk environment and country vulnerability to biological threats
In absolute terms, the US ranks worst globally in terms of the absolute numbers of cases, and deaths since the onset of the pandemic. The US ranks better than only 4 other countries with respect to the number of cases per million, deaths per million, recovery rate, and tests per thousand. Of the 36 OECD countries, the US ranks 32 ndfollowed by Spain, Sweden, the UK, and the Netherlands, which rank in 33 rdto 36 thplace, respectively (). New Zealand, which ranks 35 thglobally based on the GHS index, tops the performance list based on the four variables of interest, followed by Australia, South Korea and Lithuania (tie), which occupy the 4 th, 9 th, and 33 rdpositions, respectively, and outperform other countries ranked in the top 10 based on GHS index. Although there are limitations to this approach, the two most prepared countries based on the GHS index perform worse than other OECD countries. New Zealand tops the recovery rate ranking per our definition, followed closely by Iceland and Luxembourg. However, this parameter depends largely on the timing of index cases and whether countries have reached their peak surge of cases, and, as such, has limited utility. Iceland has conducted the most tests per thousand people, while Japan and Australia have the lowest cases and deaths per million, respectively.
Table 2
OECD countries ranked on GHS Index Ranking OECD countries ranked by cases/ million (lowest to highest) OECD countries ranked by deaths/ million (lowest to highest) OECD countries ranked by recovery rate (highest to lowest) OECD countries ranked by tests/ thousand (highest to lowest) OECD countries ranked by Cumulative Score (lowest to highest) Average Score Final Multi-criteria Rank for OECD countries
Luxembourg ranks 67 thglobally according to the GHS index and last among the OECD countries analyzed. However, as of May 15, 2020, it had outperformed twenty-one other OECD countries. It has the highest cases per million but also ranks highly with respect to tests performed per thousand population and recovery rate. Countries ranking in the bottom 5 as per the GHS index, including Slovakia, Israel, and Iceland, are in the top 10 OECD countries per their performance against the variables of interest (). Conversely, countries ranked in the top five of the GHS index, occupy the bottom eight positions of the commutative ranking. These are the US, UK, Netherlands, and Canada. The various indices and variables used in the ranking of the countries are captured in . There is a negative moderate relationship between the GHS index ranking and the computed commutative ranks, with a correlation coefficient (r s) of -0.41 and a p-value of 0.013.
Table 3
OECD Countries Total cases/million Total deaths/million Recovery Rate (%) Total tests/thousand Test Unit
Discussion
Our study’s findings indicate a negative correlation between the GHS rankings and the multi-criteria rank we developed based on our COVID-19 performance indicators, highlighting the lack of utility of the GHS index in predicting the response of countries to the COVID-19 pandemic and its impact on them. Specifically, the favorable ranking of the US and UK based on the GHS index vis-à-vis their preparedness against the threat of infectious agents is inconsistent with current data from the COVID-19 pandemic. Thus, the US and UK are among the top 10 countries with the highest number of cases per million people. While Japan and South Korea were ranked 21 stand 9 thon the GHS index rating [ 11], they ranked 1st and 2nd in the (lowest) number of cases per million, suggesting successful mechanisms for dealing with the pandemic. Additionally, our multi-criteria ranking system places New Zealand, Australia, and South Korea as the top three countries with successful mechanisms for handling the ongoing pandemic, although they ranked 35 th, 4 th, and 9 thon the GHS index, respectively. These inconsistencies reveal that the GHS index rating may have overestimated the robustness of certain national health care systems and their level of bio-preparedness while underestimating those of others.
The GHS index report revealed significant weaknesses in every country’s overall preparedness level, however it is imperative to understand why there is a discrepancy between the GHS index and the actual level of pandemic preparedness among the OECD countries studied [ 11, 12]. Although the performance of Australia and South Korea were consistent with their ranking on the GHS index, New Zealand was the best-performing country among the OECD countries, raising the question of the reliability of the GHS index rankings. South Korea and other Asian countries have provided swift, effective ways of dealing with the outbreak, perhaps due to their experience with the outbreak of Severe Acute Respiratory Syndrome (SARS) in 2003 and the Middle East Respiratory Syndrome (MERS) in 2015 [ 13– 15]. The lower death rates reported in Australia, New Zealand, Slovakia, South Korea, and Japan may also be due to extensive testing, rapid surveillance, and effectively enforced quarantine and isolation mechanisms.
The discrepancies between the GHS index rankings and the actual response to the COVID-19 pandemic based on our indicators among the OECD countries may also highlight some deficits in the weighting of categories and the sources of data utilized by the expert panel [ 14]. Importantly, the GHS index expert panel did not directly engage authorities responsible for emergency preparedness in their respective countries and other key stakeholders. Instead, the panel evaluated information provided by each country; this methodology has the potential to obscure crucial weaknesses in a country’s capacity to confront outbreaks. Although the US scored the highest (98.2) in the category of early detection and reporting of epidemics, our findings indicate that in reality, countries such as Iceland and Luxembourg outperformed the US. The discrepancy between the GHS rankings and the performance indicators we utilized may be due to the limited emphasis on testing and possibly the versatility of a country’s health system, including its reserve capacity.
The ongoing COVID-19 pandemic has shed light on the crucial role leadership plays in crisis management. Some articles cite decisive leadership and coordinated responses as potential game-changers in a country’s response to the pandemic, which may not have been considered by the GHS expert panel [ 16]. The total number of cases, numbers recovered, deaths, and the tests performed are directly influenced by the decisions made by a country’s leadership in mobilizing critical resources and engaging proper stakeholders. The importance of leadership in response to the ongoing pandemic may perhaps explain why New Zealand outperforms all the other OECD member countries, even though it was ranked 35 thin the GHS index report. Government-driven rapid responses in New Zealand and Australia have accounted for their impactful performance during the pandemic, as evidenced by their social distancing measures, minimization of non-essential services, and their prioritization of a rapid government-led response [ 17]. This is in sharp contrast to the UK government’s approach, described by Scally et al., as “too little, too late, and too flawed,” which saw the formation of a counter “independent SAGE” group to advise publicly on the UK’s response to COVID-19 [ 18]. This was to compensate for the lack of independent scientific counsel by the UK’s Scientific Advisory Group on Emergencies (SAGE) which is responsible for coordinating the governmental response to national emergencies [ 18]. The economic trade-off between shutting down borders, businesses and non-essential activities may have contributed to the delay for some countries to adopt such a strategy at the early stages. This appears to be the case for the UK, US, and Canada, which ranked among the most prepared based on the GHS index but represent some of the worst-performing countries in their COVID-19 response based on our indicators. In contrast, countries ranking lower in the GHS index that fared relatively well during the COVID-19 pandemic took swift and effective action to shut down activities associated with a heightened risk of SARS-CoV-2 acquisition [ 12, 19].
Our analysis has limitations that must be acknowledged. Like any ecological study, our study is subject to ecological fallacy due to country-level data such as total deaths, tests done, and numbers recovered. The cross-sectional nature of our study makes it difficult to draw any causal conclusions. Another limitation of this study is the variability in COVID-19 reporting, especially with regards to testing. In some countries, the lack of testing capacity for the virus can underestimate the exact number of cases. The GHS Index relied entirely on open-source information, either reported by an international entity or published by countries with the intent that, such information should be equally available to the populace. However, this approach failed to engage key stake-holders involved in directing emergency responses in various countries.
Despite these limitations, our study’s key strength lies in its ecological nature, allowing us to easily compare the level of preparedness among different countries. Our research agrees with prior studies that found the lack of readiness on many International Health Regulation indices among countries [ 20, 21]. This study provides insight into how the six categories of predictive indices can be adjusted to reflect the observed pandemic response metrics. We propose that the prevention of the emergence or release of pathogens and the early detection and reporting category should perhaps be more heavily weighed than the other categories.
Conclusion
- Our study underscores the GHS index report conclusion that no country seems fully prepared to tackle an emerging public health emergency threat.
- The discrepancy between the GHS index ranking and the actual response of countries based on COVID-19 performance indicators likely indicates that the GHS index may have underestimated the level of preparedness of some countries while overestimating that of others.
- The expert panel should consider reassessing the GHS index frequently, including the potential incorporation of the effect of leadership in subsequent reports, since this appears to have contributed to the successful responses observed in countries like New Zealand and South Korea.
- Finally, country’s response to prior health threats should be incorporated into developing future GHS index reports.
Funding Statement
The National Institute of Allergy and Infectious Diseases (NIAID) supported this study in the form of a grant awarded to PCK (K24AI143447). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
See the full version the report.
About the authors
Enoch J. Abbey, Conceptualization, Formal analysis, Methodology, Writing — original draft,1 Banda A. A. Khalifa, Conceptualization, Writing — original draft,2 Modupe O. Oduwole, Conceptualization, Writing — original draft,1,2 Samuel K. Ayeh, Conceptualization, Formal analysis, Methodology,1 Richard D. Nudotor, Conceptualization, Writing — original draft,3 Emmanuella L. Salia, Conceptualization, Project administration, Writing — original draft,2,4 Oluwatobi Lasisi, Conceptualization, Writing — original draft,5 Seth Bennett, Formal analysis, Methodology,6 Hasiya E. Yusuf, Writing — original draft,4 Allison L. Agwu, Supervision, Writing — review & editing,#1,4,‡* and Petros C. Karakousis, Supervision, Writing — review & editing
Originally published at https://www.ncbi.nlm.nih.gov.
PDF version
chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/viewer.html?pdfurl=https%3A%2F%2Fstorage.googleapis.com%2Fplos-corpus-prod%2F10.1371%2Fjournal.pone.0239398%2F1%2Fpone.0239398.pdf%3FX-Goog-Algorithm%3DGOOG4-RSA-SHA256%26X-Goog-Credential%3Dwombat-sa%2540plos-prod.iam.gserviceaccount.com%252F20210806%252Fauto%252Fstorage%252Fgoog4_request%26X-Goog-Date%3D20210806T205259Z%26X-Goog-Expires%3D86400%26X-Goog-SignedHeaders%3Dhost%26X-Goog-Signature%3D6a0c5f6dbb3a78704880c945189ac3c5bb5cd9890086662f15f69dbf4b5b897b9878d9ce29d43d09a80c7fe00f40cbc0ffc422198cae63035e02db3f7fb4685e20a06d4687ff4266e20e317b9fe73661cb6fd786a9e8915a71af13eccc2ee5b945144279deed360f7a47739502a45f2227a91b4417bcebabc41574b41b9dfe6ce8a061cebd0e0d1de46d132a385f3dbe5a4a54ebbda71e635892ea6c6abbdf83fb6c4120edc025822a394d406fd718bc7c1dd5e6a47cd6860f9899827e0663aa9af995730996f7564d9adbcea5fcc6dd6e3cff8f4e3089cbe60175979026e38d7af3a254693d7df80bed413d7d481b4f5dd0450423b30dff162ec6f38989f5d7&clen=851827&chunk=true
