Botched covid-19 test results in Britain led to thousands of extra cases.
The Economist
November 20, 2021
This is a republication of the article below @ The Economist, with the title above, focusing on the topic of quality issues. The abstract of the original paper is published at the end of this post.
A MONG THE tools health officials have used to fight covid-19, the impacts of lockdowns, masks and vaccines have been well-studied.
Testing, whose effect is hard to measure because it coincides with other pandemic-control policies, has received less attention.
But thanks to a grim natural experiment, that is now starting to change.
In September covid seemed to come to a halt in south-western Britain.
- Overnight, the positivity rate of PCR tests near Bath and Bristol fell from 3% to 1%.
- Nowhere else in England enjoyed a similar decline.
By mid-month a local volunteer group said this apparent dip might stem from faulty tests.
A few weeks later, the group and local scientists asked Britain’s Health Security Agency ( UKHSA) to investigate.
On October 12th the UKHSA shut down a lab run by Immensa, a testing firm.
- The agency said that the firm had incorrectly told 43,000 infected people that they were virus-free.
- The cause of the error remains unclear. Immensa declined to comment.
As soon as the lab was closed, the region’s reported covid case rate soared. A spokesperson for the prime minister said that the lab errors did not cause this surge.
On November 14th, however, Thiemo Fetzer of the University of Warwick released a paper showing that they probably did. It has not yet been peer-reviewed, but offers firm evidence that accurate testing does indeed slow covid’s spread, by letting infectious people know that they should isolate.
To estimate what might have happened were it not for the snafu, Mr Fetzer built a “synthetic control”: a group of areas whose prior rates of vaccination, testing, and covid cases and deaths matched those of the 13 most affected regions. The difference was stark. From September 2nd to October 12th, the areas in question recorded 13,000 fewer positive tests than the control. Afterwards, they registered 21,000 more.
This implies that each faulty test may have led to 0.6–1.6 extra cases (the range reflects uncertainty over how many people who tested positive received earlier false negatives). Based on Britain’s case-fatality rate, this translates to 400–1,100 deaths.
Surprisingly, this toll is not the highest that Mr Fetzer has attributed to technical glitches.
In 2020 a spreadsheet error prevented Britain’s statistical service from reporting 15,000 covid cases to contact-tracers.
In an earlier study, Mr Fetzer calculated that 1,500 people died as a result.■
Sources:
“Measuring the epidemiological impact of a false negative: evidence from a natural experiment”, by T. Fetzer, 2021; Office for National Statistics
This article appeared in the Graphic detail section of the print edition under the headline “An Immensa cock-up”
Originally published at https://www.economist.com on November 20, 2021.
ORIGINAL PUBLICATION
Measuring the epidemiological impact of a false negative: Evidence from a natural experiment
596/2021
Thiemo Fetzer
Abstract
Reliable COVID-19 testing remains a central pillar to manage the pandemic. Yet, the accuracy and reliability of tests and test equipment has regularly been brought into question.
- Both false-positive and false-negative test results convey costs.
- Yet, false negatives are likely more problematic due to the risk of onward transmission and the failure to break infection chains as a result.
This paper studies the epidemiological impact of a false negative in the context of a high vaccine uptake country.
- Between 2 September and 12 October an estimated 43,000 PCR tests in the UK may have produced a false negative test result with individuals infected being told that they tested negative.
- These instances were particularly pronounced in the South West of England.
Using a synthetic control method approach concentrating on the 13 most affected regions, this paper estimates that
- every false negative COVID-19 case is likely to have caused between 0.6 to 1.6 additional infections in the subsequent weeks.
About the author
Thiemo Fetzer, is a Professor in the Economics department at the University of Warwick and a Visiting Fellow at the London School of Economics.
Thiemo’s research has been featured in the New York Times, the Washington Post, the Guardian, Foreign Policy, Le Monde, and the Financial Times. He is also affiliated with the Centre for Economic Policy Research (CEPR), the Centre for Competitive Advantage in the Global Economy (CAGE) at University of Warwick and the Spatial Economics Research Centre (SERC) at London School of Economics, CESifo, and the Pearson Institute at University of Chicago.
TAGS: Quality Issues; Patient Safety Issues; Testing; Pandemic Resilient Health Systems
