AMONG THE tools health officials have used to fight covid-19, the impacts of lockdowns, masks and vaccines have been well-studied. Testing, whose effect is hard to measure because it coincides with other pandemic-control policies, has received less attention. But thanks to a grim natural experiment, that is now starting to change.
In September covid seemed to come to a halt in south-western Britain. Overnight, the positivity rate of PCR tests near Bath and Bristol fell from 3% to 1%. Nowhere else in England enjoyed a similar decline.
By mid-month a local volunteer group said this apparent dip might stem from faulty tests. A few weeks later, the group and local scientists asked Britain’s Health Security Agency (UKHSA) to investigate.
On October 12th the UKHSA shut down a lab run by Immensa, a testing firm. The agency said that the firm had incorrectly told 43,000 infected people that they were virus-free. The cause of the error remains unclear. Immensa declined to comment.
As soon as the lab was closed, the region’s reported covid case rate soared. A spokesperson for the prime minister said that the lab errors did not cause this surge. On November 14th, however, Thiemo Fetzer of the University of Warwick released a paper showing that they probably did. It has not yet been peer-reviewed, but offers firm evidence that accurate testing does indeed slow covid’s spread, by letting infectious people know that they should isolate.
To estimate what might have happened were it not for the snafu, Mr Fetzer built a “synthetic control”: a group of areas whose prior rates of vaccination, testing, and covid cases and deaths matched those of the 13 most affected regions. The difference was stark. From September 2nd to October 12th, the areas in question recorded 13,000 fewer positive tests than the control. Afterwards, they registered 21,000 more.
This implies that each faulty test may have led to 0.6-1.6 extra cases (the range reflects uncertainty over how many people who tested positive received earlier false negatives). Based on Britain’s case-fatality rate, this translates to 400-1,100 deaths.
Surprisingly, this toll is not the highest that Mr Fetzer has attributed to technical glitches. In 2020 a spreadsheet error prevented Britain’s statistical service from reporting 15,000 covid cases to contact-tracers. In an earlier study, Mr Fetzer calculated that 1,500 people died as a result.■
Sources: “Measuring the epidemiological impact of a false negative: evidence from a natural experiment”, by T. Fetzer, 2021; Office for National Statistics
This article appeared in the Graphic detail section of the print edition under the headline “An Immensa cock-up”