U of M infectious disease expert says easing of COVID-19 'months away'

How likely are you to die of coronavirus?

We may have far more infections than previously thought, and constructing models to estimate numbers is extremely hard

BY TOM CHIVERS

April 1, 2020

The national conversation is dominated by coronavirus statistical models at the moment. The Imperial College model, the Oxford model, the other Imperial model. 

I want to talk about the models, and what they tell us, because the outputs of these models drive the government’s response — and thousands of lives could turn on them. It’s important, therefore, that we understand them, and why the numbers they give us are so different. These figures led Peter Hitchens, the Mail on Sunday columnist, to complain that the number of deaths has jumped around from 500,000 to 20,000, to 5,000. I can see why people are confused, if they just think “the models” are taking the same numbers and spitting out these weirdly different results.

But first, I want to talk about something much simpler. It’s the question that many of us, I’d say, most want to know, when we’re anxiously thinking about Covid-19 and ourselves and our loved ones. That is: if someone gets the disease, how likely are they to die?

The splendid Our World in Data (OWID) — who, full disclosure, I’ve been doing some editing for during this crisis — have been working on answering that question. So has Oxford’s equally splendid Centre for Evidence-Based Medicine (CEBM).

It is probably the most basic question you can ask about a disease, and yet it’s bloody hard to answer. It changes between places and over time, and between different groups; it depends on a variety of hard-to-measure factors, and the answer you get itself directly affects our understanding of several other numbers, all of which are vital to any model of the disease.

So. You may have heard a term being used: the “case fatality rate”, or CFR. That is the number of deaths divided by the number of confirmed cases. When journalists talk about the “death rate”, that’s often what they are referring to. If a country has 10,000 confirmed cases and 100 deaths, then the CFR in that country is (100/10,000), or 1%.

That is not what we are looking for, and it is probably not even very close to what we are looking for.

Instead what we want is the “infection fatality rate”, or IFR. That is the number of deaths divided by the number of people who actually have the disease. The number of people who have tested positive for the disease is probably only a fraction of the total number who had it, because only a fraction of the population has actually been tested. 

Obviously, the IFR is much harder to determine accurately. The only people getting tested will be the people who are most ill, so your IFR is probably much lower than your CFR, because your denominator — the number you’re dividing by — is probably much bigger. 

So if your country has tested absolutely everyone and found all cases of the disease, then your IFR is the same as your CFR, or 1%. But if it has only found 10% of the people with the disease, then your 10,000 confirmed cases are just the tip of a 100,000-person iceberg. With those 100 deaths, your IFR would be (100/100,000) or 0.1%.

Sadly, all we know is the CFR, and it changes hugely from country to country. Professor Jason Oke, a statistician at Oxford University and one of the people behind the CEBM analysis, points out that the CFR in Italy is many times higher than that in Germany; 11% of confirmed cases have died in the former, compared to 0.79% in the latter. “That can’t be down to healthcare differences,” he says: “Italy isn’t a third-world country. And it can’t be demographics — Italy has an old population [and older people are at greater risk], but Germany isn’t far behind it.” 

The likely explanation is that the difference is down to testing. Italy has largely tested people with symptoms, in hospitals; Germany has tested many thousands of people who have no symptoms. That probably helps prevent some deaths, but the most direct impact will be that it hugely increases the denominator; again, if you’re dividing your 100 deaths by 100,000 instead of 10,000, your death rate will be much smaller. Germany’s will be closer to (but not the same as) the IFR, the number we really want.

So, a country’s CFR will vary depending on how many tests it’s done, because that changes the denominator. But at least the numerator — the number being divided — is probably pretty straightforward, right? A death is a death.

Sadly, that’s not the case either. Dr Hannah Ritchie, one of the data scientists at OWID, points out that the death statistics are complex too, for two reasons. One is prosaic: a lot of people who have the disease and will die of it have not yet died. “The period from onset to death is about a month,” she says. So your simple “divide the numerator by the denominator” rule — the number of deaths by the number of patients — doesn’t work, because your number of deaths is a product of how many people had the disease a month ago, not how many people have it now.

That’s bad enough. But there’s a more profound problem, which is that deaths themselves can be recorded very differently in different places. Professor Sir David Spiegelhalter, a statistician at the University of Cambridge, says that the UK simply counts people who have tested positive and then died. But in some other countries, people are recorded as having died of Covid-19 if they had the symptoms, even if they weren’t tested (“suspected” as opposed to “confirmed”); in others, people outside hospitals are not tested and so are not recorded.

“Even the number of deaths is not a perfect statistic at all,” Spiegelhalter says. El Pais did an interesting look at some of the international differences here; Britain’s Office for National Statistics explains why its numbers look different from the official Government ones here.

To some extent it doesn’t matter, says Spiegelhalter: as long as each individual country maintains the same regime, ”the number of deaths is still a good monitor for the shape of the epidemic”. 

But it’s not clear that they are fixed; countries may have good reasons to change the way they collect data as circumstances change, but it apparently happens often enough that the World Health Organisation feels that they have to ask countries to notify them when they do it. Famously, China did so earlier in the epidemic, but others do too: in complying with the WHO’s request, Australia has noted that it has changed its definition of a Covid-19 “case” (and therefore a Covid-19 “death”) at least 12 times since 23 January. 

So, in essence, to work out the IFR — the number we want — we need to know two other factors: the number of people infected with Covid-19, and the number of people who died of it; the denominator, and the numerator. And, sadly, both numbers are uncertain.

How much does any of this matter? Well: now, I’m going to try and build my very own, rather stupid model. I’m not going to try to predict the future; I’m just going to try to use some very simple numbers to “predict” the number of cases there are in the UK right now.

First, the number of reported Covid-19 deaths in the UK is 1,408. Second, the lag between infection and death is about three or four weeks; let’s say three. Third, the number of (confirmed) cases in the UK has been doubling about every three to five days; let’s say five (and assume it’s staying constant; forget social isolation for now).

With those numbers, we can plug in our guess at the IFR (the infection fatality rate, remember: the real number we want to know, the “if I get it, how likely am I to die” number) and use it to work out roughly how many cases we’d expect now.

So what number should we use as our IFR? I’m going to use three: one from Imperial College London’s MRC team, the one behind the famous model; and two from CEBM. Imperial’s latest work assumes an IFR of 1%; CEBM estimates it to be between 0.1% and 0.26%.

If we take the Imperial 1%, then that means that we can multiply the 1,408 deaths now by 100 to get the number of people who’d had the disease three weeks ago, because we think about one in 100 of them died. So about 140,000 people.

Then we can take our doubling time — we said five days — to get how many cases we’d see now. In three weeks, 21 days, you’d see four doublings; two to the power four is 16. So 16 times 140,000, which is 2,240,000. We could imagine that we’ve probably got about two million cases now.

But let’s use the CEBM numbers. First the highest one, 0.26%. If we take that, we can multiply the 1,408 deaths by 400, instead of 100, to give us the number of infections three weeks ago. That is 560,000. Then we can multiply that by 16 to give us an estimate of how many there are now: about 9,000,000.

And how about if we use their lowest estimate, 0.1%? Same routine: 1,408 multiplied by 1,000, multiplied by 16: more than 20,000,000.

So by changing a single number, the IFR, to one of three plausible values, in a very simple model, we get outputs that range from “3% of people have already had it” to “30% of people have already had it”. And that’s before we start messing around with the other assumptions; is doubling time three days, not five? Is infection to death four weeks, not three? Is “1,408 deaths” even correct?

I want to reiterate: this is a very simple, stupid model, put together by a journalist, not an epidemiologist. The actual models will be far more complex, and will take into account other things — the number of cases in hospital and so on — to try to ground them in objective fact. Don’t mistake this for some plausible estimate of infection numbers. And there are loads of other things to worry about: people suffering long-term health consequences, even if they live; people dying of other things because the healthcare system is overwhelmed.

But the problem that I’m illustrating is real. Small, plausible adjustments to your inputs make your model spit out very different things. The assumptions you make are vital. We haven’t even started to think about other crucial things — for instance, government interventions, and how effective they are. 

“The different scenarios — isolation, closing schools, quarantines — they come with massive assumptions about how adherent people are,” says Ritchie. “You get massively varying outputs, depending on what you put in.” Plus, of course, it’s all circular: your model influences how you respond; your response changes what numbers get put back into the model.

What you need is better numbers, to plug into the models. And that’s what people are trying to get. The CEBM paper uses, among other things, numbers from Iceland, which — being tiny — managed to test a huge proportion of its population, nearly 3%. It found 963 cases and just two deaths; an CFR of 0.2%, from which the CEBM extrapolates an IFR of 0.05%. But that’s likely an underestimate, because quarantining has protected the elderly, the most at-risk group. Others have done something similar with passengers on the cruise ship Diamond Princess, finding a CFR of around 1% — likely an overestimate, since the passengers tended to be older.

Another way has been to screen small groups who are in quarantine, such as the Diamond Princess passengers or passengers on aircraft, to see how many people 1) test positive and 2) show symptoms. If you know how many people have the disease but are asymptomatic, then you can extrapolate to the wider population — if you’re testing all the people who are symptomatic, and you know that 50% of infected people don’t show symptoms, and you find 20,000 cases, you can estimate that the real number is more like 40,000.

But there’s a problem here, too, which is that “asymptomatic” is not a simple thing, according to George Davey Smith, an epidemiologist at the University of Bristol. If you’re sitting in quarantine and you cough, you might be recorded as symptomatic; but out in the real world, you’re not going to take yourself to hospital for a gentle cough, so you still won’t get tested.

Instead of there being a neat “symptomatic/asymptomatic” division, you have a third group: people with some symptoms but who think it’s just a cold in the chest. (As I write, I’m coughing a little; but I don’t think that’s Covid-19, I think it’s just because I went for a run this morning and the cold irritated my lungs. But I’d probably be recorded as “symptomatic” if I were in quarantine and being screened.)

And yet another way is to look at how many people die every year, and how many people are dying now, and seeing whether more people are dying than usual. That’s how we attribute deaths to flu each year, says Spiegelhalter; the European Monitoring of Excess Mortality group (EuroMOMO) uses this data to say that in an average year in the UK, 17,000 deaths are “associated” with influenza. But so far there is no excess death at all, except in Italy: the EuroMOMO charts are all around the seasonal average. That will likely change, but we forget that in a population of millions, you’d expect thousands of deaths every day anyway: even the Covid-19 pandemic is still being lost in the noise.

In the end, we need testing. And not just the sort of testing we have now — PCR testing, which shows who has the virus right now; we need serological testing, which shows who has had it in the past. That will come along relatively soon, and hopefully can be quite quickly used to test randomly selected people, like an opinion poll sampling a population; then we can see how many people have had it, and from there work out the IFR. But for the moment we don’t have that. 

I wanted to write this to give an impression of how appallingly difficult the modeller’s job is. I write, sometimes, pieces about statistics — I suggested that claims about the loneliness epidemic, teen suicides, and the media’s influence on Brexit were overstated, for instance. They involved very basic maths, done for very low stakes: if I messed up, if I failed to carry a 2 or whatever, I would look very stupid and would be very embarrassed, but no one would die. 

Whereas, if the Imperial College modellers get it wrong, with their far more complex maths and their far more uncertain inputs, they could sway government policy enormously. Whether we lock down society or carry on as normal depends heavily on the outputs of models like these. And it’s not that there’s an easy “better safe than sorry” option; if we crash the economy, it will (eventually) cause real health problems.

A February 2020 review found that 10 years of austerity may have caused the growth in life expectancy to stall, especially among the poorest; I’m sceptical of the “130,000 deaths caused by austerity” stat, but it’s pretty clear that it had a real negative impact. The post-Covid-19 world will almost certainly involve huge austerity to pay for the vast costs incurred during the virus.

Get it wrong one way, and thousands of people die unnecessarily from the virus; get it wrong the other, and you crash our public services and kill people that way. (I’ve only seen one attempt to model the health outcomes of that crash, and I have no way of judging it; for what it’s worth, though, it does say they will be extremely terrible; on the other hand, recessions don’t seem to shorten life expectancy, so who knows.)

So I’m very sympathetic to the modellers. But there are things which would help, and which they can do, but haven’t, so far at least. Ferguson’s team has not released the code his model is based on; he says he is working with software developers to do so, but proponents of open science, like Davey Smith and his colleague Marcus Munafò, say this isn’t happening fast enough.

“These models are so sensitive to their assumptions,” says Munafò. “And they’re black boxes.” The code is 13 years old; it’s vital that other scientists are allowed to look at it, check it for mistakes and stress-test its assumptions. There are other, open-source models available, but the Imperial one is still kept under wraps, and it shouldn’t be.

Because a lot rides on the outputs. If millions have already been infected and the disease is less deadly than we think, then our response should be very different to if millions are still to be infected and tens or hundreds of thousands more will die. 

The latest from Ferguson’s team suggests that between 1% and 5% of the UK’s population has already been infected. Oke of CEBM thinks that that could be an underestimate — he thinks that the disease was circulating in China for a month or so before it was announced. “There were early reports of doctors saying they were seeing unusual respiratory symptoms, which were suppressed,” he says. That could have brought it all here much earlier.

When I mentioned the Oxford “study” — in fact a model showing what plausible inputs could produce what we’ve seen, one of which was a very low IFR and huge number of people already infected — he didn’t endorse it, but said “I think a lot of people have underestimated how far this has already spread, and how early.” Davey Smith also thinks that those Imperial figures could well be an underestimate. I have no idea if they’re right or wrong, but whether they are or not matters a great deal.

For the record, to take us back to the beginning, Peter Hitchens had flatly misunderstood what was going on. The 500,000 number was a worst-case scenario if we did nothing; the 20,000 was Ferguson’s team’s estimate of what we’d see now that social-distancing measures and so on are in place.

The 5,000 wasn’t from Ferguson’s team at all but from an electrical engineering group also at Imperial who just eyeballed the death curve on the China graph, fitted the UK numbers so far onto that, and extrapolated from there. “They explicitly say they’re not doing any epidemiological modelling at all,” says Spiegelhalter, “and they retracted it two days later on Twitter,” after it became obvious that it was wrong.

But we shouldn’t be complacent and assume that, just because people are misunderstanding what the modellers are doing, the models must be correct. Everything that comes out of them is the product of what goes in, and all of that is going to be wrong, to some degree. “The key point is that the numbers we have now are not correct,” says Ritchie. 

If you look back to previous outbreaks, such as the 2009 swine flu epidemic, the numbers people were using while it was still going on were wildly different from the ones scientists settled on afterward: early estimates in 2009 were between 0.1% and 5.1%; the eventual WHO estimate was just 0.02%, similar to seasonal flu. In a fast-moving situation, it is easy to make large mistakes. (In either direction! I am not suggesting that the Covid-19 situation will necessarily be similarly overstated.)

These models are the best information we have at the moment. But they are hugely uncertain, and likely to be wrong. All we can do is try to get better information for them, and make the best decisions we can under conditions of appalling uncertainty — and be forgiving of the modellers who are desperately trying to make life-changing, history-changing decisions at high speed and with bad data. 

The Mathematics of Predicting the Course of the Coronavirus

WIRED

Epidemiologists are using complex models to help policymakers get ahead of the Covid-19 pandemic. But the leap from equations to decisions is a long one.

ADAM ROGERS MEGAN MOLTENI

SCIENCE

03.30.2020 07:00 AM

                     People at a supermarket in Barcelona, Spain, practice social distancing

                                      PHOTOGRAPH: DAVID RAMOS/GETTY IMAGES

IN THE PAST few days, New York City’s hospitals have become unrecognizable. Thousands of patients sick with the novel coronavirus have swarmed into emergency rooms and intensive care units. From 3,000 miles away in Seattle, as Lisa Brandenburg watched the scenes unfold—isolation wards cobbled together in lobbies, nurses caring for Covid-19 patients in makeshift trash bag gowns, refrigerated mobile morgues idling on the street outside—she couldn’t stop herself from thinking: “That could be us.”

It could be, if the models are wrong.

Until this past week, Seattle had been the center of the Covid-19 pandemic in the United States. It’s where US health officials confirmed the nation’s first case, back in January, and its first death a month later. As president of the University of Washington Medicine Hospitals and Clinics, Brandenburg oversees the region’s largest health network, which treats more than half a million patients every year. In early March, she and many public health authorities were shaken by an urgent report produced by computational biologists at the Fred Hutchinson Cancer Research Center. Their analysis of genetic data indicated the virus had been silently circulating in the Seattle area for weeks and had already infected at least 500 to 600 people. The city was a ticking time bomb.

The mayor of Seattle declared a civil emergency. Superintendents started closing schools. King and Snohomish counties banned gatherings of more than 250 people. The Space Needle went dark. Seattleites wondered if they should be doing more, and they petitioned the governor to issue a statewide shelter-at-home order. But Brandenburg was left with a much grimmer set of questions: How many people are going to get hospitalized? How many of them will require critical care? When will they start showing up? Will we have enough ventilators when they do?

There’s no way to know those answers for sure. But hospital administrators like Brandenburg have to hazard an educated guess. That’s the only way they can try to buy enough ventilators and hire enough ICU nurses and clear out enough hospital beds to be ready for a wave of hacking, gasping, suffocating Covid-19 patients.

That’s where Chris Murray and his computer simulations come in.

Murray is the director of the Institute for Health Metrics and Evaluation at the University of Washington. With about 500 statisticians, computer scientists, and epidemiologists on staff, IHME is a data-crunching powerhouse. Every year it releases the Global Burden of Disease study—an alarmingly comprehensive report that quantifies the incidence and impact of every conceivable illness and injury in each of the world’s 195 countries and territories.

In February, Murray and a few dozen IHME employees turned their attention full-time to forecasting how Covid-19 will hit the US. Specifically, they were trying to help hospitals—starting with the UW Medicine system—prepare for the coming crisis. Brandenburg says the collaboration could turn out to be, quite literally, life-saving. “It’s one thing to know you may be getting a surge of patients,” she says. “If you can make that more tangible—here’s what it’s actually going to look like—then we’re in a much better place in terms of being able to plan for the worst.”

But it’s a big if. During a pandemic, real data is hard to find. Chinese researchers have only published some of their findings on the spread of Covid-19 in Hubei. The ongoing catastrophe of testing for the virus in the United States means no researcher has even a reliable denominator, an overall number of infections that would be a reasonable starting point for untangling how rapidly the disease spreads. Since the 2009 outbreak of H1N1 influenza, researchers worldwide have increasingly relied on mathematical models, computer simulations informed by what little data they can find, and some reasoned inferences. Federal agencies like the Centers for Disease Control and Prevention and the National Institutes of Health have modeling teams, as do many universities.

As with simulations of Earth’s changing climate or what happens when a nuclear bomb detonates in a city, the goal here is to make an informed prediction—within a range of uncertainty—about the future. When data is sparse, which happens when a virus crosses over into humans for the first time, models can vary widely in terms of assumptions, uncertainties, and conclusions. But governors and task force leads still tout their models from behind podiums, increasingly famous modeling labs release regular reports into the content mills of the press and social media, and policymakers still use models to make decisions. In the case of Covid-19, responding to those models may yet be the difference between global death tolls in the thousands or the millions. Models are imperfect, but they’re better than flying blind—if you use them right.

THE BASIC MATH of a computational model is the kind of thing that seems obvious after someone explains it. Epidemiologists break up a population into “compartments,” a sorting-hat approach to what kind of imaginary people they’re studying. A basic version is an SIR model, with three teams: susceptible to infection, infected, and recovered or removed (which is to say, either alive and immune, or dead). Some models also drop in an E—SEIR—for people who are “exposed” but not yet infected. Then the modelers make decisions about the rules of the game, based on what they think about how the disease spreads. Those are variables like how many people one infected person infects before being taken off the board by recovery or death, how long it takes one infected person to infect another (also known as the interval generation time), which demographic groups recover or die, and at what rate. Assign a best-guess number to those and more, turn a few virtual cranks, and let it run.

“At the beginning, everybody is susceptible and you have a small number of infected people. They infect the susceptible people, and you see an exponential rise in the infected,” says Helen Jenkins, an infectious disease epidemiologist at the Boston University School of Public Health. So far, so terrible.

The assumption for how big any of those fractions of the population are, and how fast they move from one compartment to another, start to matter immediately. “If we discover that only 5 percent of a population have recovered and are immune, that means we’ve still got 95 percent of the population susceptible. And as we move forward, we have much bigger risk of flare-ups,” Jenkins says. “If we discover that 50 percent of the population has been infected—that lots of them were asymptomatic and we didn’t know about them—then we’re in a better position.”

So the next question is: How well do people transmit the disease? That’s called the “reproductive number,” or R₀, and it depends on how easily the germ jumps from person to person—whether they’re showing symptoms or not. It also matters how many people one of the infected comes into contact with, and how long they are actually contagious. (That’s why social distancing helps; it cuts the contact rate.) You might also want the “serial interval,” the amount of time it takes for an infected person to infect someone else, or the average time before a susceptible person becomes an infected one, or an infected person becomes a recovered one (or dies). That’s “reporting delay.”

And R₀ really only matters at the beginning of an outbreak, when the pathogen is new and most of the population is House Susceptible. As the population fractions change, epidemiologists switch to another number: the Effective Reproductive Number, or R_t, which is still the possible number of people infected, but can flex and change over time.

You can see how fiddling with the numbers could generate some very complicated math very quickly. (A good modeler will also conduct sensitivity analyses, making some numbers a lot bigger and a lot smaller to see how the final result changes.)

Those problems can tend to catastrophize, to present a worst-case scenario. Now, that’s actually good, because apocalyptic prophecies can galvanize people into action. Unfortunately, if that action works, it makes the model look as if it was wrong from the start. The only way these mathematical oracles can be truly valuable is to goose people into doing the work to ensure the predictions don’t come true—at which point it’s awfully difficult to take any credit.

Models are helping scientists understand Covid-19 infections rates and hospitals plan for surges. This one—a generic version—illustrates the concept of how infection rates can be changed by social distancing measures. 

Speaking at a White House briefing on Thursday, Deborah Birx, response coordinator for the Coronavirus Task Force, admonished the press against taking those models too seriously, even as New York governor Andrew Cuomo begged for federal help with acquiring ventilators and protective equipment for health care workers. “The predictions of the models don’t match the reality on the ground,” Birx said.

Responding to Birx in a thread on Twitter, Harvard infectious disease epidemiologist Marc Lipsitch said Birx had been talking about work from his lab, which the federal government had asked for two days prior. In a preprint (so not peer-reviewed), his team had used an SEIR model with numbers tweaked to simulate the tightening or loosening of social distancing measures, as well as a potential flu-like seasonal variation in Covid-19 infections. He was varying R₀, essentially. In the model, putting a stop to strict social distancing (without something like a vaccine or a cure coming along) allowed infections to climb right back up to their peak of about two critical cases per 1,000 people—which could be 660,000 Americans getting seriously ill or dying. And even with the strictest lockdown-type measures lasting from April through July, his team’s model finds that the disease surges back in autumn.

Remember, the whole point of social distancing is to slow the epidemic, to keep the numbers of sick people at any one time below the maximum that the health care system can handle and stall so scientists can work on treatments. If Lipsitch’s team is right, the characteristics of Covid-19 might require a cyclical flux between strict social distancing and viral resurgence, on and on, perhaps until 2022. If everything goes right, Lipsitch wrote—massive testing and quarantines of the ill, and aggressive social distancing—it’ll be possible to keep numbers down and maybe shorten the timeline. But, Lipsitch said on Twitter, he didn’t see any of that underway.

So in dismissing all that, was Birx making a policy determination to assume that the model’s most Panglossian all-is-well prediction will turn out to be correct? “That was my impression of her comment,” said Yonatan Grad, an infectious disease epidemiologist at the Harvard School of Public Health and a lead author with Lipsitch on that study, speaking at a press conference on Friday.

Birx also took aim at an influential report published earlier this month by disease modelers at Imperial College London that predicted the deadly coronavirus could kill 500,000 Brits before the year was out. These chilling forecasts jolted Boris Johnson’s UK government out of its plan to sit back and wait for herd immunity to take the British Isles.

The report, which also predicted 2.2 million American deaths if the government did nothing, got President Donald Trump’s attention. Shortly after, the White House rolled out a 15-day social distancing challenge, encouraging Americans to stay home as an act of patriotism. Then the US economy tanked, and Trump got nervous about staying the course. So when one of the Imperial researchers, Neil Ferguson, brought new estimates to the UK parliament last Thursday that predicted a British death toll below 20,000, Trump’s task force seized on the apparent walk-back. “Half a million to 20,000,” Birx said during the Thursday press briefing. “We are looking at that, in great detail, to understand that adjustment.”

Except Ferguson wasn’t really walking back his estimates or his model. As he explained later in his own series of tweets, the new numbers resulted from two things: The UK government’s implementation of social distancing measures, and a slightly higher R₀ gleaned from new data from around Europe that suggests the outbreak is moving faster than at first believed—so more people are infected than anyone knows, with milder symptoms. Ferguson said this should lend more evidence, not less, to the importance of social distancing measures.

To be clear, Ferguson was doing exactly what any good scientist would do when presented with new data: updating the model. But these revisions came at a politically dicey moment. Only days before, the British media had begun telling people that maybe they didn’t have to worry after all. A new study said that half the country had already contracted the coronavirus and were already immune to it. This is, in fact, not what the study said. But the two things hitting headlines at the same time created the public perception that maybe the virus wasn’t so worrisome after all.

Produced by a group of researchers at Oxford, that other study had examined the number of observed deaths that occured in Italy and the UK prior to any social distancing interventions. The scientists then tried to ascertain which hypothetical—emphasis on hypothetical— circumstances could have led to those rapidly rising death tolls. One plausible explanation, they found, is exactly what the Imperial group’s models suggest: The virus has just begun to spread in the UK and it is causing severe symptoms among a significant percentage of people. But equally plausible, according to their models, is that SARS-CoV-2 could actually have been circulating since January, possibly infecting up to half the population. For this scenario to work, most people would only get a mild version of the disease—only a tiny fraction of those infected would wind up in the hospital. In other words, in the first scenario, the epidemic is just taking off. In the second, it’s already swept through the population.

If it’s the second scenario, says Sunetra Gupta, the theoretical epidemiologist who led the Oxford work, “that would be great news,” because it would mean a substantial chunk of the UK population is already immune. Nevertheless, even though it’s only one of the scenarios that Gupta’s model implies, the fact that it seemed to contradict Ferguson’s work at Imperial College was enough for commentators and some media to tell a story of conflicting (and therefore untrustworthy) models.

To be clear, it does seem like some number of people, possibly a large number, transmit the virus without being diagnosed. They’re House Infected posing as House Susceptible. That seems clear from researchers showing that in January, the strict travel measures that China imposed on people trying to leave Wuhan, the center of the outbreak, slowed the spread of the disease. That shows up in location data drawn from mobile phone apps; the extent of the disease followed people’s travel patterns. When Wuhan locked down, that spread almost completely stopped. It bought time for the world to prepare—which large parts of the world, including the United States, squandered.

One clever study even tried to use a complicated model to estimate exactly how many undiagnosed, or “undocumented,” cases the Chinese population had in January. The researchers—some at Imperial College and others in the US—broke the infected population into two groups, diagnosed and undiagnosed. (Or, in the language of this particular study, “documented” and “undocumented.”) Through surveys and an app-based data collection project, the US team had actual data on how many people were wandering around at any given time with a respiratory virus; their calculations see that number peaking at more than 10 percent.

Using that as a kind of baseline, and combining it with location data for travel among 375 Chinese cities including Wuhan, the researchers tried various models to infer, given the number of overall infections and where they happened, how many undiagnosed infections had to have been out there. Their conclusion was stunning. Just 14 percent of infections were diagnosed, they wrote. Fully 86 percent of infected people were the walking ill, stealth transmitters of the virus. “Those undocumented infected people were about half as infectious. However, because there are many more of them, they are the dominant driver of the outbreak,” says one of the creators of the model, Jeffrey Shaman, director of the Climate and Health Program at the Columbia University School of Public Health. “This virus needs these undocumented cases to successfully move through a society. If you’re identifying cases, you’re going to have a better handle on it.”

For now, there’s really only one way to figure that out: tests. Specifically, that means gathering blood from infected people, which would contain their antibodies to the virus. That’s what Gupta has concluded, too. “Our motivation was to explore, conceptually, the extreme variation that could be underlying what we see,” says Gupta. “What we see is just the tip of the iceberg. And the only way to see under the surface is to go out there and look for these antibodies.”

One of her collaborators has already developed one of these so-called serological tests, which can tell scientists who has been exposed to the virus and therefore now has immunity. Over the weekend, the researchers began testing blood samples collected from healthy Brits over the previous two months. (Gupta declined to say where the samples came from, citing confidentiality.) She says it could be just a matter of weeks before they have a much better picture of how vulnerable the UK population really is. But until then, at least in the UK, it will continue to be a tale of two models.

ONE THING THAT models will try to predict next, given the tranche of new data that these first 80,000-plus cases in the US will yield, is when social distancing and shelter-in-place measures can end. “You don’t make the timeline. The virus makes the timeline,” Anthony Fauci, head of the National Institute of Allergy and Infectious Diseases told CNN. But how will anyone determine that timeline? The role of children as spreaders of the disease still isn’t clear. Nor is the role of adults with mild symptoms.

“One of the crucial things that has to happen is serology tests, testing large numbers of the population for antibodies,” Jenkins says. This data would show whether a person has been infected—whether or not they had symptoms. Population wide, that can give you more certainty on the numbers of susceptible and recovered people. The tests really only work a week or so after a person contracts the virus, but that’s valuable enough that the UK has purchased 3.5 million blood tests already, and researchers in the Netherlands have begun testing blood bank donations.

“The modeling is going to be absolutely key for how we come out of this and what things look like longer-term. But for places in Western Europe and the United States, the scientific evidence is not particularly complicated. If you act soon, with a firmer response, you limit early deaths and get through the initial phase more quickly,” Jenkins says. That’s based less on models, she says, and more on research like a 2007 article about the “non-pharmaceutical interventions” different US cities used to respond to the 1918 influenza pandemic. Places that locked down more quickly had death rates half as high as ones that waited—and one of the coauthors of that study was the same Marc Lipsitch who tangled with the White House last week.

That paper’s a lot clearer than a model, especially when so much about Covid-19 remains unknown. “One of the big dangers of modeling is that a model can get quite complicated quite quickly,” Jenkins says. “And it’s only as good as the data that go into it.”

That’s not the only barrier, either. The channels for model-makers to get to policymakers aren’t clear. Even though governors across the US are touting models to justify their shelter-in-place orders and build-outs of critical care beds, it’s just as easy for political leaders like Birx, a representative of the federal coronavirus response, to dismiss them—as a report from the Center for Health Security at Johns Hopkins points out.

Just as happens with models of climate change, the presentation of a range of possible futures in epidemiological models provides a lever for political opposition. Conservative commentators and allies of President Trump, The Washington Post reports, are increasingly describing social distancing orders and pleas for medical aid as part of a deep state plot. On his radio show Friday, ultraconservative provocateur Rush Limbaugh said,“We didn't elect a president to defer to a bunch of health experts that we don't know. And how do we know they're even health experts?”

The president seems to share these sentiments. After Governor Andrew Cuomo based a request for tens of thousands of ventilators on model projections, the president told television personality Sean Hannity, “I don't believe you need 40,000 or 30,000 ventilators.” He based that opinion, he said, on “a feeling.” Or maybe the president doesn’t feel this way; two days later he tweeted that Ford and GM should start mass-producing ventilators, and he obliquely threatened to invoke the law he could use to make this happen. Maybe.

LISA BRANDENBURG THOUGH, would take the models over a feeling any day. University of Washington Medicine hospitals got their first confirmed Covid-19 patient on March 7. Three days later, she reached out to Murray and the Institute for Health Metrics and Evaluation. The following Tuesday, his team delivered a first round of projections for three scenarios: best, middle, and worst case. The worst case was bad. According to the models, UWM would have to accommodate an additional 950 Covid patients per day during the surge, which was due to arrive April 7. With around 1,500 beds across four hospitals, they would be overrun.

So Brandenburg’s team got to work. They had already begun ordering more masks, gloves, face shields, and ventilators. They had opened a drive-thru testing station. Now they moved to deploy a surge plan, canceling all elective surgeries and trying to clear out as many beds as possible. They built wedding-party-size triage tents outside hospitals’ emergency room departments to keep potential Covid-19 patients away from others seeking care. They called up ICU nurses who’d retired within the past five years. They began shuffling in nurses, respiratory therapists, and technicians from other departments, training them up on the specifics of critical care.

Murray’s team embedded with Brandenburg’s, providing them with daily updated projections as new data came in. In the most recent models from late last week, things started to take a turn—and for the first time, they were for the better. The curve is flattening out. In the new worst-case scenario, the number of patients has dropped by 20 percent compared with IHME’s first report. The peak is now 10 days later, on April 17.

Across UWM’s four hospitals, Covid-19 cases are down too. At the end of last week, doctors and nurses were caring for just over 60 Covid-19 patients, down from about 75 a few days prior. “It looks like the social distancing is helping,” says Brandenburg.

She knows the projections can change any time, for the worse. And that’s still what they’re preparing for. But for the first time, she says, looking at those graphs she allowed herself to think that maybe, maybe, it was no longer a question of when Seattle would become the next Spain, the next Italy, the next New York. “For the first time I feel like, ‘OK, maybe we are actually going to have all our plans in place,’” she says.

Other hospital administrators and local public health officials should take note. After word got out about the work IHME was doing for hospitals in Seattle, other health care providers around the US began sending Murray emails, asking for help with their own preparedness plans. As the individual requests piled up, his team decided to go public with their work last week, providing interactive state-by-state projections for how the nation’s supply of hospital beds, intensive care units, and ventilators will hold up over the next few months.

The new coronavirus will spread through different regions at different speeds—depending on population density, transit patterns, and how well people are adhering to whatever social distancing measures are in place. So Murray’s hope is that local policymakers can use the models to get a more fine-grained view on when their particular wave might be cresting. “We want to help them figure out when their worst week will be and to prepare accordingly, however they can,” says Murray. His team plans to update their models every Monday, pulling in the latest death counts and adjusting for any changes to statewide social distancing policies. It’s still too soon to say if Washington will be a success story. But at least right now, it appears to be an outlier.

According to IHME’s models, 41 states will need more hospital beds than they currently have. Twelve states will need to boost their numbers of ICU beds by 50 percent or more. The models predict that over the next four months, these shortfalls will contribute to the deaths of 81,000 Americans, with the number of deaths per day peaking as soon as mid-April.

Even this estimate is generous. As epidemiologists have been pointing out on Twitter, Murray’s models assume that states that haven’t yet enacted strict stay-at-home orders will do so in the next week, in light of what’s happening in New York—and that they’ll achieve Wuhan-level lockdowns, which many public health experts are skeptical Americans can pull off. Indeed, plenty of states, mostly conservative-leaning and where case counts so far remain low, have resisted taking those steps. Even before Covid-19, scientists had trouble getting policymakers to pay attention to their warnings. Now they can’t get enough data to make those warnings specific, and politicians are working to undermine what little the scientists are sure of. What was already a tragedy has evolved into a disaster, reaching toward catastrophe. And all of it was predictable.

Adam Rogers writes about science and miscellaneous geekery. Before coming to WIRED, Rogers was a Knight Science Journalism Fellow at MIT and a reporter for Newsweek. He is the author of the New York Times science bestseller Proof: The Science of Booze.

Megan Molteni is a staff writer at WIRED, covering biotechnology, public health, and genetic privacy. Previously, she freelanced as a reporter, audio producer, and fact-checker. Her work has appeared in Popular Science, Discover, Undark, Nautilus, and Aeon. She studied biology and ultimate frisbee at Carleton College and has a graduate...