posts: 31762

{
    "id": "wp-31762",
    "slug": "untitled-reusable-block-205",
    "content": {
        "toc": [],
        "body": [
            {
                "text": [
                    {
                        "text": "Testing data provides us with two indicators of the quality of data on COVID-19",
                        "spanType": "span-simple-text"
                    }
                ],
                "type": "heading",
                "level": 3,
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "No country knows the true number of people infected with COVID-19. All we know is the infection status of those who have been tested.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The total number of people that have tested positive \u2013 the number of ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": "confirmed",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "text": " cases \u2013 is not the total number of people who have been infected. The true number of people infected with COVID-19 is much higher.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Whilst there is no way to infer the true number of infections from testing data, it can help give us a strong indication of the quality of a country\u2019s data on the pandemic and an idea of how informative the number of confirmed cases in a country may be.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "text": [
                    {
                        "text": "Testing coverage",
                        "spanType": "span-simple-text"
                    }
                ],
                "type": "heading",
                "level": 2,
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The chart here shows a measure of testing coverage \u2013 tests per thousand people.\u00a0",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Countries are reporting testing data in different ways: some report the number of tests, others report the number of people tested. This distinction is important \u2013 people may be tested many times, and the number of tests a person has is likely to vary across countries.{ref}We provide detailed descriptions of the data for each country ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/covid-testing#source-information-country-by-country",
                        "children": [
                            {
                                "text": "here",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".{/ref}",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Across different countries, we see an enormous range in testing coverage. In Iceland there have been more than 100 tests per thousand people \u2013 far more than in any other country. In Indonesia, testing coverage is very low \u2013 only 0.1 tests per thousand people.{ref}In both cases it is unclear from the source whether figures relate to the number of tests or the number of people tested. Detailed descriptions of the data for each country can be found ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/covid-testing#source-information-country-by-country",
                        "children": [
                            {
                                "text": "here",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".{/ref}",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Generally, we would expect that more testing means more reliable data on confirmed cases, for two reasons.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Firstly, a greater degree of testing provides us with a larger \u2018sample\u2019 of people for which their infection status is known. If everybody was tested, we would know the true number of people who are infected.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Secondly, it may be the case that countries with a high capacity for testing do not need to ration tests as much. Where the capacity for testing is low, tests may be reserved (or \u2018rationed\u2019) for particularly high-risk groups. Such rationing is one of the reasons that tested people are not representative of the wider population.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "As such, where testing coverage is higher, the \u2018sample\u2019 of tested people may provide a less biased idea of the true prevalence of the virus.{ref}This will be influenced by variations in the way that countries allocate tests across groups, however.{/ref}\u00a0",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "children": [
                            {
                                "text": "Download the data:",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-bold"
                    },
                    {
                        "text": " we make our full testing dataset, alongside detailed source descriptions, available ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://github.com/owid/covid-19-data/tree/master/public/data/",
                        "children": [
                            {
                                "text": "on GitHub",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "url": "https://ourworldindata.org/grapher/full-list-cumulative-total-tests-per-thousand-bar-chart",
                "type": "chart",
                "parseErrors": []
            },
            {
                "text": [
                    {
                        "text": "The number of tests per confirmed case",
                        "spanType": "span-simple-text"
                    }
                ],
                "type": "heading",
                "level": 2,
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "A further complication with using testing coverage as an indicator of reliability, is that the number of tests needed to have an accurate picture of the spread of the virus varies over the course of an outbreak.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "At the beginning of an outbreak, where the number of people infected with the virus is low, a much smaller number of tests are needed to accurately assess the spread of the virus.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "As the virus infects more people, testing coverage also needs to expand in order to provide a reliable picture of the true number of infected people.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "For this reason it is helpful to look at the number of tests performed for each confirmed case. This gives us an indication of the scale of testing that accounts for the different stages each country may be in its outbreak.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The bar chart shows the number of tests, or people tested per confirmed case. The data can also be viewed over time in ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/grapher/number-of-covid-19-tests-per-confirmed-case?time=17..&country=AUS+ECU+DEU+IDN+ITA+JPN+NZL+PHL+TWN+GBR+USA+VNM",
                        "children": [
                            {
                                "text": "this chart",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The key insight from this metric is that there are ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": "very",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "text": " large differences between countries.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "In some countries the number of tests are many times higher than the number of confirmed cases. As of 11 April, in Vietnam more than 400 tests had been conducted for each confirmed case. In Taiwan and Russia there had been around a hundred tests for each confirmed case.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "But in other countries testing is",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": " very",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "text": " low relative to the number of confirmed cases. The US, the UK and Ecuador had performed around 5 tests or fewer for every confirmed case.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "children": [
                            {
                                "text": "Download the data:",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-bold"
                    },
                    {
                        "text": " we make our full testing dataset, alongside detailed source descriptions, available ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://github.com/owid/covid-19-data/tree/master/public/data/",
                        "children": [
                            {
                                "text": "on GitHub",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "url": "https://ourworldindata.org/grapher/number-of-covid-19-tests-per-confirmed-case-bar-chart",
                "type": "chart",
                "parseErrors": []
            },
            {
                "text": [
                    {
                        "text": "What can we learn from these measures about the pandemic?",
                        "spanType": "span-simple-text"
                    }
                ],
                "type": "heading",
                "level": 2,
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Both testing coverage and the number of tests per confirmed case help us understand what we can know about the true spread of the virus from data on confirmed cases.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "But it is the number of tests per confirmed case that is arguably the most helpful in this regard",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": ", ",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-bold"
                    },
                    {
                        "text": "because this accounts for the fact that a smaller outbreak requires less testing.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Consider for instance the difference between three countries: the UK, Australia and Taiwan.\u00a0",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "These countries are highlighted in the chart here, which shows the number of tests per million against the number of confirmed cases per million. The dotted comparison lines show the points on the chart where the number of tests are a fixed number of times larger than the number of confirmed cases \u2013 2, 5, 10, 20, 50, 100, 200 and 500 times larger.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "In terms of testing coverage the UK appears to be ahead of Taiwan, with at least twice the number of people tested per thousand, as of 11 April.{ref}As of 11 April, the UK had tested around 4 people for every thousand people in its population. In Taiwan, there had been less than two tests per thousand people \u2013 though it is not totally clear from the source whether this relates to the number of people tested, or the number of samples tested. See our ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/covid-testing#source-information-country-by-country",
                        "children": [
                            {
                                "text": "detailed source descriptions",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": " for more information.{/ref}",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "But on the same date, there were ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/explorers/coronavirus-data-explorer?zoomToSelection=true&facet=none&pickerSort=asc&pickerMetric=location&hideControls=true&Metric=Confirmed+cases&Interval=Cumulative&Relative+to+Population=true&Color+by+test+positivity=true&country=TWN~GBR",
                        "children": [
                            {
                                "text": "60 times",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": " more confirmed cases per million in the UK than in Taiwan \u2013 1,035 per million and 16 cases per million respectively.\u00a0",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "So whilst testing relative to population size is higher in the UK, testing ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": "relative to the",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "children": [
                            {
                                "text": "size of the outbreak",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "text": " is much, much higher in Taiwan.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "As of 11 April, in Taiwan one case was confirmed for every 120 tests. In the UK, a case was confirmed in fewer than every four tests.{ref}As of 11 April, the UK had tested 3.8 people per confirmed case. In Taiwan, 122 tests had been performed per confirmed case \u2013 though it is not totally clear from the source whether this relates to the number of people tested, or the number of samples tested. See our ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/covid-testing#source-information-country-by-country",
                        "children": [
                            {
                                "text": "detailed source descriptions",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": " for more information.{/ref}",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "In Australia, testing coverage is much higher than in Taiwan. But in terms of the number of tests per confirmed case, the countries are much closer \u2013 one case was confirmed for every 55 tests in Australia as of 11 April. A number of issues with the data on testing \u2013 discussed ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/covid-testing",
                        "children": [
                            {
                                "text": "here",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": " \u2013 mean that small differences between countries should not be overinterpreted.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "But the very large differences \u2013 such as those seen between Taiwan, Australia and the UK \u2013 do tell us something important about the quality of the data.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "A country that performs very few tests for each case it confirms is not testing widely enough for the number of confirmed cases to paint a reliable picture of the true spread of the virus. Whilst those people with the most severe symptoms may have been tested in such countries, there are likely to be many times more people with mild or no symptoms that were never tested.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Testing in the UK has not kept pace with the advancing outbreak. The number of people tested per confirmed case ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/grapher/covid-19-tests-cases-scatter-with-comparisons?time=1..81&country=TWN+GBR",
                        "children": [
                            {
                                "text": "fell rapidly",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": " throughout March and early April \u2013 from more than 400, to less than 4. The current low level of testing, relative to the size of the outbreak, suggests that the true number of infections in the UK is likely to be far higher than the number of confirmed cases.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The large number of tests for each confirmed case in Taiwan and Australia suggests that the number of confirmed cases paint a much more reliable picture of the true number of infections in these countries.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "Researchers from the ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "children": [
                            {
                                "text": "London School of Hygiene and Tropical Medicine",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-italic"
                    },
                    {
                        "text": " \u2013 Timothy Russel, Joel Hellewell, Sam Abbott and others \u2013 reach similar conclusions about the UK and Australia via a different method.{ref}Russel T., Hellewell J., Abbot S. et al. \u2018Using a delay-adjusted case fatality ratio to estimate under-reporting\u2019. Available at the Centre for Mathematical Modelling of Infectious Diseases Repository, ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://cmmid.github.io/topics/covid19/severity/global_cfr_estimates.html",
                        "children": [
                            {
                                "text": "here",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".{/ref} They estimate the degree to which countries' confirmed cases may underestimate total symptomatic cases by applying the case fatality rate (we explain this metric in detail ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/coronavirus#what-do-we-know-about-the-risk-of-dying-from-covid-19",
                        "children": [
                            {
                                "text": "here",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ") observed in large studies in China and South Korea to data on the number of COVID-19 deaths in countries around the world.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "They estimate that in Australia the number of confirmed cases reflect more than three quarters of the total number of symptomatic cases in the country. For the UK, they estimate that confirmed cases represent less than one in twenty symptomatic cases.{ref}The exact estimate for Australia is 81% with a confidence interval of 52% - 100%. The estimate for the UK is 3.4%, with a confidence interval of 2.8% - 7.7%. The data they use at the time of writing (13 April) appear to relate to the situation as of 8 April.{/ref}",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "As such, the gap between the UK and Australia in terms of the true number of infections is likely to be far higher than that indicated by ",
                        "spanType": "span-simple-text"
                    },
                    {
                        "url": "https://ourworldindata.org/explorers/coronavirus-data-explorer?hideControls=true&Metric=Confirmed+cases&Interval=Cumulative&Relative+to+Population=false&Color+by+test+positivity=true&country=AUS~TWN~GBR",
                        "children": [
                            {
                                "text": "their confirmed cases",
                                "spanType": "span-simple-text"
                            }
                        ],
                        "spanType": "span-link"
                    },
                    {
                        "text": ".",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The intuition behind these researchers\u2019 estimates is that where the number of confirmed cases looks low against the number of deaths, this is a clear indication that the true number of cases is likely to be much, much higher. But the fundamental reason for this is the limited extent of testing.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "type": "text",
                "value": [
                    {
                        "text": "The rate of tests per case thus gives us another useful way of approaching the same question, by looking at the extent of testing relative to the number of cases directly.",
                        "spanType": "span-simple-text"
                    }
                ],
                "parseErrors": []
            },
            {
                "url": "https://ourworldindata.org/grapher/covid-19-tests-cases-scatter-with-comparisons?country=AUS+TWN+GBR",
                "type": "chart",
                "parseErrors": []
            }
        ],
        "type": "article",
        "title": "What can testing data tell us?",
        "authors": [
            null
        ],
        "dateline": "April 13, 2020",
        "sidebar-toc": false,
        "featured-image": ""
    },
    "createdAt": "2020-04-13T23:11:51.000Z",
    "published": false,
    "updatedAt": "2023-03-01T21:27:04.000Z",
    "revisionId": null,
    "publishedAt": "2020-04-13T22:11:34.000Z",
    "relatedCharts": [],
    "publicationContext": "listed"
}