posts_gdocs: 15sjB_Kv--BQpTknXV_Qn4G_AU2WyASscEuqNq392epU
Data license: CC-BY
This data as json
id | slug | type | content | published | createdAt | publishedAt | updatedAt | publicationContext | revisionId | breadcrumbs | markdown | title |
---|---|---|---|---|---|---|---|---|---|---|---|---|
15sjB_Kv--BQpTknXV_Qn4G_AU2WyASscEuqNq392epU | disaster-database-limitations | article | { "toc": [ { "slug": "many-smaller-events-in-the-past-aren-t-captured", "text": "Many smaller events in the past aren\u2019t captured", "title": "Many smaller events in the past aren\u2019t captured", "supertitle": "", "isSubheading": false }, { "slug": "we-should-be-cautious-about-reporting-increases-in-the-number-of-disasters-using-em-dat", "text": "We should be cautious about reporting increases in the number of disasters using EM-DAT", "title": "We should be cautious about reporting increases in the number of disasters using EM-DAT", "supertitle": "", "isSubheading": false } ], "body": [ { "type": "text", "value": [ { "text": "If we want to reduce the risks of disasters, we need to track where they\u2019re happening; what types of events they are; their human and economic impacts; and how these trends change over time.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "High-quality data helps us see patterns in the data on factors such as increased resilience, climate change, and humanitarian response.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "There are now several dedicated research groups that publish in-depth databases of disaster records.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "One of the most widely cited is the ", "spanType": "span-simple-text" }, { "url": "https://www.emdat.be/", "children": [ { "text": "International Disaster Database (EM-DAT) of the Centre for Research on the Epidemiology of Disasters (CRED)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". It is open-access and free and lets anyone dig into the specific details of each recorded disaster. At Our World in Data, we rely on EM-DAT as our main data source for disasters. It\u2019s also used by organizations such as the United Nations, World Meteorological Organization, UNFCCC, and many academic researchers.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But no disaster database is perfect. Data is incomplete. Its quality varies over time. And some events are either unreported or hard to quantify.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "That\u2019s why it\u2019s important to understand the biases and limitations of data sources so that they can be interpreted usefully.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Many of them are explained by EM-DAT itself in ", "spanType": "span-simple-text" }, { "url": "https://doc.emdat.be/docs/", "children": [ { "text": "its documentation", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In this article, we explore several of these biases, which can lead to incorrect conclusions when analyzing historical trends.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "The increase in the number of disasters is partly a result of reporting bias", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "EM-DAT publishes data on the number of events, deaths, numbers affected, and other metrics since 1900.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you look at the chart of the ", "spanType": "span-simple-text" }, { "children": [ { "text": "number", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": " of disasters over time \u2014 shown below \u2014 you see a very steep rise since the 1980s.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "url": "https://ourworldindata.org/grapher/number-of-natural-disaster-events", "type": "chart", "parseErrors": [] }, { "type": "text", "value": [ { "text": "Many organizations, such as the United Nations and World Meteorological Organization, have reported on this as a dramatic rise in actual disaster events. Here are a couple of high-profile examples:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "url": "https://www.fao.org/3/cc7900en/cc7900en.pdf", "children": [ { "text": "Food and Agriculture Organization of the United Nations (2023)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ": \u201cAccording to the International Disaster Database (EM-DAT) of the Centre for Research on the Epidemiology of Disasters (CRED), disaster events have increased from 100 per year in the 1970s to around 400 events per year worldwide in the past 20 years.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://gadebate.un.org/en/72/secretary-general-united-nations", "children": [ { "text": "UN chief says natural disasters have quadrupled since 1970", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". This statement ", "spanType": "span-simple-text" }, { "url": "https://unfccc.int/news/un-chief-says-natural-disasters-have-quadrupled-since-1970", "children": [ { "text": "was then reported", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by the UNFCCC.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://library.wmo.int/viewer/57564", "children": [ { "text": "World Meteorological Organization (2019)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ", on page 16: \u201cThe number of disasters has increased by a factor of five over the 50-year period: whereas 711 disasters were recorded for 1970-1979, 3536 were recorded in 2000-2009.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://unfccc.int/news/climate-change-leads-to-more-extreme-weather-but-early-warnings-save-lives", "children": [ { "text": "UN Framework Convention on Climate Change (UNFCCC):", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " \u201cThe number of disasters has increased by a factor of five over the 50-year period, driven by climate change, more extreme weather, and improved reporting.\u201d", "spanType": "span-simple-text" }, { "url": "#note-1", "children": [ { "children": [ { "text": "1", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "These points were repeated in leading media outlets such as the ", "spanType": "span-simple-text" }, { "url": "https://www.bbc.co.uk/news/science-environment-65673961", "children": [ { "text": "BBC", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " and ", "spanType": "span-simple-text" }, { "url": "https://www.economist.com/graphic-detail/2017/08/29/weather-related-disasters-are-increasing", "children": [ { "text": "The Economist", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "These points are correct regarding the number of ", "spanType": "span-simple-text" }, { "children": [ { "text": "reported ", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": "disasters but are unlikely when it comes to the true number of events.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "EM-DAT \u2014 the data source that these reports rely on \u2014 says as much in ", "spanType": "span-simple-text" }, { "url": "https://doc.emdat.be/docs/known-issues-and-limitations/", "children": [ { "text": "its limitations section", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ":", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "type": "text", "value": [ { "text": "\u201cTime biases result from unequal reporting quality and coverage over time [...] Technologies and initiatives can be considered responsible for the dominant trend observed. Therefore, it is challenging to infer insight into the actual drivers of disasters such as climate change, population growth, or disaster risk management.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "type": "blockquote", "citation": "", "parseErrors": [] }, { "type": "text", "value": [ { "text": "As it explains, CRED wasn\u2019t created until 1973, when it started compiling disaster data. It wasn\u2019t until 1988 that it took over the disaster database and established EM-DAT. This period of trying to develop the first database over the 1970s and 1980s coincides with the steep rise in the number of reported disasters.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "EM-DAT also notes that communication technologies developed rapidly over this period \u2014 most notably satellites, the Internet, and personal computers. This is likely to have caused a step-wise change in the frequency of reporting across the world. Several publications from CRED over the years warn about the overinterpretation of these trends.", "spanType": "span-simple-text" }, { "url": "#note-2", "children": [ { "children": [ { "text": "2", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "text": [ { "text": "Many smaller events in the past aren\u2019t captured", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "At least some of the observed increase in the number of reported disasters since 1900 is likely to result from increased reporting. Many medium-to-large events can be found in historical records, but smaller events with less damage or fatalities are missing.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In its 2004 report, ", "spanType": "span-simple-text" }, { "url": "https://www.unisdr.org/files/1078_publication2004emdat.pdf", "children": [ { "text": "Thirty Years of Natural Disasters 1974-2003: The Numbers", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ", CRED notes that historical data was based on retrospective analysis, resulting in:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "type": "text", "value": [ { "text": "\u201ca list that included mainly events of major importance, as neither humanitarian aid nor telecommunications were particularly developed and few organizations were interested in compiling data on natural disasters. When active registering of disasters took on a more important role, both the larger disasters were recorded, together with increasingly more of the smaller ones.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "type": "blockquote", "citation": "", "parseErrors": [] }, { "type": "text", "value": [ { "text": "We\u2019ve replicated this analysis with the latest data from EM-DAT in the chart below. It shows the share of reported disasters of different sizes as a share of the total. The further we go in the past, the more we see large events dominating the records. Small and medium events were missed at the time and are impossible to identify today. Every new decade, as reporting and communication improved, more small events made it into the reports. You can ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/grapher/natural-disasters-by-yearly-impact", "children": [ { "text": "also explore", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " the annual data.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "url": "https://ourworldindata.org/grapher/natural-disasters-by-decadal-size", "type": "chart", "parseErrors": [] }, { "type": "text", "value": [ { "text": "A ", "spanType": "span-simple-text" }, { "url": "https://www.tandfonline.com/doi/full/10.1080/17477891.2023.2239807", "children": [ { "text": "recent paper", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " published in ", "spanType": "span-simple-text" }, { "children": [ { "text": "Environmental Hazards", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": " analyzed the trends in the number of reported disasters in the EM-DAT database since 1900.", "spanType": "span-simple-text" }, { "url": "#note-3", "children": [ { "children": [ { "text": "3", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" }, { "text": " It looked at the number of events over time at different thresholds of \u201crecorded deaths\u201d. So, the number of recorded events with deaths below 200, 500, 1,000, 2,000, and 5,000.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "It found that the trend for small events \u2013 with less than 200 deaths \u2013 increased greatly in the 1980s and 1990s. This suggests that small events are missing in earlier periods of the database, and only in the past 30 or 40 years have they been reported more consistently.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "We did not use the data or results from this paper but instead replicated this analysis based on the latest data from EM-DAT. The only difference is that we did not include epidemics to focus on meteorological, hydrological, and geophysical events. The results are shown in the chart below. They mirror the findings, with a significant increase in the number of small events recorded.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "url": "https://ourworldindata.org/grapher/natural-disasters-reported-by-deaths", "type": "chart", "parseErrors": [] }, { "text": [ { "text": "We should be cautious about reporting increases in the number of disasters using EM-DAT", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "EM-DAT itself ", "spanType": "span-simple-text" }, { "url": "https://doc.emdat.be/docs/known-issues-and-limitations/specific-biases/#time-bias", "children": [ { "text": "strongly recommends", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " that users exclude or are cautious about interpreting trends using pre-2000 data because of this consistency issue. In fact, since September 2023, it has labeled all pre-2000 data as \u201cHistoric\u201d to differentiate it from recent records.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you look at data from 2000 onwards, there is no clear increase in the number of global disasters.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "To be clear: this does not mean that there is no increase in disasters, especially when looking at specific ", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "children": [ { "children": [ { "text": "types", "spanType": "span-simple-text" } ], "spanType": "span-italic" } ], "spanType": "span-bold" }, { "children": [ { "text": " of events, or specific locations. To establish clear trends on this, people need to look at more focused academic literature. It may also be the case that other databases ", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "children": [ { "children": [ { "text": "do", "spanType": "span-simple-text" } ], "spanType": "span-italic" } ], "spanType": "span-bold" }, { "children": [ { "text": " find an increase. It also says nothing about the ", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "children": [ { "children": [ { "text": "intensity ", "spanType": "span-simple-text" } ], "spanType": "span-italic" } ], "spanType": "span-bold" }, { "children": [ { "text": "of disasters.", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But EM-DAT shouldn\u2019t be used as evidence that there has been a four- or five-fold increase in the actual number of disasters globally. While there may be an increase, at least some of this is down to improvements in reporting.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "There are large gaps in disaster statistics, especially for economic damages", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "EM-DAT publishes a range of indicators: the estimated number of deaths, people left homeless, numbers affected, and economic damages.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "However, the completeness of this data varies. The metric where data is largely missing is economic damages. In ", "spanType": "span-simple-text" }, { "url": "https://www.nature.com/articles/s41597-022-01667-x", "children": [ { "text": "a paper", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " published in ", "spanType": "span-simple-text" }, { "children": [ { "text": "Nature Scientific Data", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": ", Rebecca Jones et al. (2022) look at the share of disasters between 1990 and 2020 that have missing data.", "spanType": "span-simple-text" }, { "url": "#note-4", "children": [ { "children": [ { "text": "4", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" }, { "text": " More than 40% of the events did not have estimated monetary damages. This was even worse for ", "spanType": "span-simple-text" }, { "children": [ { "text": "insured", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": " damages, which were missing 88% of the time, and 96% had no records of reconstruction costs.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Unsurprisingly, data coverage tended to be poorer in low-income countries where statistical capacity and reporting are more limited. From 2000 to 2019, only 13% of disasters in Africa and 23% in South Asia ", "spanType": "span-simple-text" }, { "url": "https://www.cred.be/sites/default/files/CRED-Disaster-Report-Human-Cost2000-2019.pdf", "children": [ { "text": "reported any", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " economic losses.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Data for total deaths appeared to be much more complete. The Jones et al. (2022) paper reported that just 1.3% of events did not have death estimates recorded. We tried to replicate these estimates using the ", "spanType": "span-simple-text" }, { "url": "https://www.emdat.be/", "children": [ { "text": "publicly available EM-DAT dataset", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". A much higher share of events had no data (i.e., blanks) for recorded deaths: 30% at the time of publication. However, since events in EM-DAT with ", "spanType": "span-simple-text" }, { "children": [ { "text": "zero", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": " deaths are also recorded as blanks, this estimate includes non-fatal events and those with genuine data gaps. It\u2019s therefore difficult to give a concrete estimate for what share of events have real gaps in their death records.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Users of EM-DAT data should be aware of these potential gaps in data coverage. Particularly for lower-income countries and records from previous decades when reporting was much patchier.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "Heat deaths are poorly captured", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "One disaster category that is included in EM-DAT but is likely to be very patchy is extreme temperature. There are several reasons why.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "First, the inequalities in reporting on heatwaves across regions are stark. Many regions have poor data coverage, and Sub-Saharan Africa is almost completely overlooked.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Over half of heat events in EM-DAT ", "spanType": "span-simple-text" }, { "url": "https://doc.emdat.be/docs/known-issues-and-limitations/specific-biases/#geographic-biases", "children": [ { "text": "were reported", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " across only 9 countries: Japan, India, Pakistan, the United States, France, Belgium, the United Kingdom, Spain, and Germany. It\u2019s highly unlikely that these are the only countries experiencing extreme heat events. Such events are just not being recorded or estimated in other regions.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Second, proper quantification of the health effects of extreme temperatures is difficult. We often think about acute or very sudden deaths such as heat strokes. But most heat-related deaths come from an increase in the risk of less obvious conditions such as cardiovascular disease.", "spanType": "span-simple-text" }, { "url": "#note-5", "children": [ { "children": [ { "text": "5", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" }, { "text": " These seemingly indirect deaths are not noted as being \u201cheat-related\u201d at the time and can only be estimated using various statistical methods later. This is true for both hot- and cold-related deaths.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "There is an emerging literature that tries to quantify heat-related mortality \u2014 with projections into the future \u2014 but heat deaths are not always captured (at least not fully) in disaster databases.", "spanType": "span-simple-text" }, { "url": "#note-6", "children": [ { "children": [ { "text": "6", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "We therefore suggest caution when using heat death figures. Due to reporting biases, they are likely to be underestimates (for both cold and heat-related deaths) with large inequalities.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "Failure to capture the indirect impacts of disasters", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "Disasters often have near-term and acute impacts on human mortality, health, and infrastructure. However, they can also lead to some indirect, medium-to-long-term impacts that are hard to capture.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "This is often the case for events such as droughts, where indirect impacts such as malnutrition, food insecurity, and potential impacts of water shortages are harder to quantify \u2014 especially in an ongoing or very recent event. This is explained in more detail in the UNDRR\u2019s ", "spanType": "span-simple-text" }, { "url": "https://www.undrr.org/publication/gar-special-report-drought-2021", "children": [ { "text": "Special Report on Drought 2021", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Therefore, users should know that disaster databases may fail to capture the full chain of disaster impacts.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "refs": { "errors": [], "definitions": { "466bbcf3c24095f95e4766244c4cc8ff196955c6": { "id": "466bbcf3c24095f95e4766244c4cc8ff196955c6", "index": 3, "content": [ { "type": "text", "value": [ { "text": "Jones, R.L., Guha-Sapir, D. & Tubeuf, S. Human and economic impacts of natural disasters: can we trust the global data? Sci Data 9, 572 (2022).", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "91a896f73c7948b8d19269a781cd19006c04540d": { "id": "91a896f73c7948b8d19269a781cd19006c04540d", "index": 4, "content": [ { "type": "text", "value": [ { "text": "Vicedo-Cabrera, A. M., Tobias, A., Jaakkola, J. J., Honda, Y., Hashizume, M., Guo, Y., ... & Gasparrini, A. (2022). Global mortality burden attributable to non-optimal temperatures. Lancet, 399(10330), 1113.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "a96a6c8b0210715ccba31e21c6bc761596a59dc8": { "id": "a96a6c8b0210715ccba31e21c6bc761596a59dc8", "index": 5, "content": [ { "type": "text", "value": [ { "text": "Ballester, J., Quijal-Zamorano, M., M\u00e9ndez Turrubiates, R. F., Pegenaute, F., Herrmann, F. R., Robine, J. M., ... & Achebak, H. (2023). Heat-related mortality in Europe during the summer of 2022. Nature medicine, 29(7), 1857-1866.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "ae343333a844f4315fcc64793613a41d2c98f794": { "id": "ae343333a844f4315fcc64793613a41d2c98f794", "index": 1, "content": [ { "type": "text", "value": [ { "text": "As early as 2004, ", "spanType": "span-simple-text" }, { "url": "https://www.unisdr.org/files/1078_publication2004emdat.pdf", "children": [ { "text": "CRED authors", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " noted that the observed increase:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "\u201cmight lead one to believe that disasters occur more frequently today than at the beginning of the century. However, reaching such a conclusion based only on this graph would be incorrect. In fact, what the figure is really showing is the evolution of the registration of natural disaster events over time.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In ", "spanType": "span-simple-text" }, { "url": "https://dial.uclouvain.be/pr/boreal/object/boreal:178842", "children": [ { "text": "a 2008 paper", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ", CRED authors noted:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "\u201cIndeed, justifying the upward trend in hydro-meteorological disaster occurrence and impacts essentially through climate change would be misleading.\u2009[\u2026]\u2009one major contributor to the increase in disaster occurrence over the last decades is the constantly improving diffusion and accuracy of disaster-related information.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In ", "spanType": "span-simple-text" }, { "url": "https://www.cred.be/sites/default/files/The_Human_Cost_of_Natural_Disasters_CRED.pdf", "children": [ { "text": "its 2015 report", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ", CRED wrote:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "\u201cThe volume and quality of data about natural disasters increased enormously after 1960 when the US\u2019s OFDA (Office of U.S. Foreign Disaster Assistance) actively began to collect information about these events. The arrival of CRED in 1973 further improved data recording while the development of global telecommunications and the media, plus increased humanitarian funding and reinforced international cooperation also contributed to better reporting of disasters. Thus part of the apparent increase in the frequency of disasters in the past half-century is, no doubt, due to improved recording.\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "f111bd048e2fabc676192bb66e456aa10476ab99": { "id": "f111bd048e2fabc676192bb66e456aa10476ab99", "index": 2, "content": [ { "type": "text", "value": [ { "text": "Alimonti, G., & Mariani, L. (2024). Is the number of global natural disasters increasing? Environmental Hazards, 23(2), 186\u2013202.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "f722232fe54ce8d37d25d1a5f601c48bb19305b2": { "id": "f722232fe54ce8d37d25d1a5f601c48bb19305b2", "index": 0, "content": [ { "type": "text", "value": [ { "text": "In this case, the UNFCCC does mention \u201cimproved reporting\u201d. However, they don\u2019t stress the importance of it as the main factor contributing to the 5-fold increase in reported disasters.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] } } }, "type": "article", "title": "Is the number of natural disasters increasing?", "authors": [ "Hannah Ritchie", "Pablo Rosado" ], "excerpt": "A deep dive into missing data and the limitations of disaster databases.", "subtitle": "A deep dive into missing data and the limitations of disaster databases.", "featured-image": "number-disasters-featured-image.png" } |
1 | 2024-02-16 18:21:18 | 2024-06-03 10:04:00 | 2024-05-20 10:03:34 | listed | ALBJ4LvEaNBgJ94rUQfTVzdFoU3zF_H5PlQC1enL57OCC2TWOZAGFkm6lea8lzpybuy4sqs3dO_oLmoIkJ6OBg | If we want to reduce the risks of disasters, we need to track where they’re happening; what types of events they are; their human and economic impacts; and how these trends change over time. High-quality data helps us see patterns in the data on factors such as increased resilience, climate change, and humanitarian response. There are now several dedicated research groups that publish in-depth databases of disaster records. One of the most widely cited is the [International Disaster Database (EM-DAT) of the Centre for Research on the Epidemiology of Disasters (CRED)](https://www.emdat.be/). It is open-access and free and lets anyone dig into the specific details of each recorded disaster. At Our World in Data, we rely on EM-DAT as our main data source for disasters. It’s also used by organizations such as the United Nations, World Meteorological Organization, UNFCCC, and many academic researchers. But no disaster database is perfect. Data is incomplete. Its quality varies over time. And some events are either unreported or hard to quantify. That’s why it’s important to understand the biases and limitations of data sources so they can be interpreted in a useful way. Many of them are explained by EM-DAT itself in [its documentation](https://doc.emdat.be/docs/). In this article, we explore several of these biases, which can lead to incorrect conclusions when analyzing historical trends. # The increase in the number of disasters is partly a result of reporting bias EM-DAT publishes data on the number of events, deaths, numbers affected, and various other metrics since 1900. If you look at the chart of the _number_ of disasters over time — shown below — you see a very steep rise since the 1980s. <Chart url="https://ourworldindata.org/grapher/number-of-natural-disaster-events"/> Many — including organizations such as the United Nations and World Meteorological Organization — have reported on this as a dramatic rise in the number of actual disaster events. Here are a couple of high-profile examples: * [Food and Agriculture Organization of the United Nations (2023)](https://www.fao.org/3/cc7900en/cc7900en.pdf): “According to the International Disaster Database (EM-DAT) of the Centre for Research on the Epidemiology of Disasters (CRED), disaster events have increased from 100 per year in the 1970s to around 400 events per year worldwide in the past 20 years.” * [UN chief says natural disasters have quadrupled since 1970](https://gadebate.un.org/en/72/secretary-general-united-nations). This statement [was then reported](https://unfccc.int/news/un-chief-says-natural-disasters-have-quadrupled-since-1970) by the UNFCCC. * [World Meteorological Organization (2019)](https://library.wmo.int/viewer/57564), on page 16: “The number of disasters has increased by a factor of five over the 50-year period: whereas 711 disasters were recorded for 1970-1979, 3536 were recorded in 2000-2009.” * [UN Framework Convention on Climate Change (UNFCCC):](https://unfccc.int/news/climate-change-leads-to-more-extreme-weather-but-early-warnings-save-lives) “The number of disasters has increased by a factor of five over the 50-year period, driven by climate change, more extreme weather, and improved reporting.”1 * These points were repeated in leading media outlets such as the [BBC](https://www.bbc.co.uk/news/science-environment-65673961) and [The Economist](https://www.economist.com/graphic-detail/2017/08/29/weather-related-disasters-are-increasing). These points are correct regarding the number of _reported _disasters but are unlikely when it comes to the true number of events. EM-DAT — the data source that these reports rely on — says as much in [its limitations section](https://doc.emdat.be/docs/known-issues-and-limitations/): -- As it explains, CRED wasn’t created until 1973, when it started compiling data on disasters. It wasn’t until 1988 that it took over the disaster database and established EM-DAT. This period of trying to develop the first database over the 1970s and 1980s coincides with the steep rise in the number of reported disasters. EM-DAT also notes that over this period, communication technologies developed rapidly — most notably satellites, the Internet, and personal computers. This is likely to have caused a step-wise change in the frequency of reporting across the world. Several publications from CRED over the years warn about the overinterpretation of these trends.2 ## Many smaller events in the past aren’t captured At least some of the observed increase in the number of reported disasters since 1900 is likely to result from increased reporting. Many medium-to-large events can be found in historical records, but smaller events with less damage or fatalities are missing. In its 2004 report, [Thirty Years of Natural Disasters 1974-2003: The Numbers](https://www.unisdr.org/files/1078_publication2004emdat.pdf), CRED notes that historical data was based on retrospective analysis, resulting in: -- We’ve replicated this analysis with the latest data from EM-DAT in the chart below. It shows the share of reported disasters of different sizes as a share of the total. The further we go in the past, the more we see large events dominating the records. Small and medium events were missed at the time and are impossible to identify today. Every new decade, as reporting and communication improved, more small events made it into the reports. You can [also explore](https://ourworldindata.org/grapher/natural-disasters-by-yearly-impact) the annual data. <Chart url="https://ourworldindata.org/grapher/natural-disasters-by-decadal-size"/> There is more evidence for this in a [recent paper](https://www.tandfonline.com/doi/full/10.1080/17477891.2023.2239807) by Gianluca Alimonti and Luigi Mariani, published in _Environmental Hazards_.3 They analyzed the trends in the number of reported disasters in the EM-DAT database since 1900. They looked at the number of events over time at different thresholds of “recorded deaths”. So, the number of recorded events with deaths below 200, 500, 1,000, 2,000, and 5,000. They found that the trend for small events – with less than 200 deaths – increased greatly in the 1980s and 1990s. This suggests that small events are missing in earlier periods of the database, and only in the past 30 or 40 years have they been reported more consistently. The authors concluded that “the patterns observed are largely attributable to progressively better reporting of natural disaster events, with the EM-DAT dataset now regarded as relatively complete since ∼2000.” We replicated this analysis based on the latest data from EM-DAT. The only difference is that we did not include epidemics, to focus on meteorological, hydrological and geophysical events. The results are shown in the chart below. It mirrors the findings from Alimonti and Mariani, with a significant increase in the number of small events recorded. <Chart url="https://ourworldindata.org/grapher/natural-disasters-reported-by-deaths"/> ## We should be cautious about reporting increases in the number of disasters using EM-DAT EM-DAT itself [strongly recommends](https://doc.emdat.be/docs/known-issues-and-limitations/specific-biases/#time-bias) that users exclude or are cautious about interpreting trends using pre-2000 data because of this consistency issue. In fact, since September 2023, it has labeled all pre-2000 data as “Historic” to differentiate it from recent records — consistently with Alimonti and Mariani’s evaluation. If you look at data from 2000 onwards, there is no clear increase in the number of global disasters. To be clear: this does not mean that there is no increase in disasters, especially when looking at specific _types_ of events, or specific locations. To establish clear trends on this, people need to look at more focused academic literature. It may also be the case that other databases _do_ find an increase. But EM-DAT shouldn’t be used as evidence that there has been a four- or five-fold increase in the actual number of disasters globally. While there may be an increase, at least some of this is down to improvements in reporting. # There are large gaps in disaster statistics, especially for economic damages EM-DAT publishes a range of indicators: the estimated number of deaths, people left homeless, numbers affected, and economic damages. However, the completeness of this data varies. The metric where data is largely missing is economic damages. In [a paper](https://www.nature.com/articles/s41597-022-01667-x) published in _Nature Scientific Data_, Rebecca Jones et al. (2022) look at the share of disasters between 1990 and 2020 that have missing data.4 More than 40% of the events did not have estimated monetary damages. This was even worse for _insured_ damages, which were missing 88% of the time, and 96% had no records of reconstruction costs. Unsurprisingly, data coverage tended to be poorer in low-income countries where statistical capacity and reporting are more limited. From 2000 to 2019, only 13% of disasters in Africa and 23% in South Asia [reported any](https://www.cred.be/sites/default/files/CRED-Disaster-Report-Human-Cost2000-2019.pdf) economic losses. Data for total deaths appeared to be much more complete. The Jones et al. (2022) paper reported that just 1.3% of events did not have death estimates recorded. We tried to replicate these estimates using the [publicly available EM-DAT dataset](https://www.emdat.be/). A much higher share of events had no data (i.e. blanks) for recorded deaths: 30% at the time of publication. But, since events in EM-DAT with _zero_ deaths are also recorded as blanks, this estimate includes non-fatal events and those with genuine data gaps. It’s therefore difficult to give a concrete estimate for what share of events have real gaps in their death records. Users of EM-DAT data should be aware of these potential gaps in data coverage. Particularly for lower-income countries and for records from previous decades when reporting was much patchier. # Heat deaths are poorly captured One disaster category that is included in EM-DAT but is likely to be very patchy is extreme temperature. There are several reasons why. First, the inequalities in reporting on heatwaves across regions are stark. Many regions have poor data coverage, and Sub-Saharan Africa is almost completely overlooked. Over half of heat events in EM-DAT [were reported](https://doc.emdat.be/docs/known-issues-and-limitations/specific-biases/#geographic-biases) across only 9 countries: Japan, India, Pakistan, the United States, France, Belgium, the United Kingdom, Spain, and Germany. It’s highly unlikely that these are the only countries experiencing extreme heat events. Such events are just not being recorded or estimated in other regions. Second, proper quantification of the health effects of extreme temperatures is difficult. We often think about acute or very sudden deaths such as heat strokes. But most heat-related deaths come from an increase in the risk of less obvious conditions such as cardiovascular disease.5 These seemingly indirect deaths are not noted as being “heat-related” at the time and can only be estimated using various statistical methods later. This is true for both hot- and cold-related deaths. There is an emerging literature that tries to quantify heat-related mortality — with projections into the future — but heat deaths are not always captured (at least not fully) in disaster databases.6 We therefore suggest caution when using heat death figures. They are likely to be underestimates (for both cold- and heat-related deaths) with large inequalities as a result of reporting biases. # Failure to capture the indirect impacts of disasters Disasters often have near-term and acute impacts on human mortality, health, and infrastructure. But they can also lead to some indirect, medium to long-term impacts that are hard to capture. This is often the case for events such as droughts, where indirect impacts such as malnutrition, food insecurity, and potential impacts of water shortages are harder to quantify — especially in an ongoing or very recent event. This is explained in more detail in the UNDRR’s [Special Report on Drought 2021](https://www.undrr.org/publication/gar-special-report-drought-2021). Users should therefore be aware that disaster databases may fail to capture the full chain of disaster impacts. In this case, the UNFCCC does mention “improved reporting”. However, they don’t stress the importance of it as the main factor contributing to the 5-fold increase in reported disasters. As early as 2004, [CRED authors](https://www.unisdr.org/files/1078_publication2004emdat.pdf) noted that the observed increase: “might lead one to believe that disasters occur more frequently today than at the beginning of the century. However, reaching such a conclusion based only on this graph would be incorrect. In fact, what the figure is really showing is the evolution of the registration of natural disaster events over time.” In [a 2008 paper](https://dial.uclouvain.be/pr/boreal/object/boreal:178842), CRED authors noted: “Indeed, justifying the upward trend in hydro-meteorological disaster occurrence and impacts essentially through climate change would be misleading. […] one major contributor to the increase in disaster occurrence over the last decades is the constantly improving diffusion and accuracy of disaster-related information.” In [its 2015 report](https://www.cred.be/sites/default/files/The_Human_Cost_of_Natural_Disasters_CRED.pdf), CRED wrote: “The volume and quality of data about natural disasters increased enormously after 1960 when the US’s OFDA (Office of U.S. Foreign Disaster Assistance) actively began to collect information about these events. The arrival of CRED in 1973 further improved data recording while the development of global telecommunications and the media, plus increased humanitarian funding and reinforced international cooperation also contributed to better reporting of disasters. Thus part of the apparent increase in the frequency of disasters in the past half-century is, no doubt, due to improved recording.” Alimonti, G., & Mariani, L. (2024). Is the number of global natural disasters increasing? Environmental Hazards, 23(2), 186–202. Jones, R.L., Guha-Sapir, D. & Tubeuf, S. Human and economic impacts of natural disasters: can we trust the global data? Sci Data 9, 572 (2022). Vicedo-Cabrera, A. M., Tobias, A., Jaakkola, J. J., Honda, Y., Hashizume, M., Guo, Y., ... & Gasparrini, A. (2022). Global mortality burden attributable to non-optimal temperatures. Lancet, 399(10330), 1113. Ballester, J., Quijal-Zamorano, M., Méndez Turrubiates, R. F., Pegenaute, F., Herrmann, F. R., Robine, J. M., ... & Achebak, H. (2023). Heat-related mortality in Europe during the summer of 2022. Nature medicine, 29(7), 1857-1866. | Is the number of natural disasters increasing? |