posts_gdocs: 1vMsru_zjboUD_W5aBXoMKMMxCxqyJ4oYVCfchYBzDQM
Data license: CC-BY
This data as json
id | slug | type | content | published | createdAt | publishedAt | updatedAt | publicationContext | revisionId | breadcrumbs | markdown | title |
---|---|---|---|---|---|---|---|---|---|---|---|---|
1vMsru_zjboUD_W5aBXoMKMMxCxqyJ4oYVCfchYBzDQM | democracies-measurement | article | { "toc": [ { "slug": "how-do-approaches-work-to-make-assessments-valid", "text": "How do approaches work to make assessments valid?", "title": "How do approaches work to make assessments valid?", "supertitle": "", "isSubheading": false }, { "slug": "how-do-approaches-work-to-make-assessments-precise", "text": "How do approaches work to make assessments precise?", "title": "How do approaches work to make assessments precise?", "supertitle": "", "isSubheading": false }, { "slug": "how-do-approaches-work-to-make-assessments-comparable", "text": "How do approaches work to make assessments comparable?", "title": "How do approaches work to make assessments comparable?", "supertitle": "", "isSubheading": false }, { "slug": "how-are-remaining-differences-dealt-with", "text": "How are remaining differences dealt with?", "title": "How are remaining differences dealt with?", "supertitle": "", "isSubheading": false }, { "slug": "how-do-approaches-work-to-make-data-accessible-and-transparent", "text": "How do approaches work to make data accessible and transparent?", "title": "How do approaches work to make data accessible and transparent?", "supertitle": "", "isSubheading": false }, { "slug": "keep-reading-at-our-world-in-data", "text": "Keep reading at Our World in Data", "title": "Keep reading at Our World in Data", "supertitle": "", "isSubheading": false }, { "slug": "acknowledgements", "text": "Acknowledgements", "title": "Acknowledgements", "supertitle": "", "isSubheading": false }, { "slug": "varieties-of-democracy", "text": "Varieties of Democracy", "title": "Varieties of Democracy", "supertitle": "", "isSubheading": false }, { "slug": "spectrums", "text": "Spectrums", "title": "Spectrums", "supertitle": "", "isSubheading": true }, { "slug": "regimes-of-the-world", "text": "Regimes of the World", "title": "Regimes of the World", "supertitle": "", "isSubheading": false }, { "slug": "classification", "text": "Classification", "title": "Classification", "supertitle": "", "isSubheading": true }, { "slug": "lexical-index-of-electoral-democracy", "text": "Lexical Index of Electoral Democracy", "title": "Lexical Index of Electoral Democracy", "supertitle": "", "isSubheading": false }, { "slug": "spectrum-and-classification", "text": "Spectrum and classification", "title": "Spectrum and classification", "supertitle": "", "isSubheading": true }, { "slug": "boix-miller-rosato-bmr", "text": "Boix-Miller-Rosato (BMR)", "title": "Boix-Miller-Rosato (BMR)", "supertitle": "", "isSubheading": false }, { "slug": "classifications", "text": "Classifications", "title": "Classifications", "supertitle": "", "isSubheading": true }, { "slug": "polity", "text": "Polity", "title": "Polity", "supertitle": "", "isSubheading": false }, { "slug": "spectrum-and-classification", "text": "Spectrum and classification", "title": "Spectrum and classification", "supertitle": "", "isSubheading": true }, { "slug": "freedom-in-the-world", "text": "Freedom in the World", "title": "Freedom in the World", "supertitle": "", "isSubheading": false }, { "slug": "classification-1", "text": "Classification 1", "title": "Classification 1", "supertitle": "", "isSubheading": true }, { "slug": "classification-2", "text": "Classification 2", "title": "Classification 2", "supertitle": "", "isSubheading": true }, { "slug": "bertelsmann-transformation-index-bti", "text": "Bertelsmann Transformation Index (BTI)", "title": "Bertelsmann Transformation Index (BTI)", "supertitle": "", "isSubheading": false }, { "slug": "spectrum", "text": "Spectrum", "title": "Spectrum", "supertitle": "", "isSubheading": true }, { "slug": "classification", "text": "Classification", "title": "Classification", "supertitle": "", "isSubheading": true }, { "slug": "economist-intelligence-unit-eiu", "text": "Economist Intelligence Unit (EIU)", "title": "Economist Intelligence Unit (EIU)", "supertitle": "", "isSubheading": false }, { "slug": "spectrum", "text": "Spectrum:", "title": "Spectrum:", "supertitle": "", "isSubheading": true }, { "slug": "classification", "text": "Classification", "title": "Classification", "supertitle": "", "isSubheading": true } ], "body": [ { "type": "text", "value": [ { "text": "Measuring the state of democracy across the world helps us understand the extent to which people have political rights and freedoms.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But measuring how democratic a country is, comes with many challenges. People do not always agree on what characteristics define a democracy. These characteristics \u2014 such as whether an election was free and fair \u2014 even once defined, are difficult to assess. The judgement of experts is to some degree subjective and they may disagree; either about a specific characteristic, or how several characteristics can be reduced into a single measure of democracy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "So how do researchers address these challenges and identify which countries are democratic and undemocratic?", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In our work on ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/democracy", "children": [ { "text": "Democracy", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ", we provide data from eight leading approaches of measuring democracy:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "url": "https://www.v-dem.net/vdemds.html", "children": [ { "text": "Varieties of Democracy (V-Dem)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by the V-Dem project", "spanType": "span-simple-text" }, { "url": "#note-1", "children": [ { "children": [ { "text": "1", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://www.v-dem.net/vdemds.html", "children": [ { "text": "Regimes of the World (RoW)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by L\u00fchrmann et al. (2018)", "spanType": "span-simple-text" }, { "url": "#note-2", "children": [ { "children": [ { "text": "2", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" }, { "text": ", which use V-Dem data", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/WPKNIT", "children": [ { "text": "Lexical Index of Electoral Democracy (LIED)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by Skaaning et al. (2015)", "spanType": "span-simple-text" }, { "url": "#note-3", "children": [ { "children": [ { "text": "3", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://sites.google.com/site/mkmtwo/data?authuser=0", "children": [ { "text": "Boix-Miller-Rosato", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by Boix et al. (2013, BMR)", "spanType": "span-simple-text" }, { "url": "#note-4", "children": [ { "children": [ { "text": "4", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://www.systemicpeace.org/inscrdata.html", "children": [ { "text": "Polity", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by the Center for Systemic Peace", "spanType": "span-simple-text" }, { "url": "#note-5", "children": [ { "children": [ { "text": "5", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Freedom House\u2019s (FH) ", "spanType": "span-simple-text" }, { "url": "https://freedomhouse.org/report/freedom-world", "children": [ { "text": "Freedom in the World", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "url": "#note-6", "children": [ { "children": [ { "text": "6", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "url": "https://bti-project.org/en/downloads", "children": [ { "text": "Bertelsmann Transformation Index (BTI)", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by the Bertelsmann Foundation", "spanType": "span-simple-text" }, { "url": "#note-7", "children": [ { "children": [ { "text": "7", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Economist Intelligence Unit\u2019s (EIU) ", "spanType": "span-simple-text" }, { "url": "https://www.eiu.com/n/campaigns/democracy-index-2021/?utm_source=eiu-website&utm_medium=blog&utm_campaign=democracy-index-2021", "children": [ { "text": "Democracy Index", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "url": "#note-8", "children": [ { "children": [ { "text": "8", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "These approaches all measure democracy (or a closely related aspect), they cover many countries and years, and are commonly used by researchers and policymakers.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "You can delve into their data \u2014 the main democracy measures, indicators of specific characteristics, and global and regional overviews \u2014\u00a0 in our ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/explorers/democracy", "children": [ { "text": "Democracy Data Explorer", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Reassuringly, the approaches typically agree about big differences in countries\u2019 political institutions: they readily distinguish between highly democratic countries, such as Chile and Norway, and highly undemocratic countries, such as North Korea and Saudi Arabia.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But they do not always agree. They come to different assessments about which of the two highly democratic countries \u2013 Chile and Norway \u2013 is more democratic, and whether Chile is more or less democratic than it was ten years ago. At times they come to strikingly different conclusions about countries that are neither highly democratic nor highly undemocratic, such as Nigeria today or the United States in the 19th century.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Why do these measures sometimes reach such different conclusions? In this article I summarize the key similarities and differences of these approaches, and discuss when each source is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "How is democracy characterized?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "In this and the following tables I summarize how each approach defines and scores democracy, and what coverage each approach provides.", "spanType": "span-simple-text" }, { "url": "#note-9", "children": [ { "children": [ { "text": "9", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Narrow and broader: electoral, liberal, participatory, deliberative, or egalitarian democracy</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Narrow: electoral or liberal democracy</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Narrow: electoral (or liberal) democracy</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Narrow: electoral democracy</li></ul></td></tr><tr><td>Polity</td><td><ul><li>\tNarrow: electoral and liberal democracy</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Narrow: electoral or liberal democracy</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Broad: electoral, liberal, participatory, deliberative, and effective democracy</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Broad: electoral, liberal, participatory, deliberative, and effective democracy</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "We see that the approaches share a basic principle of democracy: a democracy is an electoral political system in which citizens get to participate in free and fair elections. The approaches also mostly agree that democracies are liberal political systems, in which citizens have additional civil rights and are protected from the state by constraining it.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Some approaches stop there, and stick to these narrower conceptions of democracy. Others characterize democracy in broader terms, and also see it as a participatory and deliberative (citizens engage in elections, civil society, and public discourse) as well as an effective (governments can act on citizens\u2019 behalf) political system.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Varieties of Democracy \u2014 true to its name \u2014 offers both narrow and broader characterizations, by separately adding liberal, participatory, deliberative, as well as egalitarian (economic and social resources are equally distributed) political institutions to electoral democracy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "How is democracy scored?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches also differ in how they ", "spanType": "span-simple-text" }, { "children": [ { "text": "score", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": " democracy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>On a spectrum: 0 to 1, highly undemocratic to highly democratic</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>As a classification: closed autocracy < electoral autocracy < electoral democracy < liberal democracy</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>As a classification: non-electoral autocracy < one-party autocracy < multi-party autocracy without elected executive < multi-party autocracy < exclusive democracy < male democracy < electoral democracy < polyarchy</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>As a classification: non-democracy < democracy</li></ul></td></tr><tr><td>Polity</td><td><ul><li>On a spectrum: -10 to 10, hereditary monarchy to consolidated democracy</li><li>classification: autocracy < anocracy < democracy</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>As a classification; classification 1: not free < partly free < free</li><li>classification 2: non-democracy < electoral democracy</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>On a spectrum: 1 to 10, highly undemocratic to highly democratic</li><li>classification: hard-line autocracy < moderate autocracy < very defective democracy < defective democracy < consolidating democracy</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>On a spectrum: 0 to 10, highly undemocratic to 10 highly democratic</li><li>classification: authoritarian regime < hybrid regime < flawed democracy < full democracy</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem treats democracy as a ", "spanType": "span-simple-text" }, { "children": [ { "text": "spectrum", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ", with some countries being scored as more democratic than others.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Other approaches instead treat democracy as a binary, and ", "spanType": "span-simple-text" }, { "children": [ { "text": "classify", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": " a country as either a democracy or not.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "A final group ", "spanType": "span-simple-text" }, { "children": [ { "text": "does both", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ", using a spectrum of countries being more or less democratic, and setting thresholds above which a country is considered a democracy overall.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Approaches that classify countries into democracies and non-democracies further differ in whether all countries that are not democracies are considered autocracies or authoritarian regimes, or whether there are some countries that do not clearly belong in either group.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "And while Freedom in the World identifies which countries are electoral democracies in recent years, its main classification distinguishes between free, partly-free, and not-free countries (which many treat as a proxy for liberal democracy).", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Beyond these broad similarities in how the approaches characterize and score democracy, their exact definitions differ in smaller ways, too. If you are interested in the details, you can take a closer look at the specific defining characteristics at the end of this article.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "What differences are captured?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "How the approaches score democracy affects what differences in democracy they can capture.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>\tBig to very small differences</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Big differences, with clear meaning</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Big to medium differences, with very clear meaning</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Big differences, with clear meaning</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Big to medium differences</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Big differences</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Big to small differences</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Big to small differences</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "Classifications tend to be coarser, and therefore cover big to medium differences in democracy: they reduce the complexity of political systems a lot and distinguish between broad types, such as the democracies of Chile and Norway on the one hand, and the non-democracies of North Korea and Saudi Arabia, on the other.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The fine-grained spectrums of other approaches meanwhile reduce political systems\u2019 complexity a bit less, and capture both big and small differences in democracy, such as the difference in democratic quality between the democracies Chile and Norway, and the difference between autocracies North Korea and Saudi Arabia. Spectrums can also better capture small changes within political systems over time, towards or away from democracy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "While some approaches use their classifications exclusively to reduce the complexity of their spectrums, others also use theirs to clearly define what features characterize each category.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "What years and countries are covered?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches also differ in what years and countries they cover.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Years since 1789</li><li>202 countries, also non-independent</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Years since 1789</li><li>202 countries, also non-independent</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Years since 1789</li><li>242 countries, also non-independent and microstates</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Years since 1800</li><li>218 countries, also microstates</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Years 1800 \u2014 2018</li><li>192 countries</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Years since 1972</li><li>229 countries and territories, also microentities</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Years since 2005</li><li>138 countries and territories, no consolidated democracies</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Years since 2006</li><li>167 countries</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "All approaches cover the recent past, but differ in how far they go back in time. BTI and EIU begin in the mid-2000s. Freedom in the World starts in the early 1970s. The other approaches go back to the beginning of the 19th century or even the late 18th century. The Regimes of the World data we ourselves extended ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/regimes-of-the-world-data", "children": [ { "text": "back from 1900", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "All approaches cover most countries in the world. They differ in how comprehensive their coverage is: BTI excludes long-term members of the OECD (which it considers consolidated democracies), while all other approaches assess them. Some approaches also include very small states and territories, and some also assess many non-independent countries, usually colonies.", "spanType": "span-simple-text" }, { "url": "#note-10", "children": [ { "children": [ { "text": "10", "spanType": "span-simple-text" } ], "spanType": "span-superscript" } ], "spanType": "span-ref" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "How are democracy\u2019s characteristics assessed?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches also differ in how they go about assessing the characteristics of democracy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Mostly through evaluations by experts; some easy-to-observe characteristics assessed by own researchers</li><li>Then weighting, adding, and multiplying scores for (sub)characteristics</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Mostly through evaluations by experts; some easy-to-observe characteristics assessed by own researchers</li><li>Then evaluating whether necessary characteristics are (not) present</li><li>Then weighting, adding, and multiplying scores for a few characteristics</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Mostly with easy-to-observe characteristics, few evaluations by own researchers based on academic research</li><li>Then evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Mostly with easy-to-observe characteristics, few evaluations by own researchers based on academic literature</li><li>Then evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Mostly through evaluations by own researchers based on academic literature and news reports</li><li>Then weighting and adding scores for characteristics</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Mostly through evaluations by country and regional experts and own researchers based on different types of sources</li><li>Free countries: then adding scores for (sub)characteristics</li><li>Electoral democracies: then adding scores and evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Mostly through evaluations by country, regional, and general experts, some evaluations by representative surveys of regular citizens</li><li>Spectrum: then averaging of scores for (sub)characteristics</li><li>Classification: then averaging and evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Mostly through evaluations by own country experts, some evaluations by representative surveys of regular citizens</li><li>Then averaging and minor weighting of scores for (sub)characteristics</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "Many rely on evaluations to assess democratic characteristics that are difficult to observe, such as whether elections were competitive and people were free to express their views.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Some rely on evaluations by country experts to assess whether, or to which extent, democracy\u2019s characteristics are present (or not) in any given country and year. Others depend on evaluations by their own researchers reviewing the academic literature and news reports. And many use both country experts and their own teams.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "A few additionally incorporate some representative surveys of regular citizens.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The Lexical Index and the Boix-Miller-Rosato data meanwhile work to avoid difficult evaluations by either experts or researchers, and mostly have their own teams assess easy-to-observe characteristics \u2014 such as whether regular elections are held and several parties compete in them \u2014 to identify (non-)democracies.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Depending on whether they score democracy as a spectrum or classification, the approaches then aggregate the scores for specific characteristics: some average, add, and/or weigh the scores, others assess whether necessary characteristics are present, and a few do both.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "How do approaches work to make assessments valid?", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The next tables summarize how the approaches address the challenges that come with measuring democracy. The first challenge is to make their assessments valid \u2014 to actually measure what they want to capture.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Experts (often nationals or residents) know country and characteristics well, own researchers know measurement procedures well</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Experts (often nationals or residents) know country and characteristics well, own researchers know measurement procedures well</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Own researchers know measurement procedures well</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Own researchers know measurement procedures well</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Own researchers know measurement well</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Experts know country or region well, own researchers know measurement well</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Experts (about half of them local) know country well, regular citizens know their own experiences well</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Experts know country or region well, regular citizens know their own experiences well</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches go about measuring democracy differently because they weigh the challenges of measurement differently.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "For those mostly relying on experts, the priority is that democracy\u2019s characteristics are evaluated by people that know the country well. For those relying on their own researchers, the priority is that the coders know the approach\u2019s characterization of democracy and the measurement procedures well. And for those relying on representative surveys, capturing the difficult-to-observe lived realities of regular citizens is especially important.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "How do approaches work to make assessments precise?", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches are also concerned with making their assessments in a precise and reliable manner.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Several experts per country, year, and characteristic used (usually 5 or more since 1900, often 25 per country)</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Several experts per country, year, and characteristic used (usually 5 or more since 1900, often 25 per country)</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Characteristics easy to understand and observe; subjective evaluation therefore mostly unnecessary</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>\tCharacteristics easy to understand and observe; subjective evaluation therefore mostly unnecessary</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Several researchers used</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>More than 100 experts and researchers used in total; Experts and researchers rely on academic research, news and NGO reports, personal conversations, and on-the-ground research</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Two experts per country and year used</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>One or two experts per country and year used</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "Expert-based approaches therefore often recruit many experts in total, several experts per country, or even several to many experts per country, year and characteristic.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Own-researcher-based approaches instead either focus more on making difficult subjective evaluation mostly unnecessary, or encourage their teams to rely on many different secondary sources, such as country-specific academic research, news reports, and personal conversations.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "How do approaches work to make assessments comparable?", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches also face the challenge of how to make the coders\u2019 respective assessments comparable across countries and time.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Experts answer very specific questions about sub-characteristics on completely explained scale</li><li>Experts also code hypothetical countries and many code several countries, denote own uncertainty and personal demographic information</li><li>Project investigated expert biases and found them to be limited</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Experts answer very specific questions about sub-characteristics on completely explained scale</li><li>Experts also code hypothetical examples and many code several countries, denote own uncertainty and personal attributes</li><li>Project investigated expert biases and found them to be limited</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Researchers answer specific questions about characteristics on explained scale</li><li>Same researcher assesses all countries and years</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Same researcher assesses all countries and years</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Experts answer specific questions about characteristics on completely explained scale</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Experts answer questions about characteristics separately</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Experts answer specific questions about sub-characteristics on explained scale</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Experts answer specific questions about sub-characteristics on completely explained scale</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "The surveys therefore ask the experts questions about specific characteristics of democracy, such as the presence or absence of election fraud, instead of making them rely on their broad impressions. They also explain the scales on which the characteristics are scored, and often all of the scales\u2019 values.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Measuring many specific low-level characteristics also helps users understand why a country received a specific score, and it allows them to create new measures tailored to their own interests.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "How are remaining differences dealt with?", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "The approaches then all work to address any remaining differences between coders, even if they do so differently.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Measurement model uses main and additional information and provides estimates of remaining measurement uncertainty</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Measurement model uses main and additional information and provides estimates of remaining measurement uncertainty</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>One primary coder, so no differences between coders to be reconciled</li><li>Second researcher for some countries reproduced most assessments</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>One primary coder, so no differences between coders to be reconciled</li><li>For recent years discussions among researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Discussions among researchers reconcile different standards across coders, countries, and years</li><li>Separate researcher teams for some countries and years reproduced most assessments</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Discussions among experts and researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Discussions among regional and general experts and own researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Discussions among experts and researchers reconcile different standards across coders, countries, and years</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem and RoW work with a statistical model which uses the experts\u2019 ratings of actual countries and hypothetical country examples, as well as the experts\u2019 stated uncertainties and personal demographics to produce both best and upper- and lower-bound estimates of many characteristics.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "They thereby avoid forcing themselves to eliminate all uncertainty and thereby possibly biasing their scores, and acknowledge that its coders make errors. This also recognizes that small differences in democracy on fine-grained spectrums may actually not exist, or be reversed, because measurement is uncertain.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Most other approaches go about it differently, and have researchers and experts discuss differing scores to reconcile them. This adds an additional step to make the assessments comparable across coders, countries, and years.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "And while it uses discussions, Freedom in the World still acknowledges that it refined its approach over time, which makes its scores not as readily comparable: they work best for comparing different countries at the same time, or comparing the same country over the course of a few years.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The Lexical Index and Polity meanwhile do not have several coders per country and year, but they still worked to assess coding differences by once having its researchers rate some countries independently and compare their results. Reassuringly, they found that they came to similar conclusions.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "text": "How do approaches work to make data accessible and transparent?", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "Finally, the approaches all take steps to make their data accessible and the underlying measurement transparent.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "html", "value": "<table class=\"html-table\"><tr><td>Varieties of Democracy</td><td><ul><li>Provides data for sub-indices and several hundred specific questions by country-year, country-date, and coder</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination in detail</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Provides data for sub-indices and several hundred specific questions by country-year, country-date, and coder</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Provides disaggregated data for specific questions by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies in detail democracy characteristics and their combination</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Provides data by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Provides disaggregated data for sub-indices and specific questions by country-year</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Provides recent disaggregated data for sub-indices and specific questions by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Provides disaggregated data for sub-indices and specific questions by country-year</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Provides disaggregated data for sub-indices by country-year</li><li>Questions and coding procedures are available</li><li>Justifies democracy characteristics</li></ul></td></tr></table>", "parseErrors": [] }, { "type": "text", "value": [ { "text": "All approaches publicly release their data and almost all make the data straightforward to download and use. Most approaches release not only the overall classification and scores, but also the underlying (sub)characteristics. V-Dem even releases the data coded by each (anonymous) expert.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Almost all release descriptions of how they characterize democracy, as well as the questions and coding procedures guiding the experts and researchers. V-Dem again stands out here for its very detailed descriptions that also discuss why it weighs, adds, and multiplies the scores for specific characteristics.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Polity, Freedom in the World, and BTI meanwhile provide additional helpful information by explaining their quantitative scores in country reports that discuss influential events.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "horizontal-rule", "value": {}, "parseErrors": [] }, { "text": [ { "text": "The best democracy measure depends on your questions", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "type": "text", "value": [ { "text": "There is no single \u2018best\u2019 approach to measuring democracy. Conceptions of democracy are too different, and the challenges of measurement are too diverse for that. All of the approaches put a lot of effort into measuring democracy in ways that are useful to researchers, policymakers, and interested citizens.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The most appropriate democracy measure depends on what question you want to answer. It is the one that captures the characteristics of democracy and the countries and years you are interested in.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you are interested in big and small differences in varieties of democracy, far into the past, and want to use country experts to measure characteristics of political systems that are difficult to observe, the Varieties of Democracy data is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you are instead interested in big differences in political regimes over the last two hundred years, and want to use the knowledge of country experts, the Regimes of the World data is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you rather want to explore medium differences in political regimes, especially in the 19th and earlier 20th century, and want to rely more on characteristics that are easier to observe, the Lexical Index ist best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "And if you want to study big differences in political regimes, drawing on easier-to-observe features of political systems, the Boix-Miller-Rosato data is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you instead want to explore the source that was researchers\u2019 go-to for democracy for a long time, and are fine with its less precise data, Polity is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you especially care about the political and civil freedoms that democracy grants, Freedom House is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you value a broad understanding of democracy that encompasses its electoral, liberal, participatory, deliberative, and effective dimensions, then the Bertelsmann Transformation Index is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "And if you want to use a broad understanding of democracy to study it both in countries where it is older and those in which it is young or absent, then the Economist Intelligence Unit is best.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Even if you have a preferred source, it can still be useful to see what other sources show and where they agree and differ.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "This means that having several approaches to measuring democracy is not a flaw, but a strength: it gives us different tools to understand the past spread, current state, and possible future of democracy around the world.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "If you want to explore the data that each of these datasets produce, you can do so in our ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/explorers/democracy", "children": [ { "text": "Democracy Data Explorer", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "And if you want to compare the sources directly, you can do so in these charts:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "left": [ { "url": "https://ourworldindata.org/grapher/democracy-index-by-source", "type": "chart", "parseErrors": [] } ], "type": "side-by-side", "right": [ { "url": "https://ourworldindata.org/grapher/political-regime-classification-by-source", "type": "chart", "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Keep reading at ", "spanType": "span-simple-text" }, { "children": [ { "text": "Our World in Data", "spanType": "span-simple-text" } ], "spanType": "span-italic" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "url": "https://ourworldindata.org/explorers/democracy", "type": "prominent-link", "title": "Democracy Data Explorer", "thumbnail": "democracy-data-how-do-reasearchers-measure-democracy-featured-image.png", "description": "Explore the world\u2019s political systems with the leading approaches of measuring democracy.", "parseErrors": [] }, { "url": "https://docs.google.com/document/d/1xO9wHbwM5LKlGFbHyet3CLmiqnI3ZOHS8V3P_81Itf4/edit", "type": "prominent-link", "parseErrors": [] }, { "url": "https://docs.google.com/document/d/14zTYMg-mkPcMC68DqgQNb1eAe8VBwoD93yzyKGIeguw/edit", "type": "prominent-link", "parseErrors": [] }, { "url": "https://docs.google.com/document/d/14ThFloGyQv4uSGdEeZROWq_2yvHC9ggnAFij_9Oyz6g/edit", "type": "prominent-link", "parseErrors": [] }, { "text": [ { "text": "Acknowledgements", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "I thank Daniel Bachler, Hauke Hartmann, Joan Hoey, Staffan Lindberg, Michael K. Miller, Hannah Ritchie, Max Roser, and Svend-Erik Skaaning for reading drafts of this text and their very helpful comments.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "expandable-paragraph", "items": [ { "text": [ { "text": "What are democracy's specific characteristics?", "spanType": "span-simple-text" } ], "type": "heading", "level": 1, "parseErrors": [] }, { "text": [ { "text": "Varieties of Democracy", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Spectrums", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "electoral democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": extent to which political leaders are elected in free and fair elections under comprehensive voting rights and freedoms of association and expression", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "liberal democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": electoral democracy and extent to which citizens have individual and minority rights, are equal before the law, and the actions of the executive are constrained by the legislative and the courts", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "participatory democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": electoral democracy and extent to which citizens can engage in civil society organizations and direct democracy", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "deliberative democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": electoral democracy and extent to which citizens and leaders discuss different views and seek public good", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "egalitarian democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": electoral democracy and extent to which economic and social resources are distributed equally", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Regimes of the World", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Classification", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "closed autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens do not have the right to choose either the chief executive of the government or the legislature through multi-party elections", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "electoral autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature through multi-party elections; but they lack some freedoms, such as the freedoms of association or expression that make the elections meaningful, free, and fair", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "electoral democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature in meaningful, free and fair, and multi-party elections", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "liberal democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": electoral democracy and citizens enjoy individual and minority rights, are equal before the law, and the actions of the executive are constrained by the legislative and the courts", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Lexical Index of Electoral Democracy", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Spectrum and classification", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "non-electoral autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens do not have the right to elect the chief executive or the legislature", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "one-party autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": some citizens have the right to choose the chief executive or the legislature, but only have one choice", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "multiparty autocracy without elected executive", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": some citizens have the right to choose the legislature and have more than one choice, but chief executive not elected", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "multiparty autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": some citizens have the right to choose the chief executive and the legislature and have more than one choice, but election outcome is certain", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "exclusive democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, but suffrage is restricted", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "male democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, but suffrage is restricted to men", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "electoral democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "polyarchy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, and enjoy freedoms of expression, assembly, and association", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Boix-Miller-Rosato (BMR)", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Classifications", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": a majority of adult men have the right to choose the chief executive and the legislature in free and fair elections", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "democracy with women's suffrage", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": a majority of adult men and women have the right to choose the chief executive and the legislature in free and fair elections", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Polity", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Spectrum and classification", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "full/consolidated democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": open, multi-party, and competitive elections choose chief executive, who faces comprehensive institutional constraints, and political participation is competitive", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": mostly democratic characteristics", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "anocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": neither clearly democratic nor autocratic characteristics", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": mostly autocratic characteristics", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "full autocracy/hereditary monarchy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": hereditary succession chooses chief executive who faces no institutional constraints, and political participation is restricted and suppressed", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Freedom in the World", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Classification 1", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "free country", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have many political rights (free and fair elections, political pluralism and participation, functioning government) and civil liberties (freedoms of expression and association, rule of law, personal autonomy)", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "partly free country", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have some political rights and civil liberties", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "not free country", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have few political rights and civil liberties", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Classification 2", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "electoral democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": citizens have the right to choose chief executive and legislature in broadly free and fair elections and have substantial other political rights and civil liberties", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Bertelsmann Transformation Index (BTI)", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Spectrum", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "democratic features", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": extent of political participation, the rule of law, stable democratic institutions, political and social integration, and a capable state", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Classification", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "consolidating democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": comprehensive democratic features and minimum democratic characteristics (citizens can choose political leaders in free and fair elections and enjoy freedoms of association, expression and some further civil liberties, political power is separated, and leaders can effectively govern a state that fulfils basic functions)", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "defective democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": minimum democratic characteristics, but limited other democratic features", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "very defective democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": minimum democratic characteristics, but very limited other democratic features", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "moderate autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": no minimum democratic characteristics, but possibly other broadly democratic features", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "hard-line autocracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": no minimum democratic characteristics, and few other democratic features", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Economist Intelligence Unit (EIU)", "spanType": "span-simple-text" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "text": "Spectrum:", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": extent to which citizens can choose their political leaders in free and fair elections, enjoy civil liberties, prefer democracy over other political systems, can and do participate in politics, and have a functioning government that acts on their behalf", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "text": "Classification", "spanType": "span-simple-text" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "full democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": comprehensive extent of democracy, few weaknesses", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "flawed democracy", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": some weaknesses in democratic institutions and culture", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "hybrid regime", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": serious weaknesses in democratic institutions and culture", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "authoritarian regime", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": few democratic institutions and little democratic culture", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] } ], "parseErrors": [] } ], "refs": { "errors": [], "definitions": { "26b9873719c5200f632b509e6cfa837a0ebfe3ba": { "id": "26b9873719c5200f632b509e6cfa837a0ebfe3ba", "index": 3, "content": [ { "type": "text", "value": [ { "text": "Boix, Carles, Michael Miller, and Sebastian Rosato. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Boix%2C+Carles%2C+Michael+Miller%2C+and+Sebastian+Rosato.+A+Complete+Data+Set+of+Political+Regimes%2C+1800%E2%80%932007.+Comparative+Political+Studies+46%2812%29%3A1523-1554.&btnG=", "children": [ { "text": "A Complete Data Set of Political Regimes, 1800\u20132007", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Comparative Political Studies 46(12):1523-1554.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "32b4f478b88e71384fc285f380eab877646949d0": { "id": "32b4f478b88e71384fc285f380eab877646949d0", "index": 4, "content": [ { "type": "text", "value": [ { "text": "Marshall, Monty G. and Ted Robert Gurr. 2021. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Marshall%2C+Monty+G.+and+Ted+Robert+Gurr.+2021.+Polity+5%3A+Political+Regime+Characteristics+and+Transitions%2C+1800-2018.+Center+for+Systemic+Peace&btnG=", "children": [ { "text": "Polity 5: Political Regime Characteristics and Transitions, 1800-2018", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Center for Systemic Peace.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "3346a8c66328dc3f645a59ad38849e9cacb908ea": { "id": "3346a8c66328dc3f645a59ad38849e9cacb908ea", "index": 9, "content": [ { "type": "text", "value": [ { "text": "To cover even more of today\u2019s countries when they were still non-sovereign territories we further identified for V-Dem, RoW and slightly for Boix-Miller-Rosato the historical entity the territories were a part of and used that regime\u2019s data whenever available.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "7a2024a388937763d52582bfb4b189833d3d7b39": { "id": "7a2024a388937763d52582bfb4b189833d3d7b39", "index": 7, "content": [ { "type": "text", "value": [ { "text": "Economist Intelligence Unit. 2023. ", "spanType": "span-simple-text" }, { "url": "https://www.eiu.com/n/campaigns/democracy-index-2022/", "children": [ { "text": "Democracy Index 2022: Frontline democracy and the battle for Ukraine.", "spanType": "span-simple-text" } ], "spanType": "span-link" } ], "parseErrors": [] } ], "parseErrors": [] }, "9bb3abe48bf48caad9572b129881e920df4814a5": { "id": "9bb3abe48bf48caad9572b129881e920df4814a5", "index": 1, "content": [ { "type": "text", "value": [ { "text": "L\u00fchrmann, Anna, Marcus Tannnberg, and Staffan Lindberg. 2018. Regimes of the World (RoW): ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=L%C3%BChrmann%2C+Anna%2C+Marcus+Tannnberg%2C+and+Staffan+Lindberg.+2018.+Regimes+of+the+World+%28RoW%29%3A+Opening+New+Avenues+for+the+Comparative+Study+of+Political+Regimes.+Politics+and+Governance+6%281%29%3A+60-77.%7B%2Fref%7D&btnG=", "children": [ { "text": "Opening New Avenues for the Comparative Study of Political Regimes", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Politics and Governance 6(1): 60-77.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "a12d127abf5ab33ac70573cc3950d2ba05796596": { "id": "a12d127abf5ab33ac70573cc3950d2ba05796596", "index": 5, "content": [ { "type": "text", "value": [ { "text": "Freedom House. 2022. ", "spanType": "span-simple-text" }, { "url": "https://freedomhouse.org/report/freedom-world", "children": [ { "text": "Freedom in the world 2022", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "b4fa629301a7eb793dcb37d9a1f911ecb2540b46": { "id": "b4fa629301a7eb793dcb37d9a1f911ecb2540b46", "index": 8, "content": [ { "type": "text", "value": [ { "text": "This article draws on several very helpful other articles summarizing and reviewing some of the datasets, as well as the datasets\u2019 own codebooks and descriptions:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Bertelsmann Foundation. 2022. ", "spanType": "span-simple-text" }, { "url": "http://web.archive.org/web/20220404134021/https://bti-project.org/fileadmin/api/content/en/downloads/data/BTI_2022_Codebook_for_Stata.pdf", "children": [ { "text": "BTI Codebook for Stata", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Boese, Vanessa. 2019. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Boese%2C+Vanessa.+2019.+How+%28not%29+to+measure+democracy.+International+Area+Studies+Review+22%282%29%3A+95-127&btnG=", "children": [ { "text": "How (not) to measure democracy", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". International Area Studies Review 22(2): 95-127.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Boix, Carles, Michael K. Miller, and Sebastian Rosato. 2022. ", "spanType": "span-simple-text" }, { "url": "https://sites.google.com/site/mkmtwo/data?authuser=0", "children": [ { "text": "Boix-Miller-Rosato (BMR) Dichotomous Coding of Democracy, Version 4.0 (1800-2020) Codebook", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerl\u00f8w, Adam Glynn, Sandra Grahn, Allen Hicken, Katrin Kinzelbach, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Pamela Paxton, Daniel Pemstein, Johannes von R\u00f6mer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Eitan Tzelgov, Luca Uberti, Yi-ting Wang, Tore Wig, and Daniel Ziblatt. 2022. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Katrin+Kinzelbach%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Eitan+Tzelgov%2C+Luca+Uberti%2C+Yi-ting+Wang%2C+Tore+Wig%2C+and+Daniel+Ziblatt.+2022.+V-Dem+Codebook+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=", "children": [ { "text": "V-Dem Codebook v12", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Varieties of Democracy (V-Dem) Project.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Coppedge, Michael, John Gerring, Staffan I. Lindberg, Svend-Erik Skaaning, and Jan Teorell. 2017. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Staffan+I.+Lindberg%2C+Svend-Erik+Skaaning%2C+and+Jan+Teorell.+2017.+V-Dem+Comparisons+and+Contrasts+with+Other+Measurement+Projects.+V-Dem+Working+Paper+45.&btnG=", "children": [ { "text": "V-Dem Comparisons and Contrasts with Other Measurement Projects", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". V-Dem Working Paper 45.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Economist Intelligence Unit. 2023. ", "spanType": "span-simple-text" }, { "url": "https://www.eiu.com/n/campaigns/democracy-index-2022/", "children": [ { "text": "Democracy Index 2022: Frontline democracy and the battle for Ukraine.", "spanType": "span-simple-text" } ], "spanType": "span-link" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Elff, Martin, and Sebastian Ziaja. 2018. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Elff%2C+Martin%2C+and+Sebastian+Ziaja.+2018.+Method+Factors+in+Democracy+Indicators.+Politics+and+Governance+6%281%29%3A+105-116.&btnG=", "children": [ { "text": "Method Factors in Democracy Indicators", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Politics and Governance 6(1): 105-116.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Freedom House. 2022. ", "spanType": "span-simple-text" }, { "url": "http://web.archive.org/web/20220510113257/https://freedomhouse.org/sites/default/files/2022-02/FIW_2022_Methodology_For_Web.pdf", "children": [ { "text": "Freedom in the World 2022 Methodology", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Marshall, Monty G. and Ted Robert Gurr. 2020. ", "spanType": "span-simple-text" }, { "url": "https://web.archive.org/web/20220420174443/http://www.systemicpeace.org/inscr/p5manualv2018.pdf", "children": [ { "text": "Polity 5: Political Regime Characteristics and Transitions, 1800-2018 Dataset Users\u2019 Manual", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Center for Systemic Peace.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "McMann, Kelly, Daniel Pemstein, Brigitte Seim, Jan Teorell, and Staffan Lindberg. 2021. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C14&q=McMann%2C+Kelly%2C+Daniel+Pemstein%2C+Brigitte+Seim%2C+Jan+Teorell%2C+and+Staffan+Lindberg.+2021.+Assessing+Data+Quality%3A+An+Approach+and+An+Application.+Political+Analysis.&btnG=", "children": [ { "text": "Assessing Data Quality: An Approach and An Application", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". ", "spanType": "span-simple-text" }, { "children": [ { "text": "Political Analysis", "spanType": "span-simple-text" } ], "spanType": "span-italic" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "M\u00f8ller, J\u00f8rgen and Svend-Erik Skaaning. 2021. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=M%C3%B8ller%2C+J%C3%B8rgen+and+Svend-Erik+Skaaning.+2021.+Varieties+of+Measurement%3A+A+Comparative+Assessment+of+Relatively+New+Democracy+Ratings+based+on+Original+Data.+V-Dem+Working+Paper+123.&btnG=", "children": [ { "text": "Varieties of Measurement: A Comparative Assessment of Relatively New Democracy Ratings based on Original Data", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". V-Dem Working Paper 123.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Skaaning, Svend-Erik. 2018. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Skaaning%2C+Svend-Erik.+2018.+Different+Types+of+Data+and+the+Validity+of+Democracy+Measures.+Politics+and+Governance+6%281%29%3A+105-116.&btnG=", "children": [ { "text": "Different Types of Data and the Validity of Democracy Measures", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Politics and Governance 6(1): 105-116.Skaaning, Svend-Erik. 2021. ", "spanType": "span-simple-text" }, { "url": "https://dataverse.harvard.edu/file.xhtml?fileId=4571029&version=1.0", "children": [ { "text": "The Lexical Index of Electoral Democracy (LIED) Dataset (v6.0) Codebook", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "cf1cd977b1c9c22e64f48470c34b6c2199aa9715": { "id": "cf1cd977b1c9c22e64f48470c34b6c2199aa9715", "index": 6, "content": [ { "type": "text", "value": [ { "text": "Bertelsmann Foundation. 2022. ", "spanType": "span-simple-text" }, { "url": "https://bti-project.org/en", "children": [ { "text": "Bertelsmann Transformation Index 2022", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "d4124c4d79f641e6d5f582f6dc4887dfedbab809": { "id": "d4124c4d79f641e6d5f582f6dc4887dfedbab809", "index": 0, "content": [ { "type": "text", "value": [ { "text": "Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, David Altman, Fabio Angiolillo, Michael Bernhard, Cecilia Borella, Agnes Cornell, M. Steven Fish, Linnea Fox, Lisa Gastaldi, Haakon Gjerl\u00f8w, Adam Glynn, Ana Good God, Sandra Grahn, Allen Hicken, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Natalia Natsika, Anja Neundorf, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Ryd\u00e9n, Johannes von R\u00f6mer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundstr\u00f6m, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson, and Daniel Ziblatt. 2024. \"", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+David+Altman%2C+Fabio+Angiolillo%2C+Michael+Bernhard%2C+Cecilia+Borella%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Linnea+Fox%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Ana+Good+God%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Natalia+Natsika%2C+Anja+Neundorf%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%C3%A9n%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2024.+%22V-Dem+Country-Year+Dataset+v14%22+Varieties+of+Democracy+%28V-Dem%29+Project.+https%3A%2F%2Fdoi.org%2F10.23696%2Fmcwt-fr58&btnG=", "children": [ { "text": "V-Dem Country-Year Dataset v14", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": "\" Varieties of Democracy (V-Dem) Project. https://doi.org/10.23696/mcwt-fr58", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Pemstein, Daniel, Kyle L. Marquardt, Eitan Tzelgov, Yi-ting Wang, Juraj Medzihorsky, Joshua Krusell, Farhad Miri, and Johannes von R\u00f6mer. 2024. \u201c", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Pemstein%2C+Daniel%2C+Kyle+L.+Marquardt%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Juraj+Medzihorsky%2C+Joshua+Krusell%2C+Farhad+Miri%2C+and+Johannes+von+R%C3%B6mer.+2024.+%E2%80%9CThe+V-Dem+Measurement+Model%3A+Latent+Variable+Analysis+for+Cross-National+and+Cross-Temporal+Expert-Coded+Data%E2%80%9D.+V-Dem+Working+Paper+No.+21.+9th+edition.+University+of+Gothenburg%3A+Varieties+of+Democracy+Institute.&btnG=", "children": [ { "text": "The V-Dem Measurement Model: Latent Variable Analysis for Cross-National and Cross-Temporal Expert-Coded Data", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": "\u201d. V-Dem Working Paper No. 21. 9th edition. University of Gothenburg: Varieties of Democracy Institute.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, "fc29ef02a8112cf544a7007baac240c4774c1b12": { "id": "fc29ef02a8112cf544a7007baac240c4774c1b12", "index": 2, "content": [ { "type": "text", "value": [ { "text": "Skaaning, Svend-Erik, John Gerring, and Henrikas Bartusevi\u010dius. 2015. ", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Skaaning%2C+Svend-Erik%2C+John+Gerring%2C+and+Henrikas+Bartusevi%C4%8Dius.+2015.+A+Lexical+Index+of+Electoral+Democracy.+Comparative+Political+Studies+48%2812%29%3A+1491-1525&btnG=", "children": [ { "text": "A Lexical Index of Electoral Democracy", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Comparative Political Studies 48(12): 1491-1525.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] } } }, "type": "article", "title": "Democracy data: how sources differ and when to use which one", "authors": [ "Bastian Herre" ], "excerpt": "There are many ways to classify and measure political systems. What approaches do different sources take? And when is which approach best?", "dateline": "originally published on June 17, 2022 (last updated in April 2024)", "subtitle": "There are many ways to classify and measure political systems. What approaches do different sources take? And when is which approach best?", "featured-image": "democracy-data-how-do-reasearchers-measure-democracy-featured-image.png" } |
1 | 2023-07-21 16:10:29 | 2022-06-17 07:24:25 | 2024-02-27 15:15:07 | unlisted | ALBJ4LtV3LLmyT-uK-nRvj8NHdMzsCJGoFRsxj3DYNYtDTuqjNYn-UFIjQKlVhXVIrITGWpnE9yno6GCySTMGA | Measuring the state of democracy across the world helps us understand the extent to which people have political rights and freedoms. But measuring how democratic a country is, comes with many challenges. People do not always agree on what characteristics define a democracy. These characteristics — such as whether an election was free and fair — even once defined, are difficult to assess. The judgement of experts is to some degree subjective and they may disagree; either about a specific characteristic, or how several characteristics can be reduced into a single measure of democracy. So how do researchers address these challenges and identify which countries are democratic and undemocratic? In our work on [Democracy](https://ourworldindata.org/democracy), we provide data from eight leading approaches of measuring democracy: * [Varieties of Democracy (V-Dem)](https://www.v-dem.net/vdemds.html) by the V-Dem project1 * [Regimes of the World (RoW)](https://www.v-dem.net/vdemds.html) by Lührmann et al. (2018)2, which use V-Dem data * [Lexical Index of Electoral Democracy (LIED)](https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/WPKNIT) by Skaaning et al. (2015)3 * [Boix-Miller-Rosato](https://sites.google.com/site/mkmtwo/data?authuser=0) by Boix et al. (2013, BMR)4 * [Polity](https://www.systemicpeace.org/inscrdata.html) by the Center for Systemic Peace5 * Freedom House’s (FH) [Freedom in the World](https://freedomhouse.org/report/freedom-world)6 * [Bertelsmann Transformation Index (BTI)](https://bti-project.org/en/downloads) by the Bertelsmann Foundation7 * Economist Intelligence Unit’s (EIU) [Democracy Index](https://www.eiu.com/n/campaigns/democracy-index-2021/?utm_source=eiu-website&utm_medium=blog&utm_campaign=democracy-index-2021)8 These approaches all measure democracy (or a closely related aspect), they cover many countries and years, and are commonly used by researchers and policymakers. You can delve into their data — the main democracy measures, indicators of specific characteristics, and global and regional overviews — in our [Democracy Data Explorer](https://ourworldindata.org/explorers/democracy). Reassuringly, the approaches typically agree about big differences in countries’ political institutions: they readily distinguish between highly democratic countries, such as Chile and Norway, and highly undemocratic countries, such as North Korea and Saudi Arabia. But they do not always agree. They come to different assessments about which of the two highly democratic countries – Chile and Norway – is more democratic, and whether Chile is more or less democratic than it was ten years ago. At times they come to strikingly different conclusions about countries that are neither highly democratic nor highly undemocratic, such as Nigeria today or the United States in the 19th century. Why do these measures sometimes reach such different conclusions? In this article I summarize the key similarities and differences of these approaches, and discuss when each source is best. --- # How is democracy characterized? In this and the following tables I summarize how each approach defines and scores democracy, and what coverage each approach provides.9 <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Narrow and broader: electoral, liberal, participatory, deliberative, or egalitarian democracy</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Narrow: electoral or liberal democracy</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Narrow: electoral (or liberal) democracy</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Narrow: electoral democracy</li></ul></td></tr><tr><td>Polity</td><td><ul><li> Narrow: electoral and liberal democracy</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Narrow: electoral or liberal democracy</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Broad: electoral, liberal, participatory, deliberative, and effective democracy</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Broad: electoral, liberal, participatory, deliberative, and effective democracy</li></ul></td></tr></table> We see that the approaches share a basic principle of democracy: a democracy is an electoral political system in which citizens get to participate in free and fair elections. The approaches also mostly agree that democracies are liberal political systems, in which citizens have additional civil rights and are protected from the state by constraining it. Some approaches stop there, and stick to these narrower conceptions of democracy. Others characterize democracy in broader terms, and also see it as a participatory and deliberative (citizens engage in elections, civil society, and public discourse) as well as an effective (governments can act on citizens’ behalf) political system. Varieties of Democracy — true to its name — offers both narrow and broader characterizations, by separately adding liberal, participatory, deliberative, as well as egalitarian (economic and social resources are equally distributed) political institutions to electoral democracy. --- # How is democracy scored? The approaches also differ in how they _score_ democracy. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>On a spectrum: 0 to 1, highly undemocratic to highly democratic</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>As a classification: closed autocracy < electoral autocracy < electoral democracy < liberal democracy</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>As a classification: non-electoral autocracy < one-party autocracy < multi-party autocracy without elected executive < multi-party autocracy < exclusive democracy < male democracy < electoral democracy < polyarchy</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>As a classification: non-democracy < democracy</li></ul></td></tr><tr><td>Polity</td><td><ul><li>On a spectrum: -10 to 10, hereditary monarchy to consolidated democracy</li><li>classification: autocracy < anocracy < democracy</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>As a classification; classification 1: not free < partly free < free</li><li>classification 2: non-democracy < electoral democracy</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>On a spectrum: 1 to 10, highly undemocratic to highly democratic</li><li>classification: hard-line autocracy < moderate autocracy < very defective democracy < defective democracy < consolidating democracy</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>On a spectrum: 0 to 10, highly undemocratic to 10 highly democratic</li><li>classification: authoritarian regime < hybrid regime < flawed democracy < full democracy</li></ul></td></tr></table> V-Dem treats democracy as a **spectrum**, with some countries being scored as more democratic than others. Other approaches instead treat democracy as a binary, and **classify** a country as either a democracy or not. A final group **does both**, using a spectrum of countries being more or less democratic, and setting thresholds above which a country is considered a democracy overall. Approaches that classify countries into democracies and non-democracies further differ in whether all countries that are not democracies are considered autocracies or authoritarian regimes, or whether there are some countries that do not clearly belong in either group. And while Freedom in the World identifies which countries are electoral democracies in recent years, its main classification distinguishes between free, partly-free, and not-free countries (which many treat as a proxy for liberal democracy). Beyond these broad similarities in how the approaches characterize and score democracy, their exact definitions differ in smaller ways, too. If you are interested in the details, you can take a closer look at the specific defining characteristics at the end of this article. --- # What differences are captured? How the approaches score democracy affects what differences in democracy they can capture. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li> Big to very small differences</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Big differences, with clear meaning</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Big to medium differences, with very clear meaning</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Big differences, with clear meaning</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Big to medium differences</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Big differences</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Big to small differences</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Big to small differences</li></ul></td></tr></table> Classifications tend to be coarser, and therefore cover big to medium differences in democracy: they reduce the complexity of political systems a lot and distinguish between broad types, such as the democracies of Chile and Norway on the one hand, and the non-democracies of North Korea and Saudi Arabia, on the other. The fine-grained spectrums of other approaches meanwhile reduce political systems’ complexity a bit less, and capture both big and small differences in democracy, such as the difference in democratic quality between the democracies Chile and Norway, and the difference between autocracies North Korea and Saudi Arabia. Spectrums can also better capture small changes within political systems over time, towards or away from democracy. While some approaches use their classifications exclusively to reduce the complexity of their spectrums, others also use theirs to clearly define what features characterize each category. --- # What years and countries are covered? The approaches also differ in what years and countries they cover. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Years since 1789</li><li>202 countries, also non-independent</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Years since 1789</li><li>202 countries, also non-independent</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Years since 1789</li><li>242 countries, also non-independent and microstates</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Years since 1800</li><li>218 countries, also microstates</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Years 1800 — 2018</li><li>192 countries</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Years since 1972</li><li>229 countries and territories, also microentities</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Years since 2005</li><li>138 countries and territories, no consolidated democracies</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Years since 2006</li><li>167 countries</li></ul></td></tr></table> All approaches cover the recent past, but differ in how far they go back in time. BTI and EIU begin in the mid-2000s. Freedom in the World starts in the early 1970s. The other approaches go back to the beginning of the 19th century or even the late 18th century. The Regimes of the World data we ourselves extended [back from 1900](https://ourworldindata.org/regimes-of-the-world-data). All approaches cover most countries in the world. They differ in how comprehensive their coverage is: BTI excludes long-term members of the OECD (which it considers consolidated democracies), while all other approaches assess them. Some approaches also include very small states and territories, and some also assess many non-independent countries, usually colonies.10 --- # How are democracy’s characteristics assessed? The approaches also differ in how they go about assessing the characteristics of democracy. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Mostly through evaluations by experts; some easy-to-observe characteristics assessed by own researchers</li><li>Then weighting, adding, and multiplying scores for (sub)characteristics</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Mostly through evaluations by experts; some easy-to-observe characteristics assessed by own researchers</li><li>Then evaluating whether necessary characteristics are (not) present</li><li>Then weighting, adding, and multiplying scores for a few characteristics</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Mostly with easy-to-observe characteristics, few evaluations by own researchers based on academic research</li><li>Then evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Mostly with easy-to-observe characteristics, few evaluations by own researchers based on academic literature</li><li>Then evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Mostly through evaluations by own researchers based on academic literature and news reports</li><li>Then weighting and adding scores for characteristics</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Mostly through evaluations by country and regional experts and own researchers based on different types of sources</li><li>Free countries: then adding scores for (sub)characteristics</li><li>Electoral democracies: then adding scores and evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Mostly through evaluations by country, regional, and general experts, some evaluations by representative surveys of regular citizens</li><li>Spectrum: then averaging of scores for (sub)characteristics</li><li>Classification: then averaging and evaluating whether necessary characteristics are present or not</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Mostly through evaluations by own country experts, some evaluations by representative surveys of regular citizens</li><li>Then averaging and minor weighting of scores for (sub)characteristics</li></ul></td></tr></table> Many rely on evaluations to assess democratic characteristics that are difficult to observe, such as whether elections were competitive and people were free to express their views. Some rely on evaluations by country experts to assess whether, or to which extent, democracy’s characteristics are present (or not) in any given country and year. Others depend on evaluations by their own researchers reviewing the academic literature and news reports. And many use both country experts and their own teams. A few additionally incorporate some representative surveys of regular citizens. The Lexical Index and the Boix-Miller-Rosato data meanwhile work to avoid difficult evaluations by either experts or researchers, and mostly have their own teams assess easy-to-observe characteristics — such as whether regular elections are held and several parties compete in them — to identify (non-)democracies. Depending on whether they score democracy as a spectrum or classification, the approaches then aggregate the scores for specific characteristics: some average, add, and/or weigh the scores, others assess whether necessary characteristics are present, and a few do both. ## How do approaches work to make assessments valid? The next tables summarize how the approaches address the challenges that come with measuring democracy. The first challenge is to make their assessments valid — to actually measure what they want to capture. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Experts (often nationals or residents) know country and characteristics well, own researchers know measurement procedures well</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Experts (often nationals or residents) know country and characteristics well, own researchers know measurement procedures well</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Own researchers know measurement procedures well</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Own researchers know measurement procedures well</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Own researchers know measurement well</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Experts know country or region well, own researchers know measurement well</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Experts (about half of them local) know country well, regular citizens know their own experiences well</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Experts know country or region well, regular citizens know their own experiences well</li></ul></td></tr></table> The approaches go about measuring democracy differently because they weigh the challenges of measurement differently. For those mostly relying on experts, the priority is that democracy’s characteristics are evaluated by people that know the country well. For those relying on their own researchers, the priority is that the coders know the approach’s characterization of democracy and the measurement procedures well. And for those relying on representative surveys, capturing the difficult-to-observe lived realities of regular citizens is especially important. ## How do approaches work to make assessments precise? The approaches are also concerned with making their assessments in a precise and reliable manner. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Several experts per country, year, and characteristic used (usually 5 or more since 1900, often 25 per country)</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Several experts per country, year, and characteristic used (usually 5 or more since 1900, often 25 per country)</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Characteristics easy to understand and observe; subjective evaluation therefore mostly unnecessary</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li> Characteristics easy to understand and observe; subjective evaluation therefore mostly unnecessary</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Several researchers used</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>More than 100 experts and researchers used in total; Experts and researchers rely on academic research, news and NGO reports, personal conversations, and on-the-ground research</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Two experts per country and year used</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>One or two experts per country and year used</li></ul></td></tr></table> Expert-based approaches therefore often recruit many experts in total, several experts per country, or even several to many experts per country, year and characteristic. Own-researcher-based approaches instead either focus more on making difficult subjective evaluation mostly unnecessary, or encourage their teams to rely on many different secondary sources, such as country-specific academic research, news reports, and personal conversations. ## How do approaches work to make assessments comparable? The approaches also face the challenge of how to make the coders’ respective assessments comparable across countries and time. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Experts answer very specific questions about sub-characteristics on completely explained scale</li><li>Experts also code hypothetical countries and many code several countries, denote own uncertainty and personal demographic information</li><li>Project investigated expert biases and found them to be limited</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Experts answer very specific questions about sub-characteristics on completely explained scale</li><li>Experts also code hypothetical examples and many code several countries, denote own uncertainty and personal attributes</li><li>Project investigated expert biases and found them to be limited</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Researchers answer specific questions about characteristics on explained scale</li><li>Same researcher assesses all countries and years</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Same researcher assesses all countries and years</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Experts answer specific questions about characteristics on completely explained scale</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Experts answer questions about characteristics separately</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Experts answer specific questions about sub-characteristics on explained scale</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Experts answer specific questions about sub-characteristics on completely explained scale</li></ul></td></tr></table> The surveys therefore ask the experts questions about specific characteristics of democracy, such as the presence or absence of election fraud, instead of making them rely on their broad impressions. They also explain the scales on which the characteristics are scored, and often all of the scales’ values. Measuring many specific low-level characteristics also helps users understand why a country received a specific score, and it allows them to create new measures tailored to their own interests. ## How are remaining differences dealt with? The approaches then all work to address any remaining differences between coders, even if they do so differently. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Measurement model uses main and additional information and provides estimates of remaining measurement uncertainty</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Measurement model uses main and additional information and provides estimates of remaining measurement uncertainty</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>One primary coder, so no differences between coders to be reconciled</li><li>Second researcher for some countries reproduced most assessments</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>One primary coder, so no differences between coders to be reconciled</li><li>For recent years discussions among researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Discussions among researchers reconcile different standards across coders, countries, and years</li><li>Separate researcher teams for some countries and years reproduced most assessments</li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Discussions among experts and researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Discussions among regional and general experts and own researchers reconcile different standards across coders, countries, and years</li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Discussions among experts and researchers reconcile different standards across coders, countries, and years</li></ul></td></tr></table> V-Dem and RoW work with a statistical model which uses the experts’ ratings of actual countries and hypothetical country examples, as well as the experts’ stated uncertainties and personal demographics to produce both best and upper- and lower-bound estimates of many characteristics. They thereby avoid forcing themselves to eliminate all uncertainty and thereby possibly biasing their scores, and acknowledge that its coders make errors. This also recognizes that small differences in democracy on fine-grained spectrums may actually not exist, or be reversed, because measurement is uncertain. Most other approaches go about it differently, and have researchers and experts discuss differing scores to reconcile them. This adds an additional step to make the assessments comparable across coders, countries, and years. And while it uses discussions, Freedom in the World still acknowledges that it refined its approach over time, which makes its scores not as readily comparable: they work best for comparing different countries at the same time, or comparing the same country over the course of a few years. The Lexical Index and Polity meanwhile do not have several coders per country and year, but they still worked to assess coding differences by once having its researchers rate some countries independently and compare their results. Reassuringly, they found that they came to similar conclusions. ## How do approaches work to make data accessible and transparent? Finally, the approaches all take steps to make their data accessible and the underlying measurement transparent. <table class="html-table"><tr><td>Varieties of Democracy</td><td><ul><li>Provides data for sub-indices and several hundred specific questions by country-year, country-date, and coder</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination in detail</li></ul></td></tr><tr><td>Regimes of the World</td><td><ul><li>Provides data for sub-indices and several hundred specific questions by country-year, country-date, and coder</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li></ul></td></tr><tr><td>Lexical Index</td><td><ul><li>Provides disaggregated data for specific questions by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies in detail democracy characteristics and their combination</li></ul></td></tr><tr><td>Boix-Miller-Rosato</td><td><ul><li>Provides data by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li></ul></td></tr><tr><td>Polity</td><td><ul><li>Provides disaggregated data for sub-indices and specific questions by country-year</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Freedom House</td><td><ul><li>Provides recent disaggregated data for sub-indices and specific questions by country-year</li><li>Questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Bertelsmann Transformation Index</td><td><ul><li>Provides disaggregated data for sub-indices and specific questions by country-year</li><li>Detailed questions and coding procedures are available and easy to access</li><li>Justifies democracy characteristics and their combination</li><li>Explains scores with country reports </li></ul></td></tr><tr><td>Economist Intelligence Unit</td><td><ul><li>Provides disaggregated data for sub-indices by country-year</li><li>Questions and coding procedures are available</li><li>Justifies democracy characteristics</li></ul></td></tr></table> All approaches publicly release their data and almost all make the data straightforward to download and use. Most approaches release not only the overall classification and scores, but also the underlying (sub)characteristics. V-Dem even releases the data coded by each (anonymous) expert. Almost all release descriptions of how they characterize democracy, as well as the questions and coding procedures guiding the experts and researchers. V-Dem again stands out here for its very detailed descriptions that also discuss why it weighs, adds, and multiplies the scores for specific characteristics. Polity, Freedom in the World, and BTI meanwhile provide additional helpful information by explaining their quantitative scores in country reports that discuss influential events. --- # The best democracy measure depends on your questions There is no single ‘best’ approach to measuring democracy. Conceptions of democracy are too different, and the challenges of measurement are too diverse for that. All of the approaches put a lot of effort into measuring democracy in ways that are useful to researchers, policymakers, and interested citizens. The most appropriate democracy measure depends on what question you want to answer. It is the one that captures the characteristics of democracy and the countries and years you are interested in. This means that having several approaches to measuring democracy is not a flaw, but a strength: it gives us different tools to understand the past spread, current state, and possible future of democracy around the world. If you are interested in big and small differences in varieties of democracy, far into the past, and want to use country experts to measure characteristics of political systems that are difficult to observe, the Varieties of Democracy data is best. If you are instead interested in big differences in political regimes over the last two hundred years, and want to use the knowledge of country experts, the Regimes of the World data is best. If you rather want to explore medium differences in political regimes, especially in the 19th and earlier 20th century, and want to rely more on characteristics that are easier to observe, the Lexical Index ist best. And if you want to study big differences in political regimes, drawing on easier-to-observe features of political systems, the Boix-Miller-Rosato data is best. If you instead want to explore the source that was researchers’ go-to for democracy for a long time, and are fine with its less precise data, Polity is best. If you especially care about the political and civil freedoms that democracy grants, Freedom House is best. If you value a broad understanding of democracy that encompasses its electoral, liberal, participatory, deliberative, and effective dimensions, then the Bertelsmann Transformation Index is best. And if you want to use a broad understanding of democracy to study it both in countries where it is older and those in which it is young or absent, then the Economist Intelligence Unit is best. If you want to explore the data that each of these datasets produce, you can do so in our [Democracy Data Explorer](https://ourworldindata.org/explorers/democracy). And if you want to compare the sources directly, you can do so in these charts: <Chart url="https://ourworldindata.org/grapher/democracy-index-by-source"/> <Chart url="https://ourworldindata.org/grapher/political-regime-classification-by-source"/> ## Keep reading at _Our World in Data_ ### Democracy Data Explorer Explore the world’s political systems with the leading approaches of measuring democracy. https://ourworldindata.org/explorers/democracy ### undefined undefined https://docs.google.com/document/d/1xO9wHbwM5LKlGFbHyet3CLmiqnI3ZOHS8V3P_81Itf4/edit ### undefined undefined https://docs.google.com/document/d/14zTYMg-mkPcMC68DqgQNb1eAe8VBwoD93yzyKGIeguw/edit ### undefined undefined https://docs.google.com/document/d/14ThFloGyQv4uSGdEeZROWq_2yvHC9ggnAFij_9Oyz6g/edit ## Acknowledgements I thank Daniel Bachler, Hauke Hartmann, Joan Hoey, Staffan Lindberg, Michael K. Miller, Hannah Ritchie, Max Roser, and Svend-Erik Skaaning for reading drafts of this text and their very helpful comments. # What are democracy's specific characteristics? ## Varieties of Democracy ### Spectrums * **electoral democracy**: extent to which political leaders are elected in free and fair elections under comprehensive voting rights and freedoms of association and expression * **liberal democracy**: electoral democracy and extent to which citizens have individual and minority rights, are equal before the law, and the actions of the executive are constrained by the legislative and the courts * **participatory democracy**: electoral democracy and extent to which citizens can engage in civil society organizations and direct democracy * **deliberative democracy**: electoral democracy and extent to which citizens and leaders discuss different views and seek public good * **egalitarian democracy**: electoral democracy and extent to which economic and social resources are distributed equally ## Regimes of the World ### Classification * **closed autocracy**: citizens do not have the right to choose either the chief executive of the government or the legislature through multi-party elections * **electoral autocracy**: citizens have the right to choose the chief executive and the legislature through multi-party elections; but they lack some freedoms, such as the freedoms of association or expression that make the elections meaningful, free, and fair * **electoral democracy**: citizens have the right to choose the chief executive and the legislature in meaningful, free and fair, and multi-party elections * **liberal democracy**: electoral democracy and citizens enjoy individual and minority rights, are equal before the law, and the actions of the executive are constrained by the legislative and the courts ## Lexical Index of Electoral Democracy ### Spectrum and classification * **non-electoral autocracy**: citizens do not have the right to elect the chief executive or the legislature * **one-party autocracy**: some citizens have the right to choose the chief executive or the legislature, but only have one choice * **multiparty autocracy without elected executive**: some citizens have the right to choose the legislature and have more than one choice, but chief executive not elected * **multiparty autocracy**: some citizens have the right to choose the chief executive and the legislature and have more than one choice, but election outcome is certain * **exclusive democracy**: citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, but suffrage is restricted * **male democracy**: citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, but suffrage is restricted to men * **electoral democracy**: citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections * **polyarchy**: citizens have the right to choose the chief executive and the legislature in multi-party, uncertain elections, and enjoy freedoms of expression, assembly, and association ## Boix-Miller-Rosato (BMR) ### Classifications * **democracy**: a majority of adult men have the right to choose the chief executive and the legislature in free and fair elections * **democracy with women's suffrage**: a majority of adult men and women have the right to choose the chief executive and the legislature in free and fair elections ## Polity ### Spectrum and classification * **full/consolidated democracy**: open, multi-party, and competitive elections choose chief executive, who faces comprehensive institutional constraints, and political participation is competitive * **democracy**: mostly democratic characteristics * **anocracy**: neither clearly democratic nor autocratic characteristics * **autocracy**: mostly autocratic characteristics * **full autocracy/hereditary monarchy**: hereditary succession chooses chief executive who faces no institutional constraints, and political participation is restricted and suppressed ## Freedom in the World ### Classification 1 * **free country**: citizens have many political rights (free and fair elections, political pluralism and participation, functioning government) and civil liberties (freedoms of expression and association, rule of law, personal autonomy) * **partly free country**: citizens have some political rights and civil liberties * **not free country**: citizens have few political rights and civil liberties ### Classification 2 * **electoral democracy**: citizens have the right to choose chief executive and legislature in broadly free and fair elections and have substantial other political rights and civil liberties ## Bertelsmann Transformation Index (BTI) ### Spectrum * **democratic features**: extent of political participation, the rule of law, stable democratic institutions, political and social integration, and a capable state ### Classification * **consolidating democracy**: comprehensive democratic features and minimum democratic characteristics (citizens can choose political leaders in free and fair elections and enjoy freedoms of association, expression and some further civil liberties, political power is separated, and leaders can effectively govern a state that fulfils basic functions) * **defective democracy**: minimum democratic characteristics, but limited other democratic features * **very defective democracy**: minimum democratic characteristics, but very limited other democratic features * **moderate autocracy**: no minimum democratic characteristics, but possibly other broadly democratic features * **hard-line autocracy**: no minimum democratic characteristics, and few other democratic features ## Economist Intelligence Unit (EIU) ### Spectrum: * **democracy**: extent to which citizens can choose their political leaders in free and fair elections, enjoy civil liberties, prefer democracy over other political systems, can and do participate in politics, and have a functioning government that acts on their behalf ### Classification * **full democracy**: comprehensive extent of democracy, few weaknesses * **flawed democracy**: some weaknesses in democratic institutions and culture * **hybrid regime**: serious weaknesses in democratic institutions and culture * **authoritarian regime**: few democratic institutions and little democratic culture Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerløw, Adam Glynn, Ana Good God, Sandra Grahn, Allen Hicken, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Natalia Natsika, Anja Neundorf, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Rydén, Johannes von Römer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundström, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson and Daniel Ziblatt. 2023. [V-Dem [Country-Year/Country-Date] Dataset v13.](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Ana+Good+God%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Natalia+Natsika%2C+Anja+Neundorf%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%C3%A9n%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2023.+V-Dem+%5BCountry-Year%2FCountry-Date%5D+Dataset+v13.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=) Varieties of Democracy (V-Dem) Project. Pemstein, Daniel, Kyle L. Marquardt, Eitan Tzelgov, Yi-ting Wang, Juraj Medzihorsky, Joshua Krusell, Farhad Miri, and Johannes von Römer. 2023. [The V-Dem Measurement Model: Latent Variable Analysis for Cross-National and Cross-Temporal Expert-Coded Data.](https://v-dem.net/media/publications/Working_Paper_21_z5BldB1.pdf) V-Dem Working Paper No. 21. University of Gothenburg: Varieties of Democracy Institute. Lührmann, Anna, Marcus Tannnberg, and Staffan Lindberg. 2018. Regimes of the World (RoW): [Opening New Avenues for the Comparative Study of Political Regimes](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=L%C3%BChrmann%2C+Anna%2C+Marcus+Tannnberg%2C+and+Staffan+Lindberg.+2018.+Regimes+of+the+World+%28RoW%29%3A+Opening+New+Avenues+for+the+Comparative+Study+of+Political+Regimes.+Politics+and+Governance+6%281%29%3A+60-77.%7B%2Fref%7D&btnG=). Politics and Governance 6(1): 60-77. Skaaning, Svend-Erik, John Gerring, and Henrikas Bartusevičius. 2015. [A Lexical Index of Electoral Democracy](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Skaaning%2C+Svend-Erik%2C+John+Gerring%2C+and+Henrikas+Bartusevi%C4%8Dius.+2015.+A+Lexical+Index+of+Electoral+Democracy.+Comparative+Political+Studies+48%2812%29%3A+1491-1525&btnG=). Comparative Political Studies 48(12): 1491-1525. Boix, Carles, Michael Miller, and Sebastian Rosato. [A Complete Data Set of Political Regimes, 1800–2007](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Boix%2C+Carles%2C+Michael+Miller%2C+and+Sebastian+Rosato.+A+Complete+Data+Set+of+Political+Regimes%2C+1800%E2%80%932007.+Comparative+Political+Studies+46%2812%29%3A1523-1554.&btnG=). Comparative Political Studies 46(12):1523-1554. Marshall, Monty G. and Ted Robert Gurr. 2021. [Polity 5: Political Regime Characteristics and Transitions, 1800-2018](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Marshall%2C+Monty+G.+and+Ted+Robert+Gurr.+2021.+Polity+5%3A+Political+Regime+Characteristics+and+Transitions%2C+1800-2018.+Center+for+Systemic+Peace&btnG=). Center for Systemic Peace. Freedom House. 2022. [Freedom in the world 2022](https://freedomhouse.org/report/freedom-world). Bertelsmann Foundation. 2022. [Bertelsmann Transformation Index 2022](https://bti-project.org/en). Economist Intelligence Unit. 2023. [Democracy Index 2022: Frontline democracy and the battle for Ukraine.](https://www.eiu.com/n/campaigns/democracy-index-2022/) This article draws on several very helpful other articles summarizing and reviewing some of the datasets, as well as the datasets’ own codebooks and descriptions: Bertelsmann Foundation. 2022. [BTI Codebook for Stata](http://web.archive.org/web/20220404134021/https://bti-project.org/fileadmin/api/content/en/downloads/data/BTI_2022_Codebook_for_Stata.pdf). Boese, Vanessa. 2019. [How (not) to measure democracy](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Boese%2C+Vanessa.+2019.+How+%28not%29+to+measure+democracy.+International+Area+Studies+Review+22%282%29%3A+95-127&btnG=). International Area Studies Review 22(2): 95-127. Boix, Carles, Michael K. Miller, and Sebastian Rosato. 2022. [Boix-Miller-Rosato (BMR) Dichotomous Coding of Democracy, Version 4.0 (1800-2020) Codebook](https://sites.google.com/site/mkmtwo/data?authuser=0). Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerløw, Adam Glynn, Sandra Grahn, Allen Hicken, Katrin Kinzelbach, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Pamela Paxton, Daniel Pemstein, Johannes von Römer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Eitan Tzelgov, Luca Uberti, Yi-ting Wang, Tore Wig, and Daniel Ziblatt. 2022. [V-Dem Codebook v12](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Katrin+Kinzelbach%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Eitan+Tzelgov%2C+Luca+Uberti%2C+Yi-ting+Wang%2C+Tore+Wig%2C+and+Daniel+Ziblatt.+2022.+V-Dem+Codebook+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=). Varieties of Democracy (V-Dem) Project. Coppedge, Michael, John Gerring, Staffan I. Lindberg, Svend-Erik Skaaning, and Jan Teorell. 2017. [V-Dem Comparisons and Contrasts with Other Measurement Projects](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Staffan+I.+Lindberg%2C+Svend-Erik+Skaaning%2C+and+Jan+Teorell.+2017.+V-Dem+Comparisons+and+Contrasts+with+Other+Measurement+Projects.+V-Dem+Working+Paper+45.&btnG=). V-Dem Working Paper 45. Economist Intelligence Unit. 2023. [Democracy Index 2022: Frontline democracy and the battle for Ukraine.](https://www.eiu.com/n/campaigns/democracy-index-2022/) Elff, Martin, and Sebastian Ziaja. 2018. [Method Factors in Democracy Indicators](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Elff%2C+Martin%2C+and+Sebastian+Ziaja.+2018.+Method+Factors+in+Democracy+Indicators.+Politics+and+Governance+6%281%29%3A+105-116.&btnG=). Politics and Governance 6(1): 105-116. Freedom House. 2022. [Freedom in the World 2022 Methodology](http://web.archive.org/web/20220510113257/https://freedomhouse.org/sites/default/files/2022-02/FIW_2022_Methodology_For_Web.pdf). Marshall, Monty G. and Ted Robert Gurr. 2020. [Polity 5: Political Regime Characteristics and Transitions, 1800-2018 Dataset Users’ Manual](https://web.archive.org/web/20220420174443/http://www.systemicpeace.org/inscr/p5manualv2018.pdf). Center for Systemic Peace. McMann, Kelly, Daniel Pemstein, Brigitte Seim, Jan Teorell, and Staffan Lindberg. 2021. [Assessing Data Quality: An Approach and An Application](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C14&q=McMann%2C+Kelly%2C+Daniel+Pemstein%2C+Brigitte+Seim%2C+Jan+Teorell%2C+and+Staffan+Lindberg.+2021.+Assessing+Data+Quality%3A+An+Approach+and+An+Application.+Political+Analysis.&btnG=). _Political Analysis_. Møller, Jørgen and Svend-Erik Skaaning. 2021. [Varieties of Measurement: A Comparative Assessment of Relatively New Democracy Ratings based on Original Data](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=M%C3%B8ller%2C+J%C3%B8rgen+and+Svend-Erik+Skaaning.+2021.+Varieties+of+Measurement%3A+A+Comparative+Assessment+of+Relatively+New+Democracy+Ratings+based+on+Original+Data.+V-Dem+Working+Paper+123.&btnG=). V-Dem Working Paper 123. Skaaning, Svend-Erik. 2018. [Different Types of Data and the Validity of Democracy Measures](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Skaaning%2C+Svend-Erik.+2018.+Different+Types+of+Data+and+the+Validity+of+Democracy+Measures.+Politics+and+Governance+6%281%29%3A+105-116.&btnG=). Politics and Governance 6(1): 105-116.Skaaning, Svend-Erik. 2021. [The Lexical Index of Electoral Democracy (LIED) Dataset (v6.0) Codebook](https://dataverse.harvard.edu/file.xhtml?fileId=4571029&version=1.0). To cover even more of today’s countries when they were still non-sovereign territories we further identified for V-Dem, RoW and slightly for Boix-Miller-Rosato the historical entity the territories were a part of and used that regime’s data whenever available. | Democracy data: how sources differ and when to use which one |