posts: 55153
Data license: CC-BY
This data as json
id | title | slug | type | status | content | archieml | archieml_update_statistics | published_at | updated_at | gdocSuccessorId | authors | excerpt | created_at_in_wordpress | updated_at_in_wordpress | featured_image | formattingOptions | markdown | wpApiSnapshot |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
55153 | The 'Varieties of Democracy' data: how do researchers measure human rights? | vdem-human-rights-data | post | publish | <!-- wp:paragraph --> <p>Measuring the state of human rights across the world helps us understand the extent to which people have fundamental personal and civil rights and freedoms.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>But it can be challenging to measure how well-protected these human rights are.. People do not always agree on what rights are fundamental. These rights — such as whether people are free to voice their opinions — are difficult to define and assess. The judgement of experts is to some degree subjective. They may disagree about a specific characteristic or how several characteristics can be reduced into a single measure.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>How do researchers address these challenges and measure how much people’s human rights are protected?</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>What are the Varieties of Democracy project?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>In some of our work on democracy, we rely on data published by the <a href="https://www.v-dem.net/vdemds.html">Varieties of Democracy (V-Dem) project</a>.{ref}Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, Nazifa Alizada, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerløw, Adam Glynn, Sandra Grahn, Allen Hicken, Garry Hindle, Nina Ilchenko, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Ryden, Johannes von Römer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundström, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson and Daniel Ziblatt. 2022.<a href="https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+Nazifa+Alizada%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Garry+Hindle%2C+Nina+Ilchenko%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%E2%80%80en%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2022.+VDem+%5BCountry%E2%80%93Year%2FCountry%E2%80%93Date%5D+Dataset+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG="> VDem [Country–Year/Country–Date] Dataset v12</a>. Varieties of Democracy (V-Dem) Project.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The project is managed by the V-Dem Institute, based at the University of Gothenburg in Sweden. It spans seven more regional centers around the world and is <a href="https://www.v-dem.net/about/v-dem-project/">run</a> by five principal investigators, dozens of project and regional managers, and more than 100 country coordinators.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem is funded through grants and donations by government agencies and private foundations, such as the Swedish Research Council, the European Commission, and the Marcus and Marianne Wallenberg Foundation.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>How does V-Dem characterize human rights?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>Our team at Our World in Data uses V-Dem’s Civil Liberties Index to measure human rights.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem characterizes civil liberties as three types of freedoms: physical integrity rights, private civil liberties, and political civil liberties. More specifically, this means:</p> <!-- /wp:paragraph --> <!-- wp:list --> <ul><li><strong>Physical integrity rights</strong>: people are free and protected from government torture and political killings</li><li><strong>Private civil liberties</strong>: people are free from forced labor, have property rights, and enjoy freedoms of movement (move unrestricted within, to, and from the country) and religion (choose and practice their faith)</li><li><strong>Political civil liberties</strong>: people enjoy freedoms of association (parties and civil society organizations can form and operate freely) and expression (they can voice their views, and the media can present different political perspectives)</li></ul> <!-- /wp:list --> <!-- wp:heading {"level":4} --> <h4><strong>How are human rights scored?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem’s Civil Liberties Index scores each country on a spectrum, with some countries protecting human rights more than others.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The spectrum ranges from 0 (‘fewest rights’) to 1 (‘most rights’).</p> <!-- /wp:paragraph --> <!-- wp:html --> <iframe src="https://ourworldindata.org/grapher/human-rights-vdem" loading="lazy" style="width: 100%; height: 600px; border: 0px none;"></iframe> <!-- /wp:html --> <!-- wp:html --> <iframe src="https://ourworldindata.org/grapher/distribution-human-rights-vdem" loading="lazy" style="width: 100%; height: 600px; border: 0px none;"></iframe> <!-- /wp:html --> <!-- wp:heading {"level":4} --> <h4><strong>What years and countries are covered?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>As of version 12 of the dataset, V-Dem covers 202 countries, going back in time as far as 1789. Many countries have been covered since 1900, including before they became independent from their colonial powers.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>How is democracy measured?</strong></h4> <!-- /wp:heading --> <!-- wp:heading {"level":5} --> <h5><strong>How does V-Dem work to make its assessments valid?</strong></h5> <!-- /wp:heading --> <!-- wp:paragraph --> <p>To actually measure what it wants to capture, V-Dem assesses the characteristics of human rights mostly through evaluations by experts.{ref} For more details, see: Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von Römer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>These anonymous experts are primarily academics and members of the media and civil society. They are also often nationals or residents of the country they assess, and therefore know its political system well and can evaluate aspects that are difficult to observe.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem’s own team of researchers supplements the expert evaluations. They code some easier-to-observe rules and laws of the political system, such as whether the legislature has a lower and upper house.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":5} --> <h5><strong>How does V-Dem work to make its assessments precise and reliable?</strong></h5> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem uses several experts per country, year, and topic, to make its assessments less subjective. In total, around 3,500 country-experts fill surveys for V-Dem every year.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>While there are fewer experts for small countries and for the time before 1900, they rely typically on 25 experts per country and 5 experts per topic.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":5} --> <h5><strong>How does V-Dem work to make its assessments comparable?</strong></h5> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem also works to make their coders’ assessments comparable across countries and time.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The surveys ask the experts to answer very specific questions on completely explained scales about sub-characteristics of human rights — such as whether women can freely move in their own country — instead of making them rely on their broad impressions.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The surveys are available in English, Arabic, French, Portuguese, Russian, and Spanish to reduce misunderstandings.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Experts further evaluate hypothetical countries, many coded several countries, and they denote their own uncertainty and personal demographic information.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem then uses this information to investigate expert biases, which they have found to be limited: they only find that experts from a country tend to be stricter in their assessments. {ref}“We have run extensive tests on how well such individual-level factors predict country-ratings but have found that the only factor consistently associated with country-ratings is country of origin (with “domestic” experts being harsher in their judgments).”</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von Römer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":5} --> <h5><strong>How are the remaining differences in the data dealt with?</strong></h5> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem uses a statistical model to address any remaining differences between coders.{ref}Specifically, it uses a Bayesian Item-Response Theory estimation strategy.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Marquardt, Kyle, and Daniel Pemstein. 2018. IRT Models for Expert-Coded Panel Data. Political Analysis 26(4): 431-456.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The model combines the experts’ ratings of actual countries and hypothetical countries, as well as the experts’ stated uncertainties and personal demographics to produce best, upper-, and lower-bound estimates of many characteristics.{ref}Expressed precisely, V-Dem’s measurement model produces a probability distribution over the country-year scores. The best estimate is the distribution’s median, while the upper and lower bound estimates demarcate the interval in which the model places 68 percent of the probability mass.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem provides these different estimates for all of its main and supplementary indices, including the Civil Liberties Index and the subindices for physical integrity rights, private civil liberties, and political civil liberties.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>With the different estimates, V-Dem explicitly acknowledges that its coders can be uncertain or make errors in their measurement.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The overall Civil Liberties Index score is the result of averaging the three subindices.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>How is the data made accessible and transparent?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem releases <a href="https://v-dem.net/data/the-v-dem-dataset/">its data</a> publicly, and makes it straightforward to download and use.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>It publishes the overall scores, the underlying subindices, and several hundred specific questions by country-year, country-date, and coder.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem also releases detailed descriptions of the questions and coding procedures that guide the experts and researchers.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>How do we change the data?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>In our work, we expand the years covered by V-Dem further.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>To expand the time coverage of today’s countries and include more of the period when they were still non-sovereign territories, we identified the historical entity they were a part of and used that regime’s data whenever available.{ref}For example, V-Dem only provides data since Bangladesh’s independence in 1971. There is, however, data for Pakistan and the colony of India, both of which the current territory of Bangladesh was a part. We, therefore, use the data of Pakistan for Bangladesh from 1947 to 1970, and the data of India from 1789 to 1946. We did so for all countries with a past or current population of more than one million.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><meta http-equiv="content-type" content="text/html; charset=utf-8">We also calculated regional and global averages of the Civil Liberties Index and its sub-indices, weighted and unweighted by population.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Our code and data are available <a href="https://github.com/owid/notebooks/tree/main/BastianHerre/democracy">on GitHub</a> and record our revisions in detail.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>How often and when is the data updated?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>V-Dem releases a new version of the data each year in March.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>We at Our World in Data aim to update our own data within a few weeks of the release.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>What are the data’s shortcomings?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>There are shortcomings in the way that V-Dem’s Civil Liberties Index characterizes and measures human rights.{ref}This and the following section draw on an article summarizing and reviewing some of the leading human rights datasets:</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Cope, Kevin, Charles Crabtree, and Christopher Fariss. 2020. <a href="https://www.cambridge.org/core/journals/political-science-research-and-methods/article/abs/patterns-of-disagreement-in-indicators-of-state-repression/FBCA92BDEFD630ED364DEFE73600172F">Patterns of disagreement in indicators of state repression</a>. Political Science Research and Methods 8(1): 178-187.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The index focuses on human rights as civil liberties and does not account for other characterizations, such as rights to food, health, or education. This means that countries with good health and education outcomes but restricted civil liberties, such as Iran and Singapore in recent years, still receive relatively low scores.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The index also does not tell us anything about how human rights differ across parts of the population, such as between men and women, or between different ethnic groups.{ref}Though some of the index’s specific indicators distinguish between rights for men and women.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>V-Dem also does not cover some countries with very small populations.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Furthermore, the index is more difficult to interpret than other measures. The Civil Liberties Index does not identify whether a country grants or protects human rights or not, but only allows us to say whether a country is protecting human rights by comparing it to the range of the index, to other countries, or to the same country at another point in time. And when doing so, it is still difficult to say how large these differences are.{ref}This can be made easier by comparing how a score relates to the index’s overall distribution or its distribution for a specific year.{/ref}</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The assessment of the Civil Liberties Index remains to some extent subjective. Its index is built on difficult evaluations by experts and relies less on easier-to-observe characteristics, such as whether forming a civil society organization independent of the state is legal, or the number of allegations made in human rights reports against the government.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Finally, the index’s aggregation remains to some extent arbitrary. V-Dem does not say why these specific subindices were chosen, and why the subindices are given the same weight.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>What are the data’s strengths?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>Despite these shortcomings, the index tells us a lot about how protected human rights are around the world, in the past and today.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Its characterization of human rights as people enjoying physical integrity, as well as private and political civil liberties, is <a href="https://www.cambridge.org/core/journals/american-political-science-review/article/human-rights-are-increasingly-plural-learning-the-changing-taxonomy-of-human-rights-from-largescale-text-reveals-information-effects/F202F327EA8F4CF52D2E65EB48D409D3">commonly recognized</a> to be at the core of human rights.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Because it treats human rights as a spectrum, the index is able to capture both big and small differences in their protection across countries, and to record small changes within countries over time. This allows us to observe whether one country protects human rights more than another, or whether a country has protected human rights more or less over time.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The index also covers many countries and years. With the exception of microstates, it covers all countries in the world. Many countries are covered since 1900 — even while they were colonized by another country — and some of them as far back as 1789.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Finally, V-Dem takes many steps to make its assessments valid, precise, comparable across countries and time, and transparent. It relies on many country and subject experts answering detailed surveys to measure aspects of political systems that are often difficult to observe and acknowledges the remaining uncertainty in their assessments.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>What is our summary assessment?</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>Whether V-Dem’s Civil Liberties Index is a useful measure of human rights will depend on the questions we want to answer.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The index will not give us a satisfying answer if we are interested in an understanding of human rights as also including rights to health or education; in differences in the protection of human rights by gender and ethnicity; and if we are also interested in the political systems of microstates.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>In these cases, we may have to rely on <a href="https://ourworldindata.org/grapher/physical-integrity-rights-fkr">other measures</a>.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>But if we value a sophisticated measure based on the knowledge of many country experts and are interested in big and small differences in civil liberties, within and across countries, and far into the past, we can learn a lot from this data.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>It is for these latter purposes we use the measure in some of our reporting on human rights.</p> <!-- /wp:paragraph --> <!-- wp:heading {"level":4} --> <h4><strong>Keep reading on </strong><strong><em>Our World in Data</em></strong></h4> <!-- /wp:heading --> <!-- wp:owid/prominent-link {"title":"","linkUrl":"https://ourworldindata.org/human-rights","className":"is-style-thin"} /--> <!-- wp:heading {"level":4} --> <h4><strong>Acknowledgments</strong></h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>I thank Edouard Mathieu for his very helpful comments and ideas about how to improve this article.</p> <!-- /wp:paragraph --> | { "id": "wp-55153", "slug": "vdem-human-rights-data", "content": { "toc": [], "body": [ { "type": "text", "value": [ { "text": "Measuring the state of human rights across the world helps us understand the extent to which people have fundamental personal and civil rights and freedoms.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But it can be challenging to measure how well-protected these human rights are.. People do not always agree on what rights are fundamental. These rights \u2014 such as whether people are free to voice their opinions \u2014 are difficult to define and assess. The judgement of experts is to some degree subjective. They may disagree about a specific characteristic or how several characteristics can be reduced into a single measure.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "How do researchers address these challenges and measure how much people\u2019s human rights are protected?", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "What are the Varieties of Democracy project?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "In some of our work on democracy, we rely on data published by the ", "spanType": "span-simple-text" }, { "url": "https://www.v-dem.net/vdemds.html", "children": [ { "text": "Varieties of Democracy (V-Dem) project", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".{ref}Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, Nazifa Alizada, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerl\u00f8w, Adam Glynn, Sandra Grahn, Allen Hicken, Garry Hindle, Nina Ilchenko, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Ryden, Johannes von R\u00f6mer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundstr\u00f6m, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson and Daniel Ziblatt. 2022.", "spanType": "span-simple-text" }, { "url": "https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+Nazifa+Alizada%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Garry+Hindle%2C+Nina+Ilchenko%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%E2%80%80en%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2022.+VDem+%5BCountry%E2%80%93Year%2FCountry%E2%80%93Date%5D+Dataset+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=", "children": [ { "text": " VDem [Country\u2013Year/Country\u2013Date] Dataset v12", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Varieties of Democracy (V-Dem) Project.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The project is managed by the V-Dem Institute, based at the University of Gothenburg in Sweden. It spans seven more regional centers around the world and is ", "spanType": "span-simple-text" }, { "url": "https://www.v-dem.net/about/v-dem-project/", "children": [ { "text": "run", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " by five principal investigators, dozens of project and regional managers, and more than 100 country coordinators.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem is funded through grants and donations by government agencies and private foundations, such as the Swedish Research Council, the European Commission, and the Marcus and Marianne Wallenberg Foundation.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How does V-Dem characterize human rights?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "Our team at Our World in Data uses V-Dem\u2019s Civil Liberties Index to measure human rights.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem characterizes civil liberties as three types of freedoms: physical integrity rights, private civil liberties, and political civil liberties. More specifically, this means:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "list", "items": [ { "type": "text", "value": [ { "children": [ { "text": "Physical integrity rights", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": people are free and protected from government torture and political killings", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "Private civil liberties", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": people are free from forced labor, have property rights, and enjoy freedoms of movement (move unrestricted within, to, and from the country) and religion (choose and practice their faith)", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "children": [ { "text": "Political civil liberties", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "text": ": people enjoy freedoms of association (parties and civil society organizations can form and operate freely) and expression (they can voice their views, and the media can present different political perspectives)", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How are human rights scored?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem\u2019s Civil Liberties Index scores each country on a spectrum, with some countries protecting human rights more than others.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The spectrum ranges from 0 (\u2018fewest rights\u2019) to 1 (\u2018most rights\u2019).", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "url": "https://ourworldindata.org/grapher/human-rights-vdem", "type": "chart", "parseErrors": [] }, { "url": "https://ourworldindata.org/grapher/distribution-human-rights-vdem", "type": "chart", "parseErrors": [] }, { "text": [ { "children": [ { "text": "What years and countries are covered?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "As of version 12 of the dataset, V-Dem covers 202 countries, going back in time as far as 1789. Many countries have been covered since 1900, including before they became independent from their colonial powers.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How is democracy measured?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "text": [ { "children": [ { "text": "How does V-Dem work to make its assessments valid?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "text", "value": [ { "text": "To actually measure what it wants to capture, V-Dem assesses the characteristics of human rights mostly through evaluations by experts.{ref} For more details, see: Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von R\u00f6mer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "These anonymous experts are primarily academics and members of the media and civil society. They are also often nationals or residents of the country they assess, and therefore know its political system well and can evaluate aspects that are difficult to observe.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem\u2019s own team of researchers supplements the expert evaluations. They code some easier-to-observe rules and laws of the political system, such as whether the legislature has a lower and upper house.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How does V-Dem work to make its assessments precise and reliable?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem uses several experts per country, year, and topic, to make its assessments less subjective. In total, around 3,500 country-experts fill surveys for V-Dem every year.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "While there are fewer experts for small countries and for the time before 1900, they rely typically on 25 experts per country and 5 experts per topic.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How does V-Dem work to make its assessments comparable?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem also works to make their coders\u2019 assessments comparable across countries and time.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The surveys ask the experts to answer very specific questions on completely explained scales about sub-characteristics of human rights \u2014 such as whether women can freely move in their own country \u2014 instead of making them rely on their broad impressions.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The surveys are available in English, Arabic, French, Portuguese, Russian, and Spanish to reduce misunderstandings.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Experts further evaluate hypothetical countries, many coded several countries, and they denote their own uncertainty and personal demographic information.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem then uses this information to investigate expert biases, which they have found to be limited: they only find that experts from a country tend to be stricter in their assessments. {ref}\u201cWe have run extensive tests on how well such individual-level factors predict country-ratings but have found that the only factor consistently associated with country-ratings is country of origin (with \u201cdomestic\u201d experts being harsher in their judgments).\u201d", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von R\u00f6mer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How are the remaining differences in the data dealt with?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 3, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem uses a statistical model to address any remaining differences between coders.{ref}Specifically, it uses a Bayesian Item-Response Theory estimation strategy.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Marquardt, Kyle, and Daniel Pemstein. 2018. IRT Models for Expert-Coded Panel Data. Political Analysis 26(4): 431-456.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The model combines the experts\u2019 ratings of actual countries and hypothetical countries, as well as the experts\u2019 stated uncertainties and personal demographics to produce best, upper-, and lower-bound estimates of many characteristics.{ref}Expressed precisely, V-Dem\u2019s measurement model produces a probability distribution over the country-year scores. The best estimate is the distribution\u2019s median, while the upper and lower bound estimates demarcate the interval in which the model places 68 percent of the probability mass.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem provides these different estimates for all of its main and supplementary indices, including the Civil Liberties Index and the subindices for physical integrity rights, private civil liberties, and political civil liberties.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "With the different estimates, V-Dem explicitly acknowledges that its coders can be uncertain or make errors in their measurement.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The overall Civil Liberties Index score is the result of averaging the three subindices.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How is the data made accessible and transparent?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem releases ", "spanType": "span-simple-text" }, { "url": "https://v-dem.net/data/the-v-dem-dataset/", "children": [ { "text": "its data", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " publicly, and makes it straightforward to download and use.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "It publishes the overall scores, the underlying subindices, and several hundred specific questions by country-year, country-date, and coder.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem also releases detailed descriptions of the questions and coding procedures that guide the experts and researchers.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How do we change the data?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "In our work, we expand the years covered by V-Dem further.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "To expand the time coverage of today\u2019s countries and include more of the period when they were still non-sovereign territories, we identified the historical entity they were a part of and used that regime\u2019s data whenever available.{ref}For example, V-Dem only provides data since Bangladesh\u2019s independence in 1971. There is, however, data for Pakistan and the colony of India, both of which the current territory of Bangladesh was a part. We, therefore, use the data of Pakistan for Bangladesh from 1947 to 1970, and the data of India from 1789 to 1946. We did so for all countries with a past or current population of more than one million.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "We also calculated regional and global averages of the Civil Liberties Index and its sub-indices, weighted and unweighted by population.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Our code and data are available ", "spanType": "span-simple-text" }, { "url": "https://github.com/owid/notebooks/tree/main/BastianHerre/democracy", "children": [ { "text": "on GitHub", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " and record our revisions in detail.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "How often and when is the data updated?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem releases a new version of the data each year in March.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "We at Our World in Data aim to update our own data within a few weeks of the release.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "What are the data\u2019s shortcomings?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "There are shortcomings in the way that V-Dem\u2019s Civil Liberties Index characterizes and measures human rights.{ref}This and the following section draw on an article summarizing and reviewing some of the leading human rights datasets:", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Cope, Kevin, Charles Crabtree, and Christopher Fariss. 2020. ", "spanType": "span-simple-text" }, { "url": "https://www.cambridge.org/core/journals/political-science-research-and-methods/article/abs/patterns-of-disagreement-in-indicators-of-state-repression/FBCA92BDEFD630ED364DEFE73600172F", "children": [ { "text": "Patterns of disagreement in indicators of state repression", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ". Political Science Research and Methods 8(1): 178-187.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The index focuses on human rights as civil liberties and does not account for other characterizations, such as rights to food, health, or education. This means that countries with good health and education outcomes but restricted civil liberties, such as Iran and Singapore in recent years, still receive relatively low scores.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The index also does not tell us anything about how human rights differ across parts of the population, such as between men and women, or between different ethnic groups.{ref}Though some of the index\u2019s specific indicators distinguish between rights for men and women.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "V-Dem also does not cover some countries with very small populations.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Furthermore, the index is more difficult to interpret than other measures. The Civil Liberties Index does not identify whether a country grants or protects human rights or not, but only allows us to say whether a country is protecting\u00a0 human rights by comparing it to the range of the index, to other countries, or to the same country at another point in time. And when doing so, it is still difficult to say how large these differences are.{ref}This can be made easier by comparing how a score relates to the index\u2019s overall distribution or its distribution for a specific year.{/ref}", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The assessment of the Civil Liberties Index remains to some extent subjective. Its index is built on difficult evaluations by experts and relies less on easier-to-observe characteristics, such as whether forming a civil society organization independent of the state is legal, or the number of allegations made in human rights reports against the government.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Finally, the index\u2019s aggregation remains to some extent arbitrary. V-Dem does not say why these specific subindices were chosen, and why the subindices are given the same weight.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "What are the data\u2019s strengths?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "Despite these shortcomings, the index tells us a lot about how protected human rights are around the world, in the past and today.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Its characterization of human rights as people enjoying physical integrity, as well as private and political civil liberties, is ", "spanType": "span-simple-text" }, { "url": "https://www.cambridge.org/core/journals/american-political-science-review/article/human-rights-are-increasingly-plural-learning-the-changing-taxonomy-of-human-rights-from-largescale-text-reveals-information-effects/F202F327EA8F4CF52D2E65EB48D409D3", "children": [ { "text": "commonly recognized", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": " to be at the core of human rights.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Because it treats human rights as a spectrum, the index is able to capture both big and small differences in their protection across countries, and to record small changes within countries over time. This allows us to observe whether one country protects human rights more than another, or whether a country has protected human rights more or less over time.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The index also covers many countries and years. With the exception of microstates, it covers all countries in the world. Many countries are covered since 1900 \u2014 even while they were colonized by another country \u2014 and some of them as far back as 1789.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "Finally, V-Dem takes many steps to make its assessments valid, precise, comparable across countries and time, and transparent. It relies on many country and subject experts answering detailed surveys to measure aspects of political systems that are often difficult to observe and acknowledges the remaining uncertainty in their assessments.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "What is our summary assessment?", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "Whether V-Dem\u2019s Civil Liberties Index is a useful measure of human rights will depend on the questions we want to answer.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "The index will not give us a satisfying answer if we are interested in an understanding of human rights as also including rights to health or education; in differences in the protection of human rights by gender and ethnicity; and if we are also interested in the political systems of microstates.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "In these cases, we may have to rely on ", "spanType": "span-simple-text" }, { "url": "https://ourworldindata.org/grapher/physical-integrity-rights-fkr", "children": [ { "text": "other measures", "spanType": "span-simple-text" } ], "spanType": "span-link" }, { "text": ".", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "But if we value a sophisticated measure based on the knowledge of many country experts and are interested in big and small differences in civil liberties, within and across countries, and far into the past, we can learn a lot from this data.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "type": "text", "value": [ { "text": "It is for these latter purposes we use the measure in some of our reporting on human rights.", "spanType": "span-simple-text" } ], "parseErrors": [] }, { "text": [ { "children": [ { "text": "Keep reading on ", "spanType": "span-simple-text" } ], "spanType": "span-bold" }, { "children": [ { "children": [ { "text": "Our World in Data", "spanType": "span-simple-text" } ], "spanType": "span-italic" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "url": "https://ourworldindata.org/human-rights", "type": "prominent-link", "title": "", "description": "", "parseErrors": [] }, { "text": [ { "children": [ { "text": "Acknowledgments", "spanType": "span-simple-text" } ], "spanType": "span-bold" } ], "type": "heading", "level": 2, "parseErrors": [] }, { "type": "text", "value": [ { "text": "I thank Edouard Mathieu for his very helpful comments and ideas about how to improve this article.", "spanType": "span-simple-text" } ], "parseErrors": [] } ], "type": "article", "title": "The 'Varieties of Democracy' data: how do researchers measure human rights?", "authors": [ "Bastian Herre" ], "excerpt": "There are several ways to measure human rights. Here is how the Varieties of Democracy project does it, one of the leading sources of global human rights data.", "dateline": "December 16, 2022", "subtitle": "There are several ways to measure human rights. Here is how the Varieties of Democracy project does it, one of the leading sources of global human rights data.", "sidebar-toc": false, "featured-image": "distribution-human-rights-vdem.png" }, "createdAt": "2022-12-16T17:12:36.000Z", "published": false, "updatedAt": "2023-06-08T09:57:14.000Z", "revisionId": null, "publishedAt": "2022-12-16T17:33:07.000Z", "relatedCharts": [], "publicationContext": "listed" } |
{ "errors": [ { "name": "unexpected wp component tag", "details": "Found unhandled wp:comment tag list" }, { "name": "unhandled html tag found", "details": "Encountered the unhandled tag meta" } ], "numBlocks": 77, "numErrors": 2, "wpTagCounts": { "html": 2, "list": 1, "heading": 17, "paragraph": 56, "owid/prominent-link": 1 }, "htmlTagCounts": { "p": 56, "h4": 13, "h5": 4, "ul": 1, "meta": 1, "iframe": 2 } } |
2022-12-16 17:33:07 | 2024-02-16 14:22:54 | 1Hy_mYebgaQCiZLU2AM3aRUBMebz6zGrj7uFLjdnDJkU | [ "Bastian Herre" ] |
There are several ways to measure human rights. Here is how the Varieties of Democracy project does it, one of the leading sources of global human rights data. | 2022-12-16 17:12:36 | 2023-06-08 09:57:14 | https://ourworldindata.org/wp-content/uploads/2022/12/distribution-human-rights-vdem.png | {} |
Measuring the state of human rights across the world helps us understand the extent to which people have fundamental personal and civil rights and freedoms. But it can be challenging to measure how well-protected these human rights are.. People do not always agree on what rights are fundamental. These rights — such as whether people are free to voice their opinions — are difficult to define and assess. The judgement of experts is to some degree subjective. They may disagree about a specific characteristic or how several characteristics can be reduced into a single measure. How do researchers address these challenges and measure how much people’s human rights are protected? ## **What are the Varieties of Democracy project?** In some of our work on democracy, we rely on data published by the [Varieties of Democracy (V-Dem) project](https://www.v-dem.net/vdemds.html).{ref}Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, Nazifa Alizada, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerløw, Adam Glynn, Sandra Grahn, Allen Hicken, Garry Hindle, Nina Ilchenko, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Ryden, Johannes von Römer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundström, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson and Daniel Ziblatt. 2022.[ VDem [Country–Year/Country–Date] Dataset v12](https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+Nazifa+Alizada%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Garry+Hindle%2C+Nina+Ilchenko%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%E2%80%80en%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2022.+VDem+%5BCountry%E2%80%93Year%2FCountry%E2%80%93Date%5D+Dataset+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=). Varieties of Democracy (V-Dem) Project.{/ref} The project is managed by the V-Dem Institute, based at the University of Gothenburg in Sweden. It spans seven more regional centers around the world and is [run](https://www.v-dem.net/about/v-dem-project/) by five principal investigators, dozens of project and regional managers, and more than 100 country coordinators. V-Dem is funded through grants and donations by government agencies and private foundations, such as the Swedish Research Council, the European Commission, and the Marcus and Marianne Wallenberg Foundation. ## **How does V-Dem characterize human rights?** Our team at Our World in Data uses V-Dem’s Civil Liberties Index to measure human rights. V-Dem characterizes civil liberties as three types of freedoms: physical integrity rights, private civil liberties, and political civil liberties. More specifically, this means: * **Physical integrity rights**: people are free and protected from government torture and political killings * **Private civil liberties**: people are free from forced labor, have property rights, and enjoy freedoms of movement (move unrestricted within, to, and from the country) and religion (choose and practice their faith) * **Political civil liberties**: people enjoy freedoms of association (parties and civil society organizations can form and operate freely) and expression (they can voice their views, and the media can present different political perspectives) ## **How are human rights scored?** V-Dem’s Civil Liberties Index scores each country on a spectrum, with some countries protecting human rights more than others. The spectrum ranges from 0 (‘fewest rights’) to 1 (‘most rights’). <Chart url="https://ourworldindata.org/grapher/human-rights-vdem"/> <Chart url="https://ourworldindata.org/grapher/distribution-human-rights-vdem"/> ## **What years and countries are covered?** As of version 12 of the dataset, V-Dem covers 202 countries, going back in time as far as 1789. Many countries have been covered since 1900, including before they became independent from their colonial powers. ## **How is democracy measured?** ### **How does V-Dem work to make its assessments valid?** To actually measure what it wants to capture, V-Dem assesses the characteristics of human rights mostly through evaluations by experts.{ref} For more details, see: Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von Römer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref} These anonymous experts are primarily academics and members of the media and civil society. They are also often nationals or residents of the country they assess, and therefore know its political system well and can evaluate aspects that are difficult to observe. V-Dem’s own team of researchers supplements the expert evaluations. They code some easier-to-observe rules and laws of the political system, such as whether the legislature has a lower and upper house. ### **How does V-Dem work to make its assessments precise and reliable?** V-Dem uses several experts per country, year, and topic, to make its assessments less subjective. In total, around 3,500 country-experts fill surveys for V-Dem every year. While there are fewer experts for small countries and for the time before 1900, they rely typically on 25 experts per country and 5 experts per topic. ### **How does V-Dem work to make its assessments comparable?** V-Dem also works to make their coders’ assessments comparable across countries and time. The surveys ask the experts to answer very specific questions on completely explained scales about sub-characteristics of human rights — such as whether women can freely move in their own country — instead of making them rely on their broad impressions. The surveys are available in English, Arabic, French, Portuguese, Russian, and Spanish to reduce misunderstandings. Experts further evaluate hypothetical countries, many coded several countries, and they denote their own uncertainty and personal demographic information. V-Dem then uses this information to investigate expert biases, which they have found to be limited: they only find that experts from a country tend to be stricter in their assessments. {ref}“We have run extensive tests on how well such individual-level factors predict country-ratings but have found that the only factor consistently associated with country-ratings is country of origin (with “domestic” experts being harsher in their judgments).” Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von Römer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref} ### **How are the remaining differences in the data dealt with?** V-Dem uses a statistical model to address any remaining differences between coders.{ref}Specifically, it uses a Bayesian Item-Response Theory estimation strategy. Marquardt, Kyle, and Daniel Pemstein. 2018. IRT Models for Expert-Coded Panel Data. Political Analysis 26(4): 431-456.{/ref} The model combines the experts’ ratings of actual countries and hypothetical countries, as well as the experts’ stated uncertainties and personal demographics to produce best, upper-, and lower-bound estimates of many characteristics.{ref}Expressed precisely, V-Dem’s measurement model produces a probability distribution over the country-year scores. The best estimate is the distribution’s median, while the upper and lower bound estimates demarcate the interval in which the model places 68 percent of the probability mass.{/ref} V-Dem provides these different estimates for all of its main and supplementary indices, including the Civil Liberties Index and the subindices for physical integrity rights, private civil liberties, and political civil liberties. With the different estimates, V-Dem explicitly acknowledges that its coders can be uncertain or make errors in their measurement. The overall Civil Liberties Index score is the result of averaging the three subindices. ## **How is the data made accessible and transparent?** V-Dem releases [its data](https://v-dem.net/data/the-v-dem-dataset/) publicly, and makes it straightforward to download and use. It publishes the overall scores, the underlying subindices, and several hundred specific questions by country-year, country-date, and coder. V-Dem also releases detailed descriptions of the questions and coding procedures that guide the experts and researchers. ## **How do we change the data?** In our work, we expand the years covered by V-Dem further. To expand the time coverage of today’s countries and include more of the period when they were still non-sovereign territories, we identified the historical entity they were a part of and used that regime’s data whenever available.{ref}For example, V-Dem only provides data since Bangladesh’s independence in 1971. There is, however, data for Pakistan and the colony of India, both of which the current territory of Bangladesh was a part. We, therefore, use the data of Pakistan for Bangladesh from 1947 to 1970, and the data of India from 1789 to 1946. We did so for all countries with a past or current population of more than one million.{/ref} We also calculated regional and global averages of the Civil Liberties Index and its sub-indices, weighted and unweighted by population. Our code and data are available [on GitHub](https://github.com/owid/notebooks/tree/main/BastianHerre/democracy) and record our revisions in detail. ## **How often and when is the data updated?** V-Dem releases a new version of the data each year in March. We at Our World in Data aim to update our own data within a few weeks of the release. ## **What are the data’s shortcomings?** There are shortcomings in the way that V-Dem’s Civil Liberties Index characterizes and measures human rights.{ref}This and the following section draw on an article summarizing and reviewing some of the leading human rights datasets: Cope, Kevin, Charles Crabtree, and Christopher Fariss. 2020. [Patterns of disagreement in indicators of state repression](https://www.cambridge.org/core/journals/political-science-research-and-methods/article/abs/patterns-of-disagreement-in-indicators-of-state-repression/FBCA92BDEFD630ED364DEFE73600172F). Political Science Research and Methods 8(1): 178-187.{/ref} The index focuses on human rights as civil liberties and does not account for other characterizations, such as rights to food, health, or education. This means that countries with good health and education outcomes but restricted civil liberties, such as Iran and Singapore in recent years, still receive relatively low scores. The index also does not tell us anything about how human rights differ across parts of the population, such as between men and women, or between different ethnic groups.{ref}Though some of the index’s specific indicators distinguish between rights for men and women.{/ref} V-Dem also does not cover some countries with very small populations. Furthermore, the index is more difficult to interpret than other measures. The Civil Liberties Index does not identify whether a country grants or protects human rights or not, but only allows us to say whether a country is protecting human rights by comparing it to the range of the index, to other countries, or to the same country at another point in time. And when doing so, it is still difficult to say how large these differences are.{ref}This can be made easier by comparing how a score relates to the index’s overall distribution or its distribution for a specific year.{/ref} The assessment of the Civil Liberties Index remains to some extent subjective. Its index is built on difficult evaluations by experts and relies less on easier-to-observe characteristics, such as whether forming a civil society organization independent of the state is legal, or the number of allegations made in human rights reports against the government. Finally, the index’s aggregation remains to some extent arbitrary. V-Dem does not say why these specific subindices were chosen, and why the subindices are given the same weight. ## **What are the data’s strengths?** Despite these shortcomings, the index tells us a lot about how protected human rights are around the world, in the past and today. Its characterization of human rights as people enjoying physical integrity, as well as private and political civil liberties, is [commonly recognized](https://www.cambridge.org/core/journals/american-political-science-review/article/human-rights-are-increasingly-plural-learning-the-changing-taxonomy-of-human-rights-from-largescale-text-reveals-information-effects/F202F327EA8F4CF52D2E65EB48D409D3) to be at the core of human rights. Because it treats human rights as a spectrum, the index is able to capture both big and small differences in their protection across countries, and to record small changes within countries over time. This allows us to observe whether one country protects human rights more than another, or whether a country has protected human rights more or less over time. The index also covers many countries and years. With the exception of microstates, it covers all countries in the world. Many countries are covered since 1900 — even while they were colonized by another country — and some of them as far back as 1789. Finally, V-Dem takes many steps to make its assessments valid, precise, comparable across countries and time, and transparent. It relies on many country and subject experts answering detailed surveys to measure aspects of political systems that are often difficult to observe and acknowledges the remaining uncertainty in their assessments. ## **What is our summary assessment?** Whether V-Dem’s Civil Liberties Index is a useful measure of human rights will depend on the questions we want to answer. The index will not give us a satisfying answer if we are interested in an understanding of human rights as also including rights to health or education; in differences in the protection of human rights by gender and ethnicity; and if we are also interested in the political systems of microstates. In these cases, we may have to rely on [other measures](https://ourworldindata.org/grapher/physical-integrity-rights-fkr). But if we value a sophisticated measure based on the knowledge of many country experts and are interested in big and small differences in civil liberties, within and across countries, and far into the past, we can learn a lot from this data. It is for these latter purposes we use the measure in some of our reporting on human rights. ## **Keep reading on ****_Our World in Data_** ### https://ourworldindata.org/human-rights ## **Acknowledgments** I thank Edouard Mathieu for his very helpful comments and ideas about how to improve this article. | { "id": 55153, "date": "2022-12-16T17:33:07", "guid": { "rendered": "https://owid.cloud/?p=55153" }, "link": "https://owid.cloud/vdem-human-rights-data", "meta": { "owid_publication_context_meta_field": [] }, "slug": "vdem-human-rights-data", "tags": [], "type": "post", "title": { "rendered": "The ‘Varieties of Democracy’ data: how do researchers measure human rights?" }, "_links": { "self": [ { "href": "https://owid.cloud/wp-json/wp/v2/posts/55153" } ], "about": [ { "href": "https://owid.cloud/wp-json/wp/v2/types/post" } ], "author": [ { "href": "https://owid.cloud/wp-json/wp/v2/users/49", "embeddable": true } ], "curies": [ { "href": "https://api.w.org/{rel}", "name": "wp", "templated": true } ], "replies": [ { "href": "https://owid.cloud/wp-json/wp/v2/comments?post=55153", "embeddable": true } ], "wp:term": [ { "href": "https://owid.cloud/wp-json/wp/v2/categories?post=55153", "taxonomy": "category", "embeddable": true }, { "href": "https://owid.cloud/wp-json/wp/v2/tags?post=55153", "taxonomy": "post_tag", "embeddable": true } ], "collection": [ { "href": "https://owid.cloud/wp-json/wp/v2/posts" } ], "wp:attachment": [ { "href": "https://owid.cloud/wp-json/wp/v2/media?parent=55153" } ], "version-history": [ { "href": "https://owid.cloud/wp-json/wp/v2/posts/55153/revisions", "count": 19 } ], "wp:featuredmedia": [ { "href": "https://owid.cloud/wp-json/wp/v2/media/55154", "embeddable": true } ], "predecessor-version": [ { "id": 57351, "href": "https://owid.cloud/wp-json/wp/v2/posts/55153/revisions/57351" } ] }, "author": 49, "format": "standard", "status": "publish", "sticky": false, "content": { "rendered": "\n<p>Measuring the state of human rights across the world helps us understand the extent to which people have fundamental personal and civil rights and freedoms.</p>\n\n\n\n<p>But it can be challenging to measure how well-protected these human rights are.. People do not always agree on what rights are fundamental. These rights \u2014 such as whether people are free to voice their opinions \u2014 are difficult to define and assess. The judgement of experts is to some degree subjective. They may disagree about a specific characteristic or how several characteristics can be reduced into a single measure.</p>\n\n\n\n<p>How do researchers address these challenges and measure how much people\u2019s human rights are protected?</p>\n\n\n\n<h4><strong>What are the Varieties of Democracy project?</strong></h4>\n\n\n\n<p>In some of our work on democracy, we rely on data published by the <a href=\"https://www.v-dem.net/vdemds.html\">Varieties of Democracy (V-Dem) project</a>.{ref}Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan I. Lindberg, Jan Teorell, Nazifa Alizada, David Altman, Michael Bernhard, Agnes Cornell, M. Steven Fish, Lisa Gastaldi, Haakon Gjerl\u00f8w, Adam Glynn, Sandra Grahn, Allen Hicken, Garry Hindle, Nina Ilchenko, Katrin Kinzelbach, Joshua Krusell, Kyle L. Marquardt, Kelly McMann, Valeriya Mechkova, Juraj Medzihorsky, Pamela Paxton, Daniel Pemstein, Josefine Pernes, Oskar Ryden, Johannes von R\u00f6mer, Brigitte Seim, Rachel Sigman, Svend-Erik Skaaning, Jeffrey Staton, Aksel Sundstr\u00f6m, Eitan Tzelgov, Yi-ting Wang, Tore Wig, Steven Wilson and Daniel Ziblatt. 2022.<a href=\"https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Coppedge%2C+Michael%2C+John+Gerring%2C+Carl+Henrik+Knutsen%2C+Staffan+I.+Lindberg%2C+Jan+Teorell%2C+Nazifa+Alizada%2C+David+Altman%2C+Michael+Bernhard%2C+Agnes+Cornell%2C+M.+Steven+Fish%2C+Lisa+Gastaldi%2C+Haakon+Gjerl%C3%B8w%2C+Adam+Glynn%2C+Sandra+Grahn%2C+Allen+Hicken%2C+Garry+Hindle%2C+Nina+Ilchenko%2C+Katrin+Kinzelbach%2C+Joshua+Krusell%2C+Kyle+L.+Marquardt%2C+Kelly+McMann%2C+Valeriya+Mechkova%2C+Juraj+Medzihorsky%2C+Pamela+Paxton%2C+Daniel+Pemstein%2C+Josefine+Pernes%2C+Oskar+Ryd%E2%80%80en%2C+Johannes+von+R%C3%B6mer%2C+Brigitte+Seim%2C+Rachel+Sigman%2C+Svend-Erik+Skaaning%2C+Jeffrey+Staton%2C+Aksel+Sundstr%C3%B6m%2C+Eitan+Tzelgov%2C+Yi-ting+Wang%2C+Tore+Wig%2C+Steven+Wilson+and+Daniel+Ziblatt.+2022.+VDem+%5BCountry%E2%80%93Year%2FCountry%E2%80%93Date%5D+Dataset+v12.+Varieties+of+Democracy+%28V-Dem%29+Project.&btnG=\"> VDem [Country\u2013Year/Country\u2013Date] Dataset v12</a>. Varieties of Democracy (V-Dem) Project.{/ref}</p>\n\n\n\n<p>The project is managed by the V-Dem Institute, based at the University of Gothenburg in Sweden. It spans seven more regional centers around the world and is <a href=\"https://www.v-dem.net/about/v-dem-project/\">run</a> by five principal investigators, dozens of project and regional managers, and more than 100 country coordinators.</p>\n\n\n\n<p>V-Dem is funded through grants and donations by government agencies and private foundations, such as the Swedish Research Council, the European Commission, and the Marcus and Marianne Wallenberg Foundation.</p>\n\n\n\n<h4><strong>How does V-Dem characterize human rights?</strong></h4>\n\n\n\n<p>Our team at Our World in Data uses V-Dem\u2019s Civil Liberties Index to measure human rights.</p>\n\n\n\n<p>V-Dem characterizes civil liberties as three types of freedoms: physical integrity rights, private civil liberties, and political civil liberties. More specifically, this means:</p>\n\n\n\n<ul><li><strong>Physical integrity rights</strong>: people are free and protected from government torture and political killings</li><li><strong>Private civil liberties</strong>: people are free from forced labor, have property rights, and enjoy freedoms of movement (move unrestricted within, to, and from the country) and religion (choose and practice their faith)</li><li><strong>Political civil liberties</strong>: people enjoy freedoms of association (parties and civil society organizations can form and operate freely) and expression (they can voice their views, and the media can present different political perspectives)</li></ul>\n\n\n\n<h4><strong>How are human rights scored?</strong></h4>\n\n\n\n<p>V-Dem\u2019s Civil Liberties Index scores each country on a spectrum, with some countries protecting human rights more than others.</p>\n\n\n\n<p>The spectrum ranges from 0 (\u2018fewest rights\u2019) to 1 (\u2018most rights\u2019).</p>\n\n\n\n<iframe src=\"https://ourworldindata.org/grapher/human-rights-vdem\" loading=\"lazy\" style=\"width: 100%; height: 600px; border: 0px none;\"></iframe>\n\n\n\n<iframe src=\"https://ourworldindata.org/grapher/distribution-human-rights-vdem\" loading=\"lazy\" style=\"width: 100%; height: 600px; border: 0px none;\"></iframe>\n\n\n\n<h4><strong>What years and countries are covered?</strong></h4>\n\n\n\n<p>As of version 12 of the dataset, V-Dem covers 202 countries, going back in time as far as 1789. Many countries have been covered since 1900, including before they became independent from their colonial powers.</p>\n\n\n\n<h4><strong>How is democracy measured?</strong></h4>\n\n\n\n<h5><strong>How does V-Dem work to make its assessments valid?</strong></h5>\n\n\n\n<p>To actually measure what it wants to capture, V-Dem assesses the characteristics of human rights mostly through evaluations by experts.{ref} For more details, see: Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von R\u00f6mer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}</p>\n\n\n\n<p>These anonymous experts are primarily academics and members of the media and civil society. They are also often nationals or residents of the country they assess, and therefore know its political system well and can evaluate aspects that are difficult to observe.</p>\n\n\n\n<p>V-Dem\u2019s own team of researchers supplements the expert evaluations. They code some easier-to-observe rules and laws of the political system, such as whether the legislature has a lower and upper house.</p>\n\n\n\n<h5><strong>How does V-Dem work to make its assessments precise and reliable?</strong></h5>\n\n\n\n<p>V-Dem uses several experts per country, year, and topic, to make its assessments less subjective. In total, around 3,500 country-experts fill surveys for V-Dem every year.</p>\n\n\n\n<p>While there are fewer experts for small countries and for the time before 1900, they rely typically on 25 experts per country and 5 experts per topic.</p>\n\n\n\n<h5><strong>How does V-Dem work to make its assessments comparable?</strong></h5>\n\n\n\n<p>V-Dem also works to make their coders\u2019 assessments comparable across countries and time.</p>\n\n\n\n<p>The surveys ask the experts to answer very specific questions on completely explained scales about sub-characteristics of human rights \u2014 such as whether women can freely move in their own country \u2014 instead of making them rely on their broad impressions.</p>\n\n\n\n<p>The surveys are available in English, Arabic, French, Portuguese, Russian, and Spanish to reduce misunderstandings.</p>\n\n\n\n<p>Experts further evaluate hypothetical countries, many coded several countries, and they denote their own uncertainty and personal demographic information.</p>\n\n\n\n<p>V-Dem then uses this information to investigate expert biases, which they have found to be limited: they only find that experts from a country tend to be stricter in their assessments. {ref}\u201cWe have run extensive tests on how well such individual-level factors predict country-ratings but have found that the only factor consistently associated with country-ratings is country of origin (with \u201cdomestic\u201d experts being harsher in their judgments).\u201d</p>\n\n\n\n<p>Coppedge, Michael, John Gerring, Carl Henrik Knutsen, Staffan Lindberg, Jan Teorell, Kyle Marquardt, Juraj Medzihorsky, Daniel Pemstein, Nazifa Alizada, Lisa Gastaldi, Garry Hindle, Josefine Pernes, Johannes von R\u00f6mer, Eitan Tzelgov, Yi-ting Wang, and Steven Wilson. 2021. V-Dem Methodology v11.1. Varieties of Democracy (V-Dem) Project: page 24.{/ref}</p>\n\n\n\n<h5><strong>How are the remaining differences in the data dealt with?</strong></h5>\n\n\n\n<p>V-Dem uses a statistical model to address any remaining differences between coders.{ref}Specifically, it uses a Bayesian Item-Response Theory estimation strategy.</p>\n\n\n\n<p>Marquardt, Kyle, and Daniel Pemstein. 2018. IRT Models for Expert-Coded Panel Data. Political Analysis 26(4): 431-456.{/ref}</p>\n\n\n\n<p>The model combines the experts\u2019 ratings of actual countries and hypothetical countries, as well as the experts\u2019 stated uncertainties and personal demographics to produce best, upper-, and lower-bound estimates of many characteristics.{ref}Expressed precisely, V-Dem\u2019s measurement model produces a probability distribution over the country-year scores. The best estimate is the distribution\u2019s median, while the upper and lower bound estimates demarcate the interval in which the model places 68 percent of the probability mass.{/ref}</p>\n\n\n\n<p>V-Dem provides these different estimates for all of its main and supplementary indices, including the Civil Liberties Index and the subindices for physical integrity rights, private civil liberties, and political civil liberties.</p>\n\n\n\n<p>With the different estimates, V-Dem explicitly acknowledges that its coders can be uncertain or make errors in their measurement.</p>\n\n\n\n<p>The overall Civil Liberties Index score is the result of averaging the three subindices.</p>\n\n\n\n<h4><strong>How is the data made accessible and transparent?</strong></h4>\n\n\n\n<p>V-Dem releases <a href=\"https://v-dem.net/data/the-v-dem-dataset/\">its data</a> publicly, and makes it straightforward to download and use.</p>\n\n\n\n<p>It publishes the overall scores, the underlying subindices, and several hundred specific questions by country-year, country-date, and coder.</p>\n\n\n\n<p>V-Dem also releases detailed descriptions of the questions and coding procedures that guide the experts and researchers.</p>\n\n\n\n<h4><strong>How do we change the data?</strong></h4>\n\n\n\n<p>In our work, we expand the years covered by V-Dem further.</p>\n\n\n\n<p>To expand the time coverage of today\u2019s countries and include more of the period when they were still non-sovereign territories, we identified the historical entity they were a part of and used that regime\u2019s data whenever available.{ref}For example, V-Dem only provides data since Bangladesh\u2019s independence in 1971. There is, however, data for Pakistan and the colony of India, both of which the current territory of Bangladesh was a part. We, therefore, use the data of Pakistan for Bangladesh from 1947 to 1970, and the data of India from 1789 to 1946. We did so for all countries with a past or current population of more than one million.{/ref}</p>\n\n\n\n<p><meta http-equiv=\"content-type\" content=\"text/html; charset=utf-8\">We also calculated regional and global averages of the Civil Liberties Index and its sub-indices, weighted and unweighted by population.</p>\n\n\n\n<p>Our code and data are available <a href=\"https://github.com/owid/notebooks/tree/main/BastianHerre/democracy\">on GitHub</a> and record our revisions in detail.</p>\n\n\n\n<h4><strong>How often and when is the data updated?</strong></h4>\n\n\n\n<p>V-Dem releases a new version of the data each year in March.</p>\n\n\n\n<p>We at Our World in Data aim to update our own data within a few weeks of the release.</p>\n\n\n\n<h4><strong>What are the data\u2019s shortcomings?</strong></h4>\n\n\n\n<p>There are shortcomings in the way that V-Dem\u2019s Civil Liberties Index characterizes and measures human rights.{ref}This and the following section draw on an article summarizing and reviewing some of the leading human rights datasets:</p>\n\n\n\n<p>Cope, Kevin, Charles Crabtree, and Christopher Fariss. 2020. <a href=\"https://www.cambridge.org/core/journals/political-science-research-and-methods/article/abs/patterns-of-disagreement-in-indicators-of-state-repression/FBCA92BDEFD630ED364DEFE73600172F\">Patterns of disagreement in indicators of state repression</a>. Political Science Research and Methods 8(1): 178-187.{/ref}</p>\n\n\n\n<p>The index focuses on human rights as civil liberties and does not account for other characterizations, such as rights to food, health, or education. This means that countries with good health and education outcomes but restricted civil liberties, such as Iran and Singapore in recent years, still receive relatively low scores.</p>\n\n\n\n<p>The index also does not tell us anything about how human rights differ across parts of the population, such as between men and women, or between different ethnic groups.{ref}Though some of the index\u2019s specific indicators distinguish between rights for men and women.{/ref}</p>\n\n\n\n<p>V-Dem also does not cover some countries with very small populations.</p>\n\n\n\n<p>Furthermore, the index is more difficult to interpret than other measures. The Civil Liberties Index does not identify whether a country grants or protects human rights or not, but only allows us to say whether a country is protecting human rights by comparing it to the range of the index, to other countries, or to the same country at another point in time. And when doing so, it is still difficult to say how large these differences are.{ref}This can be made easier by comparing how a score relates to the index\u2019s overall distribution or its distribution for a specific year.{/ref}</p>\n\n\n\n<p>The assessment of the Civil Liberties Index remains to some extent subjective. Its index is built on difficult evaluations by experts and relies less on easier-to-observe characteristics, such as whether forming a civil society organization independent of the state is legal, or the number of allegations made in human rights reports against the government.</p>\n\n\n\n<p>Finally, the index\u2019s aggregation remains to some extent arbitrary. V-Dem does not say why these specific subindices were chosen, and why the subindices are given the same weight.</p>\n\n\n\n<h4><strong>What are the data\u2019s strengths?</strong></h4>\n\n\n\n<p>Despite these shortcomings, the index tells us a lot about how protected human rights are around the world, in the past and today.</p>\n\n\n\n<p>Its characterization of human rights as people enjoying physical integrity, as well as private and political civil liberties, is <a href=\"https://www.cambridge.org/core/journals/american-political-science-review/article/human-rights-are-increasingly-plural-learning-the-changing-taxonomy-of-human-rights-from-largescale-text-reveals-information-effects/F202F327EA8F4CF52D2E65EB48D409D3\">commonly recognized</a> to be at the core of human rights.</p>\n\n\n\n<p>Because it treats human rights as a spectrum, the index is able to capture both big and small differences in their protection across countries, and to record small changes within countries over time. This allows us to observe whether one country protects human rights more than another, or whether a country has protected human rights more or less over time.</p>\n\n\n\n<p>The index also covers many countries and years. With the exception of microstates, it covers all countries in the world. Many countries are covered since 1900 \u2014 even while they were colonized by another country \u2014 and some of them as far back as 1789.</p>\n\n\n\n<p>Finally, V-Dem takes many steps to make its assessments valid, precise, comparable across countries and time, and transparent. It relies on many country and subject experts answering detailed surveys to measure aspects of political systems that are often difficult to observe and acknowledges the remaining uncertainty in their assessments.</p>\n\n\n\n<h4><strong>What is our summary assessment?</strong></h4>\n\n\n\n<p>Whether V-Dem\u2019s Civil Liberties Index is a useful measure of human rights will depend on the questions we want to answer.</p>\n\n\n\n<p>The index will not give us a satisfying answer if we are interested in an understanding of human rights as also including rights to health or education; in differences in the protection of human rights by gender and ethnicity; and if we are also interested in the political systems of microstates.</p>\n\n\n\n<p>In these cases, we may have to rely on <a href=\"https://ourworldindata.org/grapher/physical-integrity-rights-fkr\">other measures</a>.</p>\n\n\n\n<p>But if we value a sophisticated measure based on the knowledge of many country experts and are interested in big and small differences in civil liberties, within and across countries, and far into the past, we can learn a lot from this data.</p>\n\n\n\n<p>It is for these latter purposes we use the measure in some of our reporting on human rights.</p>\n\n\n\n<h4><strong>Keep reading on </strong><strong><em>Our World in Data</em></strong></h4>\n\n\n <block type=\"prominent-link\" style=\"is-style-thin\">\n <link-url>https://ourworldindata.org/human-rights</link-url>\n <title></title>\n <content></content>\n <figure></figure>\n </block>\n\n\n<h4><strong>Acknowledgments</strong></h4>\n\n\n\n<p>I thank Edouard Mathieu for his very helpful comments and ideas about how to improve this article.</p>\n", "protected": false }, "excerpt": { "rendered": "There are several ways to measure human rights. Here is how the Varieties of Democracy project does it, one of the leading sources of global human rights data.", "protected": false }, "date_gmt": "2022-12-16T17:33:07", "modified": "2023-06-08T10:57:14", "template": "", "categories": [ 1 ], "ping_status": "closed", "authors_name": [ "Bastian Herre" ], "modified_gmt": "2023-06-08T09:57:14", "comment_status": "closed", "featured_media": 55154, "featured_media_paths": { "thumbnail": "/app/uploads/2022/12/distribution-human-rights-vdem-150x106.png", "medium_large": "/app/uploads/2022/12/distribution-human-rights-vdem-768x542.png" } } |