posts: 45801
Data license: CC-BY
This data as json
| id | title | slug | type | status | content | archieml | archieml_update_statistics | published_at | updated_at | gdocSuccessorId | authors | excerpt | created_at_in_wordpress | updated_at_in_wordpress | featured_image | formattingOptions | markdown | wpApiSnapshot |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 45801 | Missing Data on Energy: Our list of datasets that are needed but are not available | energy-missing-data | post | publish | <!-- wp:columns --> <div class="wp-block-columns"><!-- wp:column --> <div class="wp-block-column"><!-- wp:paragraph --> <p>Below we list the key metrics on this topic that we think are missing from our coverage on <em>Our World in Data</em>. These are metrics we think are critical to understand the problem and build solutions. </p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The reason we list this missing data is because we are often asked by funders or researchers for examples of work that would provide a high-value return. This list should provide a useful reference for impactful projects to support. We believe these data gaps are important to fill; doing so would provide a lot of benefit.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>There are several possible reasons why a particular metric or dataset is not available:</p> <!-- /wp:paragraph --> <!-- wp:list --> <ul><li>Many are fundamental knowledge gaps where the relevant data or research simply <strong>does not exist at all</strong>.</li><li>Some are gaps where the data <em>does</em> exist but it is <strong>not in the public domain</strong>. It is privately licensed or locked behind paywalls.</li><li>Some are gaps where the existing data is very <strong>low-quality, outdated, or has poor coverage</strong>.</li><li>Some are gaps where the data is published by some countries but it <strong>has not been aggregated</strong> into regional or global datasets.</li></ul> <!-- /wp:list --> <!-- wp:paragraph --> <p>If you are aware of existing data or research which fills these gaps, please do get in touch at <a href="mailto:[email protected]">[email protected]</a>. </p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>It’s important that these datasets are regularly updated; and are open-access for everyone to use.</p> <!-- /wp:paragraph --></div> <!-- /wp:column --> <!-- wp:column --> <div class="wp-block-column"></div> <!-- /wp:column --></div> <!-- /wp:columns --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Electricity access at higher thresholds of electricity use</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p><strong>What is available:</strong> Data on access to electricity – presented as the share of the population with access to electricity – is available globally. The World Bank publishes this data, which we make available <a href="https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity"><strong>here</strong></a>.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing: </strong>The threshold in the available statistics for what it means to have ‘access to electricity’ is very low. This issue is explained <a href="https://www.energyforgrowth.org/report/modern-energy-minimum/">here</a>. This means that a large number of people is counted as ‘having access to electricity’ which in fact only have very little access – we explain this problem in the middle-section of <a href="https://www.energyforgrowth.org/report/modern-energy-minimum/">this essay on energy poverty</a>.<br><br>It would be valuable to understand access and electricity use across higher thresholds as well. in one dataset that aggregates this information for countries around the world. For example, the share of people who consume x units of electricity per day; or electricity for at least x hours per day. Where x units of electricity is representative of a sufficient amount to complete standard household tasks. This would give us information on the distribution of electricity usage rather than the average. It would also allow us to understand inequalities in electricity consumption across a population.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>As far as we are aware, this data does not currently exist.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Affordability of energy</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>For many households, energy can come at a high cost. It can account for a large share of their income – making it compete with other essentials such as food and shelter. This means many are living in energy poverty.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is available: </strong>Data on global fuel prices (e.g. coal or oil prices) exists, from sources such as the BP Statistical Review or energy market data. Some countries (for example, <a href="https://www.gov.uk/government/collections/fuel-poverty-statistics">the UK</a>) publish national statistics on fuel poverty.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing: </strong>There is, as far as I am aware, no harmonized global data on the cost of energy in households (or for the end user) across the world. Nor are there comparisons to how this relates to the income of people in these countries. This means we lack the data we need to understand the depths of energy poverty globally.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>A dataset which brings today’s energy costs across the world would provide a lot of value in helping to answer this question.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Reliability of electricity supply</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>Having access to electricity does not guarantee that is is reliable and available when it’s needed the most.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is available: </strong>Data on access to electricity – presented as the share of the population with access to electricity – is available globally. The World Bank publishes this data, which we make available <a href="https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity"><strong>here</strong></a>. This does not tell us how reliable this supply is.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing:</strong> No global, continuously maintained data exists on the reliability of electricity – when and how frequently blackouts occur – across the world. This would be an important measure to track progress on energy access.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Final energy consumption</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p><strong>What is available: </strong>We have good data on <em>primary</em> energy – the total amount of energy generated from all sources.<br><br>Primary energy includes energy that is finally consumed, plus energy that is wasted as heat in the combustion of fossil fuels. This measure is useful, but it does not represent the amount of energy we would need to produce in a low-carbon economy, and our rate of progress on decarbonization. Since a large amount of primary energy from fossil fuels is wasted as heat, we would need to produce much less energy from alternative sources to replace fossil fuel energy supplies. </p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing: </strong>Final energy consumption, which removes these losses in the combustion process. It is primary energy <em>minus</em> these losses from heat.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Some individual countries publish this data (see the UK as <a href="https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/904503/UK_Energy_in_Brief_2020.pdf">an example</a>). Some regions – for example, the European Environmental Agency – also <a href="https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment">publishes final energy</a> estimates. But, unfortunately, there are few harmonized global datasets. The <a href="http://data.un.org/Explorer.aspx?d=EDATA">UN Energy Division</a> makes some data publicly available. </p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>The most comprehensive dataset – which includes this data – is published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href="https://ourworldindata.org/iea-open-data">made an open call</a> for this data to be made public.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Final energy consumption is one of the most important energy metrics (perhaps the most important one) and it is unacceptable that no global, publicly usable dataset exists.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Final energy consumption by source</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>See above – ‘Final energy consumption’. This also applies to the breakdown of final energy consumption by source: how much comes from fossil fuels, renewables and nuclear energy.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Primary energy consumption (low-income countries)</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p><strong>What is available: </strong>Up-to-date data on primary energy consumption is available for most countries in publicly available datasets, such as the BP Statistical Review of World Energy. We present this data <a href="https://ourworldindata.org/explorers/energy?facet=none&country=USA~GBR~CHN~OWID_WRL~IND~BRA~ZAF&Total+or+Breakdown=Total&Energy+or+Electricity=Primary+energy&Metric=Annual+consumption">here</a>. However, some low-income countries are absent from these datasets.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing:</strong> Unfortunately many low income countries are absent from the BP dataset. We try to supplement this with other public sources, such as the <a href="https://www.theshiftdataportal.org/energy">SHIFT Data Portal</a>. However, this data is not up-to-date and only extends to 2016. </p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>Complete global data on primary energy is available from organizations such as the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href="https://ourworldindata.org/iea-open-data">made an open call</a> for this data to be made public.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Energy use by sector and sub-sector</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>It would be useful to know how our energy is used: how much is used for electricity in households; how much in cars; how much in global aviation.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is available: </strong>Some countries publish data on the allocation of energy to end use sectors (for example, <a href="https://www.ons.gov.uk/economy/environmentalaccounts/datasets/ukenvironmentalaccountsenergyusebyindustrysourceandfuel">the UK</a> and <a href="https://www.eia.gov/energyexplained/use-of-energy/">the US</a>). Some regions also publish aggregated datasets – such as the <a href="https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment">European Environment Agency</a>. Often these estimates are only available at high-level sectors and do not provide breakdowns by sub-sector. For example, they stop at allocation to ‘transportation’ which further breakdown of ‘road, rail, aviation’.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing: </strong>An open-access global dataset with sector-by-sector data for all countries. Ideally, this would be available at the sub-sector level.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p>This data is included in data published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href="https://ourworldindata.org/iea-open-data">made an open call</a> for this data to be made public.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Electrical storage capacity and demand</h4> <!-- /wp:heading --> <!-- wp:paragraph --> <p>As the world moves towards more low-carbon energy sources, and electrifies an increasing number of sectors, energy storage will become increasingly important to balance supply and demand.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is available</strong>: The <a href="https://www.sandia.gov/ess-ssl/doe-global-energy-storage-database/">DOE Global Energy Storage Database</a> is a harmonized global database that attempts to quantify energy storage capacity across the world.</p> <!-- /wp:paragraph --> <!-- wp:paragraph --> <p><strong>What is missing:</strong> This database is incomplete, with data for many countries missing. It would also benefit from the integration of estimates of electric storage <em>demand</em> today and in the future with decarbonization. This would allow us to track the storage gap that might exist.</p> <!-- /wp:paragraph --> <!-- wp:separator --> <hr class="wp-block-separator"/> <!-- /wp:separator --> <!-- wp:heading {"level":4} --> <h4>Back to the overview of all our work on Energy</h4> <!-- /wp:heading --> <!-- wp:owid/prominent-link {"title":"","linkUrl":"https://ourworldindata.org/energy","className":"is-style-thin"} /--> | {
"id": "wp-45801",
"slug": "energy-missing-data",
"content": {
"toc": [],
"body": [
{
"type": "text",
"value": [
{
"text": "Below we list the key metrics on this topic that we think are missing from our coverage on ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "Our World in Data",
"spanType": "span-simple-text"
}
],
"spanType": "span-italic"
},
{
"text": ". These are metrics we think are critical to understand the problem and build solutions.\u00a0",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "The reason we list this missing data is because we are often asked by funders or researchers for examples of work that would provide a high-value return. This list should provide a useful reference for impactful projects to support. We believe these data gaps are important to fill; doing so would provide a lot of benefit.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "There are several possible reasons why a particular metric or dataset is not available:",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "list",
"items": [
{
"type": "text",
"value": [
{
"text": "Many are fundamental knowledge gaps where the relevant data or research simply ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "does not exist at all",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": ".",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Some are gaps where the data ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "does",
"spanType": "span-simple-text"
}
],
"spanType": "span-italic"
},
{
"text": " exist but it is ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "not in the public domain",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": ". It is privately licensed or locked behind paywalls.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Some are gaps where the existing data is very ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "low-quality, outdated, or has poor coverage",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": ".",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Some are gaps where the data is published by some countries but it ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "has not been aggregated",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": " into regional or global datasets.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "If you are aware of existing data or research which fills these gaps, please do get in touch at ",
"spanType": "span-simple-text"
},
{
"url": "mailto:[email protected]",
"children": [
{
"text": "[email protected]",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ".\u00a0",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "It\u2019s important that these datasets are regularly updated; and are open-access for everyone to use.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Electricity access at higher thresholds of electricity use",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available:",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": " Data on access to electricity \u2013 presented as the share of the population with access to electricity \u2013 is available globally. The World Bank publishes this data, which we make available ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity",
"children": [
{
"children": [
{
"text": "here",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
}
],
"spanType": "span-link"
},
{
"text": ".",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "The threshold in the available statistics for what it means to have \u2018access to electricity\u2019 is very low. This issue is explained ",
"spanType": "span-simple-text"
},
{
"url": "https://www.energyforgrowth.org/report/modern-energy-minimum/",
"children": [
{
"text": "here",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ". This means that a large number of people is counted as \u2018having access to electricity\u2019 which in fact only have very little access \u2013 we explain this problem in the middle-section of ",
"spanType": "span-simple-text"
},
{
"url": "https://www.energyforgrowth.org/report/modern-energy-minimum/",
"children": [
{
"text": "this essay on energy poverty",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ".",
"spanType": "span-simple-text"
},
{
"spanType": "span-newline"
},
{
"spanType": "span-newline"
},
{
"text": "It would be valuable to understand access and electricity use across higher thresholds as well. in one dataset that aggregates this information for countries around the world. For example, the share of people who consume x units of electricity per day; or electricity for at least x hours per day. Where x units of electricity is representative of a sufficient amount to complete standard household tasks. This would give us information on the distribution of electricity usage rather than the average. It would also allow us to understand inequalities in electricity consumption across a population.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "As far as we are aware, this data does not currently exist.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Affordability of energy",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "For many households, energy can come at a high cost. It can account for a large share of their income \u2013 making it compete with other essentials such as food and shelter. This means many are living in energy poverty.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "Data on global fuel prices (e.g. coal or oil prices) exists, from sources such as the BP Statistical Review or energy market data. Some countries (for example, ",
"spanType": "span-simple-text"
},
{
"url": "https://www.gov.uk/government/collections/fuel-poverty-statistics",
"children": [
{
"text": "the UK",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ") publish national statistics on fuel poverty.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "There is, as far as I am aware, no harmonized global data on the cost of energy in households (or for the end user) across the world. Nor are there comparisons to how this relates to the income of people in these countries. This means we lack the data we need to understand the depths of energy poverty globally.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "A dataset which brings today\u2019s energy costs across the world would provide a lot of value in helping to answer this question.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Reliability of electricity supply",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Having access to electricity does not guarantee that is is reliable and available when it\u2019s needed the most.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "Data on access to electricity \u2013 presented as the share of the population with access to electricity \u2013 is available globally. The World Bank publishes this data, which we make available ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity",
"children": [
{
"children": [
{
"text": "here",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
}
],
"spanType": "span-link"
},
{
"text": ". This does not tell us how reliable this supply is.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing:",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": " No global, continuously maintained data exists on the reliability of electricity \u2013 when and how frequently blackouts occur \u2013 across the world. This would be an important measure to track progress on energy access.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Final energy consumption",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "We have good data on ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "primary",
"spanType": "span-simple-text"
}
],
"spanType": "span-italic"
},
{
"text": " energy \u2013 the total amount of energy generated from all sources.",
"spanType": "span-simple-text"
},
{
"spanType": "span-newline"
},
{
"spanType": "span-newline"
},
{
"text": "Primary energy includes energy that is finally consumed, plus energy that is wasted as heat in the combustion of fossil fuels. This measure is useful, but it does not represent the amount of energy we would need to produce in a low-carbon economy, and our rate of progress on decarbonization. Since a large amount of primary energy from fossil fuels is wasted as heat, we would need to produce much less energy from alternative sources to replace fossil fuel energy supplies.\u00a0",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "Final energy consumption, which removes these losses in the combustion process. It is primary energy ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "minus",
"spanType": "span-simple-text"
}
],
"spanType": "span-italic"
},
{
"text": " these losses from heat.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Some individual countries publish this data (see the UK as ",
"spanType": "span-simple-text"
},
{
"url": "https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/904503/UK_Energy_in_Brief_2020.pdf",
"children": [
{
"text": "an example",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": "). Some regions \u2013 for example, the European Environmental Agency \u2013 also ",
"spanType": "span-simple-text"
},
{
"url": "https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment",
"children": [
{
"text": "publishes final energy",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " estimates. But, unfortunately, there are few harmonized global datasets. The ",
"spanType": "span-simple-text"
},
{
"url": "http://data.un.org/Explorer.aspx?d=EDATA",
"children": [
{
"text": "UN Energy Division",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " makes some data publicly available.\u00a0",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "The most comprehensive dataset \u2013 which includes this data \u2013 is published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/iea-open-data",
"children": [
{
"text": "made an open call",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " for this data to be made public.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Final energy consumption is one of the most important energy metrics (perhaps the most important one) and it is unacceptable that no global, publicly usable dataset exists.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Final energy consumption by source",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "See above \u2013 \u2018Final energy consumption\u2019. This also applies to the breakdown of final energy consumption by source: how much comes from fossil fuels, renewables and nuclear energy.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Primary energy consumption (low-income countries)",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "Up-to-date data on primary energy consumption is available for most countries in publicly available datasets, such as the BP Statistical Review of World Energy. We present this data ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/explorers/energy?facet=none&country=USA~GBR~CHN~OWID_WRL~IND~BRA~ZAF&Total+or+Breakdown=Total&Energy+or+Electricity=Primary+energy&Metric=Annual+consumption",
"children": [
{
"text": "here",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ". However, some low-income countries are absent from these datasets.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing:",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": " Unfortunately many low income countries are absent from the BP dataset. We try to supplement this with other public sources, such as the ",
"spanType": "span-simple-text"
},
{
"url": "https://www.theshiftdataportal.org/energy",
"children": [
{
"text": "SHIFT Data Portal",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ". However, this data is not up-to-date and only extends to 2016.\u00a0",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "Complete global data on primary energy is available from organizations such as the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/iea-open-data",
"children": [
{
"text": "made an open call",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " for this data to be made public.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Energy use by sector and sub-sector",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "It would be useful to know how our energy is used: how much is used for electricity in households; how much in cars; how much in global aviation.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "Some countries publish data on the allocation of energy to end use sectors (for example, ",
"spanType": "span-simple-text"
},
{
"url": "https://www.ons.gov.uk/economy/environmentalaccounts/datasets/ukenvironmentalaccountsenergyusebyindustrysourceandfuel",
"children": [
{
"text": "the UK",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " and ",
"spanType": "span-simple-text"
},
{
"url": "https://www.eia.gov/energyexplained/use-of-energy/",
"children": [
{
"text": "the US",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": "). Some regions also publish aggregated datasets \u2013 such as the ",
"spanType": "span-simple-text"
},
{
"url": "https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment",
"children": [
{
"text": "European Environment Agency",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": ".\u00a0 Often these estimates are only available at high-level sectors and do not provide breakdowns by sub-sector. For example, they stop at allocation to \u2018transportation\u2019 which further breakdown of \u2018road, rail, aviation\u2019.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing: ",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": "An open-access global dataset with sector-by-sector data for all countries. Ideally, this would be available at the sub-sector level.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "This data is included in data published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have ",
"spanType": "span-simple-text"
},
{
"url": "https://ourworldindata.org/iea-open-data",
"children": [
{
"text": "made an open call",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " for this data to be made public.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Electrical storage capacity and demand",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"type": "text",
"value": [
{
"text": "As the world moves towards more low-carbon energy sources, and electrifies an increasing\u00a0 number of sectors, energy storage will become increasingly important to balance supply and demand.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is available",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": ": The ",
"spanType": "span-simple-text"
},
{
"url": "https://www.sandia.gov/ess-ssl/doe-global-energy-storage-database/",
"children": [
{
"text": "DOE Global Energy Storage Database",
"spanType": "span-simple-text"
}
],
"spanType": "span-link"
},
{
"text": " is a harmonized global database that attempts to quantify energy storage capacity across the world.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"type": "text",
"value": [
{
"children": [
{
"text": "What is missing:",
"spanType": "span-simple-text"
}
],
"spanType": "span-bold"
},
{
"text": " This database is incomplete, with data for many countries missing. It would also benefit from the integration of estimates of electric storage ",
"spanType": "span-simple-text"
},
{
"children": [
{
"text": "demand",
"spanType": "span-simple-text"
}
],
"spanType": "span-italic"
},
{
"text": " today and in the future with decarbonization. This would allow us to track the storage gap that might exist.",
"spanType": "span-simple-text"
}
],
"parseErrors": []
},
{
"text": [
{
"text": "Back to the overview of all our work on Energy",
"spanType": "span-simple-text"
}
],
"type": "heading",
"level": 2,
"parseErrors": []
},
{
"url": "https://ourworldindata.org/energy",
"type": "prominent-link",
"title": "",
"description": "",
"parseErrors": []
}
],
"type": "article",
"title": "Missing Data on Energy: Our list of datasets that are needed but are not available",
"authors": [
"Hannah Ritchie"
],
"excerpt": "What are the key datasets on global energy that the world needs, but are not publicly available?",
"dateline": "November 8, 2021",
"subtitle": "What are the key datasets on global energy that the world needs, but are not publicly available?",
"sidebar-toc": false,
"featured-image": "OWID-background-map.png"
},
"createdAt": "2021-11-08T15:46:04.000Z",
"published": false,
"updatedAt": "2023-10-10T09:27:11.000Z",
"revisionId": null,
"publishedAt": "2021-11-08T15:46:04.000Z",
"relatedCharts": [],
"publicationContext": "listed"
} |
{
"errors": [
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag list"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
},
{
"name": "unhandled html tag found",
"details": "Encountered the unhandled tag hr"
},
{
"name": "unexpected wp component tag",
"details": "Found unhandled wp:comment tag separator"
}
],
"numBlocks": 42,
"numErrors": 19,
"wpTagCounts": {
"list": 1,
"column": 2,
"columns": 1,
"heading": 9,
"paragraph": 31,
"separator": 9,
"owid/prominent-link": 1
},
"htmlTagCounts": {
"p": 31,
"h4": 9,
"hr": 9,
"ul": 1,
"div": 3
}
} |
2021-11-08 15:46:04 | 2024-02-16 14:22:52 | 1iFM1-niv0J6JPl8fvHvE3T0R_J2w-4me8OcBhpLhYaQ | [
"Hannah Ritchie"
] |
What are the key datasets on global energy that the world needs, but are not publicly available? | 2021-11-08 15:46:04 | 2023-10-10 09:27:11 | https://ourworldindata.org/wp-content/uploads/2020/05/OWID-background-map.png | {} |
Below we list the key metrics on this topic that we think are missing from our coverage on _Our World in Data_. These are metrics we think are critical to understand the problem and build solutions. The reason we list this missing data is because we are often asked by funders or researchers for examples of work that would provide a high-value return. This list should provide a useful reference for impactful projects to support. We believe these data gaps are important to fill; doing so would provide a lot of benefit. There are several possible reasons why a particular metric or dataset is not available: * Many are fundamental knowledge gaps where the relevant data or research simply **does not exist at all**. * Some are gaps where the data _does_ exist but it is **not in the public domain**. It is privately licensed or locked behind paywalls. * Some are gaps where the existing data is very **low-quality, outdated, or has poor coverage**. * Some are gaps where the data is published by some countries but it **has not been aggregated** into regional or global datasets. If you are aware of existing data or research which fills these gaps, please do get in touch at [[email protected]](mailto:[email protected]). It’s important that these datasets are regularly updated; and are open-access for everyone to use. ## Electricity access at higher thresholds of electricity use **What is available:** Data on access to electricity – presented as the share of the population with access to electricity – is available globally. The World Bank publishes this data, which we make available [**here**](https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity). **What is missing: **The threshold in the available statistics for what it means to have ‘access to electricity’ is very low. This issue is explained [here](https://www.energyforgrowth.org/report/modern-energy-minimum/). This means that a large number of people is counted as ‘having access to electricity’ which in fact only have very little access – we explain this problem in the middle-section of [this essay on energy poverty](https://www.energyforgrowth.org/report/modern-energy-minimum/). It would be valuable to understand access and electricity use across higher thresholds as well. in one dataset that aggregates this information for countries around the world. For example, the share of people who consume x units of electricity per day; or electricity for at least x hours per day. Where x units of electricity is representative of a sufficient amount to complete standard household tasks. This would give us information on the distribution of electricity usage rather than the average. It would also allow us to understand inequalities in electricity consumption across a population. As far as we are aware, this data does not currently exist. ## Affordability of energy For many households, energy can come at a high cost. It can account for a large share of their income – making it compete with other essentials such as food and shelter. This means many are living in energy poverty. **What is available: **Data on global fuel prices (e.g. coal or oil prices) exists, from sources such as the BP Statistical Review or energy market data. Some countries (for example, [the UK](https://www.gov.uk/government/collections/fuel-poverty-statistics)) publish national statistics on fuel poverty. **What is missing: **There is, as far as I am aware, no harmonized global data on the cost of energy in households (or for the end user) across the world. Nor are there comparisons to how this relates to the income of people in these countries. This means we lack the data we need to understand the depths of energy poverty globally. A dataset which brings today’s energy costs across the world would provide a lot of value in helping to answer this question. ## Reliability of electricity supply Having access to electricity does not guarantee that is is reliable and available when it’s needed the most. **What is available: **Data on access to electricity – presented as the share of the population with access to electricity – is available globally. The World Bank publishes this data, which we make available [**here**](https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity). This does not tell us how reliable this supply is. **What is missing:** No global, continuously maintained data exists on the reliability of electricity – when and how frequently blackouts occur – across the world. This would be an important measure to track progress on energy access. ## Final energy consumption **What is available: **We have good data on _primary_ energy – the total amount of energy generated from all sources. Primary energy includes energy that is finally consumed, plus energy that is wasted as heat in the combustion of fossil fuels. This measure is useful, but it does not represent the amount of energy we would need to produce in a low-carbon economy, and our rate of progress on decarbonization. Since a large amount of primary energy from fossil fuels is wasted as heat, we would need to produce much less energy from alternative sources to replace fossil fuel energy supplies. **What is missing: **Final energy consumption, which removes these losses in the combustion process. It is primary energy _minus_ these losses from heat. Some individual countries publish this data (see the UK as [an example](https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/904503/UK_Energy_in_Brief_2020.pdf)). Some regions – for example, the European Environmental Agency – also [publishes final energy](https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment) estimates. But, unfortunately, there are few harmonized global datasets. The [UN Energy Division](http://data.un.org/Explorer.aspx?d=EDATA) makes some data publicly available. The most comprehensive dataset – which includes this data – is published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have [made an open call](https://ourworldindata.org/iea-open-data) for this data to be made public. Final energy consumption is one of the most important energy metrics (perhaps the most important one) and it is unacceptable that no global, publicly usable dataset exists. ## Final energy consumption by source See above – ‘Final energy consumption’. This also applies to the breakdown of final energy consumption by source: how much comes from fossil fuels, renewables and nuclear energy. ## Primary energy consumption (low-income countries) **What is available: **Up-to-date data on primary energy consumption is available for most countries in publicly available datasets, such as the BP Statistical Review of World Energy. We present this data [here](https://ourworldindata.org/explorers/energy?facet=none&country=USA~GBR~CHN~OWID_WRL~IND~BRA~ZAF&Total+or+Breakdown=Total&Energy+or+Electricity=Primary+energy&Metric=Annual+consumption). However, some low-income countries are absent from these datasets. **What is missing:** Unfortunately many low income countries are absent from the BP dataset. We try to supplement this with other public sources, such as the [SHIFT Data Portal](https://www.theshiftdataportal.org/energy). However, this data is not up-to-date and only extends to 2016. Complete global data on primary energy is available from organizations such as the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have [made an open call](https://ourworldindata.org/iea-open-data) for this data to be made public. ## Energy use by sector and sub-sector It would be useful to know how our energy is used: how much is used for electricity in households; how much in cars; how much in global aviation. **What is available: **Some countries publish data on the allocation of energy to end use sectors (for example, [the UK](https://www.ons.gov.uk/economy/environmentalaccounts/datasets/ukenvironmentalaccountsenergyusebyindustrysourceandfuel) and [the US](https://www.eia.gov/energyexplained/use-of-energy/)). Some regions also publish aggregated datasets – such as the [European Environment Agency](https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment). Often these estimates are only available at high-level sectors and do not provide breakdowns by sub-sector. For example, they stop at allocation to ‘transportation’ which further breakdown of ‘road, rail, aviation’. **What is missing: **An open-access global dataset with sector-by-sector data for all countries. Ideally, this would be available at the sub-sector level. This data is included in data published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have [made an open call](https://ourworldindata.org/iea-open-data) for this data to be made public. ## Electrical storage capacity and demand As the world moves towards more low-carbon energy sources, and electrifies an increasing number of sectors, energy storage will become increasingly important to balance supply and demand. **What is available**: The [DOE Global Energy Storage Database](https://www.sandia.gov/ess-ssl/doe-global-energy-storage-database/) is a harmonized global database that attempts to quantify energy storage capacity across the world. **What is missing:** This database is incomplete, with data for many countries missing. It would also benefit from the integration of estimates of electric storage _demand_ today and in the future with decarbonization. This would allow us to track the storage gap that might exist. ## Back to the overview of all our work on Energy ### https://ourworldindata.org/energy | {
"id": 45801,
"date": "2021-11-08T15:46:04",
"guid": {
"rendered": "https://owid.cloud/?p=45801"
},
"link": "https://owid.cloud/energy-missing-data",
"meta": {
"owid_publication_context_meta_field": []
},
"slug": "energy-missing-data",
"tags": [],
"type": "post",
"title": {
"rendered": "Missing Data on Energy: Our list of datasets that are needed but are not available"
},
"_links": {
"self": [
{
"href": "https://owid.cloud/wp-json/wp/v2/posts/45801"
}
],
"about": [
{
"href": "https://owid.cloud/wp-json/wp/v2/types/post"
}
],
"author": [
{
"href": "https://owid.cloud/wp-json/wp/v2/users/17",
"embeddable": true
}
],
"curies": [
{
"href": "https://api.w.org/{rel}",
"name": "wp",
"templated": true
}
],
"replies": [
{
"href": "https://owid.cloud/wp-json/wp/v2/comments?post=45801",
"embeddable": true
}
],
"wp:term": [
{
"href": "https://owid.cloud/wp-json/wp/v2/categories?post=45801",
"taxonomy": "category",
"embeddable": true
},
{
"href": "https://owid.cloud/wp-json/wp/v2/tags?post=45801",
"taxonomy": "post_tag",
"embeddable": true
}
],
"collection": [
{
"href": "https://owid.cloud/wp-json/wp/v2/posts"
}
],
"wp:attachment": [
{
"href": "https://owid.cloud/wp-json/wp/v2/media?parent=45801"
}
],
"version-history": [
{
"href": "https://owid.cloud/wp-json/wp/v2/posts/45801/revisions",
"count": 9
}
],
"wp:featuredmedia": [
{
"href": "https://owid.cloud/wp-json/wp/v2/media/33236",
"embeddable": true
}
],
"predecessor-version": [
{
"id": 58233,
"href": "https://owid.cloud/wp-json/wp/v2/posts/45801/revisions/58233"
}
]
},
"author": 17,
"format": "standard",
"status": "publish",
"sticky": false,
"content": {
"rendered": "\n<div class=\"wp-block-columns\">\n<div class=\"wp-block-column\">\n<p>Below we list the key metrics on this topic that we think are missing from our coverage on <em>Our World in Data</em>. These are metrics we think are critical to understand the problem and build solutions. </p>\n\n\n\n<p>The reason we list this missing data is because we are often asked by funders or researchers for examples of work that would provide a high-value return. This list should provide a useful reference for impactful projects to support. We believe these data gaps are important to fill; doing so would provide a lot of benefit.</p>\n\n\n\n<p>There are several possible reasons why a particular metric or dataset is not available:</p>\n\n\n\n<ul><li>Many are fundamental knowledge gaps where the relevant data or research simply <strong>does not exist at all</strong>.</li><li>Some are gaps where the data <em>does</em> exist but it is <strong>not in the public domain</strong>. It is privately licensed or locked behind paywalls.</li><li>Some are gaps where the existing data is very <strong>low-quality, outdated, or has poor coverage</strong>.</li><li>Some are gaps where the data is published by some countries but it <strong>has not been aggregated</strong> into regional or global datasets.</li></ul>\n\n\n\n<p>If you are aware of existing data or research which fills these gaps, please do get in touch at <a href=\"mailto:[email protected]\">[email protected]</a>. </p>\n\n\n\n<p>It\u2019s important that these datasets are regularly updated; and are open-access for everyone to use.</p>\n</div>\n\n\n\n<div class=\"wp-block-column\"></div>\n</div>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Electricity access at higher thresholds of electricity use</h4>\n\n\n\n<p><strong>What is available:</strong> Data on access to electricity \u2013 presented as the share of the population with access to electricity \u2013 is available globally. The World Bank publishes this data, which we make available <a href=\"https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity\"><strong>here</strong></a>.</p>\n\n\n\n<p><strong>What is missing: </strong>The threshold in the available statistics for what it means to have \u2018access to electricity\u2019 is very low. This issue is explained <a href=\"https://www.energyforgrowth.org/report/modern-energy-minimum/\">here</a>. This means that a large number of people is counted as \u2018having access to electricity\u2019 which in fact only have very little access \u2013 we explain this problem in the middle-section of <a href=\"https://www.energyforgrowth.org/report/modern-energy-minimum/\">this essay on energy poverty</a>.<br><br>It would be valuable to understand access and electricity use across higher thresholds as well. in one dataset that aggregates this information for countries around the world. For example, the share of people who consume x units of electricity per day; or electricity for at least x hours per day. Where x units of electricity is representative of a sufficient amount to complete standard household tasks. This would give us information on the distribution of electricity usage rather than the average. It would also allow us to understand inequalities in electricity consumption across a population.</p>\n\n\n\n<p>As far as we are aware, this data does not currently exist.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Affordability of energy</h4>\n\n\n\n<p>For many households, energy can come at a high cost. It can account for a large share of their income \u2013 making it compete with other essentials such as food and shelter. This means many are living in energy poverty.</p>\n\n\n\n<p><strong>What is available: </strong>Data on global fuel prices (e.g. coal or oil prices) exists, from sources such as the BP Statistical Review or energy market data. Some countries (for example, <a href=\"https://www.gov.uk/government/collections/fuel-poverty-statistics\">the UK</a>) publish national statistics on fuel poverty.</p>\n\n\n\n<p><strong>What is missing: </strong>There is, as far as I am aware, no harmonized global data on the cost of energy in households (or for the end user) across the world. Nor are there comparisons to how this relates to the income of people in these countries. This means we lack the data we need to understand the depths of energy poverty globally.</p>\n\n\n\n<p>A dataset which brings today\u2019s energy costs across the world would provide a lot of value in helping to answer this question.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Reliability of electricity supply</h4>\n\n\n\n<p>Having access to electricity does not guarantee that is is reliable and available when it\u2019s needed the most.</p>\n\n\n\n<p><strong>What is available: </strong>Data on access to electricity \u2013 presented as the share of the population with access to electricity \u2013 is available globally. The World Bank publishes this data, which we make available <a href=\"https://ourworldindata.org/grapher/share-of-the-population-with-access-to-electricity\"><strong>here</strong></a>. This does not tell us how reliable this supply is.</p>\n\n\n\n<p><strong>What is missing:</strong> No global, continuously maintained data exists on the reliability of electricity \u2013 when and how frequently blackouts occur \u2013 across the world. This would be an important measure to track progress on energy access.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Final energy consumption</h4>\n\n\n\n<p><strong>What is available: </strong>We have good data on <em>primary</em> energy \u2013 the total amount of energy generated from all sources.<br><br>Primary energy includes energy that is finally consumed, plus energy that is wasted as heat in the combustion of fossil fuels. This measure is useful, but it does not represent the amount of energy we would need to produce in a low-carbon economy, and our rate of progress on decarbonization. Since a large amount of primary energy from fossil fuels is wasted as heat, we would need to produce much less energy from alternative sources to replace fossil fuel energy supplies. </p>\n\n\n\n<p><strong>What is missing: </strong>Final energy consumption, which removes these losses in the combustion process. It is primary energy <em>minus</em> these losses from heat.</p>\n\n\n\n<p>Some individual countries publish this data (see the UK as <a href=\"https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/904503/UK_Energy_in_Brief_2020.pdf\">an example</a>). Some regions \u2013 for example, the European Environmental Agency \u2013 also <a href=\"https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment\">publishes final energy</a> estimates. But, unfortunately, there are few harmonized global datasets. The <a href=\"http://data.un.org/Explorer.aspx?d=EDATA\">UN Energy Division</a> makes some data publicly available. </p>\n\n\n\n<p>The most comprehensive dataset \u2013 which includes this data \u2013 is published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href=\"https://ourworldindata.org/iea-open-data\">made an open call</a> for this data to be made public.</p>\n\n\n\n<p>Final energy consumption is one of the most important energy metrics (perhaps the most important one) and it is unacceptable that no global, publicly usable dataset exists.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Final energy consumption by source</h4>\n\n\n\n<p>See above \u2013 \u2018Final energy consumption\u2019. This also applies to the breakdown of final energy consumption by source: how much comes from fossil fuels, renewables and nuclear energy.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Primary energy consumption (low-income countries)</h4>\n\n\n\n<p><strong>What is available: </strong>Up-to-date data on primary energy consumption is available for most countries in publicly available datasets, such as the BP Statistical Review of World Energy. We present this data <a href=\"https://ourworldindata.org/explorers/energy?facet=none&country=USA~GBR~CHN~OWID_WRL~IND~BRA~ZAF&Total+or+Breakdown=Total&Energy+or+Electricity=Primary+energy&Metric=Annual+consumption\">here</a>. However, some low-income countries are absent from these datasets.</p>\n\n\n\n<p><strong>What is missing:</strong> Unfortunately many low income countries are absent from the BP dataset. We try to supplement this with other public sources, such as the <a href=\"https://www.theshiftdataportal.org/energy\">SHIFT Data Portal</a>. However, this data is not up-to-date and only extends to 2016. </p>\n\n\n\n<p>Complete global data on primary energy is available from organizations such as the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href=\"https://ourworldindata.org/iea-open-data\">made an open call</a> for this data to be made public.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Energy use by sector and sub-sector</h4>\n\n\n\n<p>It would be useful to know how our energy is used: how much is used for electricity in households; how much in cars; how much in global aviation.</p>\n\n\n\n<p><strong>What is available: </strong>Some countries publish data on the allocation of energy to end use sectors (for example, <a href=\"https://www.ons.gov.uk/economy/environmentalaccounts/datasets/ukenvironmentalaccountsenergyusebyindustrysourceandfuel\">the UK</a> and <a href=\"https://www.eia.gov/energyexplained/use-of-energy/\">the US</a>). Some regions also publish aggregated datasets \u2013 such as the <a href=\"https://www.eea.europa.eu/data-and-maps/indicators/final-energy-consumption-by-sector-13/assessment\">European Environment Agency</a>. Often these estimates are only available at high-level sectors and do not provide breakdowns by sub-sector. For example, they stop at allocation to \u2018transportation\u2019 which further breakdown of \u2018road, rail, aviation\u2019.</p>\n\n\n\n<p><strong>What is missing: </strong>An open-access global dataset with sector-by-sector data for all countries. Ideally, this would be available at the sub-sector level.</p>\n\n\n\n<p>This data is included in data published by the IEA. However, despite being almost entirely publicly funded, its licensing policies mean that this data is locked behind a paywall. Since this data is so crucial to understand the energy transition, we have <a href=\"https://ourworldindata.org/iea-open-data\">made an open call</a> for this data to be made public.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Electrical storage capacity and demand</h4>\n\n\n\n<p>As the world moves towards more low-carbon energy sources, and electrifies an increasing number of sectors, energy storage will become increasingly important to balance supply and demand.</p>\n\n\n\n<p><strong>What is available</strong>: The <a href=\"https://www.sandia.gov/ess-ssl/doe-global-energy-storage-database/\">DOE Global Energy Storage Database</a> is a harmonized global database that attempts to quantify energy storage capacity across the world.</p>\n\n\n\n<p><strong>What is missing:</strong> This database is incomplete, with data for many countries missing. It would also benefit from the integration of estimates of electric storage <em>demand</em> today and in the future with decarbonization. This would allow us to track the storage gap that might exist.</p>\n\n\n\n<hr class=\"wp-block-separator\"/>\n\n\n\n<h4>Back to the overview of all our work on Energy</h4>\n\n\n <block type=\"prominent-link\" style=\"is-style-thin\">\n <link-url>https://ourworldindata.org/energy</link-url>\n <title></title>\n <content></content>\n <figure></figure>\n </block>",
"protected": false
},
"excerpt": {
"rendered": "What are the key datasets on global energy that the world needs, but are not publicly available?",
"protected": false
},
"date_gmt": "2021-11-08T15:46:04",
"modified": "2023-10-10T10:27:11",
"template": "",
"categories": [
48
],
"ping_status": "closed",
"authors_name": [
"Hannah Ritchie"
],
"modified_gmt": "2023-10-10T09:27:11",
"comment_status": "closed",
"featured_media": 33236,
"featured_media_paths": {
"thumbnail": "/app/uploads/2020/05/OWID-background-map-150x79.png",
"medium_large": "/app/uploads/2020/05/OWID-background-map-768x402.png"
}
} |
