Dear all,
Thank you for this amazing resource! Its truly a public service that makes a big difference in making information available to all.
I was wondering if there is any way of adding the Oxford Stringency Index database in DB NOMICS? https://www.bsg.ox.ac.uk/research/research-projects/coronavirus-government-response-tracker
Thanks a lot!
Hi @joaoleal,
Thank you very much for your message!
It is totally possible to add the data to DBnomics since they are time series and are freely available. We will add them very soon, thank you for contacting us 
Have a great day,
Enzo
Dear Enzo,
Thanks for the swift reply! I am really happy that it is feasible!
I have a couple of other ideas in mind but I don’t want to abuse your time.
Here in the EC, to monitor economic activity, we also make use of daily measures of NO2 concentrations in several European countries. The data is freely available at the European Environment Agency:
also here
Do you think it would be possible to try to add that as well?
Many thanks!
João
Hi @joaoleal,
Thank you very much for your ideas, these are very interesting data. Particularly the ones at https://www.eea.europa.eu/themes/air/air-quality-and-covid19.
I have downloaded some files from https://discomap.eea.europa.eu/map/fme/AirQualityExport.htm but I have trouble finding the correspondence between the codes and their values. For example where to find the name of the AirQualityStationEoIcode: “AT10003”?
Same question for AirQualityNetwork, Sample, etc…
Finally, I barely understand the names of the CSV files. Let’s take the ‘AT_38_48883_2013_timeseries.csv’ file, for example, I understand that “AT” is the iso code for Austria and “2013” is the year but what does the rest mean?
I figure I can find the answers at https://dd.eionet.europa.eu/vocabularies?expand=true&expanded=&folderId=1#folder-1, but I have been searching for a while and I still don’t find what I am looking for.
Can you help me on that?
Many thanks!
Enzo
Dear Enzo,
Thanks for looking into this!
When I extract the data manually, I usually do so in the “Air quality and COVID-19” website, where at the end of the Tableau there is a download button - after that one can select do extract the full database and there the names of stations appear properly (not in code, but with a more meaningful description :)).
But I think I found some information. The matching of the AirQualityStationEoICode can be found here: http://aided.apps.eea.europa.eu/?source={"query"%3A{"match_all"%3A{}}%2C"display_type"%3A"tabular"}
In this case, AT10003 refers to Kittsee.
Do you think this helps?
Thanks a lot!
Hi @joaoleal,
Thank you very much for your help! The information on AirQualityStationEoICode is very useful so thanks again.
I will see with the DBnomics team if it is possible to integrate these data and I come back to you later
In the meantime, we are integrating data from the EDGAR database of the Joint Research Center of the European Commission EDGAR - EDGAR v5.0 Global Greenhouse Gas Emissions - European Commission, perhaps these data might be useful to you.
Have a great day,
Enzo
Dear Enzo,
Thanks a lot to you and your team! If its too much trouble its probably not worth it.
I had one last request (for the next few weeks :))!
We also monitor daily electricity production in Europe, with data made available by ENTSO-E ( European Network of Transmission System Operators for Electricity). This is useful for many purposes - including monitoring industrial activity in several Member States (after correcting for temperature fluctuations) in almost real time.
The data is available at their transparency platform: Data view
You can select country and then use the actual load to the network at different hours of the day (not the forecast load).
Let me know if feasible
As always, thanks a million!
Best,
João
Hello @joaoleal,
We have been already working a huge amount of time to integrate ENTSOE data on DBnomics. This provider is one of our priorities!
The issue we encounter is that the data we retrieve from the Entsoe API is slightly different from the website’s one. We do not know if it is a problem of time zone or something else and we have been stuck for a long time now.
Do you have any idea of why this problem occurs?
Best regards,
Enzo
Dear Enzo,
I would think it is probably a timezone issue - or maybe you are retrieving the “forecast” rather than the “actual” loads?
I can share with you the database as extracted from our private data provider if it helps!
Dear @joaoleal,
Our problem occurs for “Actual Generation per Production Type” so it is not forecasted data.
We have been investigating the time zone problem by adapting our dates to the time zone of the country we retrieve the data from: sometimes we get the same values but for some dates, there are tiny differences and we do not know why.
Do you have the programming code that extracts this database of yours? It might be of great help to have both
Thank you very much!
Enzo
Unfortunately I do not have access to the programming code… The output is the one attached though. What I noticed sometimes is that the the data for the day of extraction is different but for previous days is fine…
I found the following R package that might be useful though: GitHub - wagnertimo/entsoecrawlR: This R package crawls energy system data of the European Network of Transmission System Operators (ENTSO-E) at https://transparency.entsoe.eu
Also this one with scripts: https://data.open-power-system-data.org/
Sorry if I cannot be of much more help!
Best,
JoãoDBNOMICS_ElectricityConsumption_ENTSO_2nd.7z (2.3 MB) DBNOMICS_ElectricityConsumption_ENTSO_1st.7z (2.9 MB)
Hi @joaoleal,
Entsoe data is available on DBnomics: ENTSOE/ATL | DBnomics.
We have data on Actual Total Load and Actual Generation per Production Type. Thank you very much for using DBnomics !
Have a nice day
Enzo