Challenge 17 - The solar energy dashboard: visualising ECMWF and Copernicus data for the renewable energy community

[RubenRT7]

Challenge 17 - The solar energy dashboard: visualising ECMWF and Copernicus data for the renewable energy community

Stream 1 - Data Visualization and visual narratives for Earth Sciences applications

Goal

Within the framework of the Copernicus Energy Hub, this challenge aims to create an interactive web application that effectively visualises data related to the solar energy sector. The application should combine data from a range of sources, including model output and satellite observations from the Copernicus Atmosphere Monitoring Service (CAMS) and Copernicus Climate Change service (C3S).

Mentors and skills

• Mentors: Nube Gonzalez Reviriego, Edward Comyn-Platt, James Varndell, Julie Letertre, Melanie Ades (all ECMWF)
• Skills required:
  • Python
  • Experience with frontend development e.g. ReactJS
  • Working with large geospatial datasets

---

Challenge description

Copernicus is the Earth observation component of the European Union's space programme, which studies our planet and its environment for the benefit of all European citizens. It provides information based on Earth observation satellites and in-situ (non-space) data through the so-called Copernicus Services.

Both the Copernicus Climate Change Service (C3S) and the Copernicus Atmospheric Monitoring Service (CAMS) are implemented by ECMWF and their products are available through their respective catalogues: the Climate Data Store (CDS) and the Atmospheric Data Store (ADS).

Last year, a new approach to Copernicus information was launched through thematic hubs. And a few months ago, the Copernicus Energy Hub (CEH) was launched by ECMWF, with the aim to illustrate and facilitate the uptake of Copernicus data relevant to the energy sector, and to foster a community of practice around it.

Within this framework, the solar renewable energy sector has been identified as one of the communities more interested in the datasets offered by CAMS and C3S. However, navigating through the large datasets and different catalogues and identifying the relevant data for specific decision making is complex for many users.

The aim of this challenge is to create a user-centric web application that allows solar energy users to visualise, compare and get a first taste of the relevant data before downloading it. The web application must be able to do at least the following:

• Retrieve data from a range of different sources, in particular from the ADS (e.g. CAMS solar radiation time series, CAMS global atmospheric composition forecasts) and the CDS (e.g. ERA5 Land, seasonal forecasts, climate change projections) catalogues, but also from the ECMWF catalogue.

• Produce interactive and effective data visualisations of solar energy related variables (at least solar irradiance for both all and clear sky, but desirable 2m temperature, soil temperature, cloud coverage and dust) at different time scales (historical data, near real time data, next days data, next months data and next years data).

• Include a functionality that allows users to select specific sites (geographical coordinates) within a global map.

• To ensure the web-application is responsive, the data storage format should permit high-performance reading.

[mahmoud-alqiaty]

Hi!
We are a web development team in the egyptian Meteorological Authority (EMA).
we have read this challenge (i.e. No:17), but the requirements description not clear enough.
Can you put a comment here with more details so that we can write a proposal?

[trakasa]

Hi @mahmoud-alqiaty,
many thanks for your interest in Code for Earth and this challenge!

As we have different funding sources, including the EU, we need to ensure full compliance with the different applicable rules and regulations. I assume you are all residents and nationals of Egypt, thus unfortunately the eligibility rules do not apply for you.

"ECMWF funding is available for nationals and residents of ECMWF Member States and Co-operating states.
EU funding is available for nationals from European Union Member States, countries associated with EU’s Space Programme (currently Iceland, Norway and United Kingdom) and countries associated with EU’s Digital Europe Programme (currently Albania, Iceland, Lichtenstein, Montenegro, North Macedonia, Norway, Serbia and Türkiye)."

Thus if you are NOT living or a national of the above mentioned countries, you are not eligible to participate in this year's Code for Earth edition.

Still I hope you keep an eye on Code for Earth, rules might change from year to year!

Bye and have a nice WE.

Athina

[irmariad]

Hi,
we are a development team very interested in this challenge. For the implementation of the project, we have some doubts.
We would like to know the sources of the data: Is there a WMS or WFS available to quickly retrieve the datasets or should we find the best way to work directly with CDS/ADS api?

Thanks,
Irma

[trakasa]

Dear @irmariad ,
many thanks for your message!
A colleague will get back to your questions asap after noon...
Stay tuned :-)

Bye, Athina

[JamesVarndell]

Hi @irmariad,

Many thanks for your question!

The data to be visualised will come from a variety of sources, including the CDS and ADS. Data from the CDS/ADS is best accessed using the CDS/ADS API - but the application itself does not necessarily have to access the datasets in this way "on the fly".

For example, you could initially use the CDS API to download a copy of the required data onto a virtual machine, and then set up a WMS or another web service layer on top of that data specifically for use with web applications. We're flexible about the technical solution here, and are keen to explore the available options with you! :)

I hope that helps!
James

[irmariad]

Thank you for the response! That is exactly what we needed to know in order to complete the proposal.
Many thanks,
Irma