ESSI2.9 - Challenges of integrating large infrastructures using the example of ENES-CDI and EOSC, by Hannes Thiemann et al.
ESSI3.5 - Provenance powered microservices: a flexible and generic approach fostering reproducible research in Earth Science, by Alessandro Spinuso et al.
Sessions in which IS-ENES3 members are co-conveners
The project Final General Assembly was held on January 16-18, 2023 at the “Centre International de Conférences” on Météo-France campus in Toulouse, France. The workshop was held in a hybrid format with remote attendance possible.
Find the full programme here.
Presentations
IS-ENES3 Overview, Sylvie Joussaume, Bryan Lawrence
Session 1 - Obj. 2 – Models, tools and HPC (incl. Evaluation tools)
Session 2 - Obj. 3 – Exploitation of model data
Session 3 - Obj. 1 - Integration, sustainability and strategy
Session 4 - Introducing new ESM projects
Session 5 - What’s next? IS-ENES in the European and international landscape
Watch the full recording of the CW2023 on our Youtube channel !
The 6th Workshop on Coupling Technologies for Earth System Models (CW2023) will be held on January 18-20, 2023 at the “Centre International de Conférences” on Météo-France campus in Toulouse, France. The workshop will be held in a hybrid format with remote attendance possible.
Find all information on the official webpage.
The International ESGF Hybrid Conference Toulouse/Oak Ridge will be held on January 18-19, 2023 at the “Centre International de Conférences” on Météo-France campus in Toulouse, France, in parallel with the Coupling Workshop 2023. The workshop will be held in two different locations at the same time: Toulouse (France) for the EU side, Oak Ridge (USA) for the American side, with a visioconference system to link both places.
Find the full programme here
2022 CF Workshop will take place on 13-15 September 2022 hosted by IFCA at Santander (Spain). After 2 successful virtual editions (2020 and 2021), the 2022 edition is organized as a hybrid event having in-person and on-line participants.
The Climate and Forecast metadata conventions (CF) are a community-developed standard designed to promote the processing and sharing of climate and forecast model and observational output data, and derived data products. The conventions define metadata that provide a definitive description of what the data in each variable represents, and the spatial and temporal properties of the data. This enables users of data from different sources to decide which quantities are comparable, and facilitates building applications with powerful extraction, regridding, and display capabilities. The CF convention includes a standard name table, which defines strings that identify physical quantities.
Find all the information (including the agenda) and the registration procedure on the event official webpage. Registration deadline: 30 August 2022
The first ESMValTool Workshop 2022 took place at DLR Oberpfaffenhofen from 13–15 June as a hybrid meeting. Participants were from BSC, DLR, Met Office, NLeSC, PML, SMHI, U Bremen and U Reading. The main goal of the workshop was to bring together the development community, discuss future strategies and provide updates on progress since the last workshop in November 2022.
Find the detailed workshop report here
Watch the recording of the workshop on our YouTube channel !
Find all details about this workshop on the ENES Portal
You can find the summary report of the workshop here
The Second Technical ESMValTool Workshop 2021 took place via video call from 23-25 November 2021 with 34 participants from BSC, DLR, Met Office, NLeSC, PML, SMHI, U Bremen and U Reading. The main goal of the workshop was to bring together the development community, discuss future strategies and provide updates on progress since the last workshop in May 2021. Specifically, the workshop included the following topics and side meetings:
Table of presentations:
9h30-12h30: Session 1 - Plenary session
Time Slot | Author(s) and presentation |
---|---|
9h30-10h15 | Overview of IS-ENES3 - Sylvie Joussaume & Bryan Lawrence |
Update on sustainability (WP2-NA1) - Fanny Adloff | |
10h15-10h55 | NextGEMS – Next Generation Earth Modelling Systems - Björn Stevens, MPI-M |
ESM2025 – Earth System Models for the future - Roland Séférian, MF-CNRM | |
10h55-11h10 | Results from the HPC survey – Claire Lévy, IPSL-LOCEAN |
About the estimation of energy-cost of data transfer – Jean-Claude André | |
11h25-12h30 | General project information, budget assessment for 2022 and reallocations – Sophie Morellon & Sylvie Joussaume |
14h30-16h30: Session 2 - Model Evaluation
Time Slot | Author(s) and presentation |
---|---|
14h30-14h55 | WP debriefings WP3-NA2, WP5-NA4, WP6-VA1, WP7-VA2, WP9-JRA2 - Kim Serradell & Rémi Kazeroni |
14h55-15h45 | Survey results on model evaluation and perspectives – Jérôme Servonnat |
Overview of ESMValTool progress – Rémi Kazeroni | |
Provenance and technical standards (WP3-NA2, WP5-NA4 – Kim Serradell & Javier Vegas | |
15h45-16h30 | Model Evaluation: cross-workpackage issues |
10h-12h: Session 3 - Data, metadata and other data software
Time Slot | Author(s) and presentation |
---|---|
10h-10h25 | WP debriefings (WP5-NA4, WP7-VA2, WP10-JRA3) |
10h25-11h25 | ESGF architecture – Philip Kershaw |
Climate4impact portal 2.0 – Alessandro Spinuso | |
Update on user requirements (including climate indices) – Janette Bessembinder | |
ES-DOC – Sadie Bartholomew | |
11h25-12h | Data, metadata and other data software: cross-workpackage issues and introduction to breakout groups |
14h30-16h30: Session 4 - Models, Tools and HPC
Time Slot | Author(s) and presentation |
---|---|
14h30-14h55 | WP debriefings (WP4-NA3, WP6-VA1, WP8-JRA1) |
14h55-15h55 | Recent developments in XIOS – Yann Meurdesoif |
Update on Cylc/Rose – David Matthews | |
Update on NEMO Sea Ice model – Ed Blockley & Martin Vancoppenolle | |
NEMO HPC Working Group – Italo Epicoco | |
15h55-16h35 | Models, Tools and HPC: cross-workpackage issues and introduction to breakout groups |
The IS-ENES3 Virtual First General Assembly was held on the 25th-27th of March 2020. Initially planned in Toulouse (Centre International de Conférences), the Covid-19 situation compelled the project to turn it into a remote meeting. More than 100 persons joined throughout the three days to attend presentations of the project activities (organized in sessions according to the three main themes: Data, metadata and software; Models, tools and HPC; model Evaluation) and participate to discussions on various topics.
Find the presentations within the agenda, by clicking on the title of the presentations.
Agenda
Time Slot | Author(s) and presentation |
---|---|
10h-10h15 | Overview of IS-ENES3 - Sylvie Joussaume & Bryan Lawrence |
10h20-10h35 | Introduction to sustainability (WP2-NA1) - Michael Lautenschlager, Fanny Adloff |
10h50-11h00 | Introduction to user engagement - Janette Bessembinder, Eric Guilyardi |
11h00-11h15 | Downstream data usage – Janette Bessembinder |
11h45-12h05 | Introduction to innovation (including Copernicus C3S) – Martin Juckes, Fanny Adloff |
12h20-12h20 | Preparing the RP1 report – Sophie Morellon |
12h30-12h40 | Autumn Data School – Judith Klostermann |
12h40-12h50 | Carbon Footprint working group – Sophie Valcke et al. |
14h30-17h30 Session 2: Data, metadata and other software
Time Slot | Author(s) and presentation |
---|---|
14h30-14h45 | WP debriefings: WP5-NA4, WP7-VA2, WP10-JRA3 - Phil Kershaw, Klaus Zimmermann, Stephan Kindermann, Wim Som de Cerff, Sandro Fiore, Christian Pagé |
14h55-15h10 | Status of ESGF for CMIP6 - Stephan Kindermann |
15h10-15h25 | Status of ES-DOC for CMIP6 - David Hassell |
15h25-15h40 | Perspectives on possible Future architecture for ESGF – Philip Kershaw |
15h40-15h55 | Perspectives on compute services for ESGF – Sandro Fiore |
16h35-16h45 | Data, metadata and other data software: presentation of cross-WP issues |
Time Slot | Author(s) and presentation |
---|---|
10h-10h15 | WP debriefings: WP4-NA3, WP6-VA1, WP8-JRA1 - Jean-Christophe Rioual, Mario Acosta, Uwe Fladrich, Eric Maisonnave, Sophie Valcke, Italo Epicoco |
10h25-10h35 | Cylc and Rose: latest news) - David Matthews |
10h35-10h45 | XIOS: where are we and example of use - Yann Meuredesoif |
10h45-10h55 | OASIS3-MCT latest news – Sophie Valcke |
11h20-11h35 | European sea ice modelling integrated initiative – Ed Blockley, Martin Vancopenolle |
11h35-11h50 | NEMO: improving performance results from IS-ENES3 and other projects (ESiWACE2, IMMERSE) – Italo Epicoco |
11h50-12h05 | Model performance: results for CMIP6 – Mario Acosta |
12h20-12h30 | Models, tools, HPC: presentation of cross-WP issues – Sophie Valcke et al. |
12h30-12h45 | Innovation for “Models, Tools and HPC” – Graham Riley |
12h45-13h | Machine learning/AI – Graham Riley |
14h30-17h30 - Session 4: Model Evaluation
Time Slot | Author(s) and presentation |
---|---|
14h30-14h50 | WP debriefings: WP3-NA2, WP5-NA4, WP6-VA1, WP7-VA2, WP9-JRA2 - Eric Guilyardi, Klaus Zimmermann, Uwe Fladrich, Stephan Kindermann, Björn Brötz, Kim Serradell |
15h05-15h25 | ESMValTool (IS-ENES3 and CRESCENDO) - Björn Brötz |
15h25-15h40 | Update on interfacing the CLIVAR ENSO package with ESMValTool - Eric Guilyardi, Javier Vegas-Regidor, Kim Serradell, Yann Planton |
16h10-16h20 | Model Evaluation: Presentation of cross-workpackage issues |
Data, metadata and other software
Time Slot | Author(s) and presentation |
---|---|
10h-11h | Model Evaluation, C4I and link with the Compute Service – Björn Brötz, Christian Pagé |
11h-12h | ENES CDI – Sandro Fiore, Stephan Kindermann |
12h-13h | ESGF Future Architecture – Mario Acosta |
Models, tools and HPC
Time Slot | Author(s) and presentation |
---|---|
10h-11h30 | XIOS benchmarks – Sophie Valcke, Mario Acosta |
11h30-13h | Computational evaluation of ESMs, including coupling issues (LUCIA) and energy consumption – Mario Acosta |
14h/14h30-16h/16h30 - Session 6: “Around coffee” parallel discussions
Time Slot | Author(s) and presentation |
---|---|
14h30-16h | Carbon footprint group - Sophie Valcke |
14h30-15h15 | Copernicus and climate projections - Martin Juckes |
15h15-16h30 | Climate indices standards - Lars Bärring, Christian Pagé |
Sep 27, 2021 from 11:00 AM to 03:00 PM
The IS-ENES3 consortium organizes an online workshop ‘Climate indices - Eastern European perspective’. The workshop will be an online effort to collect information on the current status about usage and implementation of different climate indices in the region, which will be the starting point to draft requirements and recommendations for the future. It will be organized as two online meetings, combined with online surveys and online interviews between them.
The aim of the workshop? Used by a broad user community for many applications outside the climate science community, climate indices provide compact information on key physical parameters. A reference specification of the indices has been developed by joint CCl/CLIVAR/JCOMM Expert Team (ET) on Climate Change Detection and Indices (ETCCDI), and these have been implemented in the ICCLIM tool and many others. The workshop will evaluate and review the usage of existing indices and explore the need for additional ones in these broader and new communities.
Who organizes it? Researchers from the IS-ENES3 consortium. These researchers will interact directly with the workshop participants. Beside many activities, IS-ENES3 project aims at further engaging with the community of users of IS-ENES services, by widening the user base through training, engaging the community in co-constructing standards and expressing needs, and engaging the younger generation in interdisciplinary approaches.
For whom? This workshop is for climate scientists and researchers from different disciplines (agriculture, forestry, water resources, public health etc) that often use different climate indices. We aim to create a mix of different disciplines so that recommendations will follow needs from broad research communities.
What is the programme? The initial online meeting will be organized to present the main goals and planned output of the final workshop together with the discussion on current status and potential future developments. After the meeting the online survey will be initialized together with online interviews, from which a set of recommendations will be drafted. The topics related to the climate indices that will be covered are: indices definition and usage, data sources, software for calculation and visualization, current gaps and limitations.
Contact: vdj[at]ff.bg.ac.rs
Find the final report “M3.5 - Workshop on climate indice - Eastern Europe perspective” here
Presentation | Author(s) |
---|---|
IS-ENES3 project introduction | WP debriefings (WP4-NA3, WP6-VA1, WP8-JRA1) |
Indices workshop goals | Vladimir Djurdjevic (FPUB) |
ETCCDI indices: recap and usage examples | Lars Bärring (SHMI) |
ICCLIM and Climate4impact tool | Christian Pagé (CERFACS) |
Regional perspective: Previous analysis (presentation of ORIENTGATE survey and analysis report) | Aleksandra Krzic (RHMSS/FPUB) |
Next steps: survey, interviews and the planned content of the final report | Vladimir Djurdjevic (FPUB) |
Presentation | Author(s) |
---|---|
Workshop Climate indices - past activities and next steps | Vladimir Djurdjevic (FPUB) |
Changes in temperature extremes in Romania | Adina-Eliza Croitoru et al. (1) Babes-Bolyai University, Romania; 2) JRC, Italy) |
Application of Climate Indices in the Regional Climatology over Southeast Europe | Hristo Chervenkov (National Institute of Meteorology and Hydrology, Bulgaria) |
Use of Climate Indices in R. N. Macedonia: ClimDex and ClimPACT | Aleksandar D. Prodanov (National Hydrometeorological Service, N. Macedonia) |
Sectoral climate indices studies in Turkey | Serhat Şensoy (Turkish State Meteorological Service) |
Operational use of climate indices in RHMSS | Dragan Mihic (Republic Hydrometeorological Service, Serbia) |
Climate indices - Presentation of the survey results | Aleksandra Krzic (RHMSS/FPUB) |
Climate indices report - main conclusions | Vladimir Djurdjevic (FPUB) |
The 2021 CF Workshop will be a virtual meeting on 21-23 September 2021. The meeting will run for three hours on each day, 15:00 to 18:00 UTC, plus an informal hour at the end of each day.
Find the detailed programme here.
This workshop has been supported by the IS-ENES3 project.
The “IS-ENES3 Virtual workshop on requirements for a fast and scalable evaluation workflow” is a web meeting organized in the context of the EU H2020 IS-ENES3 project in close collaboration with the ESMValTool development team.
The workshop aims to bring together leading researchers and software engineers in the field of evaluation frameworks for Earth System Models to discuss users’ requirements, current solutions and to identify gaps and challenges about the next evaluation workflows.
In this workshop, current and future requirements (such as input data size, memory footprint, reproducibility and computation time, among others) will be gathered, producing a complete set of specifications. This will include feedback from the users obtained from the survey performed by Assimila.
Find the detailed agenda here
Day 1 (May 18th)
Presentation | Author(s) |
---|---|
Welcome and general overview from IPCC and other projects | Pierre-Antoine Bretonnière/Kim Serradell, Francisco Doblas-Reyes (BSC) |
Results of the Assimila survey | Zofia Stott (Assimila) |
Analysing CMIP in small groups | Belen Rodríguez de Fonseca (UCM) |
JASMIN: Infrastructure to support a diverse range of scientific use cases | Ag Stephens (STFC) |
BoG1: data storage and distribution | Chair: Pierre-Antoine Bretonnière |
BoG2: data processing machines | Chair: Kim Serradell |
Day 2 (May 19th
Presentation | Author(s) |
---|---|
Results of the Assimila survey | Zofia Stott (Assimila) |
CMIP5 and CMIP6 Mediterranean climate change projections | Josep Cos (BSC) |
User engagement | Niels Drost (NLeSC) |
ESMValTool vs multiple languages | Valeriu Predoi (NCAS) |
Ophidia | Donatello Elia (CMCC) |
Results of the Assimila survey | Zofia Stott (Assimila) |
Synda integration in ESMValTool | Bowe Andela (NLeSC) |
Online model evaluation | Javier Vegas (BSC) |
BoG1: Workflow and Performance | Javier Vegas, Kim Serradell |
BoG2: Reproducibility and provenance | Saskia Loosveldt |
The Technical ESMValTool Workshop took place via video call from 4-6 May 2021 with 23 participants from BSC, DLR, ETH, Met Office, NLeSC, PML, SMHI, U Bremen and U Reading. The main goal of the workshop was to bring together the development community, discuss future strategies and provide updates on progress since the last workshop in November 2020.
Specifically, the workshop included the following topics and presentations: • Overview and strategy for merging IPCC AR6 diagnostics into the official release • ESMValTool June release (v2.3.0) • General discussion on the following topics: naming of versions, support of new NCL diagnostics, automated formatting, ETCCDI, import of native model output, gallery, website • ESMValTool related IS-ENES3 tasks and deliverables • Reviewing and merging open pull requests • Presentation: Introduction of new teams and updates on governance and future strategy • Presentation: Update on improving automated testing of diagnostics • Presentation: Update on Jupyter Notebook capabilities for the ESMValTool
You can find the summary report of the workshop here
Find all the presentations of the EGU2021 here
Watch the recording of the ML/AI workshop on our YouTube channel !
Organised jointly by the H2020 projects IS-ENES3 and ESiWACE2, the workshop was held virtually from the 16th to 18th March 2021 (3.5h per day).
The aim of this workshop was to bring together climate scientists and experts from academia and industry to share knowledge and experience and to identify new opportunities in the areas of machine learning, artificial intelligence and big data techniques for Weather and Climate Modelling.
The workshop was organised around three sessions:
The final agenda is available here. **Find the recording of the talks on the IS-ENES3 Youtube channel, under the event playlist !
The participants’ personal data used for the organisation of the workshop was covered by the following privacy policy
Presentations
Session 1 : Views from Domain Science
Presentation | Author(s) |
---|---|
New approaches based on ML for a range of climate prediction problems | Emily Shuckburgh (U. Cambridge) |
Philosophy and Targeted Applications of ML/AI Techniques for Climate Risk Analytics at Jupiter | Luke Madaus & Steve Sain (Jupiter Intel.) |
The optimization dichotomy: Why is it so hard to improve climate models with machine learning | Stephan Rasp (ClimateAI) |
Improving convection parameterizations with a library of large-eddy simulations | Zhaoyi Shen (Caltech) |
Stochastic Super-Resolution for Convective Regimes using Gaussian Random Fields | Rachel Prudden (Met Office Inf. Lab) |
Subseasonal Forecasts of Opportunity Identified by an Explainable Neural Network | Kirsten Mayer (CSU) |
Using transfer learning and backscattering analysis to build stable, generalizable data-driven subgrid-scale models: A 2D turbulence test case | Pedram Hassanzadeh (U. Rice) |
Session 2: ML/AI Software technologies
Presentation | Author(s) |
---|---|
Stochastic machine learning for atmospheric fields with generative adversarial networks | Jussi Leinonen (MeteoSwiss) |
Causal discovery in time series with unobserved confounders | Andreas Gerhardus (DLR Jena) |
Estimating stochastic closures using sparsity-promoting ensemble Kalman inversion | Jinlong Wu (Caltech) |
Deep Learning on the sphere for weather/climate applications | Gionata Ghiggi and Michaël Defferrard (EPFL) |
Deep learning-based remote sensing for infrastructure damage assessment(https://raw.githubusercontent.com/IS-ENES3/IS-ENES-Website/main/pdf_documents/ | Thomas Chen (AMSE) |
Leveraging physics information in neural networks for fluid flow problems | Akshay Subramaniam (NVIDIA) |
Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models | Jonathan Weyn (U. of Washington) |
Session 3: High performance, Infrastructure and Big data challenges
Presentation | Author(s) |
---|---|
Scaling Up Deep Learning Workloads - A Data-Centric View | Tal Ben-Nun (ETHZ) |
Radar QPE and Machine Learning | Micheal Simpson (NOAA) |
Using ML at the Edge to Improve Data Gathering | Pete Warden (Google) |
An Overview of ML and AI on Arm Based HPC Systems for Weather and Climate Applications | Phil Ridley (Arm) |
Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows | Jan Ackmann (U. Oxford) |
You do you. How next-gen data platforms can stop weather and climate scientists from being software engineers and other perversions | Theo McCaie (MO Informatics Lab) |
3D bias correction with deep learning in the Integrated Forecasting System | Thorsten Kurth (NVIDIA) |
A fourth IS-ENES3 technical workshop will take place on 28-29th January 2021, dedicated to the development of the Climate4impact portal (C4I) and the Compute Services. It will be a virtual meeting, organized by CERFACS.
The main objectives of this workshop is to enable partners, involved in the development of Compute Services of the ENES Climate Data Infrastructure and especially on climate4impact, to work together on specific items, with high collaboration and dedicated full time. It will consist of brainstorming sessions, followed by coding and developments, and a summary of achievements. The brainstorming will be an opportunity to discuss the overall architecture, identifying parts where there is a need of developments and decisions. The actual coding and development sessions will happen in focused groups on identified specific points in the brainstorming session. The summary will be the opportunity to discuss problems and bottlenecks encountered.
Even if the meeting focus is on C4I related work and tasks, it is also the opportunity to develop other parts of the ENES infrastructure that C4I will use.
The Technical ESMValTool Workshop took place via video call from 24-26 November 2020 with 23 participants from U Bremen, NLeSC, BSC, U Reading, PML, SMHI, ENEA, ETH and DLR. The main goal of the workshop was to work on open pull request and draft guidelines for reviewing pull requests.
Specifically, the workshop included the following topics:
See the full workshop report here.
Watch the recording of the CW2020 on our YouTube channel !
Find all details about this workshop on the ENES Portal
A third IS-ENES3 technical workshop will take place from June 16th to June 17th, 2020, dedicated to the development of the Climate4impact portal (C4I) and the Compute Services. It will be a virtual meeting, organized by CERFACS.
The main objectives of this workshop is to enable partners, involved in the development of Compute Services of the ENES Climate Data Infrastructure and especially on climate4impact, to work together on specific items, with high collaboration and dedicated full time. It will consist of brainstorming sessions, followed by coding and developments, and a summary of achievements. The brainstorming will be an opportunity to discuss the overall architecture, identifying parts where there is a need of developments and decisions. The actual coding and development sessions will happen in focused groups on identified specific points in the brainstorming session. The summary will be the opportunity to discuss problems and bottlenecks encountered.
Even if the meeting focus is on C4I related work and tasks, it is also the opportunity to develop other parts of the ENES infrastructure that C4I will use. Learn more about the C4I portal here.
Find the recording of the webinar on the IS-ENES3 YouTube channel !
Program of the webinar Introduction - Janette Bessembinder (KNMI)
During this webinar and demonstration we will explain what the Earth System Grid Federation (ESGF) is and what it does to make climate data available for research.
ESGF is an international open-source effort that disseminates climate model data, observational and reanalysis data free of charge. Short demonstrations will be given on how to access and analyze climate data available through ESGF. This webinar is organized by the IS-ENES3 project, the European part of ESGF, that works on enhancing and improving current climate research infrastructure. The webinar is aimed at users in any scientific or applied domain that need access to climate data, for example, climate modelers performing multi-model comparisons, impact researchers evaluating climate change impacts, climate services providers, etc., at global or regional scales.
Find here the Wrap-up and Conclusions of the 2020 CF Workshop !
The Climate and Forecast (CF) metadata convention for netCDF (netCDF-CF) is a community-developed standard first released in 2003. The CF conventions were originally developed to represent climate and forecast model output encoded in the netCDF binary format, with the specific goal of facilitating comparison of output from different models. Subsequent development of the convention has broadened its scope to include observational data and derived products.
Because of the COVID-19 pandemic situation, the meeting will be virtual from the 9th to 11th of June 2020. The meeting will only run for 3 hours on each day: 16:00 - 19:00 UTC, followed by a short purely social time for those who can, and want to, stay on.
Find the agenda here
Find all the presentations of the EGU2020 here
Find the agenda here
Presentations
Presentation | Author(s) |
---|---|
IPSL/Climate Modelling center | Olivier Boucher |
IS-ENES3 Overview | Sylvie Joussaume |
Challenges related with infrastructure | Bryan Lawrence |
Lessons from the WIP/Vision for the future | V. Balaji |
ExtremeEarth Challenge | Peter Bauer |
WP2-NA1 | Bryan Lawrence, Martin Lautenschlager |
WP3-NA2 | Eric Guilyardi, Janette Bessembinder |
WP4-NA3 | Mick Carter, Mario Acosta |
WP6-VA1 | Uwe Fladrich, Eric Maisonnave |
WP8-JRA1 | Sophie Valcke, Italo Epicoco |
IMMERSE (NEMO) | Julien le Sommer |
ESiWACE2 | Joachim Biercamp |
Presentation | Author(s) |
---|---|
WP5-NA4 | Sébastien Denvil, Klaus Zimmermann |
WP7-VA2 | Stephan Kindermann, Wim Som de Cerff |
WP9-JRA2 | Veronika Eyring, Kim Serradell |
WP10-JRA3 | Sandro Fiore, Christian Pagé |
ESGF in next 3 years | Sébastien Denvil |
Copernicus and C4I portal | Wim Som de Cerff, Christian Pagé |
Involvement of ENES in EOSC and other data project | Stephan Kindermann |
ESMValTool: Legacy of ENES projects | Mick Carter, Björn Brötz |
BoG1: Models, tools and HPC | Mick Carter, Sophie Valcke, Mario Acosta |
BoG2: Data and metadata | Sébastien Denvil, Sandro Fiore, Stephan Kindermann |
Virtual WP - Innovation | Martin Juckes |
H2020 Financial and legal aspects | Federico Esu |
IS-ENES3 Communication and Dissemination | Sylvie Joussaume, Nada Caud |
Presentation | Author(s) |
---|---|
General discussion on Integration (NA2) | Eric Guilyardi, Janette Bessembinder |
Data Management Plan | Bryan Lawrence, Francesca Guglielmo |
Low Carbon | Casimir de Lavergne |
BoG3: Model Evaluaton | Eric Guilyardi, Björn Brötz, Kim Serradell |
BoG4: Preparing Sustainability | Bryan Lawrence, Martin Lautenschlager |
BoG5: Technical meetings | Philip Kershaw |
The Technical ESMValTool Coding Workshop took place via video call from 9-12 March 2020 with 13 participants from U Bremen, NLeSC, BSC, U Reading, PML, MetOffice, SMHI, and DLR. The main goal of the workshop was to discuss a governance draft for the ESMValTool and to advance preparation of the upcoming v2.0 release of the software. Specifically, the workshop included the following topics:
Find the Summary of the coding workshop here
A second WP10 Coding Sprint, focused on the Climate4Impact portal developments, will be held from the 5th to the 7th of February. It will be hosted at CERFACS in Toulouse and reunite all institutions from the work package. It follows the first WP10 coding sprint which was organized at KNMI, de Bilt (Netherlands) from June 18th to 21st, in collaboration with the DARE project.
The IS-ENES3/ESGF Virtual Workshop on Compute and Analytics is a web meeting organized in the context of the EU H2020 IS-ENES3 project in close collaboration with the Earth System Grid Federation international effort.
The Virtual Workshop will discuss users’ requirements, solutions, gaps and challenges about the compute and analytics services in the climate change domains.
Talks on state of the art implementations in this field as well as applications built on top of them will be presented. The main outcome of the workshop, which will collect all contributions from the participants, will be documented into a final report on “Compute service requirements and state of the art approaches”.
Find the recording of the webinar on the IS-ENES3 YouTube channel !
Agenda
Session 1 – State of the art on the climate compute and analytics services: requirements, solutions and gaps - Chair: Christian Pagé
Time Slot | Author(s) and presentation |
---|---|
16:05-16h20 | Compute and Analytics services at DKRZ: status and plans - Stephan Kindermann and Carsten Ehbrecht, DKRZ |
16h20-16h35 | An open “data-side” platform for climate analytics and services - Guillaume Levavasseur, IPSL |
16h35-16h50 | Robust and Reliable WPS for climate simulations – nothing clever, just test, test, test! - Ag Stephens, UKRI |
16h50-17h05 | A Climate Analytics Hub for multi-model analysis - Donatello Elia, CMCC |
Session 2 - State of the art on the climate compute and analytics services: requirements, solutions and gaps - Chair: Ghaleb M. Abdulla
Time Slot | Author(s) and presentation |
---|---|
17:15-17h30 | Compute Services requirements for the climate impact community using C4I - Maarten Plieger, Wim Som de Cerff, Janette Bessembinder, KNMI, Christian Pagé, CERFACS |
17h30-17h45 | Packaging, deployment and interfacing of machine learning applications in scientific workflow environments - Tom Landry, CRIM |
17h45-18h00 | The Earth Data Analytic Services (EDAS) Framework - Thomas P. Maxwell, NASA |
18h00-18h15 | Compute with Kubernetes - Jason Jerome Boutte, LLNL |
18h15-18h30 | Talk by NCI - Ben Evans, NCI |
Session 3 - Discussion session on Compute and Analytics - Chair: Sandro Fiore General discussion on requirements Wrap up and closing remarks 7:15 - End of the Virtual Workshop
Organizing Committee Sandro Fiore (CMCC), Christian Pagé (CERFACS), Sylvie Joussaume (IPSL) and Ghaleb M. Abdulla (LLNL)
ESGF Future Architecture Meeting is a project meeting to review the existing system architecture, examine requirements for a future system and propose new solutions.
About this Event It is now nearly ten years since the original ESGF system was designed. At that time the development was driven by the need to create a globally distributed archive for downloading CMIP data. Since that time, there have been a number of changes: ESGF has grown and diversified in the number of projects and disciplines it supports; the operational requirements are clearer for the ESGF to support an international federated archive of this size; many of the ESGF nodes now have other functions beyond CMIP and there has also been changing landscape of data repository and science needs. This meeting has been convened by the ESGF Executive Committee (ESGF-XC) with the purpose of re-assessing the requirements and developing a future architecture for the system.
Meeting Structure The meeting will run over three days. Attendance is by invitation only and concentrates on ESGF key developers. The programme for the meeting has been specified by Philip Kershaw (UKRI STFC, local host), Ghaleb Abdullah (LLNL) and Ben Evans (NCI) on behalf of the ESGF-XC. In addition to requirements analysis, technology survey and review high-level architecture the programme concentrates on the topical areas:
Sponsorship This workshop is sponsored by IS-ENES3, which has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 824084, and co-organised by the ESGF-XC and IS-ENES. ESGF as the global climate data infrastructure is supported by:
The 5th Technical ESMValTool Coding Workshop took place at DLR Oberpfaffenhofen (Germany) from 14-17 October 2019 with 20 participants from U Bremen, NLeSC, MPI Jena, U Hamburg, BSC, LMU, U Reading, IPCC WG1 TSU, SMHI, and DLR.
The main goal of the workshop was to advance preparation of the upcoming v2.0 release of the software.
Specifically, the workshop included the following topics:
In addition, a draft roadmap for the ESMValTool development has been created and added to the ESMValTool website to make the ongoing development activities more visible and transparent.
The workshop was funded by the EU Horizon 2020 research and innovation programme under the grant agreement No 824084 (IS-ENES3 project).
ESMValTool Development Team • esmvaltool.org
![5thESMValTool](../images/
You can find the summary report of the workshop here
The IS-ENES3 workshop “Defining a cutting-edge future for sea ice modelling”, organized by Met Office, CNRS, and DOE, in conjunction with the NEMO Sea Ice Working Group and the CICE Consortium, will take place from the 24th to 26th of September 2019 in Laugarvatn, Iceland.
This workshop proposes to discuss the future evolution and development of sea ice models.
The majority of present-day sea ice models are based upon the continuum model approach that was conceived in the 1970s, and has been successfully used to simulate sea ice within most IPCC-class climate models and short-range forecasting systems since then. With the progressive increase in model resolution, the most advanced applications of sea ice models now run at up to 100 times finer resolution than the target applications these models were originally designed for. High-resolution applications not only question the underlying physical assumptions but also increasingly push the scaling limits of modern massively-parallel supercomputing architectures. In addition, modern forecast applications are increasingly seeking to resolve more detailed features of the sea ice scape — such as the location of the sea ice edge, individual floes, leads or ridges, fast ice — poorly resolved by current models, which may prove overly simple for such an endeavour. In light of these present, and future, demands of climate and forecasting systems, we believe that the existing approach to sea ice modelling requires a fresh look.
The workshop will thus bring together representation from across the international sea ice modelling community to explore how our models can match the various needs of the research, climate modelling and operational communities. The questions addressed will be the following:
Theme 1: Scientific and technical validity/limitations of current models
Theme 2: Physical processes and complexity: bridging the gap between weather and climate requirements
An IS-ENES3 technical meeting will take place from June 18th to June 21st, 2019, dedicated to the development of the Climate4impact portal (C4I).
It will be preceded by a collaborative DARE/IS-ENES3 meeting on June 17th. It will be hosted at KNMI, De Bilt, Netherlands.
The main objectives of these two complementary meetings are to enable partners, involved in the development of the ENES Climate Data Infrastructure and especially on climate4impact, to work together on specific items, with high collaboration and dedicated full time.
It will consist of brainstorming sessions, followed by coding and developments, and a summary of achievements. The brainstorming will be an opportunity to discuss the overall architecture, identifying parts where there is a need of developments and decisions. The actual coding and development sessions will happen in focused groups on identified specific points in the brainstorming session. The summary will be the opportunity to discuss problems and bottlenecks encountered.
The meeting will focus on C4I related work and tasks, but not only as it is also the opportunity to develop other parts of the ENES infrastructure that C4I will use. The evaluation of the DARE Platform, made by C4I and people developing solutions for workflows and data processing of climate data, will also act as a dissemination event as this platform can be used within the ENES CDI.
The 4th Technical ESMValTool coding workshop took place at DLR Oberpfaffenhofen (Germany) from 3rd to 6th June 2019 with 24 participants.
The two main goals of the workshop have been the preparation of the v2.0 beta release and the finalization of the input for the three planned publications on the new ESMValTool version.
Find the summary of the 4th Technical ESMValTool Coding Workshop here.
The workshop was organized at DLR Oberpfaffenhofen (Germany), from the 6th to 8th of February in order to address several high priority issues in the ESMValTool v2, to set the basis for the next release and to prepare for the upcoming hot phase of CMIP6, with most modeling groups submitting their data.
Find the summary of the 3rd ESMValTool Coding Workshop here.