Recently published ESiWACE2 Deliverables

In the last few months, we have published the following eight project deliverables intended for the general public. Stay tuned for a few more before 31 March 2023, which will mark the end of the ESiWACE2 funding phase.

D2.1: Report summarising the adaptation of the proposed DSLs and the evaluation of the benchmarks and models proposed in this project

Deliverable D2.1 discusses extensions and improvements on the two domain-specific languages (DSLs) in use within the ESiWACE2 project, PSyclone and dusk/dawn, in order for them to support the Weather and Climate models: NEMO, LFRic, and ICON. The content is complemented by a comparison of PSyclone and dusk/dawn using a NEMO benchmark, and the topic of interoperability between those two DSLs is addressed. Read D2.1 here 

D2.7: Second white paper on community guidelines on the use, value and applicability of emerging technologies in climate and weather applications

This deliverable summarises state-of-the-art advancements related to HPC infrastructures, heterogeneous architectures and machine learning related to climate and weather applications as tracked by Work Package 2. In addition to tracking and compiling the efforts in literature, the WP2 colleagues organised a second virtual workshop on Emerging Technologies for Weather and Climate Modelling in October 2022. The workshop content is documented in this deliverable through the presentation abstracts, and the majority of workshop presentations is available in the workshop playlist on the ESiWACE YouTube channel. Read D2.7 here

D2.9: Final Report on Porting Earth System Models to Containers

The containerisation of atmosphere and ocean models with complex dependencies, external configurations, and performance requirements helps to provide a consistent environment to ensure security, portability and performance on multiple platforms. In this deliverable we document the multi-year effort to containerise key models from the climate / numerical weather prediction community, led by ETH Zurich and kicked off through the container hackathon for modellers in 2019. D2.9 provides an overview of containerisation efforts on the models EC-Earth, LFRic, COSMO and ICON, as well as references to the public online documentation developed by the respective teams. Read D2.9 here

D3.2: Report on services in portability and refactoring

With computing infrastructure rapidly evolving, existing software such as complex weather and climate models needs to be adapted in order to make efficient use of state-of-the-art hardware architectures. To support weather and climate modelling groups in code refactoring and the portability of their model codes to different platforms, Work Package 3 established short collaborative projects within the scope of ESiWACE2 “Service 1: Model portability and refactoring”. Deliverable D3.2 summarises the results of ten such Service 1 projects delivered and illustrates how each of the codes, e.g. RegCM, OBLIMAP2 and MicroHH, could advance towards exascale in the future. Read D3.2 here

D3.3: Report on services offered on IO, coupling and workflow

Within the scope of “Service 2: Coupling, IO and workflows” of ESiWACE2 Work Package 3, the weather and climate modelling community had had the chance to apply for and receive dedicated support for the optimal usage of three community tools: the OASIS3-MCT coupler, the XIOS IO server, and the Cylc workflow engine. Deliverable D3.3 presents an overview of the respective services provided. Read D3.3 here

D3.5: To make Europe's Earth system models fit for the exascale

Modern exascale supercomputers increasingly rely on GPUs as the major source of compute power. However, existing weather and climate modelling codes were designed to run on traditional CPU-based supercomputers and require a significant adaptation effort in order to make efficient use of these new systems. To assist weather and climate modelling groups in this endeavour, ESiWACE2 offered three services, providing guidance, engineering, and advice via collaborative projects. D3.5 reports in detail on the Service 1 projects RegCM and MicroHH, and gives a summary of all three Services provided via Work Package 3. The deliverable concludes with valuable lessons learned, bottlenecks on the path to exascale and associated challenges to be addressed in the near future. Read D3.5 here

D4.3: Software documentation and roadmap

As managing data from modern high-resolution weather and climate simulations is becoming problematic due to the sheer data deluge, novel solutions are needed. In this deliverable we present a summary of two classes of middleware software developed and / or improved in ESiWACE2 that help to overcome this challenge both during and after simulations: 1) Tools for in-flight analysis of ensembles of simulations, ideally supporting cross-ensemble calculations,  and 2) Middleware for managing writing data to disk and managing the migration of data through storage tiers. Read D4.3 here

D5.3: Report on the final implementation of key selected post-processing, analytics and visualisation applications and main outcomes

Deliverable D5.3 presents the recent developments in Work Package 5 since the publication of D5.2 on core routines for post-processing, analytics and visualisation (PAV) applications plus their interplay with the ESDM documented in D4.1. The recently published D5.3 details on improvements made regarding the selected PAV applications Ophidia, CDO and ParaView, and also introduces the newly developed YAVIZ interface for online (in-transit) diagnostics and visualisation with models that use the YAC coupler. Read D5.3 here