When

Oct 06, 2020 03:00 PM to Nov 03, 2020 04:00 PM
(Europe/Berlin / UTC200)

This online training course aims to increase scientists’ expertise on data analysis and visualisation applied to climate and weather domains, using high-performance data analytics and visualisation tools available from the open source market (i.e., Ophidia and ParaView).

The training covers topics from simple analytics tasks to workflows and applications (e.g., Python-based) and provides best practices and guidelines on dealing with massive scientific datasets on HPC architectures. 

Examples of real applications of Ophidia for data analytics and ParaView for visualisation in the climate and weather domain will be presented. Demos and hands-on concerning the tools will also be carried out during the training. 

This course is organised in the context of the “Centre of Excellence in Simulation of Weather and Climate in Europe” (ESiWACE) phase 2 project.

Ophidia snapshot

 

Topics:

  • Introduction to scientific data management and analytics

  • Big Data in HPC: High-performance data management

  • Analytics workflows for eScience

  • Open-source High Performance Data Analytics (HPDA) tools

  • Data Processing using CDO

  • Introduction to data visualisation using ParaView

  • Discussion of visualisation workflows, from post to in-situ

 

Audience:
The training targets an audience in the field of weather and climate research with different backgrounds, from computer to Earth system scientists. Basic knowledge of the following is expected to fully take advantage of the training: Python, Linux, general aspects concerning climate/weather data.

 

Agenda:
The training ran over four weeks in October and beginning of November, with 2 hours of work per week required from the participants. Training sessions combined presentations and hands-on and were scheduled as follows: