WP3 - Tackling the data challenge

Design innovative data layouts and investigate data compression techniques to help reduce I/O and storage costs while enabling fast, flexible access to large-scale climate simulation outputs tailored to real science use cases.

Implement FAIR Digital Objects (FDOs) for Earth System model data, ensuring consistent and machine-readable metadata, provenance tracking and cross-community findability and interoperability of datasets.

Develop scalable high-performance data analytics frameworks supporting novel data layouts, compression techniques as well as leveraging benefits of the FDO concept to improve data analysis workflows on HPC infrastructures.

  • Explanation of ESiWACE3's WP3 by WP leader Karsten Peters-von Gehlen (DKRZ).

  • Explanation of ESiWACE3's WP3 by WP leader Karsten Peters-von Gehlen (DKRZ).