WP3 - Tackling the data challenge
Design innovative data layouts and investigate data compression techniques to help reduce I/O and storage costs while enabling fast, flexible access to large-scale climate simulation outputs tailored to real science use cases.
Implement FAIR Digital Objects (FDOs) for Earth System model data, ensuring consistent and machine-readable metadata, provenance tracking and cross-community findability and interoperability of datasets.
Develop scalable high-performance data analytics frameworks supporting novel data layouts, compression techniques as well as leveraging benefits of the FDO concept to improve data analysis workflows on HPC infrastructures.