HPC, Big Data, and AI Convergence Towards Exascale Challenge and Vision

HPC, Big Data, AI Convergence Towards Exascale provides an updated vision on the most advanced computing, storage, and interconnection technologies, that are at basis of convergence among the HPC, Cloud, Big Data, and artificial intelligence (AI) domains. Through the presentation of the solutions devised within recently founded H2020 European projects, this book provides an insight on challenges faced by integrating such technologies and in achieving performance and energy efficiency targets towards the exascale level. Emphasis is given to innovative ways of provisioning and managing resources, as well as monitoring their usage. Industrial and scientific use cases give to the reader practical examples of the needs for a cross-domain convergence.

All the chapters in this book pave the road to new generation of technologies, support their development and, in addition, verify them on real-world problems. The readers will find this book useful because it provides an overview of currently available technologies that fit with the concept of unified Cloud-HPC-Big Data-AI applications and presents examples of their actual use in scientific and industrial applications.

1. Towards the Convergence of High-Performance Computing, Cloud, and Big Data Domains. 2. The LEXIS Platform for Distributed Workflow Execution and Data Management. 3. Enabling the HPC and Artificial Intelligence Cross-Stack Convergence at the Exascale Level. 4. Data System and Data Management in a Federation of HPC/Cloud Centers. 5. Distributed HPC Resources Orchestration for Supporting Large-Scale Workflow Execution. 6. Advanced Engineering Platform Supporting CFD Simulations of Aeronautical Engine Critical Parts. 7. Event-Driven, Time-Constrained Workflows: An Earthquake and Tsunami Pilot. 8. Exploitation of Multiple Model Layers Within LEXIS Weather and Climate Pilot. 9. Data Convergence for High-Performance Cloud. 10. The DeepHealth HPC Infrastructure: Leveraging Heterogenous HPC and Cloud Computing Infrastructures for IA-Based Medical Solutions. 11. Applications of AI and HPC in Health Domain. 12. CYBELE: On the Convergence of HPC, Big Data Services, and AI Technologies. 13. CYBELE: A Hybrid Architecture of HPC and Big Data for AI Applications in Agriculture. 14. European Processor Initiative: Europe's Approach to Exascale Computing.

Olivier Terzo is currently the Head of the ACA Advance Computing and Applications Research Area with a staff of 16 Reseaerchers at the LINKS Foundation Research Center (Italy).

Jan Martinovic is currently the Head of the Advanced Data Analysis and Simulations Lab at IT4Innovations National Supercomputing Center.