Panorama 360: Performance data capture and analysis for end-to-end scientific workflow

This project aims to develop a repository and associated capabilities for data collection, ingestion, and analysis for a broad class of Department of Energy (DOE) applications that span experimental and simulation science workflows. In particular, the proposed work will focus on workflows that include experimental data generation at DOE facilities and include: 1) a distributed repository for different types of data (point measurements, time series, and traces), 2) a set of data capture, curation, and publishing tools that can be used to interact with the repository, 3) a set of analysis, algorithms, and machine learning based tools to analyze and characterize the data, and, 4) best practices and recommendations for workflow evaluation, analysis, execution, and architectures.