The Adaptable I/O System, ADIOS, is a service-oriented framework to enable high performance I/O. The ADIOS 1.X series has been a successful component of the DOE high performance computing space for the last decade. As described in the main ADIOS project page, the primary goals of ADIOS have been to enable high performance, end-to-end scientific I/O capabilities. The ADIOS 1.X series saw the development not only of innovative, log-based I/O formats (BP) and parallel performance implementations, but it also introduced a number of memory-to-memory coupling methods, referred to as staging methods within the ADIOS lexicon.
The <method> options for ADIOS showcase the service-oriented architecture approach that ADIOS manages to hide behind its POSIX-like interface. The person running the code can use a runtime configuration through command arguments or configuration file to specify exactly how the reads and writes within the code should be performed, without requiring recompilation of the code. So a scientist could do development for a new analysis routine using the Lustre-optimized disk I/O method MPI_AGGREGATE to generate files to cross-validate the results, and then he or she could launch that analysis as an in situ pipeline with the main science code to use DATASPACES, FLEXPATH, or one of the other available staging methods that would then generate the analysis without moving data to disk.
Last Updated: May 28, 2020 - 4:05 pm