Jetstream2 Cloud HPC system goes into production

Jetstream2, a collaborative cloud-based HPC system distributed across five institutions, entered full production after an initial phase of operations that began earlier this year. The computer, which now serves a large community of researchers, provides a total of eight peak petaflops.

“Jetstream is a cloud!” proclaims a red alert box on the system Insight page. “While it shares many common features and capabilities with other research computing resources, it is not a traditional high-performance computing (HPC) or high-throughput computing (HTC) environment.

Indeed, the Jetstream2 hardware – supported by an NSF grant – is divided into five segments, all built by Dell: a main system at Indiana University in Bloomington (416 compute nodes, 90 GPU nodes and 96 storage) and four smaller systems at Arizona State University, Cornell University, Texas Advanced Computing Center (TACC), and University of Hawaii (each with 8 compute nodes and 2 GPU nodes). Other system partners include Johns Hopkins University, the University of Arizona and the University Corporation for Atmospheric Research.

Jetstream2’s standard compute nodes (of which there are 384 in total) are each equipped with two AMD Epyc “Milan” 7713 processors and 512 GB of memory, while 32 additional high-memory compute nodes with a terabyte of memory each. The 90 GPU nodes in total have the same CPUs, 512GB of memory, and four Nvidia A100 GPUs. Total: Approximately eight cumulative peak petaflops of cloud computing power supported by 17 PB of storage.

As the name suggests, Jetstream2 follows in the footsteps of Jetstream, launched in 2016, consisting of 640 Intel Haswell nodes split between IU and TACC with an additional deployment of 16 development nodes at the University of Arizona.

“Like its predecessor, Jetstream2 will continue to break down barriers to discovery,” said John Fonner, Director of Special Projects at TACC and one of the Jetstream2 Prize PIs, in a interview with Faith Singer of TACC. “It will provide flexible advanced computing capabilities to researchers who otherwise might not have sufficient resources at their institutions. And it gives teachers a cohesive, accessible computing environment they can bring into the classroom. »

Before going into production this summer, Jetstream2 went through a first phase of operations in February, during which it was integrated into the NSF’s Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) program, the successor to the popular XSEDE program.

“We want Jetstream2 to be a democratizing force within the NSF ecosystem, enabling researchers and educators to access cutting-edge resources regardless of project scale,” said David Hancock, Director of advanced cyberinfrastructure for academic information technology services at Indiana University.

For more on Jetstream2, read TACC’s Faith Singer report here.

Header image: the main installation of Jetstream2 at IU Bloomington. Image courtesy of the university.