AI Hardware

NVIDIA HGX A100
THE MOST POWERFUL END-TO-END
AI SUPERCOMPUTING PLATFORM

https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/HGX/a100-80gb-hgx-a100-datasheet-us-nvidia-1485640-r6-web.pdf

Purpose-Built for the Convergence of
Simulation, Data Analytics, and AI

Massive datasets, exploding model sizes, and complex simulations
require multiple GPUs with extremely fast interconnections. The
NVIDIA HGX™ platform brings together the full power of NVIDIA
GPUs, NVIDIA® NVLink®, NVIDIA Mellanox® InfiniBand® networking,
and a fully optimized NVIDIA AI and HPC software stack from NGC™
to provide highest application performance. With its end-to-end
performance and flexibility, NVIDIA HGX enables researchers and
scientists to combine simulation, data analytics, and AI to advance
scientific progress.

With a new generation of A100 80GB GPUs, a single HGX A100
now has up to 1.3 terabytes (TB) of GPU memory and a world’s
first 2 terabytes second (TB/s) of memory bandwidth, delivering
unprecedented acceleration for emerging workloads, fueled by
exploding model sizes and massive data-sets.