Nvidia A100 Superpod

Built on nvidia dgx a100 systems and nvidia mellanox network fabric superpod shows that it s possible to deliver a platform that can reduce processing times on the world s most complex language understanding models from weeks to under an hour.

Nvidia a100 superpod. Hc32 nvidia dgx a100 superpod design for performance radix. Dgx a100 brings new and faster nvidia nvlink and nvswitch technology for multi gpu communication to the dgx superpod along with nine nvidia mellanox connectx 6 hdr infiniband adapters each with two ports of 200gb s infiniband hdr and ethernet connectivity with sub 600 nanosecond latency to deliver the i o bandwidth to take dgx superpod solutions to the next level. Hc32 nvidia dgx a100 superpod mellanox 200gbps hdr switches. Altogether selene comprises 280 dgx a100s housing a total 2 240 a100 gpus and 494 mellanox quantum 200g infiniband switches providing 56 tb s network fabric.

If none of that sounds like enough power for you nvidia also announced the next generation of the dgx superpod which clusters 140 dgx a100 systems for an insane 700 petaflops of compute. The universal system for ai infrastructure. There is an additional ipmi oob management nic. Dgx a100 sets a new bar for compute density packing 5 petaflops of ai performance into a 6u form factor.

Nvidia dgx superpod unified for ai training inference acceleration data analytics the nvidia dgx pod is an ai supercomputing infrastructure that delivers groundbreaking performance deploys in weeks as a fully integrated system and is designed to solve the world s most challenging ai problems. The nvidia dgx superpod with nvidia dgx a100 systems is the next generation artificial intelligence ai supercomputing infrastructure providing the computational power necessary to train today s state of the art deep learning dl models and to fuel innovation well into the future. There are two storage cards with another port being used for in band management on one of the storage nics. Located in santa clara calif selene is a dgx superpod powered by nvidia s a100 gpus and amd s epyc rome cpus within the dgx a100 form factor clustered over mellanox hdr infiniband.

It pairs eight of the chipmaker s top of the line a100 data center graphics processing units with two.