Nvidia A100 Bandwidth

8x a100s 2x amd epyc cpus and pcie gen 4.

Nvidia a100 bandwidth. The dgx a100 server. The nvidia a100 tensor core gpu is the flagship product of the nvidia data center platform for deep learning hpc and data analytics. So while v100 offered 6 nvlinks for a total bandwidth of 300gb. Far from your computer screens and deep inside the cloud is where the new computational war is being fought right in the heart of the data centers.

Nvidia a100 will simultaneously boost throughput and drive down the cost of data centers. Nvidia explains its new ampere a100 gpu as a technical design breakthrough field by five key innovations. Nvidia s new ampere a100 54 billion transistor gpu will revolutionize data center design. In figure 1 we are visualizing the speedups we get when replacing an nvidia v100 gpu with an nvidia a100 gpu without code modification.

The gpu s other imposing traits include 40gb of hbm2e memory across a 5 120 bit memory interface for a bandwidth up to a whopping 1 555 gbps. A100 delivers improved raw bandwidth of 1 6tb sec as well as higher dynamic random access memory dram utilization efficiency at 95 percent. Nvidia a100 pcie image credit. While the main memory bandwidth has increased on paper from 900 gb s v100 to 1 555 gb s a100 the speedup factors for the stream benchmark routines range between 1 6 and 1 72 for large data sets.

This is one of the many features that make dgx a100 the foundational building block for large ai clusters such as nvidia dgx superpod the enterprise blueprint for scalable ai infrastructure. This article was first published on 15 may 2020. For a100 in particular nvidia has used the gains from these smaller nvlinks to double the number of nvlinks available on the gpu. Nvidia s dgx a100 supercomputer is the ultimate instrument to advance ai and fight covid 19.

The server is the first generation of the dgx series to use amd cpus. If the new ampere architecture based a100 tensor core data center gpu is the component responsible re architecting the data center nvidia s new dgx a100 ai supercomputer is the ideal enabler to revitalize data centers. In addition to the nvidia ampere architecture and a100 gpu that was announced nvidia also announced the new dgx a100 server.