www.hardwarezone.com.sg Open in urlscan Pro
152.195.221.44  Public Scan

URL: https://www.hardwarezone.com.sg/tech-news-nvidia-dgx-a100-supercomputer-super-performance-fight-covid-19
Submission: On October 08 via api from US — Scanned from SG

Form analysis 2 forms found in the DOM

POST /search

<form id="PageSearchForm" method="post" action="/search">
  <fieldset style="display:none;"><input type="hidden" name="_method" value="POST"></fieldset>
  <fieldset>
    <input type="hidden" name="data[Page][context]" value="all" id="PageContext">
    <div class="search-bar-wrapper">
      <input name="data[Page][q]" type="text" title="Type and hit return" class="text" value="" placeholder="Type and hit return" id="PageQ" autocomplete="off"> <a href="javascript:void(0)" id="search-opt-id" class="search-menu-link">All Content</a>
    </div>
    <div class="main-menu-dropdown-content" id="search-tiny-dropdown">
      <label for="search-opt-item-all">All Content</label><input type="radio" id="search-opt-item-all" name="data[Page][context]" value="all" checked="">
      <label for="search-opt-item-tag">By Tag</label><input type="radio" id="search-opt-item-tag" name="data[Page][context]" value="tag">
    </div>
  </fieldset>
</form>

POST /search

<form id="PageSearchForm" method="post" action="/search">
  <fieldset style="display:none;"><input type="hidden" name="_method" value="POST"></fieldset>
  <fieldset>
    <input type="hidden" name="data[Page][context]" value="all" id="PageContext">
    <div class="search-bar-wrapper">
      <input name="data[Page][q]" type="text" title="Type and hit return" class="text" value="" placeholder="Search..." id="PageQ">
      <div class="mb-search-actions">
        <a href="javascript:void(0)" id="mb-search-opt-id" class="search-menu-link">All Content</a> <input type="image" src="/img/icons/icon-search.png" title="Search" class="submit">
      </div>
    </div>
    <div class="main-menu-dropdown-content" id="mb-search-tiny-dropdown">
      <label for="mb-search-opt-item-all">All Content</label><input type="radio" id="mb-search-opt-item-all" name="data[Page][context]" value="all" checked="">
      <label for="mb-search-opt-item-tag">By Tag</label><input type="radio" value="tag" id="mb-search-opt-item-tag" name="data[Page][context]">
    </div>
  </fieldset>
</form>

Text Content

 * 
 * Follow Us
 * Tech Shows
 * Market Place
 * Price Lists
 * Forums

 * * News
   * Reviews
   * Videos
   * Topics
     Smartphones & Tablets
     Networking & Telco
     NetworkingTelco
     NotebooksHeadphonesWearablesPhotographyApps & SoftwareInternet, Cloud,
     eCommerce
     Computing
     Desktop SystemsNotebooksInput DevicesMonitorsPrintersStorage
     PC Components
     CasingsCoolersCPUGraphics CardsMemoryMotherboardPower Supply Units
     Audio & Visual
     AV SystemsHeadphonesMedia Streamers and HubsProjectorsSpeakersTelevisions
     Gaming & Entertainment Culture
     Games & GearEsportsToys & CollectiblesMovies & Shows
     Smart Living & Lifestyle
     Smart LivingAutomotive TechScience & TechTravel & Aviation
   * Deals
   * Gaming
   * Lifestyle
   * Biz & SME Tech
   * HWZ Coupons
     AmazonTrip.comGrabFoodShopee
     
     
 * * All Content
     All Content By Tag
     SEARCH
   * LOGIN

×
Topics
Smartphones & TabletsNetworking & Telco
NetworkingTelco
NotebooksHeadphonesWearablesPhotographyApps & SoftwareInternet, Cloud,
eCommerceComputing
Desktop SystemsNotebooksInput DevicesMonitorsPrintersStorage
PC Components
CasingsCoolersCPUGraphics CardsMemoryMotherboardPower Supply Units
Audio & Visual
AV SystemsHeadphonesMedia Streamers and HubsProjectorsSpeakersTelevisions
Gaming & Entertainment Culture
Games & GearEsportsToys & CollectiblesMovies & Shows
Smart Living & Lifestyle
Smart LivingAutomotive TechScience & TechTravel & Aviation
Videos

Reviews & Articles
ReviewsShootoutsTech GuidesFeature ArticlesEvent CoverageGalleryDealsBlogs
Shopping
Price List DownloadsDealsHWZ Coupons
Forums
Special EventsInfotech ClinicDigital Entertainment Lifestyle HubSpecial Interest
GroupsMarketplaceLifestyleAcademic ConcernsFeedback ChannelsOthers
Lifestyle


The authoritative voice on technology trends, gadget shootouts, and geeky life
hacks you never knew you couldn't live without.

 * 
 * * SEARCH
   * LOGIN
 * 

 * Forums
 * Price Lists
 * Tech Shows
 * Market Place
 * Follow Us

News

Topics
Smartphones & TabletsNetworking & Telco
NetworkingTelco
NotebooksHeadphonesWearablesPhotographyApps & SoftwareInternet, Cloud,
eCommerceComputing
Desktop SystemsNotebooksInput DevicesMonitorsPrintersStorage
PC Components
CasingsCoolersCPUGraphics CardsMemoryMotherboardPower Supply Units
Audio & Visual
AV SystemsHeadphonesMedia Streamers and HubsProjectorsSpeakersTelevisions
Gaming & Entertainment Culture
Games & GearEsportsToys & CollectiblesMovies & Shows
Smart Living & Lifestyle
Smart LivingAutomotive TechScience & TechTravel & Aviation
Videos

Reviews & Articles
ReviewsShootoutsTech GuidesFeature ArticlesEvent CoverageGalleryDealsBlogs
Lifestyle

Deals

HWZ Coupons
All CouponsAmazonTrip.comGrabFoodShopee
Gaming

Biz & SME Tech

All Content
All Content By Tag

Trending
Tecno Phantom V Flip 5G review: The most affordable clamshell foldable you
cannot buy in Singapore

BYD Dolphin review: What’s Singapore's most affordable EV like?

DJI launches Mini 4 Pro drone, bringing 4K60FPS HDR in a 249g body
News
News Categories
AV SystemsBluetooth HeadsetsCasingsCoolersCPUDigital PaymentsExternal
StorageGames & GearGraphics CardsHard Disk DrivesHeadphonesInkjet PrintersLaser
PrintersMedia Streamers and HubsMemoryMobile
PhonesMotherboardNASNetworkingOptical DrivesPortable Media PlayersPower Supply
UnitsProjectorsSmartphones & TabletsSolid State
DrivesSpeakersTabletsTelcoTelevisionsDesktop SystemsEsportsNetworking &
TelcoNotebooksToys & CollectiblesWearablesInput DevicesMonitorsMovies &
ShowsPhotographyPrintersStorageApps & SoftwareInternet, Cloud,
eCommerceComputingPC ComponentsAudio & VisualGaming & Entertainment
CultureBlu-ray PlayersSmart LivingSmart Living & LifestyleAutomotive TechScience
& TechTravel & AviationBiz & SME TechOthers


NVIDIA DGX A100 SUPERCOMPUTER IS HALF THE COST AND SIZE WITH DOUBLE THE
PERFORMANCE! HOW DOES IT DO IT?

By Vijay Anand - on 15 May 2020, 4:54pm
Facebook WhatsApp Share

 * < Prev
 * Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
   Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
   Page 1 of 1
   Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
 * Next >


NVIDIA'S DGX A100 SUPERCOMPUTER IS THE ULTIMATE INSTRUMENT TO ADVANCE AI AND
FIGHT COVID-19

Note: This article was first published on 15 May 2020.

(Image source: NVIDIA)

If the new Ampere architecture based A100 Tensor Core data center GPU is the
component responsible re-architecting the data center, NVIDIA’s new DGX A100 AI
supercomputer is the ideal enabler to revitalize data centers. With 5 petaflops
of AI performance, it also packs the power and capabilities of an entire data
center into a single machine. And given the advancements of the new Ampere A100
GPU, this is not just a marketing statement.




NVIDIA DGX A100 is the ultimate instrument for advancing AI. NVIDIA DGX is the
first AI system built for the end-to-end machine learning workflow — from data
analytics to training to inference. And with the giant performance leap of the
new DGX, machine learning engineers can stay ahead of the exponentially growing
size of AI models and data. - Jensen Huang, founder and CEO of NVIDIA

WHAT’S UNDER THE HOOD OF THE DGX A100

The DGX A100 is NVIDIA’s third iteration of its supercomputing unit and it’s
packed with eight of NVIDIA’s latest Ampere-based A100 GPUs that communicate via
6 upgraded NVSwitches (which, mind you, were already impressive in their last
iteration) to match up with the speeder third-gen NVLinks on the new GPUs. The
second-generation NVSwitch interconnect fabric now boasts an inter-GPU bandwidth
of 600GB/s (thanks to speedier NVLinks on the A100) and brings the total
inter-GPU communication bandwidth of 4.8TB/s across all the GPUs in the DGX A100
supercomputer.



While that’s the same as what the DGX-2, DGX A100 does this with far fewer
components. The NVSwitch interconnect fabric does however theoretically allow
scaling it further to support 16 GPUs and 16 NVSwtiches, which would then bring
the total inter-GPU communication bandwidth to 9.6TB/s.

NVSwich interconnect fabric can go up to 16 switches to service 16 GPUs -
theoretically. However, the DGX A100 is so powerful, it only requires of the
components of the DGX-2 and yet leapfrog it in performance and capability.

The eight GPUs combined bring 320GB of total GPU memory to the system using
higher speed HBM2 memory from Samsung. And although total GPU memory is down
from 512GB on the DGX-2, the new DGX A100 has far higher speed memory and helps
close the gap to boast 12.4TB/s peak memory throughput (just a little less than
14.4TB/s in the DGX-2).

Connectivity out of the box to scale up data center capabilities with more DGX
supercomputers is courtesy of NVIDIA’s new acquisition that allows them to use
high-speed Mellanox HDR 200Gbps interconnects – which are twice the throughput
that Infiniband 100GbE offered on the DGX-2. The DGX A100 offers 8x single-port
Mellanox ConnectX-6 HDR Infiniband/200GbE and with clustering, supports a total
peak interconnect performance of 200GB/s! It also has a single dual-port
ConnectX-6 for data and storage networking needs.

In a surprising move, NVIDIA’s latest supercomputer dumps Intel for AMD’s EPYC
7742, 64-core server processor! This speaks volumes of AMD’s speedier
advancement in the server and data center scene and NVIDIA’s confidence in their
supply chain. There’s two of them on the motherboard baseboard within then DGX
A100, so that’s a total of 128 CPU cores and 1TB of system memory. Storage space
is serviced by dual 1.92TB M.2 NVMe drives to host the OS while non-OS storage
comes up to be a total of 15TB utilizing quad 3.84TB U.2 NVMe drives.

 

HERE’S WHAT MAKES THE NVIDIA DGX A100 EVEN MORE IMPRESSIVE

So almost all the quantity, frequency, bandwidth and throughput figures are
quite a fair bit higher – and we stress almost because in some ways, the DGX
A100 does come with less that helps it bring its sticker price way lower than
you would imagine. The previous AI supercomputer, DGX-2, costs a whopping
US$399,000 and puts out 2 teraflops of AI performance.

The new DGX A100 costs ‘only’ US$199,000 and churns out 5 teraflops of AI
performance –the most powerful of any single system. It is also much smaller
than the DGX-2 that has a height of 444mm. Meanwhile, the DGX A100 with a height
of only 264mm fits within a 6U rack form factor. How can NVIDIA serve out
something that’s half of the cost of its predecessor, nearly half the size and
more than doubles the performance capability?

For starters, the DGX A100 only uses 8 GPUs vs. 16 on the DGX-2, which is enough
reason for massive cost savings from a silicon consumption and complexity
management perspective. Less GPUs mean less NVSwtiches deployed, and that is
also halved in the DGX A100. The reduces number of components mean it has one
less plane used to accommodate all the GPUs it needs compared to the DGX-2. If
you managed to playback the DGX A100 video intro above, you would get a glimpse
of the back of the supercomputer and its layout that has been simplified. The
bottom plane houses all the redundant PSUs, the next layer houses all the
external system connectivity options, followed by the single GPU plane at the
top. All of this adds up to tremendous cost savings while the improved GPU
architecture and connectivity options ensure you get much more for less.

It doesn’t just stop there. Thanks to the Multi-Instance GPU (MIG) capability of
the new A100 GPU, each GPU can partition itself into seven discrete instances,
fully isolated from each other and running various workloads while still having
their own slice of high bandwidth memory, cache, compute cores and more. With
the DGX A100’s eight GPUs, this gives the administrator the ability carve out up
to 56 GPU instances. This key feature makes along with massive processing
throughput boosts make the DGX A100 the most versatile high-density compute
system in the market offering a consolidated option for training, inferencing,
analytics needs into a unified, easy-to-deploy AI system with unprecedented
levels of performance.

What a typical AI data center looks like today.

In fact, NVIDIA’s painted a picture of a typical AI data center setup today that
might consist of 50 DGX-1 systems for AI training and 600 CPU systems for AI
inferencing that could horde up to 25 racks in space, sip up to 630kW of power
and cost about US$11 million in infrastructure alone can be consolidated into a
single rack with just five of the DGX A100 AI supercomputers to do the job at
just a million dollars and consuming 28kW of power. That’s tremendous savings in
infrastructure costs, running costs and carbon footprint.

How just 5 units of DGX A100 AI supercomputers could overhaul data centers
completely.

Unlike its predecessors, the DGX A100 is no longer just another option in
NVIDIA’s supercomputer lineup, but this effectively retires both the DGX-1 and
DGX-2 by a long shot. The performance to cost ratio is simply off the charts –
comparatively speaking.

 

AVAILABILITY AND WHO’S ADOPTING IT?

Immediately available, DGX A100 systems have begun shipping worldwide, with the
first order going to the U.S. Department of Energy’s (DOE) Argonne National
Laboratory, which will use the cluster’s AI and computing power to better
understand and fight COVID-19.

We’re using America’s most powerful supercomputers in the fight against
COVID-19, running AI models and simulations on the latest technology available,
like the NVIDIA DGX A100.  The compute power of the new DGX A100 systems coming
to Argonne will help researchers explore treatments and vaccines and study the
spread of the virus, enabling scientists to do years’ worth of AI-accelerated
work in months or days. - Rick Stevens, associate laboratory director for
Computing, Environment and Life Sciences at Argonne. 

Here are the other early adopters:-

 * The Center for Biomedical AI - At the University Medical Center
   Hamburg-Eppendorf, Germany, they will leverage DGX A100 to advance clinical
   decision support and process optimization.
    
 * Chulalongkorn University - Thailand’s top research-intensive university will
   use DGX A100 to accelerate its pioneering research such as Thai natural
   language processing, automatic speech recognition, computer vision and
   medical imaging.
    
 * German Research Center for Artificial Intelligence (DFKI) will use the DGX
   A100 systems to further accelerate its research on new deep learning methods
   and their explainability while significantly reducing space and energy
   consumption.
    
 * Harrison.ai - A Sydney-based healthcare AI company will deploy Australia’s
   first DGX A100 systems to accelerate the development of its
   AI-as-medical-device.
    
 * The UAE Artificial Intelligence Office - First in the Middle East to deploy
   the new DGX A100 is building a national infrastructure to accelerate AI
   research, development and adoption across the public and private sector.
    
 * VinAI Research - Vietnam’s leading AI research lab, based in Hanoi and Ho Chi
   Minh City will use DGX A100 to conduct high-impact research and accelerate
   the application of AI.
    

Read Next (1): NVIDIA's new Ampere architecture will soon power cars!
Read Next (2): Meet NVIDIA's new 54-billion transistor Ampere GPU, the A100

 * < Prev
 * Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
   Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
   Page 1 of 1
   Page 1 of 1 - NVIDIA's DGX A100 supercomputer is the ultimate instrument to
   advance AI and fight Covid-19
 * Next >

Join HWZ's Telegram channel here and catch all the latest tech news!
Tags: server nvidia gpu data center a.i ampere a100 dgx a100 gtc 2020
Facebook WhatsApp Share

Our articles may contain affiliate links. If you buy through these links, we may
earn a small commission.
Previous Story
Facebook buys GIF-sharing platform Giphy
Next Story
Grand Theft Auto 5 is now available for free on the Epic Games Store


RECOMMENDED

Skip
Ads by







--------------------------------------------------------------------------------




SUGGESTED READS » MORE

 * AMD is bundling selected CPUs and GPUs with Bethesda’s highly-anticipated
   Starfield RPG
   19 Jul 2023  /  By The Count
 * NVIDIA cuLitho to accelerate next-gen chip manufacturing, will be adopted by
   TSMC, ASML, Synopsys
   22 Mar 2023  /  By Zachary Chan
 * AMD shows off 146-billion transistor Instinct MI300, the world's first
   integrated CPU and GPU data center chip (Updated)
   21 Jan 2023  /  By Vijay Anand
 * NVIDIA launches new Grace Superchip during GTC 2022
   23 Mar 2022  /  By Ken Wong
 * NVIDIA confirmed it will give up on Arm acquisition (Updated)
   08 Feb 2022  /  By Cookie Monster




FROM GAMEAXIS » MORE

 * Counter-Strike 2 is out now on Steam and is free to play for everyone
 * Disney+ will crackdown on password-sharing in Canada starting 1 November
 * Apple TV+ has released Argylle's first trailer and its ensemble cast looks
   absolutely wicked in it

 * HWZ Coupons
 * Connect with us
   * 
   * 
   * 
   * 

Trending Topics

 * Mobile Phones
 * AV Peripherals and Systems
 * Digital Cameras
 * Notebooks
 * Graphic Cards

Our Sections

 * News
 * Product Guide
 * HWZ TV
   
 * Articles
 * Site Map

 

 * Forums
 * Price Lists
 * Market Place
 * Tech Show Portal
 * HWZ Coupons



AWARDS & ACCOLADES

We thank all our supporters who have helped us garner these prestigious media
awards in the industry!

Website/App of the Year for Consumer Tech Enthusiasts
Best Engagement Strategy by a Media Owner: Loyalty & Engagement Awards 2018
Consumer Review Media of the Year
Photography of the Year (Online)
Advertise on HWZ Contact Us & Feedback Terms of Service Privacy Policy PDPA
Member Terms & Conditions
Copyright © 2023 SPH Media Limited. Co. Regn. No. 202120748H. All rights
reserved.
✓
Thanks for sharing!
AddToAny
More…