www.h3platform.com
Open in
urlscan Pro
34.123.188.105
Public Scan
URL:
https://www.h3platform.com/blog-detail/16
Submission: On September 03 via manual from IL — Scanned from DE
Submission: On September 03 via manual from IL — Scanned from DE
Form analysis 1 forms found in the DOM
<form class="gsc-search-box gsc-search-box-tools" accept-charset="utf-8">
<table cellspacing="0" cellpadding="0" role="presentation" class="gsc-search-box">
<tbody>
<tr>
<td class="gsc-input">
<div class="gsc-input-box" id="gsc-iw-id1">
<table cellspacing="0" cellpadding="0" role="presentation" id="gs_id50" class="gstl_50 gsc-input" style="width: 100%; padding: 0px;">
<tbody>
<tr>
<td id="gs_tti50" class="gsib_a"><input autocomplete="off" type="text" size="10" class="gsc-input" name="search" title="search" aria-label="search" id="gsc-i-id1" dir="ltr" spellcheck="false"
style="width: 100%; padding: 0px; border: none; margin: 0px; height: auto; background: url("https://www.google.com/cse/static/images/1x/en/branding.png") left center no-repeat rgb(255, 255, 255); outline: none;"></td>
<td class="gsib_b">
<div class="gsst_b" id="gs_st50" dir="ltr"><a class="gsst_a" href="javascript:void(0)" title="Clear search box" role="button" style="display: none;"><span class="gscb_a" id="gs_cb50" aria-hidden="true">×</span></a></div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
<td class="gsc-search-button"><button class="gsc-search-button gsc-search-button-v2"><svg width="13" height="13" viewBox="0 0 13 13">
<title>search</title>
<path
d="m4.8495 7.8226c0.82666 0 1.5262-0.29146 2.0985-0.87438 0.57232-0.58292 0.86378-1.2877 0.87438-2.1144 0.010599-0.82666-0.28086-1.5262-0.87438-2.0985-0.59352-0.57232-1.293-0.86378-2.0985-0.87438-0.8055-0.010599-1.5103 0.28086-2.1144 0.87438-0.60414 0.59352-0.8956 1.293-0.87438 2.0985 0.021197 0.8055 0.31266 1.5103 0.87438 2.1144 0.56172 0.60414 1.2665 0.8956 2.1144 0.87438zm4.4695 0.2115 3.681 3.6819-1.259 1.284-3.6817-3.7 0.0019784-0.69479-0.090043-0.098846c-0.87973 0.76087-1.92 1.1413-3.1207 1.1413-1.3553 0-2.5025-0.46363-3.4417-1.3909s-1.4088-2.0686-1.4088-3.4239c0-1.3553 0.4696-2.4966 1.4088-3.4239 0.9392-0.92727 2.0864-1.3969 3.4417-1.4088 1.3553-0.011889 2.4906 0.45771 3.406 1.4088 0.9154 0.95107 1.379 2.0924 1.3909 3.4239 0 1.2126-0.38043 2.2588-1.1413 3.1385l0.098834 0.090049z">
</path>
</svg></button></td>
<td class="gsc-clear-button">
<div class="gsc-clear-button" title="clear results"> </div>
</td>
</tr>
</tbody>
</table>
</form>Text Content
Part of the Technology photoes in this website are created by rawpixel.com -
www.freepik.com
* Product
* CXL Memory Pooling Solution
* NVMe MR-IOV Solution
* GPU Chassis
* PCIe Chassis
* Accessories
* Management Software
* CXL 2.0 Memory Pooling Solution
* PCIe 5.0 NVMe MR-IOV Solution
* Falcon 5208
* Falcon 4205
* Falcon 4210
* Falcon 4005
* Falcon 4010
* Falcon 4016
* Falcon 4109
* Falcon 4118
* Accessories
* GUI
* Solution
* Composable AI
* Cloud Service
* Rendering
* Applications
* HA architecture
* DevOps
* System Scaling
* Newsroom
* Press Release
* Event
* News
* Webinar
* Blog
* Support
* RMA Application
* Bug/Issue Report
* Security Advisory
* Warranty
* Compatible Devices
* Knowledge Base
* Case Study
* Customer Story
* Q&A
* Download
* About
* About Us
* Where to Buy
* Product
* Solution
* Newsroom
* Blog
* Support
* About
* Product
* CXL Memory Pooling Solution
* CXL 2.0 Memory Pooling Solution
* NVMe MR-IOV Solution
* PCIe 5.0 NVMe MR-IOV Solution
* Falcon 5208
* GPU Chassis
* Falcon 4205
* Falcon 4210
* Falcon 4005
* Falcon 4010
* Falcon 4016
* PCIe Chassis
* Falcon 4109
* Falcon 4118
* Accessories
* Accessories
* Management Software
* GUI
* Solution
* Composable AI
* Cloud Service
* Rendering
* Applications
* HA architecture
* DevOps
* System Scaling
* Newsroom
* Press Release
* Event
* News
* Webinar
* Support
* RMA Application
* Bug/Issue Report
* Security Advisory
* Warranty
* Compatible Devices
* Knowledge Base
* Case Study
* Customer Story
* Q&A
* Download
* About
* About Us
* Where to Buy
×
search
Custom Search
Sort by:
Relevance
Relevance
Date
* Blog
* GPU
*
--------------------------------------------------------------------------------
GPU EXPANSION: DIFFERENCES BETWEEN FAN-OUT AND FABRIC
July 24, 2020
by H3 Platform
2946
0
KEY TO PCIE DEVICE EXPANSION-KNOWING DIFFERENT PCIE SWITCHES
Following the release of PCIe Gen 4 standard in 2018 by PCI-SIG, AMD announced
its first PCIe Gen 4 GPU in 2019, and nVidia revealed its A100 GPU this year.
Clearly, the industry standard is moving toward PCIe Gen 4 for better system
performance and power consumptions. An expansion chassis is one of the easiest
ways to incorporate these new and powerful GPUs to your existing system. Despite
PCIe Gen 3 or Gen 4, you might have seen many PCIe switch-based expansion
chassis on the market, and you might have noticed that some of these chassis are
“fan-out” chassis while the others are “fabric” chassis. Both options allow you
to add more GPUs to your system, but what exactly is the difference?
To explain it, let us look at the topology of fan-out switch and fabric switch
a. Fan-out topology
The fan-out topology is quite straightforward. The switch divides the PCIe lane
into more lanes, thus it can bridge more devices to the CPU. Pros of fan-out
switch include better signal integrity and easy to configure. However, the
biggest downside of fan-out is that there is only one upstream port, meaning
only one host can be connected.
b. Fabric topology
The fabric topology is more complex. The switch here actually plays a mapping
role, linking more than one host to your devices. Yes, there are more things to
do to configure a system with PCIe fabric switch, but the fabric switch enables
powerful application that the fan-out switch would not do.
CAPABILITY OF DIFFERENT PCIE SWITCHES- FINDING A SUITABLE SOLUTION FOR YOUR
APPLICATION
The capability of PCIe switch chip set, really, is depending on its SoC. The SoC
in a fan-out switch chip set is designed to handle simple tasks, acting like a
gateway between PCIe devices and the host. The fan-out switch does not do
anything special to the data but passing it to the end devices. On the other
hand, the SoC in a Fabric switch chip set is designed to handle more complicated
tasks.
Single-host vs Multi-host
For single host usage, a fan-out PCIe switch can handle the expansion task more
efficiently. Data will pass through less nodes until it reaches its destination,
therefore the level of data integrity would not be much affected. In addition,
fan-out switch does not require much settings, making the deployment of your
expansion system easier.
PCIe fabric switch stands out when you need fan-out for more than one host. They
way fabric switch enables multi-host usage is that the SoC emulates an empty
PCIe device, and requests for bus number and memory space from the host BIOS or
OS. Then, the requested memory space will be partitioned for its downstream PCIe
devices. The switch not only receives data from hosts and send it to the
relative endpoint/device, but it can also achieve dynamical device provision to
hosts or dump them back to the resource pool by altering the memory partitions.
Port bifurcation-Utilizing your bandwidth and resource pool
You will find x16 PCIe downstream port in most servers, and some of them have
BIOS that supports the bifurcation of the port, dividing a x16 port into two x8
or four x4 ports, and this allows better utilization of the bandwidth. Afterall,
even for high end x16 GPUs, the performance would not be affected much when the
bandwidth is reduced to x8 in most cases, it would be inefficient to use up the
entire x16 bandwidth.
Recall that there is only one upstream form a fan-out switch, it will take all
x16 bandwidth when connected to the host even though it may only need 4 or 8
lanes. The fabric switch though, can bifurcate its x16 upstream port to up to
four x4 ports. This allows us to interconnect more systems together without
having them affecting each other. Without taking all 16 PCIe lanes of the hosts,
the rest of them can be used for other peripherals, leading to better bandwidth
utilization.
Complex deployment-keep track of your devices
A fan-out switch is only bridging the devices to the host, you will most likely
have to embed extra program to monitor your devices because the switch itself
will not read the configurations. On the other hand, the SoC of fabric switch
makes it acting as the root complex that can read the configuration space of
your PCIe devices, therefore it gets all the basic information and recognize
what each PCIe device does.
In H3 Platfrom expansion chassis, the turned-off slots get 3.3V power by
default. This allows the BMC to recognize devices and get the information for
your need, even when the slots/devices are at rest.
Device error occurrence-Dealing with reset processes
When errors occurred to one of your PCIe devices, a fan-out switch would not
allow you to reset the device alone, you would reset all devices in the entire
fan-out system. But a PCIe fabric switch will allow you to reset only the device
that needs it. As we have discussed, a fabric switch enables memory space
partitioning. And because every downstream is assigned to different partition,
fabric switch allows you to reset the device with error without affecting other
devices by recognizing which partition it is in.
FUTURE OF IT SYSTEMS-SMALLER IN SIZE, HIGHER CAPABILITY, AND BETTER UTILIZATION
We have gone through the major differences between PCIe fan-out switch and the
PCIe fabric switch. Clearly, a fabric switch is capable of more complex things
than a fan-out switch could, but the applications of fabric switches are not
commonly seen so far. In high-performance computing industry, IT infrastructures
are expanding rapidly to cope with the increasing IT needs. Servers are piled up
in data warehouses and devices are added with fan-out modules, which really
create a lot of wastes and inefficient usage of resources. With PCIe4 introduces
to the market, IT manufacturers will be able to fit more computing power onto a
smaller device, so we can expect certain drop in the amount of wastes created.
In addition to that, PCIe fabric switch technology will allow the IT leaders to
utilize their devices better. In stead of piling up servers and storage, it is
more important to make every piece of them efficient.
Product Info：PCIe Gen4 GPU Chassis｜rackmount pcie expansion chassis
--------------------------------------------------------------------------------
category : GPU
tags :
* AI
* Rendering
Please enable JavaScript to view the comments powered by Disqus.
*
*
*
*
POPULAR TAGS
* CXL 2.0
* PCIe 5.0
* AI
* Rendering
* High-performance computing
* Datacenter
* Composable infrastructure
PEOPLE ALSO VIEWED
* GPU
June 23, 2020 2946
BALANCED GPU SOLUTION IN COMPOSABILITY AND PERFORMANCE
Compare PCIe fabrics, InfiniBand, and Ethernet in terms of GPU pooling.
Explain how H3 GPU solution could achieve balance between performance and
composability.
Read More
We use cookies to help us improve our webpage. Please read our Cookie Policy.
OK
* Products
CXL Memory Pooling Solution NVMe MR-IOV Solution GPU Chassis PCIe Chassis
Accessories Management Software Product Selector Storage Box
* Solution
Composable AI Rendering NVMeoF Case Study
* Support
RMA Application Bug/Issue Report Security Advisory Warranty
* Knowledge Base
Q&A Document
* Newsroom
Press Release Event News Webinar
* About
About H3 Careers Contact Us
*
11F-2, No.79, Sec. 1, Xintai 5th Rd., Xizhi Dist., New Taipei City 22101,
Taiwan
*
+886 2 2698 3800
*
*
*
*
Disclaimer
Cookie Policy
Copyright © 2019 H3 Platform Inc.