sambanova.ai Open in urlscan Pro
199.60.103.3  Public Scan

Submitted URL: https://shortclick.link/lk96sw
Effective URL: https://sambanova.ai/technology/sn40l-rdu-ai-chip?utm_source=freeman-forrest&utm_medium=Newsletter&utm_campaign=Samba...
Submission: On November 19 via manual from BR — Scanned from CA

Form analysis 0 forms found in the DOM

Text Content

This website stores cookies on your computer. These cookies are used to collect
information about how you interact with our website and allow us to remember
you. We use this information in order to improve and customize your browsing
experience and for analytics and metrics about our visitors both on this website
and other media. To find out more about the cookies we use, see our Privacy
Policy.

Accept

Support



EN
 * Japanese

Products
SambaNova’s AI platform is the technology backbone for the next decade of AI
innovation. Customers are turning to SambaNova to quickly deploy
state-of-the-art AI and deep learning capabilities that help them outcompete
their peers.
SambaNova Suite
The only, enterprise grade full stack platform, purpose built for generative AI
DataScale®
The platform for generative AI development and innovation
Use Cases
Public Sector | AI for Science | Sovereign AI
Technology
RDU: The GPU Alternative
Power the most demanding generative and agentic AI workloads with the most
performant & capable processor, purpose-built for AI
Composition of Experts
Easily run your custom models, accelerate discovery, & power the next generation
of high performance computing
Developers
SambaNova delivers the only enterprise-grade full stack platform, from chips to
models, purpose built for generative AI
SambaNova Cloud
Supercharge your AI-powered applications across Llama 3 8B, 70B, & 405B models.
For free.
Resources
Developer Community
Starter Kits
Research
Technical Documentation
Resources
Find what you need to accelerate your AI journey.
Blogs
Webinars
White Papers
Product Collateral
Support
Ebooks
Videos
Reports
Podcasts
Contact Us
About
Customers are turning to SambaNova to quickly deploy state-of-the-art AI
capabilities to gain competitive advantage. Our purpose-built enterprise-scale
AI platform is the technology backbone for the next generation of AI computing.
We power the foundation models that unlock the valuable business insights
trapped in data.
About
Company
Team
Investors
Careers
Latest News
Awards & Recognition
Press Releases
News Coverage
Try It Now »
EN
 * Japanese

Try It Now »

 * Products
   SambaNova’s AI platform is the technology backbone for the next decade of AI
   innovation. Customers are turning to SambaNova to quickly deploy
   state-of-the-art AI and deep learning capabilities that help them outcompete
   their peers.
   SambaNova Suite
   The only, enterprise grade full stack platform, purpose built for generative
   AI
   DataScale®
   The platform for generative AI development and innovation
   Use Cases
   Public Sector | AI for Science | Sovereign AI
   Technology
   RDU: The GPU Alternative
   Power the most demanding generative and agentic AI workloads with the most
   performant & capable processor, purpose-built for AI
   Composition of Experts
   Easily run your custom models, accelerate discovery, & power the next
   generation of high performance computing
 * Developers
   SambaNova delivers the only enterprise-grade full stack platform, from chips
   to models, purpose built for generative AI
   SambaNova Cloud
   Supercharge your AI-powered applications across Llama 3 8B, 70B, & 405B
   models. For free.
   Resources
   Developer Community
   Starter Kits
   Research
   Technical Documentation
   Support
 * Resources
   Find what you need to accelerate your AI journey.
   Blogs
   Webinars
   White Papers
   Product Collateral
   Ebooks
   Videos
   Reports
   Podcasts
 * About
   Customers are turning to SambaNova to quickly deploy state-of-the-art AI
   capabilities to gain competitive advantage. Our purpose-built
   enterprise-scale AI platform is the technology backbone for the next
   generation of AI computing. We power the foundation models that unlock the
   valuable business insights trapped in data.
   About
   Company
   Team
   Investors
   Careers
   Latest News
   Awards & Recognition
   Press Releases
   News Coverage
 * Support
 * Contact Us

Try It Now »


RDU: THE GPU ALTERNATIVE


POWER THE MOST DEMANDING GENERATIVE AND AGENTIC AI WORKLOADS WITH THE MOST
PERFORMANT AND CAPABLE PROCESSOR, PURPOSE-BUILT FOR AI




BUILT FOR AGENTIC AI

With TBs of addressable memory, the SN40L reconfigurable dataflow unit (RDU) was
built for the next generation of AI workloads, known as Agentic AI. Agentic AI
connects multiple models to work together to perform complex tasks that
individual models cannot do alone, all from a single user prompt.  This is a
complex task that cannot be effectively performed with GPUs. 



HOLD HUNDREDS OF MODELS IN MEMORY AT THE SAME TIME

The SN40L can hold hundreds of models in-memory, equating to trillions of
parameters. This results in incredible performance gains over GPUs that can only
hold a single  model at a time.

SWITCH BETWEEN MODELS IN MICROSECONDS

With Agentic AI many models work together to perform complex tasks, requiring
the ability to switch between models rapidly. The SN40L switches between models
in microseconds, up to 100x faster than GPU.




WORLD RECORD INFERENCE PERFORMANCE

Inference is rapidly replacing model training as the primary function of AI
systems. The combination of the large addressable memory and the dataflow
architecture of the RDU result in a system that is significantly faster than
other processors for model inference, shown by the multiple world records. While
other processors can only perform inference, the SambaNova RDU is capable of
model training and inference on a single system. With the SambaNova RDU you can
train and fine tune your models on the same platform you run inference, all with
the same or better training performance than GPUs.



 


DATAFLOW ARCHITECTURE

Designed for AI, the SambaNova RDU was built with a revolutionary dataflow
architecture. This design makes the RDU significantly more efficient for these
workloads than GPUs as it eliminates redundant calls to memory, which are an
inherent limitation of how GPUs function. This built-in efficiency is one of the
features that makes the RDU capable of much higher performance than GPUs in a
fraction of the footprint.


BUILT FOR THE AI WORKLOADS OF TODAY AND TOMORROW

Protect your investment in AI infrastructure with the only complete platform
that can efficiently run the generative AI workloads of today and the agentic AI
solutions of tomorrow. The SambaNova systems are capable of seamlessly scaling
out, so it can grow with your organization as you increase your AI capabilities.


READY TO SEE MORE?

Schedule a meeting to see how SambaNova can help advance your AI initiatives.

Get Started

Stay on Top of AI: trends, information and company news delivered to you.
Sign Up
Headquarters:
2200 Geng Road, Unit 100
Palo Alto, CA 94303
(650) 263-1153
Terms & Conditions Privacy Policy
Copyright © 2024 SambaNova Systems, Inc. All rights reserved


PRODUCTS

 * Sambanova Suite
 * DataScale®
 * Public Sector
 * AI for Science
 * Sovereign AI
   


TECHNOLOGY

 * RDU: The GPU Alternative
 * Compositon of Experts


RESOURCES

 * Blogs
 * Ebooks
 * Podcasts
 * Product Collateral
 * Reports
 * Videos
 * White Papers
 * Webinars


ABOUT

 * Company
 * Team
 * Investors
 * Careers
 * Latest News


CONTACT

 * Email Us
 * Support

Customers turn to SambaNova to quickly deploy state-of-the-art AI capabilities
to meet the demands of the AI-enabled world. Our purpose-built enterprise-scale
AI platform is the technology backbone for the next generation of AI computing.
We enable customers to unlock the valuable business insights trapped in their
data. Our flagship offering, SambaNova Suite, overcomes the limitations of
legacy technology to power the large complex foundation models that enable
customers to discover new services and revenue streams, and boost operational
efficiency. Headquartered in Palo Alto, California, SambaNova Systems was
founded in 2017 by industry luminaries, and hardware and software design experts
from Sun/Oracle and Stanford University. Investors include SoftBank Vision Fund
2, funds and accounts managed by BlackRock, Intel Capital, GV, Walden
International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, Celesta,
and several others.
Headquarters:
2200 Geng Road, Unit 100
Palo Alto, CA 94303
(650) 263-1153
Terms & Conditions Privacy Policy
Copyright © 2024 SambaNova
Systems, Inc. All rights reserved