www.modular.com Open in urlscan Pro
63.35.51.142  Public Scan

Form analysis
0 forms found in the DOM

Text Content

Max Platform

NEW


MAX Platform


Learn more

MAX Engine

MAX Serving

Mojo
Docs



Docs


Learn more

MAX Engine Docs

MAX Serving Docs

Mojo Docs
Company



About


Learn more

Vision

Keynote

Culture

Team

Contact

Careers
Blog

ModCon

LoginSign Up

Contact salesSign In
Menu
INTRODUCING MAX & ALL THE MODCON '23 ANNOUNCEMENTS
JOIN US AT MODCON '23 - OUR ANNUAL DEVELOPER CONFERENCE
LEARN more

Coming Q1 2024
Introducing  

Max Platform 
The world’s only extensible and unified AI inference platform

The Modular Accelerated Xecution (MAX) platform is an integrated suite of tools
for AI deployment that power all your AI workloads of today, and tomorrow.

Learn MoreSign Up
JOIN INCREDIBLE COMPANIES




GIVE YOUR AI DEVELOPERS SUPERPOWERS

Enable your AI developers to achieve more with less. Empower them to bring the
newest AI innovations to production faster, with higher performance and lower
cost. All without having to rewrite your stack.


FEWER THINGS THAT WORK BETTER

One set of tools to support your entire inference pipeline and all your AI
models — reduce complexity and simplify deployment.


UNPARALLELED PERFORMANCE

Productionize your GenAI and traditional AI inference pipelines within your
latency and budget constraints — take full advantage of any hardware out of the
box.


MEETS YOU WHERE YOU ARE

Drop-in compatible with the tools and technologies you already use in production
— realize more value faster without rewriting your stack.

01
USE CASES


SUPPORT ALL YOUR GENERATIVE AND TRADITIONAL AI USE CASES

MAX provides drop-in compatibility with any model from any framework.  Support
for all the framework operations, quantized types, dynamics shapes, and your
custom operations.

Sign up now


DLRM RMC1 (MULTI-HOT SUPPORT)


ROBERTA-BASE


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2 (MULTI-HOT SUPPORT)


ROBERTA-BASE


DLRM RMC1 (MULTI-HOT SUPPORT)


ROBERTA-BASE


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2 (MULTI-HOT SUPPORT)


ROBERTA-BASE


DLRM RMC1 (MULTI-HOT SUPPORT)


ROBERTA-BASE


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2 (MULTI-HOT SUPPORT)


ROBERTA-BASE


DLRM RMC1 (MULTI-HOT SUPPORT)


ROBERTA-BASE


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2 (MULTI-HOT SUPPORT)


ROBERTA-BASE


BERT-BASE-UNCASED


DLRM RMC1 (MULTI-HOT SUPPORT)


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2


CLIP-VIT-LARGE-PATCH14


BERT-BASE-UNCASED


DLRM RMC1 (MULTI-HOT SUPPORT)


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2


CLIP-VIT-LARGE-PATCH14


BERT-BASE-UNCASED


DLRM RMC1 (MULTI-HOT SUPPORT)


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2


CLIP-VIT-LARGE-PATCH14


BERT-BASE-UNCASED


DLRM RMC1 (MULTI-HOT SUPPORT)


GPT-2


BERT-LARGE-UNCASED


DLRM RMC2


CLIP-VIT-LARGE-PATCH14

02
USE CASES


DEPLOY ON THE WORLD’S MOST PERFORMANT & COST EFFICIENT UNIFIED INFRASTRUCTURE

MAX unlocks state-of-the-art latency and throughput for your generative and
traditional AI models, helping you productionize larger models and realize
massive cost savings on your cloud bill.

Queries per Second *
125 qps
TensorFlow

17
qps
PyTorch

28
qps
Modular Engine

125
qps

* Model
DLRM RMC1
Instance
AWS c6g.4xlarge
(Graviton2)
Batch Size
1


DON’T BELIEVE US? PUT US TO THE TEST.

Explore our performance


LANGUAGE

Run Test




COMPUTER VISION

Run Test




RECOMMENDATION

Run Test


03
INTEGRATIONS


PLUG INTO WHAT YOU ALREADY USE

MAX integrates with the your existing AI serving stack so you can deploy to
production using the libraries and tools you know and trust. Adopt what's next
without throwing away what works.

Learn more

04
privacy & security


ENTERPRISE-GRADE AI THAT MEETS YOUR SECURITY AND PRIVACY STANDARDS

MAX integrates seamlessly into your enterprise, with superior data protection,
privacy, and compliance controls specialized to your industry.


DATA PROTECTION

Fortify your data, models, and inferences with encryption at-rest and in-transit
to prevent unauthorized access.




PRIVACY

Retain full data sovereignty with your infrastructure, security protocols, and
standards, ensuring you always comply with your operational jurisdictions and
privacy mandates.




COMPLIANCE

Maintain the highest standards of operational compliance within your enterprise,
including SOC 2, ISO-27001, GDPR, CCPA, PCI-DSS, GLBA, NIS Directive, and more.


Sign up


DATA PROTECTION

Fortify your data, models, and inferences with encryption at-rest and in-transit
to prevent unauthorized access.




PRIVACY

Retain full data sovereignty with your infrastructure, security protocols, and
standards, ensuring you always comply with your operational jurisdictions and
privacy mandates.




COMPLIANCE

Maintain the highest standards of operational compliance within your enterprise,
including SOC 2, ISO-27001, GDPR, CCPA, PCI-DSS, GLBA, NIS Directive, and more.



Sign up

AVAILABLE NOW


GET STARTED WITH MOJO 🔥

Download the Modular CLI to download and play with Mojo on your local machine.
We currently support Mac, Linux, and Windows (WSL) operating systems.

Download Now
Explore Mojo 🔥
Unpacking modular (0.1.0) ... Setting up modular (0.1.0) ...

  __  __           _       _
 |  \/  |         | |     | |
 | \  / | ___   __| |_   _| | __ _ _ __
 | |\/| |/ _ \ / _` | | | | |/ _` | '__|
 | |  | | (_) | (_| | |_| | | (_| | |
 |_|  |_|\___/ \__,_|\__,_|_|\__,_|_|




Thanks for installing the Modular CLI!
To get started, type "modular --help".
To install Mojo, type "modular install mojo".

Visit https://www.modular.com/mojo for our getting started guide.
Join our Discord at https://discord.gg/modular,
or file issues on Github at https://github.com/modularml/mojo/issues. modular
install mojo # Found release for https://packages.modular.com/mojo @
0.3.0--release, installing to /root/.modular/pkg/packages.modular.com_mojo
# Downloads complete, setting configs...
# Configs complete, running post-install hooks...
Testing `MODULAR_HOME=/root/.modular` *
`/root/.modular/pkg/packages.modular.com_mojo/bin/mojo`...
TEST: `mojo --help`... OK
TEST: `mojo run --help`... OK
TEST: `mojo build test_mandelbrot.mojo`... OK
TEST: `mojo build test_python.mojo`... OK
TEST: `mojo demangle`... OK
reformatted /tmp/tmpmclc50j5/test_format.mojo

All done! ✨ 🍰 ✨
# Installation complete. Mojo is installed under $HOME/.modular. Set
$MODULAR_HOME in your current shell to this location, and add
$HOME/.modular/pkg/packages.modular.com_mojo/bin to your PATH.
# Downloads complete, setting configs...
# Configs complete, running post-install hooks...
🔥 Mojo installed! 🔥 python3 matmul.py Throughput of a 128x128 matrix
multiplication in Python:
0.00215 GFLOP/s mojo matmul.🔥 Throughput of a 512x512 vectorized + parallelized
matrix multiplication in Mojo:
79.636 GFLOP/s (36870x speedup over Python)


LATEST ABOUT MODULAR

Product


KEY ANNOUNCEMENTS FROM MODCON 2023

December 4, 2023

Company


MODULAR PARTNERS WITH AMAZON WEB SERVICES (AWS) TO BRING MAX ENTERPRISE EDITION
EXCLUSIVELY TO AWS SERVICES

December 4, 2023

Company


MODULAR PARTNERS WITH NVIDIA TO BRING GPUS TO THE MAX PLATFORM

December 4, 2023

Developer


MOJO 🔥 TRAITS HAVE ARRIVED!

December 3, 2023

Community


MOJO 🔥 ADVENT OF CODE 2023

November 26, 2023

Company


MODCON 2023 SESSIONS YOU DON’T WANT TO MISS!

November 22, 2023



WHY MODULAR?


BUILT BY THE WORLD’S AI EXPERTS,

Our team has built most of the world’s existing AI infrastructure, including
TensorFlow, PyTorch, XLA, and we’ve built and scaled dev tools like Swift, LLVM,
& MLIR. Now we’re focused on rebuilding AI infrastructure for the world.


REINVENTED FROM THE GROUND UP

To unlock the next wave of AI innovation, we need a “first principles” approach
to the lowest layers of the AI stack. We can’t pile on more and more layers of
complexity on top of already over-complicated existing solutions.


BUILT WITH GENERALITY IN MIND

Natively multi-framework, multi-hardware, and multi-cloud — our infrastructure
was designed from the beginning to scale from the largest accelerator clusters
down to the smallest edge devices and in-between.


INFRASTRUCTURE THAT JUST WORKS

We build technology that meets you where you are. We don’t require you to
rewrite your models, workflows, or application code, grapple with confusing
converters, or be a hardware expert to take advantage of bleeding-edge
technology.


BUILT FOR YOU

Move beyond Big Tech’s trickle-down infrastructure and the challenges of
open-source software. Get direct access to industry experts that can solve any
issue you have with our infrastructure and make sure we’re meeting your
SLA/SLOs.




READY TO GET STARTED?

Sign up to gain access to Modular’s infrastructure.

Sign up now
API References, Tutorials, & More

Read the docs





MAX Platform

MAX Engine 🏎️

MAX Serving ⚡️

Mojo 🔥

Sign Up

Blog

Careers


Copyright ©

2023

Modular Inc

Terms

,
Privacy

&
Acceptable Use

Please accept our cookies
We use cookies to track visitor traffic so we can learn to improve the website
and documentation. Read more
AcceptReject

Cookie preferences

Cookie usage
The Modular Docs website uses browser cookies only to track website traffic with
Google Analytics. For more details about how we handle sensitive data, please
read our privacy policy.
Google Analytics cookiesGoogle Analytics cookies
These cookies track website usage and are unique to this website.

NameDomainExpirationDescription^_gagoogle.com2 yearsGoogle Analytics

Accept allReject allSave settings