www.modular.com Open in urlscan Pro
34.249.200.254  Public Scan

Form analysis
0 forms found in the DOM

Text Content

Engine
Overview

PERFORMANCE DASH

dOCS
Mojo🔥
Overview

Docs
Blog

ModCon NEW

Careers

Company
About

Vision

KEYNOTEs

Team

Newsletter

Culture

contact
Contact Sales


LoginSign Up
LoginSign Up
Menu
JOIN US AT MODCON '23 - OUR ANNUAL DEVELOPER CONFERENCE
WE'VE RAISED $100M TO FIX AI 
INFRASTRUCTURE FOR THE WORLD.
LEARN more



THE FUTUREOF AI DEVELOPMENT STARTS HERE

Mojo 🔥 - the programming language for all AI developers

Available on Mac 🍎, Linux & Windows (WSL)

Download Now
Learn more

Unpacking modular (0.1.0) ...Setting up modular (0.1.0)
...████████████████████████████████████████ 100%





OUR UNIFIED, EXTENSIBLE PLATFORM SUPERPOWERS YOUR AI

Modular is an integrated, composable suite of tools that simplifies your
AI infrastructure so your team can develop, deploy, and innovate faster.

Clouds
Ai Frameworks
Engine

Devices


01
Model deployment


THE WORLD’S FASTEST UNIFIED INFERENCE ENGINE

Modular’s inference engine unifies AI industry frameworks and hardware, enabling
you to deploy to any cloud or on-prem environment with minimal code changes –
unlocking unmatched usability, performance, and portability.

Learn moreRead the docs
COMpute portability


RUN YOUR MODELS
ANYWHERE, REDUCE COSTS

Seamlessly move your workloads to the best hardware for the job without
rewriting or recompiling your models. Avoid lock-in and take advantage of cloud
price efficiencies and performance improvements without migration costs.

Learn more



02
Programmability & Extensibility


MOJO 🔥 — A NEW PROGRAMMING LANGUAGE FOR ALL AI DEVELOPERS

Mojo is a programming language that combines the usability of Python with the
performance of C, unlocking unparalleled programmability of AI hardware and
extensibility of AI models.

Learn moreRead the docs
SOftmax.🔥

def softmax(lst):
  norm = np.exp(lst - np.max(lst))
  return norm / norm.sum()

struct NDArray:
  def max(self) -> NDArray:
    return self.pmap(SIMD.max)

struct SIMD[type: DType, width: Int]:
  def max(self, rhs: Self) -> Self:
    return (self >= rhs).select(self, rhs)



model Scalability


DEPLOY THE LARGEST MODELS IN THE WORLD ON OUR STACK

The Modular Compute Platform dynamically partitions models with billions of
parameters and distributes their execution across multiple machines, enabling
unparalleled efficiency, scale, and reliability for the largest workloads.

Contact Sales
LLaMA

Gopher

T5

Jurassic

WORLD CLASS ENTERPRISE & COMMUNITY SUPPORT


GET HELP FROM THE PEOPLE WHO KNOW MODULAR BEST

As a community member, you can chat with the Modular team directly on Discord,
and as an enterprise customer, you get direct support from industry experts to
keep you running and enable you to scale to your next challenges.

Chat with us now
General
Modular
Today at 4:17PM
How can we help you?


DEPLOY ON THE FASTEST UNIFIED INFRASTRUCTURE ON THE PLANET

Modular unlocks state-of-the-art latency, efficiency, and throughput, helping
you productionize larger models and realize massive cost savings on your cloud
bill.

Queries per Second *
125 qps
TensorFlow

17
qps
PyTorch

28
qps
Modular Engine

125
qps

* Model
DLRM RMC1
Instance
AWS c6g.4xlarge
(Graviton2)
Batch Size
1


DON’T BELIEVE US? PUT US TO THE TEST.

Explore our performance


LANGUAGE

Run Test




COMPUTER VISION

Run Test




RECOMMENDATION

Run Test


LAUNCHING IN 2024


MODULAR'S CLOUD
COMPUTE PLATFORM

Join the waiting list



01.

TRAINING AT SCALE

Notebooks for training on the largest compute clusters using Python & Mojo 🔥
for highly optimized workloads.


02.

MANAGED & BYOC

Utilize our managed environment, or Bring your own cloud (BYOC), for seamless
workload management.


03.

PERFORMANCE & METRICS

Detailed machine performance and metrics data to provide end-to-end insight into
your AI workloads.


04.

DEVELOPER FIRST UI & CLI

Leverage our easy-to-use web UI or CLI tooling to seamlessly manage your
training and deployment workflows.


05.

SECURITY & ENCRYPTION

Enterprise security & encryption for your data to be secured at rest and in
transit on your data stores.





WHY MODULAR?


BUILT BY THE WORLD’S AI EXPERTS,

Our team has built most of the world’s existing AI infrastructure, including
TensorFlow, PyTorch, TPUs, and MLIR, and launched software like Swift and LLVM.
Now we’re focused on rebuilding AI infrastructure for the world.


REINVENTED FROM THE GROUND UP

To unlock the next wave of AI innovation, we need a “first principles” approach
to the lowest layers of the AI stack. We can’t pile on more and more layers of
complexity on top of already over-complicated existing solutions.


BUILT WITH GENERALITY IN MIND

Natively multi-model, multi-framework, multi-hardware, and multi-cloud — our
infrastructure scales from the largest clusters down to the smallest edge
devices and in-between.


INFRASTRUCTURE THAT JUST WORKS

We build technology that meets you where you are at. You shouldn’t have to
rewrite your models or application code, grapple with confusing converters, or
be a hardware expert to take advantage of state-of-the-art technology.


BUILT FOR YOU

Move beyond Big Tech’s trickle-down infrastructure. Get direct access to
industry experts that will help solve any issue you have with our infrastructure
and make sure we’re meeting your SLA/SLOs.




READY TO GET STARTED?

Sign up to gain access to Modular’s infrastructure.

Sign up now
API References, Tutorials, & More

Read the docs





Engine

Mojo 🔥

Hardware

Performance

Sign Up

Blog

Careers


Copyright ©

2023

Modular Inc

Terms

,
Privacy

&
Acceptable Use


Please accept our cookies
We use cookies to track visitor traffic so we can learn to improve the website
and documentation. Read more
AcceptReject

Cookie preferences

Cookie usage
The Modular Docs website uses browser cookies only to track website traffic with
Google Analytics. For more details about how we handle sensitive data, please
read our privacy policy.
Google Analytics cookiesGoogle Analytics cookies
These cookies track website usage and are unique to this website.

NameDomainExpirationDescription^_gagoogle.com2 yearsGoogle Analytics

Accept allReject allSave settings