docs.runpod.io Open in urlscan Pro
2606:4700::6810:f276  Public Scan

Submitted URL: http://docs.runpod.io/
Effective URL: https://docs.runpod.io/docs
Submission: On November 02 via api from US — Scanned from DE

Form analysis 0 forms found in the DOM

Text Content

Jump to Content

GuidesRecipesAPI ReferenceChangelogv1.0

--------------------------------------------------------------------------------

Log In
Guides
Log In
Moon (Dark Mode)Sun (Light Mode)
v1.0
GuidesRecipesAPI ReferenceChangelog

Ctrl+K
WELCOME📖 | About❓ | FAQ🤔 | How Do I?Expose PortsAutomatically Stop My
PodCustomize a TemplateUse Real SSHBulk Start/Stop PodsOverride My Public
KeyCreate a Network VolumeSync My Volume To A Cloud ProviderBackblaze B2 Cloud
StorageDropboxGoogle Cloud StorageMicrosoft Azure Blob StorageAmazon S3Terminate
a PodDownload a Folder from a PodManage Payment Card DeclinesTransfer Files with
SCP/rsyncGPU INSTANCESTroubleshooting 502 ErrorsTemplatesPodsPod Environment
VariablesLogsSavings PlansSERVERLESS🛰️ | OverviewQuick Start⚙️ | The
HandlerGenerator HandlerAsync HandlerError HandlingAdditional Controls📦 | The
Worker🏁 | The EndpointTemplate CreationEndpoint Creation🖇️ | Using Your
EndpointEndpoint URLsJob States/LifecycleCustom APIsWorker Image
CreationTemplate CreationAutoscaling and Worker LifecycleUsing Your APITesting
Your API's Response TimeUsing S3 to upload images with serverlessUpdating Your
EndpointResources & Tools🎞️ | Video Resources🧰 | runpodctl🐍 | runpod-python🧬
| GraphQL SpecGraphQL APICreate PodGet GPU TypesGet PodStart PodStop PodManage
TemplatesManage Serverless EndpointsTeam AccountGet StartedRolesInviteshosts🤝 |
GPU Partners✔️ | Requirements🛠️ | Maintenance & Reliability🔥 | Burn Testing
All
Guides
Recipes
Reference
Changelog

START TYPING TO SEARCH…


WELCOME

 * 📖 | About
 * ❓ | FAQ
 * 🤔 | How Do I?
   * Expose Ports
   * Automatically Stop My Pod
   * Customize a Template
   * Use Real SSH
   * Bulk Start/Stop Pods
   * Override My Public Key
   * Create a Network Volume
   * Sync My Volume To A Cloud Provider
   * Backblaze B2 Cloud Storage
   * Dropbox
   * Google Cloud Storage
   * Microsoft Azure Blob Storage
   * Amazon S3
   * Terminate a Pod
   * Download a Folder from a Pod
   * Manage Payment Card Declines
   * Transfer Files with SCP/rsync


GPU INSTANCES

 * Troubleshooting 502 Errors
 * Templates
 * Pods
   * Pod Environment Variables
   * Logs
 * Savings Plans


SERVERLESS

 * 🛰️ | Overview
   * Quick Start
 * ⚙️ | The Handler
   * Generator Handler
   * Async Handler
   * Error Handling
   * Additional Controls
 * 📦 | The Worker
 * 🏁 | The Endpoint
   * Template Creation
   * Endpoint Creation
 * 🖇️ | Using Your Endpoint
   * Endpoint URLs
   * Job States/Lifecycle
 * Custom APIs
   * Worker Image Creation
   * Template Creation
   * Autoscaling and Worker Lifecycle
   * Using Your API
   * Testing Your API's Response Time
   * Using S3 to upload images with serverless
   * Updating Your Endpoint


RESOURCES & TOOLS

 * 🎞️ | Video Resources
 * 🧰 | runpodctl
 * 🐍 | runpod-python
 * 🧬 | GraphQL Spec
 * GraphQL API
   * Create Pod
   * Get GPU Types
   * Get Pod
   * Start Pod
   * Stop Pod
   * Manage Templates
   * Manage Serverless Endpoints


TEAM ACCOUNT

 * Get Started
 * Roles
 * Invites


HOSTS

 * 🤝 | GPU Partners
   * ✔️ | Requirements
   * 🛠️ | Maintenance & Reliability
   * 🔥 | Burn Testing


📖 | ABOUT

Suggest Edits

RUNPOD

> RunPod is a cloud computing platform, primarily designed for AI and machine
> learning applications. Our key offerings include GPU Instances, Serverless
> GPUs, and AI Endpoints.


GPU INSTANCES

> Our GPU Instances allow you to deploy container-based GPU instances that spin
> up in seconds using both public and private repositories. They are available
> in two different types: Secure Cloud and Community Cloud. The Secure Cloud
> runs in T3/T4 data centers providing high reliability and security, while the
> Community Cloud connects individual compute providers to consumers through a
> vetted, secure peer-to-peer system.


SERVERLESS GPUS

> The Serverless GPU service offers pay-per-second serverless GPU computing,
> bringing autoscaling to your production environment. This service, part of our
> Secure Cloud offering, guarantees low cold-start times and stringent security
> measures.


AI ENDPOINTS

> Our AI Endpoints are fully managed and scaled to handle any workload. They are
> designed for a variety of applications including Dreambooth, Stable Diffusion,
> Whisper, and more.


ADDITIONAL FEATURES

> RunPod also provides a CLI / GraphQL API to automate workflows and manage
> compute jobs effectively. Users can access multiple points for coding,
> optimizing, and running AI/ML jobs, including SSH, TCP Ports, and HTTP Ports.
> We also offer OnDemand and Spot GPUs to suit different compute needs, and
> Persistent Volumes to ensure the safety of your data even when your pods are
> stopped. Our Cloud Sync feature allows seamless data transfer to any cloud
> storage.


OUR MISSION

> RunPod is committed to making cloud computing accessible and affordable to all
> without compromising on features, usability, or experience. We strive to
> empower individuals and enterprises with cutting-edge technology, enabling
> them to unlock the potential of AI and cloud computing.

For any general inquiries, we recommend browsing through our documentation. Our
team is also available on Discord, our support chat, and by email. More
information can be found on our contact page.

Updated about 2 months ago

--------------------------------------------------------------------------------

❓ | FAQ
Did this page help you?
Yes
No
 * Table of Contents
 * * RunPod
     * GPU Instances
     * Serverless GPUs
     * AI Endpoints
     * Additional Features
     * Our Mission