urlscan.io logo urlscan.io
SecurityTrails logo

litellm.brry.co Open in urlscan Pro
2606:4700:3032::6815:c3a  Public Scan

Back to summary
URL: https://litellm.brry.co/
Submission: On December 06 via api from US — Scanned from US

Form analysis 0 forms found in the DOM

Text Content

LITELLM API

 1.53.7 

OAS 3.1

/openapi.json

Proxy Server to call 100+ LLMs in the OpenAI format. Customize Swagger Docs

👉 LiteLLM Admin Panel on /ui. Create, Edit Keys with SSO

💸 LiteLLM Model Cost Map.

Authorize



MODEL MANAGEMENT

GET/models
Model List

GET/v1/models
Model List

POST/model/new
Add New Model

POST/model/update
Update Model

GET/v1/model/info
Model Info V1

GET/model/info
Model Info V1

GET/model_group/info
Model Group Info

POST/model/delete
Delete Model



CHAT/COMPLETIONS

POST/openai/deployments/{model}/chat/completions
Chat Completion

POST/engines/{model}/chat/completions
Chat Completion

POST/chat/completions
Chat Completion

POST/v1/chat/completions
Chat Completion



COMPLETIONS

POST/openai/deployments/{model}/completions
Completion

POST/engines/{model}/completions
Completion

POST/completions
Completion

POST/v1/completions
Completion



EMBEDDINGS

POST/openai/deployments/{model}/embeddings
Embeddings

POST/engines/{model}/embeddings
Embeddings

POST/embeddings
Embeddings

POST/v1/embeddings
Embeddings



IMAGES

POST/images/generations
Image Generation

POST/v1/images/generations
Image Generation



AUDIO

POST/audio/speech
Audio Speech

POST/v1/audio/speech
Audio Speech

POST/audio/transcriptions
Audio Transcriptions

POST/v1/audio/transcriptions
Audio Transcriptions



ASSISTANTS

GET/assistants
Get Assistants

POST/assistants
Create Assistant

GET/v1/assistants
Get Assistants

POST/v1/assistants
Create Assistant

DELETE/assistants/{assistant_id}
Delete Assistant

DELETE/v1/assistants/{assistant_id}
Delete Assistant

POST/threads
Create Threads

POST/v1/threads
Create Threads

GET/threads/{thread_id}
Get Thread

GET/v1/threads/{thread_id}
Get Thread

POST/threads/{thread_id}/messages
Add Messages

GET/threads/{thread_id}/messages
Get Messages

POST/v1/threads/{thread_id}/messages
Add Messages

GET/v1/threads/{thread_id}/messages
Get Messages

POST/threads/{thread_id}/runs
Run Thread

POST/v1/threads/{thread_id}/runs
Run Thread



BATCH

POST/batches
Create Batch

GET/batches
List Batches

POST/v1/batches
Create Batch

GET/v1/batches
List Batches

POST/{provider}/v1/batches
Create Batch

GET/{provider}/v1/batches
List Batches

GET/batches/{batch_id}
Retrieve Batch

GET/v1/batches/{batch_id}
Retrieve Batch

GET/{provider}/v1/batches/{batch_id}
Retrieve Batch



MODERATIONS

POST/moderations
Moderations

POST/v1/moderations
Moderations



LLM UTILS

POST/utils/token_counter
Token Counter

GET/utils/supported_openai_params
Supported Openai Params



BUDGET MANAGEMENT

POST/budget/new
New Budget

POST/budget/info
Info Budget

GET/budget/settings
Budget Settings

GET/budget/list
List Budget

POST/budget/delete
Delete Budget



DEFAULT

GET/
Home

GET/routes
Get Routes

GET/config/pass_through_endpoint
Get Pass Through Endpoints

POST/config/pass_through_endpoint
Create Pass Through Endpoints

DELETE/config/pass_through_endpoint
Delete Pass Through Endpoints

POST/config/pass_through_endpoint/{endpoint_id}
Update Pass Through Endpoints



RERANK

POST/rerank
Rerank

POST/v1/rerank
Rerank



FINE-TUNING

POST/fine_tuning/jobs
✨ (Enterprise) Create Fine-Tuning Job

GET/fine_tuning/jobs
✨ (Enterprise) List Fine-Tuning Jobs

POST/v1/fine_tuning/jobs
✨ (Enterprise) Create Fine-Tuning Job

GET/v1/fine_tuning/jobs
✨ (Enterprise) List Fine-Tuning Jobs

POST/fine_tuning/jobs/{fine_tuning_job_id}/cancel
✨ (Enterprise) Cancel Fine-Tuning Jobs

POST/v1/fine_tuning/jobs/{fine_tuning_job_id}/cancel
✨ (Enterprise) Cancel Fine-Tuning Jobs



VERTEX AI PASS-THROUGH

PATCH/vertex_ai/{endpoint}
Vertex Proxy Route

PUT/vertex_ai/{endpoint}
Vertex Proxy Route

GET/vertex_ai/{endpoint}
Vertex Proxy Route

POST/vertex_ai/{endpoint}
Vertex Proxy Route

DELETE/vertex_ai/{endpoint}
Vertex Proxy Route



PASS-THROUGH

PATCH/vertex_ai/{endpoint}
Vertex Proxy Route

PUT/vertex_ai/{endpoint}
Vertex Proxy Route

GET/vertex_ai/{endpoint}
Vertex Proxy Route

POST/vertex_ai/{endpoint}
Vertex Proxy Route

DELETE/vertex_ai/{endpoint}
Vertex Proxy Route

PATCH/gemini/{endpoint}
Gemini Proxy Route

PUT/gemini/{endpoint}
Gemini Proxy Route

GET/gemini/{endpoint}
Gemini Proxy Route

POST/gemini/{endpoint}
Gemini Proxy Route

DELETE/gemini/{endpoint}
Gemini Proxy Route

PATCH/cohere/{endpoint}
Cohere Proxy Route

PUT/cohere/{endpoint}
Cohere Proxy Route

GET/cohere/{endpoint}
Cohere Proxy Route

POST/cohere/{endpoint}
Cohere Proxy Route

DELETE/cohere/{endpoint}
Cohere Proxy Route

PATCH/anthropic/{endpoint}
Anthropic Proxy Route

PUT/anthropic/{endpoint}
Anthropic Proxy Route

GET/anthropic/{endpoint}
Anthropic Proxy Route

POST/anthropic/{endpoint}
Anthropic Proxy Route

DELETE/anthropic/{endpoint}
Anthropic Proxy Route

PATCH/bedrock/{endpoint}
Bedrock Proxy Route

PUT/bedrock/{endpoint}
Bedrock Proxy Route

GET/bedrock/{endpoint}
Bedrock Proxy Route

POST/bedrock/{endpoint}
Bedrock Proxy Route

DELETE/bedrock/{endpoint}
Bedrock Proxy Route

PATCH/azure/{endpoint}
Azure Proxy Route

PUT/azure/{endpoint}
Azure Proxy Route

GET/azure/{endpoint}
Azure Proxy Route

POST/azure/{endpoint}
Azure Proxy Route

DELETE/azure/{endpoint}
Azure Proxy Route

PATCH/langfuse/{endpoint}
Langfuse Proxy Route

PUT/langfuse/{endpoint}
Langfuse Proxy Route

GET/langfuse/{endpoint}
Langfuse Proxy Route

POST/langfuse/{endpoint}
Langfuse Proxy Route

DELETE/langfuse/{endpoint}
Langfuse Proxy Route



GOOGLE AI STUDIO PASS-THROUGH

PATCH/gemini/{endpoint}
Gemini Proxy Route

PUT/gemini/{endpoint}
Gemini Proxy Route

GET/gemini/{endpoint}
Gemini Proxy Route

POST/gemini/{endpoint}
Gemini Proxy Route

DELETE/gemini/{endpoint}
Gemini Proxy Route



COHERE PASS-THROUGH

PATCH/cohere/{endpoint}
Cohere Proxy Route

PUT/cohere/{endpoint}
Cohere Proxy Route

GET/cohere/{endpoint}
Cohere Proxy Route

POST/cohere/{endpoint}
Cohere Proxy Route

DELETE/cohere/{endpoint}
Cohere Proxy Route



ANTHROPIC PASS-THROUGH

PATCH/anthropic/{endpoint}
Anthropic Proxy Route

PUT/anthropic/{endpoint}
Anthropic Proxy Route

GET/anthropic/{endpoint}
Anthropic Proxy Route

POST/anthropic/{endpoint}
Anthropic Proxy Route

DELETE/anthropic/{endpoint}
Anthropic Proxy Route



BEDROCK PASS-THROUGH

PATCH/bedrock/{endpoint}
Bedrock Proxy Route

PUT/bedrock/{endpoint}
Bedrock Proxy Route

GET/bedrock/{endpoint}
Bedrock Proxy Route

POST/bedrock/{endpoint}
Bedrock Proxy Route

DELETE/bedrock/{endpoint}
Bedrock Proxy Route



AZURE PASS-THROUGH

PATCH/azure/{endpoint}
Azure Proxy Route

PUT/azure/{endpoint}
Azure Proxy Route

GET/azure/{endpoint}
Azure Proxy Route

POST/azure/{endpoint}
Azure Proxy Route

DELETE/azure/{endpoint}
Azure Proxy Route



LANGFUSE PASS-THROUGH

PATCH/langfuse/{endpoint}
Langfuse Proxy Route

PUT/langfuse/{endpoint}
Langfuse Proxy Route

GET/langfuse/{endpoint}
Langfuse Proxy Route

POST/langfuse/{endpoint}
Langfuse Proxy Route

DELETE/langfuse/{endpoint}
Langfuse Proxy Route



HEALTH

GET/test
Test Endpoint

GET/health
Health Endpoint

GET/active/callbacks
Active Callbacks

GET/settings
Active Callbacks

GET/health/readiness
Health Readiness

OPTIONS/health/readiness
Health Readiness Options

GET/health/liveness
Health Liveliness

OPTIONS/health/liveness
Health Liveliness Options

GET/health/liveliness
Health Liveliness

OPTIONS/health/liveliness
Health Liveliness Options



KEY MANAGEMENT

POST/key/generate
Generate Key Fn

POST/key/update
Update Key Fn

POST/key/delete
Delete Key Fn

GET/key/info
Info Key Fn

POST/key/{key}/regenerate
Regenerate Key Fn

GET/key/list
List Keys

POST/key/block
Block Key

POST/key/unblock
Unblock Key

POST/key/health
Key Health



INTERNAL USER MANAGEMENT

POST/user/new
New User

GET/user/info
User Info

POST/user/update
User Update

GET/user/list
Get Users

GET/user/get_users
Get Users

POST/user/delete
Delete User



TEAM MANAGEMENT

POST/team/new
New Team

POST/team/update
Update Team

POST/team/member_add
Team Member Add

POST/team/member_delete
Team Member Delete

POST/team/member_update
Team Member Update

POST/team/delete
Delete Team

GET/team/info
Team Info

POST/team/block
Block Team

POST/team/unblock
Unblock Team

GET/team/list
List Team

POST/team/{team_id}/callback
Add Team Callbacks

GET/team/{team_id}/callback
Get Team Callbacks

POST/team/{team_id}/disable_logging
Disable Team Logging



ORGANIZATION MANAGEMENT

POST/organization/new
New Organization

POST/organization/update
Update Organization

POST/organization/delete
Delete Organization

GET/organization/list
List Organization

POST/organization/info
Info Organization

POST/organization/member_add
Organization Member Add



CUSTOMER MANAGEMENT

POST/customer/block
Block User

POST/customer/unblock
Unblock User

POST/customer/new
New End User

GET/customer/info
End User Info

POST/customer/update
Update End User

POST/customer/delete
Delete End User

GET/customer/list
List End User



BUDGET & SPEND TRACKING

GET/spend/tags
View Spend Tags

GET/global/spend/report
Get Global Spend Report

GET/global/spend/tags
Global View Spend Tags

POST/spend/calculate
Calculate Spend

GET/spend/logs
View Spend Logs

POST/global/spend/reset
Global Spend Reset

POST/add/allowed_ip
Add Allowed Ip

POST/delete/allowed_ip
Delete Allowed Ip



CACHING

GET/cache/ping
Cache Ping

POST/cache/delete
Cache Delete

GET/cache/redis/info
Cache Redis Info

POST/cache/flushall
Cache Flushall



FILES

POST/files
Create File

GET/files
List Files

POST/v1/files
Create File

GET/v1/files
List Files

POST/{provider}/v1/files
Create File

GET/{provider}/v1/files
List Files

GET/files/{file_id}
Get File

DELETE/files/{file_id}
Delete File

GET/v1/files/{file_id}
Get File

DELETE/v1/files/{file_id}
Delete File

GET/{provider}/v1/files/{file_id}
Get File

DELETE/{provider}/v1/files/{file_id}
Delete File

GET/files/{file_id}/content
Get File Content

GET/v1/files/{file_id}/content
Get File Content

GET/{provider}/v1/files/{file_id}/content
Get File Content



SCHEMAS

AddTeamCallback
Expand allobject

BlockKeyRequest
Expand allobject

BlockTeamRequest
Expand allobject

BlockUsers
Expand allobject

Body_audio_transcriptions_audio_transcriptions_post
Expand allobject

Body_audio_transcriptions_v1_audio_transcriptions_post
Expand allobject

Body_create_file__provider__v1_files_post
Expand allobject

Body_create_file_files_post
Expand allobject

Body_create_file_v1_files_post
Expand allobject

BudgetDeleteRequest
Expand allobject

BudgetNew
Expand allobject

BudgetRequest
Expand allobject

ConfigurableClientsideParamsCustomAuth
Expand allobject

DeleteCustomerRequest
Expand allobject

DeleteTeamRequest
Expand allobject

DeleteUserRequest
Expand allobject

Deployment
Expand allobject

ErrorResponse
Expand allobject

GenerateKeyRequest
Expand allobject

GenerateKeyResponse
Expand allobject

HTTPValidationError
Expand allobject

Hyperparameters
Expand allobject

IPAddress
Expand allobject

KeyHealthResponse
Expand allobject

KeyRequest
Expand allobject

LiteLLMFineTuningJobCreate
Expand allobject

LiteLLM_BudgetTable
Expand allobject

LiteLLM_EndUserTable
Expand allobject

LiteLLM_OrganizationMembershipTable
Expand allobject

LiteLLM_Params
Expand allobject

LiteLLM_SpendLogs
Expand allobject

LiteLLM_TeamMembership
Expand allobject

LiteLLM_TeamTable
Expand allobject

LiteLLM_UserTable
Expand allobject

LiteLLM_VerificationToken
Expand allobject

LoggingCallbackStatus
Expand allobject

Member
Expand allobject

ModelInfo
Expand allobject

ModelInfoDelete
Expand allobject

NewCustomerRequest
Expand allobject

NewOrganizationRequest
Expand allobject

NewOrganizationResponse
Expand allobject

NewTeamRequest
Expand allobject

NewUserRequest
Expand allobject

NewUserResponse
Expand allobject

OrgMember
Expand allobject

OrganizationAddMemberResponse
Expand allobject

OrganizationMemberAddRequest
Expand allobject

OrganizationRequest
Expand allobject

PassThroughEndpointResponse
Expand allobject

PassThroughGenericEndpoint
Expand allobject

RegenerateKeyRequest
Expand allobject

SpendCalculateRequest
Expand allobject

TeamAddMemberResponse
Expand allobject

TeamMemberAddRequest
Expand allobject

TeamMemberDeleteRequest
Expand allobject

TeamMemberUpdateRequest
Expand allobject

TeamMemberUpdateResponse
Expand allobject

TokenCountRequest
Expand allobject

TokenCountResponse
Expand allobject

UpdateCustomerRequest
Expand allobject

UpdateKeyRequest
Expand allobject

UpdateTeamRequest
Expand allobject

UpdateUserRequest
Expand allobject

ValidationError
Expand allobject

updateDeployment
Expand allobject

updateLiteLLMParams
Expand allobject