AI Gateway


Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

SkyPilot abstracts away cloud infra burdens:

  • Launch jobs & clusters on any cloud
  • Easy scale-out: queue and run many jobs, automatically managed
  • Easy access to object stores (S3, GCS, R2)

SkyPilot maximizes GPU availability for your jobs:

  • Provision in all zones/regions/clouds you have access to (the Sky), with automatic failover

SkyPilot cuts your cloud costs:

  • Managed Spot: 3-6x cost savings using spot VMs, with auto-recovery from preemptions
  • Optimizer: 2x cost savings by auto-picking the cheapest VM/zone/region/cloud
  • Autostop: hands-free cleanup of idle clusters

SkyPilot supports your existing GPU, TPU, and CPU workloads, with no code changes.

Current supported providers (AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare, any Kubernetes cluster):

SkyPilot Supported Clouds
Welcome to SkyPilot! — SkyPilot documentation
About the author

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to AI Gateway.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.