AI Gateway

OpenRouter

The future will bring us hundreds of language models and dozens of providers for each. How will you choose the

Replicate

Deploying and scaling machine learning models can be a complex and time-consuming process. However, Replicate is a platform that aims

INFRA

LiteLLM

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

LLMs

AutoGen

Build LLM applications via multiple agents AutoGen provides a multi-agent conversation framework as a high-level abstraction. It is an open-source

FRAMEWORK

Langchain

LangChain is a framework for developing applications powered by language models. It enables applications that: * Are context-aware: connect a language

FRAMEWORK

SkyPilot

Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with

INFRA

WandB

The AI Developer Platform Weights & Biases helps AI developers build better models faster. Quickly track experiments, version and iterate on

ML

EdgeLLama

An Open Standard For Distributed Inference In Federated Networks EdgeLLama is an open standard designed to allow any supported machine

FEDNET

PyRCA

A Library for Metric-based Root Cause Analysis PyRCA (Python Root Cause Analysis) is an open-source Python machine learning library specifically

ML

Deep Lake

Vector Database for All Data Deep Lake as a Vector Store for LLM Applications * Store and search embeddings and their

DATALAKE

LlamaIndex

LlamaIndex (formerly GPT Index) is a data framework for LLM applications to ingest, structure, and access private or domain-specific data.

RAG

GPTCache

A Library for Creating Semantic Cache for LLM Queries 🚀 What is GPTCache? ChatGPT and various large language models (LLMs) boast

GPT

Gorilla LLM

Large Language Model Connected with Massive APIs Gorilla is a LLM that can provide appropriate API calls. It is trained

LLMs