Documentation

Govern, secure, and enhance your AI traffic.

Quick Start

A full featured and managed AI gateway that provides instant access to 250+ LLMs with enterprise ready features.

Self Hosted

A self-hosted option for organizations that require complete control over their AI infrastructure.

Getting Started

Govern, Secure, and Optimize your AI Traffic. LangDB AI Gateway provides unified interface to all LLMs using OpenAI API format. Built with performance and reliability in mind.

from openai import OpenAI
client = OpenAI(
    base_url="https://api.us-east-1.langdb.ai"  # LangDB API base URL,
    api_key=api_key,  # Replace with your LangDB token
)
# Make the API call to LangDB's Completions API
response = client.chat.completions.create(
    model="gpt-4o",  # Use the model
    messages=[{"role": "developer", "content": "You are a helpful assistant."},
              {"role": "user", "content": "Hello!"}],  
    extra_headers={"x-project-id": "xxxxx"} # LangDB Project ID
)

Discover LangDB features and capabilities.

What is AI Gateway ?

Introduction to LangDB’s AI Gateway and its capabilities.

Working with API

Guide to integrating LangDB using its API.

Tracing Multiple Agents

Learn how to track and analyze multiple AI agents in LangDB.

Python SDK

Explore the Python SDK for seamless integration with LangDB.

Features

Tracing

Monitor and debug LLM workflows.

Routing

Optimize LLM selection dynamically based on cost, speed, and availability.

MCP Support

Enable compatibility and integration with MCP systems.

Usage

Track costs effectively.

Analytics

Gain insights of your API calls.

Evaluation

Extract and analyze model interactions to improve AI performance.

Guardrails

Ensure safe, reliable, and compliant AI interactions.