Introducing Virtual MCP Servers
LogoLogo
GithubJoin SlackSignupBook a Demo
  • Documentation
  • Self Hosted
  • Integrations
  • Guides
  • Enterprise
  • Introduction to AI Gateway
  • Supported Models
  • Supported MCP Servers
  • Getting Started
    • Quick Start
    • Working with API
    • Working with Multiple Agents
    • Working with MCPs
    • Working with Headers
    • User Tracking
    • Using Parameters
  • Concepts
    • Thread
    • Trace
    • Run
    • Label
    • Message
    • Virtual Models
      • Routing with Virtual Model
      • Draft Mode
    • Virtual MCP Servers
  • Features
    • Tracing
    • Routing
    • MCP Support
    • Publishing MCP Servers
    • Usage
    • Analytics
    • Guardrails
    • User Roles
    • Cost Control
    • Response Caching
  • Python SDK
    • Getting Started
  • API Reference
  • Postman Collection
Powered by GitBook
LogoLogo

Social

  • LinkedIn
  • X
  • Youtube
  • Github

Platform

  • Pricing
  • Documentation
  • Blog

Company

  • Home
  • About

Legal

  • Privacy Policy
  • Terms of Service

2025 LangDB. All rights reserved.

On this page

Was this helpful?

Export as PDF
  1. Concepts
  2. Virtual Models

Routing with Virtual Model

Manage routing strategies easily in LangDB AI Gateway’s UI to boost efficiency, speed, and reliability in AI workflows.

PreviousVirtual ModelsNextDraft Mode

Last updated 1 month ago

Was this helpful?

In LangDB AI Gatewau, any virtual model can act as a router. Just define a strategy and list of target models—it’ll route requests based on metrics like cost, latency, percentage, er or custom rules.

Setting up Routing

Setting up routing in a virtual model is straightforward:

  1. Open any virtual model in the Chat Playground and click Show Config

  2. Choose a routing strategy (like fallback, optimized, percentage, etc.)

  3. Add your target models—each one can be configured just like the virtual models you set up in the previous section

Each target defines:

  • Which model to use

  • Prompt

  • MCP Servers

  • Guardrails

  • Response Format

  • Custom parameters like temperature, max_tokens, penalties, etc.

All routing options are available directly in the virtual model config panel.

Check more about the Routing Strategies.