Virtual Models

Virtual Models in LangDB let you save and reuse AI configurations, ensuring streamlined workflows and consistent behavior across applications. They allow you to define system and user messages upfront, customize model parameters like temperature, max tokens, and penalties, and integrate LangDB’s built-in tools for enhanced response capabilities.

Once saved, these configurations can be quickly accessed and reused across multiple applications.

Features

• Predefined Conversations: Set system and user messages to guide AI behavior.

• Custom Parameters: Fine-tune settings like temperature, max tokens, top-p, logit bias, and penalties.

• Tools Integration: Augment AI responses with LangDB’s built-in tools.

• Reusable Configurations: Save models under a unique name for easy retrieval and use.

How to Create a Virtual Model

1

Choose a model in the Chat Playground

2

Click on the Show Config Drop-down on the right

3

Edit the Model and Save

Let's create a gpt-4o-minimodel with some custom system prompt, parameters and LangDB Search Tool.

4

Go to Models Section

Once, we create a new virtual model, it is ready to be used just as any model on LangDB.

You can check all the virtual models in the models section of the project.