Docs
Configuration
librechat.yaml
Object Structure
Model Config

Model Config Structure

Each item under models is part of a list of records, either a boolean value or Object:

When specifying a model as an object:

An object allows for detailed configuration of the model, including its deploymentName and/or version. This mode is used for more granular control over the models, especially when working with multiple versions or deployments under one instance or resource group.

Example:

endpoints / azureOpenAI / groups / {group_item} / models / {model_item=Object}
models:
  gpt-4-vision-preview:
    deploymentName: "gpt-4-vision-preview"
    version: "2024-02-15-preview"

Notes:

  • Deployment Names and Versions are critical for ensuring that the correct model is used.
    • Double-check these values for accuracy to prevent unexpected behavior.

deploymentName

Key:

KeyTypeDescriptionExample
deploymentNameStringThe name of the deployment for the model. Identifies the deployment of the model within Azure.This does not have to be the matching OpenAI model name as is convention, but must match the actual name of your deployment on Azure.

Required: yes

Example:

endpoints / azureOpenAI / groups / {group_item} / models / {model_item=Object} / deploymentName
deploymentName: "gpt-4-vision-preview"

version

Key:

KeyTypeDescriptionExample
versionStringSpecifies the version of the model. Defines the version of the model to be used.

Required: yes

Example:

endpoints / azureOpenAI / groups / {group_item} / models / {model_item=Object} / version
version: "2024-02-15-preview"

Enabling a Model with Default Group Configuration

Key:

KeyTypeDescriptionExample
modelsBooleanEnables a model with default group configuration.When a model is enabled (`true`) without using an object, it uses the group's configuration values for deployment name and version.

Example:

endpoints / azureOpenAI / groups / {group_item} / models
models:
  gpt-4-turbo: true