Custom Endpoints

Add custom AI providers like OpenRouter, Ollama, and Anthropic-compatible gateways to LibreChat using librechat.yaml

LibreChat supports OpenAI API-compatible services as custom endpoints. It also supports Anthropic-compatible custom endpoints with provider: "anthropic". You configure endpoints in librechat.yaml, store API keys in .env, and mount the config via docker-compose.override.yml for Docker deployments.

Which File Does What?

Custom endpoint setup involves three files, each with a specific role:

librechat.yaml -- Defines your custom endpoints (name, API URL, models, display settings)
.env -- Stores sensitive values like API keys (referenced from librechat.yaml using ${VAR_NAME} syntax)
docker-compose.override.yml -- Mounts librechat.yaml into the Docker container (Docker users only)

For a full overview of how these files work together, see the Configuration Overview.

Before You Start

This guide assumes you have LibreChat installed and running. If not, complete the Docker setup first.

Step 1. Mount librechat.yaml (Docker Only)

Docker users need to mount librechat.yaml as a volume so the container can read it. Skip this step if you are running LibreChat locally without Docker.

cp docker-compose.override.yml.example docker-compose.override.yml

Edit docker-compose.override.yml and ensure the volume mount is uncommented:

services:
  api:
    volumes:
      - type: bind
        source: ./librechat.yaml
        target: /app/librechat.yaml

Learn more: Docker Override Guide

Step 2. Configure librechat.yaml

Create a librechat.yaml file in the project root (if it does not exist) and add your endpoint configuration. See the librechat.yaml guide for detailed setup instructions.

Here is an example with OpenRouter, Ollama, and an Anthropic-compatible gateway:

version: 1.3.13
cache: true
endpoints:
  custom:
    - name: 'OpenRouter'
      apiKey: '${OPENROUTER_KEY}'
      baseURL: 'https://openrouter.ai/api/v1'
      models:
        default: ['meta-llama/llama-3-70b-instruct']
        fetch: true
      titleConvo: true
      titleModel: 'meta-llama/llama-3-70b-instruct'
      dropParams: ['stop']
      modelDisplayLabel: 'OpenRouter'
    - name: 'Ollama'
      apiKey: 'ollama'
      baseURL: 'http://host.docker.internal:11434/v1/'
      models:
        default: ['llama3:latest', 'command-r', 'mixtral', 'phi3']
        fetch: true
      titleConvo: true
      titleModel: 'current_model'
    - name: 'Claude-Compatible'
      provider: 'anthropic'
      apiKey: '${ANTHROPIC_API_KEY}'
      baseURL: 'https://api.anthropic.com'
      headers:
        anthropic-version: '2023-06-01'
      models:
        default: ['claude-sonnet-4-5']
        fetch: false
      titleConvo: true
      titleModel: 'claude-sonnet-4-5'

Browse all compatible providers in the AI Endpoints section. For the full field reference, see Custom Endpoint Object Structure.

Anthropic-Compatible Endpoints

Use provider: "anthropic" only for endpoints that speak the native Anthropic Messages API. For OpenAI-compatible gateways that merely expose Anthropic models, omit provider and use the regular OpenAI-compatible custom endpoint shape.

API Key Configuration

When configuring API keys in custom endpoints, you have three options:

Environment variable (recommended): apiKey: "${OPENROUTER_KEY}" -- reads from .env
User provided: apiKey: "user_provided" -- users enter their own key in the UI
Direct value (not recommended): apiKey: "sk-your-actual-key" -- stored in plain text

Step 3. Set Environment Variables

Add the API keys referenced in your librechat.yaml to the .env file:

OPENROUTER_KEY=your_openrouter_api_key

Each ${VARIABLE_NAME} in librechat.yaml must have a matching entry in .env.

Step 4. Restart and Verify

After editing configuration files, you must restart LibreChat for changes to take effect.

docker compose down && docker compose up -d

Open LibreChat in your browser. Your custom endpoints should appear in the endpoint selector dropdown.

Not Seeing Your Endpoint?

Check the server logs for configuration errors:

docker compose logs api

Common issues: YAML syntax errors, missing env vars, or librechat.yaml not mounted in Docker. Validate your YAML with the YAML Validator.

OpenRouter Still Does Not Show Up

For OpenRouter specifically, verify the three-file chain:

.env has OPENROUTER_KEY=...
librechat.yaml has apiKey: "${OPENROUTER_KEY}" under the OpenRouter custom endpoint
Docker users mounted librechat.yaml in docker-compose.override.yml

Then restart with:

docker compose down && docker compose up -d

If the endpoint appears but returns 402 Payment Required, the request reached OpenRouter successfully and the issue is usually account credits, billing, or model availability on OpenRouter.

Next Steps

AI Endpoints

Browse all compatible AI providers with example configurations

→

librechat.yaml Guide

Full setup guide and reference for the config file

→