Docs
Configuration
librechat.yaml
Custom AI Endpoints
Databricks

Databricks

[Sign up for Databricks](https://www.databricks.com/try-databricks#account)

Notes:

  • Since Databricks provides a full completions endpoint, ending with “invocations” for “serving-endpoints”, use of directEndpoint setting is required.
  • titleMessageRole set to “user” is also required for title generation, as singular “system” messages are not supported.
librechat.yaml
    - name: 'Databricks'
      apiKey: '${DATABRICKS_API_KEY}'
      baseURL: 'https://your_databricks_serving_endpoint_url_here_ending_with/invocations'
      models:
        default: [
          "databricks-meta-llama-3-70b-instruct",
        ]
        fetch: false
      titleConvo: true
      titleModel: 'current_model'
      directEndpoint: true # required
      titleMessageRole: 'user' # required