Docs
Configuration
librechat.yaml
Custom AI Endpoints
Cohere

Cohere

Cohere API key: dashboard.cohere.com

Notes:

  • Known: icon provided.
  • Experimental: does not follow OpenAI-spec, uses a new method for endpoint compatibility, shares some similarities and parameters.
  • For a full list of Cohere-specific parameters, see the Cohere API documentation.
  • Note: The following parameters are recognized between OpenAI and Cohere. Most are removed in the example config below to prefer Cohere’s default settings:
    • stop: mapped to stopSequences
    • top_p: mapped to p, different min/max values
    • frequency_penalty: mapped to frequencyPenalty, different min/max values
    • presence_penalty: mapped to presencePenalty, different min/max values
    • model: shared, included by default.
    • stream: shared, included by default.
    • max_tokens: shared, mapped to maxTokens, not included by default.
librechat.yaml
    - name: "cohere"
      apiKey: "${COHERE_API_KEY}"
      baseURL: "https://api.cohere.ai/v1"
      models:
        default: ["command-r","command-r-plus","command-light","command-light-nightly","command","command-nightly"]
        fetch: false
      modelDisplayLabel: "cohere"
      titleModel: "command"
      dropParams: ["stop", "user", "frequency_penalty", "presence_penalty", "temperature", "top_p"]

image