LibreChat is joining ClickHouse to power the open-source Agentic Data Stack 🎉 Learn more
LibreChat
ConfigurationLibreChat YAMLAI EndpointsFireworks

Fireworks

Configure Fireworks as a custom endpoint in LibreChat.

Fireworks AI serves a range of open models through an OpenAI-compatible API, used in LibreChat as a custom endpoint.

Get an API key

Create a key from the Fireworks API keys page. Add it to your .env file:

FIREWORKS_API_KEY=your-api-key

Configuration

Add the endpoint under endpoints.custom in your librechat.yaml:

    - name: "Fireworks"
      apiKey: "${FIREWORKS_API_KEY}"
      baseURL: "https://api.fireworks.ai/inference/v1"
      models:
        default: [
          "accounts/fireworks/models/mixtral-8x7b-instruct",
          ]
        fetch: true
      titleConvo: true
      titleModel: "accounts/fireworks/models/llama-v2-7b-chat"
      summarize: false
      summaryModel: "accounts/fireworks/models/llama-v2-7b-chat"
      modelDisplayLabel: "Fireworks"
      dropParams: ["user"]

Notes

  • The API is strict for some models and may reject fields like user, so drop them with dropParams.

How is this guide?

Edit on GitHub

Deepseek

Configure Deepseek as a custom endpoint in LibreChat.

Groq

Configure Groq as a custom endpoint in LibreChat.

On this page

Get an API keyConfigurationNotes