Skip to main content

LibreChat is joining ClickHouse. Learn more

LibreChat

APIpie

Configure APIpie as a custom endpoint in LibreChat.

APIpie is an aggregator that exposes models from many providers through a single OpenAI-compatible endpoint.

Get an API key

Create a key from apipie.ai/dashboard/profile/api-keys and add it to your .env file:

APIPIE_API_KEY=your-api-key

Configuration

Add the endpoint to the custom list under endpoints in your librechat.yaml. If your file already has an endpoints.custom list, paste only the - name: entry into it, keeping the same indentation:

endpoints:
  custom:
    - name: "APIpie"
      apiKey: "${APIPIE_API_KEY}"
      baseURL: "https://apipie.ai/v1/"
      models:
        default: [
          "gpt-4",
          "gpt-4-turbo",
          "gpt-3.5-turbo",
          "claude-3-opus",
          "claude-3-sonnet",
          "claude-3-haiku",
          "llama-3-70b-instruct",
          "llama-3-8b-instruct",
          "gemini-pro-1.5",
          "gemini-pro",
          "mistral-large",
          "mistral-medium",
          "mistral-small",
          "mistral-tiny",
          "mixtral-8x22b",
          ]
        fetch: false
      titleConvo: true
      titleModel: "claude-3-haiku"
      dropParams: ["stream"]
      modelDisplayLabel: "APIpie"

Notes

  • Automatic model fetching is not supported, so fetch is set to false and the model list is defined inline. Use the script above to regenerate the list when new models are added.
  • Conversation titling results can be inconsistent.
  • dropParams: ["stream"] removes the stream parameter, which is not currently supported.

How is this guide?