# Anyscale (https://www.librechat.ai/docs/configuration/librechat_yaml/ai_endpoints/anyscale)

Anyscale Endpoints serves open models such as Llama through an OpenAI-compatible API that you can add to LibreChat as a custom endpoint.

## Get an API key

Create a key from your [Anyscale credentials](https://app.endpoints.anyscale.com/credentials). Add it to your `.env` file:

```bash filename=".env"
ANYSCALE_API_KEY=your-api-key
```

## Configuration

Add the endpoint under `endpoints.custom` in your `librechat.yaml`:

```yaml filename="librechat.yaml"
    - name: "Anyscale"
      apiKey: "${ANYSCALE_API_KEY}"
      baseURL: "https://api.endpoints.anyscale.com/v1"
      models:
        default: [
          "meta-llama/Llama-2-7b-chat-hf",
          ]
        fetch: true
      titleConvo: true
      titleModel: "meta-llama/Llama-2-7b-chat-hf"
      summarize: false
      summaryModel: "meta-llama/Llama-2-7b-chat-hf"
      modelDisplayLabel: "Anyscale"
```

## Notes

- With `fetch: true`, LibreChat loads the available model list from Anyscale, so the `default` array is only the initial selection.