AI Overview

LibreChat allows you to configure and integrate various AI providers, APIs, and their corresponding credentials. This enables you to utilize different AI models, settings, and functionalities based on your needs and requirements.

Key Concepts

• Endpoints: An endpoint refers to an AI provider, configuration, or API that determines the available models and settings for a chat request. Examples include OpenAI, Google, Anthropic, and others.

• Presets: A preset is a saved combination of an endpoint, model, and conversation settings. You can create and manage multiple presets to suit different use cases.

• Default Endpoint: If you have multiple endpoints configured, you can specify a default endpoint to be used when creating a new conversation.

• Default Preset: Similarly, you can set a default preset to be used automatically when starting a new conversation.

Functionality

1. AI Providers: Set up various pre-configured AI providers by providing the necessary credentials and API keys.

2. Manage Endpoints: Enable or disable different endpoints based on your requirements.

3. Create and Manage Presets: Define and save specific combinations of endpoints, models, and conversation settings as presets.

4. Set Default Endpoint and Preset: Specify a default endpoint and preset to streamline the process of starting new conversations. Here's a video to demonstrate: Setting a Default Preset

5. Customize Configurations: Explore advanced configuration options, such as adding custom endpoints like Ollama, Mistral AI or Openrouter.

Searching

LibreChat has separate search features for the web, your files, and your conversations:

• Search the web: Let the AI look up current information. In a regular chat, open the + palette in the message composer and select Web Search. For an agent, enable the Web Search capability in the Agent Builder instead. Web search needs both a search provider and a scraper, configured by your admin or with your own API keys when prompted. See Web Search.

• Search your files: Ask questions about documents you upload. In a regular chat, select File Search from the + palette. For an agent, enable the File Search capability in the Agent Builder. File Search finds passages by meaning using the RAG API, which your admin deploys. See RAG API (Chat with Files).

• Search your conversations: Use the search box in the sidebar to find past messages. It appears only when the admin has enabled Meilisearch. See Message Search.

Web Search and File Search are optional. They show up only when your deployment enables them, which includes turning on the web_search or file_search agent capability and giving your role the matching permission. If one is missing, ask your admin, or see Web Search option is not visible and the fileSearch interface setting.