Model Specs Object Structure
Overview
The modelSpecs object helps you provide a simpler UI experience for AI models within your application.
There are 3 main fields under modelSpecs:
enforce(optional; default: false)prioritize(optional; default: true)list(required)addedEndpoints(optional)
Notes:
- If
enforceis set to true, model specifications can potentially conflict with other interface settings such asmodelSelect,presets, andparameters. - The
listarray contains detailed configurations for each model, including presets that dictate specific behaviors, appearances, and capabilities. - If interface fields are not specified in the configuration, having a list of model specs will disable the following interface elements:
modelSelectparameterspresets
- If you would like to enable these interface elements along with model specs, you can set them to
truein theinterfaceobject.
Managing user-provided API keys with Model Specs
When Model Specs disable modelSelect, the endpoints dropdown — and the gear icon that opens the Set API Key dialog — is hidden. Users can still set or rotate keys for any endpoint configured with apiKey: "user_provided" from Settings → Data controls → API keys.
That list is scoped to the endpoints a user can actually reach: the endpoints referenced by your model specs, plus any addedEndpoints. When the agents endpoint is reachable, it also includes the agent allowedProviders (or every configured provider when allowedProviders is left unset).
Example
modelSpecs:
enforce: true
prioritize: true
list:
- name: 'meeting-notes-gpt4'
label: 'Meeting Notes Assistant (GPT4)'
softDefault: true
description: 'Generate meeting notes by simply pasting in the transcript from a Teams recording.'
iconURL: 'https://example.com/icon.png'
showOnLanding: true
conversation_starters:
- 'Summarize this meeting transcript'
- 'Extract action items and owners'
hideBadgeRow: true
skills:
- 'brand-guidelines'
- 'meeting-notes'
subagents:
enabled: true
allowSelf: true
agent_ids: []
preset:
endpoint: 'azureOpenAI'
model: 'gpt-4-turbo-1106-preview'
maxContextTokens: 128000 # Maximum context tokens
max_tokens: 4096 # Maximum output tokens
temperature: 0.2
modelLabel: 'Meeting Summarizer'
greeting: |
This assistant creates meeting notes based on transcripts of Teams recordings.
To start, simply paste the transcript into the chat box.
promptPrefix: |
Based on the transcript, create coherent meeting minutes for a business meeting. Include the following sections:
- Date and Attendees
- Agenda
- Minutes
- Action Items
Focus on what items were discussed and/or resolved. List any open action items.
The format should be a bulleted list of high level topics in chronological order, and then one or more concise sentences explaining the details.
Each high level topic should have at least two sub topics listed, but add as many as necessary to support the high level topic.
- Do not start items with the same opening words.
Take a deep breath and be sure to think step by step.Top-level Fields
enforce
| Key | Type | Description | Example |
|---|---|---|---|
| enforce | Boolean | Determines whether the model specifications should strictly override other configuration settings. | Setting this to `true` can lead to conflicts with interface options if not managed carefully. |
Default: false
Example:
modelSpecs:
enforce: trueprioritize
| Key | Type | Description | Example |
|---|---|---|---|
| prioritize | Boolean | Specifies if model specifications should take priority over the default configuration when both are applicable. | When set to `true`, it ensures that a modelSpec is always selected in the UI. Doing this may prevent users from selecting different endpoints for the selected spec. |
Default: true
Example:
modelSpecs:
prioritize: falseaddedEndpoints
| Key | Type | Description | Example |
|---|---|---|---|
| addedEndpoints | Array of Strings | Allows specific endpoints (e.g., "openAI", "google") to be selectable in the UI alongside the defined model specs. | Requires `interface.modelSelect` to be `true`. If this field is used and `interface.modelSelect` is not explicitly set, `modelSelect` will default to `true`. |
Default: [] (empty list)
Note: Must be one of the following:
openAI, azureOpenAI, google, anthropic, assistants, azureAssistants, bedrock, agents
Example:
modelSpecs:
# ... other modelSpecs fields
addedEndpoints:
- openAI
- googlelist
Required
| Key | Type | Description | Example |
|---|---|---|---|
| list | Array of Objects | Contains a list of individual model specifications detailing various configurations and behaviors. | Each object in the list details the configuration for a specific model, including its behaviors, appearance, and capabilities related to the application's functionality. |
Model Spec (List Item)
Within each Model Spec, or each list item, you can configure the following fields:
name
| Key | Type | Description | Example |
|---|---|---|---|
| name | String | Unique identifier for the model. | No default. Must be specified. |
Description: Unique identifier for the model.
label
| Key | Type | Description | Example |
|---|---|---|---|
| label | String | A user-friendly name or label for the model, shown in the header dropdown. | No default. Optional. |
Description: A user-friendly name or label for the model, shown in the header dropdown.
default
| Key | Type | Description | Example |
|---|---|---|---|
| default | Boolean | Specifies if this model spec is the default selection, to be auto-selected on every new chat. |
Description:
Specifies if this model spec is the default selection, to be auto-selected on every new chat.
softDefault
| Key | Type | Description | Example |
|---|---|---|---|
| softDefault | Boolean | Specifies if this model spec should be selected only for first-time users who have not already selected a model, model spec, or agent. |
Description:
Specifies a first-run default without overriding a user's later selections. Use softDefault when you want to guide new users to a curated spec while preserving user choice after they pick another model, spec, or agent.
Viewing an older conversation that used a soft-default spec does not re-arm that spec as the user's default after they have made another selection.
Example:
modelSpecs:
list:
- name: 'general-assistant'
label: 'General Assistant'
softDefault: true
preset:
endpoint: 'openAI'
model: 'gpt-4o-mini'iconURL
| Key | Type | Description | Example |
|---|---|---|---|
| iconURL | String | URL or a predefined endpoint name for the model's icon in selector, header, and conversation branding. | No default. Optional. |
Description:
URL or a predefined endpoint name for the model's icon in selector, header, and conversation branding. Use showIconInMenu and showIconInHeader to control where the icon appears.
description
| Key | Type | Description | Example |
|---|---|---|---|
| description | String | A brief description of the model and its intended use or role, shown in the model selector and optionally on the chat landing. | No default. Optional. |
Description:
A brief description of the model and its intended use or role, shown in the model selector. If showOnLanding is true, the same description is also shown on the chat landing under the spec label.
Plain text descriptions render as text. Descriptions that start with < render through the config HTML sanitizer, allowing safe inline markup and media such as small icons.
conversation_starters
| Key | Type | Description | Example |
|---|---|---|---|
| conversation_starters | Array of Strings | Suggested starter prompts shown as clickable cards on the chat landing when this model spec is selected. | No default. Optional. |
Description:
Conversation starters give users curated first prompts for a model spec. They are shown on the empty chat landing for the selected spec and are especially useful with showOnLanding branding. Clicking a starter submits it as the first message of a new conversation.
- A maximum of 4 starters are displayed, matching the agent/assistant limit.
- If the spec's preset points to an agent or assistant that defines its own conversation starters, those take precedence.
Example:
modelSpecs:
list:
- name: 'meeting-notes'
label: 'Meeting Notes'
showOnLanding: true
conversation_starters:
- 'Summarize this meeting transcript'
- 'Create action items with owners and due dates'
preset:
endpoint: 'agents'
model: 'gpt-4o'showOnLanding
| Key | Type | Description | Example |
|---|---|---|---|
| showOnLanding | Boolean | Shows this model spec's label and description on the chat landing in place of the default greeting. | showOnLanding: true |
Default: false
Use this when a curated model spec should brand the first empty-chat screen. Existing model specs are unchanged unless showOnLanding is set to true.
Example:
modelSpecs:
list:
- name: 'branded-assistant'
label: 'Acme Research'
description: '<span><img src="/assets/acme.svg" alt="Acme" /> Research with approved sources</span>'
showOnLanding: true
iconURL: '/assets/acme.svg'
preset:
endpoint: 'openAI'
model: 'gpt-4o'group
| Key | Type | Description | Example |
|---|---|---|---|
| group | String | Optional group name for organizing model specs in the UI selector. Controls where the spec appears in the menu hierarchy. | No default. Optional. |
| groupIcon | String | Optional icon for custom groups. Can be a URL or a built-in endpoint key (e.g., "openAI", "groq"). Only the first spec with a groupIcon in each group is used. | No default. Optional. |
Description:
Optional group name for organizing model specs in the UI selector. The group field provides flexible control over how model specs are organized:
- If
groupmatches an endpoint name (e.g.,"openAI","groq"): The model spec appears nested under that endpoint in the selector menu - If
groupis a custom name (doesn't match any endpoint): Creates a separate collapsible section with that name. You can optionally usegroupIconto set a custom icon for this section (URL or built-in key like"openAI") - If
groupis omitted: The model spec appears as a standalone item at the top level
This feature is particularly useful when you want to add descriptions to models without losing the organizational structure of the selector menu.
hideBadgeRow
| Key | Type | Description | Example |
|---|---|---|---|
| hideBadgeRow | Boolean | Hides the tool badge row for this model spec in the chat composer. | hideBadgeRow: true |
Default: false
Use this when a curated model spec should not show the row of tool/capability badges beneath the composer.
Example:
modelSpecs:
list:
- name: 'general-assistant'
label: 'General Assistant'
hideBadgeRow: true
preset:
endpoint: 'openAI'
model: 'gpt-4o-mini'Example:
modelSpecs:
list:
# Example 1: Nested under an endpoint
# When group matches an endpoint name, the spec appears under that endpoint
- name: 'gpt-4o-optimized'
label: 'GPT-4 Optimized'
description: 'Most capable GPT-4 model with multimodal support'
group: 'openAI' # Appears nested under the OpenAI endpoint
preset:
endpoint: 'openAI'
model: 'gpt-4o'
# Example 2: Custom group section with icon
# When group is a custom name, it creates a separate collapsible section
- name: 'coding-assistant'
label: 'Coding Assistant'
description: 'Specialized for coding tasks'
group: 'My Assistants'
groupIcon: 'https://example.com/icons/assistants.png' # Custom icon for the group
preset:
endpoint: 'openAI'
model: 'gpt-4o'
# Multiple specs with the same group name are grouped together
- name: 'writing-assistant'
label: 'Writing Assistant'
description: 'Specialized for creative writing'
group: 'My Assistants' # Grouped with coding-assistant, uses its icon
preset:
endpoint: 'anthropic'
model: 'claude-sonnet-4'
# Example 3: Custom group using built-in icon
- name: 'fast-model'
label: 'Fast Model'
group: 'Fast Models'
groupIcon: 'groq' # Uses built-in Groq icon
preset:
endpoint: 'groq'
model: 'llama3-8b-8192'
# Example 4: Standalone (no group)
# When group is omitted, the spec appears at the top level
- name: 'general-assistant'
label: 'General Assistant'
description: 'General purpose assistant'
# No group field - appears as standalone item at top level
preset:
endpoint: 'openAI'
model: 'gpt-4o-mini'showIconInMenu
| Key | Type | Description | Example |
|---|---|---|---|
| showIconInMenu | Boolean | Controls whether the model's icon appears in the header dropdown menu. |
Description:
Controls whether the model's icon appears in the header dropdown menu. Defaults to true.
showIconInHeader
| Key | Type | Description | Example |
|---|---|---|---|
| showIconInHeader | Boolean | Controls whether the model's icon appears in the header dropdown button, left of its name. |
Description:
Controls whether the model's icon appears in the header dropdown button, left of its name. Defaults to true.
authType
| Key | Type | Description | Example |
|---|---|---|---|
| authType | String | Authentication type required for the model spec. | Optional. Possible values: "override_auth", "user_provided", "system_defined" |
Description:
Authentication type required for the model spec. Determines whether authentication is overridden, provided by the user, or defined by the system.
webSearch
| Key | Type | Description | Example |
|---|---|---|---|
| webSearch | Boolean | Enables web search capability for this model spec. | When true, the model can perform web searches. |
Description:
Enables web search capability for this model spec. When set to true, the model can perform web searches to retrieve current information.
Example:
modelSpecs:
list:
- name: 'research-assistant'
label: 'Research Assistant'
webSearch: true
preset:
endpoint: 'openAI'
model: 'gpt-4o'fileSearch
| Key | Type | Description | Example |
|---|---|---|---|
| fileSearch | Boolean | Enables file search capability for this model spec. | When true, the model can search through uploaded files. |
Description:
Enables file search capability for this model spec. When set to true, the model can search through and reference uploaded files.
Example:
modelSpecs:
list:
- name: 'document-analyst'
label: 'Document Analyst'
fileSearch: true
preset:
endpoint: 'openAI'
model: 'gpt-4o'executeCode
| Key | Type | Description | Example |
|---|---|---|---|
| executeCode | Boolean | Enables code execution capability for this model spec. | When true, the model can execute code. |
Description:
Enables code execution capability for this model spec. When set to true, the model can execute code in a sandboxed environment.
Example:
modelSpecs:
list:
- name: 'code-assistant'
label: 'Code Assistant'
executeCode: true
preset:
endpoint: 'openAI'
model: 'gpt-4o'mcpServers
| Key | Type | Description | Example |
|---|---|---|---|
| mcpServers | Array of Strings | List of Model Context Protocol (MCP) server names to enable for this model spec. | Each string should match a configured MCP server name. |
Description:
List of Model Context Protocol (MCP) server names to enable for this model spec. MCP servers extend the model's capabilities with custom tools and resources.
Example:
modelSpecs:
list:
- name: 'enhanced-assistant'
label: 'Enhanced Assistant'
mcpServers:
- 'filesystem'
- 'sequential-thinking'
- 'fetch'
preset:
endpoint: 'openAI'
model: 'gpt-4o'skills
| Key | Type | Description | Example |
|---|---|---|---|
| skills | Boolean or Array of Strings | Controls Skills for this model spec. Use true for the user's active accessible catalog, false to force Skills off, or an array of Skill names as a strict allowlist. | skills: ["brand-guidelines", "code-review"] |
Description:
Controls Skills for this model spec when the Agents endpoint Skills capability is available.
true: enables the user's active accessible Skill catalog.false: disables Skills for this spec.- Array of Skill names: narrows catalog, manual invocation, and always-apply resolution to the named Skills.
Example:
modelSpecs:
list:
- name: 'brand-assistant'
label: 'Brand Assistant'
skills:
- 'brand-guidelines'
- 'approved-claims'
preset:
endpoint: 'agents'
model: 'gpt-4o'subagents
| Key | Type | Description | Example |
|---|---|---|---|
| subagents.enabled | Boolean | Enables the Subagents capability for ephemeral agents created from this model spec. | enabled: true |
| subagents.allowSelf | Boolean | Allows the ephemeral agent to spawn an isolated copy of itself for focused work. | allowSelf: true |
| subagents.agent_ids | Array of Strings | Private server-side allowlist of additional agent IDs this model spec may spawn. | agent_ids: [] |
Description:
Controls Subagents for ephemeral agents created from this model spec. Use this when you want a curated model spec to expose delegation behavior without requiring users to create or select a persisted parent agent.
enabled: adds the subagent spawn tool for this model spec.allowSelf: lets the ephemeral agent spawn a fresh isolated copy of itself.agent_ids: allows specific persisted agents as additional subagents. This list is capped byMAX_SUBAGENTSand remains server-side; startup config sent to clients only includes publicenabledandallowSelfflags.
When model specs are enforced, the model spec's subagents settings are authoritative over request payload values.
Example:
modelSpecs:
list:
- name: 'research-assistant'
label: 'Research Assistant'
subagents:
enabled: true
allowSelf: true
agent_ids: []
preset:
endpoint: 'agents'
model: 'gpt-4o'artifacts
| Key | Type | Description | Example |
|---|---|---|---|
| artifacts | String | Boolean | Enables the Artifacts capability for this model spec and optionally sets the artifact mode. | Set to `true` to enable with the default mode, `false` or omit to disable, or a specific mode string (e.g., `"default"`) to enable with that mode. |
Description:
Enables the Artifacts capability for this model spec, allowing the model to generate and display interactive artifacts such as React components, HTML, and Mermaid diagrams. When set to true, the default artifact mode is used. You can also specify a mode string directly.
Example:
modelSpecs:
list:
- name: 'artifact-assistant'
label: 'Artifact Assistant'
artifacts: true
preset:
endpoint: 'openAI'
model: 'gpt-4o'preset
| Key | Type | Description | Example |
|---|---|---|---|
| preset | Object | Detailed preset configurations that define the behavior and capabilities of the model. | See "Preset Object Structure" below. |
Description:
Detailed preset configurations that define the behavior and capabilities of the model (see Preset Object Structure below).
Preset Fields
The preset field for a modelSpecs.list item is made up of a comprehensive configuration blueprint for AI models within the system. It is designed to specify the operational settings of AI models, tailoring their behavior, outputs, and interactions with other system components and endpoints.
System Options
endpoint
Required
Accepted Values:
openAIazureOpenAIgoogleanthropicassistantsazureAssistantsbedrockagents
Note: If you are using a custom endpoint, the endpoint value must match the defined custom endpoint name exactly.
| Key | Type | Description | Example |
|---|---|---|---|
| endpoint | Enum (EModelEndpoint) or String (nullable) | Specifies the endpoint the model communicates with to execute operations. This setting determines the external or internal service that the model interfaces with. |
Example:
preset:
endpoint: 'openAI'modelLabel
| Key | Type | Description | Example |
|---|---|---|---|
| modelLabel | String (nullable) | The label used to identify the model in user interfaces or logs. It provides a human-readable name for the model, which is displayed in the UI, as well as made aware to the AI. | None |
Default: None
Example:
preset:
modelLabel: 'Customer Support Bot'greeting
| Key | Type | Description | Example |
|---|---|---|---|
| greeting | String | A predefined message that is visible in the UI before a new chat is started. This is a good way to provide instructions to the user, or to make the interface seem more friendly and accessible. |
Default: None
Example:
preset:
greeting: 'This assistant creates meeting notes based on transcripts of Teams recordings. To start, simply paste the transcript into the chat box.'promptPrefix
| Key | Type | Description | Example |
|---|---|---|---|
| promptPrefix | String (nullable) | A static text prepended to every prompt sent to the model, setting a consistent context for responses. | When using "assistants" as the endpoint, this becomes the OpenAI field `additional_instructions`. |
Default: None
Example 1:
preset:
promptPrefix: 'As a financial advisor, ...'Example 2:
preset:
promptPrefix: |
Based on the transcript, create coherent meeting minutes for a business meeting. Include the following sections:
- Date and Attendees
- Agenda
- Minutes
- Action Items
Focus on what items were discussed and/or resolved. List any open action items.
The format should be a bulleted list of high level topics in chronological order, and then one or more concise sentences explaining the details.
Each high level topic should have at least two sub topics listed, but add as many as necessary to support the high level topic.
- Do not start items with the same opening words.
Take a deep breath and be sure to think step by step.resendFiles
| Key | Type | Description | Example |
|---|---|---|---|
| resendFiles | Boolean | Indicates whether files should be resent in scenarios where persistent sessions are not maintained. |
Default: true
Example:
preset:
resendFiles: trueimageDetail
Accepted Values:
- low
- auto
- high
| Key | Type | Description | Example |
|---|---|---|---|
| imageDetail | Enum (eImageDetailSchema) | Specifies the level of detail required in image analysis tasks, applicable to models with vision capabilities (OpenAI spec). |
Default: "auto"
Example:
preset:
imageDetail: 'high'maxContextTokens
| Key | Type | Description | Example |
|---|---|---|---|
| maxContextTokens | Number | The maximum number of context tokens to provide to the model. | Useful if you want to limit the maximum context for this preset. |
Example:
preset:
maxContextTokens: 4096Agent Options
Note that these options are only applicable when using the agents endpoint.
You should exclude any model options and defer to the agent's configuration as defined in the UI.
Agent Access Filtering (v0.8.0+)
As of v0.8.0, LibreChat uses an ACL (Access Control List) based permissions system for agents. When model specs are configured to use agents, any agents that the user doesn't have access to will be automatically filtered out, even if they are configured in the model spec. This ensures users only see and can use agents they have proper permissions for.
For more information about the ACL permissions system, see the Agents documentation.
agent_id
| Key | Type | Description | Example |
|---|---|---|---|
| agent_id | String | Identification of an assistant. |
Example:
preset:
agent_id: 'agent_someUniqueId'Assistant Options
Note that these options are only applicable when using the assistants or azureAssistants endpoint.
Similar to Agents, you should exclude any model options and defer to the assistant's configuration.
assistant_id
| Key | Type | Description | Example |
|---|---|---|---|
| assistant_id | String | Identification of an assistant. |
Example:
preset:
assistant_id: 'asst_someUniqueId'instructions
Note: this is distinct from promptPrefix, as this overrides existing assistant instructions for current runs.
Only use this if you want to override the assistant's core instructions.
Use promptPrefix for additional_instructions.
More information:
- https://platform.openai.com/docs/api-reference/models#runs-createrun-instructions
- https://platform.openai.com/docs/api-reference/runs/createRun#runs-createrun-additional_instructions
| Key | Type | Description | Example |
|---|---|---|---|
| instructions | String | Overrides the assistant's default instructions. |
Example:
preset:
instructions: 'Please handle customer queries regarding order status.'append_current_datetime
Adds the current date and time to additional_instructions for each run. Does not overwrite promptPrefix, but adds to it.
| Key | Type | Description | Example |
|---|---|---|---|
| append_current_datetime | Boolean | Adds the current date and time to `additional_instructions` as defined by `promptPrefix` |
Example:
preset:
append_current_datetime: trueModel Options
Note: Each parameter below includes a note on which endpoints support it.
OpenAI / AzureOpenAI / Custom typically supporttemperature,presence_penalty,frequency_penalty,stop,top_p,max_tokens.
Google / Anthropic typically supporttopP,topK,maxOutputTokens; Google also supportsurl_contexton supported Gemini text models. Anthropic / OpenRouter / Bedrock (Anthropic and Nova models) supportpromptCacheandpromptCacheTtl. Bedrock supportsregion,maxTokens, and a few others.
model
Supported by: All endpoints (except
agents)
| Key | Type | Description | Example |
|---|---|---|---|
| model | String (nullable) | The model name to use for the preset, matching a configured model under the chosen endpoint. | None |
Default: None
Example:
preset:
model: 'gpt-4-turbo'temperature
Supported by:
openAI,azureOpenAI,temperature),anthropic(astemperature), and custom (OpenAI-like)
| Key | Type | Description | Example |
|---|---|---|---|
| temperature | Number | Controls how deterministic or “creative” the model responses are. |
Example:
preset:
temperature: 0.7presence_penalty
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
Not typically used by Google/Anthropic/Bedrock
| Key | Type | Description | Example |
|---|---|---|---|
| presence_penalty | Number | Penalty for repetitive tokens, encouraging exploration of new topics. |
Example:
preset:
presence_penalty: 0.3frequency_penalty
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
Not typically used by Google/Anthropic/Bedrock
| Key | Type | Description | Example |
|---|---|---|---|
| frequency_penalty | Number | Penalty for repeated tokens, reducing redundancy in responses. |
Example:
preset:
frequency_penalty: 0.5stop
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
Not typically used by Google/Anthropic/Bedrock
| Key | Type | Description | Example |
|---|---|---|---|
| stop | Array of Strings | Stop tokens for the model, instructing it to end its response if encountered. |
Example:
preset:
stop:
- 'END'
- 'STOP'top_p
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
Google/Anthropic often usetopP(capital “P”) instead oftop_p.
| Key | Type | Description | Example |
|---|---|---|---|
| top_p | Number | Nucleus sampling parameter (0-1), controlling the randomness of tokens. |
Example:
preset:
top_p: 0.9topP
Supported by:
anthropic
(similar purpose totop_p, but named differently in those APIs)
| Key | Type | Description | Example |
|---|---|---|---|
| topP | Number | Nucleus sampling parameter for Google/Anthropic endpoints. |
Example:
preset:
topP: 0.8topK
Supported by:
anthropic
(k-sampling limit on the next token distribution)
| Key | Type | Description | Example |
|---|---|---|---|
| topK | Number | Limits the next token selection to the top K tokens. |
Example:
preset:
topK: 40max_tokens
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
For Google/Anthropic, usemaxOutputTokensormaxTokens(depending on the endpoint).
| Key | Type | Description | Example |
|---|---|---|---|
| max_tokens | Number | The maximum number of tokens in the model response. |
Example:
preset:
max_tokens: 4096maxOutputTokens
Supported by:
anthropic
Equivalent tomax_tokensfor these providers.
| Key | Type | Description | Example |
|---|---|---|---|
| maxOutputTokens | Number | The maximum number of tokens in the response (Google/Anthropic). |
Example:
preset:
maxOutputTokens: 2048promptCache
Supported by:
anthropic, OpenRouter custom endpoints,bedrock(Anthropic and Nova models) (Toggle provider prompt caching)
| Key | Type | Description | Example |
|---|---|---|---|
| promptCache | Boolean | Enables or disables provider prompt caching. |
Default: true
Example:
preset:
promptCache: trueNote: For Bedrock endpoints, prompt caching is automatically enabled for Claude and Nova models. Set promptCache: false to explicitly disable it.
promptCacheTtl
Supported by:
anthropic, OpenRouter custom endpoints,bedrock(Anthropic and Nova models) (Sets the prompt-cache lifetime when prompt caching is enabled)
| Key | Type | Description | Example |
|---|---|---|---|
| promptCacheTtl | Enum | Sets the prompt-cache lifetime. Supported values are `5m` and `1h`. | Provider or SDK default |
Accepted Values:
5m1h
Example:
preset:
promptCache: true
promptCacheTtl: '1h'Note: promptCacheTtl is ignored when prompt caching is disabled. When omitted, the provider integration uses its default prompt-cache lifetime.
reasoning_effort
Accepted Values:
""(empty string — unset, uses API default)"none""minimal""low""medium""high""xhigh"(extra high)
Supported by:
openAI,azureOpenAI, custom (OpenAI-like),bedrock(ZAI, MoonshotAI models)
| Key | Type | Description | Example |
|---|---|---|---|
| reasoning_effort | String | Controls the reasoning effort level for the model. Reducing reasoning effort can result in faster responses and fewer tokens used on reasoning. The `xhigh` option provides maximum reasoning capability for complex problems. For Bedrock, accepted values are `low`, `medium`, `high`. |
Default: "" (unset)
Example:
preset:
reasoning_effort: 'low'reasoning_summary
Accepted Values:
""(empty string — disables reasoning summaries)"auto""concise""detailed"
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
| Key | Type | Description | Example |
|---|---|---|---|
| reasoning_summary | String | Sets reasoning summary preferences for the model. |
Default: "" (disabled)
Example:
preset:
reasoning_summary: 'detailed'useResponsesApi
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
| Key | Type | Description | Example |
|---|---|---|---|
| useResponsesApi | Boolean | Enables or disables the responses API for the model. |
Default: false
Example:
preset:
useResponsesApi: trueverbosity
Accepted Values:
""(empty string — unset, uses API default)"low""medium""high"
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
| Key | Type | Description | Example |
|---|---|---|---|
| verbosity | String | Controls the verbosity level of model responses. |
Default: "" (unset)
Example:
preset:
verbosity: 'low'web_search
Supported by:
openAI,azureOpenAI, custom (OpenAI-like),anthropic
| Key | Type | Description | Example |
|---|---|---|---|
| web_search | Boolean | Enables or disables web search functionality for the model. |
Default: false
Note: For Google endpoints, this parameter appears as Grounding with Google Search in the actual panel but controls web_search in the implementation.
Example:
preset:
web_search: trueurl_context
Supported by:
| Key | Type | Description | Example |
|---|---|---|---|
| url_context | Boolean | Enables Google URL Context so the model can read URLs included in the user message. YouTube links are converted to native video-understanding inputs when possible. |
Default: false
Example:
preset:
url_context: truedisableStreaming
Supported by:
openAI,azureOpenAI, custom (OpenAI-like)
| Key | Type | Description | Example |
|---|---|---|---|
| disableStreaming | Boolean | Disables streaming responses from the model. |
Default: false
Example:
preset:
disableStreaming: truethinkingBudget
Supported by:
anthropic,bedrock(Anthropic models)
| Key | Type | Description | Example |
|---|---|---|---|
| thinkingBudget | Number or String | Controls the number of thinking tokens the model can use for internal reasoning. Larger budgets can improve response quality for complex problems. |
Default: "Auto (-1)" (Google), 2000 (Anthropic, Bedrock (Anthropic models))
Example:
preset:
thinkingBudget: '2000'thinkingLevel
Supported by:
| Key | Type | Description | Example |
|---|---|---|---|
| thinkingLevel | String | Controls the thinking effort level for Gemini 3+ models. Gemini 2.5 models use `thinkingBudget` instead. |
Accepted Values:
""(unset/auto)"minimal""low""medium""high"
Default: "" (unset — model decides)
Example:
preset:
thinkingLevel: 'medium'effort
Supported by:
anthropic,bedrock(Anthropic models)
| Key | Type | Description | Example |
|---|---|---|---|
| effort | String | Controls the Adaptive Thinking effort level for supported Anthropic models (e.g., Claude Opus 4.6+ and Claude Fable/Mythos-class models). Higher effort levels allocate more thinking tokens for complex problems. |
Options: "" (unset/auto), "low", "medium", "high", "xhigh", "max"
Default: "" (unset — model decides)
Example:
preset:
effort: 'high'thinkingDisplay
Supported by:
anthropic,bedrock(Anthropic models)
| Key | Type | Description | Example |
|---|---|---|---|
| thinkingDisplay | String | Controls whether reasoning content is returned in model responses. Claude Opus 4.7+ and Claude Fable/Mythos-class models omit thinking content by default; this setting lets you opt in to reasoning summaries or explicitly suppress them. |
Options: "auto" (default), "summarized", "omitted"
"auto"— LibreChat decides: opts in to"summarized"for models that omit thinking by default (Opus 4.7+ and Fable/Mythos-class), leaves the field off for older models"summarized"— always request a post-hoc summary of the reasoning"omitted"— always suppress reasoning content (slightly lower latency)
Default: "auto"
Example:
preset:
thinkingDisplay: 'summarized'thinking
Supported by:
anthropic,bedrock(Anthropic models)
| Key | Type | Description | Example |
|---|---|---|---|
| thinking | Boolean | Indicates whether the model should spend time thinking before generating a response. |
Default: true
Example:
preset:
thinking: trueregion
Supported by:
bedrock
(Used to specify an AWS region for Amazon Bedrock)
| Key | Type | Description | Example |
|---|---|---|---|
| region | String | AWS region for Amazon Bedrock endpoints. |
Example:
preset:
region: 'us-east-1'maxTokens
Supported by:
bedrock
(Used in place ofmax_tokens)
| Key | Type | Description | Example |
|---|---|---|---|
| maxTokens | Number | Maximum output tokens for Amazon Bedrock endpoints. |
Example:
preset:
maxTokens: 1024How is this guide?