Custom Parameters
Picking A Default Parameters Set
By default, when you specify a custom endpoint in librechat.yaml
config file, it will use the default parameters of the OpenAI API. However, you can override these defaults by specifying the customParams.defaultParamsEndpoint
field within the definition of your custom endpoint. For example, to use Google parameters for your custom endpoint:
endpoints:
custom:
- name: 'Google Gemini'
apiKey: ...
baseURL: ...
customParams:
defaultParamsEndpoint: 'google'
Your “Google Gemini” endpoint will now display parameters for Google API when you create a new agent or preset.
Overriding Parameter Definitions
On top of that, you can also fine tune the parameters provided for your custom endpoint. For example, the temperature
parameter for google endpoint is a slide with range from 0.0 to 1.0, and default of 1.0, you can update the librechat.yaml
file to override these values:
endpoints:
custom:
- name: 'Google Gemini'
apiKey: ...
baseURL: ...
customParams:
defaultParamsEndpoint: 'google'
paramDefinitions:
- key: temperature
range:
min: 0
max: 0.7
step: 0.1
default: 0.5
As a result, the Temperature
slider will be limited to the range of 0.0
and 0.7
with step of 0.1
, and a default of 0.5
. The rest of the parameters will be set to their default values.