Chat model
We recommend configuring GPT-4o as your chat model.
models:
- name: GPT-4o
provider: openai
model: gpt-4o
apiKey: <YOUR_OPENAI_API_KEY>
models:
- name: GPT-4o
provider: openai
model: gpt-4o
apiKey: <YOUR_OPENAI_API_KEY>
{
"models": [
{
"title": "GPT-4o",
"provider": "openai",
"model": "gpt-4o",
"apiKey": "<YOUR_OPENAI_API_KEY>"
}
]
}
Autocomplete model
OpenAI currently does not offer any autocomplete models.
Click here to see a list of autocomplete model providers.
Embeddings model
We recommend configuring text-embedding-3-large as your embeddings model.
models:
- name: OpenAI Embeddings
provider: openai
model: text-embedding-3-large
apiKey: <YOUR_OPENAI_API_KEY>
roles:
- embed
models:
- name: OpenAI Embeddings
provider: openai
model: text-embedding-3-large
apiKey: <YOUR_OPENAI_API_KEY>
roles:
- embed
{
"embeddingsProvider": {
"provider": "openai",
"model": "text-embedding-3-large",
"apiKey": "<YOUR_OPENAI_API_KEY>"
}
}
Reranking model
OpenAI currently does not offer any reranking models.
Click here to see a list of reranking model providers.
OpenAI compatible servers / APIs
OpenAI compatible servers
OpenAI compatible APIs
If you are using an OpenAI compatible server / API, you can change the apiBase like this:
models:
- name: OpenAI-compatible server / API
provider: openai
model: MODEL_NAME
apiBase: http://localhost:8000/v1
apiKey: <YOUR_CUSTOM_API_KEY>
models:
- name: OpenAI-compatible server / API
provider: openai
model: MODEL_NAME
apiBase: http://localhost:8000/v1
apiKey: <YOUR_CUSTOM_API_KEY>
{
"models": [
{
"title": "OpenAI-compatible server / API",
"provider": "openai",
"model": "MODEL_NAME",
"apiKey": "<YOUR_CUSTOM_API_KEY>",
"apiBase": "http://localhost:8000/v1"
}
]
}
To force usage of chat/completions instead of completions endpoint you can set:
models:
- name: OpenAI-compatible server / API
provider: openai
model: MODEL_NAME
apiBase: http://localhost:8000/v1
useLegacyCompletionsEndpoint: true
models:
- name: OpenAI-compatible server / API
provider: openai
model: MODEL_NAME
apiBase: http://localhost:8000/v1
useLegacyCompletionsEndpoint: true
{
"models": [
{
"title": "OpenAI-compatible server / API",
"provider": "openai",
"model": "MODEL_NAME",
"apiBase": "http://localhost:8000/v1",
"useLegacyCompletionsEndpoint": true
}
]
}
