Cohere

Before using Cohere, visit the Cohere dashboard to create an API key.

Chat model

We recommend configuring Command A as your chat model.

YAML

config.yaml

models:
  - name: Command A 03-2025
    provider: cohere
    model: command-a-03-2025
    apiKey: <YOUR_COHERE_API_KEY>

JSON

config.json

{
  "models": [
    {
      "title": "Command A 03-2025",
      "provider": "cohere",
      "model": "command-a-03-2025",
      "apiKey": "<YOUR_COHERE_API_KEY>"
    }
  ]
}

Autocomplete model

Cohere currently does not offer any autocomplete models.

Click here to see a list of autocomplete model providers.

Embeddings model

We recommend configuring embed-v4.0 as your embeddings model.

YAML

config.yaml

models:
  - name: Cohere Embed v4.0
    provider: cohere
    model: embed-v4.0
    apiKey: <YOUR_COHERE_API_KEY>
    roles:
      - embed

JSON

config.json

{
  "embeddingsProvider": {
    "provider": "cohere",
    "model": "embed-v4.0",
    "apiKey": "<YOUR_COHERE_API_KEY>"
  }
}

Reranking model

We recommend configuring rerank-v3.5 as your reranking model.

YAML

config.yaml

models:
  - name: Cohere Rerank v3.5
    provider: cohere
    model: rerank-v3.5
    apiKey: <YOUR_COHERE_API_KEY>
    roles:
      - rerank

JSON

config.json

{
  "reranker": {
    "name": "cohere",
    "params": {
      "model": "rerank-v3.5",
      "apiKey": "<YOUR_COHERE_API_KEY>"
    }
  }
}