Before using Cohere, visit the Cohere dashboard to create an API key.

Chat model

We recommend configuring Command A as your chat model.

config.yaml
models:
  - name: Command A 03-2025
    provider: cohere
    model: command-a-03-2025
    apiKey: <YOUR_COHERE_API_KEY>

Autocomplete model

Cohere currently does not offer any autocomplete models.

Click here to see a list of autocomplete model providers.

Embeddings model

We recommend configuring embed-v4.0 as your embeddings model.

config.yaml
models:
  - name: Cohere Embed v4.0
    provider: cohere
    model: embed-v4.0
    apiKey: <YOUR_COHERE_API_KEY>
    roles:
      - embed

Reranking model

We recommend configuring rerank-v3.5 as your reranking model.

config.yaml
models:
  - name: Cohere Rerank v3.5
    provider: cohere
    model: rerank-v3.5
    apiKey: <YOUR_COHERE_API_KEY>
    roles:
      - rerank