Skip to main content

Anthropic

info

You can get an API key from the Anthropic console.

Chat model​

We recommend configuring Claude 3.5 Sonnet as your chat model.

config.json
{
  "models": [
    {
      "title": "Claude 3.5 Sonnet",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "[API_KEY]"
    }
  ]
}

Autocomplete model​

Anthropic currently does not offer any autocomplete models.

Click here to see a list of autocomplete model providers.

Embeddings model​

Anthropic currently does not offer any embeddings models.

Click here to see a list of embeddings model providers.

Reranking model​

Anthropic currently does not offer any reranking models.

Click here to see a list of reranking model providers.

Prompt caching​

Anthropic supports prompt caching with Claude.

Currently, we only allow caching of the system message. To enable this feature, update your your model configuration with "cacheSystemMessage": true:

{
  "models": [
    {
      // Enable prompt caching
      "cacheSystemMessage": true,
      "title": "Anthropic",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "[API_KEY]"
    }
  ]
}