Anthropic

To setup Anthropic, obtain an API key from here and add the following to your config.json file:

~/.continue/config.json

{
  "models": [
    {
      "title": "Anthropic",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "YOUR_API_KEY"
    }
  ]
}

View the source

Prompt caching

Anthropic supports prompt caching with Claude.

Currently, we only allow caching of the system message. To enable this feature, update your your model configuration with "cacheSystemMessage": true:

{
  "models": [
    {
      // Enable prompt caching
      "cacheSystemMessage": true,
      "title": "Anthropic",
      "provider": "anthropic",
      "model": "claude-3-5-sonnet-20240620",
      "apiKey": "YOUR_API_KEY"
    }
  ]
}