Skip to main content

Cloudflare Workers AI

Cloudflare Workers AI can be used for both chat and tab autocompletion in Continue. To setup Cloudflare Workers AI, add the following to your config.json file:

config.json
{
"models": [
{
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"contextLength": 2400,
"completionOptions": {
"maxTokens": 500
},
"model": "@cf/meta/llama-3-8b-instruct", // This can be the name of any model supported by Workers AI
"provider": "cloudflare",
"title": "Llama 3 8B"
},
{
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"contextLength": 2400,
"completionOptions": {
"maxTokens": 500
},
"model": "@hf/thebloke/deepseek-coder-6.7b-instruct-awq",
"provider": "cloudflare",
"title": "DeepSeek Coder 6.7b Instruct"
}
...
"tabAutocompleteModel": {
"accountId": "YOUR CLOUDFLARE ACCOUNT ID",
"apiKey": "YOUR CLOUDFLARE API KEY",
"model": "@hf/thebloke/deepseek-coder-6.7b-base-awq",
"provider": "cloudflare",
"title": "DeepSeek 7b"
},
]
}

Visit the Cloudflare dashboard to create an API key.

Review available models on Workers AI

View the source