Cerebras - Continue

Cerebras Inference uses specialized silicon to provides fast inference.

Create an account in the portal here.
Create and copy the API key for use in Continue.
Update your Continue config file:

YAML
JSON

config.yaml

name: My Config
version: 0.0.1
schema: v1

models:
  - name: Cerebras Llama 3.1 70B
    provider: cerebras
    model: llama3.1-70b
    apiKey:  <YOUR_CEREBRAS_API_KEY>

config.json

{
  "models": [
    {
      "title": "Cerebras Llama 3.1 70B",
      "provider": "cerebras",
      "model": "llama3.1-70b",
      "apiKey": "<YOUR_CEREBRAS_API_KEY>"
    }
  ]
}

⌘I

Customize