nCompass

The nCompass Technologies API exposes an extremely fast inference engine for open-source language models. You can sign up here, copy your API key on the initial welcome screen, and then hit the play button on any model from the nCompass Models list. Change ~/.continue/config.json to look like this:

YAML

Package or config.yaml

models:
  - name: Ncompass Qwen2.5 Coder
    provider: ncompass
    model: Qwen/Qwen2.5-Coder-32B-Instruct
    apiKey: <YOUR_NCOMPASS_API_KEY>

JSON

config.json

{
  "models": [
    {
      "title": "Ncompass Qwen2.5 Coder",
      "provider": "ncompass",
      "model": "Qwen/Qwen2.5-Coder-32B-Instruct",
      "apiKey": "<YOUR_NCOMPASS_API_KEY>"
    }
  ]
}

View the source