The nCompass Technologies API exposes an extremely fast inference engine for open-source language models. You can sign up here, copy your API key on the initial welcome screen, and then hit the play button on any model from the nCompass Models list. Change ~/.continue/config.json to look like this:
Package or config.yaml
models:
  - name: Ncompass Gemma 3 Coder
    provider: ncompass
    model: google/gemma-3-27b-it
    apiKey: <YOUR_NCOMPASS_API_KEY>
View the source