Skip to main content

Ollama

Chat model​

We recommend configuring Llama3.1 8B as your chat model.

config.json
{
  "models": [
    {
      "title": "Llama3.1 8B",
      "provider": "ollama",
      "model": "llama3.1:8b"
    }
  ]
}

Autocomplete model​

We recommend configuring StarCoder2 3B as your autocomplete model.

config.json
{
  "tabAutocompleteModel": {
    "title": "StarCoder2 3B",
    "provider": "ollama",
    "model": "starcoder2:3b"
  }
}

Embeddings model​

We recommend configuring Nomic Embed Text as your embeddings model.

config.json
{
  "embeddingsProvider": {
    "provider": "ollama",
    "model": "nomic-embed-text"
  }
}

Reranking model​

Ollama currently does not offer any reranking models.

Click here to see a list of reranking model providers.