Llamafile

A llamafile is a self-contained binary that can run an open-source LLM. You can configure this provider in your config.json as follows:

config.yaml
models:
  - name: Llamafile
    provider: llamafile
    model: mistral-7b

config.json
{
  "models": [
    {
      "title": "Llamafile",
      "provider": "llamafile",
      "model": "mistral-7b"
    }
  ]
}