Get started with Llama.cpp
Configuration
- YAML
- JSON (Deprecated)
config.yaml
Check out our new look in Mission Control. It's now easier than ever to create Workflows, Integrate with the tools you use, and to create a one-off Task.
name: My Config
version: 0.0.1
schema: v1
models:
- name: <MODEL_NAME>
provider: llama.cpp
model: <MODEL_ID>
apiBase: http://localhost:8080
{
"models": [
{
"title": "<MODEL_NAME>",
"provider": "llama.cpp",
"model": "<MODEL_ID>"
"apiBase": "http://localhost:8080"
}
]
}
Was this page helpful?