Nebius AI Studio

You can get an API key from the Nebius AI Studio API keys page

Availible models

Available models can be found on the Nebius AI Studio models page

Chat model

YAML

Package or config.yaml

models:
  - name: Llama 3.1 405b
    provider: nebius
    model: llama3.1-405b
    apiKey: <YOUR_NEBIUS_API_KEY>

JSON

config.json

{
  "models": [
    {
      "title": "Llama 3.1 405b",
      "provider": "nebius",
      "model": "llama3.1-405b",
      "apiKey": "<YOUR_NEBIUS_API_KEY>"
    }
  ]
}

Embeddings model

Available models can be found on the Nebius AI Studio embeddings page

YAML

config.yaml

models:
  - name: BAAI Embedder
    provider: nebius
    model: BAAI/bge-en-icl
    apiKey: <YOUR_NEBIUS_API_KEY>
    roles:
      - embed

JSON

config.json

{
  "embeddingsProvider": {
    "provider": "nebius",
    "model": "BAAI/bge-en-icl",
    "apiKey": "<YOUR_NEBIUS_API_KEY>"
  }
}