You need to enable the Vertex AI API and set up the Google Application Default Credentials.

​
How to Set Up Vertex AI Chat Models

We recommend configuring Claude 3.5 Sonnet as your chat model.
config.yaml
models:
  - name: Claude 3.5 Sonnet
    provider: vertexai
    model: claude-3-5-sonnet-20240620
    env:
      projectId: <PROJECT_ID>
      region: us-east5

​
How to Set Up Vertex AI Autocomplete Models

We recommend configuring Codestral or code-gecko as your autocomplete model.
config.yaml
models:
  - name: Codestral (Vertex AI)
    provider: vertexai
    model: codestral
    roles:
      - autocomplete
    env:
      projectId: <PROJECT_ID>
      region: us-central1

​
How to Configure Vertex AI Embeddings Models

We recommend configuring text-embedding-004 as your embeddings model.
config.yaml
models:
  - name: Text Embedding-004
    provider: vertexai
    model: text-embedding-004
    env:
      projectId: <PROJECT_ID>
      region: us-central1
    roles:
      - embed

​
How to Configure Vertex AI Reranking Models

Vertex AI currently does not offer any reranking models. Click here to see a list of reranking model providers.

​
How to Enable Vertex AI Express Mode

You can use VertexAI in express mode by only providing an API Key. Only some Gemini models are supported in express mode for now.