Tetrate Agent Router Service

The Tetrate Agent Router Service provides a unified Gateway for accessing various AI models with fast inference capabilities.
This gateway acts as an intelligent router that can distribute requests across multiple model providers, offering enterprise-grade reliability and performance optimization.
Want to get started quickly? Sign up for the Tetrate Agent Router Service to get an API key, then follow the configuration examples below.

Setup

1

Sign in or sign up

Visit the Agent Router Service portal and create an account to get your API key
Tetrate sign in page
2

Get your API key

Go to the API keys page to get your key
Tetrate get API key
3

Configure Continue

  • Choose a configuration method below.
  • If you use the Continue VS Code extension, install version >=1.2.3.

Configuration Methods

In Local Agent Configuration

Define models directly in your local agent configuration.

Using Local Model Blocks

Create a local model block for reuse across agents.

Configuration Examples

Click a tab to see an example.
When to use: Simple local setups (like using the VS Code extension) when you don't need shared or published blocks.
Use a Tetrate model block in your local agent configuration:
name: Local Agent
version: 1.0.0
schema: v1
models:
  - uses: tetrate/claude-sonnet-4
    with:
      TETRATE_API_KEY: ${{ secrets.TETRATE_API_KEY }}
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase
Or define the model directly:
name: Local Agent
version: 1.0.0
schema: v1
models:
  - name: Claude Sonnet 4
    provider: tars
    model: claude-4-sonnet-20250514
    apiKey: ${{ secrets.TETRATE_API_KEY }}
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

Troubleshooting Common Issues

Invalid API key

Verify your API key is active and has no extra spaces.

Model not found

Confirm the model ID matches the Tetrate catalog.

Slow responses

Check your network or try a less-loaded model. Contact Tetrate support if issues persist.

Configuration not loading

Validate YAML syntax and review error messages in Continue.

Join the Community

Connect with Tetrate and other builders for help and discussion.

Join the Tetrate Community

Get answers, insights, and best practices for secure, scalable infrastructure
OpenAIVertex AI