Novita

Configure Novita AI with Continue to access their affordable and reliable inference platform for language models like Llama 3.1, offering scalable LLM API services

Novita AI offers an affordable, reliable, and simple inference platform with scalable LLM API, empowering developers to build AI applications. Try the Novita AI Llama 3 API Demo today!. You can sign up here, copy your API key on the Key Management, and then hit the play button on any model from the Novita AI Models list. Change ~/.continue/config.json to look like this:

name: My Config
version: 0.0.1
schema: v1

models:
  - name: Llama 3.1 8B
    provider: novita
    model: meta-llama/llama-3.1-8b-instruct
    apiKey: <YOUR_NOVITA_API_KEY>

View the source