Novita AI offers an affordable, reliable, and simple inference platform with scalable LLM API, empowering developers to build AI applications. Try the Novita AI Llama 3 API Demo today!. You can sign up here, copy your API key on the Key Management, and then hit the play button on any model from the Novita AI Models list. Change ~/.continue/config.json to look like this:
config.yaml
models:
  - name: Llama 3.1 8B
    provider: novita
    model: meta-llama/llama-3.1-8b-instruct
    apiKey: <YOUR_NOVITA_API_KEY>
View the source