DeepInfra provides inference for open-source models at very low cost. To get started with DeepInfra, obtain your API key here. Then, find the model you want to use here and copy the name of the model. Continue can then be configured to use the DeepInfra LLM class, like the example here:
config.yaml
models:
  - name: DeepInfra
    provider: deepinfra
    model: mistralai/Mixtral-8x7B-Instruct-v0.1
    apiKey: <YOUR_DEEP_INFRA_API_KEY>
View the source