Chat model

A "chat model" is an LLM that is trained to respond in a conversational format. Because they should be able to answer general questions and generate complex code, the best chat models are typically large, often 405B+ parameters. In Continue, these models are used for Chat, Edit, and Actions.

Recommended Chat models

If you have the ability to use any model, we recommend Claude 3.5 Sonnet.

Otherwise, some of the next best options are:

• GPT-4o
• Gemini 1.5 Pro
• Llama3.1 405B