LLM API Support
Together.ai
Overview
Together.ai hosts a number of language models and offers inference API with support for chat completion, JSON completion, and tools call. You can use Instructor with Together.ai as demonstrated below.
Please note that some Together.ai models support Mode::Tools or Mode::Json, which are much more reliable than Mode::MdJson.
Mode compatibility:
- Mode::Tools - supported for selected models
- Mode::Json - supported for selected models
- Mode::MdJson - fallback mode