Skip to main content
Instructor is provider-agnostic. Provider selection is handled through LLMConfig and the Polyglot runtime that powers the underlying inference calls. Once the configuration is resolved, your application code stays the same regardless of which provider you use.

Selecting a Provider

The most common approaches:
Presets are YAML files stored in the config/llm/presets directory. Each file defines the API URL, driver, default model, and other provider-specific settings.

Supported Providers

The following providers have built-in presets:

Custom Providers

Any OpenAI-compatible API can be used by building an LLMConfig manually: