Skip to main content

Overview

You can use Instructor with local Ollama instance. Please note that, at least currently, OS models do not perform on par with OpenAI (GPT-3.5 or GPT-4) model for complex data schemas. Supported modes:
  • OutputMode::MdJson - fallback mode, works with any capable model
  • OutputMode::Json - recommended
  • OutputMode::Tools - supported (for selected models - check Ollama docs)

Example