Skip to main content

Overview

Support for Cerebras API which uses custom hardware for super fast inference. Cerebras provides Llama models. Mode compatibility:
  • OutputMode::Tools (supported)
  • OutputMode::Json (supported)
  • OutputMode::JsonSchema (supported)
  • OutputMode::MdJson (fallback)

Example