Skip to main content

Overview

Support for SambaNova’s API, which provide fast inference endpoints for Llama and Qwen LLMs. Mode compatibility:
  • OutputMode::MdJson (supported)
  • OutputMode::Tools (not supported)
  • OutputMode::Json (not supported)
  • OutputMode::JsonSchema (not supported)

Example