Skip to main content

Overview

Support for SambaNova’s API, which provide fast inference endpoints for Llama and Qwen LLMs. Inference feature compatibility:
  • Instructor markdown-JSON fallback (supported)
  • tool calling (not supported)
  • native JSON object response_format (not supported)
  • native JSON schema response_format (not supported)

Example