Creating requests

Polyglot provides a clean, fluent API for building inference requests. You can configure messages, models, tools, response formats, and provider-specific options — all through a consistent interface that works across every supported LLM provider.

Basic Request

The simplest way to get a response is to pass a string message directly:

<?php
use Cognesy\Polyglot\Inference\Inference;
use Cognesy\Messages\Messages;

$response = Inference::using('openai')
    ->withMessages(Messages::fromString('What is the capital of France?'))
    ->get();

echo $response; // "Paris."
// @doctest id="9fab"

Messages::fromString() wraps a plain string as a user message. You can also use Messages::fromArray() to pass an array of role/content pairs.

The `with()` Method

When you need to configure multiple request fields at once, use the combined with() method. It accepts all core request parameters in a single call:

<?php
use Cognesy\Polyglot\Inference\Inference;
use Cognesy\Messages\Messages;

$text = Inference::using('openai')
    ->with(
        messages: Messages::fromArray([
            ['role' => 'system', 'content' => 'Answer briefly.'],
            ['role' => 'user', 'content' => 'What is CQRS?'],
        ]),
        model: 'gpt-4.1-nano',
        options: ['temperature' => 0.2],
    )
    ->get();
// @doctest id="204b"

All parameters on with() are optional — pass only what you need:

Parameter	Type	Description
`messages`	`?Messages`	The messages to send to the LLM
`model`	`?string`	Model identifier (overrides preset default)
`tools`	`?ToolDefinitions`	Tool/function definitions for the model
`toolChoice`	`?ToolChoice`	Tool selection preference
`responseFormat`	`?ResponseFormat`	Response format specification
`options`	`?array`	Provider-specific request options

Focused Helper Methods

For better readability, use the dedicated fluent helpers instead of packing everything into a single with() call:

<?php
use Cognesy\Polyglot\Inference\Inference;
use Cognesy\Messages\Messages;

$response = Inference::using('anthropic')
    ->withModel('claude-sonnet-4-20250514')
    ->withMessages(Messages::fromArray([
        ['role' => 'system', 'content' => 'You are a helpful assistant who provides concise answers.'],
        ['role' => 'user', 'content' => 'What is the capital of France?'],
        ['role' => 'assistant', 'content' => 'Paris.'],
        ['role' => 'user', 'content' => 'And what about Germany?'],
    ]))
    ->withOptions(['temperature' => 0.5])
    ->get();
// @doctest id="757f"

Each helper returns a new immutable instance, so you can safely branch from a shared base:

$base = Inference::using('openai')->withModel('gpt-4.1-nano');

$creative = $base->withOptions(['temperature' => 0.9]);
$precise  = $base->withOptions(['temperature' => 0.0]);
// @doctest id="a81a"

The full list of fluent helpers:

withMessages(...) — set the conversation messages
withModel(...) — override the model
withTools(...) — attach tool/function definitions
withToolChoice(...) — control tool selection
withResponseFormat(...) — specify the response format
withOptions(...) — set provider-specific options
withStreaming(...) — enable or disable streaming
withMaxTokens(...) — set the maximum token count
withCachedContext(...) — attach reusable cached context
withRetryPolicy(...) — configure retry behavior
withResponseCachePolicy(...) — configure response caching

Using the `Messages` Class

For complex conversations, use the Messages class to build message sequences with a more expressive API:

<?php
use Cognesy\Messages\Messages;
use Cognesy\Polyglot\Inference\Inference;

$messages = (new Messages)
    ->asSystem('You are a senior PHP8 backend developer.')
    ->asDeveloper('Be concise and use modern PHP8.2+ features.')
    ->asUser([
        'What is the best way to handle errors in PHP8?',
        'Provide a code example.',
    ]);

$response = Inference::using('openai')
    ->withModel('gpt-4.1-nano')
    ->withMessages($messages)
    ->get();
// @doctest id="513b"

The asDeveloper() method maps to OpenAI’s developer role and is automatically normalized for providers that do not support it.

Message Formats

The withMessages() method requires a Messages object. You can create one from different input formats using the factory methods on Messages:

Messages::fromString($text) — wraps a plain string as a single user message
Messages::fromArray($array) — converts an array of role/content pairs
Messages fluent API — build messages with asSystem(), asUser(), asDeveloper(), asAssistant()

Multimodal Content

For providers that support vision, you can include images in your messages:

<?php
use Cognesy\Polyglot\Inference\Inference;
use Cognesy\Messages\Messages;

$imageData = base64_encode(file_get_contents('image.jpg'));
$messages = Messages::fromArray([
    [
        'role' => 'user',
        'content' => [
            [
                'type' => 'text',
                'text' => 'What\'s in this image?',
            ],
            [
                'type' => 'image_url',
                'image_url' => [
                    'url' => "data:image/jpeg;base64,$imageData",
                ],
            ],
        ],
    ],
]);

$response = Inference::using('openai')
    ->withModel('gpt-4o')
    ->withMessages($messages)
    ->get();
// @doctest id="f048"

Using `InferenceRequest` Directly

If your application already constructs request objects — for example, when deserializing stored requests or building them in a pipeline — you can pass them in directly:

<?php
use Cognesy\Messages\Messages;
use Cognesy\Polyglot\Inference\Data\InferenceRequest;
use Cognesy\Polyglot\Inference\Inference;

$request = new InferenceRequest(
    messages: Messages::fromString('Return one deployment tip.'),
    model: 'gpt-4.1-nano',
    options: ['temperature' => 0],
);

$text = Inference::using('openai')
    ->withRequest($request)
    ->get();
// @doctest id="eed4"

InferenceRequest objects are immutable value objects. Use with() or the dedicated mutators (withMessages(), withModel(), etc.) to derive modified copies. Note that InferenceRequest::with() accepts typed objects (Messages, ToolDefinitions, ToolChoice, ResponseFormat) rather than primitive arrays or strings:

$updated = $request->with(
    model: 'gpt-4.1',
    options: ['temperature' => 0.7],
);
// @doctest id="eb7b"

Packages

Instructor

Polyglot

Agents

Agent-ctrl

Telemetry

Sandbox

HTTP Client

Laravel

Symfony

Xprompt

Basic Request

The `with()` Method

Focused Helper Methods

Using the `Messages` Class

Message Formats

Multimodal Content

Using `InferenceRequest` Directly

​Basic Request

​The with() Method

​Focused Helper Methods

​Using the Messages Class

​Message Formats

​Multimodal Content

​Using InferenceRequest Directly

Basic Request

The `with()` Method

Focused Helper Methods

Using the `Messages` Class

Message Formats

Multimodal Content

Using `InferenceRequest` Directly