Skip to main content
Understanding Polyglot’s architecture makes it easier to extend the library to support new providers or add new functionality.

​
Adding a New LLM Provider

To add support for a new LLM provider, you need to implement several components:
  1. Message Format Adapter: Implements CanMapMessages to convert Polyglot’s message format to the provider’s format
  2. Body Format Adapter: Implements CanMapRequestBody to structure the request body according to the provider’s API
  3. Request Adapter: Implements ProviderRequestAdapter to build HTTP requests for the provider
  4. Response Adapter: Implements ProviderResponseAdapter to parse responses from the provider
  5. Usage Format Adapter: Implements CanMapUsage to extract token usage information
Then, you need to modify the InferenceDriverFactory to create the appropriate driver for your provider: 
// In InferenceDriverFactory
public function newProvider(LLMConfig $config, CanHandleHttpRequest $httpClient, EventDispatcher $events): CanHandleInference {
    return new ModularLLMDriver(
        $config,
        new NewProviderRequestAdapter(
            $config,
            new NewProviderBodyFormat($config, new NewProviderMessageFormat())
        ),
        new NewProviderResponseAdapter(new NewProviderUsageFormat()),
        $httpClient,
        $events
    );
}
// @doctest id="116e"
Finally, add your provider to the make method’s match statement.

​
Adding a New Embeddings Provider

Similarly, to add a new embeddings provider, implement the CanVectorize interface: 
namespace Cognesy\Polyglot\Embeddings\Drivers;

class NewEmbeddingsDriver implements CanVectorize {
    public function __construct(
        protected EmbeddingsConfig $config,
        protected ?CanHandleHttpRequest $httpClient = null,
        protected ?EventDispatcher $events = null
    ) { ... }

    public function vectorize(array $input, array $options = []): EmbeddingsResponse { ... }

    protected function getEndpointUrl(): string { ... }
    protected function getRequestHeaders(): array { ... }
    protected function getRequestBody(array $input, array $options): array { ... }
    protected function toResponse(array $response): EmbeddingsResponse { ... }
    protected function makeUsage(array $response): Usage { ... }
}
// @doctest id="fba5"
Then, modify the Embeddings class to create your driver: 
// In Embeddings::getDriver
protected function getDriver(EmbeddingsConfig $config, CanHandleHttpRequest $httpClient): CanVectorize {
    return match ($config->providerType) {
        // Existing providers...
        'new-provider' => new NewEmbeddingsDriver($config, $httpClient, $this->events),
        default => throw new InvalidArgumentException("Unknown client: {$config->providerType}"),
    };
}
// @doctest id="fefa"

​
Adding Custom Middleware

You can extend Polyglot’s HTTP layer by creating custom middleware: 
namespace YourNamespace\Http\Middleware;

use Cognesy\Http\Contracts\HttpResponse;use Cognesy\Http\Data\HttpRequest;use Cognesy\Http\Middleware\Base\BaseMiddleware;

class YourCustomMiddleware extends BaseMiddleware {
    protected function beforeRequest(HttpRequest $request): void {
        // Modify the request before it's sent
    }

    protected function afterRequest(
        HttpRequest $request,
        HttpResponse $response
    ): HttpResponse {
        // Modify the response after it's received
        return $response;
    }
}
// @doctest id="4d80"
Then, add your middleware to the HTTP client: 
$httpClient = new HttpClient();
$httpClient->withMiddleware(new YourCustomMiddleware());

$inference = new Inference();
$inference->withHttpClient($httpClient);
// @doctest id="782c"
⌘I