Supported Providers

LLM Drivers provide a standardized interface for interacting with different language model providers. Switch between providers without changing your application code.

Available Drivers

OpenAI

Default driver for OpenAI API. Works with GPT-4, GPT-4o, and other OpenAI models.

Anthropic (Claude)

Native support for Claude models via the Anthropic API.

Google Gemini

Native Gemini driver for Google’s AI models.

Groq

Ultra-fast inference with Groq’s LPU platform.

Ollama

Run local LLMs with Ollama integration.

OpenRouter

Access multiple providers through OpenRouter’s unified API.

All drivers are pre-configured in config/laragent.php. Add your API key and you’re ready to go.

Quick Setup

OpenAI (Default)

.env

OPENAI_API_KEY=your-api-key

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'default'; // Uses OpenAI
    protected $model = 'gpt-4o-mini';
}

Anthropic (Claude)

.env

ANTHROPIC_API_KEY=your-api-key

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'claude';
    protected $model = 'claude-sonnet-4-20250514';
}

Claude supports structured output (response schemas) for type-safe JSON responses from v1.1.0

Google Gemini

.env

GEMINI_API_KEY=your-api-key

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'gemini';
    protected $model = 'gemini-2.5-pro-preview-03-25';
}

Groq

.env

GROQ_API_KEY=your-api-key

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'groq';
    protected $model = 'llama-3.3-70b-versatile';
}

Ollama (Local)

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'ollama';
    protected $model = 'llama2'; // Any model installed in Ollama
}

OpenRouter

.env

OPENROUTER_API_KEY=your-api-key

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = 'openrouter';
    protected $model = 'anthropic/claude-3-opus';
}

Configuration

Global Configuration

Configure providers in config/laragent.php:

config/laragent.php

'providers' => [
    'default' => [
        'label' => 'openai',
        'api_key' => env('OPENAI_API_KEY'),
        'driver' => \LarAgent\Drivers\OpenAi\OpenAiDriver::class,
        'default_temperature' => 1,
        'default_max_completion_tokens' => 2048,
    ],
    
    'claude' => [
        'label' => 'anthropic',
        'api_key' => env('ANTHROPIC_API_KEY'),
        'driver' => \LarAgent\Drivers\Anthropic\ClaudeDriver::class,
    ],
],

Per-Agent Configuration

Override the driver directly in your agent:

use LarAgent\Drivers\OpenAi\OpenAiCompatible;

class MyAgent extends Agent
{
    protected $driver = OpenAiCompatible::class;
    protected $provider = 'custom-provider';
}

Agent-level driver configuration overrides the global provider settings.

Multi-Provider Fallback

Automatically switch between AI providers when one fails, ensuring your agents stay operational even when a provider is down or rate-limited.

Per-Agent Configuration

Set multiple providers directly in your agent using an array:

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    // First is primary, others are fallbacks in order
    protected $provider = ['openai', 'gemini', 'claude'];
    
    public function instructions()
    {
        return 'You are a helpful assistant.';
    }
}

With Per-Provider Overrides

Override specific settings for each provider in the fallback chain:

App/AiAgents/MyAgent.php

class MyAgent extends Agent
{
    protected $provider = [
        'openai',
        'gemini' => ['model' => 'gemini-2.0-flash'],
        'claude',
    ];
    
    public function instructions()
    {
        return 'You are a helpful assistant.';
    }
}

Global Configuration

Set default fallback providers for all agents in config/laragent.php:

config/laragent.php

return [
    'providers' => [
        'default' => [
            'label' => 'openai',
            'model' => 'gpt-4o-mini',
            'api_key' => env('OPENAI_API_KEY'),
            'driver' => \LarAgent\Drivers\OpenAi\OpenAiDriver::class,
        ],
        
        'gemini' => [
            'label' => 'gemini',
            'model' => 'gemini-2.0-flash',
            'api_key' => env('GEMINI_API_KEY'),
            'driver' => \LarAgent\Drivers\Gemini\GeminiDriver::class,
        ],
        
        'claude' => [
            'label' => 'anthropic',
            'api_key' => env('ANTHROPIC_API_KEY'),
            'driver' => \LarAgent\Drivers\Anthropic\ClaudeDriver::class,
        ],
    ],
    
    // Global fallback chain for all agents
    'default_providers' => [
        'openai',
        'gemini' => ['model' => 'gemini-2.0-flash'],
        'claude',
    ],
];

Agent-level $provider array takes precedence over default_providers config.

Debugging Fallback

Use these methods to inspect the provider sequence and active provider:

$agent = MyAgent::make();

// Get the configured provider sequence
$sequence = $agent->getProviderSequence();
// ['openai', 'gemini', 'claude']

// After a response, check which provider was used
$response = $agent->respond('Hello!');
$activeProvider = $agent->getActiveProviderName();
// 'openai' (or 'gemini' if openai failed)

The fallback_provider config option is deprecated. Use default_providers or array-based $provider instead.

Driver Reference

Driver	Class	Provider Key
OpenAI	`LarAgent\Drivers\OpenAi\OpenAiDriver`	`default`
OpenAI Compatible	`LarAgent\Drivers\OpenAi\OpenAiCompatible`	—
Anthropic	`LarAgent\Drivers\Anthropic\ClaudeDriver`	`claude`
Gemini	`LarAgent\Drivers\Gemini\GeminiDriver`	`gemini`
Groq	`LarAgent\Drivers\Groq\GroqDriver`	`groq`
Ollama	`LarAgent\Drivers\OpenAi\OllamaDriver`	`ollama`
OpenRouter	`LarAgent\Drivers\OpenAi\OpenAiCompatible`	`openrouter`

The OpenAiCompatible driver works with any API that follows the OpenAI format, making it easy to integrate with custom or self-hosted solutions.

Best Practices

Store API keys in environment variables — never hardcode them.

Configure multi-provider fallback for production reliability.

Not all providers support the same features. Check provider documentation for streaming, tool calling, and structured output support.

Next Steps

Create & Configure

Configure agents with different providers.

Streaming

Enable real-time streaming responses.

Structured Output

Get typed, validated responses from your agents.

Context Overview

Manage conversation history and agent state.

Get Started

Agents

Context (Storage)

Available Drivers

OpenAI

Anthropic (Claude)

Google Gemini

Groq

Ollama

OpenRouter

Quick Setup

OpenAI (Default)

Anthropic (Claude)

Google Gemini

Groq

Ollama (Local)

OpenRouter

Configuration

Global Configuration

Per-Agent Configuration

Multi-Provider Fallback

Per-Agent Configuration

With Per-Provider Overrides

Global Configuration

Debugging Fallback

Driver Reference

Best Practices

Next Steps

Create & Configure

Streaming

Structured Output

Context Overview

​Available Drivers

OpenAI

Anthropic (Claude)

Google Gemini

Groq

Ollama

OpenRouter

​Quick Setup

​OpenAI (Default)

​Anthropic (Claude)

​Google Gemini

​Groq

​Ollama (Local)

​OpenRouter

​Configuration

​Global Configuration

​Per-Agent Configuration

​Multi-Provider Fallback

​Per-Agent Configuration

​With Per-Provider Overrides

​Global Configuration

​Debugging Fallback

​Driver Reference

​Best Practices

​Next Steps

Create & Configure

Streaming

Structured Output

Context Overview

Available Drivers

Quick Setup

OpenAI (Default)

Anthropic (Claude)

Google Gemini

Groq

Ollama (Local)

OpenRouter

Configuration

Global Configuration

Per-Agent Configuration

Multi-Provider Fallback

Per-Agent Configuration

With Per-Provider Overrides

Global Configuration

Debugging Fallback

Driver Reference

Best Practices

Next Steps