Supported Models

Overview

Aira supports four categories of models:

1. Built-in models — managed by Aira, ready to use immediately
2. BYOM (Bring Your Own Model) — any OpenAI-compatible endpoint with tool calling support
3. Cloud provider models — accessed through AWS Bedrock, Azure OpenAI, or Google Vertex AI
4. Self-hosted models — your own deployments via vLLM, Ollama, or TGI

All models get the same tool-calling experience in Ask Aira chat and return structured output (decision, confidence, key factors, reasoning) in consensus cases.

Built-in Models

These models are available out of the box. Use Provider Credentials to bring your own API keys, or let Aira manage keys for you.

Anthropic

OpenAI

Google

BYOM — Bring Your Own Model

Register any model accessible via an OpenAI-compatible /v1/chat/completions endpoint. This includes hosted API providers, self-hosted models via vLLM/Ollama/TGI, or any custom endpoint.

Aira uses the standard OpenAI function-calling format for tool use. Models that support it get the same full tool-calling experience as built-in models — including multi-step reasoning with all Ask Aira tools.

Verified Models

These open-weight models have been verified to work with Aira's tool calling and structured output:

Any OpenAI-compatible endpoint serving these models will work — whether self-hosted or via a hosted provider.

How to Register

curl -X POST https://api.airaproof.com/api/v1/models/custom \
  -H "Authorization: Bearer aira_live_xxxxx" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Llama 3.3 70B",
    "model_id": "llama-3.3-70b",
    "endpoint_url": "https://your-endpoint/v1/chat/completions",
    "auth_header": "Bearer your-api-key",
    "timeout_ms": 30000
  }'

Or register from the dashboard: Models → Register Model → Custom Endpoint.

Cloud Provider Models

Access models through your existing cloud provider accounts. Useful for data residency compliance, enterprise agreements, or accessing models not available as built-in.

AWS Bedrock

{
  "provider": "bedrock",
  "credentials": {
    "type": "aws",
    "access_key_id": "AKIA...",
    "secret_access_key": "...",
    "region": "us-east-1"
  }
}

Available: Claude (Opus, Sonnet, Haiku), Llama 3.3/4, Mistral Large.

Azure OpenAI

{
  "provider": "azure",
  "credentials": {
    "type": "azure",
    "endpoint": "https://your-resource.openai.azure.com",
    "api_key": "...",
    "api_version": "2024-10-21"
  }
}

Google Vertex AI

{
  "provider": "vertex",
  "credentials": {
    "type": "vertex",
    "project_id": "your-gcp-project",
    "region": "us-central1"
  }
}

Self-Hosted Models

Host models on your own infrastructure using vLLM, Ollama, or TGI. Register them as custom models — they get the same tool-calling support as any BYOM model.

Recommended for Self-Hosting

vLLM Setup (Recommended)

vLLM supports OpenAI-compatible tool calling with constrained decoding for guaranteed valid JSON:

vllm serve meta-llama/Llama-4-Maverick-17B-128E-Instruct \
  --host 0.0.0.0 \
  --port 8000 \
  --tensor-parallel-size 4 \
  --enable-auto-tool-choice \
  --tool-call-parser llama4_pythonic

Then register:

curl -X POST https://api.airaproof.com/api/v1/models/custom \
  -H "Authorization: Bearer aira_live_xxxxx" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Llama 4 Maverick (self-hosted)",
    "model_id": "llama-4-maverick",
    "endpoint_url": "https://your-gpu-server:8000/v1/chat/completions",
    "timeout_ms": 60000
  }'

Ollama Setup

For development and smaller deployments:

ollama pull llama3.3:70b
ollama serve

Register with the Ollama endpoint:

curl -X POST https://api.airaproof.com/api/v1/models/custom \
  -H "Authorization: Bearer aira_live_xxxxx" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Llama 3.3 70B (Ollama)",
    "model_id": "llama-3.3-70b",
    "endpoint_url": "http://your-server:11434/v1/chat/completions",
    "timeout_ms": 60000
  }'

Capabilities Matrix

Structured Output by Provider

Each provider handles structured output differently. Aira abstracts this so all models return the same decision schema.

For best-effort providers, Aira validates the response and retries once if the output is malformed. If the retry also fails, the model returns a model_error result.

Model Selection Recommendations

High-Stakes Decisions (Finance, Healthcare, Legal)

Use 3-5 models from different providers for maximum independence:

{
  "models": ["claude-opus-4-6", "gpt-5.4", "gemini-3.1-pro"]
}

Add o3 for complex multi-step reasoning decisions.

Cost-Optimized Cases

Use faster, cheaper models for high-volume, lower-risk decisions:

{
  "models": ["claude-sonnet-4-6", "gpt-5.2", "claude-haiku-4-5"]
}

Maximum Provider Diversity

Mix commercial and open-source models:

{
  "models": ["gpt-5.4", "claude-sonnet-4-6", "custom:llama-4-maverick"]
}

Open-Source Only (Self-Hosted)

For organizations that require full data sovereignty:

{
  "models": ["custom:gemma-4-31b", "custom:llama-4-maverick", "custom:qwen-3.5"]
}