Cardix

Enterprise AI routing

The cardinal axis for your AI

Cardix deploys inside your network to classify every request, enforce data policy, and route to the optimal model. It balances cost, latency, quality, compliance, personalization, and the custom metrics that matter to your organization.

OpenAI-compatibleOn-prem inferencePrivate cloudApproved APIsVPC / air-gap
Routing decision
Illustrative

Incoming request

Summarize Q3 portfolio report · RESTRICTED · summarization

Cardix
Llama 3 · on-prem
Best fit
Mistral · VPC
Eligible
GPT-4o · cloud
Policy-gated

Multi-axis

Optimization axes

Cost, latency, quality, compliance, personalization, and custom metrics you define

Hybrid

Deployment modes

On-prem, VPC, and air-gapped

1

OpenAI-compatible endpoint

Drop-in for your existing SDK

Fail-closed

Policy enforcement

Residency rules before routing

Platform

Enterprise routing for hybrid AI

One endpoint, resilient failover, cost intelligence, policy enforcement, and personalization, all deployed inside your perimeter.

One endpoint

Every model in your fleet, one routing layer

Replace separate endpoints for on-prem inference, private deployments, and approved cloud APIs with a single OpenAI-compatible interface. Cardix routes across your entire hybrid catalog.

Explore product

Your apps

Cardix

On-prem
Cloud

Higher availability

Resilient routing when backends fail

When a model backend is unavailable, Cardix falls back to the next eligible option, respecting policy constraints on every retry. No custom failover logic required.

See architecture
Primary backendActive
Fallback #1
Fallback #2

Cost intelligence

Right model, right price, every request

Stop defaulting every query to a frontier model. Cardix weighs cost against quality and latency on every call, then tracks spend against an all-frontier baseline.

Cost visibility

Optimized spend

↓ 56%

vs. all-frontier

Illustrative

Metrics stay on your infrastructure

Data policies

Policy before routing, inside your perimeter

Every request is classified for sensitivity and task type. Residency rules are enforced before any model is considered. Cardix deploys in your VPC, on-prem, or air-gapped environment.

How policy works

Your perimeter

1Classify sensitivity
2Apply residency rules
3Select eligible model

Personalization

Routing that learns your organization

Cardix improves from your traffic signals, learning which models excel for which teams and workloads. Intelligence stays on your infrastructure and adapts as your fleet evolves.

Self-improving routing
EngineeringFast modelHigh
LegalOn-prem LLMHigh
FinanceFrontier (gated)Matched

Drop-in

Your OpenAI SDK works out of the box

Point your existing client at Cardix. Change the base URL, not your application.

openai_sdk.py
from openai import OpenAI

client = OpenAI(
    base_url="https://cardix.internal/v1",
    api_key="your-internal-key",
)

response = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "Summarize this report."}],
    stream=True,
)

Integration

Three steps to intelligent routing

No rip-and-replace. Cardix integrates with the stack you already run.

01

Point your SDK

Change the base URL in your existing OpenAI-compatible client. No application rewrite, and streaming is supported.

02

Set your policy

Define residency rules, sensitivity labels, and approved backends. Cardix enforces them before any model is considered.

03

Route across your fleet

Every request is classified, optimized, and dispatched to the best eligible model across on-prem, private cloud, or approved APIs.

Hybrid catalog

Your models, your rules

An illustrative view of how Cardix unifies on-prem, private, and approved cloud backends under one routing layer.

On-premises & private

Llama 3 (on-prem)

On-premises

Eligible

Mistral (private)

VPC

Eligible

Custom fine-tune

Air-gapped

Eligible

Approved cloud APIs

GPT-4o

Approved cloud

Policy-gated

Claude Sonnet

Approved cloud

Policy-gated

Bedrock models

Approved cloud

Policy-gated

Industries

Where Cardix fits

Regulated enterprises running AI across on-prem and cloud, without compromising data sovereignty.

Financial services

Client portfolios and trading data must stay on-prem; summarization can use cloud when policy allows.

Cardix enforces matter-level routing without re-architecting existing AI integrations.

Healthcare

Clinical notes contain PHI that cannot leave the hospital network.

Restricted-classified requests route only to on-prem models; violations are blocked and logged.

Legal & professional services

Matter sensitivity varies; partners need confidence data is handled correctly.

Policy rules map data labels to allowed locations before any model sees the prompt.

Platform engineering

Team manages on-prem inference plus cloud APIs for different workloads.

One OpenAI-compatible endpoint; Cardix handles eligibility and selection across the fleet.

Trust

Built for regulated workloads

Clear control boundaries, policy-first routing, and full visibility into every decision.

Operational safeguards for regulated AI workloads.

Policy before routingFail-closed enforcementYour data never reaches usDeploys inside your networkOpenAI-compatible

Positioning

What Cardix is not

A focused routing intelligence layer, not a platform you have to rebuild around.

Not a hosted SaaS that sees your prompts

Not an inference platform or MLOps suite

Not another chat UI

Get started

Deploy intelligent routing inside your perimeter

Review the architecture, assess fit for your stack, and speak with our team about your deployment requirements.