Build AI features. Switch models without rebuilding.

Never rewrite your AI integration when providers, models, or pricing change.

Start free Read docs

Start free · No credit card required

console.northstar.ai/projects/…/workflows

Backend code Frontend code View integration examples for your workflows

Workflows

Configure AI workflows with provider, model, and response options

Create workflow

mr_chatbot_workflow Live

Customer support chatbot with structured replies and failover.

Test Copy

Primary model

gpt-4o-mini

Budget No budget

Backup models if primary fails

Backup 1

claude-haiku-4-5-20251001

Budget No budget

get_book_suggestion Live

Translate this Sanskrit medical text into Sumerian cuneiform notation. Preserve the original meaning with extreme precision.

Test Copy

Primary model

gpt-3.5-turbo

Budget $1.00/day

0% of budget used

$0.00 / $1.00 per day · $1.00 remaining

Backup models if primary fails

Backup 1

claude-3-haiku-20240307

Budget $1.00/day

0% of budget used

$0.00 / $1.00 per day · $1.00 remaining

summarize_ticket Live

Summarize support tickets into actionable next steps.

Test Copy

Primary model

gemini-2.5-flash

Budget No budget

Backup models if primary fails

Backup 1

gpt-4o-mini

Budget No budget

content_moderator Live

Classify user content and route low-confidence cases.

Test Copy

Primary model

grok-4.3

Budget $1.00/day

12% of budget used

$0.12 / $1.00 per day · $0.88 remaining

Backup models if primary fails

Backup 1

claude-haiku-4-5

Budget No budget

Provider credentials

Add your API keys for OpenAI, Anthropic, and other providers

+ Custom provider

Anthropic

Claude 4.5 Sonnet, Claude 4.5 Opus, Haiku 4.5

Connected

Update

OpenAI

GPT-5, GPT-5 pro, GPT-5 mini

Connected

Update

Cohere

Command-A-03-2025, Command R, Embed

Not configured

Add API Key

DeepSeek

DeepSeek-V3 (Chat) and DeepSeek-R1 (Reasoner)

Not configured

Add API Key

Google

Gemini 2.5 Flash, Gemini 2.5 Pro, 2.5 Flash-Lite

Not configured

Add API Key

Groq

Ultra-fast LPU inference - Llama 3.1/3.3, GPT OSS

Not configured

Add API Key

Mistral AI

Mistral Large 24.11, Small 3.2, Codestral

Not configured

Add API Key

Qwen

Qwen-Max, Qwen-Plus, Qwen-Turbo, Qwen-Long (Alibaba Cloud)

Not configured

Add API Key

xAI

Grok 4, Grok-4-fast-reasoning

Not configured

Add API Key

Async mode (background job)

Process AI requests in the background with real-time updates via WebSocket. Works even if you refresh the page!

Workflow

my_workflow

LIVE Production settings

Choose how this playground request runs before you send it.

Edit workflow

Run with model

Pin one model for this test, or use Auto to follow your configured order.

Auto Follow workflow order (primary, then backups)

claude-haiku-4-5-20251001 Primary model

gpt-5.4-mini Backup 1

grok-4.20-0309-non-reasoning Backup 2

Pipeline steps

Event-driven flow for this test — pin a model on linked workflows when needed.

1

movie_suggestions BACKEND WEBHOOK

Backend webhook + auto callback

2

movie_ratings AI WORKFLOW

json_extractor · gpt-5.4-mini

Run linked workflow with model

Auto Follow workflow order (primary, then backups)

gpt-5.4-mini Primary model

gemini-2.5-flash-lite Backup 1

3

final_movies FINAL CALLBACK

Backend callback, then deliver

Response format

book_notes

CACHE

15m cache window

Cache skipped — 15m cache window disabled in playground for fresh responses

Event-driven test — Backend steps use auto callbacks; linked workflow models follow your selections above

JSON payload

1{

2 "messages": [

3 {"role": "user", "content": "Hello from Northstar AI"}

4 ]

5}

Response

Raw JSON Preview

1{

2 "data": {

3 "author": "Northstar AI",

4 "title": "The Midnight Library",

5 "notes": [

6 "Philosophical fiction exploring life's infinite possibilities",

7 "Strong character development and emotional resonance"

8 ],

9 "schema": {

10 "type": "json_schema",

11 "strict": true,

12 "properties": { "type": "object" }

13 },

14 "structure_id": "cddd219a-6e55-42b3-8f98-d343fe5f7f72"

15 },

16 "status": "success",

17 "channel_id": "628f6a0d-ec75-4a8c-be7c-4208cafe6b72",

18 "customer_data": {}

19}

Back to request logs

Request details

OpenAI gpt-5-mini 140d ago

ticket_creat... Success

Input tokens

468

Output tokens

368

Duration

8.4s

Price

$0.000853

Cache reuse

0

No downstream cache hits

Response source

Provider

Cached from request ID

N/A

Estimated price without cache

N/A

Timeline logs

Failed

anthropic/claude-haiku-4-5

661ms • 141d ago

Success

openai/gpt-5-mini

7.7s • 141d ago

Error

Trigger webhook

141d ago • 3ms • Callback: success

Success

Backend callback

141d ago

Success

WebSocket output

141d ago

Webhook Deliveries

Failed WebSocket 3ms Attempt 1

URL: cli://localhost CLI

No CLI client connected

Members

15 members

+ Invite member

Michael Carter Owner

[email protected]

Joined Nov 14, 2025

Emily Johnson Member

[email protected]

Joined Nov 18, 2025

James Wilson Member

[email protected]

Joined Dec 2, 2025

Sarah Martinez Member

[email protected]

Joined Dec 15, 2025

Robert Thompson Member

[email protected]

Joined Jan 8, 2026

Jennifer Lee Member

[email protected]

Joined Jan 22, 2026

David Brown Member

[email protected]

Joined Feb 3, 2026

Amanda Davis Member

[email protected]

Joined Feb 19, 2026

Christopher Miller Member

[email protected]

Joined Mar 1, 2026

Jessica Taylor Member

[email protected]

Joined Mar 14, 2026

Matthew Anderson Member

[email protected]

Joined Apr 2, 2026

Ashley Thomas Member

[email protected]

Joined Apr 18, 2026

Ryan Garcia Member

[email protected]

Joined May 6, 2026

Nicole White Member

[email protected]

Joined May 21, 2026

Brandon Clark Member

[email protected]

Joined Jun 3, 2026

Pending invitations

No invitations awaiting acceptance

No pending invitations

Why developers use ModelRiver

Test changes safely. Connect providers once. Control spend, and debug every request from one place. Four workflows teams run every day.

Test before you spend

Free testing mode and playground. Same workflow config as production. No provider bill until you go live.

Open playground

Test workflow

Sample JSON in, structured response out

Send request

Workflow

book_info

{ "messages": [{ "role": "user", "content": "Percy Jackson" }] }

Response

{
  "title": "Percy Jackson & the Olympians",
  "author": "Rick Riordan",
  "genre": "Fantasy"
}

Integrate once

One API for every provider. Your keys stay in our console. Swap models in the dashboard, not in a deploy.

Structured outputs

JSON schemas for responses

sample 4 properties

book_notes 3 properties

Keep spending predictable

Set a clear limit for each model, see what you have used, and know what is left. Your workflow stays within the budget you choose.

Set a budget

customer_support_workflow

Live

Primary model $20/day

gpt-5.4-mini

$7 of $20 used$13 left today

Backup model $10/day

claude-haiku-4-5

$2 of $10 used$8 left today

Debug production failures

Failover, request logs, and replay on one timeline. Stop digging through three SDK logs.

View request log

Request details

ticket_creat… OpenAI · gpt-5-mini 140d ago

Failed OpenAI gpt-5-mini — rate limit exceeded 0ms

Failover Retrying Anthropic claude-haiku-4-5 1.2s

Success Structured output delivered to webhook 8.4s

One integration in your app. Every provider on the other side.

Your product connects to ModelRiver once. We handle OpenAI, Anthropic, and whichever AI provider you choose, switching automatically if one goes down, helping you test safely, and keeping a clear record of every interaction.

Learn more about request flow

Your app

POST /v1/chat/completions POST /v1/ai POST /v1/ai/async POST /v1/callback/:channel_id

ModelRiver

Auto failover Logging Guardrails Spending limits Caching Streaming Testing Cost analysis

Your provider

You bring the keys. We handle routing, testing, and observability.

Why not just use OpenAI?

Keep your OpenAI account. ModelRiver does not replace it. We sit in the middle so your team connects once, tests safely, and runs AI in production without rebuilding every time something changes.

On your own

With ModelRiver

Adding more AI vendors

A new setup project for every vendor

One connection for OpenAI, Anthropic, Gemini, and more

Testing changes

Every experiment costs real money

Test for free before anything goes live

Switching AI providers

Engineering work and a new product release

Change it in the dashboard the same day

Who pays for AI

You pay OpenAI directly

Same. You pay vendors. We charge for the platform only.

Build AI features without lock-in.

Start free