Setting the file. One moment.
Chapter 04 · Cloudflare Deploy
Subchapter 4.7
references/ai-gateway/dynamic-routing.mdMarkdown2 KBView on GitHub
Configure complex routing in dashboard without code changes. Use route names instead of model names.
const response = await client.chat.completions.create({
model: 'dynamic/smart-chat', // Route name from dashboard
messages: [{ role: 'user', content: 'Hello!' }]
});| Node | Purpose | Use Case |
|---|---|---|
| Conditional | Branch on metadata | Paid vs free users, geo routing |
| Percentage | A/B split traffic | Model testing, gradual rollouts |
| Rate Limit | Enforce quotas | Per-user/team limits |
| Budget Limit | Cost quotas | Per-user spending caps |
| Model | Call provider | Final destination |
Pass via header (max 5 entries, flat only):
headers: {
'cf-aig-metadata': JSON.stringify({
userId: 'user-123',
tier: 'pro',
region: 'us-east'
})
}Multi-model fallback:
Start → GPT-4 → On error: Claude → On error: LlamaTiered access:
Conditional: tier == 'enterprise' → GPT-4 (no limit)
Conditional: tier == 'pro' → Rate Limit 1000/hr → GPT-4o
Conditional: tier == 'free' → Rate Limit 10/hr → GPT-4o-miniGradual rollout:
Percentage: 10% → New model, 90% → Old modelCost-based fallback:
Budget Limit: $100/day per teamId
< 80%: GPT-4
>= 80%: GPT-4o-mini
>= 100%: Errormodel: 'dynamic/route@v2'Dashboard → Gateway → Dynamic Routes: