Talk
10 Trillion Tokens, One Decision: The Router Behind Brazil’s Largest AI Platform
How do you serve 168 models through one integration and stay reliable at 3M+ requests a day? Adapta, the team behind Brazil's largest generative AI platform, did exactly that on AI Gateway and the Vercel Platform. Hear how they built an app-level router that picks the right model per request in under 200ms, wired up automatic failover and per-user budgets, and kept reliability climbing as traffic spiked. A practical look at the architecture decisions behind running frontier models at scale.
- Main Stage · In-person + Online