Over the past year, we've been building and operating AI agents that help marketers analyze campaign performance and investigate why metrics change. While the demos looked impressive, production quickly exposed a different set of challenges: agents choosing the wrong tools, making unsupported assumptions, becoming expensive to run, and failing in ways traditional monitoring doesn't catch.
This talk will be a look at what worked, what didn't, and what surprised us while running AI agents in production.
Shobhit Gupta is co-founder of Segwise AI, where he works on AI-powered analytics and agent systems. Previously, he worked at WhatsApp, Uber, Yahoo, and FamPay as a backend engineer or engineering manager. He enjoys building products that help people make sense of complex data.
