LangSmith’s Bring Your Own Cloud (BYOC) model lets customers run LangSmith in their AWS accounts across many regions. Our team is responsible for provisioning the infrastructure, shipping upgrades, monitoring deployments, and proactively resolving issues. As the fleet grows, we need to keep doing that reliably without a proportional increase in manual work. In this talk, I’ll show how we operate this fleet efficiently while keeping operational overhead low. I'll cover how we provision and continuously reconcile infrastructure, how we manage private customer environments through a shared control plane, and how we build internal tooling to keep day-to-day operations manageable as the fleet grows. We’ll follow a release through our deployment pipeline: validating changes, rolling them out across customer environments, designing upgrades to avoid downtime, and handling failures along the way. Finally, we’ll look at how we leverage telemetry to understand what’s happening across the fleet, surface failures that require attention, and use internal AI tooling to help troubleshoot incidents.
Romain Priour is a software engineer on LangChain’s infrastructure team, where he leads the team behind LangSmith’s Bring Your Own Cloud (BYOC) platform. Previously, he helped build an intelligent log compression engine at Grepr and worked on SAP Business Network at SAP. Romain studied computer science at UC Berkeley. Go Bears!
