Setting up continuous integration is now a common practice in the industry. However, there are still only few effective solutions for doing so across hundreds of repositories encompassing thousands of projects. How do we manage dependencies between projects? How do we assess the quality of each one? How do we automate the validation of a project's clients even before merging a pull request? In this session, we’ll quickly revisit the fundamentals of the problem. Then, we’ll share Criteo's own journey on this topic, along with the pros and cons of the different approaches we explored.
Emmanuel Guérin is a Staff Site Reliability Engineer at Criteo. Over the past 25 years, he has been a strong advocate for automation, working with a number of small French startups. Frustrated by the lack of progress as an individual contributor, he continued to champion better practices wherever he could. At Criteo, he has helped scale the primary build system used by the R&D organization. He now focuses on the company’s main scheduler for data jobs.
