D2DO252: (Re)Building Cloudflare’s Millions-of-Logs-Per-Second Logging Pipeline
Day Two DevOps
Ned Bellavance and I on Day Two DevOps host brilliant and effusive engineers who share their lessons learned from large, impactful projects. Come soak up all the hard lessons they learned through building big stuff (and sometimes destroying big stuff), all for the low low cost of totally free.
Summary
Cloudflare’s transition from SysLog-NG to OpenTelemetry is the topic of discussion on this episode of Day Two DevOps. Guests Colin Douch and Jayson Cena from Cloudflare explain the reasons behind the migration, including the need for better scalability, memory safety, and maintainability. They delve into challenges such as ensuring uninterrupted customer traffic and optimizing performance. The episode also digs into OpenTelemetry, including improved observability and customizability, and shares helpful lessons for other organizations considering similar migrations.
Episode Guests: Colin Douch and Jayson Cena
Colin Douch, Observability Tech Lead, Cloudflare, Inc.
Colin Douch is currently the Observability Tech Lead at Cloudflare. He is an experienced Site Reliability Engineer with a demonstrated history of working in the computer software industry. He is skilled in Python, C++, Go, Rust, and Amazon Web Services (AWS). He is a strong engineering professional with a Bachelor of Engineering (Hons) focused in Network Engineering from Victoria University of Wellington, New Zealand.
Jayson Cena, Systems Reliability Engineer on Observability Team, Cloudflare, Inc.
Jayson Cena is a detail-oriented and highly analytical IT professional with 10 years of experience in the industry. He is well versed in Linux, Unix and data security including customization of source code of open-source software to meet project requirements. He has also worked with multiple startups and hosting company as web engineer specializing in scaling web applications horizontally using RDBMS replications, NoSQL technology, clustering and file replications.
Listen Now!
Head over to Packet Pushers to listen to the podcast. It’s available on Apple Podcasts, Spotify, Overcast.FM, and pca.ST (basically anywhere that will take our podcasts).
Thanks all! Good luck out there.
kyler