DataLayer - Ambry: LinkedIn's Scalable Geo-Distributed Object Store HD

Sivabalan Narayanan with Linkedin discusses Ambry, an open-source geo-distributed highly available and horizontally scalable object store built at LinkedIn. It is an active-active, immutable, eventually consistent handle store that can be configured to provide different levels of consistency. At LinkedIn, Ambry runs on hundreds of nodes spanning multiple data centers and is the source of truth for all media and immutable content. We’ll look at the need for a scalable, geo-distributed and highly available object store in a media centric world. We will go over some of the unique challenges that an object store posses and how did Ambry over come those by smart design choices which in turn helped Ambry to scale for both large and small objects maintaining low latency and availability. Second part of the talk goes over the architecture of Ambry in little more detail with some selected internals and the talk ends with our roadmap lying ahead for us.