Next data platform architecture: Distributed data mesh

Many enterprises are investing in their next-generation data platform with the hope of democratizing data at scale to provide business insights and ultimately make automated intelligent decisions. Data platforms based on the data lake architecture have common failure modes that lead to unfulfilled promises at scale.

Zhamak Dehghani examines her observations and insights from working with many organizations that are busy developing their next-generation centralized data platforms. She explores the failure modes of a centralized paradigm of a data lake or its predecessor, the data warehouse.

She introduces data mesh, the next-generation data platform that shifts to a paradigm that draws from modern distributed architecture: considering domains as the first-class concern, applying platform thinking to create self-serve data infrastructure, and treating data as a product.