The data engineering domain has benefited from many advances over the recent years, including streaming technologies, on-demand infrastructure, and the proliferation of cloud-native tooling to digest, process, store, and serve data at scale. Despite these advances, one thing remains underdeveloped: the approach to the overall data engineering platform architecture and team structure. The current state of the art, unfortunately, remains centralized, functionally organized and managed by hyperspecialized teams, difficult to scale, and hard to leverage.
Zhamak Dehghani shares observations and lessons learned working with and consulting many organizations that are busy developing their data engineering capabilities and technology. Zhamak then introduces an alternative data engineering architecture, organizational, and operational model that can enable your organization to become truly data driven—a decentralized and ubiquitous data engineering platform that enables any team to produce or consume data at scale with low overhead.
This session is sponsored by Thoughtworks.
Zhamak Dehghani is a principal consultant at ThoughtWorks focusing on distributed systems architecture and digital platform strategy for the enterprise. She’s a member of the ThoughtWorks Global Technology Advisory Board and contributes to the creation of the ThoughtWorks Technology Radar. Zhamak has worked as a software engineer and architect for over 20 years in the areas of distributed computing communications and embedded device technologies and has contributed to multiple patents in these areas.
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org