Get the free Ebook:
Private and Open Data in Asia: A Regional Guide.
In this talk, we unravel the experience of developing “Hoodoo” — an in-house solution at Flipkart.com to manage the enormous catalog of the marketplace. We’ll share the paradigms and patterns that evolved through the lifecycle of the solution.
Hoodoo is a generic, distributed, and elastic data store abstraction that helps to manage semi-structured data that has a high velocity of change in semantics and structural definition. Using primitive concepts of entities and relationships (E-R Modelling), it helps model and manage functional data with such traits. Hoodoo unifies data access patterns in its APIs (id based access, parametrized queries, search, et al) and provides tuneable consistency levels for stored data.
Functional data can often be non-trivial to manage and serve, especially when it is constantly evolving. As an example, consider catalog data for a retail marketplace like Flipkart.
Hoodoo uses the following patterns, techniques, and technologies:
Utkarsh B is principal architect at Flipkart responsible for building the marketplace technology platform with specific focus on building Cataloging as a Service. Utkarsh has extensive experience (12+ years) in large scale product/systems development, including seven years in the product development space. His specialties include service-oriented architecture, distributed computing, data storage techniques, map reduce, large scale product architecture and design, and platform components/stacks.
©2015, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org
Apache Hadoop, Hadoop, Apache Spark, Spark, and Apache are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries, and are used with permission. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event, which is managed by O'Reilly Media and/or Cloudera.