As it relates to the topic of big data and technologies such as Hadoop, there tends to be a lot of talk around enabling the next-generation use cases or advanced analytics. While those applications should play a role in any enterprise’s data strategy, much of the initial value and benefits of a modern data platform can often come from simply offloading the analytic workloads you’re running today. However, where do you start when developing an offload strategy? Which workloads are better suited for Hadoop? And how do you offload complex analytic workloads?
At Visa, this process of optimizing the enterprise data warehouse and consolidating data marts by migrating these analytic workloads to Hadoop has played a key role in the adoption of the platform and how data has transformed Visa as an organization. During this talk, Nandu (Visa) and Ewa (Cloudera) will look at Visa’s experience optimizing their data warehouse landscape by moving to Hadoop and provide some best practices and guidance for organizations looking to migrate workloads to Hadoop.
In particular, Nandu will discuss Visa’s approach to bringing Hadoop into their business, their offload strategy, and lessons learned from the experience. In addition, he will also discuss how they’re using new technologies to help better understand the legacy workloads running today and prioritize migrations to continue to alleviate costs and pressures on these systems. Finally, he will showcase the successes thus far and look at what’s in store for the future.
Nandu Jayakumar is a software architect and engineering leader at Visa, where he is currently responsible for the long-term architecture of data systems and leads the data platform development organization. Previously, as a senior leader of Yahoo’s well-regarded data team, Nandu built key pieces of Yahoo’s data processing tools and platforms over several iterations, which were used to improve user engagement on Yahoo websites and mobile apps. He also designed large-scale advertising systems and contributed code to Shark (SQL on Spark) during his time there. Nandu holds a bachelor’s degree in electronics engineering from Bangalore University and a master’s degree in computer science from Stanford University, where he focused on databases and distributed systems.
Ewa is responsible for SQL workload optimization solutions including traditional data warehouse workloads offload, and Impala/Hive workloads optimization. She manages product direction and strategy of Navigator Optimizer (formerly known as Xplain.io). Prior to Cloudera, Ewa held leadership positions driving product strategy and product design for several enterprise SaaS applications, including Xplain.io.
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org