Docker helps to easily build, ship, and run your applications. There are several ways to run Spark with Docker. Spark on Kubernetes is one of the solutions to run Spark by using a native way like Spark on Yarn or Mesos. Zhen Fan and Wei Ting Chen explain how JD.com uses Spark on Kubernetes in a production environment and why the company chose Spark on Kubernetes for its AI workloads. You’ll learn how to run with Spark with Docker while using Kubernetes as a resource manager and gain an understanding of the advantages this provides.
Topics include:
Zhen Fan is a software development engineer at JD.com, where he focuses on machine learning platform development and management.
Wei Ting Chen is a senior software engineer in Intel’s Software Service Group, where he works on big data on cloud solutions. One of his responsibilities is helping customers integrate big data solutions into their cloud infrastructure. Wei Ting is a contributor to the OpenStack Sahara project.
Comments on this page are now closed.
For exhibition and sponsorship opportunities, email strataconf@oreilly.com
For information on trade opportunities with O'Reilly conferences, email partners@oreilly.com
View a complete list of Strata Data Conference contacts
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • confreg@oreilly.com
Comments
I have uploaded the slides, please feel free to download the slides and ask any question.
@Dean Sure, could you leave your email address, I’ll post you soon.
I enjoyed your presentation yesterday. Could you post the slides?