Docker helps to easily build, ship, and run your applications. There are several ways to run Spark with Docker. Spark on Kubernetes is one of the solutions to run Spark by using a native way like Spark on Yarn or Mesos. Zhen Fan and Wei Ting Chen explain how JD.com uses Spark on Kubernetes in a production environment and why the company chose Spark on Kubernetes for its AI workloads. You’ll learn how to run with Spark with Docker while using Kubernetes as a resource manager and gain an understanding of the advantages this provides.
Zhen Fan is a software development engineer at JD.com, where he focuses on machine learning platform development and management.
Wei Ting Chen is a senior software engineer in Intel’s Software Service Group, where he works on big data on cloud solutions. One of his responsibilities is helping customers integrate big data solutions into their cloud infrastructure. Wei Ting is a contributor to the OpenStack Sahara project.
Comments on this page are now closed.
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org