Machine learning sits at the core of many essential products and services at Facebook. Yangqing Jia and Dmytro Dzhulgakov offer an overview of the hardware and software infrastructure that supports machine learning at global scale.Facebook’s machine learning workloads are extremely diverse: services require many different types of models in practice. This diversity has implications at all layers in the system stack. In addition, a sizable fraction of all data stored at Facebook flows through machine learning pipelines, presenting significant challenges in delivering data to high-performance distributed training flows. Computational requirements are also intense, leveraging both GPU and CPU platforms for training and abundant CPU capacity for real-time inference. Addressing these and other emerging challenges continues to require diverse efforts that span machine learning algorithms, software, and hardware design.
Yangqing Jia is director of engineering for Facebook’s AI platform team, which develops general-purpose open source AI solutions that serve as the backbone of Facebook AI products, such as ranking, computer vision, natural language processing, speech recognition, mobile AI, and AR. He has been influential in developing an open source deep learning software stack, many of the components of which serve as the de facto industry standard in AI. He is the creator or cocreator of Caffe, TensorFlow, Caffe2, ONNX, and PyTorch 1.0. Lately, he has been focused on the design and evolution of the AI hardware and software ecosystem and the combination of AI research and conventional wisdom of computer science.
Dmytro Dzhulgakov is an engineering manager and technical lead for AI infrastructure at Facebook, where he is currently leading the core development of PyTorch 1.0, an open source deep learning platform. Dmytro is one of the cocreators of ONNX, a joint initiative aimed at making AI development more interoperable. Previously, he built several generations of large-scale deep learning recommendation systems at Facebook that powered products from ads to the news feed. Dmytro holds an MS in applied mathematics. He had a successful career in programming competitions and was ranked in the Top 20 on Topcoder.
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
©2018, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com