Migrating AI-infused chat to Kubernetes
Who is this presentation for?
- Software engineers, DevOps engineers, and architects
Steven Jones and Nicholas Fong explain how a team of messaging and AI engineers at IBM builds, tests, deploys, and manages 20+ customer-facing chatbots that serve people across various geographies and languages on the web every day.
The teams needed an easy way to manage, deploy, scale, and update these microservices. They found out-of-the-box platform-as-a-service (PaaS) technologies had CPU, memory, and disk limitations that prevented them from leveraging large models. Bare-metal servers are hard to manage. IBM’s microservices intercommunicate frequently, so network communication speed is important. Kubernetes met all of the teams’ needs: it’s scalable, flexible, manageable, and fast.
Steven and Nicholas walk you through migrating IBM’s chatbot, cognitive search, and other services to a Kubernetes-based architecture. Technologies include multiregion clusters, load balancers, integrating Express and Flask servers, and high-speed data transfer for importing models.
- A basic understanding of software development and cloud computing
What you'll learn
- Discover when to use a PaaS versus Kubernetes for managing microservices
- Learn about hosting machine learning models in Kubernetes
Steven W Jones is the lead architect of messaging and AI for the inbound marketing channel on IBM.com, cloud platform, and in-app infusing AI into chat, messaging, scheduler, chatbots, and transcript analysis.
Nicholas Fong is a full stack engineer working at IBM. When not working on delighting users, he enjoys exploring New York City for new restaurants and playing with his cat, Miko.
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
For media/analyst press inquires