Put open source to work
July 16–17, 2018: Training & Tutorials
July 18–19, 2018: Conference
Portland, OR

Machine overlord and you: Building AI on iOS with open source tools

Jon Manning (Secret Lab), Tim Nugent (Lonely Coffee), Paris Buttfield-Addison (Secret Lab)
1:30pm–5:00pm Tuesday, July 17, 2018
Artificial intelligence, TensorFlow
 Location: E143/144
Tags: tensorflow
Level: Beginner
Average rating: *****
(5.00, 2 ratings)

Who is this presentation for?

  • Programmers and software engineers, engineering managers, technical leads, and other managers with a strong technical background

Prerequisite knowledge

  • Programming experience with any language
  • Familiarity with object-oriented programming (useful but not required)
  • A basic understanding of developing on macOS using Xcode and Swift (useful but not required)

Materials or downloads needed in advance

  • A macOS laptop with Xcode installed (free from the macOS App Store)

What you'll learn

  • Explore and learn how to implement and use Apple’s ML features and frameworks
  • Discover how to incorporate popular open source ML and AI libraries into that work
  • Understand how, where, and why to use AI- and ML-powered features

Description

Join Jonathon Manning, Tim Nugent, and Paris Buttfield-Addison to get up to speed with the new machine learning features of iOS and learn how to apply the Vision and Core ML frameworks to solve practical problems in object detection, face recognition, and more. These frameworks run on-device, so they work quickly with no network access, making them cost effective and user-privacy conscious. You’ll combine Apple’s frameworks with open source libraries Keras, and TensorFlow to create an iOS app that makes it look easy to detect faces and facial features, detect and classify objects in photos, and expose these features to the user.

Topics include:

  • The basics of machine learning: The differences between, and reasons to be interested in, supervised learning, unsupervised learning, and reinforcement learning and the different types of problems each can address
  • What Apple’s Core ML and Vision frameworks do
  • How to set up your Swift-based iOS development environment for machine learning
  • How to work with Keras and TensorFlow, the popular open source Python neural network and machine learning libraries, to create, manipulate, and bring models into CoreML
  • How to implement machine learning-based features in your iOS apps and load trained models for use in machine learning
Photo of Jon Manning

Jon Manning

Secret Lab

Jon Manning is the cofounder of independent game development studio Secret Lab. He’s working on the critically acclaimed award-winning adventure game Night in the Woods, which includes his interactive dialogue system Yarn Spinner, and Button Squid, a top-down puzzler. He’s written a whole bunch of books for O’Reilly about iOS development and game development. Jon holds a PhD about jerks on the internet. He’s currently writing Practical AI with Swift for O’Reilly.

Photo of Tim Nugent

Tim Nugent

Lonely Coffee

Tim Nugent pretends to be a mobile app developer, game designer, tools builder, researcher, and tech author. When he isn’t busy avoiding being found out as a fraud, Tim spends most of his time designing and creating little apps and games he won’t let anyone see. He also spent a disproportionately long time writing his tiny little bio, most of which was taken up trying to stick a witty sci-fi reference in…before he simply gave up. He’s writing Practical Artificial Intelligence with Swift for O’Reilly and building a game for a power transmission company about a naughty quoll. (A quoll is an Australian animal.)

Photo of Paris Buttfield-Addison

Paris Buttfield-Addison

Secret Lab

Paris Buttfield-Addison is a cofounder of Secret Lab, a game development studio based in beautiful Hobart, Australia. Secret Lab builds games and game development tools, including the multi-award-winning ABC Play School iPad games, the BAFTA- and IGF-winning Night in the Woods, the Qantas airlines Joey Playbox games, and the Yarn Spinner narrative game framework. Previously, Paris was a mobile product manager for Meebo (acquired by Google). Paris particularly enjoys game design, statistics, blockchain, machine learning, and human-centered technology. He researches and writes technical books on mobile and game development (more than 20 so far) for O’Reilly; he recently finished writing Practical AI with Swift and is currently working on Head First Swift. He holds a degree in medieval history and a PhD in computing. Paris loves to bring machine learning into the world of practical and useful. You can find him on Twitter as @parisba.

Comments on this page are now closed.

Comments

Satwik Raj |
04/28/2018 2:19pm PDT

I am a grade 10 student and want to learn coding. Can i join your lecture online