14–17 Oct 2019

Practical on-device AI and ML using Swift

Paris Buttfield-Addison (Secret Lab), Tim Nugent (lonely.coffee)
13:4514:25 Wednesday, October 16, 2019
Location: King's Suite - Balmoral

Who is this presentation for?

  • Anyone interested in on-device AI, AI and machine learning without the cloud, Swift, or new approaches

Level

Beginner

Description

Find out what’s possible in the world of offline, on-device machine learning and artificial intelligence using Swift. Apple’s powerful silicon, combined with the ease of use of Swift, and the associated ML and AI frameworks, including CoreML, CreateML, TensorFlow, and beyond, make it easier than ever to create ML-driven features that exist entirely offline on a user’s iOS device.

In a world of paranoia, lack of privacy and lack of confidence in cloud services and government access, on-device machine learning and artificial intelligence is more important—and thanks to advances low-power silicon, more feasible—than it’s ever been.

Paris Buttfield-Addison and Tim Nugent take a deep dive into what Apple’s Core ML and Vision frameworks do; how to set up your Swift-based iOS development environment for machine learning; how to work with TensorFlow, the popular open source Python neural network and machine learning library, to create, manipulate, and bring models into CoreML and Swift; and how to implement machine learning-based features in your iOS apps and load trained models for use in machine learning.

Join the authors of Practical Artificial Intelligence with Swift (coming late 2019 from O’Reilly) to get up to speed with the latest in machine learning features of iOS, Swift frameworks, and offline, on-device AI. Learn how to apply the Vision and Core ML frameworks to solve practical problems in object detection, face recognition, and more. These frameworks run on-device, so they work quickly with no network access, making them cost effective and user-privacy conscious. You’ll combine Apple’s frameworks with open source libraries Keras and TensorFlow to create an iOS app that makes it look easy to detect faces and facial features, detect and classify objects in photos, and expose these features to the user, and you’ll go beyond this and explore using advanced custom models, and more subtle ML and AI features. You’ll do it all on device. And you’ll move fast.

Prerequisite knowledge

  • Experience with basic programming

What you'll learn

  • Learn how to use Swift, CoreML, and other related tools for on-device machine learning without the cloud
Photo of Paris Buttfield-Addison

Paris Buttfield-Addison

Secret Lab

Paris Buttfield-Addison is a cofounder of Secret Lab, a game development studio based in beautiful Hobart, Australia. Secret Lab builds games and game development tools, including the multi-award-winning ABC Play School iPad games, the BAFTA- and IGF-winning Night in the Woods, the Qantas airlines Joey Playbox games, and the Yarn Spinner narrative game framework. Previously, Paris was a mobile product manager for Meebo (acquired by Google). Paris particularly enjoys game design, statistics, blockchain, machine learning, and human-centered technology research and writes technical books on mobile and game development (more than 20 so far) for O’Reilly and is currently writing Practical AI with Swift and Head First Swift. He holds a degree in medieval history and a PhD in computing.

Photo of Tim Nugent

Tim Nugent

lonely.coffee

Tim Nugent pretends to be a mobile app developer, game designer, tools builder, researcher, and tech author. When he isn’t busy avoiding being found out as a fraud, Tim spends most of his time designing and creating little apps and games he won’t let anyone see. He also spent a disproportionately long time writing his tiny little bio, most of which was taken up trying to stick a witty sci-fi reference in…before he simply gave up. He’s currently writing Practical Artificial Intelligence with Swift for O’Reilly and building a game for a power transmission company about a naughty quoll (a quoll is an Australian animal).

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

aisponsorships@oreilly.com

For information on exhibiting or sponsoring a conference

Contact list

View a complete list of O'Reilly AI contacts