Making Open Work
May 8–9, 2017: Training & Tutorials
May 10–11, 2017: Conference
Austin, TX

Workers, queues, and data

2:35pm3:15pm Wednesday, May 10, 2017
Adopt This Now, Infrastructure
Location: Ballroom F
Level: Intermediate
Average rating: ****.
(4.00, 11 ratings)

Who is this presentation for?

  • Developers and architects

Prerequisite knowledge

  • Intermediate development experience

What you'll learn

  • Learn techniques for creating a good queue setup and solid worker scripts to consume those queues


Queues are a powerful addition to your applications, enabling highly scalable systems and loose coupling between your components. Lorna Mitchell covers how queues in general, and excellent open source tool RabbitMQ in particular, can be used to improve the scalability and robustness of applications. Lorna explores designing queue structures and the options around queues, messages, and durability.

Creating reliable worker scripts can be tricky, but Lorna shares advice on doing so even in systems that require complex or multistep processing of tasks. Along the way, Lorna also discusses data hygiene, when to include data with a message, when a worker should fetch data itself, and how to manage the flow of information back to the component that created the message in the first place.

Photo of Lorna Mitchell

Lorna Mitchell


Lorna Mitchell is a Leeds-based developer advocate with IBM Cloud Data Services. She brings her technical expertise on a range of topics to audiences all over the world with her writing and speaking engagements, always delivered with a very practical slant. Lorna is the author of PHP Web Services (O’Reilly), PHP Master (Sitepoint), and Git Workbook (Leanpub) and is regularly published at a number of outlets, including net magazine and her blog,