Presented By O'Reilly and Cloudera
Make Data Work
Dec 4–5, 2017: Training
Dec 5–7, 2017: Tutorials & Conference

Architecting a text analytics system in the cloud

Arun Veettil (Skellam AI)
5:05pm5:45pm Thursday, December 7, 2017

Who is this presentation for?

  • Big data architects, engineers, and data scientists

Prerequisite knowledge

  • A basic understanding of the AWS stack (S3, Lambda, SQS, SNS, etc.)

What you'll learn

  • Explore best practices for building an enterprise-level text analytics system in the cloud


Processing unstructured text data at scale has largely been a challenge from both an algorithm and an engineering perspective. However, the advent of cloud computing solved most off the difficulties in building scalable algorithms for text analytics. Arun Veettil shares his experience and lessons learned developing a customized, enterprise-level NLP platform to replace a leading text analytics vendor platform.

Topics include:

  • Building topic detection at scale (both rule-based and machine-learned topic detection)
  • Developing automated topic detection and anomaly detection algorithms for text
  • Using features generated from text processing to solve other predictive analytics problems
  • Architecture and pitfalls
Photo of Arun Veettil

Arun Veettil

Skellam AI

Arun Veettil is the chief architect at Skellam AI, a company dedicated to helping businesses develop custom AI solutions. Arun is a tech veteran with over 17 years of industry experience. For the last seven years, Arun has been working at the intersection of machine learning and product development. Previously, he worked at Point Inside, Nordstrom Advanced Analytics, the Walt Disney Company, and IBM. His expertise includes developing machine learning algorithms to run against very large amounts of data and building large-scale distributed applications. Arun holds a master’s degree in computer science from the University of Washington and a bachelor’s degree in electronics engineering from the National Institute of Technology, Allahabad, India.