Presented By O'Reilly and Cloudera
Make Data Work
September 25–26, 2017: Training
September 26–28, 2017: Tutorials & Conference
New York, NY

Automated data pipelines in hybrid environments: Myth or reality? (sponsored by BMC)

Basil Faruqui (BMC Software), Jon Ouimet (BMC Software)
2:05pm2:45pm Thursday, September 28, 2017
Location: 1E 06

What you'll learn

  • Learn how to automate data pipelines across a hybrid environment


Basil Faruqui and Jon Ouimet walk you through a customer journey to automate data pipelines across a hybrid environment. You’ll get a glimpse at the reality of building, running, and managing complex data pipelines across a dynamic infrastructure (both cloud and on-premises) spanning multiple applications from a single point of control with BMC’s Control-M—all while integrating the entire pipeline into a CI/CD tool chain and giving business users access to the status of their workflows from a mobile app.

This session is sponsored by BMC.

Photo of Basil Faruqui

Basil Faruqui

BMC Software

Basil Faruqui is lead solutions manager at BMC, where he leads the development and execution of big data and multicloud strategy for BMC’s Digital Business Automation line of business (Control-M). Basil’s key areas of focus include evangelizing the role automation plays in delivering successful big data projects and advising companies on how to build scalable automation strategies for cloud and big data initiatives. Basil has over 15 years of industry experience in various areas of software research and development, customer support, and knowledge management.

Photo of Jon Ouimet

Jon Ouimet

BMC Software

Jon Ouimet is a senior solution engineer on the Control-M Innovation IT team at BMC Software, where he supports efforts to integrate Control-M into the DevOps, big data, and cloud markets. Jon has years of experience working with Control-M—administering it and scheduling and operating various environments. His specialties include Control-M, ETL processes, system administration (Linux and Windows), and programming in C++, Java, Python, and bash, to name a few.

Comments on this page are now closed.


Picture of Basil Faruqui
09/21/2017 3:34pm EDT

Join this session to see a live demo of how to tackle the following challenges when building complex data pipelines:

*Building, running and managing a data pipeline from a single point of control that spans multiple applications, file transfers and runs across multiple public clouds and on-prem environments
*Implementing a pipeline that can fit into agile development and CI/CD frameworks
*Creating cross application dependencies across workflows without custom scripting
*Ensuring that workflows running inside data pipelines will complete within the SLAs negotiated with the business users
*Giving business users and groups outside of the dev and ops visibility into the processes that are critical to them
*Ensuring that data moving in and out of Hadoop and systems is being processed securely
*Automate the promotion of data pipelines across multiple environments like test, dev and prod
*Addressing audit and compliance requirements