Presented By
O’Reilly + Cloudera
Make Data Work
29 April–2 May 2019
London, UK
Please log in

Executive Briefing: Overview of data governance

Paco Nathan (derwen.ai)
14:5515:35 Wednesday, 1 May 2019
Average rating: ****.
(4.14, 7 ratings)

Level

Beginner

What you'll learn

  • Explore the history, themes, and current drivers regarding data governance in industry as well as the tools, vendors, process, standards, and open source projects supporting data governance
  • Learn data governance best practices
  • Understand the impact of machine learning on data governance and vice versa, as well as the impact of security concerns, ethics and bias in ML, highly regulated environments, "democratizing data," and workflow reproducibility

Description

Effective data governance is foundational for AI adoption in enterprise, but it’s an almost overwhelming topic. Paco Nathan offers an overview of its history, themes, tools, process, standards, and more—partly based on interviewing experts in this field about issues and best practices. Join in to learn what impact machine learning has on data governance and vice versa.

On the one hand, poor data governance can lead to system data-quality issues, lack of data availability, and other risks, which means that the people within an organization cannot leverage data effectively, thus limiting ROI. On the other hand, there’s a galaxy of compliance issues aimed at preventing risks if people leverage data inappropriately. (While many are quick to mention GDPR, there are many standards in play, depending on the business vertical.) However, several other issues create drivers for data governance: how security concerns are reshaping the structure of web apps; ethics, bias, and others’ needs for ML transparency; the implications of “democratizing data and analytics,” both pro and con; the priority for reproducibility in analytics workflows; and unexpected ways in which open source is evolving rapidly in highly regulated environments.

Although many practices emerged from the era of data warehouses, big data changed the game and began drawing attention from regulators. Facebook, Twitter, and other tech giants now testify before US senators, who in turn struggle to grasp basic concepts in IT. Meanwhile the IT landscape is evolving rapidly: new forms of hardware and networking, serverless cloud offerings, and edge computing, for example, are redefining even the basic concepts related to data governance. Ultimately, risk management plays the “thin edge of the wedge” for these changes in enterprise, while the mantle of responsibility for data governance moves toward the emerging chief data officer role.

Topics include:

  • History, themes, and current drivers regarding data governance in industry
  • A survey of tools, vendors, process, standards, open source projects, etc.
  • Interviews with experts about issues and best practices
  • Security concerns, ethics and bias in ML, highly regulated environments, “democratizing data,” and workflow reproducibility
  • The impact machine learning has on data governance and vice versa
  • The role risk management plays as the “thin edge of the wedge” for these changes in enterprise
  • How the emerging chief data officer role fits in
Photo of Paco Nathan

Paco Nathan

derwen.ai

Paco Nathan is known as a “player/coach” with core expertise in data science, natural language processing, machine learning, and cloud computing. He has 35+ years of experience in the tech industry, at companies ranging from Bell Labs to early-stage startups. His recent roles include director of the Learning Group at O’Reilly and director of community evangelism at Databricks and Apache Spark. Paco is the cochair of Rev conference and an advisor for Amplify Partners, Deep Learning Analytics, Recognai, and Primer. He was named one of the "top 30 people in big data and analytics" in 2015 by Innovation Enterprise.

Comments on this page are now closed.

Comments

Picture of Paco Nathan
Paco Nathan | EVIL MAD SCIENTIST
1/05/2019 13:44 BST

Slides for my talk are at https://derwen.ai/s/6fqt