The apparent difficulty of managing Hadoop compared to more traditional and proprietary data products makes some companies wary of the Hadoop ecosystem, but managing security is becoming more accessible in the Hadoop space, with projects like Ranger, Knox, Sentry, and Metron providing enterprise-ready security features. However, the overall lack of built-in security threatens to hamper the open source platform’s spread in the banking and financial market before it’s really gotten off the ground.
If you set out to build a big data platform for a financial institution today, data security would be one of your top priorities. Every week seems to bring news of yet another massive data breach. In the last two years, big names like Target, Yahoo, and JPMorgan Chase, among others, have collectively lost hundreds of millions of customer records, including names, addresses, credit card numbers, and Social Security numbers. New regulations and legislation with strict directives like the EU’s General Data Protection Regulation (GDPR) make data security a main concern in the enterprise.
Federico Leven offers an overview of an end-to-end security deployment on Hadoop and the data and security governance policies implemented.
Federico Leven is the founder and lead data architect at ReactoData, a startup located in Buenos Aires, Argentina, and Wroclaw, Poland, focused on big data, advanced analytics applications and Hadoop. He also participates in the Open Compute Project doing benchmarks of big data frameworks, coordinates the big data meetups at IAAR, teaches a hands-on Hadoop lab at the Universidad De Palermo in Argentina, and is a frequent speaker at big data conferences (when he has a good idea to share). He began working with Hadoop in 2012 at Luminar Insights; previously, he was a data warehouse architect and Python developer.
©2018, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org