Presented By O'Reilly and Cloudera
Make Data Work
31 May–1 June 2016: Training
1 June–3 June 2016: Conference
London, UK

Simple, fast, and flexible risk aggregation in Hadoop

Deenar Toraskar (Think Reactive)
14:55–15:35 Thursday, 2/06/2016
Hadoop use cases
Location: Capital Suite 10/11 Level: Intermediate
Average rating: ***..
(3.00, 2 ratings)

Value at risk (VaR) is a widely used risk measure that risk managers use to measure and control the level of risk that their firm undertakes. VaR is not simply additive; the VaR of a portfolio containing assets A and B does not equal the sum of the VaR of asset A and the VaR of asset B. This provides unique challenges to report VaR at any aggregate level, such as portfolio, desk, business hierarchy, or firm, as traditional database aggregation functions don’t work.

Accompanied by a code walk-through and a live demo, Deenar Toraskar explains how the Hive complex data types and user-defined functions can be used very effectively to provide simple, fast, and flexible VaR aggregations. These functions, combined with other standard Hive features, can provide not only aggregate reporting but also other features such as slice and dice, rollups, and what-if analysis. Using Spark SQL’s external data sources, VaR aggregation and reporting can also be done over a business hierarchy sourced from a relational database. Deenar also shows how to use these building blocks to succinctly and easily implement the new risk measures introduced by the Basel Committee for Banking Supervision (BCBS) as part of the fundamental review of the trading book (FRTB), including expected shortfall, P-values, and market liquidity premia.

Photo of Deenar Toraskar

Deenar Toraskar

Think Reactive

Deenar Toraskar is a cofounder of Think Reactive, which provides a responsive, resilient, elastic, ready-to-go risk analytics solutions based on Spark. Think Reactive has worked with various banks to implement market and credit risk calculation platforms including the new FRTB calculations see (http://goo.gl/8bJY3Q). The solution features an intuitive interactive notebook interface and is backed by a high definition warehouse to provide deep insight.

Previously, Deenar worked at a Tier 1 investment bank, leading a team developing risk analytics applications (with numerous passionate and satisfied users) on a Spark/Hadoop platform. Deenar is also a Apache Spark contributor, a keen cyclist, and a proud parent.