Value at risk (VaR) is a widely used risk measure that risk managers use to measure and control the level of risk that their firm undertakes. VaR is not simply additive; the VaR of a portfolio containing assets A and B does not equal the sum of the VaR of asset A and the VaR of asset B. This provides unique challenges to report VaR at any aggregate level, such as portfolio, desk, business hierarchy, or firm, as traditional database aggregation functions don’t work.
Accompanied by a code walk-through and a live demo, Deenar Toraskar explains how the Hive complex data types and user-defined functions can be used very effectively to provide simple, fast, and flexible VaR aggregations. These functions, combined with other standard Hive features, can provide not only aggregate reporting but also other features such as slice and dice, rollups, and what-if analysis. Using Spark SQL’s external data sources, VaR aggregation and reporting can also be done over a business hierarchy sourced from a relational database. Deenar also shows how to use these building blocks to succinctly and easily implement the new risk measures introduced by the Basel Committee for Banking Supervision (BCBS) as part of the fundamental review of the trading book (FRTB), including expected shortfall, P-values, and market liquidity premia.
Deenar Toraskar is a cofounder of Think Reactive, which provides a responsive, resilient, elastic, ready-to-go risk analytics solutions based on Spark. Think Reactive has worked with various banks to implement market and credit risk calculation platforms including the new FRTB calculations see (http://goo.gl/8bJY3Q). The solution features an intuitive interactive notebook interface and is backed by a high definition warehouse to provide deep insight.
Previously, Deenar worked at a Tier 1 investment bank, leading a team developing risk analytics applications (with numerous passionate and satisfied users) on a Spark/Hadoop platform. Deenar is also a Apache Spark contributor, a keen cyclist, and a proud parent.
©2016, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org
Apache Hadoop, Hadoop, Apache Spark, Spark, and Apache are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries, and are used with permission. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event, which is managed by O'Reilly Media and/or Cloudera.