High-speed, machine-automated trading is now responsible for more than half of all US equity trades, and its continued growth across security markets seems inevitable. As human agents become less involved, and machines drive these transactions to a greater extent, it is becoming increasingly important to closely monitor these automated transactions at both a high level and a granular level to help inform future strategic decisions, control risk, and ensure regulatory compliance.
When it comes to processing and analyzing large-scale data for the trading of hundreds of millions of dollars, every packet matters. Strategically, the insights derived from analysis in these environments are highly valuable to the financial audience. Fergal Toomey and Pierre Lacave demonstrate how to effectively use Spark and Hadoop to analyze trading activity in the world’s largest financial institutions.
Fergal Toomey is a specialist in network data analytics and a founder of Corvil, where he has been intensively involved in developing key product innovations directly applicable to managing IT system performance. Fergal has been involved in the design and development of innovative measurement and analysis algorithms for the past 12 years. Previously, he was an assistant professor at the Dublin Institute for Advanced Studies, where he was a member of the Applied Probability Group, which also included Raymond Russell, Corvil’s CTO. Fergal holds an MSc in physics and a PhD in applied probability theory, both from Trinity College, Dublin.
Pierre Lacave is a senior software engineer at Corvil. Pierre has contributed to more than 200 Corvil analytics plugins to decode, analyze, and enrich network data in enterprise and electronic trading infrastructure, and he is also lead developer in the integration of the Corvil flagship product with the Hadoop/Spark ecosystem. Pierre studied computer science in Paris, France, and Chongqing, China, and holds a double MSC in software engineering.
©2016, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org
Apache Hadoop, Hadoop, Apache Spark, Spark, and Apache are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries, and are used with permission. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event, which is managed by O'Reilly Media and/or Cloudera.