Presented By O'Reilly and Cloudera
Make Data Work
22–23 May 2017: Training
23–25 May 2017: Tutorials & Conference
London, UK

Performance and security: A tale of two cities

Rekha Joshi (Intuit)
14:5515:35 Thursday, 25 May 2017
Data engineering and architecture
Location: Capital Suite 8/9
Level: Intermediate
Average rating: **...
(2.00, 5 ratings)

Who is this presentation for?

  • Engineers, architects, and product managers

Prerequisite knowledge

  • A basic knowledge of cloud computing and large-scale distributed systems
  • Familiarity with security patterns (useful but not required)

What you'll learn

  • Learn how Intuit manages performance and security

Description

It is no longer sufficient that software works. For software to be successful, it has to perform really well—to scale, achieve desired latency, and have consistent behavior with high throughput. Indeed performance tuning is the true engineering challenge, almost a black art. It is also no longer sufficient to just have intelligent data pipelines and services. Now, it is essential that they be extremely secure.

However, performance and security are often at loggerheads. Rekha Joshi explains why and offers a deep dive into how performance and security are managed in some of the most intense and critical data platform services at Intuit, exploring the factors that play a critical role in getting to highly secure performant system.

Topics include:

  • Taking the system as a whole, not just a part
  • Understanding the operating system and its quirks
  • Regular vulnerability testing and threat modeling of application
  • Restacking and applying AMI patches in smooth, automatic deployments
  • Your choice of cloud/computing platform and architecture and its lasting influences
  • Is the environment/tool a perfect fit?
  • Optimizing the hardware
  • The language of implementation and its idiosyncrasies
  • The frameworks used and the internal tuning factors
  • External or third-party services and APIs
  • Resource needs: CPU-intensive or memory-intensive operations?
  • Database and UI layers and caching
  • Avoiding wasteful processing paths: Is the application attempting impossible use cases or too wide a range of use cases?
  • Optimizing the algorithm
  • Measuring and the measurement tools
  • Profiling and tuning the application
Photo of Rekha Joshi

Rekha Joshi

Intuit

Rekha Joshi is principal engineer working in Intuit’s Technology group, where she is responsible for designing and implementing large-scale intelligent distributed platform solutions. Previously, she delivered large-scale personalized solutions for internet scale at Yahoo. Rekha has worked in diverse domains of finance, advertising, supply chain, and AI research. Her refueling stops include reading Issac Asimov, Richard Feynman, and PG Wodehouse and stalking Elon Musk.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)