Stitch Fix has come a long way, both as a company and as a data science–heavy team. Its business challenges its data teams in terms of scale and complexity.
Neelesh Salian discusses how Stitch Fix’s data platform team maintains and innovates its infrastructure for the company’s data scientists and evolves the ecosystem as the business continues to expand.
The team’s charter has always remained to build a self-service data platform for data scientists, empowering them to be full stack and responsible for their own workflows. To accomplish this goal, the team prioritizes impactful changes, invests time in prototyping and testing, and uses its own infrastructure to test and innovate. This enables the team to be autonomous as developers of data infrastructure while also focusing on the larger team mission.
The team takes a microservice architecture–based approach to solving critical problems. Neelesh shares details about such approaches the team took to change the ecosystem: adapting for data lineage, changing the reading and writing interfaces to the data warehouse, and improving the execution of Spark workflows, for instance. These were larger cross-functional projects that required careful planning and execution.
Join in to explore lessons the team learned during this evolution that have helped them grow and make better decisions for the future.
Neelesh Srinivas Salian is a software engineer on the data platform team at Stitch Fix, where he works on the compute infrastructure used by the company’s data scientists. Previously, he worked at Cloudera, where he worked with Apache projects like YARN, Spark, and Kafka.
For exhibition and sponsorship opportunities, email strataconf@oreilly.com
For information on trade opportunities with O'Reilly conferences, email partners@oreilly.com
View a complete list of Strata Data Conference contacts
©2019, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • confreg@oreilly.com