EOSDIS is working toward a vision of a cloud-based, highly flexible system to meet its ever-growing and evolving data demands. Cumulus, a free and open source framework, supports this vision via configurable workflows to ingest, process, archive, manage, and distribute NASA’s Earth imagery. The Cumulus infrastructure is designed for scalability and reliability, using much of the AWS serverless platform, which enables Cumulus to scale in real time to be performant under the largest expected workloads.
Cumulus is poised to make a huge impact on how NASA manages and disseminates its Earth science imagery. In one notable case, the NASA-ISRO Synthetic Aperture Radar (NISAR) mission, Cumulus will be used to collect more data in a year than exists in NASA’s current archive. The NISAR mission will collect 45 PB a year and process that data at a rate of 1 GB per second. The need for Cumulus is proven through its application to NASA missions, but its application has extended beyond NASA’s Distributed Active Archive Centers (DAACs). It’s being used to monitor agriculture in Tanzania, apply machine learning models to estimate hurricane intensity, and generate air quality predictions using near-real-time forecast data.
Aimee Barciauskas outlines the motivation for Cumulus, the achievements and hurdles of the past two years, and its varied applications. You’ll learn about the availability of the open-sourced software and how NASA intends to make its Earth Observing Geospatial data available for free to the public in the cloud.
Aimee Barciauskas is a data engineer at Development Seed. She works with NASA and the European Space Agency (ESA) to make the vast collection of Earth Observation data cloud friendly and analysis ready and helps the machine learning team improve the understanding of and access to data. She’s experienced in building cloud service-oriented architecture, web APIs, and data processing pipelines. Previously, Aimee was a full stack web developer at Nava, Medidata, and Fundraise.com. She cares deeply about using data, data science, and machine learning to drive positive social change; she’s a chapter leader of DataKind DC, where she volunteers on projects ranging from a program referral portal for DC’s Child and Family Services Agency to the use of natural language processing to understand why people give philanthropically. When not coding, Aimee enjoys rock climbing and fancy beer. She holds a MS in data science from Barcelona Graduate School of Economics and a BA in economics and philosophy from Boston College.
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com