What’s in a filesystem? Whether you’re building a new application in a public cloud such as AWS, Azure, or GCE, porting an existing application to use a cloud file store, or adjusting your code to interact with a cloud-native file store, there is a lot to consider.
Sean Mackrory offers an overview of and best practices for filesystems in public cloud infrastructures as they relate to traditional filesystems. Sean explores some of the considerations with filesystems such as Amazon’s S3, as well as network-attached storage, such as EBS or Microsoft’s SSD-backed premium storage. Many of the examples will relate to Hadoop, namely moving from HDFS to S3. You’ll leave with a map to navigate the waters, based on the testing, tuning, and best practices that ensure that your application and cloud filesystem will work together well.
Sean Mackrory is a software engineer at Cloudera, where he works on cloud filesystem connectors, in particular s3a for Amazon’s S3 and WASB for Microsft’s Azure platform. Sean has extensive knowledge of Linux packaging and has worked on Cloudera’s build and packaging frameworks.
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org