Storage Systems: Organization, Performance, Coding, Reliability, and Their Data Processing - Softcover

Thomasian, Alexander

Softcover

ISBN 10: 0323907962 ISBN 13: 9780323907965

Publisher: Morgan Kaufmann, 2021

Synopsis

Storage Systems: Organization, Performance, Coding, Reliability and Their Data Processing was motivated by the 1988 Redundant Array of Inexpensive/Independent Disks proposal to replace large form factor mainframe disks with an array of commodity disks. Disk loads are balanced by striping data into strips―with one strip per disk― and storage reliability is enhanced via replication or erasure coding, which at best dedicates k strips per stripe to tolerate k disk failures. Flash memories have resulted in a paradigm shift with Solid State Drives (SSDs) replacing Hard Disk Drives (HDDs) for high performance applications. RAID and Flash have resulted in the emergence of new storage companies, namely EMC, NetApp, SanDisk, and Purestorage, and a multibillion-dollar storage market. Key new conferences and publications are reviewed in this book.

The goal of the book is to expose students, researchers, and IT professionals to the more important developments in storage systems, while covering the evolution of storage technologies, traditional and novel databases, and novel sources of data. We describe several prototypes: FAWN at CMU, RAMCloud at Stanford, and Lightstore at MIT; Oracle's Exadata, AWS' Aurora, Alibaba's PolarDB, Fungible Data Center; and author's paper designs for cloud storage, namely heterogeneous disk arrays and hierarchical RAID.

• Surveys storage technologies and lists sources of data: measurements, text, audio, images, and video
• Familiarizes with paradigms to improve performance: caching, prefetching, log-structured file systems, and merge-trees (LSMs)
• Describes RAID organizations and analyzes their performance and reliability
• Conserves storage via data compression, deduplication, compaction, and secures data via encryption
• Specifies implications of storage technologies on performance and power consumption
• Exemplifies database parallelism for big data, analytics, deep learning via multicore CPUs, GPUs, FPGAs, and ASICs, e.g., Google's Tensor Processing Units

About this title

About the Author

Dr. Alexander Thomasian is the founder and CEO of Thomasian Associates consulting, in Pleasantville, NY, USA. As a former IBM Systems Engineer, he did a PhD in Computer Science at UCLA. Dr. Thomasian has held teaching and research positions at Case Western Reserve U., U. Southern California, Burroughs Corp., IBM T.J. Watson Research Center, and New Jersey Institute of Technology. At IBM's Almaden Research Center, he developed the analysis to predict the performance of IBM's RAID5 product under development. His storage research was funded by National Science Foundation Hitachi Global Storage Technologies, and AT&T. He was a visiting scientist of Chinese Academy of Sciences at Shenzhen and a Fulbright Fellow at the American University of Armenia in Yerevan. He is a Life Fellow of IEEE for fundamental contributions to the performance analysis of computer systems. He was an Editor of IEEE Transactions on Parallel and Distributed Systems, a monograph on database concurrency control, and 150 papers, more recently on storage systems.

From the Back Cover

Storage Systems: Organization, Performance, Coding, Reliability and Their Data covers computer storage systems with replication and erasure coding. Noted storage systems pioneer and researcher Alexander Thomasian discusses coding, reliability, and performance of popular RAID organizations: RAID1 mirrored disks, RAID5/6/7 1/2/3-disk failure tolerant - 1/2/3DFT arrays. RAID5 is analyzed in normal, degraded (with one failed disk), and rebuild mode. Clustered RAID organizations are proposals to improve RAID performance in degraded mode. Various rebuild techniques are discussed for the systematic reconstruction of a failed disk on a spare disk. Storage technologies starting with punched cards up to ash memories and beyond are discussed. Data placement and scheduling of magnetic disks is discussed, although they are being replaced with Solid State Disks (SSDs) for high performance applications. Readers will learn about the storage of files, SQL and NoSQL databases on disk and SSD to achieve higher efficiency. Data compression, deduplication, and encryption techniques for storage systems have led to new technologies and startups, as well as techniques to save power in storage and server systems. Finally, three storage prototypes discussed are Fast Array of Wimpy Nodes (FAWN) at CMU, RAMCloud at Stanford, and key-value flash Lightstore at MIT, along with two storage proposals: heterogeneous disk arrays and hierarchical RAID, which are relevant to cloud computing.

Edition details

• Publisher: Morgan Kaufmann
• Publication date: 2021
• Language: English
• ISBN 10: 0323907962
• ISBN 13: 9780323907965
• Binding: Paperback
• Edition number: 1
• Number of pages: 746