Pelican: a building block for exascale cold data storage

• DOI: 10.5555/2685048.2685076
• Publication Date: 2014-10-06
• Authors: Shobana Balakrishnan; Richard Black; Austin Donnelly; P. England; Adam Glass; Dave Harper; Sergey Legtchenko; Aaron Ogus; Eric Peterson; Antony Rowstron
• Keywords: Provisioning; Pelican

A significant fraction of data stored in cloud storage is rarely accessed. This referred to as cold data; cost-effective for has become a challenge providers. Pelican rack-scale hard-disk based unit designed the basic building block exabyte scale data. In Pelican, server, power, cooling and interconnect bandwidth resources are provisioned by design support workloads; this right-provisioning significantly reduces Pelican's total cost ownership compared traditional disk-based storage.Resource means only 8% drives can be concurrently spinning. introduces complex resource management handled stack. Resource restrictions expressed constraints over hard drives. The layout IO scheduling ensures that these not violated. We evaluate performance prototype compare against overprovisioned rack using cross-validated simulator. show performs well workloads, providing high throughput with acceptable latency.