For most people, crypto is synonymous with Bitcoin. Those with some Bitcoin savvy know the technology relies on “proof of work” to validate transactions. Operations on the Bitcoin blockchain use “miners” to perform complex cryptographic “work,” which, in turn, requires significant CPU and GPU resources.
However, proof of work requires a great deal of energy. This draws criticism from environmentally minded skeptics. In addition to Bitcoin, other blockchains pursue different roles using different validation methods. Increasingly, “proof of space,” which validates operations with participants’ excess storage capacity, provides an approach that may be both greener—and rife with opportunity for organizations to derive revenue from their IT infrastructure.
Proofs of Space and Time
A slew of news stories recently reported on a spike in demand for both hard drives (HDDs) and solid state drives (SSDs), provoked by the cryptocurrency Chia; this is especially a reality in China.
The demands placed on storage, and the systems supporting it, depend on the blockchain. Today’s most popular storage crypto blockchains are Chia and Filecoin.
Started by Bram Cohen, the creator of BitTorrent, Chia Network set out to create a greener alternative to the Bitcoin blockchain, developing proof algorithms that rely on storage capacity rather than electricity consumption. Instead of “proof of work,” the blockchain depends on on “proof of space” and “proof of time.” Its requirements are affordable for small companies and even enthusiast consumers wanting to provide storage resources.
Storage-centric blockchains are seen as a more energy-efficient alternative to proof of work because they lack the power-hungry transactions. According to a United States Data Center Energy Report, storage typically only amounts to 11% of data centers’ power.
“Proof of Space is directly linear in the storage you allocate,” Chia’s COO Gene Hoffman told me. “Your 100 TB is just as likely to win as anyone else’s 100 TB. Now, the total [network space] is likely to scale up so that home farmers may not be able to win once a week or once a month on their own.” Chia is working on a solution to this problem. “We will be introducing an official pooling protocol that addresses the centralization risks while letting smaller farmers pool together and share all the rewards daily,” Hoffman said, adding he expected the rollout in early June.
Protocol Labs’ Filecoin uses “proof of space and time” for blockchain validation and similarly rewards miners in FIL currency. Unlike Chia’s “farmers,” Filecoin storage miners make their unused capacity available to the network, creating a vast “decentralized, efficient, and robust foundation for humanity’s information.” Clients strike “deals” with storage miners to store data and verify that data’s integrity over time. Factors such as latency, proximity, bandwidth, capacity, lock-up duration, and offered cost will affect miners’ ability to win deals. Given the enormous amount of capacity pledged to Filecoin, an enterprise like a medical center can archive a great deal of data, which frees up its local capacity for other, more critical use.
Upon receiving the data, a miner will write the file(s) into a sector, “seal” it, and deliver proofs to the blockchain. Uptime failures or malicious activity result in “slashing,” or penalties deducted from miners’ compensation. The more capacity a miner makes available to the network, the higher their chances of winning a block.
Protocol Labs’ other creation, the InterPlanetary File System (IPFS) protocol, has been adopted by many open-source projects. IPFS is considered part of the so-called Web 3.0 ecosystem, enabling decentralized application development. Filecoin incentivizes the use of IPFS, unlocking a vast amount of storage for open-source data.
“Over 10,000 developers have contributed to the IPFS & Filecoin projects,” Colin Evran, Ecosystem Lead for the Filecoin Project, told me. “And hundreds of applications operate using IPFS and Filecoin infrastructure.” The developers get to put “the zettabytes of latent storage capacity around the world to work” while the users get the “full control over their data, allowing them to make their own decisions on what happens to the data they store on the Filecoin network.”
Enterprise-Class Mining: Best Practices
Filecoin sealing is I/O-intensive, so Filecoin recommends at least “1TiB NVMe-based disk space for cache storage.” Once sealed, data moves to mass-capacity storage, which provides the most cost-efficient means for storing big data. (In hyperscale data centers, optimal TCO means HDDs make up 90% of the architecture while SSDs supply 10%.) Slashing penalties are steep.
The data storage company Seagate Technology, where I work, recommends some best practices for optimizing any storage. They apply here: Always design storage infrastructure that allows you to achieve desired performance and reliability. Emerging data center and distributed storage applications need to focus on total cost of ownership in order to scale globally. In the crypto world, it pays to use a combination of high-reliability, enterprise-class SSDs and mass-capacity hard drives. Given the importance of data protection and data durability, it is best to use a hardware RAID or erasure-coded solution featuring drive and even controller redundancy. This type of configuration would maximize uptime and data protection.
In general, crypto involves three main scenarios, with the following storage recommendations:
- First, for the transaction-intensive workloads such as data sealing, SSDs are a good bet that helps achieve application performance.
- Second, for capacity-intensive workloads, cost-efficient and space-maximizing hard drives are the way to go.
- Third, if a particular cryptocurrency penalizes lost capacity, choose protected hard drive storage, which should prevent that from happening.
When Stored Data Equals Value, Literally
Filecoin and others showcase how businesses can turn their idle infrastructure into ongoing revenue.
This is an emerging set of distributed storage opportunities that will coexist with distributed application development. We now have a working foundation, a universally available data backbone for distributed storage that didn’t exist a decade ago. CIOs can install the resources they’ll need someday, make money from it in the near term, and gracefully exit the market when it’s time to put that storage to work.
A host of considerations remain, starting with how businesses should balance storage infrastructure robustness, capacity investment, and crypto revenue. They might also reassess the value of their data, given that the data’s physical media can now produce income from both unused (as with Chia) and rented (Filecoin) space.
It’s been many years since long-term accumulation of local bulk storage—or HODLing, for those who prefer meme-rooted crypto slang—held such value potential. IT groups may find that blockchains radically transform TCO equations. On the consumption side, expect crypto storage to find a place in enterprise vertical strategies. Filecoin, Chia, and others may soon offer more enticing mass-capacity storage than today’s big, centralized providers.
However it happens, the staying power of blockchain and decentralization is an inevitable reality. It’s time to make room for it—on our drives, in our day-to-day transactions, and in realms yet to be discovered.
Written by Danny Fishler Seagate Lyve Lab Israel
