Cooperative storage cloud

A cooperative storage cloud is a decentralized model of networked online storage where data is stored on multiple computers (nodes), hosted by the participants cooperating in the cloud. For the cooperative scheme to be viable, the total storage contributed in aggregate must be at least equal to the amount of storage needed by end users. However, some nodes may contribute less storage and some may contribute more. There may be reward models to compensate the nodes contributing more.

Unlike a traditional storage cloud, a cooperative does not directly employ dedicated servers for the actual storage of the data, thereby eliminating the need for a significant dedicated hardware investment. Each node in the cooperative runs specialized software which communicates with a centralized control and orchestration server, thereby allowing the node to both consume and contribute storage space to the cloud. The centralized control and orchestration server requires several orders of magnitude less resources (storage, computing power, and bandwidth) to operate, relative to the overall capacity of the cooperative.

Data security

Files hosted in the cloud are fragmented and encrypted before leaving the local machine. They are then distributed randomly using a load balancing and geo-distribution algorithm to other nodes in the cooperative. Users can add an additional layer of security and reduce storage space by compressing and encrypting files before they are copied to the cloud.

Data redundancy

In order to maintain data integrity and high availability across a relatively unreliable set of computers over a wide area network like the Internet, the source node will add some level of redundancy to each data block.[1] This allows the system to recreate the entire block even if some nodes are temporarily unavailable (due to loss of network connectivity, the machine being powered off or a hardware failure). The most storage and bandwidth efficient forms of redundancy use erasure coding techniques like Reed-Solomon. A simple, less CPU intensive but more expensive form of redundancy is duplicate copies.

Flexible contribution

Due to bandwidth or hardware constraints some nodes may not be able to contribute as much space as they consume in the cloud. On the other hand, nodes with large storage space and limited or no bandwidth constraints may contribute more than they consume, thereby the cooperative can always stay in balance.

Examples

The University of California's OceanStore project, MIT's Chord, is a non-commercial example.[1]

Sia is a fully distributed system using a blockchain where a cryptocurrency is exchanged for storage, and a daemon that can act both as a file host and as a "renter" of storage, using Merkle trees to provide strong guarantees that hosts will only get paid if they successfully hold data for the duration of a "storage contract".[2] Data is encrypted and spread among hosts in a redundant manner, using erasure coding, to maximize availability.[3] According to one of its creators, Sia was the first platform of its kind to launch an end-user product.[4]

On June 1, 2016[5] Minebox GMBH[6] announced that their forthcoming Minebox Networked Attached Storage device (NAS) will utilize the Sia network to persist its backups. Users of the Minebox will also be able to rent their free disk space via Sia.

Storj is another example: based on the Bitcoin blockchain technology and a peer-to-peer architecture, it intends to provide cloud storage to people. It is currently developing two applications to achieve this goal: MetaDisk,[7] which lets the user upload files to the network, and DriveShare, allowing users to rent out their storage space to MetaDisk users.[8]

A partly centralized system is operated by Symform, Inc., a startup company based in Seattle.[1][9] Symform generates and keeps the keys used to encrypt and decrypt, and since it also decides which server will host which parts of a file, users have to trust Symform not to share those with any other party or misuse the information.[10] Symform is discontinuing its service on Jul 31, 2016.

See also

References

  1. 1 2 3 Mearian, Lucas (2009-09-21). "Start-up unveils cloud storage co-op". Computerworld. Retrieved 2010-10-14.
  2. ↑ Young, Joseph. "Sia Launches Decentralized Blockchain-based Storage Platform Similar to Filecoin and Storj". Bitcoin Magazine. Retrieved 2016-02-29.
  3. ↑ Vorick, David; Champine, Luke. "Sia: Simple Decentralized Storage" (PDF).
  4. ↑ Evander, Smart. "Sia Launches Bitcoin Cloud Storage With Own Blockchain". CCN: Financial Bitcoin & Cryptocurrency News. Retrieved 2016-02-27.
  5. ↑ http://us12.campaign-archive1.com/?u=28542349724534dc599e8f3e0&id=a6ab62aecb
  6. ↑ https://minebox.io
  7. ↑ http://metadisk.org
  8. ↑ Wilkinson, Shawn. "Storj: Decentralized Cloud Storage".
  9. ↑ Huang, Gregory T (2009-02-19). "Symform, Founded by Ex-Microsoft Pair, Offers Cheap, Efficient Data Storage in the Cloud". Xconomy. Retrieved 2010-10-14.
  10. ↑ "Symform Security Analysis". VirtualServerGuy. December 19, 2012.

External links

This article is issued from Wikipedia - version of the 10/14/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.