Single-instance storage

Single-instance storage (SIS) is a system's ability to keep one copy of content that multiple users or computers share. It is a means to eliminate data duplication and to increase efficiency. SIS is frequently implemented in file systems, e-mail server software, data backup and other storage-related computer software.

Concept

In the case of an e-mail server, single-instance storage would mean that a single copy of a message is held within its database whilst individual mailboxes access the content through a reference pointer. However, there is a common misconception that the primary benefit of single instance storage in mail servers is a reduction in disk space requirements. The truth is that its primary benefit is to greatly enhance delivery efficiency of messages sent to large distribution lists. In a mail server scenario disk space savings from single instance storage are transient and drop off very quickly over time.

When used in conjunction with backup software, single instance storage can reduce the quantity of archive media required since it avoids storing duplicate copies of the same file. Often identical files are installed on multiple computers, for example operating system files. With single instance storage, only one copy of a file is written to the backup media therefore reducing space. This becomes more important when the storage is offsite and on cloud storage such as Amazon S3. In such cases, it has been reported that deduplication can help reduce the costs of storage, costs of bandwidth and backup windows by up to 10:1.[1]

Novell GroupWise was built on single-instance storage which accounts for its large capacity.

ISO CD/DVD image files can be optimized to use SIS to reduce the size of a CD/DVD compilation (if there are enough duplicated files) to make it fit into smaller media.

SIS is related to system wide file duplication search and multiple file instance detection tools such as the P2P application BearShare (5.n Versions and below) but differs in that SIS reduces storage utilization automatically and creates and retains symbolic linkages, whereas Bearshare allows for manual deletion of duplicates and associated user level file system, Windows Explorer type of icon links.

Microsoft

In the United States, Microsoft has a patent related to single instance storage.[2]

SIS was introduced with the Remote Installation Services feature of Windows 2000 Server. A typical server might hold ten or more unique installation configurations (perhaps with different device drivers or software suites) but perhaps only 20% of the data may be unique between configurations.[3] Microsoft states that "SIS works by searching a hard disk volume to identify duplicate files. When SIS finds identical files, it saves one copy of the file to a central repository, called the SIS Common Store, and replaces other copies with pointers to the stored versions."[4] Files are compared solely by their hash functions; files with different names or dates can be consolidated so long as the data itself is identical.[3] Windows Server 2003 Standard Edition has SIS capabilities but is limited to OEM OS system installs.

The file-based Windows Imaging Format introduced in Windows Vista also supported single-instance storage. Single-instance storage was a feature of Microsoft Exchange Server since version 4.0 and is also present in Microsoft's Windows Home Server. It is deduplicating attachments only in Exchange 2007 and was dropped completely in Microsoft Exchange Server 2010.[5] It is protected by several patent applications, including United States Patent numbers 6389433 and 6477544.

Microsoft announced Windows Storage Server 2008 (WSS2008)[6] with Single Instance Storage on June 1, 2009, and states this feature is not available on Windows Server 2008.[6]

See also

References

  1. ↑ Deduplication + Amazon S3 will save you time and money. White Paper: Published June 2008
  2. ↑ United States Patent 5,813,008; Benson, et al., September 22, 1998 at US Pat. Ofc.
  3. 1 2 "Single Instance Storage in Windows 2000" (PDF). Microsoft Research and Balder Technology Group. August 2000.
  4. ↑ Single Instance Storage in Microsoft Windows Storage Server 2003 R2: Technical White Paper: Published May 2006
  5. ↑ The Exchange Team Blog, Microsoft Corp.
  6. 1 2 Windows Storage Server 2008 at Microsoft
This article is issued from Wikipedia - version of the 11/11/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.