{"id":87929,"date":"2020-08-21T17:05:19","date_gmt":"2020-08-21T17:05:19","guid":{"rendered":"https:\/\/www.red-gate.com\/simple-talk\/?p=87929"},"modified":"2022-04-24T20:50:29","modified_gmt":"2022-04-24T20:50:29","slug":"storage-101-the-future-of-storage","status":"publish","type":"post","link":"https:\/\/www.red-gate.com\/simple-talk\/databases\/sql-server\/database-administration-sql-server\/storage-101-the-future-of-storage\/","title":{"rendered":"Storage 101: The Future of Storage"},"content":{"rendered":"

The series so far:<\/strong><\/p>\n

    \n
  1. Storage 101: Welcome to the Wonderful World of Storage<\/a><\/li>\n
  2. Storage 101: The Language of Storage<\/a><\/li>\n
  3. Storage 101: Understanding the Hard-Disk Drive<\/a>\u00a0<\/li>\n
  4. Storage 101:\u00a0Understanding the NAND Flash Solid State Drive<\/a><\/li>\n
  5. Storage 101: Data Center Storage Configurations<\/a><\/li>\n
  6. Storage 101: Modern Storage Technologies<\/a><\/li>\n
  7. Storage 101: Convergence and Composability<\/a>\u00a0<\/li>\n
  8. Storage 101: Cloud Storage<\/a><\/li>\n
  9. Storage 101: Data Security and Privacy<\/a>\u00a0<\/li>\n
  10. Storage 101: The Future of Storage<\/a><\/li>\n
  11. Storage 101: Monitoring storage metrics<\/a><\/li>\n
  12. Storage 101: RAID<\/a><\/li>\n<\/ol>\n\n

    An IDC report published in November 2018 predicted that the world\u2019s data would grow to 175 zettabytes by the year 2025. For those unaccustomed to such amounts, a zettabyte is about 1,000 exabytes, which comes to one billion terabytes or one trillion gigabytes. Given our current trajectory, we\u2019ll likely see those predictions come true. Even if we fall short, there will still be a heap load of data.<\/p>\n

    <\/a> Current storage technologies are going to have a tough time keeping up. They\u2019re already having a tough time keeping up. With the explosion of mobile devices, followed by the influx of the Internet of Things (IoT), more data than ever is being generated\u2014by people, by applications, by machines. The only way to derive meaning from all that data is to develop innovative high-performing, high capacity storage solutions.<\/p>\n

    \"A<\/p>\n

    Figure 1. Data\u2019s exponential growth (image by geralt<\/a>)<\/p>\n

    Scientists are pioneering storage solutions that can support our data loads into the future. To this end, they\u2019re searching for ways to improve NAND flash and storage class memory, while experimenting with new storage technologies. In this article\u2014the last in my series on storage\u2014I provide an overview of many of these efforts to give you a sense of what we might expect in the near and, with any luck, not-too-distant future.<\/p>\n

    What\u2019s up with NAND flash?<\/h2>\n

    <\/a> NAND flash adoption has significant data center market share, offering substantially better performance and durability than what hard-disk drives (HDDs) are physically capable of ever achieving. As NAND\u2019s popularity has increased, along with its densities, prices have steadily dropped, making it a more viable storage option than ever.<\/p>\n

    Yet even with these improvements, they\u2019re not enough to meet the demands of many of today\u2019s data volumes and workloads, which is why vendors are working hard to make solid-state drives (SSDs) that can deliver better performance and greater densities while minimizing the cost-per-GB.<\/p>\n

    <\/a> The primary strategy for doing so is adding more bits per cell, more layers per chip, or a combination of both. Flash SSDs have gone from one bit per cell to two bits and then three. Now we have quad-level cell (QLC) SSDs, which squeeze four bits into each cell. Initially, QLC flash primarily targeted PCs, but that\u2019s starting to change, with some vendors now offering QLC storage for the data center.<\/p>\n

    <\/a> More bits per cell increases the need for error correction, slowing program\/erase (P\/E) cycles. The additional bits also decrease endurance as cells become more labile. Until significant advances are made in P\/E processes such as garbage collection, enterprise QLC flash will be limited to read-intensive workloads. In the meantime, vendors are pushing ahead with more bits per cell, even developing penta-level cell (PLC) SSDs that boast five bits per cell.<\/p>\n

    At some point, adding more bits per cell will no longer be practical, which is why vendors are also adding more layers to their NAND chips, a technology referred to as 3D NAND. In this type of chip, memory cells are stacked into vertical layers to increase capacity. The first 3D NAND chips had 32 layers. Many vendors now offer SSDs with 96 layers.<\/p>\n

    <\/a> In addition, several vendors are ramping up production on 128-layer SSDs, with 256-layer devices on the horizon. Devices featuring 500 and even 800 layers or more are forecast. But additional layers mean thinner materials, amplifying manufacturing challenges and costs. The cost-per-GB is unlikely to decline as quickly as it has been without novel technological advances.<\/p>\n

    Who\u2019s invading the flash space?<\/h2>\n

    While vendors continue to enhance their NAND flash offerings, some are also investing in technologies that could eventually replace flash or be used in conjunction with flash to create a hybrid solution. One of these is Intel\u2019s Optane DC SSD, which is based on the 3D XPoint architecture, a storage-class memory (SCM) technology <\/a>developed by Intel in partnership with Micron.<\/p>\n

    The Optane DC SSD provides greater throughput and lower latency than a traditional flash SSD, including Intel\u2019s own line of enterprise flash storage. IBM is now working on its second generation of the Optane DC SSD, offering hints that it might nearly double the speed of its first-gen implementation.<\/p>\n

    \"A<\/p>\n

    Figure 2. Moving into flash territory (image by Fotocitizen<\/a>)<\/p>\n

    Not to be outdone, Samsung now offers its own alternative to traditional NAND flash\u2014the Z-SSD drive (or Z-NAND). Although the Z-SSD is based on NAND technologies, it offers a unique circuit design and controller that delivers much better performance. In fact, the Z-SSD is often described as an SCM device and is considered Samsung\u2019s answer to Intel\u2019s Optane DC SSD.<\/p>\n

    Micron has also released an SSD built on the XPoint architecture\u2014the X100 NVMe SSD. Both Micron and Samsung appear to be planning their next generation of flash alternatives. But they\u2019ve released few details about the devices or how they\u2019ll perform.<\/p>\n

    In the meantime, Kioxia (formerly Toshiba Memory) is working on its own NAND flash alternative, Twin BiCs FLASH, which the company describes as the \u201cworld\u2019s first three-dimensional (3D) semicircular split-gate flash memory cell structure.\u201d That\u2019s quite the mouthful and certainly sounds intriguing. However, the project is still in research and development and will likely not see the light of day for some time to come.<\/p>\n

    It\u2019s uncertain at this point what the future looks like for NAND flash alternatives such as those from Intel, Micron, Samsung, and Kioxia. Much will depend on how traditional NAND flash evolves and the affordability of these new devices over the long-term. With workload and data demands increasing, organizations will continue to look for whatever solutions can effectively balance performance and capacity against endurance and cost.<\/p>\n

    Where does storage class memory fit in?<\/h2>\n

    <\/a><\/a> In the last couple years, storage class memory (SCM) has inspired many headlines, especially with IBM\u2019s recent release of the first Optane DC persistent memory modules (PMMs).The modules plug into standard dual in-line memory module (DIMM) slots, allowing the PMMs to connect directly to the server\u2019s memory space. The Optane DC modules represent a big step forward toward the vision of a new storage tier that sits between traditional dynamic RAM (DRAM) and NAND flash storage to support demanding enterprise workloads.<\/p>\n

    <\/a> Intel\u2019s Optane DC modules are typically referred to as a type of phase-change memory (PCM)\u2014\u201ctypically\u201d because the company\u2019s messaging has been somewhat mixed around this issue and they are sometimes considered to be a type of resistive RAM. However, the consensus is that the Optane DC modules fit neatly into the PCM category.<\/p>\n

    Phase-change memory is a type of nonvolatile memory that stores data by rapidly changing a material between amorphous and crystalline states. Phase-change memory offers much faster performance and lower latency than NAND flash and has the potential of delivering greater endurance. On the other hand, PCM is also much more expensive.<\/p>\n

    But PCM is not the only SCM effort under development. Scientists are actively researching other technologies that they believe can also serve as a bridge between DRAM and flash storage. One of these is resistive RAM (RRAM or ReRAM), another type of nonvolatile memory that promises significantly greater performance than NAND flash, with speeds approaching those of DRAM.<\/p>\n

    Resistive RAM works by applying different voltage levels to a material in order to switch its resistance from one state to another. Compared to NAND flash, RRAM offers much better performance and higher endurance while consuming less power. In fact, the technology shows so much promise that it has been proposed as a possible replacement for both NAND flash and DRAM.<\/p>\n

    Another nonvolatile memory technology that shows promise is ferroelectric memory (FRAM or FeRAM), which is built on a ferroelectric capacitor architecture that incorporates a mechanism for controlling polarities. Ferroelectric memory offers high read and write speeds, low power consumption, and high endurance. But in its current form, it has a very low density and its processing costs are high.<\/p>\n

    Nanotube RAM (NRAM) is another nonvolatile memory technology that\u2019s being actively researched for its DRAM-like performance, low power consumption, and ability to withstand extreme environmental conditions. Nanotube RAM can also retain data far beyond NAND flash capabilities. A NRAM device is made up of tiny carbon nanotubes that are extremely strong and have conductive properties. The nanotubes sit between two electrodes through which voltage is applied to change the resistance, providing the structure for data storage.<\/p>\n

    Researchers are also focusing on Magnetic RAM (MRAM), which could potentially deliver speeds on par with static RAM (SRAM). Magnetic RAM\u2014also called magnetoresistive RAM\u2014is a nonvolatile memory technology that uses magnetic states to store data bits, rather than using electrical charges like other memory technologies.<\/p>\n

    Vendors are pursuing different strategies for implementing MRAM. One of the most promising is spin tunnel torque MRAM (STT-MRAM), which leverages the angular momentum in quantum mechanics to store data. The biggest challenge with MRAM, however, is its extremely low density.<\/p>\n

    All of these memory types\u2014along with others being investigated\u2014are in various stages of research and development. Although several vendors already offer products based on some of these technologies, today\u2019s research is what will drive them into the future and make it possible to create a memory-storage stack in which all memory is nonvolatile, profoundly changing the way we deliver applications and store data.<\/p>\n

    What does the future hold?<\/h2>\n

    The memory technologies I\u2019ve discussed so far are mostly works in progress, with vendors looking for ways to make them more practical and profitable beyond a handful of small niche use cases. But researchers are also looking further into the future, working on technologies that are still in their infancy or have been around for a while but are now being infused with new efforts.<\/p>\n

    One area of research that\u2019s caught the industry\u2019s imagination is silica glass, which can be used to store data much like the crystals that taught Superman about his Krypton roots<\/a>. This idea of silica glass got its boost in 2013 from researchers at the University of Southampton, <\/a>who demonstrated storing a 300 KB text file in fused glass.<\/p>\n

    The storage medium, referred to as 5D memory crystal, or 5D storage, relies on superfast femtosecond laser technology, like that used for refractive surgery. The laser etches microscopic nanogratings into the glass to provide the data bit structure. A special technique is then used to retrieve the data, taking advantage of the light\u2019s polarization and intensity.<\/p>\n

    According to the researchers, a 25-mm silica disk could store as much as 360 TB of data, sustain temperatures up to 190 degrees Celsius, and remain viable for over 13 billion years, making today\u2019s storage media seem like cardboard cutouts. In fact, 5D storage has already received a fair share of notoriety. A silica disk storing Isaac Asimov\u2019s Foundation<\/em> series now orbits the sun, sitting inside Elon Musk\u2019s cherry red Tesla Roadster, which itself sits onboard the Falcon Heavy SpaceX rocket.<\/p>\n

    Microsoft was so impressed with the 5D storage technology that it has launched its own initiative, dubbed Project Silica, whose stated goal is to develop the \u201cfirst-ever storage technology designed and built from the media up, for the cloud.\u201d Project Silica uses femtosecond lasers to write data into quartz glass, the same process used for 5D storage. As its first proof of concept, Microsoft teamed up with Warner Bros. to store and retrieve the entire 1978 Superman<\/em> movie on a piece of glass about the size of a drink coaster.<\/p>\n

    Another innovative approach to data storage is racetrack memory, which was first proposed by IBM researchers in 2008. Racetrack memory applies electrical current to nanowires to create domain walls with opposite magnetic regions between them (thus the racetrack concept). The domain walls and their regions provide a structure for efficiently storing data. IBM hopes that racetrack technology might eventually yield a nonvolatile, solid-state storage device that can hold 100 times more data than current technologies at a lower cost-per-GB.<\/p>\n

    <\/a> Other researchers are pursuing a different approach to racetrack memory, leveraging the inherent properties in skyrmions, which are microscopic swirls found in certain magnetic materials. Skyrmions work in conjunction with anti-skyrmions to create opposing magnetic swirls that can be used to create a three-dimensional structure for hosting digital data. Skyrmion-based storage requires very little current and has the potential for storing large quantities of data while delivering high-speed performance.<\/p>\n

    Scientists are also researching the potential of storing data at the molecular level. One of the most publicized approaches is DNA, in which data is encoded directly into the genetic material. Corporate, university, and government researchers are actively pursuing DNA\u2019s potential for persisting data. DNA can store massive amounts of information, is millions of times more efficient than anything we have today, requires almost no maintenance, and can endure for many millennia.<\/p>\n

    \"A<\/p>\n

    Figure 3. Betting on DNA storage (image by geralt<\/a>)<\/p>\n

    The challenge with DNA storage, however, is that it\u2019s error-prone and expensive to produce. To address these issues, scientist have been experimenting with multiple solutions. For example, researchers at the University of Texas at Austin have come up with error-correcting algorithms that help compensate for the high rate of errors. Using synthetic DNA, they have successfully stored the entire book The Wizard of Oz,<\/em> translated into Esperanto. But this is nothing compared to DNA\u2019s true potential. As many have claimed, DNA could make it possible to store the entire internet in a shoe box.<\/p>\n

    Despite the enthusiasm around DNA storage, researchers are also investigating different molecular storage techniques, using molecules that are smaller than DNA and other long-chain polymers. The big advantage here is that smaller molecules can be cheaper and easier to produce, and they have the potential for storing more data. If that\u2019s not small enough, scientists are also researching single-atom data storage, with each bit stored in an individual atom. So far, I\u2019ve come across no discussions about going smaller.<\/p>\n

    Where do we go from here?<\/h2>\n

    If technologies such as molecular storage and silica glass storage can be manufactured in a way that is both efficient and cheap, we\u2019ll be better prepared to handle all the data that\u2019s expected in the years to come. But we have a long way to go before we get there, and until then, we\u2019ll have to rely on the advancements being made with NAND flash and its alternatives, as well as with SCM. What we\u2019ll do with all that data once we figure out how to store is another matter altogether. In terms of storage, however, the sky is indeed the limit.<\/p>\n

     <\/p>\n","protected":false},"excerpt":{"rendered":"

    Robert Sheldon continues his series on storage by discussing the latest storage innovation and ideas. …<\/p>\n","protected":false},"author":221841,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[143527],"tags":[5433],"coauthors":[6779],"class_list":["post-87929","post","type-post","status-publish","format-standard","hentry","category-database-administration-sql-server","tag-disk-space-monitoring"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/87929","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/users\/221841"}],"replies":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/comments?post=87929"}],"version-history":[{"count":5,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/87929\/revisions"}],"predecessor-version":[{"id":88614,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/87929\/revisions\/88614"}],"wp:attachment":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/media?parent=87929"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/categories?post=87929"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/tags?post=87929"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/coauthors?post=87929"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}