Flash memory cache including for use with persistent key-value store

a flash memory and key-value technology, applied in the direction of memory address formation, micro-instruction address formation, instruments, etc., can solve the problems of flash devices being subject to reduced lifetimes, flash media is expensive, and costs ten to twenty times more per gigaby

Inactive Publication Date: 2011-11-10
MICROSOFT TECH LICENSING LLC
View PDF2 Cites 276 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, flash media is expensive, at present costing ten to twenty times more per gigabyte than hard disk storage.
Further, flash devices are subject to reduced lifetimes due to page wearing, whereby small random writes (that also have relatively high latency) are not desirable.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Flash memory cache including for use with persistent key-value store
  • Flash memory cache including for use with persistent key-value store
  • Flash memory cache including for use with persistent key-value store

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016]Various aspects of the technology described herein are generally directed towards using flash media as a cache between RAM and hard disk storage. In general, various data structures and mechanisms (e.g., algorithms) suitable for a given application allow data items such as key-value pairs to be efficiently looked up and / or inserted while stored on RAM or flash memory, in a manner that substantially reduces or avoids unnecessary hard disk access. One example implementation described herein maintains key-value pairs and provides efficient key lookup and insert operations, including based upon predetermined tradeoffs between performance and cost. Another example implementation provides an efficient and cost effective system for facilitating data deduplication operations.

[0017]It should be understood that any of the examples herein are non-limiting. Indeed, the technology described herein applies to any type of non-volatile storage that is faster than disk access, not only the fla...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Described is using flash memory, RAM-based data structures and mechanisms to provide a flash store for caching data items (e.g., key-value pairs) in flash pages. A RAM-based index maps data items to flash pages, and a RAM-based write buffer maintains data items to be written to the flash store, e.g., when a full page can be written. A recycle mechanism makes used pages in the flash store available by destaging a data item to a hard disk or reinserting it into the write buffer, based on its access pattern. The flash store may be used in a data deduplication system, in which the data items comprise chunk-identifier, metadata pairs, in which each chunk-identifier corresponds to a hash of a chunk of data that indicates. The RAM and flash are accessed with the chunk-identifier (e.g., as a key) to determine whether a chunk is a new chunk or a duplicate.

Description

BACKGROUND[0001]Flash media has advantages over RAM and hard disk storage, namely that unlike RAM, flash media is persistent, and unlike hard disk, flash media provides much faster data access times, e.g., on the order of hundreds or thousands of times faster than hard disk access. Many applications thus may benefit from the use of flash media.[0002]However, flash media is expensive, at present costing ten to twenty times more per gigabyte than hard disk storage. Further, flash devices are subject to reduced lifetimes due to page wearing, whereby small random writes (that also have relatively high latency) are not desirable. What is needed is a technology for using flash media that provides high performance, while factoring in cost considerations, efficiency and flash media lifetimes.SUMMARY[0003]This Summary is provided to introduce a selection of representative concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(United States)
IPC IPC(8): G06F12/02G06F12/10G06F12/00
CPCG06F12/0866G06F12/0897G11C7/1072G06F2212/222G06F12/0246G06F12/123
Inventor SENGUPTA, SUDIPTADEBNATH, BIPLOB KUMARLI, JIN
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products