Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method, data processing device and data processing system

A data block and processor technology, applied in the computer field, can solve the problem that the compression schemes cannot effectively cooperate with each other, and achieve the effect of improving the hit rate, realizing cooperative work, and improving the cache hit rate.

Inactive Publication Date: 2012-07-25
HUAWEI TECH CO LTD
View PDF6 Cites 61 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of the fact that the current various compression schemes cannot effectively cooperate with each other and the additional overhead caused by hot data compression, the embodiment of the present invention combines compression technology and caching technology to provide a data storage method based on data compression to improve storage performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, data processing device and data processing system
  • Data processing method, data processing device and data processing system
  • Data processing method, data processing device and data processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0028] please participate figure 1 , is a schematic structural diagram of a computing node provided by an embodiment of the present invention. like figure 1 As shown, the computing node includes:

[0029] A hardware layer 10, an operating system 20 running on the hardware layer, and an application layer 30 running on the operating system, the hardware layer 10 further includes a processor 11, a storage controller 12, a first storage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention provides a data processing method, a data processing device and a data processing system. The data processing method includes: acquiring data writing requests comprising to-be-written data blocks containing heat attribute and compression attribute, writing the data blocks into corresponding target storage areas according to the heat attribute and the compression attribute, wherein the heat attribute includes a hot spot, a warm spot or a cold spot, the compression attribute includes a compressible attribute or non-compressible attribute. Accordingly, reading hit rate of data in cache or hot spot data disk is increased by utilizing data compression technology.

Description

technical field [0001] The present invention relates to the field of computers, and in particular, to a data processing method, device and system. Background technique [0002] How to solve the IO bottleneck is the hottest topic in the server field. The explosion of information data has doubled the storage capacity, but the growth of storage and IO technology cannot keep up with the growth of information data volume, resulting in an increasingly serious IO burden. Compression technology utilizes excess processor computing power to reduce data storage capacity and IO transmission bandwidth; caching technology (SSD cache, Page Cache) places hot data in faster storage modules to reduce IO bottlenecks. [0003] Operating system manufacturers provide data compression functions for file systems and memory; storage manufacturers provide storage compression functions; database manufacturers provide database compression functions; each manufacturer strives to be transparent in their...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F12/06G06F3/06
Inventor 章晓峰
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com