Application sensitive big data de-duplication storage system and method

An application-aware and deduplication technology, which is applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as poor scalability, large system network workload, and low throughput of deduplication nodes.

Active Publication Date: 2016-11-02
PLA UNIV OF SCI & TECH
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The main technical problem to be solved by the present invention is to provide an application-aware big data deduplication storage system and method, which solves the problem that the prior art does not

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Application sensitive big data de-duplication storage system and method
  • Application sensitive big data de-duplication storage system and method
  • Application sensitive big data de-duplication storage system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to facilitate the understanding of the present invention, the present invention will be described in more detail below in conjunction with the accompanying drawings and specific embodiments. Preferred embodiments of the invention are shown in the accompanying drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described in this specification. On the contrary, these embodiments are provided to make the understanding of the disclosure of the present invention more thorough and comprehensive.

[0048] It should be noted that, unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by those skilled in the technical field of the present invention. Terms used in the description of the present invention are only for the purpose of describing specific embodiments, and are not used to limit the present invention. The term "...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an application sensitive big data de-duplication storage system and method. The system comprises clients interconnected on the basis of a computer network, a management server and de-duplication nodes. The clients and the management server determine a de-duplication node list for application file storage through an application sensitive routing method, and the clients and the de-duplication nodes determine target de-duplication nodes from the de-duplication node list through a similar sensitive routing method. The system also comprises super blocks used for storing application files. The application files are stored and managed through the system, so that the application files same in type can be stored in the same de-duplication nodes, the load capacity of network communication can be effectively reduced, the improvement on the de-duplication rate and the improvement on the storage throughput rate of each de-duplication node are also facilitated, and the network expandability is enhanced.

Description

technical field [0001] The invention relates to the field of computer data storage management, in particular to a large data deduplication storage system and method based on application perception in a cloud computing environment. Background technique [0002] In the digital world, data volume and complexity are exploding. International Data Corporation IDC (International Data Corporation) research shows: In the past five years, the annual growth of data has increased by 9 times to 7ZB, and in the next ten years, it will increase by 44 times to 35ZB. The amount of digital information in an enterprise can easily rise to PB level or even EB level. Due to the continuous growth of data volume in the era of big data, management has become more and more complex, and data management costs and data loss risks have increased. With the continuous expansion of the storage system, it not only needs to consume more data storage space, energy consumption and cooling costs of the data ce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/1748G06F16/182
Inventor 付印金谢钧陈卫卫缪嘉嘉赵洪华端义锋
Owner PLA UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products