Multithread concurrent data compression method based on FT processor platform

A data compression, multi-threading technology, applied in the direction of concurrent instruction execution, machine execution device, etc., to achieve the effect of high data compression efficiency, good concurrency, and improved speed

Inactive Publication Date: 2014-08-13
NAT UNIV OF DEFENSE TECH
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There is no published literature in the existing research on the method of using multi-threa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multithread concurrent data compression method based on FT processor platform
  • Multithread concurrent data compression method based on FT processor platform
  • Multithread concurrent data compression method based on FT processor platform

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0018] Such as figure 1 As shown, the implementation steps of the multithreaded concurrent data compression method based on the Feiteng processor platform in this embodiment are as follows:

[0019] 1) Get the compression parameters passed in when the upper application calls multi-threaded concurrent data compression. The compression parameters include the start address of the buffer where the data to be compressed is located and the length of the data to be compressed; initialization is used to store the divided compressed data information of each compression thread The compression queue, a write queue used to store the compression result data of each compression thread, and a write thread used to splice the compression result data of the write queue at the same time;

[0020] 2) Determine the number of compression threads, the start address of each buffer that divides the compressed data and the size of the compressed data according to the start address of the buffer where the dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multithread concurrent data compression method based on an FT processor platform. The implementation steps include that compression parameters are obtained, a compression queue and a write queue are initialized, and a write thread is enabled; each portion of segmented compression data information is determined according to the compression parameters and is stored in the compression queue; compression threads are created according to the determined number of compression threads, each compression thread reads the corresponding segmented compression data according to the received segmented compression data information and carries out compression meta operation, and the compression result data is stored in the write queue; the write thread continuously reads the write queue and writes the compression result data into a result buffer for splicing, meanwhile the compression result data in the write queue already written into the result buffer is released, and finally, the data result after compression is obtained in the result buffer. The multithread concurrent data compression method based on the FT processor makes full use of the multi-core and multithread features of the FT processor and has the advantages of good data compression concurrency, high data compression speed, high data compression efficiency and good compatibility.

Description

technical field [0001] The invention relates to the technical field of data concurrent compression of computer systems, in particular to a multi-thread concurrent data compression method based on a Feiteng processor platform. Background technique [0002] With the development of computer technology and information technology, data has become a particularly important and rapidly growing resource in all walks of life. According to a report by the data research company IDC, the total amount of global data in 2011 has reached 1.8ZB (trillion GB), and it is estimated that by 2020, the data stored in global electronic devices will surge to 40ZB. The increasing amount of data has brought huge challenges to the data storage and transmission speed, especially the compression speed of large-scale data takes up a lot of cpu time. In order to meet the storage and transmission needs of various users, data compression technology is particularly important and is widely used in network tra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/38
Inventor 吴庆波史佩昌单晋奎高珑夏若冰魏彦斌刘云黄雪娇
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products