Method for processing compression program parallelization based on computer clusters

A technology of computer clustering and compressing programs, applied in the direction of inter-program communication, multi-programming device, etc., can solve the problems that the algorithm does not have universality, generality, and frame structure, etc.

Inactive Publication Date: 2009-10-14
BEIJING UNION UNIVERSITY
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the disadvantage of this method is that its algorithms for specific problems are not universal, and there is no genera

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for processing compression program parallelization based on computer clusters
  • Method for processing compression program parallelization based on computer clusters
  • Method for processing compression program parallelization based on computer clusters

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0016] The present invention will be described in detail below with reference to the drawings and embodiments.

[0017] The present invention is used to deal with the parallelization problem of the serial compression algorithm in the compression process in the computer cluster environment, but since the solution idea of ​​the compression problem is similar to the decompression problem, the method of the present invention can also be applied to the decompression process. In the compression process, the present invention implements a general high-level compression parallel processing method based on the original serial compression software. Without modifying the original serial compression algorithm, by dividing the massive data into multiple fixed-length data blocks, and then distributing them to the computing nodes of the computer cluster, and finally using the original serial compression algorithm Data compression or decompression processing is performed on data blocks at the sam...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for processing compression program parallelization based on computer clusters. The method is characterized by comprising a provider-processor-producer frame, wherein the provider-processor-producer frame comprises a provider process, a processor process and a producer process; the provider process divides data to be processed into a plurality of fixed-length data blocks to be sent and then sends the data blocks to be sent to the processor process; idle processer process is gradually stopped after the data blocks to be sent are completely sent out; the processor process requests data blocks to be sent from the provider process and sends processed data blocks to a user process; after receiving the processed data blocks sent by the processor process, the user process outputs the processed data blocks sequentially; the processor comprises a plurality of serial compression algorithms and executes the serial compression algorithms in parallelization manner; and when the data blocks to be sent and the processed data blocks are transferred among the provider process, the processor process and the user process, unique data block serial numbers are respectively attached to the data blocks to be sent and the processed data blocks.

Description

technical field [0001] The invention relates to a computer parallel processing method, in particular to a computer cluster-based compression program parallel processing method. Background technique [0002] Today's computer technology has entered the era of parallelization and high data volume. The use of fast compression algorithms is very important for processing massive data. However, it is very time-consuming to use traditional compression software to process massive data. At the same time, a new compression algorithm is developed. It is quite difficult, so it is of great practical significance to parallelize the development of traditional compression software. At present, some people have rewritten the original serial compression algorithm in parallel, but because the rewritten core compression algorithm is very complicated, the process of completely parallelizing the original serial compression algorithm is very slow, and none of them is more general method to solve t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/46G06F9/54
Inventor 梁军陈炜钊鲍泓张迪刘振恒
Owner BEIJING UNION UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap