Data area overlapped boundary data zero communication parallel computing method and system

A boundary data and parallel computing technology, applied in the field of data processing, can solve problems such as reducing the efficiency of parallel processing, and achieve the effect of saving waiting time and improving efficiency

Inactive Publication Date: 2012-03-28
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI +1
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In traditional parallel processing, multiple adjacent data blocks need to communicate with each other. Due to the communication between adjacent data blocks, when the required data has not arrived, it will cause the parallel process to wait and reduce the efficiency of parallel processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data area overlapped boundary data zero communication parallel computing method and system
  • Data area overlapped boundary data zero communication parallel computing method and system
  • Data area overlapped boundary data zero communication parallel computing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] Such as figure 1 As shown, it is a flow chart of an embodiment of a boundary data zero-communication parallel computing method with overlapping data regions. The zero-communication parallel computing method for boundary data with overlapping data areas includes the following steps:

[0021] S100: Divide the parent data to be processed into multiple sub-block data. A plurality of sub-block data into which the parent data is divided redundantly stores boundary data among adjacent sub-block data. Among them, the parent data is the data that requires a long processing time for a single processing in the data parallel processing, and the sub-block data is the data that is relatively simple for a single processing and therefore takes a short time. Boundary data refers to data that needs to be used in parallel processing for adjacent sub-block data.

[0022] The sub-block data obtained by cutting the parent data should take almost the same time to be processed by the parall...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data area overlapped boundary data zero communication parallel computing method, which comprises the following steps of: partitioning mother data to be processed into a plurality of sub blocks of data, wherein each sub block of data stores boundary data of the adjacent sub block of data in a redundant way; and carrying out parallel processing to the sub blocks of data. The invention also discloses a data area overlapped boundary data zero communication parallel computing system, which comprises a data partitioning module which is used for carrying out redundant partitioning to the mother data, and a parallel processing unit which is used for carrying out parallel processing to the sub blocks of data, and also comprises a data partitioning module which is used for carrying out non-redundant partitioning to the mother data, a data exchange module which is used for exchanging the boundary data of the adjacent sub blocks of data and carrying out redundant storage to the boundary data, and a parallel processing unit which is used for carrying out parallel processing to the sub blocks of data. According to the method and the system, disclosed by the invention, the waiting time during the data transmission can be saved, and the efficiency of the parallel processing can be improved.

Description

【Technical field】 [0001] The invention relates to a large amount of data processing, in particular to a zero-communication parallel computing method and system for boundary data with overlapping data areas. 【Background technique】 [0002] When processing a large amount of data, the data can be divided into multiple smaller data blocks, which are processed in parallel by multiple processing units at the same time, and then the processed results are aggregated, which can greatly improve the efficiency of data processing. [0003] In traditional parallel processing, multiple adjacent data blocks need to communicate with each other. Due to the communication between adjacent data blocks, when the required data has not arrived, it will cause the parallel process to wait and reduce the efficiency of parallel processing. 【Content of invention】 [0004] Based on this, it is necessary to provide a data parallel processing method capable of improving parallel processing efficiency. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L12/56
Inventor 朱定局李朝晖
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap