A data sorting method, system, co-processing device and main processing device

Abstract

The embodiment of the invention relates to the field of big data, and discloses a data sorting method, a system, a co-processing device and a main processing device. The sorting method of the data inthe invention comprises the following steps: receiving a sorting request sent by a main processing device and first key value data, wherein the first key value data is all key value elements containedin the first key value pair data to be sorted; Constructing second numerical data corresponding to the first key value data according to the first key value data; Composing the first key value data and the corresponding second numerical value data into the second key value pair data; Sorting the data by the second key value according to the sorting request; The sorted second key-value pair data is returned to the main processing device. The data sorting method of the invention improves the speed of data exchange between the co-processing device and the main processing device, and acceleratesthe speed of sorting the data sent by the main processing device by the co-processing device.

Description

technical field [0001] The embodiments of the present invention relate to the field of big data, in particular to a data sorting method, system, co-processing device and main processing device. Background technique [0002] With the emergence of distributed system infrastructure (such as: Hadoop, referred to as "Hadoop") technology, big data technology is widely used. Big data is to distribute computing resources and data resources to different computing devices for computing, and to use the multi-threading technology of processors and the computing power of clusters composed of multiple hosts to achieve powerful computing and storage functions. The sorting algorithm is a commonly used algorithm in big data technology and occupies an important position in big data technology. [0003] Today's big data technology is widely used, and the demand for speed continues to increase. In addition to the continuous improvement of CPU chip performance in accordance with Moore's Law, co...

AI Technical Summary

Problems solved by technology

The main processing chip transmits data to the co-processing chip, and the co-processing chip sorts and processes the data, so as to realize the acceleration of data processing by the co-processing chip on the main processing chip. The inventor finds that at least the following problems exist in the prior art: The data exchange speed between the processing chip and the co-processing chip is very slow. At the same time, the co-processing chip sorts the data sent by the main processing chip is also very time-consuming, which completely loses the significance of the co-processing chip helping the main processing chip to process data.

Images