Stream data-oriented two-level sorting method

Abstract

The invention relates to the technical field of data sorting, and in particular to a stream data-oriented two-level sorting method. The method comprises the following steps: S101, building a data structure, wherein the data structure is of a two-level sorting structure and comprises a first-level sorting structure composed of an array and a second-level sorting structure composed of a plurality of arrays and the first-level sorting structure is the index of the second-level sorting structure; S102, searching in the first-level sorting structure, awaiting data arrival, searching the arriving data in the first-level sorting structure and positioning a certain array in the second-level sorting structure; and S103, sorting in the second-level sorting structure, inserting the arriving data in the searched array in the second-level sorting structure and returning to the step S102. By adopting the method, under the circumstance that the data size is unknowable, the continuously-arriving mass data can be rapidly sorted and the searching scale and sorting scale can be reduced by a large margin.

Description

technical field [0001] The invention relates to the technical field of data sorting, and Tebi is a secondary sorting method for streaming data. Background technique [0002] Sorting is an operation that is often performed in a computer, and its purpose is to adjust a set of "disordered" data into "ordered" data. Data sorting is not a new problem. There are already many classic sorting algorithms, but they are relatively general algorithms with more restrictions. For example, the overall situation of the data needs to be known in advance and all the data is loaded into memory before sorting can be started. . Streaming data is a large, fast, and continuously arriving data sequence, which can be regarded as a dynamic data collection that grows infinitely over time. [0003] Chinese invention patent CN103577559A discloses a data sorting method, which reads the data to be sorted into the memory in batches, and each time a piece of data is read, sorts the read data to obtain ord...

AI Technical Summary

Problems solved by technology

However, streaming data is very likely to be large-scale data, so a single data structure or algorithm cannot be applied; at the same time, because streaming data is a continuously arriving data sequence, the data scale is unknown in advance; therefore, the method of the above invention cannot be used for streaming data nice sort

Images