Mass data real-time sorting and inquiring method and system

Abstract

The present invention discloses a mass data real-time sorting and inquiring method and system. The method comprises: a sorting step of partitioning users into n+1 levels from 0-n according to experience values, storing all id numbers at each level by using a linked list, respectively storing user data into each node of the linked lists, and establishing experience value inked lists, wherein an insertion sequence of the users at a current experience value level is also stored in the corresponding experience value linked list, and each experience value linked list uses a head pointer and a tail pointer which respectively point at a first node and a last node; and an inquiring step of firstly, accumulating a total people number at each experience value level from the beginning of the maximum experience value, i.e. the n+1 level, then carrying out traversal inquiring in the experience value linked lists to which the users correspondingly belong so as to find rankings of the users in the users with the same experience values, and carrying out accumulation to obtain a total ranking in the system. According to the mass data real-time sorting and inquiring method and system which are disclosed by the present invention, functions of microsecond-level inquiry, addition, deletion, real-time sorting and the like can be provided for mass data at the level of hundred millions of users.

Description

technical field [0001] The present invention relates to the technical field of computer data processing, in particular to a method capable of providing microsecond-level query, addition, deletion, real-time sorting and other functions for massive data at the level of hundreds of millions of users, and can provide hundreds of thousands to several A method and system for real-time sorting and querying of massive data of millions of access requests. Background technique [0002] In many software systems, there are application scenarios like this: sorting a set of data with the same attribute value, displaying the top N-bit data, displaying the current data ranking, etc. For example, BBS forum, each forum registered user will have an experience value attribute, the user can see the ranking among all users, and the top few users with the highest experience value in the current forum. Another example is the number of clicks to read articles published on the website, and you can s...

AI Technical Summary

Problems solved by technology

[0004] When the number of users exceeds a certain level, such as millions, tens of millions or even hundreds of millions of users, traditional solutions cannot work normally

The main performance is that when the amount of data in a single table of the database exceeds the order of millions, even if various optimization measures are adopted, the performance is difficult to meet the system requirements

Under the premise of tens of millions of data, the performance of database addition, deletion, modification and query is relatively low, and a single database can only provide thousands of visits per second, which cannot meet massive concurrent requests

Images