Multi-dimensional index structure under cloud environment, construction method thereof and similarity query method

Abstract

The invention discloses a multi-dimensional index structure under a cloud environment, a construction method thereof and a similarity query method. The index structure disclosed by the invention comprises a global index and local indexes which are respectively positioned at all storage nodes, the cloud environment uses an overlay network to organize the storage nodes, and the local indexes are of clustering results obtained by clustering approximate vectors of all vector data in the storage nodes where the local indexes are located; and the global index is of information of clustering centers of all the local indexes, which are distributed to the whole overlay network and addresses of the storage nodes where the clustering centers are located. The index structure disclosed by the invention has the advantages of reducing index storage space, reducing resource consumption, effectively supporting multi-dimensional data index and similarity query under the cloud environment, using the clustering information obtained by clustering all the approximate vectors as the local indexes and improving query efficiency by only performing query on corresponding categories through the information of the clustering centers without scanning all the approximate vectors during the query of the local indexes.

Description

technical field [0001] The invention relates to a multidimensional indexing method in a cloud computing environment, in particular to a multidimensional indexing method in a cloud environment supporting similarity query and a construction method thereof, belonging to the technical field of computer information retrieval. Background technique [0002] With the increasing popularity of the Internet and the rapid development of IT technology, Internet data is rapidly expanding, how to store and manage massive data has become a challenging problem that needs to be solved urgently. The concept of cloud computing came into being. Cloud computing has brought new service methods for users and enterprises. At present, some cloud computing systems have been successfully applied, such as: Amazon's Elastic Cloud (EC2), IBM's Blue Cloud and Google's cloud computing platform, etc. These cloud computing systems contain a large number of computer nodes, store massive amounts of data, and s...

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved by the present invention is to overcome the deficiency that the existing cloud environment index structure does not support efficient simila

Images