Vector model-based massive spatiotemporal data retrieval method and system

Abstract

The invention discloses a vector model-based massive spatiotemporal data retrieval method and system. The method comprises the steps of performing vectorization processing on data of event space and problem space to obtain a spatiotemporal data vector; performing dimension reduction processing on the spatiotemporal data vector according to a target condition vector needed to be retrieved; performing vector operation on each dimension of the spatiotemporal data vector subjected to the dimension reduction processing and the target condition vector; and judging vector operation results, screening out the vector operation results meeting a preset condition, and obtaining corresponding retrieval results. The system comprises a spatiotemporal data vector representation module, a spatiotemporal data vector dimension reduction module, a spatiotemporal data vector operation module and a retrieval result judgment module. According to the method and the system, the to-be-queried data volume can be reduced, the calculation complexity is greatly lowered, and the retrieval efficiency is effectively improved. The method and the system can be widely applied to the field of retrieval.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and system for retrieving massive spatio-temporal data based on a vector model. Background technique [0002] In today's big data era, in the face of so much data, returning query results within a reasonable time to help decision-making has become an urgent problem to be solved. For example, when a police officer locates a criminal suspect during criminal investigation and solving a case, he or she can use massive data such as tourism, airlines, and railways to find out the suspected gang of the criminal suspect based on the possible potential relationship with the criminal suspect. member. In this scenario, the mining of potential relationships is mostly related to criminal suspects in time or space. The public security department has tens of billions of data, and the data formats involve tables, texts, etc. In such a massive Among various forms of data, disco...

AI Technical Summary

Problems solved by technology

However, if it is processed directly without adopting measures such as optimized cache, the effect will be better than that of traditional databases, but some data will be processed repeatedly. When the intermediate results are stored on the disk, the IO bottleneck caused by the long disk seek time will waste calculations. resources, reducing processing speed

Images