Multi-source heterogeneous data association query method and system
A data association and data query technology, applied in other database query, other database retrieval, other database index, etc., can solve the problems of high bandwidth and storage resource consumption, low query efficiency, complexity, etc., to reduce the amount of disk scanning, save Overhead, the effect of optimizing query efficiency
Active Publication Date: 2020-02-25
CHINA UNITECHS
View PDF8 Cites 13 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0006] The embodiment of the present invention provides a multi-source heterogeneous data association query method and system, which solves the problem of data migration and unified cleaning in advance in the prior art. Complexity, high consumption of bandwidth and storage resources, and low query efficiency due to the separation of data storage and computing
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0026] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0027] In the embodiment of the present invention, based on the differences in the correlation calculation methods among multi-source heterogeneous data in the prior art, the present invention provides a multi-source heterogeneous data correlation query system, such as figure 1 As shown, including: multiple heterogeneous data sources, intermediate indexing devices, and interface devices;
[0028] The interface device is used for: connecting with ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a multi-source heterogeneous data association query method and system. The system comprises a plurality of heterogeneous data sources, an intermediate index device and an interface device; the interface device is used for being connected with the plurality of heterogeneous data sources and splitting the received data query request; the intermediate indexing device is used for establishing index information for information to be associated in a plurality of heterogeneous data sources, analyzing the split data query request, and determining a data query processing mode; the intermediate index device and the plurality of heterogeneous data sources complete data query operation according to a data query processing mode; the data query processing mode comprises the stepsof performing data query screening on a plurality of heterogeneous data sources, returning a screening result to the intermediate index device for association and combination, or writing index information into the heterogeneous data sources, screening the index information, performing data query according to the screened index information, and returning a query result to the plurality of heterogeneous data sources. The scheme can improve the data query efficiency.
Description
technical field [0001] The invention relates to the technical field of heterogeneous data association, in particular to a multi-source heterogeneous data association query method and system. Background technique [0002] Nowadays, with the diversification of data storage solutions and storage models, in different business scenarios, different data storage structures are usually selected, such as RDB, ES, HBASE, HIVE, REDIS, etc. In data analysis, AI application, data middle platform and other occasions, it is required to bring together multi-source heterogeneous data for correlation calculation and analysis. However, because the storage structure, access interface, and query logic of heterogeneous data sources are different, the data of these data sources cannot be directly related to each other, and even they do not support data association, which has caused great difficulty in computing work. [0003] There are currently two common technical solutions: [0004] One is to...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/901G06F16/903
CPCG06F16/901G06F16/90335
Inventor 毛恒
Owner CHINA UNITECHS