Joint query method and system for multi-source heterogeneous data

A multi-source heterogeneous data and joint query technology, applied in the field of heterogeneous data intelligent processing, can solve the problem that multi-source heterogeneous data cannot be completely homogeneous, and achieve the effect of improving semantics and user experience

Pending Publication Date: 2021-02-26
BEIJING MININGLAMP SOFTWARE SYST CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the technical problem that the above-mentioned multi-source heterogeneous data cannot be completely homogeneous, the present invention proposes a joint query method and system for multi-source heterogeneous data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Joint query method and system for multi-source heterogeneous data
  • Joint query method and system for multi-source heterogeneous data
  • Joint query method and system for multi-source heterogeneous data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] refer to figure 1 as shown, figure 1 It is a schematic diagram of the steps of a joint query method for multi-source heterogeneous data provided by the present invention. Such as figure 1 As shown, this embodiment discloses a specific implementation manner of a joint query method for multi-source heterogeneous data (hereinafter referred to as "method").

[0057] Specifically, the method disclosed in this embodiment mainly includes the following steps:

[0058] Step S1: Receive multi-source heterogeneous data.

[0059] Specifically, multi-source heterogeneity simply means that a whole is composed of multiple components from different sources, including mixed data (including structured and unstructured) and discrete data (data distributed in different system or platform), the Internet is a typical heterogeneous network, and the fusion communication matrix is ​​a typical multi-source heterogeneous data network. In the process of enterprise information construction, du...

Embodiment 2

[0079] In combination with the joint query method for multi-source heterogeneous data disclosed in Embodiment 1, this embodiment discloses a specific implementation example of a multi-source heterogeneous data joint query system (hereinafter referred to as "system").

[0080] refer to Figure 6 As shown, the system includes:

[0081] Input module 11: receiving multi-source heterogeneous data;

[0082] Mapping module 12: use mapper to map the multi-source heterogeneous data into homogeneous data and build an index;

[0083] Query module 13: perform query according to the index through the queryer.

[0084] Specifically, in the input module 11, multi-source heterogeneous data are received, including: mysql, elasticsearch and external data. Taking java as an example, data in mysql and elasticsearch are received through JDBC, and external data are received through HTTP.

[0085] Specifically, the mapping module 12 includes:

[0086] Configuration unit 121: configure a mapper t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a joint query method and system for multi-source heterogeneous data. The method comprises the steps of receiving the multi-source heterogeneous data; configuring a mapper tablefor each type of source data of the multi-source heterogeneous data; mapping the source data into a table structure through a mapper according to the mapper table; establishing the index for the dataof the table structure; and querying according to the index through a querier. According to the invention, a user can inquire the multi-source heterogeneous data more easily, the storage mode of bottom-layer data does not need to be paid attention to in the inquiring process, and the requirement of complex services for the multi-source data can be met only by accurately processing the mapping relation and the index of upper-layer data.

Description

technical field [0001] The invention relates to the technical field of intelligent processing of heterogeneous data, in particular to a joint query method and system for multi-source heterogeneous data. Background technique [0002] In the Internet era, enterprises attach great importance to data storage, use, and security, because many business developments are driven by data, and data is the core of enterprises. In the big data environment, enterprises are faced with various data structures: relational database, file data, No-SQL type, streaming data, inverted index; data sources are also abundant: an enterprise usually has Oracle, SQL server, MySQL and other relational databases; CSV, Parquet, Json files of different departments will be stored in different places. There are many technologies to choose from in terms of data storage. Common relational databases and non-relational databases have their own applicable scenarios, giving enterprises more choices in technology s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/901G06F16/903
CPCG06F16/901G06F16/90335
Inventor 周冬孔誉乾
Owner BEIJING MININGLAMP SOFTWARE SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap