Cross-heterogeneous data source real-time connection method and apparatus

A technology of heterogeneous data sources and connecting devices, applied in the computer field, can solve the problems of not supporting heterogeneous data sources, not supporting concurrent queries, etc.

Inactive Publication Date: 2018-11-02
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In addition, although the above two data connection methods support cross-database connections, neither supports heterogeneous data sources, nor does it support concurrent queries

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-heterogeneous data source real-time connection method and apparatus
  • Cross-heterogeneous data source real-time connection method and apparatus
  • Cross-heterogeneous data source real-time connection method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0056] The present invention will be specifically described below in conjunction with a specific embodiment, but it should be noted that this specific embodiment is only for better describing the present invention, and does not constitute an improper limitation of the present invention.

[0057] First, establish a unified virtual view that integrates different data sources, and this virtual view is used to uniformly receive various query requests from users. It is worth mentioning that since the system uses a special data storage structure as a unified virtual view, the data source adapter is used to convert the data of various data sources into a unified virtual view data, thereby providing a unified query syntax externally.

[0058] Then, according to the user's query request for data, the user's query request is analyzed by using the data field source information of the virtual view, so as to construct the query request for each data source.

[0059] Send corresponding quer...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cross-heterogeneous data source real-time connection method and apparatus. Before a query request of a user is received, a unified virtual view is established. When the queryrequest of the user is received, the method is implemented by the following steps of receiving a first query request of the user for the virtual view; analyzing the first query request, and constructing a second query request for each data source according to the analyzed first query request; sending the second query request to each data source, and acquiring a query result associated with each data source in a preset query mode; and generating a data table corresponding to each data source according to the acquired query result associated with each data source, splicing data tables in a preset splicing mode, and adding spliced data to the virtual view. Through the method and the apparatus, the difference between underlying databases can be completely shielded when the user analyzes and processes the data.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for real-time connection across heterogeneous data sources. Background technique [0002] The rapid development of the information age has brought us convenience, but we must face another problem at the same time: how will we analyze and process data from different data sources, for example, some of the data sources are relational databases, and some are key-value kv type database (Key-Value database), some are text files, and some are from certain services. For data from different data sources, due to the different storage structures, it is difficult for data processors to splice the data from these different data sources. However, making these information transparent to the user makes the user not aware of the existence of the heterogeneous database, thereby simplifying the user's use method. It has become a critical issue faced by various storage system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 李铭浩王鹏飞沈俊杰
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products