Multi-data-source joint query method based on global data dictionary

A technology of data dictionary and joint query, applied in other database query, other database index, other database retrieval, etc., can solve the problems of poor data analysis effect and slow query speed, and achieve good data analysis effect, fast management, and query fast effect

Pending Publication Date: 2022-04-12
ZHEJIANG LISHI TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the above-mentioned shortcomings in the prior art, the present invention provides a joint query method of multiple data sources based on the global data dictionary, which solves the problem of heterogeneity between the same data, requiring data sources to be converted before use , a query language that can only correspond to its own query method; and because data of different dimensions are scattered in different data tables, the query speed is slow and the data analysis effect is not good

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-data-source joint query method based on global data dictionary
  • Multi-data-source joint query method based on global data dictionary
  • Multi-data-source joint query method based on global data dictionary

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] The joint query method of multiple data sources based on the global data dictionary in this embodiment, such as figure 1 shown, including the following steps:

[0038] S1: Correspond to different types of databases in advance, and use the driver corresponding to the database in the driver layer to connect to the data source;

[0039] S2: The data layer performs initial data integration and cleaning, and extracts the data dictionary in the data layer;

[0040] S3: According to the data dictionary extracted from the S2 data layer, as a layer higher than the data layer, the data dictionary manages and controls the data tables in different data sources in a unified manner;

[0041] S4: The application layer adds corresponding indexes to the data tables of different data sources by controlling the data dictionary;

[0042] S5: In the application layer, the required data is queried through the data dictionary, and a joint query is performed according to the associated field...

Embodiment 2

[0046] like Figure 2 to Figure 5 As shown, the dynamic addition of different data sources and corresponding driver configurations in the driver layer makes the data source expand horizontally. The driver layer contains drivers corresponding to different data sources, and the drivers are used for communication between the data layer and the database. communication work.

[0047] The database in this embodiment is used to organize, store and manage data warehouses according to the data structure, and is a collection of organized, shareable, and unified management of a large amount of data stored in the computer for a long time. The database includes but is not limited to types of MySQL, Oracle database, Sybase and foshub.

[0048] The data source of this embodiment is the source of database data, which is used to provide the required data device or original media for the joint query of various data sources, and the connection information established by the database is stored in ...

Embodiment 3

[0053] like Figure 2 to Figure 5 As shown, the index is used to sort the values ​​of one or more columns added to the data table of different data sources, and the index is added to the data table of different data sources through the application layer control data dictionary, and the application layer performs parameter query based on the associated field , and multiple data sources are jointly queried based on associated fields, and the query is combined into one data source.

[0054] The data source used by the metadata database in the database area of ​​this embodiment is stored in the form of a file, and the connection string is saved, and when the connection string is extracted and used, the application layer visually adds and deletes the data source data in the database. Then implement the purpose of data source management.

[0055] The attributes of the data tables and columns in the data dictionary in this embodiment are used to provide services for modifying the st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data joint query, in particular to a multi-data-source joint query method based on a global data dictionary, which comprises the following steps of: pre-corresponding to different types of databases, connecting data sources by using drivers corresponding to the databases in a driver layer, and performing primary data integration and cleaning on a data layer; the method comprises the following steps of: selecting a data layer, extracting a data dictionary in the data layer, taking the data dictionary extracted from the data layer as a layer higher than the data layer, uniformly managing and controlling data tables in different data sources by the data dictionary, and adding corresponding indexes to the data tables of the different data sources by an application layer by controlling the data dictionary; according to the data source joint query method based on the data dictionary, global data can be integrally managed, the problems of database conversion and query waiting are avoided, and various different data sources are conveniently and quickly managed through a unified application layer, so that the query speed is high, and the data analysis effect is good.

Description

technical field [0001] The invention relates to the technical field of data joint query, in particular to a method for joint query of multiple data sources based on a global data dictionary. Background technique [0002] A data dictionary is a collection of descriptions of data objects or items in a data model for the benefit of programmers and others who need to refer to them. The first step in analyzing a system of objects exchanged by users is to identify each object and its relationship to other objects. This process is called data modeling and results in an object-relational diagram. After each data object and item has been given a descriptive name, its relationship is described (or becomes part of a structure that potentially describes the relationship), and then the type of data (such as text or image, or a binary value), lists all possible predefined values, and provides a simple textual description. This collection is organized for reference in the form of a book...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/903G06F16/901
Inventor 林彬彬陈海江
Owner ZHEJIANG LISHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products