A heterogeneous data source visual query method

A technology of heterogeneous data sources and query methods, applied in structured data retrieval, electronic digital data processing, database management systems, etc., can solve problems such as query overflow and query time-consuming, and achieve the effect of improving usability

Active Publication Date: 2019-05-28
JIANGSU DAWN INFORMATION TECH CO LTD
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When there is a large data set, it may be due to the limitation of node resources, which may lead to query overflow and query time-consuming

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A heterogeneous data source visual query method
  • A heterogeneous data source visual query method
  • A heterogeneous data source visual query method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be further explained below in conjunction with the accompanying drawings and specific embodiments.

[0025] A method for visual querying of heterogeneous data sources, comprising:

[0026] Step 1. Create a visual interface in the foreground. The user selects the query range on the foreground visual interface. The query range includes one or more data sources; determine whether the selected data source has been loaded into the presto cluster; if the selected data source is not loaded into presto Cluster, add the data source to be loaded in the presto cluster;

[0027] Add the data source to be loaded in the presto cluster, including the following steps:

[0028] (1) Register the data source to be loaded;

[0029] For different types of data sources, the registration steps are different. For the data source of structured data, input the data source information, including IP address, port number, user name and password, and test the connectivi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous data source visual query method. A user selects a query range on a foreground visual interface; whether the selected data source is loaded into a presto clusteror not is judged; if the selected data source is not loaded to the presto cluster, a to-be-loaded data source is added in the presto cluster; a query statement is sent to the presto cluster, and query is completed within the selected query range; detecting whether a plug-in required by a to-be-loaded data source is a built-in data source plug-in in a preload cluster, and if so, dynamically loading a configuration file in a calog folder by the preload cluster; And if not, creating the plug-in of the to-be-loaded data source, putting the plug-in into a Preto cluster, loading the configuration file in the calog folder, and completing the loading of the data source. According to the method, different data source basic information is configured, operation of a graphical interface is adopted, adata source is dynamically loaded, and query of a presto-based heterogeneous data source is achieved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a visual query method for heterogeneous data sources. Background technique [0002] In the era of big data explosion, there are many forms of data storage, mainly structured data, semi-structured data and unstructured data. Different data are stored in different data sources, and most structured data are stored in relational data sources, the mainstream of which are domestic databases such as mysql, oracle, sqlserver, Dameng and Jincang data sources; historical data or cleaned The converted data is stored in the data sources of big data platforms such as hive or MPP data sources based on the share nothing architecture; semi-structured data, such as streaming data, are mainly stored in Kafka, and a large number of regular log files are stored in the file server. Semi-structured key-value data stored in the memory database redis. The data in different data sources needs to be i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/245
Inventor 王海荣肖万来刘娟朱文洲徐云龙
Owner JIANGSU DAWN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap