Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Relational Data Query Optimization Method Based on Data Schema Transformation and Parallel Framework

A data model and relational data technology, applied in relational databases, database models, electrical digital data processing, etc., to achieve the effect of improving query efficiency

Active Publication Date: 2020-03-31
NORTHEASTERN UNIV LIAONING +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is currently a lack of an effective method to accurately convert the data in the relational database to the SPARK parallel query processing framework for the characteristics of the query to improve the execution efficiency of various complex query processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Relational Data Query Optimization Method Based on Data Schema Transformation and Parallel Framework
  • Relational Data Query Optimization Method Based on Data Schema Transformation and Parallel Framework
  • Relational Data Query Optimization Method Based on Data Schema Transformation and Parallel Framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0042] The software and hardware environment of the present embodiment is: server cluster, and wherein single server host hardware is 2Ghz processor, memory 4G, software is LINUX operating system REDHAT LINUX, HDFS, HBase and Apache SPARK frame are installed.

[0043] In this embodiment, the following articles are provided to review the relational database schema:

[0044] Expert table: E (expert number, expert name, certificate number, professional title, affiliation), where "expert number" is the primary key, and the attribute "professional title" is a foreign key pointing to TCODE, as shown in Table 1;

[0045] Table 1 Expert Table E Data Table

[0046] Expe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a relational data query optimization method based on data mode conversion and parallel framework, and relates to the technical field of computer databases. This method constructs a new data storage structure by structurally analyzing complex query statements on relational model data, realizes conversion processing on data storage, and transfers the data stored in the relational model database to a new data model storage system. Convert corresponding query statements according to changes in data patterns, generate SPARK tasks based on SPARK SQL queries and execute the tasks. The relational data query optimization method provided by the present invention can accurately convert the data in the relational database according to the query characteristics to the SPARK parallel query processing framework, thereby effectively improving the processing efficiency of some frequently executed complex queries on the relational database.

Description

technical field [0001] The invention relates to the technical field of computer databases, in particular to a relational data query optimization method based on data mode conversion and parallel framework. Background technique [0002] As the scale of data in various applications continues to increase, this leads to an increase in the response time for large-scale data query operations on centralized relational databases, which affects the real-time requirements of application systems for query processing. How to improve massive The performance of query processing on data has become an important requirement in the field of database applications; for the storage and access of massive data, existing data management systems use distributed storage and parallel query processing to improve the performance of query processing; the centralized relational database By decomposing the query above, the part that requires parallel processing will be reasonably transferred to the paralle...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2453G06F16/28
CPCG06F16/24532G06F16/284
Inventor 聂铁铮申德荣寇月于戈高晶房俊杨冬菊
Owner NORTHEASTERN UNIV LIAONING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com