Method and system for improving large data volume query performance

A technology with large data volume and high performance, applied in transmission systems, storage systems, structured data retrieval, etc., can solve the problems of large memory resources, occupation, and low performance of large data volume queries, so as to improve processing performance and reduce load , Improve the effect of query performance

Active Publication Date: 2014-06-11
SHENZHEN ZTE NETVIEW TECH
View PDF3 Cites 104 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In order to solve the problem in the prior art that the query performance of large amount of data is low, or needs to occupy a large amount of memory resources, the object of the present invention is to provide a method and system for improving the query performance of large amount of data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for improving large data volume query performance
  • Method and system for improving large data volume query performance
  • Method and system for improving large data volume query performance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The technical scheme of the present invention will be described in further detail below in conjunction with the accompanying drawings and specific examples, so that those skilled in the art can better understand the present invention and implement it, but the examples given are not intended to limit the present invention .

[0052] Based on the problems existing in the prior art, the inventor of the present invention considers combining the two technologies of distributed cache and memory database, and establishes a cache ID table in the memory database to store cache IDs and a small amount of key data (similar to filtering, sorting and Paginate the fields related to these query conditions), and build indexes as needed, and store a large amount of detailed information in the distributed cache. When querying data, first use the structured query (SQL) statement to filter out the required cache ID set in the memory database, and then obtain detailed data information from t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for improving the large data volume query performance and belongs to the technical field of large data volume query. The method comprises A, loading data in a disk database into distributed caches in a cache ID-entity data key value pair mode, and storing the cache ID and key information of the entity data in a cache ID table of a memory database simultaneously; B, querying the cache ID table according to a query request when the query request sent by a client is obtained to selecting an ID set meeting the query request; C, obtaining the entity data from corresponding distributed caches according to the cache ID set and returning the entity data to the client. By means o the system and the method, loads of the disk database can be effectively reduced, and the big data query performance is improved.

Description

technical field [0001] The present invention relates to the technical field of querying large amounts of data, in particular to a method and system for improving the performance of querying large amounts of data. Background technique [0002] In the context of the information age, people are exposed to more and more information, and query applications based on big data are becoming more and more extensive. The query efficiency of big data directly affects the system response time and user experience, so it is very important to study how to improve query performance. [0003] In the query of big data, the general practice is to store the big data in the form of a table in a relational database (disk database, such as Oracle, Sql Server, etc.), and use the structured query statement (SQL statement) supported by the database to execute the query. The data in this mode is stored on disk files. When requests are frequent, single queries are complex (associated with multiple tabl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F12/08H04L29/08G06F12/0802
CPCG06F16/24539G06F16/27
Inventor 姬迎东杨志彪
Owner SHENZHEN ZTE NETVIEW TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap