Intelligent storage unit data clipping process

A storage unit data and storage unit technology, applied in the computer field, can solve problems affecting transmission and processing efficiency, slow data retrieval and reading speed, etc., and achieve the effects of reducing network transmission overhead, improving effective reading rate, and reducing retrieval queries

Active Publication Date: 2013-12-18
成都虚谷伟业科技有限公司
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to invent a method that can solve the problems of slow data retrieval and reading speed in the database, and useless data affecting transmission and processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent storage unit data clipping process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings, but the content protected by the present invention is not limited to the following description.

[0036] In a database cluster, resources are distributed on different nodes. When making a query plan, the target data is distributed to different nodes, and the data request of the same node is packaged and sent to improve transmission efficiency. Conditional filter expressions, as well as column mapping relationships, filter useful columns, eliminate useless columns, select required row data according to conditions, eliminate row data that does not meet the conditions, and transfer data to working nodes for processing.

[0037] In the plan, the conditional filter expression is decomposed into a remote transferable part and a non-remote transferable part, and the non-remote transferable part is only selected when the working node is aggregated. The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent storage unit data clipping process, aiming to solve problems of high transmission quantity of data between nodes, high quantity of garbage in an intermediate result set to be processed and low effective-utilization rate of network resources in the process of cross-node query of a distributed database cluster. In a database cluster system, users request to perform analyzing query to read data by the manner of reading a small quantity of data clipped from the intelligent storage unit of nodes rather than the manner of selecting after reading all data, and therefore, reading of garbage is reduced and effective reading efficiency is improved. As data are selected and clipped in terms of line and row of the data result set by a special means of the intelligent storage unit data clipping process, data size to be processed is reduced greatly, network expenses and storage and computing cost are saved, and efficiency is improved.

Description

technical field [0001] The invention is used for data analysis and retrieval in a distributed database cluster, and belongs to the technical field of computers. Background technique [0002] The general mainstream method of database data retrieval is to load all the data from the disk to the memory first, and then select the useful part according to the constraints. This method is limited to the read performance of the disk, which will become the bottleneck of the entire retrieval process, especially the larger the amount of data. The more obvious it is. [0003] In response to this situation, the current general improvement methods are: [0004] Column store database, data is stored by column, only read relevant columns into memory, greatly reduce disk operations, and improve performance significantly, but there are complex and difficult data maintenance, and the shortcomings of different database underlying organization schemes need to be designed for different applicatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 况忠强马正红
Owner 成都虚谷伟业科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap