Huge amount of data compacting storage method and implementation apparatus therefor

A mass data and data value technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problem of system not being optimized, and achieve the effect of saving storage space and reducing the amount of data

Inactive Publication Date: 2007-02-07
北京人大金仓信息技术股份有限公司 +2
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these above-mentioned systems do not have the characteristics of optimizing according to the semantic characteristics of the data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Huge amount of data compacting storage method and implementation apparatus therefor
  • Huge amount of data compacting storage method and implementation apparatus therefor
  • Huge amount of data compacting storage method and implementation apparatus therefor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The specific implementation manner of the present invention will be described below in conjunction with the accompanying drawings. Aiming at the problems and deficiencies of the above-mentioned existing storage methods, the present invention proposes a data compression storage method that can improve query efficiency and reduce storage space based on a database system using the MVCC concurrency protocol. The data compression storage method includes:

[0034] Such as figure 1 As shown, it is the KingbaseES6 database execution engine 101, which executes the database cleaning command, and uses the data semantic analysis module to analyze, which includes: the step of selecting a storage strategy, by detecting the type of CPU, selecting a storage strategy that matches the CPU type Carry out data storage; when the storage strategy is determined, perform the following steps:

[0035] The step of compressing redundant data in the page is to save a record with complete informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The related compression storage method for great much data comprises: detecting CPU type to select matched storage strategy; saving one piece of record with integral information in website as the reference for other records; noting the reference record difference by increment means; removing the last-version data in history to realize the dynamic conversion for history and active data; according to frequency of data value, recoding data to calculate without decoding. This invention can improve query efficiency with less storage space.

Description

technical field [0001] The present invention relates to data storage technology, in particular to a storage technology for massive data in a database management system (DBMS) using a multi-version concurrency control protocol (MVCC), specifically a method for compressing and storing massive data and an execution device . Background technique [0002] The database storage subsystem is an important part of the database system. It is responsible for storing data on the storage medium and providing data access to the query processing subsystem. The storage method refers to the storage format of data on permanent media (such as disks, tapes) and the storage method on volatile media (such as ordinary memory). [0003] Common storage methods are as follows: [0004] 1. Conservative storage strategy: This is the traditional storage method [1]. Because some CPUs require the data in the memory to be stored aligned according to the data type, this method takes this part of the CPU i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王珊杜小勇任永杰周庆庆冯玉
Owner 北京人大金仓信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products