Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device

A database and metadata technology, applied in the database field, can solve the problems of consuming network resources and taking a long time in the backup process, and achieve the effect of reducing consumption, solving the problem of reading data performance, and improving the efficiency of backup

Inactive Publication Date: 2017-08-29
HUAWEI TECH CO LTD
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a method and device for data processing, which can solve the problems in the prior art that the backup process takes a long time and consumes a large amount of network resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0085] The method provided by the embodiment of the present invention is applied to a database, and the database may be a distributed database.

[0086] The database contains at least one data table (Table), which is used to store user data. For example, use a data table named user information to store user basic information, and use a data table named transaction information to store user information. Transaction details. In the database, the key-value (Key-Value) type storage method can be used to store data, that is, the data that the user needs to store is stored in the Value part, and the Key corresponding to the Value is constructed. When the user needs to find the Value, it can be found through the Key index. The corresponding Value, where the data storage is naturally sorted according to the dictionary order of the Key. Each data table can contain a large amount of data. To facilitate management and maintenance, each data table is divided into regions (Regions) accord...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data processing method and device. The data processing method is applied to a database system. The database system comprises a data table; the data table comprises at least one area. The data processing method comprises steps of storing data in an area satisfying a pre-defined condition as a data storage file in a storage device; the data storage file comprises time metadata; the metadata is area write-in data of data in the area satisfying the pre-defined condition, obtaining a last time of executing a backup operation when a combined operation triggering condition is satisfied, choosing at least two first data storage files, wherein the area write-in tie which is recoreded by time metadata which is contained by at least two first data storage files is before the time when the last backup operation is executed and combining at least two first data storage files which are chosen in order to solve a problem that a current combination method in the prior cause time consuming in a backup process.

Description

technical field [0001] The invention relates to the field of databases, in particular to a data processing method and device. Background technique [0002] With the maturity of traditional database technology, the rapid development of computer network technology and the expansion of application range, database systems are more and more widely used. [0003] In the prior art, the data is first written into the memory corresponding to a certain area in the data table, and when a certain area meets certain conditions, the data in the area will be saved to the storage device to form a data storage file, such as one Hfile, as data is continuously written into the database, there will be a large number of data storage files in the storage device. In order to improve the performance of reading data, all data storage files of the same data table will be merged into one data storage file. However, in a backup scenario, especially in an incremental backup scenario, such a merge oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F17/30
CPCG06F16/21G06F16/27G06F11/1448G06F11/1451G06F2201/80G06F11/14G06F16/00G06F16/258
Inventor 房浩毕杰山钟超强
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products