A database processing method and system

A processing method and processing system technology, applied in the direction of database update, structured data retrieval, etc., can solve problems such as database paralysis, affecting system operation, long storage time, etc., to avoid hot issues, improve query efficiency, and avoid data loss. Effect

Active Publication Date: 2019-03-26
SUNING COM CO LTD
View PDF11 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, no matter which method is used above, the business data is collected and stored directly in the traditional relational database. For massive data, it takes a long time to enter the database, and the pressure on the IO and CPU of the database is very high. And there is a risk of locking the table
Especially in the production environment, the method of directly updating a large amount of data to the database is likely to cause the database to be paralyzed, thus affecting the operation of other applications in the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A database processing method and system
  • A database processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Some, but not all, embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0040] At present, the business system needs to receive and store hundreds of millions of massive business data every day. The storage and update of the above data has brought huge pressure to the business system. In severe cases, it will cause the database to lock tables and cause the entire business system to be paralyzed. For this reason, the present invention propo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a database processing method and a system. The method comprises the following steps: S1, cleaning the new service data issued by the processing, and processing the new servicedata by semicolon section; S2, processing the new service data by semicolon section. S2, selecting new service data under one or more number segments, comparing the service data in the cached databasewith the selected new service data, and judging whether there is data inconsistent with the service data in the cached database in the selected new service data according to whether the data under the main change field is consistent; S3, if there is inconsistent data, marking the inconsistent data, and storing the inconsistent data in the cache database and the database. The invention adjusts theoverall structure and design of the service system, and realizes the pre-filtering of the service data through the comparison with the cached database when the database is updated, thereby alleviating the pressure of the massive data directly into the warehouse.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a database processing method and system. Background technique [0002] With the development of computer communication technology, the amount of data in the business system is getting larger and larger, and the problem of massive data backup for the business system is becoming more and more prominent, especially the database operation of backing up data to the production environment is a more difficult task. The problem. There are three types of database backup operations in the prior art: full backup, incremental backup, and differential backup. The so-called full backup refers to a complete copy of all data or applications at a certain point in time. Full backup is conducive to the rapid recovery of data, but since full backup will store a large amount of data in the database, there may be duplication data, so the backup time is longer. Incremental backup means that after a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23
Inventor 吴金迎叶国华司孝波钱津津杭军
Owner SUNING COM CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products