Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing system and method

A data processing system and data management technology, which is applied in the computer field, can solve problems such as lack of reasonable storage and inability to effectively improve the processing efficiency of data query operations, data modification operations, etc., and achieve the effect of improving processing efficiency

Active Publication Date: 2022-04-08
ALIBABA GRP HLDG LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Compared with the storage method of single-point database, the distributed storage method of the existing technology disperses the pressure of massive data storage to a certain extent, but this storage method does not perform reasonable storage according to the characteristics of the data itself, thus also Cannot effectively improve the processing efficiency of subsequent data query operations and data modification operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system and method
  • Data processing system and method
  • Data processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] figure 1 A schematic structural diagram of an embodiment of the data processing system provided by the present invention. Such as figure 1 As shown, the data processing system in the embodiment of the present invention may specifically include: a data management server 11 , a first database 12 and a second database 13 .

[0022] The data management server 11 is connected to the first database 12 and the second database 13 respectively, and is used for dumping data satisfying preset dumping conditions from the first database 12 to the second database 13 . Among them, the first database 12 is easy to modify data (ie, the modifiability is higher than that of the second database), and the second database 13 is easy to query data (ie, the query is easier than the first database).

[0023] Further, the first database 12 may specifically be a relational database, and the second database 13 may specifically be a non-relational database, such as an open structured database (Op...

Embodiment 2

[0084] Figure 6 A schematic flowchart of an embodiment of the data processing method provided by the present invention. Such as Figure 6 Shown, the data processing method of the embodiment of the present invention can be by figure 1 The data processing system shown can be realized, which may specifically include:

[0085] S600. Detect data in the first database, and determine data satisfying a preset dumping condition.

[0086] S601. Dump data satisfying a preset dumping condition from the first database to the second database. Wherein, the first database is easier to modify data (ie, the modifiability is higher than that of the second database), and the second database is easier to query data (ie, the query is easier than the first database).

[0087] Further, the first database may specifically be a relational database, and the second database may specifically be a non-relational database.

[0088] Further, the preset dumping condition includes that the probability th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing system and method. The data processing system includes: a data management server, a first database, and a second database, and the data management server is respectively connected to the first database and the second database, and is used to transfer data satisfying preset dump conditions from the The first database is dumped into the second database; the data modifiability of the first database is higher than that of the second database, and the queryability of the second database is higher than that of the first database. The data processing system and method provided by the present invention realize reasonable shunt storage of data through hybrid storage, and improve the processing efficiency of subsequent data query and data modification.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing system and method. Background technique [0002] With the advent of the era of big data, it is often necessary to store massive amounts of data, and to perform subsequent operations such as query and modification on the stored data. [0003] In the existing technology, the distributed storage method of multiple databases is adopted for massive data. This distributed storage method generally uses the same type of database, and the database to which the data is stored is completely based on the storage of each database. The amount of data is allocated. [0004] Compared with the storage method of single-point database, the distributed storage method of the existing technology disperses the pressure of massive data storage to a certain extent, but this storage method does not perform reasonable storage according to the characteristics of the data itself,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/28G06F16/22G06F16/2458G06F16/242
CPCG06F16/22G06F16/2433G06F16/2471G06F16/27G06F16/284
Inventor 穆文忠
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products