Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing system, method and device

A data processing system and data table technology, applied in the database field, can solve the problems of low OLTP and OLAP business processing efficiency, big data storage costs, etc., to reduce data storage costs, avoid resource competition, and improve business processing efficiency.

Pending Publication Date: 2019-07-16
SHENZHEN TENCENT COMP SYST CO LTD
View PDF9 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the current database architecture, a single database system generally only has OLTP or OLAP capabilities. When it is necessary to perform OLTP and OLAP processing on a piece of data at the same time, the data needs to be copied from the operational database (that is, the database that performs OLTP processing) , conversion, and loading to the data warehouse (that is, the database that performs OLAP processing) a series of complex processes, which have a large data storage cost, and due to the need for cross-database operations, the business processing efficiency of OLTP and OLAP is also low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system, method and device
  • Data processing system, method and device
  • Data processing system, method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] In order to make the purpose, technical solutions and advantages of the application clearer, the technical solutions in the embodiments of the application will be clearly and completely described below in conjunction with the drawings in the embodiments of the application. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. In the case of no conflict, the embodiments and the features in the embodiments of the present invention can be combined arbitrarily with each other. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0078] The terms "first" and "second" in th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing system, method and equipment, and belongs to the technical field of databases. The data processing system comprises a main node and a standby node which are independent of each other, the main node is configured to be used for processing the OLTP service, and the standby node is configured to be used for processing the OLAP service. The main node obtains target data according to the to-be-processed data which is in a row storage format and is subjected to OLTP processing, sends the obtained target data to a standby node; the standby node stores the received target data in a column storage format; carrying out OLAP (On-Line Analytical Processing) on the data; therefore, two different types of services, namely the OLTP and the OLAP, can be concurrently processed in a single database cluster; compared with the prior art, the data storage cost is reduced, the service processing efficiency is improved, the OLTP service and the OLAP service are executed through the two mutually independent database nodes respectively, resource competition can be avoided in a resource isolation mode, and the service processing efficiency is further improved.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a data processing system, method and equipment. Background technique [0002] Based on the storage format of data records, in a relational database system, row storage or column storage can be used to store data records. Row storage generally exhibits good performance in online transaction processing (On line Transaction Processing, OLTP) transactions, while column storage performs well in online analytical processing (On line Analytic Processing, OLAP) queries, because it requires only Read the data of those columns needed to process the query, which can greatly reduce the disk input / output port (Input / Output, I / O) operations. [0003] In the current database architecture, a single database system generally only has OLTP or OLAP capabilities. When it is necessary to perform OLTP and OLAP processing on a piece of data at the same time, the data needs to be copied from the oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/27
CPCG06F16/2282G06F16/27
Inventor 李跃森
Owner SHENZHEN TENCENT COMP SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products