Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and system, electronic equipment and medium

A technology of data processing and data, applied in the computer field

Active Publication Date: 2019-11-29
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the key-value database used in the streaming system to ensure high-speed reading and writing of data is quite different from the relational database in terms of structure
By actively collecting logs, there will be at least a second-level delay in real-time replication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system, electronic equipment and medium
  • Data processing method and system, electronic equipment and medium
  • Data processing method and system, electronic equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood, however, that these descriptions are exemplary only, and are not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Also, in the following description, descriptions of well-known structures and techniques are omitted to avoid unnecessarily obscuring the concepts of the present disclosure.

[0059] The terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting of the present disclosure. The terms "comprising", "comprising", etc. used herein indicate the presence of stated features,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing method for a database, and the method comprises the steps: carrying out the analysis of received streaming increment real-time data transmitted by an upstreamsystem, so as to obtain first to-be-processed data which comprises a specified primary key field; obtaining first processed data from a memory database, the first processed data including a specifiedprimary key field; comparing the first to-be-processed data with the first processed data to determine whether first effective to-be-processed data exists or not; under the condition that it is determined that the first effective to-be-processed data exists, determining a first transaction operation based on the first effective to-be-processed data; and executing the first transaction operation toobtain a first updated memory database. The invention further provides a data processing system for the database, electronic equipment and a medium.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and more specifically, to a data processing method, system, electronic device and medium for a database. Background technique [0002] With the explosive growth of information in the Internet era and the rapid development of big data processing technology, a class of real-time data with "flow" characteristics, such as real-time transaction data, traffic data, weather data, stock prices, etc., has emerged, namely streaming data. , after processing it, it can generate more time-sensitive application value, and make an important contribution to the improvement of the competitiveness of enterprises in the face of today's highly competitive and rapidly changing market environment. [0003] Streaming real-time data processing is widely used in complex scenarios that require associated business data. Usually, business data comes from multiple channels and is stored in a relational database. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/21G06F16/22G06F16/23G06F16/28
CPCG06F16/219G06F16/22G06F16/23G06F16/284
Inventor 沈贇袁一王能刘雪晶
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products