Incremental message parsing method for MySQL based on binlog

A parsing method and message technology, applied in the field of data parsing of databases, can solve problems such as difficult maintenance and unfavorable system decoupling, and achieve the effect of convenient modification and maintenance, strong parsing ability, and easy subsequent maintenance.

Inactive Publication Date: 2018-07-06
深圳友门鹿网络科技有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The shortcomings of the current method of writing logs in the existing MySQL system are: 1), the trigger (trigger) contains a large number of business codes, which will become difficult to maintain in the future; 2), the database should not carry too many businesses, Now most of the business logic is integrated into the trigger (trigger); 3), tightly coupled with the business system, which is not conducive to system decoupling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental message parsing method for MySQL based on binlog
  • Incremental message parsing method for MySQL based on binlog

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The invention will be further described in detail below in conjunction with the drawings and embodiments of the invention.

[0028] see figure 1 , the traditional MySQL system message analysis method is: 1. Business functions write various business data to the corresponding database for data update 11; 2. Establish a trigger (trigger) 12 corresponding to the database in advance; 3. Write data In the trigger (trigger), the trigger (trigger) writes incremental data 13 into the result table; 4. The business system queries the result 14 through the service framework (dubbo) database.

[0029] Since the trigger (trigger) contains a large amount of business code, the follow-up maintenance cost is very high, and the database should not carry too many businesses, but now most of the business logic is integrated into the trigger (trigger), and the business system Tightly coupled together is not conducive to system decoupling.

[0030] The invention is a binlog-based MySQL incr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an incremental message parsing method for a MySQL based on binlog. The method comprises the steps that step (1), service is written into service data; step (2), the written service data is sent to a corresponding MySQL database; step (3), a database list needing to be monitored is set in the MySQL database; step (4), changed data can be written into the database; step (5),the data is parsed; step (6), incremental data is acquired; step (7), an incremental message is sent; step (8), the incremental message is sent into a message server-side; step (9), a service system subscribes a message of the message server-side; and step (10), the service consumes messages according to needs. By adopting the method, not only a data system can be modified and maintained conveniently, but also the parsing capacity is strong, and the anti-accumulation ability of the data is improved.

Description

technical field [0001] The invention relates to a database data analysis technology, in particular to a relational database system and a binary communication and data analysis method. Background technique [0002] At present, if the log is written in the relational database system (MySQL), if the input is made in the business system code, a large number of code intrusions will be generated, making the system difficult to maintain and causing code confusion. [0003] see figure 1 , the method of writing logs in the existing MySQL system is: 1. Business functions write various business data into the corresponding database; 2. Establish a trigger (trigger) corresponding to the database in advance; 3. Write data into the trigger (trigger), the trigger (trigger) writes incremental data to the result table; 4. The business system queries the results through the service framework (dubbo) database. [0004] The shortcomings of the current method of writing logs in the existing MyS...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F11/30G06F17/30
CPCG06F9/546G06F11/3034G06F2209/548G06F16/2379
Inventor 温浩胜张亲
Owner 深圳友门鹿网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products