Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device

A data processing and data technology, applied in the field of communication, can solve problems such as increasing the burden on MySQL, failing to obtain table structure information, missing data at the subscriber end, etc., achieving the effects of unaffected performance, increasing table structure information, and enriching content

Active Publication Date: 2019-01-04
TENCENT TECH (SHENZHEN) CO LTD
View PDF10 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the binlog event data obtained through the binlog-dump protocol cannot obtain table structure information; moreover, this method of obtaining binlog through the binlog-dump protocol requires MySQL to send data to the outside, which increases the burden on MySQL; in addition, if MySQL After performing operations related to deleting binlog such as binlogpurge, data loss will still occur on the subscriber side

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

[0047] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device compr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of the Internet, in particular to a data processing method and apparatus. A manufacture module and a table storage module are preset, a cold standby serveris determined from the MySQL cluster's slave servers, through the producer module of the cold standby server to parse the binlog file to obtain the binlog parsing data, by analyzing the binlog parsing data, the table structure information is obtained and stored in the table storage module; when the message entity is outputted, the binlog parsing data and the corresponding table structure information in the table storage module are encapsulated into the message entity and outputted. The scheme of the invention obtains and parses the binlog file by bypass mode, does not increase the burden of MySQL cluster, ensures the integrity of the data, and enriches the content of the data at the same time.

Description

technical field [0001] The present invention relates to the field of communication technologies, in particular to a data processing method and device. Background technique [0002] MySQL is a relational database management system that speeds up data access and improves flexibility by storing data in different tables instead of putting all data in one large warehouse. In order to achieve server load balancing and enhance the ability of the database system to resist disasters, the MySQL database system, like other popular database systems, also adopts a master-slave synchronization architecture, that is, the system includes a master server and multiple from the server. The purpose of adopting the above-mentioned architectural approach has the following two aspects. First of all, only the data update operation can be implemented on the master server, and all data query requests are sent to the slave server for execution. By placing data update and query on different servers f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/28G06F16/22G06F16/27
Inventor 吴夏潘安群雷海林
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com