Unlock instant, AI-driven research and patent intelligence for your innovation.

A real-time data transmission system and its data synchronization method

A real-time data transmission and data synchronization technology, applied in the field of data processing, can solve problems such as difficult mass data, scalability limitations, processing, etc., and achieve good scalability effects

Active Publication Date: 2019-01-08
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a real-time data transmission system and its data synchronization method, aiming to solve the problem that the existing data transmission system is difficult to process massive data due to the limited scalability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A real-time data transmission system and its data synchronization method
  • A real-time data transmission system and its data synchronization method
  • A real-time data transmission system and its data synchronization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0020] In the embodiment of the present invention, the data adapter of the first Internet data center reads data from the data source, and sends the read data to the data import server of the second Internet data center through the transmission agent of the second Internet data center , the data is imported to each online service module of the second Internet data center through the data import server, so that the data in the data source can be synchronized to each online service module of the second Internet data center, and when the real-time data transmission system needs to process When the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is applicable to the field of data processing and provides a real-time data transmission system and a data synchronization method thereof. The method includes: when a data import server receives a data synchronization command, sending a data request to a data adapter through a transmission agent module; through the data adapter, reading data from a data source and sending the read data to the data import server through the transmission agent module; through the data import server, receiving data from the transmission agent module, and importing the received data to an on-line service module. Since the data are read from the data source through the data adapter uniformly and the data read by the data adapter are forwarded to the data import server through the transmission agent module, when capacity expansion is required, only the data adapter and / or the transmission agent module is required to be added, the real-time data transmission system has good expandability, and further synchronization of massive data can be realized.

Description

technical field [0001] The invention belongs to the field of data processing, in particular to a real-time data transmission system and a data synchronization method thereof. Background technique [0002] Real-time data transmission system (also known as real-time data transmission platform) has the characteristics of high performance, real-time, sequential, high reliability, high availability, scalability, etc., so it is widely used in Internet application fields, such as log collection, data monitoring , advertising feedback, quantum statistics, database synchronization, etc. [0003] Existing real-time data transmission systems include TimeTunnel and so on. TimeTunnel generally uses 3 servers. When TimeTunnel is applied to Taobao to process data, the three servers process about 2.3T of data per day, with a peak value of 50Mb inflow and 130Mb outflow per second. [0004] The existing TimeTunnel is difficult to support the processing of massive data due to the limited sc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1095H04L67/1097
Inventor 陈祺汶林丁吴悦
Owner TENCENT TECH (SHENZHEN) CO LTD