Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-server distributed data processing method, server and system

A distributed data, multi-server technology, applied in the field of multi-server distributed data processing methods, servers and systems, can solve problems such as inability to adapt to WebGame, uneven network quality, and complex network environment.

Active Publication Date: 2015-08-26
深圳市前海幻境网络科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For online games (WebGame) with huge data volume, game servers spread all over the world, complex network environment, and uneven network quality, especially distributed data with unstable data sources, the above-mentioned ETL method cannot adapt to WebGame. status quo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-server distributed data processing method, server and system
  • Multi-server distributed data processing method, server and system
  • Multi-server distributed data processing method, server and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The embodiment of the present invention provides a multi-server distributed data processing method, which can implement dynamic addition of data sources, and can adapt to various networks. The embodiment of the present invention also provides a corresponding server and system. Each will be described in detail below.

[0039] refer to figure 1 , from the perspective of the central server, the multi-server distributed data processing method provided by the embodiment of the present invention includes:

[0040] 101. After reading the remote proxy server information and the data extraction task information and data merging task information of the remote proxy server, the central server sends the data extraction task information to the remote proxy server.

[0041] The central server reads the task information configured by the user, finds the remote proxy server information and task information, and the task information includes the data extraction task information and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a processing method for multi-server distributed data. A central server reads remote acting server information, as well as data abstraction task information of the remote acting server and data combination task information, sends the data abstraction task information to the remote acting server, so as to enable the remote acting server to extract data required by the data abstraction task, and return the condensed and encrypted data. The data abstraction task information contains the data base server address of data required to be extracted, receives the condensed and encrypted data, decompresses the condensed and encrypted data, and loads the decompressed data to a data base according to the data combination task information. The processing method for the multi-server distributed data provided by the embodiment of the invention can realize dynamic data source adding, and can adapt various network environment and network quality.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a multi-server distributed data processing method, server and system. Background technique [0002] Data extraction, transformation and loading (ETL, Extraction-Transformation-Loading), as the core and soul of business intelligence (BI, Business Intelligence) and data warehouse (DW, Data Warehouse), integrates and improves the value of data according to unified rules, and is responsible for Completing the process of data transformation from data source to target data warehouse is an important step in the implementation of data warehouse. If the model design of the data warehouse is the design blueprint of a building, and the data is the bricks and tiles, then ETL is the process of building the building. [0003] Data ETL is generally applied in the local area network, and the data of the data source is loaded into the data warehouse after being extracted, converted, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06H04L29/08G06F17/30
Inventor 彭大力龙春燕
Owner 深圳市前海幻境网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products