Data distribution method and system

A data distribution and statistical unit technology, applied in the field of data processing, can solve the problems of different Flume server processing efficiency, reduced Flume server processing efficiency and sending and receiving efficiency, and unreasonable utilization of Flume server resources, so as to shorten data processing time and improve Effectiveness and reliability, and the effect of improving processing efficiency

Inactive Publication Date: 2018-09-11
SICHUAN FEIXUN INFORMATION TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the development of informatization, data such as upstream files is increasing massively. When the upstream files are distributed to each Flume server through the Nginx server, they are often randomly distributed to each Flume server by the Nginx server, and each Flume server The processing efficiency will vary greatly depending on the data content and other influencing factors. Therefore, random distribution will cause unreasonable utilization of Flume server resources, resulting in lower overall Flume server processing efficiency and sending and receiving efficiency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distribution method and system
  • Data distribution method and system
  • Data distribution method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific implementation manners of the present invention will be described below with reference to the accompanying drawings. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention, and those skilled in the art can also obtain other accompanying drawings based on these drawings and obtain other implementations.

[0052] In order to make the drawing concise, each drawing only schematically shows the parts related to the present invention, and they do not represent the actual structure of the product. In addition, to make the drawings concise and easy to understand, in some drawings, only one of the components having the same structure or function is schematically shown, or only one of them is marked. Herein, "a" not only means "only one", but also means "more than one".

[0053] An em...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data distribution method and system. The method comprises the following steps: S100 obtaining a retention state value corresponding to each Flume server within a preset period; S200 obtaining a data distribution priority corresponding to each Flume server according to the retention state value; S300 distributing a newly obtained uplink file to the Flume server of the corresponding grade according to the data distribution priority. By adoption of the data distribution method and system provided by the invention, data distribution tasks can be effectively and reasonablyplanned, the data processing time of each Flume server can be shortened, and the data collection efficiency can be improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data distribution method and system. Background technique [0002] With the development of informatization, data such as upstream files is increasing massively. When the upstream files are distributed to each Flume server through the Nginx server, they are often randomly distributed to each Flume server by the Nginx server, and each Flume server Processing efficiency will vary greatly depending on factors such as data content, so random distribution will cause unreasonable utilization of Flume server resources, resulting in lower overall Flume server processing efficiency and sending and receiving efficiency. Contents of the invention [0003] The purpose of the present invention is to provide a data distribution method and system, realize reasonable planning of data distribution tasks of each Flume server, and improve overall data processing efficiency and data collection effi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/06H04L67/61
Inventor 史欣炜
Owner SICHUAN FEIXUN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap