Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for distributing and processing mass data passing through message queues

A technology of message queue and massive data, which is applied in the field of massive data distribution and processing through message queue

Active Publication Date: 2013-04-03
BEIJING JINGDONG CENTURY TRADING CO LTD
View PDF1 Cites 64 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the face of such a huge amount of data, if we want to quickly and effectively save, continuously process and distribute the data, it is impossible to solve the problem by using only the traditional stand-alone system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for distributing and processing mass data passing through message queues
  • Method and system for distributing and processing mass data passing through message queues
  • Method and system for distributing and processing mass data passing through message queues

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The present invention provides a method of transferring the mass data agreed between the client and the server through the distributed message queue, and distributing the data to the databases of each application system through the logical processing of setting the extracted message queue data by the distribution processing server Methods and systems, thereby realizing a technical solution for efficient processing and distribution of massive data.

[0015] As known to those skilled in the art, the distributed message queue utilizes an efficient and reliable message delivery mechanism for platform-independent data exchange, and performs distributed system integration based on data communication. By providing message passing and message queuing models, it can extend inter-process communication in a distributed environment, supporting multiple communication protocols, languages, application platforms, hardware and software platforms. Distributed message queue provides a re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and system for distributing and processing mass data passing through message queues. The method comprises that one or a plurality of client sides collect network data and use the collected data to serve as information to be sent to a distributed message queue server; the data coming from the one or the plurality of client sides serve as information to be postponed in one or a plurality of message queues, and the distributed message queue server sends the information to distributing processors; the distributing processors filter received information to obtain effective data; the distributing processors distribute identifiers for the effective data; corresponding logical processing is carried out on the effective data through the distributing processors; and the distributing processors distribute the effective data to corresponding data bases.

Description

technical field [0001] The present invention relates to a method and system for distributing and processing massive data, and more specifically, to a method and system for distributing and processing massive data through a message queue. Background technique [0002] With the increasing abundance of network resources, it is necessary to aggregate a large amount of data from different regions and different servers so that the data of the entire network can be analyzed to serve people's study, life, entertainment and company operations. However, in the face of such a huge amount of data, if we want to quickly and effectively save, continuously process and distribute the data, it is impossible to solve it only by using the traditional stand-alone system. [0003] For example, in order to check the data sent by the client, the original data needs to be saved so that the certificate can be produced when a problem occurs. Moreover, the concurrency capability of the aggregated ser...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08H04L12/58
Inventor 程忠
Owner BEIJING JINGDONG CENTURY TRADING CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More