Data subscription and distribution method and system

A data subscription and subscription request technology, applied in the field of big data, can solve the problem of wasting traffic and achieve the effect of saving traffic

Inactive Publication Date: 2019-09-24
CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD +2
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of wasting traffic caused by adding additional processing procedures to filter data when users subscribe to finer-grained message data becaus

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data subscription and distribution method and system
  • Data subscription and distribution method and system
  • Data subscription and distribution method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to solve the problem of wasting traffic caused by adding additional processing procedures to filter data when users subscribe to finer-grained message data because the existing message queue service is limited to topic-level authorization, the present invention proposes a Data subscription distribution method and system.

[0041] The implementation principle of the data subscription and distribution method provided by the embodiment of the present invention is: in the data subscription and distribution method provided by the embodiment of the present invention, the message queue cluster server receives the subscription request sent by the subscriber, and the subscription request carries the field name of the subscription request, and the message After receiving the subscription request, the queue cluster server determines that the number of fields to be subscribed is less than the number of fields in each message content in the stored original Topic, wherein the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data subscription and distribution method and a data subscription and distribution system, which are used for solving the problem of flow waste caused by the fact that an additional processing flow is added to filter data when a user subscribes to message data with finer granularity because the existing message queue service is limited to theme-level authorization. The data subscription and distribution method comprises: a message queue cluster server receiving a subscription request sent by a subscription end, and the subscription request carrying a field name requested to be subscribed; determining that the number of fields requested to be subscribed is smaller than the number of fields in each message content in a stored original topic Topic, wherein the original Topic is a Topic to which the field content corresponding to the field name requested to be subscribed belongs; extracting the field content requested to be subscribed from the original Topic to form a new Topic; and distributing the field content in the new Topic to the subscription end.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a data subscription distribution method and system. Background technique [0002] In the existing big data platform business scenarios, a large number of multi-tenant usage requirements are involved, and it is necessary to perform classified management and permission allocation of data storage resources for different tenants, such as subscription and distribution management of data. [0003] With the improvement of data timeliness requirements, real-time processing technology is gradually applied to big data platforms. Distributed message queues can be used to buffer data during real-time data collection and aggregation. Among them, Apache Kafka is a commonly used message Queue Service, an open source messaging system project developed by the Apache Software Foundation, is a distributed, partitioned, and multi-replica log submission service that provides the functionalit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/51
Inventor 王妙琼周立陈磊任怡健温士帅徐硕顾刚
Owner CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products