A data processing method and system

Abstract

An embodiment of the present invention provides a data processing method and system, the method comprising: obtaining at least one subscription condition of a consumer to subscribe to a notification message; when the first data provided by the producer is obtained, storing the first data, and Comparing the first data with the second data that has been stored when the first data is obtained, obtaining the target subscription condition that can be satisfied, and generating a notification message that matches the target subscription condition; sending the notification message to the corresponding The consumer; wherein, after receiving the notification message, the consumer reads data matching the target subscription condition from the stored first data and second data according to the notification message. Therefore, in the solution of the present invention, notification messages are only sent to consumers meeting subscription conditions, so that consumers will not receive unnecessary messages, thereby improving system throughput.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and system. Background technique [0002] A video app that maintains a video entity for video production, cataloging, distribution, etc. Among them, some business parties are responsible for writing entity fields. For example, operation services will write catalog fields, production services will write stream fields, etc.; some systems will monitor entity field change messages, and write new fields after business processing , for example, when the labeling system monitors changes in video status, title and other fields, it will label the video if the conditions are met, and then write the label field into the entity; some systems only monitor messages, such as the recommendation system will monitor the recommendation level and the number of comments , CTR (Click-Through-Rate, click-through rate) and other fields are used for recommendation stra...

AI Technical Summary

Problems solved by technology

[0003] The characteristic of this kind of data synchronization between multiple systems is that the fields written by the data producer do not match the fields that the data consumer cares about; one data write may trigger multiple data consumers to consume data; the data consumer may need to wait for multiple Business processing can only be performed when the data writing status is satisfied

[0004] Among them, in order to achieve data synchronization between multiple systems, the producer can notify all receivers concerned about the value change of the field each time through the producer, that is, send the latest value of the specified field to the receiver each time , such as broadcasting the latest value of the specified field to all receivers, however, some receivers do not need some data, but still receive the data, causing these receivers to process useless messages, reducing the system throughput

Images