A method and system for real-time collection of characteristic samples

Abstract

The embodiment of the present invention discloses a real-time collection method of characteristic samples, including: when the sample production node monitors the result message of the model result message system, the sample production node obtains the characteristic sample from the distributed configuration system according to the session ID of the result message The required metadata, and obtain all the features required by the feature sample from the feature library, construct cache samples according to the metadata and all features and store them in the storage system; each real-time behavior collection node monitors the user behavior message system, when the real-time behavior collection node When listening to the behavior message of the user behavior message system, the real-time behavior collection node obtains the cache sample from the cache system according to the session ID of the behavior message, and produces a sample tag, integrates the sample tag and the cache sample into a feature sample and stores it in the feature sample in the storage system. The embodiment of the invention also discloses a real-time collection system for characteristic samples. The invention can well support the real-time collection of characteristic samples.

Description

technical field [0001] The invention relates to the technical field of machine learning, in particular to a method and system for real-time collection of feature samples. Background technique [0002] Feature sample collection is an important part of machine learning model training, and the quality of data determines the effect of the algorithm model. In recommender system-related technologies, samples are mostly obtained through off-line calculations. The production efficiency of samples in this way is low, the production of samples is complicated, and the accuracy of the obtained samples is also low. Contents of the invention [0003] The purpose of the present invention is to provide a method and system for real-time collection of feature samples, which can not only well support the real-time collection of feature samples to improve the online training effect of the model, but also solve the problems of low offline production efficiency, complicated production and low a...

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a method and system for real-time collection of feature samples, which can not only well support the real-time collection of feature samples to improve the online training effect of the model, but also solve the problems of low offline production efficiency, complicated production and low accuracy of feature samples. question

Images