A real-time monitoring system for live streaming sales of online products

Abstract

The present invention proposes a real-time monitoring system for live broadcast sales of online commodities, comprising: a data acquisition module for acquiring live broadcast video data; a data analysis module, comprising an ASR module, an OCR module, a violation clue discovery module and a commodity category classification module; the ASR module and the OCR module are used to identify the voice content and image content of the live broadcast video data and convert them into live broadcast text; the violation clue discovery module is used to identify whether the live broadcast text content contains violation clues; the recognition model processing is configured according to the type of violation clues; the commodity category classification module is used to label each live broadcast video segment with a commodity category label based on the live broadcast text based on a large language model; the demonstration system module is used for associated visual display, including data tables of violation clues and database information. This system simplifies the supervision process, improves supervision efficiency, takes into account efficiency, real-time performance, accuracy and reliability, and brings positive changes to the live broadcast industry.

Claims

1. A real-time monitoring system for live online sales of goods, characterized by: include: Data acquisition module, data analysis module and demonstration system module; The data acquisition module is used to acquire live video data; The data analysis module includes an ASR module, an OCR module, a violation clue discovery module and a product category classification module; The ASR module is used to identify the voice content of the live video data and convert it into live text; the OCR module is used to identify the image content of the live video data and convert it into live text; the violation clue detection module is used to identify whether the live text content contains violation clues; the types of violation clues include sensitive word types, variant word types, banned or restricted sale product types, and false product information types, and the recognition model processing is configured according to the type of violation clues; the product category classification module is used to label the product category label for each live video segment according to the live text based on the large language model; The demonstration system module is used for associated visual display, including data tables of violation clues and database information; The violation clue discovery module includes: A sensitive word matching module, based on a general sensitive word recognition model, matches the live text with words in a sensitive word library, and marks the corresponding live video data if a sensitive word exists in the live text; Variant word recognition module, used to perform multi-level variant word recognition based on variant word types; The variant words include structural variant words, phonetic variant words, and semantic variant words; The multi-level variant word identification includes: identifying the structural variant words through a preset regular expression; analyzing the language features of the live text based on a statistical language model, correcting spelling errors and identifying the phonetic and morphological variant words; performing semantic understanding and context analysis on the live text based on a large language model to identify the semantic variant words; based on the identified variant words, obtaining the original word of the variant word, and matching the original word with a pre-constructed sensitive word library to determine whether the original word exists in the sensitive word library; if so, marking the corresponding live video data; The multi-level variant word recognition is configured with a time priority graded filtering strategy, namely: In a real-time stream of live video content, the temporal priority of variant word identification based on regular expression matching is higher than the temporal priority of variant word identification based on the statistical language model, and the temporal priority of variant word identification based on the statistical language model is higher than the temporal priority of variant word identification based on the large language model; After the multi-level variant word recognition is started, the variant word recognition based on regular expression matching is fed back; After each set first time period, the variant word recognition based on the statistical language model recognizes and feeds back the data of the previous first time period; After each set second period, the variant word recognition based on the large language model recognizes and feeds back the data of the previous second period; The duration of the first time period is shorter than the duration of the second time period.

2. The real-time monitoring system for live broadcast sales of online commodities according to claim 1 is characterized in that: The data acquisition module includes a crawler module for directly acquiring the live video data and a screen recording module for indirectly acquiring the live video data; The crawler module cyclically reads the live link pool in the database, and for each live link read, starts a new thread to download the live video content in parallel; The screen recording module captures pixel data and audio data of the screen image based on FFmpeg, encodes and merges the pixel data and the audio data in real time, and encapsulates them into a multimedia container format to form a multimedia file; The downloaded live video content and the multimedia file are stored in a video buffer to be analyzed, and corresponding records are added to a video table to be analyzed in a database.

3. The real-time monitoring system for live broadcast sales of online commodities according to claim 1 is characterized in that: The violation clue discovery module also includes: The prohibited and restricted goods identification module, based on the prohibited and restricted goods identification model, identifies whether there is sales of prohibited and restricted goods in the live broadcast content. If so, it marks the corresponding live broadcast video data; The product false information identification module, based on the product false information identification model, performs product matching analysis according to the product description in the live text and the product description recorded in the product database. If there is a contradiction, the corresponding live video data is marked.

4. The real-time monitoring system for live broadcast sales of online commodities according to claim 1, characterized in that: After the multi-level variant word identification is performed, the original word of the identified variant word is compared with the sensitive word library. If the original word exists in the sensitive word library, the variant word is stored in the variant word library.

5. The real-time monitoring system for live broadcast sales of online commodities according to claim 1 is characterized in that: The commodity classification module classifies commodities into health products, medicines, cosmetics, and medical devices according to their types; The commodity category classification module obtains response results from the large language model through real-time network services; The commodity category classification module uses a global variable to temporarily store the response result; before the next classification request, the global variable is cleared.

6. The real-time monitoring system for live broadcast sales of online commodities according to claim 5 is characterized in that: Demonstration system module, including: The system homepage is used to display statistical information, including at least one of the following: the number of monitored platforms, the number of live broadcast rooms, the number of monitored anchors, the number of violation types, the number of lead videos, the number of variant words, the word cloud of high-frequency triggering keywords, and the word cloud of high-frequency triggering variant words; Entity live broadcast pool management, used to view the live broadcast room information in the live broadcast pool and provide interaction for adding new links to the live broadcast pool; Automatic live broadcast inspection, providing interaction for configuring automated monitoring of random live broadcasts; Customized live broadcast monitoring, providing interactions for configuring automated monitoring of selected live broadcasts; Violation clue display: the live broadcast room information where the violation clue discovery module detects the violation clue and the corresponding violation clue are displayed in association; The database display includes a table of evidence videos associated with violation clues, a table of banned and restricted sales items, a table of sensitive words, a table of pharmaceuticals, medical devices and cosmetics, a table of health foods, and a table of annotated matching relationships.

7. The real-time monitoring system for live broadcast sales of online commodities according to claim 6 is characterized in that: The marked matching relationship table includes a sensitive word matching table, a special variant word matching table and a prohibited or restricted sale matching table that matches product information.

8. The real-time monitoring system for live broadcast sales of online commodities according to claim 7 is characterized in that: The sensitive word matching table includes four attributes, namely 'id', 'general sensitive word_id', 'live_id', and 'eligible'; wherein 'id' is the primary key of the sensitive word matching table, 'general sensitive word id' and 'live_id' are foreign keys of the sensitive word matching table; 'eligible' has two values: '0' indicates that the video is unqualified, and '1' indicates that the video is qualified; The specialized variant word matching table includes four attributes, namely, 'id', 'special variant word_id', 'live_id', and 'eligible'; wherein, 'id' is the primary key of the specialized variant word matching table, 'special variant word_id' and 'live_id' are foreign keys of the specialized variant word table; 'eligible' has two values, '0' represents that the video is unqualified, and '1' represents that the video is qualified; The prohibited sale and restricted sale matching table includes four attributes, namely 'id', 'prohibited sale and restricted sale_id', 'live_id' and 'eligible'; among them, 'id' is the primary key of the prohibited sale and restricted sale matching table, 'prohibited sale and restricted sale_id' and 'live_id' are the foreign keys of the prohibited sale and restricted sale matching table; 'eligible' has two values, '0' represents that the video is unqualified, and '1' represents that the video is qualified.

Images