Media monitoring method, media monitoring device and media monitoring system

CN121241561APending Publication Date: 2025-12-30BOE TECHNOLOGY GROUP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202480000614.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-03-27
Publication Date
2025-12-30

AI Technical Summary

Technical Problem

The existing media monitoring technology of display terminals is inefficient and difficult to achieve unified monitoring across terminals, and manual inspections are prone to omissions.

Method used

By acquiring the display image data of the display terminal, matching it with the image fingerprint information, and using preset fingerprint information such as Bloom filter or image fingerprint algorithm, the media content of the display terminal is automatically monitored to determine the monitoring results.

Benefits of technology

It achieves efficient and accurate media monitoring, reduces labor costs, improves monitoring efficiency and result credibility, and is suitable for unified monitoring of diverse display terminals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121241561A_ABST
    Figure CN121241561A_ABST
Patent Text Reader

Abstract

The invention provides a media monitoring method and device and a media monitoring system, and relates to the technical field of computers, the method comprises the following steps: obtaining first image fingerprint information corresponding to display image data of a display terminal to be monitored, the display image data comprising at least one display image played by the display terminal, the first image fingerprint information comprises an image fingerprint corresponding to each display image; and matching the first image fingerprint information with preset fingerprint information, and determining a playing monitoring result of the media content played by the display terminal according to a matching result. The invention further provides electronic equipment and a computer readable storage medium.
Need to check novelty before this filing date? Find Prior Art

Description

Media monitoring method and device, and media monitoring system Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a media monitoring method and device, a media monitoring system, an electronic device, and a computer-readable storage medium. Background Art

[0002] Existing display terminal playback monitoring technology typically relies on manual inspections to monitor massive amounts of content. This method is not only inefficient but also prone to omissions. Furthermore, due to the diversity of display terminals, achieving unified monitoring across terminals is a major challenge.

[0003] Summary of the Invention

[0004] The present disclosure provides a media monitoring method and device, a media monitoring system, an electronic device, and a computer-readable storage medium.

[0005] According to a first aspect of the present disclosure, the present disclosure provides a media monitoring method, the media monitoring method comprising:

[0006] Acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image;

[0007] The first image fingerprint information is matched with preset fingerprint information, and a monitoring result of the media content played by the display terminal is determined according to the matching result.

[0008] In some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes:

[0009] Sending a monitoring instruction to the display terminal, wherein the monitoring instruction includes an image sampling frequency and an image sampling quantity;

[0010] receiving display image data collected by the display terminal according to the monitoring instruction;

[0011] The acquiring of the first image fingerprint information corresponding to the display image data of the display terminal includes: generating the first image fingerprint information according to the display image data based on a preset image fingerprint algorithm.

[0012] In some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes: sending a monitoring instruction to the display terminal, the monitoring instruction including at least an image sampling frequency and an image sampling quantity, so that the display terminal collects the display image data according to the monitoring instruction, and generates the first image fingerprint information according to the display image data based on a preset image fingerprint algorithm;

[0013] The acquiring of the first image fingerprint information corresponding to the display image data of the display terminal includes: receiving the first image fingerprint information sent by the display terminal.

[0014] In some embodiments, the sending of the monitoring instruction to the display terminal includes:

[0015] The monitoring instruction is sent to the display terminal according to a set time, or in response to a user's triggering monitoring operation, the monitoring instruction is sent to the display terminal.

[0016] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, and the Bloom filter is pre-generated based on the second image fingerprint information corresponding to the standard image data;

[0017] The matching of the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal according to the matching result includes:

[0018] Searching whether there is an element in the Bloom filter that matches each image fingerprint in the first image fingerprint information;

[0019] When it is retrieved that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0020] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image;

[0021] The matching of the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal according to the matching result includes:

[0022] comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information;

[0023] When there is at least one image fingerprint in the first image fingerprint information for which no corresponding matching image fingerprint is found in the second image fingerprint information, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0024] In some embodiments, when the display image data includes a plurality of continuously acquired display images and the standard image data includes a plurality of standard images, after comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information, the media monitoring method further includes:

[0025] When an image fingerprint matching each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there is no duplicate matching image fingerprint, and the playback order of the images corresponding to the matching image fingerprints in the second image fingerprint information is continuous, determining that the monitoring result of the display terminal is normal playback of the media content;

[0026] When an image fingerprint matching each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there is no repeated matching image fingerprint, and the playback order of the images corresponding to the matching image fingerprints in the second image fingerprint information is discontinuous, determining that the monitoring result of the display terminal is abnormal playback of media content;

[0027] When image fingerprints corresponding to and matching each image fingerprint in the first image fingerprint information are found in the second image fingerprint information, and there are repeated matching image fingerprints, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0028] In some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes:

[0029] Acquire standard image data to be played, wherein the standard image data includes at least one standard image;

[0030] Based on a preset image fingerprint algorithm, second image fingerprint information is generated according to the standard image data, the preset fingerprint information includes the second image fingerprint information, and the second image fingerprint information includes the image fingerprint corresponding to each standard image.

[0031] In some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes:

[0032] Acquire standard image data to be played, wherein the standard image data includes at least one standard image;

[0033] generating second image fingerprint information based on the standard image data based on a preset image fingerprint algorithm, wherein the second image fingerprint information includes an image fingerprint corresponding to each standard image;

[0034] A Bloom filter is generated according to the second image fingerprint information, where the preset fingerprint information includes the Bloom filter.

[0035] In some embodiments, generating a Bloom filter according to the second image fingerprint information includes:

[0036] Initializing a bit array of a Bloom filter, wherein a bit corresponding to each array subscript in the bit array is initialized to a first value;

[0037] For each image fingerprint in the second image fingerprint information, perform a modulo operation on the image fingerprint to determine an array subscript of the image fingerprint in the bit array;

[0038] Setting the bit corresponding to the array subscript of the image fingerprint in the bit array to a second value;

[0039] A Bloom filter corresponding to the standard image data is obtained.

[0040] According to a second aspect of the present disclosure, the present disclosure provides a media monitoring device, the media monitoring device comprising:

[0041] an information acquisition module configured to acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image;

[0042] The monitoring module is configured to match the first image fingerprint information with preset fingerprint information, and determine a monitoring result of the media content played by the display terminal according to the matching result.

[0043] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, and the Bloom filter is pre-generated based on the second image fingerprint information corresponding to the standard image data;

[0044] The monitoring module is configured to: search the Bloom filter for an element that matches each image fingerprint in the first image fingerprint information; and when it is retrieved that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0045] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image;

[0046] The monitoring module is configured to: compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; when there is at least one image fingerprint in the first image fingerprint information that does not find a corresponding matching image fingerprint in the second image fingerprint information, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0047] According to a third aspect of the present disclosure, the present disclosure provides a media monitoring system, the media monitoring system comprising: a media monitoring device and at least one display terminal, the media monitoring device comprising the above-mentioned media monitoring device;

[0048] The display terminal communicates messages with the media monitoring device through the device management agent program.

[0049] According to a fourth aspect of the present disclosure, the present disclosure provides an electronic device, the electronic device comprising:

[0050] at least one processor; and

[0051] a memory communicatively connected to the at least one processor; wherein,

[0052] The memory stores one or more computer programs that can be executed by the at least one processor. The one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the above-mentioned media monitoring method.

[0053] According to a fifth aspect of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the above-mentioned media monitoring method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. The above and other features and advantages will become more apparent to those skilled in the art by describing detailed example embodiments with reference to the accompanying drawings. In the accompanying drawings:

[0055] FIG1 is a flow chart of a media monitoring method provided by an embodiment of the present disclosure.

[0056] FIG2 is a flow chart of another media monitoring method provided by an embodiment of the present disclosure.

[0057] FIG3 is a flowchart of a specific implementation method of step S12 in an embodiment of the present disclosure.

[0058] FIG4 is a flowchart of a specific implementation method of step S12 in an embodiment of the present disclosure.

[0059] FIG5 is a schematic diagram of comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information.

[0060] FIG6 is a schematic structural diagram of a media monitoring device provided by an embodiment of the present disclosure.

[0061] FIG7 is a schematic diagram of an implementation method of a media monitoring device provided by an embodiment of the present disclosure.

[0062] FIG8 is a flow chart of a media monitoring method implemented based on a media monitoring device according to an embodiment of the present disclosure.

[0063] FIG9 is a schematic diagram of the system architecture of a media monitoring system provided by an embodiment of the present disclosure.

[0064] FIG10 is a block diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0065] To enable those skilled in the art to better understand the technical solutions of the present disclosure, exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding. These details should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0066] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.

[0067] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0068] The terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. As used herein, the singular forms "a" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise. It will also be understood that when the terms "comprising" and / or "made of" are used in this specification, the presence of the features, wholes, steps, operations, elements and / or components is specified, but the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof is not excluded. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect.

[0069] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless expressly defined as such herein.

[0070] FIG1 is a flow chart of a media monitoring method provided by an embodiment of the present disclosure. As shown in FIG1 , the media monitoring method includes steps S11 to S12.

[0071] Step S11: Acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image.

[0072] Step S12: Match the first image fingerprint information with the preset fingerprint information, and determine a monitoring result of the media content played by the display terminal according to the matching result.

[0073] According to the media monitoring method provided in the embodiment of the present disclosure, the image content played by the display terminal is monitored based on the image fingerprint. This can achieve efficient and accurate monitoring of the media playback content of the display terminal without significantly increasing the load and cost of the display terminal. Compared with traditional media monitoring methods, it effectively reduces labor costs and effectively improves monitoring efficiency and the credibility of monitoring results.

[0074] FIG2 is a flow chart of another media monitoring method provided by an embodiment of the present disclosure. As shown in FIG2 , in some embodiments, before obtaining the first image fingerprint information corresponding to the displayed image data of the display terminal, the media monitoring method further includes:

[0075] Step S01: Send a monitoring instruction to a display terminal, where the monitoring instruction at least includes an image sampling frequency and an image sampling quantity.

[0076] In some embodiments, the playback screen content of the display terminal to be monitored can be monitored according to a preset monitoring strategy. The monitoring strategy for the display terminal is pre-configured. For example, the monitoring strategy may include a timed monitoring strategy and a manual monitoring strategy. The timed monitoring strategy refers to executing the monitoring operation according to a preset period or executing the monitoring operation at a preset time point. The manual monitoring strategy refers to executing the monitoring operation in response to manual triggering by the user.

[0077] Furthermore, sending the monitoring instruction to the display terminal may further include: sending the monitoring instruction to the display terminal according to a set time, or sending the monitoring instruction to the display terminal in response to a monitoring triggering operation by the user.

[0078] Among them, the image sampling frequency and the number of image samples can be set according to actual conditions. For example, when the media content played on the display terminal is a fixed image, the image sampling frequency f can be set to 1 and the image sampling number k can be set to 1, that is, only one image is sampled; when the media content played on the display terminal is a video, the image sampling frequency f can be set to the frame rate fps of the video, and the image sampling number k can be set to a value not less than 5.

[0079] Step S02: receiving display image data collected by the display terminal according to the monitoring instruction.

[0080] In some embodiments, after receiving the monitoring instruction, the display terminal starts to collect images of the played media content according to the image sampling frequency and image sampling quantity in the monitoring instruction. After the display terminal completes the image collection, the display image data collected by the display terminal is received.

[0081] Furthermore, after receiving the display image data collected by the display terminal according to the monitoring instruction, in step S11, obtaining the first image fingerprint information corresponding to the display image data of the display terminal may further include: generating the first image fingerprint information according to the display image data based on a preset image fingerprint algorithm.

[0082] Furthermore, for each display image in the display image data, a corresponding image fingerprint is generated using a preset image fingerprint algorithm. The image fingerprint can be used to uniquely identify the corresponding image, thereby obtaining first image fingerprint information corresponding to the display image data.

[0083] In some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method also includes: sending a monitoring instruction to the display terminal, the monitoring instruction including at least the image sampling frequency and the image sampling quantity, so that the display terminal collects the display image data according to the monitoring instruction, and generates the first image fingerprint information according to the display image data based on a preset image fingerprint algorithm.

[0084] The description of the step of sending the monitoring instruction to the display terminal can refer to the above description of step S01, which will not be repeated here.

[0085] In some embodiments, the display terminal is integrated with a preset image fingerprint algorithm. After receiving the monitoring instruction, the display terminal starts to collect images of the played media content according to the image sampling frequency and image sampling quantity in the monitoring instruction, and generates a corresponding image fingerprint for each display image in the collected display image data using the preset image fingerprint algorithm, thereby obtaining the first image fingerprint information corresponding to the display image data.

[0086] In some embodiments, obtaining first image fingerprint information corresponding to the display image data of the display terminal may further include: receiving the first image fingerprint information sent by the display terminal.

[0087] In some embodiments, the preset image fingerprint algorithm may include commonly used hash algorithms such as interpolation hash, mean hash, perceptual hash, and wavelet hash.

[0088] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to the preset standard image data, and the Bloom filter is generated in advance based on the second image fingerprint information corresponding to the standard image data.

[0089] The standard image data is the correct image or video data uploaded by the user that needs to be played by the display terminal. For a specified display terminal or a group of display terminals, the user can upload the media material to be played through the mobile application (APP) or web management backend. The media material includes the standard image data and is then sent to the corresponding display terminal. After the display terminal downloads the media material, it plays the corresponding media material according to the plan. Under normal circumstances, the display terminal should play according to the standard image data. The standard image data may include one or more standard images. Accordingly, the second image fingerprint information includes the image fingerprint corresponding to each standard image. The image fingerprint corresponding to each standard image can be generated in advance based on a preset image fingerprint algorithm based on each standard image, thereby obtaining the second image fingerprint information.

[0090] In the disclosed embodiment, a Bloom filter is a probabilistic data structure consisting of a very long binary vector and a series of random mapping functions (hash functions). It is characterized by efficient insertion and query, and can determine whether a certain string must exist or may exist. The data structure of the Bloom filter is a bit vector, that is, a bit array consisting of 0 and 1 elements. In some embodiments, the image fingerprint corresponding to each standard image in the second image fingerprint information of the standard image data is mapped to the corresponding bit in the bit array of the Bloom filter, and the image fingerprint of each standard image is recorded through the bit array of the Bloom filter, thereby obtaining the Bloom filter corresponding to the standard image data.

[0091] FIG3 is a flowchart of a specific implementation of step S12 in an embodiment of the present disclosure. In some embodiments, as shown in FIG3 , in step S12, matching the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal based on the matching result may further include the following steps:

[0092] Step S121a: Search the Bloom filter to see whether there is an element that matches each image fingerprint in the first image fingerprint information.

[0093] By mapping each image fingerprint in the first image fingerprint information to the bit array of the Bloom filter, and judging whether the bit corresponding to the mapping position is 1, if all are 1, it means that the image fingerprint exists in the Bloom filter; if there is at least one bit corresponding to the mapping position that is not 1, it means that the image fingerprint does not exist in the Bloom filter.

[0094] Step S122a: When it is found that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0095] When at least one image fingerprint in the retrieved first image fingerprint information does not exist in the Bloom filter, it indicates that the display image data of the display terminal contains a display image that is inconsistent with the standard image of the standard image data. Therefore, it can be determined that the display terminal plays media content abnormally.

[0096] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image.

[0097] FIG4 is a flowchart of a specific implementation of step S12 in an embodiment of the present disclosure. In some embodiments, as shown in FIG4 , in step S12, matching the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal based on the matching result may further include the following steps:

[0098] Step S121b: Compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information.

[0099] Step S122b: When there is at least one image fingerprint in the first image fingerprint information and no corresponding matching image fingerprint is found in the second image fingerprint information, determining that the monitoring result of the display terminal is abnormal playback of media content.

[0100] In some embodiments, the standard image data is the correct image or video data uploaded by the user that needs to be played by the display terminal, and the display image data is the image or video data actually played by the display terminal. By comparing each image fingerprint in the first image fingerprint information of the display image data with each image fingerprint in the second image fingerprint information of the annotated image data, it can be determined whether the media content actually played by the display terminal is consistent with the media content required to be played.

[0101] When there is at least one image fingerprint in the first image fingerprint information for which no corresponding matching image fingerprint is found in the second image fingerprint information, it indicates that the media content actually played by the display terminal is inconsistent with the media content required to be played, and therefore the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0102] It is understandable that both the embodiment shown in FIG. 3 and the embodiment shown in FIG. 4 can be used to detect the correctness of media content played by a display terminal. FIG. 5 exemplarily shows a schematic diagram of comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information. In some embodiments, when the display image data of the display terminal includes multiple continuously acquired display images and the standard image data includes multiple standard images, in order to further detect the playback quality of the display terminal, the media monitoring method may further include:

[0103] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there is no repeated matching image fingerprint, and the image playback order corresponding to the matching image fingerprints in the second image fingerprint information is continuous, it is determined that the monitoring result of the display terminal is normal playback of the media content.

[0104] As shown in the first case in Figure 5, h(f1), h(f2), ....., h(fn) respectively represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 respectively represent the image fingerprints corresponding to each display image in the first image fingerprint information. In the first case, the image fingerprint H1 matches the image fingerprint h(f4), the image fingerprint H2 matches the image fingerprint h(f5), the image fingerprint H3 matches the image fingerprint h(f6), the image fingerprint H4 matches the image fingerprint h(f7), and the image fingerprint H5 matches the image fingerprint h(f8). The image playback order corresponding to h(f4), h(f5), h(f6), h(f7), and h(f8) is continuous, indicating that the playback quality of the display terminal is good and there is no fault. Therefore, it can be determined that the monitoring result of the display terminal is normal playback of media content.

[0105] When image fingerprints that match each image fingerprint in the first image fingerprint information are found in the second image fingerprint information, and there are no repeated matching image fingerprints, and the image playback order corresponding to the matching image fingerprints in the second image fingerprint information is discontinuous, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0106] As shown in the second situation in Figure 5, h(f1), h(f2), ....., h(fn) respectively represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 respectively represent the image fingerprints corresponding to each display image in the first image fingerprint information. In the second situation, the image fingerprint H1 matches the image fingerprint h(f2), the image fingerprint H2 matches the image fingerprint h(f3), the image fingerprint H3 matches the image fingerprint h(f5), the image fingerprint H4 matches the image fingerprint h(f6), and the image fingerprint H5 matches the image fingerprint h(f8). The image playback order corresponding to h(f2), h(f3), h(f5), h(f6), and h(f8) is discontinuous, indicating that there is frame skipping in the playback content of the display terminal and the playback quality is poor. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback of media content.

[0107] When image fingerprints corresponding to and matching each image fingerprint in the first image fingerprint information are found in the second image fingerprint information, and there are repeated matching image fingerprints, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0108] As shown in the third case in Figure 5, h(f1), h(f2), ....., h(fn) respectively represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 respectively represent the image fingerprints corresponding to each display image in the first image fingerprint information. In the third case, the image fingerprint H1 matches the image fingerprint h(f4), the image fingerprint H2 matches the image fingerprint h(f5), the image fingerprint H3 matches the image fingerprint h(f5), the image fingerprint H4 matches the image fingerprint h(f6), and the image fingerprint H5 matches the image fingerprint h(f7). The image fingerprints corresponding to the image fingerprints H2 and H3 are the same image fingerprint h(f5), that is, the display images corresponding to the image fingerprints H2 and H3 are the same image, indicating that there is a jamming phenomenon in the playback content of the display terminal and the playback quality is poor. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback of media content.

[0109] When there is at least one image fingerprint in the first image fingerprint information and no corresponding matching image fingerprint is found in the second image fingerprint information, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

[0110] As shown in the fourth situation in Figure 5, h(f1), h(f2), ....., h(fn) respectively represent the image fingerprints corresponding to each standard image in the second image fingerprint information, H1, H2, ..., H5 respectively represent the image fingerprints corresponding to each display image in the first image fingerprint information, image fingerprint H1 matches the image fingerprint h(f4), image fingerprint H2 matches the image fingerprint h(f5), and image fingerprints H3, H4 and H5 fail to find corresponding matching image fingerprints in the second image fingerprint information, indicating that the playback content of the display terminal is incorrect and does not meet the expected playback requirements. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback of media content.

[0111] In some embodiments, when the monitoring result of the display terminal is determined to be abnormal playback of media content, corresponding alarm information is generated, and the alarm information is pushed to the designated user according to the pre-configured push method and push range, notifying the user to handle it in time.

[0112] In some embodiments, before sending a monitoring instruction to the display terminal, the media monitoring method also includes: obtaining standard image data to be played, the standard image data including at least one standard image; based on a preset image fingerprint algorithm, generating second image fingerprint information according to the standard image data, the preset fingerprint information including the second image fingerprint information, and the second image fingerprint information including the image fingerprint corresponding to each standard image.

[0113] In some embodiments, before sending a monitoring instruction to the display terminal, the media monitoring method also includes: obtaining standard image data to be played, the standard image data including at least one standard image; based on a preset image fingerprint algorithm, generating second image fingerprint information according to the standard image data, the second image fingerprint information including the image fingerprint corresponding to each standard image; generating a Bloom filter according to the second image fingerprint information, the preset fingerprint information including the Bloom filter.

[0114] In some embodiments, the preset fingerprint information may include second image fingerprint information corresponding to the standard image data and a Bloom filter. In the step of matching the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result, the Bloom filter may be used to first retrieve the image fingerprint in the first image fingerprint information to check the correctness of the content played on the display terminal, and then compared with the second image fingerprint information to check the playback quality of the content played on the display terminal.

[0115] In some embodiments, if the media material uploaded by the user is a single standard image, a preset image fingerprint algorithm is used to generate a corresponding image fingerprint to obtain second image fingerprint information; if the media material is a video, the video is decoded to obtain standard image data, and for each frame of the standard image in the standard image data, a corresponding image fingerprint is generated using the preset image fingerprint algorithm to obtain second image fingerprint information. The image fingerprints in the second image fingerprint information are arranged in frame sequence order and saved in the corresponding relationship of the media material, as shown in Table 1 below, where h(fn) represents the image fingerprint generated corresponding to the nth frame in the media material.

[0116] Table 1

[0117] In some embodiments, generating a Bloom filter based on the second image fingerprint information may further include: initializing a bit array of a Bloom filter, initializing the bit corresponding to each array subscript in the bit array to a first value; performing a modulo operation on each image fingerprint in the second image fingerprint information to determine the array subscript of the image fingerprint in the bit array; setting the bit corresponding to the array subscript of the image fingerprint in the bit array to a second value; and obtaining a Bloom filter corresponding to the standard image data.

[0118] Exemplarily, a bit array of length m is initialized, denoted as BF, and each bit of BF is initially set to a first value, which is 0. The length m of BF is calculated as follows:

[0119] Among them, P fpis the preset error rate, F is the frame rate corresponding to the standard image data, Duration is the playback duration corresponding to the standard image data, and n is the total number of images in the standard image data, that is, the number of image fingerprints in the second image fingerprint information. For example, if the error rate is set to 0.0003, the frame rate corresponding to the standard image data is 30fps, and the playback duration is 60 seconds, then the total number of images in the standard image data is n = 30 * 60 = 1800, and the required length m of BF is:

[0120] Since the image fingerprint algorithm adopts the hash algorithm, the image fingerprint can be understood as a hash value. There is no need to map it through the hash function in the Bloom filter. For each image fingerprint in the second image fingerprint information, the image fingerprint can be directly subjected to a modulo (mod) operation to determine the array subscript x of the image fingerprint in the bit array of the Bloom filter. The array subscript x of each image fingerprint in the bit array BF of the Bloom filter is calculated as follows: x = h(fn) mod m BF[x] = 1

[0121] Wherein, h(fn) represents the nth image fingerprint in the second image fingerprint information, mod represents the modulo operation, m represents the length of the bit array BF, and BF[x]=1 represents setting the bit corresponding to the array subscript x in the bit array BF to the second value, where the second value is 1.

[0122] When using the generated Bloom filter to retrieve whether each image fingerprint in the first image fingerprint information exists in the Bloom filter, a modular operation can be performed on each image fingerprint in the first image fingerprint information to obtain the array subscript corresponding to each image fingerprint in the first image fingerprint information in the bit array BF of the Bloom filter, and it is checked whether the bits corresponding to the array subscript of the image fingerprint in the bit array BF are all the second numerical value. If so, it is determined that the image fingerprint exists in the Bloom filter.

[0123] In some embodiments, before monitoring a display terminal, a monitoring level corresponding to the display terminal is obtained. The monitoring level corresponding to the display terminal is pre-configured. Based on the monitoring level corresponding to the display terminal, a monitoring type for the display terminal is determined. Based on the monitoring type of the display terminal, whether to monitor the display terminal and the monitoring method for the display terminal are determined. The monitoring types of the display terminal may include, but are not limited to, any of the following: no monitoring required; monitoring only for the correctness of the media content played by the display terminal; monitoring both the correctness and the playback quality of the media content played by the display terminal.

[0124] In some embodiments, before monitoring the display terminal, it is necessary to first register the display terminal and fill in basic information of the terminal, such as brand, model, batch, purpose, location, etc.

[0125] In the embodiment of the present disclosure, an image fingerprint is a set of binary numbers obtained by computing an image according to certain algorithmic rules, and is used to uniquely identify an image.

[0126] In the disclosed embodiments, media monitoring is a means of content security detection, which refers to monitoring and analyzing media materials (videos, images, etc.) played on the display terminal to determine whether the content played on the display terminal meets expectations and whether the playback quality is normal.

[0127] It is understood that the above-mentioned various method embodiments mentioned in this disclosure can be combined with each other to form combined embodiments without violating the principle logic. Due to space limitations, this disclosure will not go into details. It is understood by those skilled in the art that in the above-mentioned methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0128] FIG6 is a schematic structural diagram of a media monitoring device provided by an embodiment of the present disclosure. As shown in FIG6 , the media monitoring device 600 includes: an information acquisition module 601 and a monitoring module 602 .

[0129] Among them, the information acquisition module 601 is configured to obtain first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes the image fingerprint corresponding to each display image; the monitoring module 602 is configured to match the first image fingerprint information with preset fingerprint information, and determine the monitoring result of the media content played by the display terminal based on the matching result.

[0130] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, and the Bloom filter is pre-generated based on the second image fingerprint information corresponding to the standard image data; the monitoring module 602 is configured to: search whether there is an element in the Bloom filter that matches each image fingerprint in the first image fingerprint information; when it is retrieved that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0131] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image; the monitoring module is configured to: compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; when there is at least one image fingerprint in the first image fingerprint information and no corresponding matching image fingerprint is found in the second image fingerprint information, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0132] FIG7 is a schematic diagram of an implementation of a media monitoring device provided by an embodiment of the present disclosure. As shown in FIG7 , in some embodiments, the media monitoring device includes:

[0133] Message communication module: One of the functional modules of the media monitoring device, it cooperates with the device management agent (DMA) on the display terminal according to a certain communication protocol to carry out real-time message communication in the upstream and downstream.

[0134] Terminal management module: responsible for the management of display terminal devices, including registration, activation, enabling, disabling, whitelist management of display terminals, monitoring level configuration of display terminals, monitoring strategy configuration of display terminals, etc. The terminal management module can be used to configure whether the specified display terminal needs to enable the monitoring function, the monitoring level and the monitoring strategy.

[0135] Content promotion and distribution module: used for content promotion and distribution management, including receiving media materials (standard image data) uploaded by users through mobile phones or computers (PCs), managing media materials, and sending media materials to designated display terminals. Standard image data may include images or video data uploaded by users, and standard image data includes at least one standard image.

[0136] Media fingerprint library: used to generate, store, manage and search for image fingerprints of standard images. For each media material (standard image data), a preset image fingerprint algorithm is used to generate corresponding second image fingerprint information. The second image fingerprint information includes the image fingerprint corresponding to each standard image. The image fingerprints in the second image fingerprint information are arranged in order according to the playback order of the standard images in the standard image data to facilitate search. For image materials, one image corresponds to one image fingerprint; for video materials, one video material corresponds to a series of image fingerprints, and one image frame corresponds to one image fingerprint.

[0137] Bloom filter module: responsible for the generation, management, storage and application of Bloom filters. For each media material uploaded by the user, a corresponding Bloom filter is generated according to the second image fingerprint information generated in the media fingerprint library.

[0138] Monitoring service module: responsible for monitoring task management, can monitor the display terminal according to the set monitoring time, and can also monitor the display terminal in response to the user manually triggering the monitoring operation through the mobile phone APP or the computer (PC) web page (web); when monitoring the display terminal, the message communication module sends a monitoring instruction to the display terminal, collects the image fingerprint corresponding to the display image data actually displayed by the display terminal, and interacts with the Bloom filter module and the media fingerprint library to monitor the media content played by the display terminal. The monitoring service module can include the above-mentioned information acquisition module 601 and the monitoring module 602.

[0139] Early warning module: You can configure multiple ways to push alarm information and push targets (users) for alarm information. When the monitoring result is abnormal playback of media content, the early warning module can be used to push alarm information through SMS, WeChat, email, phone and other methods configured in advance by users.

[0140] In the embodiment of the present disclosure, the monitoring service module in the media monitoring device can implement the media monitoring method of the embodiment of the present disclosure by communicating and interacting with other modules, thereby realizing media monitoring of the display terminal.

[0141] FIG8 is a flow chart of a media monitoring method implemented by a media monitoring device according to an embodiment of the present disclosure. As shown in FIG8 , in some embodiments, the media monitoring method implemented by the media monitoring device includes the following steps:

[0142] Step 1: The user uploads the media material to be played to the content promotion and distribution module through the mobile phone APP or web management background. The media material includes standard image data.

[0143] Step 2: The media fingerprint library calculates and stores the image fingerprint of each standard image based on the standard image data, and the Bloom filter module generates a Bloom filter based on the image fingerprint of the standard image data.

[0144] Step 3: The content promotion module sends the media material playback plan to the display terminal through the message communication module.

[0145] Step 4: The display terminal downloads the media material to be played from the content promotion module and plays it according to the playback plan.

[0146] Step 5: The monitoring service module sends a monitoring instruction to the display terminal through the message communication module.

[0147] Step 6: The display terminal uploads the collected display image data according to the monitoring instruction, or uploads the first image fingerprint information generated based on the collected display image data.

[0148] The display image data may be collected from image data cached in a graphics card memory of the display terminal.

[0149] Step 7: The monitoring service module calculates the first image fingerprint information corresponding to the display image data using a preset image fingerprint algorithm, and performs image fingerprint matching through a Bloom filter or a media fingerprint library to obtain the monitoring result of the display terminal.

[0150] Step 8: When the monitoring results show abnormal playback of media content, an alarm message is generated and a multi-channel alarm is pushed through the early warning module.

[0151] The media monitoring device provided in the embodiments of the present disclosure is used to implement the media monitoring method provided in any of the above embodiments. For specific related descriptions, please refer to the description of the media monitoring method in any of the above embodiments, which will not be repeated here.

[0152] FIG9 is a schematic diagram of the system architecture of a media monitoring system provided by an embodiment of the present disclosure. As shown in FIG9 , the media monitoring system 900 includes: a media monitoring device 901 and at least one display terminal 902 .

[0153] The media monitoring device 901 includes the media monitoring device provided in the above embodiment, and the display terminal 902 communicates with the media monitoring device 901 via a device management agent DMA, which is an application program running on the display terminal.

[0154] As shown in FIG9 , in the embodiments of the present disclosure, a display terminal is a terminal device with display capabilities, and is a display device used by users to display multimedia materials such as text, images, and videos, such as monitors, televisions, tablets, all-in-one conference machines, advertising machines, digital signage, smart screens, etc. The display terminal may have a player application, which is application software running on the display terminal for playing media materials.

[0155] FIG10 is a block diagram of another electronic device provided by an embodiment of the present disclosure.

[0156] 10 , an embodiment of the present disclosure provides an electronic device 1000, which includes: at least one processor 1001; at least one memory 1002; and one or more I / O interfaces 1003 connected between the processor 1001 and the memory 1002; wherein the memory 1002 stores one or more computer programs that can be executed by the at least one processor 1001, and the one or more computer programs are executed by the at least one processor 1001 so that the at least one processor 1001 can execute the above-mentioned media monitoring method.

[0157] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-mentioned media monitoring method. The computer-readable storage medium may be a volatile or non-volatile computer-readable storage medium.

[0158] An embodiment of the present disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above-mentioned media monitoring method.

[0159] It will be understood by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable storage medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium).

[0160] As is well known to those skilled in the art, the term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information (such as computer-readable program instructions, data structures, program modules or other data). Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technology, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those skilled in the art, communication media typically contains computer-readable program instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0161] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions to be stored in the computer-readable storage medium in each computing / processing device.

[0162] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., utilizing an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions. The electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0163] The computer program product described herein may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0164] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0165] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0166] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0167] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and the part of the module, program segment or instruction contains one or more executable instructions for realizing the prescribed logical function. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the prescribed function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0168] Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted only in a general illustrative sense and not for purposes of limitation. In some instances, it will be apparent to those skilled in the art that, unless otherwise expressly indicated, features, characteristics, and / or elements described in conjunction with a particular embodiment may be used alone or in combination with features, characteristics, and / or elements described in conjunction with other embodiments. Therefore, it will be understood by those skilled in the art that various changes in form and detail may be made without departing from the scope of the present disclosure as set forth in the appended claims.

Claims

1. A media monitoring method, characterized in that: The media monitoring method comprises: Acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image; The first image fingerprint information is matched with preset fingerprint information, and a monitoring result of the media content played by the display terminal is determined according to the matching result.

2. The media monitoring method according to claim 1, characterized in that: Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes: Sending a monitoring instruction to the display terminal, wherein the monitoring instruction includes an image sampling frequency and an image sampling quantity; receiving display image data collected by the display terminal according to the monitoring instruction; The acquiring of the first image fingerprint information corresponding to the display image data of the display terminal includes: generating the first image fingerprint information according to the display image data based on a preset image fingerprint algorithm.

3. The media monitoring method according to claim 1, wherein: Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes: sending a monitoring instruction to the display terminal, the monitoring instruction including at least an image sampling frequency and an image sampling quantity, so that the display terminal collects the display image data according to the monitoring instruction, and generates the first image fingerprint information based on the display image data based on a preset image fingerprint algorithm; The acquiring of the first image fingerprint information corresponding to the display image data of the display terminal includes: receiving the first image fingerprint information sent by the display terminal.

4. The media monitoring method according to claim 2 or 3, characterized in that: The sending of the monitoring instruction to the display terminal includes: The monitoring instruction is sent to the display terminal according to a set time, or in response to a user's triggering monitoring operation, the monitoring instruction is sent to the display terminal.

5. The media monitoring method according to claim 1, wherein: The preset fingerprint information includes a Bloom filter corresponding to the preset standard image data, and the Bloom filter is pre-generated based on the second image fingerprint information corresponding to the standard image data; The matching of the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal according to the matching result includes: Searching whether there is an element in the Bloom filter that matches each image fingerprint in the first image fingerprint information; When it is retrieved that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

6. The media monitoring method according to claim 1, characterized in that: The preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image; The matching of the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played by the display terminal according to the matching result includes: comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; When there is at least one image fingerprint in the first image fingerprint information for which no corresponding matching image fingerprint is found in the second image fingerprint information, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

7. The media monitoring method according to claim 6, characterized in that: In a case where the display image data includes a plurality of continuously acquired display images and the standard image data includes a plurality of standard images, after comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information, the media monitoring method further includes: When an image fingerprint matching each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there is no duplicate matching image fingerprint, and the playback order of the images corresponding to the matching image fingerprints in the second image fingerprint information is continuous, determining that the monitoring result of the display terminal is normal playback of the media content; When an image fingerprint matching each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there is no repeated matching image fingerprint, and the playback order of the images corresponding to the matching image fingerprints in the second image fingerprint information is discontinuous, determining that the monitoring result of the display terminal is abnormal playback of media content; When image fingerprints corresponding to and matching each image fingerprint in the first image fingerprint information are found in the second image fingerprint information, and there are repeated matching image fingerprints, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

8. The media monitoring method according to claim 1, wherein: Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes: Acquire standard image data to be played, wherein the standard image data includes at least one standard image; Based on a preset image fingerprint algorithm, second image fingerprint information is generated according to the standard image data, the preset fingerprint information includes the second image fingerprint information, and the second image fingerprint information includes the image fingerprint corresponding to each standard image.

9. The media monitoring method according to claim 1, characterized in that: Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes: Acquire standard image data to be played, wherein the standard image data includes at least one standard image; generating second image fingerprint information based on the standard image data based on a preset image fingerprint algorithm, wherein the second image fingerprint information includes an image fingerprint corresponding to each standard image; A Bloom filter is generated according to the second image fingerprint information, where the preset fingerprint information includes the Bloom filter.

10. The media monitoring method according to claim 9, characterized in that: Generating a Bloom filter according to the second image fingerprint information includes: Initializing a bit array of a Bloom filter, wherein a bit corresponding to each array subscript in the bit array is initialized to a first value; For each image fingerprint in the second image fingerprint information, perform a modulo operation on the image fingerprint to determine an array subscript of the image fingerprint in the bit array; Setting the bit corresponding to the array subscript of the image fingerprint in the bit array to a second value; A Bloom filter corresponding to the standard image data is obtained.

11. A media monitoring device, characterized in that: The media monitoring device includes: an information acquisition module configured to acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image; The monitoring module is configured to match the first image fingerprint information with preset fingerprint information, and determine a monitoring result of the media content played by the display terminal according to the matching result.

12. The media monitoring device according to claim 11, characterized in that: The preset fingerprint information includes a Bloom filter corresponding to the preset standard image data, and the Bloom filter is pre-generated based on the second image fingerprint information corresponding to the standard image data; The monitoring module is configured to: search the Bloom filter to see whether there is an element corresponding to each image fingerprint in the first image fingerprint information; When it is retrieved that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, it is determined that the monitoring result of the display terminal is abnormal playback of media content.

13. The media monitoring device according to claim 11, characterized in that: The preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes an image fingerprint corresponding to each standard image; The monitoring module is configured to: compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; when there is at least one image fingerprint in the first image fingerprint information that does not find a corresponding matching image fingerprint in the second image fingerprint information, determine that the monitoring result of the display terminal is abnormal playback of media content.

14. A media monitoring system, characterized in that: include: A media monitoring device and at least one display terminal, wherein the media monitoring device comprises the media monitoring device according to any one of claims 11 to 13; The display terminal communicates messages with the media monitoring device through the device management agent program.

15. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs that can be executed by the at least one processor. The one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the media monitoring method according to any one of claims 1 to 10.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the computer program implements the media monitoring method according to any one of claims 1 to 10.