Media playback monitoring method and apparatus, and media playback monitoring system

Abstract

The present disclosure relates to the technical field of computers. Provided are a media playback monitoring method and apparatus, and a media playback monitoring system. The method comprises: acquiring first image fingerprint information corresponding to display image data of a display terminal to be subjected to playback monitoring, wherein the display image data comprises at least one display image played by the display terminal, and the first image fingerprint information comprises an image fingerprint corresponding to each display image; and matching the first image fingerprint information with preset fingerprint information, and on the basis of the matching result, determining a playback monitoring result for media content played by the display terminal. Further provided in the present disclosure are an electronic device and a computer-readable storage medium.

Description

Media monitoring methods and devices, media monitoring systems Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a media monitoring method and apparatus, a media monitoring system, an electronic device, and a computer-readable storage medium. Background Technology

[0002] In existing display terminal playback monitoring technologies, manual inspection is typically used to monitor massive amounts of playback content. This method is not only inefficient but also prone to omissions. Furthermore, due to the diversity of display terminals, achieving unified monitoring across different terminals has become a significant challenge.

[0003] Summary of the Invention

[0004] This disclosure provides a media monitoring method and apparatus, a media monitoring system, an electronic device, and a computer-readable storage medium.

[0005] According to a first aspect of this disclosure, this disclosure provides a media monitoring method, the media monitoring method comprising:

[0006] Obtain first image fingerprint information corresponding to the display image data of the display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes the image fingerprint corresponding to each display image;

[0007] The first image fingerprint information is matched with preset fingerprint information, and the monitoring result of the media content played on the display terminal is determined based on the matching result.

[0008] In some embodiments, before acquiring the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes:

[0009] Send a monitoring command to the display terminal, the monitoring command including the image sampling frequency and the number of image samples;

[0010] Receive display image data collected by the display terminal according to the monitoring instruction;

[0011] The step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal includes: generating the first image fingerprint information based on the display image data according to a preset image fingerprint algorithm.

[0012] In some embodiments, before acquiring the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes: sending a monitoring instruction to the display terminal, the monitoring instruction including at least an image sampling frequency and an image sampling number, so that the display terminal acquires the display image data according to the monitoring instruction, and generates the first image fingerprint information based on the display image data according to a preset image fingerprint algorithm;

[0013] The step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal includes: receiving the first image fingerprint information sent by the display terminal.

[0014] In some embodiments, sending the monitoring instruction to the display terminal includes:

[0015] The monitoring command is sent to the display terminal at a set time, or in response to a user's trigger monitoring operation, the monitoring command is sent to the display terminal.

[0016] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, wherein the Bloom filter is generated in advance based on the second image fingerprint information corresponding to the standard image data;

[0017] The step of matching the first image fingerprint information with preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result includes:

[0018] Search the Bloom filter to see if there is an element that matches each image fingerprint in the first image fingerprint information;

[0019] When it is found that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0020] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, wherein the standard image data includes at least one standard image, and the second image fingerprint information includes image fingerprints corresponding to each standard image;

[0021] The step of matching the first image fingerprint information with preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result includes:

[0022] Compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information;

[0023] When at least one image fingerprint in the first image fingerprint information is not found to have a corresponding matching image fingerprint in the second image fingerprint information, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0024] In some embodiments, where the displayed image data includes a plurality of continuously acquired displayed images and the standard image data includes a plurality of standard images, the media monitoring method further includes, after comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information:

[0025] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there are no duplicate matching image fingerprints, and the image playback order of the matching image fingerprints in the second image fingerprint information is continuous, the monitoring result of the display terminal is determined to be normal playback of media content.

[0026] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there are no duplicate matching image fingerprints, and the image playback order corresponding to the matching image fingerprints in the second image fingerprint information is not continuous, the monitoring result of the display terminal is determined to be abnormal playback media content.

[0027] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there are duplicate matching image fingerprints, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0028] In some embodiments, before acquiring the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes:

[0029] Acquire standard image data to be played, wherein the standard image data includes at least one standard image;

[0030] Based on a preset image fingerprint algorithm, a second image fingerprint is generated according to standard image data. The preset fingerprint information includes the second image fingerprint information, which includes the image fingerprint corresponding to each standard image.

[0031] In some embodiments, before acquiring the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes:

[0032] Acquire standard image data to be played, wherein the standard image data includes at least one standard image;

[0033] Based on a preset image fingerprint algorithm, a second image fingerprint information is generated according to standard image data. The second image fingerprint information includes the image fingerprint corresponding to each standard image.

[0034] A Bloom filter is generated based on the fingerprint information of the second image, wherein the preset fingerprint information includes the Bloom filter.

[0035] In some embodiments, generating a Bloom filter based on the second image fingerprint information includes:

[0036] Initialize a bit array for a Bloom filter, wherein the bit corresponding to each array index in the bit array is initialized to a first value;

[0037] For each image fingerprint in the second image fingerprint information, a modulo operation is performed on the image fingerprint to determine the array index of the image fingerprint in the bit array;

[0038] Set the bit corresponding to the array index of the image fingerprint in the bit array to the second value;

[0039] The Bloom filter corresponding to the standard image data is obtained.

[0040] According to a second aspect of this disclosure, a media monitoring device is provided, the media monitoring device comprising:

[0041] The information acquisition module is configured to acquire first image fingerprint information corresponding to the display image data of the display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image.

[0042] The monitoring module is configured to match the first image fingerprint information with preset fingerprint information and determine the monitoring result of the media content played on the display terminal based on the matching result.

[0043] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, wherein the Bloom filter is generated in advance based on the second image fingerprint information corresponding to the standard image data;

[0044] The monitoring module is configured to: search the Bloom filter for an element that matches each image fingerprint in the first image fingerprint information; and when it is found that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0045] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, wherein the standard image data includes at least one standard image, and the second image fingerprint information includes image fingerprints corresponding to each standard image;

[0046] The monitoring module is configured to: compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; when at least one image fingerprint in the first image fingerprint information does not have a corresponding matching image fingerprint in the second image fingerprint information, determine that the monitoring result of the display terminal is abnormal playback of media content.

[0047] According to a third aspect of this disclosure, this disclosure provides a media monitoring system, the media monitoring system comprising: a media monitoring device and at least one display terminal, the media monitoring device comprising the aforementioned media monitoring device;

[0048] The display terminal communicates with the media monitoring device via a device management agent program.

[0049] According to a fourth aspect of this disclosure, an electronic device is provided, the electronic device comprising:

[0050] At least one processor; and

[0051] A memory communicatively connected to the at least one processor; wherein,

[0052] The memory stores one or more computer programs that can be executed by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the media monitoring method described above.

[0053] According to a fifth aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the media monitoring method described above. Attached Figure Description

[0054] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the embodiments of the present disclosure to explain the disclosure and do not constitute a limitation thereof. The above and other features and advantages will become more apparent to those skilled in the art from the detailed description of exemplary embodiments with reference to the accompanying drawings, in which:

[0055] Figure 1 is a schematic flowchart of a media monitoring method provided in an embodiment of this disclosure.

[0056] Figure 2 is a flowchart illustrating another media monitoring method provided in this embodiment.

[0057] Figure 3 is a flowchart illustrating a specific implementation of step S12 in an embodiment of this disclosure.

[0058] Figure 4 is a flowchart illustrating a specific implementation of step S12 in an embodiment of this disclosure.

[0059] Figure 5 is a schematic diagram of comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information.

[0060] Figure 6 is a schematic diagram of the structure of a media monitoring device provided in an embodiment of this disclosure.

[0061] Figure 7 is a schematic diagram of the implementation of a media monitoring device provided in an embodiment of this disclosure.

[0062] Figure 8 is a schematic flowchart of a media monitoring method based on a media monitoring device provided in an embodiment of this disclosure.

[0063] Figure 9 is a schematic diagram of the system architecture of a media monitoring system provided in an embodiment of this disclosure.

[0064] Figure 10 is a block diagram of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0065] To enable those skilled in the art to better understand the technical solutions of this disclosure, exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments of this disclosure to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0066] Where there is no conflict, the various embodiments of this disclosure and the features thereof in the embodiments may be combined with each other.

[0067] As used herein, the term “and / or” includes any and all combinations of one or more related enumerated entries.

[0068] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that when the terms “comprising” and / or “made of” are used in this specification, the presence of the stated feature, integral, step, operation, element, and / or component is specified, but the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof is not excluded. Words such as “connected” or “linked” are not limited to physical or mechanical connections but can include electrical connections, whether direct or indirect.

[0069] Unless otherwise specified, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning, unless expressly so defined herein.

[0070] Figure 1 is a schematic flowchart of a media monitoring method provided in an embodiment of this disclosure. As shown in Figure 1, the media monitoring method includes steps S11 to S12.

[0071] Step S11: Obtain the first image fingerprint information corresponding to the display image data of the display terminal to be monitored. The display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes the image fingerprint corresponding to each display image.

[0072] Step S12: Match the first image fingerprint information with the preset fingerprint information, and determine the monitoring result of the media content played on the display terminal based on the matching result.

[0073] According to the media monitoring method provided in this disclosure, the image content played on the display terminal is monitored based on image fingerprints. This method can achieve efficient and accurate monitoring of the media content played on the display terminal without significantly increasing the load and cost of the display terminal. Compared with traditional media monitoring methods, it effectively reduces labor costs and effectively improves monitoring efficiency and the reliability of monitoring results.

[0074] Figure 2 is a flowchart illustrating another media monitoring method provided in this embodiment. As shown in Figure 2, in some embodiments, before obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes:

[0075] Step S01: Send a monitoring command to the display terminal. The monitoring command shall include at least the image sampling frequency and the number of image samples.

[0076] In some embodiments, the playback content of the display terminal to be monitored can be monitored according to a preset monitoring strategy. The monitoring strategy for the display terminal is pre-configured. For example, the monitoring strategy may include a timed monitoring strategy and a manual monitoring strategy. The timed monitoring strategy refers to performing the monitoring operation according to a preset period or at a preset time point. The manual monitoring strategy refers to performing the monitoring operation in response to the user's manual triggering.

[0077] Furthermore, sending a monitoring command to the display terminal may further include: sending a monitoring command to the display terminal at a set time, or sending a monitoring command to the display terminal in response to a user's trigger monitoring operation.

[0078] The image sampling frequency and the number of image samples can be set according to the actual situation. For example, when the media content played on the display terminal is a fixed image, the image sampling frequency f can be set to 1 and the number of image samples k can be set to 1, that is, only one image needs to be sampled. When the media content played on the display terminal is video, the image sampling frequency f can be set to the video frame rate fps and the number of image samples k can be set to a value of not less than 5.

[0079] Step S02: Receive the display image data collected by the display terminal according to the monitoring instructions.

[0080] In some embodiments, after receiving a monitoring instruction, the display terminal begins to capture images of the media content being played according to the image sampling frequency and number of images specified in the monitoring instruction. After the display terminal has completed image capture, it receives the display image data captured by the display terminal.

[0081] Furthermore, after receiving the display image data collected by the display terminal according to the monitoring instruction, in step S11, obtaining the first image fingerprint information corresponding to the display image data of the display terminal may further include: generating the first image fingerprint information based on the display image data according to a preset image fingerprint algorithm.

[0082] Furthermore, for each displayed image in the displayed image data, a corresponding image fingerprint is generated using a preset image fingerprint algorithm. The image fingerprint can be used to uniquely identify the corresponding image, thereby obtaining the first image fingerprint information corresponding to the displayed image data.

[0083] In some embodiments, before acquiring the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further includes: sending a monitoring instruction to the display terminal, the monitoring instruction including at least an image sampling frequency and an image sampling quantity, so that the display terminal acquires display image data according to the monitoring instruction and generates the first image fingerprint information based on the display image data according to a preset image fingerprint algorithm.

[0084] The description of the step of sending the monitoring command to the display terminal can be found in the description of step S01 above, and will not be repeated here.

[0085] In some embodiments, the display terminal integrates a preset image fingerprint algorithm. After receiving a monitoring instruction, the display terminal begins to collect images of the media content being played according to the image sampling frequency and the number of image samples in the monitoring instruction. For each display image in the collected display image data, the display terminal uses the preset image fingerprint algorithm to generate a corresponding image fingerprint, thereby obtaining the first image fingerprint information corresponding to the display image data.

[0086] In some embodiments, obtaining the first image fingerprint information corresponding to the display image data of the display terminal may further include: receiving the first image fingerprint information sent by the display terminal.

[0087] In some embodiments, the preset image fingerprint algorithm may include commonly used hash algorithms such as interpolation hashing, mean hashing, perceptual hashing, and wavelet hashing.

[0088] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data, wherein the Bloom filter is generated in advance based on the second image fingerprint information corresponding to the standard image data.

[0089] The standard image data consists of correct image or video data uploaded by the user and intended for playback on the display terminal. For one or more specified display terminals, the user can upload media materials to be played, including the standard image data, through a mobile application (APP) or web management backend. These materials are then sent to the corresponding display terminals. After downloading the media materials, the display terminals play them according to the plan. Under normal circumstances, the display terminals should play the media according to the standard image data. The standard image data may include one or more standard images. Correspondingly, the second image fingerprint information includes the image fingerprint corresponding to each standard image. The second image fingerprint information can be obtained by pre-generating the image fingerprint corresponding to each standard image based on a preset image fingerprint algorithm.

[0090] In this embodiment, a Bloom filter is a probabilistic data structure consisting of a long binary vector and a series of random mapping functions (hash functions). Its characteristics include efficient insertion and querying, and the ability to determine whether a string definitely exists or may exist. The data structure of a Bloom filter is a bit vector, that is, an array of bits composed of 0 and 1 elements. In some embodiments, the image fingerprint corresponding to each standard image in the second image fingerprint information of the standard image data is mapped to the corresponding bits in the bit array of the Bloom filter. The bit array of the Bloom filter records the image fingerprint of each standard image, thereby obtaining the Bloom filter corresponding to the standard image data.

[0091] Figure 3 is a flowchart illustrating a specific implementation of step S12 in an embodiment of this disclosure. In some embodiments, as shown in Figure 3, step S12, which involves matching the first image fingerprint information with preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result, may further include the following steps:

[0092] Step S121a: Search the Bloom filter for elements that match the fingerprints of each image in the first image fingerprint information.

[0093] By mapping each image fingerprint in the first image fingerprint information to the bit array of the Bloom filter, and determining whether the bit corresponding to the mapping position is 1, if all of them are 1, it means that the image fingerprint exists in the Bloom filter; if at least one bit corresponding to the mapping position is not 1, it means that the image fingerprint does not exist in the Bloom filter.

[0094] Step S122a: When at least one image fingerprint in the first image fingerprint information is found not to exist in the Bloom filter, the monitoring result of the display terminal is determined to be abnormal playback media content.

[0095] When at least one image fingerprint in the first image fingerprint information is not found in the Bloom filter, it indicates that there is a display image in the display image data of the display terminal that is inconsistent with the standard image of the standard image data. Therefore, it can be determined that the display terminal is abnormally playing media content.

[0096] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes the image fingerprint corresponding to each standard image.

[0097] Figure 4 is a flowchart illustrating a specific implementation of step S12 in an embodiment of this disclosure. In some embodiments, as shown in Figure 4, step S12, which involves matching the first image fingerprint information with preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result, may further include the following steps:

[0098] Step S121b: Compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information.

[0099] Step S122b: When at least one image fingerprint in the first image fingerprint information is not found to match the corresponding image fingerprint in the second image fingerprint information, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0100] In some embodiments, standard image data is correct image or video data uploaded by the user that needs to be played by the display terminal, and display image data is the image or video data actually played by the display terminal. By comparing each image fingerprint in the first image fingerprint information of the display image data with each image fingerprint in the second image fingerprint information of the labeled image data, it can be determined whether the media content actually played by the display terminal is consistent with the media content required to be played.

[0101] If at least one image fingerprint in the first image fingerprint information cannot be found to match the corresponding image fingerprint in the second image fingerprint information, it indicates that the media content actually played by the display terminal is inconsistent with the media content required to be played. Therefore, the monitoring result of the display terminal is determined to be abnormal media content playback.

[0102] It is understood that the embodiments shown in Figure 3 and Figure 4 can both be used to detect the correctness of media content played on the display terminal. Figure 5 exemplarily shows a schematic diagram of comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information. In some embodiments, when the display image data of the display terminal includes multiple continuously acquired display images and the standard image data includes multiple standard images, in order to further detect the playback quality of the display terminal, the media monitoring method may further include:

[0103] When a matching image fingerprint is found in the second image fingerprint information that corresponds to each image fingerprint in the first image fingerprint information, and there are no duplicate matching image fingerprints, and the image playback order corresponding to the matching image fingerprints in the second image fingerprint information is continuous, the monitoring result of the display terminal is determined to be normal playback media content.

[0104] As shown in the first scenario of Figure 5, h(f1), h(f2), ..., h(fn) represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 represent the image fingerprints corresponding to each display image in the first image fingerprint information. In the first scenario, image fingerprint H1 matches image fingerprint h(f4), image fingerprint H2 matches image fingerprint h(f5), image fingerprint H3 matches image fingerprint h(f6), image fingerprint H4 matches image fingerprint h(f7), and image fingerprint H5 matches image fingerprint h(f8). Furthermore, the image playback order corresponding to h(f4), h(f5), h(f6), h(f7), and h(f8) is continuous, indicating that the playback quality of the display terminal is good and there is no fault. Therefore, it can be determined that the monitoring result of the display terminal is normal playback of media content.

[0105] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there are no duplicate matching image fingerprints, and the playback order of the images corresponding to the matching image fingerprints in the second image fingerprint information is not continuous, the monitoring result of the display terminal is determined to be abnormal playback media content.

[0106] As shown in the second scenario in Figure 5, h(f1), h(f2), ..., h(fn) represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 represent the image fingerprints corresponding to each displayed image in the first image fingerprint information. In the second scenario, image fingerprint H1 matches image fingerprint h(f2), image fingerprint H2 matches image fingerprint h(f3), image fingerprint H3 matches image fingerprint h(f5), image fingerprint H4 matches image fingerprint h(f6), and image fingerprint H5 matches image fingerprint h(f8). Furthermore, the playback order of the images corresponding to h(f2), h(f3), h(f5), h(f6), and h(f8) is not continuous, indicating that there is a frame skipping phenomenon in the playback content of the display terminal, and the playback quality is poor. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback media content.

[0107] When an image fingerprint that matches each image fingerprint in the first image fingerprint information is found in the second image fingerprint information, and there are duplicate matching image fingerprints, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0108] As shown in the third scenario in Figure 5, h(f1), h(f2), ..., h(fn) represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 represent the image fingerprints corresponding to each display image in the first image fingerprint information. In the third scenario, image fingerprint H1 matches image fingerprint h(f4), image fingerprint H2 matches image fingerprint h(f5), image fingerprint H3 matches image fingerprint h(f5), image fingerprint H4 matches image fingerprint h(f6), and image fingerprint H5 matches image fingerprint h(f7). Among them, the image fingerprints that match image fingerprints H2 and H3 are the same image fingerprint h(f5), that is, the display images corresponding to image fingerprints H2 and H3 are the same image. This indicates that there is a stuttering phenomenon in the playback content of the display terminal and the playback quality is poor. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback media content.

[0109] When at least one image fingerprint in the first image fingerprint information cannot be found in the second image fingerprint information, the monitoring result of the display terminal is determined to be abnormal playback of media content.

[0110] As shown in the fourth scenario in Figure 5, h(f1), h(f2), ..., h(fn) represent the image fingerprints corresponding to each standard image in the second image fingerprint information, and H1, H2, ..., H5 represent the image fingerprints corresponding to each displayed image in the first image fingerprint information. Image fingerprint H1 matches image fingerprint h(f4), image fingerprint H2 matches image fingerprint h(f5), while image fingerprints H3, H4, and H5 cannot find corresponding matching image fingerprints in the second image fingerprint information, indicating that the playback content of the display terminal is incorrect and does not meet the expected playback requirements. Therefore, it can be determined that the monitoring result of the display terminal is abnormal playback media content.

[0111] In some embodiments, when it is determined that the monitoring result of the display terminal is abnormal playback of media content, a corresponding alarm message is generated, and the alarm message is pushed to the designated user according to the pre-configured push method and push range, so as to notify the user to handle it in a timely manner.

[0112] In some embodiments, before sending a monitoring instruction to a display terminal, the media monitoring method further includes: acquiring standard image data to be played, the standard image data including at least one standard image; generating second image fingerprint information based on a preset image fingerprint algorithm according to the standard image data, the preset fingerprint information including the second image fingerprint information, the second image fingerprint information including the image fingerprint corresponding to each standard image.

[0113] In some embodiments, before sending a monitoring instruction to a display terminal, the media monitoring method further includes: acquiring standard image data to be played, the standard image data including at least one standard image; generating second image fingerprint information based on the standard image data according to a preset image fingerprint algorithm, the second image fingerprint information including an image fingerprint corresponding to each standard image; and generating a Bloom filter based on the second image fingerprint information, the preset fingerprint information including a Bloom filter.

[0114] In some embodiments, the preset fingerprint information may include second image fingerprint information corresponding to standard image data and a Bloom filter. In the step of matching the first image fingerprint information with the preset fingerprint information and determining the monitoring result of the media content played on the display terminal based on the matching result, the image fingerprint in the first image fingerprint information may be retrieved first using a Bloom filter to check the correctness of the content played on the display terminal, and then compared with the second image fingerprint information to check the playback quality of the content played on the display terminal.

[0115] In some embodiments, if the media material uploaded by the user is a single standard image, a corresponding image fingerprint is generated using a preset image fingerprint algorithm to obtain the second image fingerprint information; if the media material is a video, the video is decoded to obtain standard image data, and for each frame of the standard image data, a corresponding image fingerprint is generated using the preset image fingerprint algorithm to obtain the second image fingerprint information. The image fingerprints in the second image fingerprint information are arranged in the order of the frame sequence and stored in the correspondence of the media material, as shown in Table 1 below, where h(fn) represents the image fingerprint generated for the nth frame in the media material.

[0116] Table 1

[0117] In some embodiments, generating a Bloom filter based on the second image fingerprint information may further include: initializing a bit array for the Bloom filter, wherein the bit corresponding to each array index in the bit array is initialized to a first value; performing a modulo operation on each image fingerprint in the second image fingerprint information to determine the array index of the image fingerprint in the bit array; setting the bit corresponding to the array index of the image fingerprint in the bit array to a second value; and obtaining a Bloom filter corresponding to the standard image data.

[0118] For example, initialize a bit array of length m, denoted as BF. Each bit of BF is initially set to the first value, which is 0. The length m of BF is calculated as follows:

[0119] Where P fpLet F be the preset false positive rate, F be the frame rate corresponding to the standard image data, Duration be the playback duration corresponding to the standard image data, and n be the total number of images in the standard image data, i.e., the number of image fingerprints in the second image fingerprint information. For example, if the false positive rate is set to 0.0003, the frame rate corresponding to the standard image data is 30fps, and the playback duration is 60 seconds, then the total number of images in the standard image data n = 30 * 60 = 1800, and the required length m of BF is:

[0120] Since the image fingerprint algorithm uses a hash algorithm, an image fingerprint can be understood as a hash value. In the Bloom filter, there's no need for further mapping using a hash function. For each image fingerprint in the second image fingerprint information, a modulo operation can be directly performed to determine its array index x in the bit array of the Bloom filter. The calculation method for the array index x of each image fingerprint in the bit array BF of the Bloom filter is as follows: x = h(fn) mod m BF[x] = 1

[0121] Where h(fn) represents the nth image fingerprint in the second image fingerprint information, mod represents the modulo operation, m represents the length of the bit array BF, and BF[x] = 1 means that the bit corresponding to the array index x in the bit array BF is set to the second value, which is 1.

[0122] When using the generated Bloom filter to search for whether each image fingerprint in the first image fingerprint information exists in the Bloom filter, a modulo operation can be performed on each image fingerprint in the first image fingerprint information to obtain the array index corresponding to each image fingerprint in the bit array BF of the Bloom filter, and check whether the bits corresponding to the array index of the image fingerprint in the bit array BF are all the second value. If so, it is determined that the image fingerprint exists in the Bloom filter.

[0123] In some embodiments, before monitoring the display terminal, the monitoring level corresponding to the display terminal is obtained. The monitoring level corresponding to the display terminal is pre-configured. Based on the monitoring level, the monitoring type of the display terminal is determined. Based on the monitoring type, it is determined whether to monitor the display terminal and the monitoring method. The monitoring type of the display terminal may include, but is not limited to, any of the following: no monitoring required; monitoring only the correctness of the media content played by the display terminal; monitoring both the correctness and the playback quality of the media content played by the display terminal.

[0124] In some embodiments, before monitoring the display terminal, it is necessary to register the display terminal as a terminal device and fill in the basic information of the terminal device, such as brand, model, batch, purpose, location, etc.

[0125] In this embodiment of the disclosure, an image fingerprint is a set of binary numbers obtained by processing an image according to certain algorithm rules, which is used to uniquely identify an image.

[0126] In this embodiment of the disclosure, media monitoring is a content security detection method, which refers to monitoring and analyzing media materials (videos, images, etc.) played on a display terminal to determine whether the content played on the display terminal meets expectations and whether the playback quality is normal.

[0127] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further. Those skilled in the art will understand that in the above methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0128] Figure 6 is a schematic diagram of the structure of a media monitoring device provided in an embodiment of the present disclosure. As shown in Figure 6, the media monitoring device 600 includes: an information acquisition module 601 and a monitoring module 602.

[0129] The information acquisition module 601 is configured to acquire first image fingerprint information corresponding to the display image data of the display terminal to be monitored, wherein the display image data includes at least one display image played by the display terminal, and the first image fingerprint information includes an image fingerprint corresponding to each display image; the monitoring module 602 is configured to match the first image fingerprint information with preset fingerprint information, and determine the monitoring result of the media content played on the display terminal based on the matching result.

[0130] In some embodiments, the preset fingerprint information includes a Bloom filter corresponding to preset standard image data. The Bloom filter is generated in advance based on the second image fingerprint information corresponding to the standard image data. The monitoring module 602 is configured to: search the Bloom filter for an element that matches each image fingerprint in the first image fingerprint information; when it is found that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, determine that the monitoring result of the display terminal is abnormal playback media content.

[0131] In some embodiments, the preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data includes at least one standard image, and the second image fingerprint information includes image fingerprints corresponding to each standard image; the monitoring module is configured to: compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; when at least one image fingerprint in the first image fingerprint information is not found to have a corresponding matching image fingerprint in the second image fingerprint information, determine that the monitoring result of the display terminal is abnormal playback media content.

[0132] Figure 7 is a schematic diagram of an implementation of a media monitoring device provided in an embodiment of this disclosure. As shown in Figure 7, in some embodiments, the media monitoring device includes:

[0133] Message communication module: One of the functional modules of the media monitoring device, which works with the Device Management Agent (DMA) program on the display terminal to conduct real-time uplink and downlink message communication according to a certain communication protocol.

[0134] Terminal Management Module: Responsible for the management of display terminal devices, including the registration, activation, enabling, and disabling of display terminals, whitelist management of display terminals, configuration of display terminal monitoring levels, and configuration of display terminal monitoring policies. Through the terminal management module, you can configure whether a specified display terminal needs to enable the monitoring function, the monitoring level, and the monitoring policy.

[0135] Content distribution module: Used for content distribution management, including receiving media materials (standard image data) uploaded by users via mobile phone or computer (PC), managing media materials, and distributing media materials to designated display terminals. Standard image data may include image or video data uploaded by users, and standard image data includes at least one standard image.

[0136] Media fingerprint database: Used to generate, store, manage and search image fingerprints of standard images. For each media material (standard image data), a corresponding second image fingerprint is generated using a preset image fingerprint algorithm. The second image fingerprint information includes the image fingerprint corresponding to each standard image. The image fingerprints in the second image fingerprint information are arranged in order according to the playback order of the standard images in the standard image data to facilitate searching. For image materials, one image corresponds to one image fingerprint; for video materials, one video material corresponds to a series of image fingerprints, with one image frame corresponding to one image fingerprint.

[0137] Bloom filter module: Responsible for the generation, management, storage and application of Bloom filters. For each media material uploaded by the user, it generates a corresponding Bloom filter based on the second image fingerprint information generated in the media fingerprint database.

[0138] The monitoring service module is responsible for managing monitoring tasks. It can monitor the display terminal according to the set monitoring time, or respond to users' manual triggering of monitoring operations through a mobile APP or a computer (PC) web interface. When monitoring the display terminal, it sends monitoring instructions to the display terminal through the message communication module, collects the image fingerprint corresponding to the actual displayed image data of the display terminal, and realizes the monitoring of the media content played on the display terminal by interacting with the Bloom filter module and the media fingerprint database. The monitoring service module can include the aforementioned information acquisition module 601 and monitoring module 602.

[0139] Early warning module: It can be configured with various alarm information push methods and alarm information push targets (users). When the monitoring result shows abnormal media content playback, the early warning module can push alarm information through various user-configured methods such as SMS, WeChat, email, and telephone.

[0140] In this embodiment of the disclosure, the monitoring service module in the media monitoring device can communicate and interact with other modules to implement the media monitoring method of this embodiment, thereby enabling media monitoring of the display terminal.

[0141] Figure 8 is a flowchart illustrating a media monitoring method based on a media monitoring device according to an embodiment of this disclosure. As shown in Figure 8, in some embodiments, the media monitoring method based on a media monitoring device includes the following steps:

[0142] Step 1: Users upload media materials to be played to the content distribution module through the mobile APP or web management backend. The media materials include standard image data.

[0143] Step 2: The media fingerprint library calculates and stores the image fingerprint of each standard image based on the standard image data, and the Bloom filter module generates a Bloom filter based on the image fingerprint of the standard image data.

[0144] Step 3: The content distribution module sends the media material playback plan to the display terminal through the message communication module.

[0145] Step 4: The display terminal downloads the media materials to be played from the content distribution module and plays them according to the playback plan.

[0146] Step 5: The monitoring service module sends monitoring instructions to the display terminal through the message communication module.

[0147] Step 6: The display terminal uploads the collected display image data according to the monitoring instructions, or uploads the first image fingerprint information generated based on the collected display image data.

[0148] Among them, the displayed image data can be collected from the image data cached in the graphics card memory of the display terminal.

[0149] Step 7: The monitoring service module uses a preset image fingerprint algorithm to calculate the first image fingerprint information corresponding to the displayed image data, and performs image fingerprint matching through a Bloom filter or media fingerprint library to obtain the monitoring result of the display terminal.

[0150] Step 8: When the monitoring results show abnormal playback of media content, generate alarm information and push alarms through multiple channels via the early warning module.

[0151] The media monitoring device provided in this disclosure is used to implement the media monitoring method provided in any of the above embodiments. For specific related descriptions, please refer to the descriptions in the media monitoring methods of any of the above embodiments, which will not be repeated here.

[0152] Figure 9 is a schematic diagram of the system architecture of a media monitoring system provided in an embodiment of this disclosure. As shown in Figure 9, the media monitoring system 900 includes: a media monitoring device 901 and at least one display terminal 902.

[0153] The media monitoring device 901 includes the media monitoring device provided in the above embodiments, and the display terminal 902 communicates with the media monitoring device 901 via a device management agent program (DMA). The DMA is an application program running on the display terminal.

[0154] As shown in Figure 9, in this embodiment of the disclosure, the display terminal is a terminal device with display capabilities, used by users to display multimedia materials such as text, images, and videos, such as monitors, televisions, tablets, all-in-one conference machines, advertising machines, digital signage, smart screens, etc. The display terminal may have a player application, which is application software running on the display terminal for playing media materials.

[0155] Figure 10 is a block diagram of another electronic device provided in an embodiment of this disclosure.

[0156] Referring to FIG10, an embodiment of this disclosure provides an electronic device 1000, which includes: at least one processor 1001; at least one memory 1002; and one or more I / O interfaces 1003 connected between the processor 1001 and the memory 1002; wherein the memory 1002 stores one or more computer programs that can be executed by the at least one processor 1001, and the one or more computer programs are executed by the at least one processor 1001 to enable the at least one processor 1001 to perform the media monitoring method described above.

[0157] This disclosure also provides a computer-readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor, implements the media monitoring method described above. The computer-readable storage medium may be volatile or non-volatile.

[0158] This disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device executes the above-described media monitoring method.

[0159] Those skilled in the art will understand that all or some of the steps, systems, and apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software can be distributed on a computer-readable storage medium, which may include computer storage media (or non-transitory media) and communication media (or transient media).

[0160] As is known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable program instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technologies, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, it is known to those skilled in the art that communication media typically contain computer-readable program instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0161] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0162] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0163] The computer program product described herein can be implemented specifically through hardware, software, or a combination thereof. In one alternative embodiment, the computer program product is specifically embodied in a computer storage medium; in another alternative embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0164] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0165] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0166] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0167] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0168] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for illustrative purposes only and should be construed as such, and is not intended to be limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in connection with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in connection with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of this disclosure as set forth by the appended claims.

Claims

1. A method of media monitoring, characterized by, The media monitoring method comprises: obtaining first image fingerprint information corresponding to display image data of a display terminal to be monitored, the display image data comprising at least one display image played by the display terminal, the first image fingerprint information comprising image fingerprints corresponding to each display image; matching the first image fingerprint information with preset fingerprint information, and determining a monitoring result of media content played by the display terminal according to a matching result.

2. The media monitoring method of claim 1, wherein, Before the step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further comprises: sending a monitoring instruction to the display terminal, the monitoring instruction comprising an image sampling frequency and an image sampling quantity; receiving display image data collected by the display terminal according to the monitoring instruction; the step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal comprises: generating the first image fingerprint information from the display image data based on a preset image fingerprint algorithm.

3. The method of claim 1, wherein, Before the step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal, the media monitoring method further comprises: sending a monitoring instruction to the display terminal, the monitoring instruction comprising at least an image sampling frequency and an image sampling quantity, so that the display terminal collects the display image data according to the monitoring instruction, and generates the first image fingerprint information from the display image data based on a preset image fingerprint algorithm; the step of obtaining the first image fingerprint information corresponding to the display image data of the display terminal comprises: receiving the first image fingerprint information sent by the display terminal.

4. The media monitoring method according to claim 2 or 3, characterized in that, The step of sending the monitoring instruction to the display terminal comprises: sending the monitoring instruction to the display terminal at a set time, or sending the monitoring instruction to the display terminal in response to a user triggering a monitoring operation.

5. The method of claim 1, wherein, The preset fingerprint information comprises a Bloom filter corresponding to preset standard image data, the Bloom filter being generated in advance according to second image fingerprint information corresponding to the standard image data; the step of matching the first image fingerprint information with preset fingerprint information, and determining a monitoring result of media content played by the display terminal according to a matching result, comprises: searching the Bloom filter for whether there is an element corresponding to each image fingerprint in the first image fingerprint information; when it is searched that at least one image fingerprint in the first image fingerprint information does not exist in the Bloom filter, determining that the monitoring result of the display terminal is abnormal media content playing.

6. The method of claim 1, wherein, The preset fingerprint information comprises second image fingerprint information corresponding to preset standard image data, the standard image data comprising at least one standard image, the second image fingerprint information comprising image fingerprints corresponding to each standard image; the step of matching the first image fingerprint information with preset fingerprint information, and determining a monitoring result of media content played by the display terminal according to a matching result, comprises: comparing each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information; When at least one image fingerprint in the first image fingerprint information is not found a corresponding matching image fingerprint in the second image fingerprint information, it is determined that the monitoring result of the display terminal is abnormal playing media content.

7. The method of claim 6, wherein, In the case that the display image data includes a plurality of display images continuously collected, and the standard image data includes a plurality of standard images, after the comparison of each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information, the media monitoring method further includes: When each image fingerprint in the first image fingerprint information is found a corresponding matching image fingerprint in the second image fingerprint information, and there is no repeated matching image fingerprint, and the playing order of the matching image fingerprints in the second image fingerprint information is continuous, it is determined that the monitoring result of the display terminal is normal playing media content; When each image fingerprint in the first image fingerprint information is found a corresponding matching image fingerprint in the second image fingerprint information, and there is no repeated matching image fingerprint, and the playing order of the matching image fingerprints in the second image fingerprint information is not continuous, it is determined that the monitoring result of the display terminal is abnormal playing media content; When each image fingerprint in the first image fingerprint information is found a corresponding matching image fingerprint in the second image fingerprint information, and there is repeated matching image fingerprint, it is determined that the monitoring result of the display terminal is abnormal playing media content.

8. The method of claim 1, wherein, Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes: Obtaining standard image data to be played, the standard image data including at least one standard image; Generating second image fingerprint information according to the standard image data based on a preset image fingerprint algorithm, the preset fingerprint information including the second image fingerprint information, and the second image fingerprint information including an image fingerprint corresponding to each standard image.

9. The method of claim 1, wherein, Before obtaining the first image fingerprint information corresponding to the display image data of the display terminal to be monitored, the media monitoring method further includes: Obtaining standard image data to be played, the standard image data including at least one standard image; Generating second image fingerprint information according to the standard image data based on a preset image fingerprint algorithm, the second image fingerprint information including an image fingerprint corresponding to each standard image; Generating a Bloom filter according to the second image fingerprint information, the preset fingerprint information including the Bloom filter.

10. The media monitoring method of claim 9, wherein, The generating a Bloom filter according to the second image fingerprint information includes: Initializing a bit array of a Bloom filter, each array subscript in the bit array being initialized to a first value; For each image fingerprint in the second image fingerprint information, performing a modulo operation on the image fingerprint to determine an array subscript of the image fingerprint in the bit array; Setting a bit corresponding to the array subscript of the image fingerprint in the bit array to a second value; Obtaining the Bloom filter corresponding to the standard image data.

11. A media monitoring apparatus, characterized by The media monitoring device includes: The information acquisition module is configured to acquire first image fingerprint information corresponding to display image data of a display terminal to be monitored, the display image data including at least one display image played by the display terminal, and the first image fingerprint information including image fingerprints corresponding to each display image. The monitoring module is configured to match the first image fingerprint information with preset fingerprint information, and determine a monitoring result of media content played by the display terminal according to a matching result.

12. The media monitoring apparatus of claim 11, wherein, The preset fingerprint information includes a Bloom filter corresponding to preset standard image data, and the Bloom filter is generated in advance according to second image fingerprint information corresponding to the standard image data. The monitoring module is configured to search whether each image fingerprint in the first image fingerprint information exists in the Bloom filter. When at least one image fingerprint in the first image fingerprint information is searched not to exist in the Bloom filter, it is determined that the monitoring result of the display terminal is abnormal playing of media content.

13. The media monitoring apparatus of claim 11, wherein, The preset fingerprint information includes second image fingerprint information corresponding to preset standard image data, the standard image data including at least one standard image, and the second image fingerprint information including image fingerprints corresponding to each standard image. The monitoring module is configured to compare each image fingerprint in the first image fingerprint information with each image fingerprint in the second image fingerprint information, and when at least one image fingerprint in the first image fingerprint information is not found to have a corresponding matching image fingerprint in the second image fingerprint information, it is determined that the monitoring result of the display terminal is abnormal playing of media content.

14. A media monitoring system, characterized by The media monitoring device and the at least one display terminal, the media monitoring device comprising the media monitoring device according to any one of claims 11 to 13. The display terminal communicates messages between the device management agent and the media monitoring device. The media monitoring device and the at least one display terminal, the media monitoring device comprising the media monitoring device according to any one of claims 11 to 13.

15. An electronic device, comprising: The display terminal communicates messages between the device management agent and the media monitoring device. The at least one processor; and The memory is in communication with the at least one processor; and The memory stores one or more computer programs executable by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the media monitoring method according to any one of claims 1 to 10.

16. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the media monitoring method according to any one of claims 1 to 10.

Images