A monitoring system for interactive network television

Abstract

The present invention discloses a monitoring system for an interactive network television. The monitoring system comprises: an interactive network television, a multimedia acquisition device and a monitoring device; the interactive network television is used to display multimedia data to be monitored; the multimedia acquisition device is used to acquire the multimedia data and transmit target data to the monitoring device, the target data being determined based on the multimedia data; the monitoring device is used to monitor the interactive network television based on the target data. By using the monitoring system, the monitoring device can monitor the interactive network television by transmitting the target data to the monitoring device, so as to improve the user experience.

Description

Technical Field

[0001] The embodiment of the present invention relates to the field of monitoring technology, and in particular to a monitoring system for an interactive network television. Background Art

[0002] Internet Protocol Television (IPTV) is a new technology that uses broadband cable television networks to integrate multiple technologies such as the Internet, multimedia, and communications to provide home users with a variety of interactive services including digital television.

[0003] Users can watch programs on the IPTV platform, but since most of the networks at limited locations are usually within the bureau's intranet, remote manual monitoring is not possible. Therefore, when the operation configuration interface contains content that affects the physical and mental health of users (such as children), it is impossible to monitor and issue warnings. Summary of the invention

[0004] The embodiment of the present invention provides a monitoring system for an interactive network television, so as to monitor the interactive network television efficiently.

[0005] The embodiment of the present invention provides a monitoring system for an interactive network television, comprising: an interactive network television, a multimedia acquisition device and a monitoring device;

[0006] The interactive network television is used to display the multimedia data to be monitored;

[0007] The multimedia acquisition device is used to acquire the multimedia data and transmit target data to the monitoring device, wherein the target data is determined based on the multimedia data;

[0008] The monitoring device is used for monitoring the interactive network television based on the target data.

[0009] Optionally, the interactive network television is specifically used to: obtain an instruction set, and automatically play multimedia data corresponding to the instruction set based on the instruction set, the instruction set including a first selection instruction, a first play instruction and a first return instruction, one instruction set corresponds to at least one multimedia data, the first selection instruction is used to select the multimedia data, the first play instruction is used to play the multimedia data, the first return instruction is used to return to the previous level interface after playing the multimedia data, and the instruction set is determined based on the interface layout information of the interactive network television.

[0010] The interactive network television is specifically used to: determine a second selection instruction of the multimedia data to be monitored in the real-time image based on the real-time image of the program list collected by the multimedia acquisition device, the second selection instruction is used to select the multimedia data, the second selection instruction includes the location information of the multimedia data in the real-time image, after the multimedia data is selected based on the second selection instruction, control the playback of the multimedia data based on the second playback instruction, and after the multimedia data is played, return to the previous level interface based on the second return instruction.

[0011] Optionally, the method further includes:

[0012] The interactive network television continues to determine the next multimedia data to be monitored in the real-time image to monitor the multimedia data.

[0013] Optionally, the target data transmitted by the multimedia acquisition device is the multimedia data or filtered multimedia data.

[0014] Optionally, the multimedia acquisition device is specifically used to: perform character recognition on the multimedia data, and if a character is recognized in the multimedia data, then recognize the multimedia data; if the multimedia data violates set specifications, then use the multimedia data as the target data.

[0015] Optionally, when the target data is the multimedia data, the monitoring device is specifically used to identify the target data, and if the target data violates the set specifications, generate warning information based on the identification result, the target data and the identification information of the interactive network TV; send the warning information to the target user, and the warning information is used to characterize that the target data of the interactive network TV does not meet the set specifications.

[0016] Optionally, when the target data is filtered multimedia data, the monitoring device is specifically configured to generate warning information based on the target data and identification information of the interactive network television; and send the warning information to a target user.

[0017] Optionally, the monitoring device is specifically used to identify target data, and if the target data violates set specifications, generate warning information based on the identification result, the target data and identification information of the interactive network television; and send the warning information to the target user.

[0018] Optionally, the multimedia data includes one or more of audio, video and pictures.

[0019] The embodiment of the present invention provides a monitoring system for an interactive network television, the monitoring system for the interactive network television comprising: an interactive network television, a multimedia acquisition device and a monitoring device; the interactive network television is used to display multimedia data to be monitored; the multimedia acquisition device is used to acquire the multimedia data and transmit target data to the monitoring device, the target data being determined based on the multimedia data; the monitoring device is used to monitor the interactive network television based on the target data. By using the above technical solution, the monitoring device can monitor the interactive network television by transmitting the target data to the monitoring device, so as to improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of the structure of a monitoring system for an interactive network television provided by an embodiment of the present invention;

[0021] Figure 2 A schematic diagram of the structure of another monitoring system for interactive network television provided by an embodiment of the present invention;

[0022] Figure 3 A schematic diagram of a monitoring process based on a monitoring system provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0023] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0024] It should be mentioned before discussing exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe various operations (or steps) as sequential processes, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of various operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to methods, functions, procedures, subroutines, subprograms, etc. In addition, the embodiments in the present invention and the features in the embodiments can be combined with each other without conflict.

[0025] The term “including” and its variations used in the present invention are open inclusions, that is, “including but not limited to.” The term “based on” means “based at least in part on.” The term “one embodiment” means “at least one embodiment.”

[0026] It should be noted that the concepts such as "first" and "second" mentioned in the present invention are only used to distinguish the corresponding contents, and are not used to limit the order or interdependence.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] Figure 1 A schematic diagram of the structure of a monitoring system for an interactive network television provided by an embodiment of the present invention. The method is applicable to monitoring the content played by the interactive network television.

[0029] It should be noted that the present invention is used for monitoring interactive network televisions by product providers or content providers, rather than monitoring interactive network televisions by users. The monitored interactive network televisions may be one or more interactive network televisions randomly selected from the same batch, model or version of interactive network televisions shipped from the factory. The selected interactive network televisions are provided for monitoring by product providers or content providers to avoid monitoring at the user end. Since the interactive network televisions monitored by the product provider or content provider and the interactive network televisions used by the user end are from the same batch, model or version of interactive network televisions, and the displayed content is the same, the monitoring system of the present invention can synchronously monitor the interactive network television at the user end.

[0030] like Figure 1 As shown, an interactive network television monitoring system provided by an embodiment of the present invention includes: an interactive network television 1, a multimedia acquisition device 2 and a monitoring device 3;

[0031] The interactive network television 1 is used to display the multimedia data to be monitored;

[0032] The multimedia acquisition device 2 is used to collect multimedia data and transmit target data to the monitoring device 3, and the target data is determined based on the multimedia data;

[0033] The monitoring device 3 monitors the interactive network television 1 based on the target data.

[0034] Among them, the interactive network TV 1 can be a cable TV network infrastructure, with home TVs as the main terminal devices, and provide a variety of digital media services including TV programs through the Internet protocol. The interactive network TV 1 has a strong real-time feature and can be suitable for user interactive on-demand or broadcasting. Multimedia data can be a combination of multiple media data, including one or more of audio, video and pictures. The multimedia acquisition device 2 can be understood as a device for collecting multimedia data, such as an AI intelligent recognition camera.

[0035] The target data may be considered as multimedia data that may contain data that violates the set specifications. The multimedia data that violates the set specifications may include content that affects the physical and mental health of users (children). The target data may include multimedia data collected by the multimedia acquisition device 2, and may also include multimedia data screened by the multimedia acquisition device 2. The target data may be determined based on the multimedia data. This embodiment does not limit the method for determining the target data. For example, the multimedia data collected by the multimedia acquisition device 2 may be directly determined as the target data. Alternatively, when the multimedia acquisition device 2 recognizes that the multimedia data contains data that violates the set specifications, the multimedia data that violates the set specifications may be considered as the target data.

[0036] The monitoring device 3 can be understood as a device for monitoring the interactive network television 1 based on target data, and may include a monitoring server and the like.

[0037] Specifically, the interactive network television 1 can display the multimedia data to be monitored, the multimedia acquisition device 2 realizes the acquisition of the multimedia data and transmits the target data to the monitoring device 3, and the monitoring device 3 can monitor and process the interactive network television 1 based on the target data. The interactive network television 1 can display the multimedia data to be monitored in real time to realize real-time monitoring of the multimedia data.

[0038] It is understandable that, as a feasible method, the multimedia data to be monitored displayed by the interactive network television 1 can be multimedia data synchronized with the multimedia data played by the user end, such as multimedia data provided by the same content provider, the interactive network television 1 can select, play and / or return the multimedia data to be played according to the instructions in the instruction set to complete the display from the home page to the full-screen play page in a cycle, so that all the content in the home page is played as multimedia data, or the set content in the home page is played as multimedia data, and the set content can be limited according to the actual situation, such as setting the content such as the content related to the children's channel. The instruction set can be determined in advance by the developer according to the content provided by the content provider, which is not limited here, such as determining the instruction set based on the interface layout information of the interactive network television.

[0039] As another feasible method, the multimedia data to be monitored displayed by the interactive network TV 1 may be included in the real-time image of the program list captured by the multimedia acquisition device 2. The interactive network TV 1 may determine the instructions for the multimedia data to be monitored in the real-time image based on the real-time image. For example, the instructions may be instructions for selecting, playing and / or returning the multimedia data to be played. Then, the multimedia data to be monitored may be displayed according to the instructions for the multimedia data to be monitored in the real-time image.

[0040] Optionally, the interactive network television 1 can be specifically used to: obtain an instruction set, and automatically play the multimedia data corresponding to the instruction set based on the instruction set, the instruction set including a first selection instruction, a first play instruction and a first return instruction, one instruction set corresponds to at least one multimedia data, the first selection instruction is used to select multimedia data, the first play instruction is used to play multimedia data, the first return instruction is used to return to the previous level interface after playing the multimedia data, and the instruction set is determined based on the interface layout information of the interactive network television 1.

[0041] Among them, the instruction set can be considered as a set of instructions pre-set by the developer, and the instruction set is used to control the playback of multimedia data. One instruction set corresponds to at least one multimedia data, and the instruction set may include a first selection instruction, a first playback instruction, and a second return instruction. The first selection instruction may refer to an instruction for selecting multimedia data, the first playback instruction may refer to an instruction for playing multimedia data, and the first return instruction may refer to an instruction for returning to the previous interface after playing multimedia data. The first selection instruction, the first playback instruction, and the first return instruction may be determined based on the interface layout information of the interactive network TV 1. The interface layout information may be the interface information currently displayed by the interactive network TV 1, and may include the number of interface pictures, picture layout information, and the position information of pictures in the interface, etc. Among them, the picture may be the cover of the multimedia data.

[0042] Optionally, the interactive network television 1 can also be specifically used for: determining a second selection instruction for multimedia data to be monitored in the real-time image based on the real-time image of the program list captured by the multimedia capture device 2, the second selection instruction being used to select the multimedia data, the second selection instruction including the location information of the multimedia data in the real-time image, after the multimedia data is selected based on the second selection instruction, controlling the playback of the multimedia data based on the second playback instruction, and returning to the previous level interface based on the second return instruction after the multimedia data is played.

[0043] Among them, the program list can be considered as a real-time program collection of the interactive network TV 1, including channel programs and / or on-demand programs, etc.; the second selection instruction can refer to an instruction to select the multimedia data to be monitored in the real-time image, which can be determined based on the real-time image of the program list captured by the multimedia acquisition device 2, the second play instruction can refer to an instruction to play the multimedia data, and the second return instruction can refer to an instruction to return to the previous level interface after playing the multimedia data.

[0044] The first selection instruction and the second selection instruction of the present invention can replace the up, down, left, and right buttons of the remote control or the movement of the mouse to realize the selection of multimedia data. After the multimedia data is selected based on the second selection instruction, the first play instruction or the second play instruction can replace the middle confirmation button of the remote control or the double-click of the mouse to play the multimedia data. After the multimedia data is played, the second return instruction or the first return instruction can replace the return button of the remote control or click the return button of the current interface by the mouse to return to the previous level interface. The first selection instruction and the second selection instruction, the first play instruction and the second play instruction, and the first return instruction and the second return instruction are only used to distinguish different objects, and this embodiment does not limit this.

[0045] In addition, the monitoring system further includes: the interactive network television 1 continues to determine the next multimedia data to be monitored in the real-time image to monitor the multimedia data.

[0046] The interactive network television 1 can display the multimedia data to be monitored based on the second selection instruction, the second play instruction and the second return instruction of the multimedia data to be monitored in the real-time image. After responding to the second return instruction, the interactive network television 1 can return to the previous interface, that is, the interface before executing the second play instruction. The interactive network television 1 can also continue to determine the next second selection instruction, the second play instruction and the second return instruction based on the real-time image to realize the monitoring of the next multimedia data to be monitored.

[0047] It should be noted that the multimedia acquisition device 2 can collect multimedia data and transmit target data to the monitoring device 3. In addition, the multimedia acquisition device 2 can also screen the collected multimedia data. If it is identified that the collected multimedia data contains multimedia data that violates the set specifications, the multimedia data that violates the set specifications will be identified as target data.

[0048] In one embodiment, the multimedia acquisition device 2 is specifically used for: performing character recognition on multimedia data. If a character is recognized in the multimedia data, the multimedia data is recognized; if the multimedia data violates the set specification, the multimedia data is used as target data.

[0049] In this embodiment, the multimedia acquisition device 2 can make a preliminary judgment on the collected multimedia data, that is, judge whether the multimedia data violates the set regulations, and if so, transmit the violated multimedia data as target data to the monitoring device 3. Specifically, the multimedia acquisition device 2 can first determine whether the multimedia data includes a person, and the determination means are not limited here, such as identifying a picture, identifying a sound, or identifying a captured image after performing frame capture processing on a video.

[0050] Since most of the content that affects the physical and mental health of users (such as children) protects people, the multimedia acquisition device 2 first screens the multimedia data to see whether it includes people. If it does, the multimedia data including the people is further identified again to determine whether it violates the set specifications. The specific means of identification are not limited here.

[0051] The set standards include but are not limited to whether the multimedia content is healthy, and the content that violates the set standards includes the content that affects the health of the viewing user. The specific identification method of different content is not limited here.

[0052] After the monitoring device 3 receives the target data transmitted by the multimedia acquisition device 2, the interactive network television 1 can be analyzed and monitored based on the target data. When it is determined that the target data contains multimedia data that violates the set specifications, an early warning is issued to the target user, and the target user processes the target data that violates the set specifications. The target user may refer to an operation and maintenance staff member who is responsible for receiving the early warning and processing the target data that violates the set specifications.

[0053] Specifically, the monitoring device 3 may perform different operations based on different target data. The following describes and illustrates two existing situations and the corresponding operations:

[0054] As a feasible method, when the target data is multimedia data, the monitoring device 3 is specifically used to identify the target data. If the target data violates the set specifications, a warning message is generated based on the identification result, the target data and the identification information of the interactive network TV 1; and the warning message is sent to the target user. The warning message is used to characterize that the target data of the interactive network TV 1 does not meet the set specifications.

[0055] Among them, the identification information can be considered as information with the identification of the interactive network television 1, such as the model and batch number of the interactive network television 1. It should be noted that the target data in this case is the multimedia data collected by the multimedia acquisition device 2, and the monitoring device 3 is required to identify the target data and identify whether the target data violates the set specifications. If the target data violates the set specifications, an early warning message is generated based on the identification result, the target data and the identification information of the interactive network television 1, and the early warning message is sent to the target user; if the target data does not violate the set specifications, the next target data transmitted by the multimedia acquisition device 2 is continuously monitored.

[0056] As another achievable manner, when the target data is filtered multimedia data, the monitoring device 3 is specifically used to generate warning information based on the target data and identification information of the interactive network television 1; and send the warning information to the target user.

[0057] The target data in this case is the multimedia data filtered by the multimedia acquisition device 2, that is, the multimedia acquisition device 2 has identified that the target data violates the set specifications. At this time, the monitoring device 3 can generate warning information based on the target data and the identification information of the interactive network TV 1, and send the generated warning information to the target user.

[0058] In addition, when the target data is filtered multimedia data, the monitoring device 3 is also used to identify the target data. If the target data violates the set specifications, an early warning message is generated based on the identification result, the target data and the identification information of the interactive network TV 1; and the early warning message is sent to the target user.

[0059] It is understandable that, after the multimedia acquisition device 2 has identified that the target data violates the set specification, the monitoring device 3 can continue to identify the target data again to verify whether the target data violates the set specification. If it is determined that the target data violates the set specification, a warning message is generated based on the identification result, the target data and the identification information of the interactive network television 1, and the warning message is sent to the target user; if it is determined that the target data does not violate the set specification, the next target data transmitted by the multimedia acquisition device 2 is continuously monitored. The method of identifying the target data in this step can be the same as the method of identifying the target data in the above step, or it can be different from the method of identifying the target data in the above step, and this embodiment does not limit this.

[0060] It can be seen from the above description that the purpose of adding this step is to improve the accuracy of target data recognition to prevent misrecognition.

[0061] The specific means of generating the warning information based on the recognition result, the target data and the identification information of the interactive network TV is not limited. For example, the warning information includes the target data, the recognition result and the identification information of the interactive network TV to indicate to the target user that the target data of the interactive network TV of the identification information has the problem represented by the recognition result.

[0062] The specific means of generating the warning information based on the target data and the identification information of the interactive network television is not limited. For example, the warning information includes the target data and the identification information of the interactive network television to indicate that the target data of the interactive network television of the identification information violates the set specifications.

[0063] Figure 2 A schematic diagram of the structure of another monitoring system for interactive network television provided by an embodiment of the present invention is shown in FIG. Figure 2 As shown, the monitoring system includes a large TV screen and an intelligent recognition program 4, an AI intelligent recognition camera 5, a unified monitoring center 6, and an operation and maintenance personnel 7. The large TV screen, the intelligent recognition program 4, and the set-top box can constitute an interactive network TV, so that programs can be watched on the set-top box, such as for displaying multimedia data to be monitored. The AI ​​intelligent recognition camera 5 is a multimedia acquisition device, which is used to collect multimedia data and transmit target data to the unified monitoring center 6 (i.e., the monitoring device). The unified monitoring center 6 is used to monitor the large TV screen and the intelligent recognition program 4 based on the target data. The unified monitoring center 6 can analyze and identify the target data. If the target data violates the set specifications, an early warning message is generated and sent to the operation and maintenance personnel 7 (i.e., the target user). The operation and maintenance personnel 7 is responsible for receiving the early warning and processing the target data that violates the set specifications.

[0064] In this embodiment, the monitoring device or multimedia acquisition device is also used to monitor the interface layout information to prevent problems such as missing images. For example, when it is determined that the number of pictures corresponding to the multimedia data displayed in the interactive network TV is less than the preset number after identifying the real-time image, the monitoring device can generate prompt information based on the real-time image and the identification information of the interactive network TV, and send the prompt information to the target user. The prompt information may include identification information and real-time images. The real-time image is used to determine the interface layout information of the multimedia data actually displayed on the interactive network TV. The preset number can be determined based on theoretical interface layout information. If the interface layout information is theoretically for the TV screen to display four pictures, but three pictures are actually displayed, it can be considered that a missing picture has occurred. The present invention is not limited to pictures, but can also be videos, such as using a video as a cover.

[0065] In addition, the missing image recognition can also directly recognize the displayed real-time image to determine whether there is text information indicating that the image is not displayed, etc. For example, the real-time image includes the words "content not successfully obtained" or includes a code indicating "content not successfully obtained".

[0066] Figure 3 A flow chart of monitoring based on a monitoring system provided in an embodiment of the present invention, such as Figure 3 As shown, the monitoring system includes a large TV screen, an AI intelligent recognition camera, a unified monitoring center, and operation and maintenance personnel. First, the large TV screen automatically runs the script through the built-in automatic access program, refreshes the TV interface to display the multimedia data to be monitored, such as the multimedia data of the children's channel; the AI ​​intelligent recognition camera can capture the TV interface to collect multimedia data and save it to the cache, and then the AI ​​intelligent recognition camera takes out the file data (i.e., multimedia data) from the cache for intelligent recognition. If the file data violates the set specifications, the file data is transmitted to the central processing task area of ​​the unified monitoring center to generate an early warning message, and the early warning message is sent to the operation and maintenance personnel; if the file data does not violate the set specifications, the next file data is intelligently recognized; the operation and maintenance personnel are responsible for receiving the early warning message and performing alarm processing on the file data that violates the set specifications. The central processing task may include the target data transmitted by the AI ​​intelligent recognition camera. The step of the unified monitoring center determining whether to send an alarm can be considered as a step of identifying the target data.

[0067] In one embodiment, each device in the monitoring system needs to be developed independently. During the development process, compatibility and later upgrade issues must be considered, and an asynchronous processing solution must be used. After each device is developed, it is embedded in the business module to ensure that the log module is not invasive to the business module. The overall development is considered complete. Finally, after the testers complete the functional test, integration test, and performance test, the monitoring system begins to run online.

Claims

1. A monitoring system for interactive network television, characterized in that: include: Interactive network television, multimedia acquisition equipment and monitoring equipment; The interactive network television is used to display the multimedia data to be monitored; The multimedia acquisition device is used to acquire the multimedia data and transmit target data to the monitoring device, wherein the target data is determined based on the multimedia data; the target data transmitted by the multimedia acquisition device is the multimedia data or the filtered multimedia data; The screened multimedia data is multimedia data that the multimedia acquisition device identifies as violating set specifications; The monitoring device is used to monitor the interactive network television based on the target data; When the target data is filtered multimedia data, the monitoring device is specifically used to identify the target data, and if the target data violates the set rules, generate warning information based on the identification result, the target data and the identification information of the interactive network television; and send the warning information to the target user; Among them, the interactive network television is specifically used to: determine a second selection instruction of the multimedia data to be monitored in the real-time image based on the real-time image of the program list collected by the multimedia acquisition device, the second selection instruction is used to select the multimedia data, the second selection instruction includes the location information of the multimedia data in the real-time image, after the multimedia data is selected based on the second selection instruction, control the playback of the multimedia data based on the second playback instruction, and after the multimedia data is played, return to the previous level interface based on the second return instruction.

2. The monitoring system according to claim 1, characterized in that: The interactive network television is specifically used to: obtain an instruction set, and automatically play the multimedia data corresponding to the instruction set based on the instruction set, the instruction set includes a first selection instruction, a first play instruction and a first return instruction, one instruction set corresponds to at least one multimedia data, the first selection instruction is used to select the multimedia data, the first play instruction is used to play the multimedia data, the first return instruction is used to return to the previous level interface after playing the multimedia data, and the instruction set is determined based on the interface layout information of the interactive network television.

3. The monitoring system according to claim 1, characterized in that: Also includes: The interactive network television continues to determine the next multimedia data to be monitored in the real-time image to monitor the multimedia data.

4. The monitoring system according to claim 1, characterized in that: The multimedia acquisition device is specifically used to: perform character recognition on the multimedia data, and if a character is recognized in the multimedia data, then recognize the multimedia data; if the multimedia data violates the set specifications, then use the multimedia data as the target data.

5. The monitoring system according to claim 1, characterized in that: When the target data is the multimedia data, the monitoring device is specifically used to identify the target data, and if the target data violates the set specification, generate warning information based on the identification result, the target data and the identification information of the interactive network television; The warning information is sent to the target user, and the warning information is used to indicate that the target data of the interactive network television does not meet the set specification.

6. The monitoring system according to claim 1, characterized in that: The multimedia data includes one or more of audio, video and pictures.

Images