A monitoring method, a monitoring server and a terminal device for playing content by a device

Abstract

The application discloses a kind of device playing content monitoring method, monitoring server and terminal equipment, and the monitoring method applied to server of one embodiment includes: generating and publishing play plan message, play plan message includes the plan identification of characterizing the play plan corresponding to play plan message;Watermark information is generated and stored according to the play plan request sent by terminal equipment, and the storage address of watermark information and the storage address of play plan are sent to terminal equipment, so that terminal equipment downloads and plays watermark information and play plan, and play plan request is generated after terminal equipment receives play plan message, and play plan request includes plan identification and the terminal equipment identification of characterizing terminal equipment;Receive screenshot verification request sent by terminal equipment and verify the watermark information of screenshot therein, and in response to watermark information verification failure, close terminal equipment.The embodiment of the application can realize the monitoring of terminal equipment playing content, and has practical application value.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display, in particular to a method for monitoring content played by a device, a monitoring server and a terminal device. BACKGROUND

[0002] In the current environment of Internet of Everything, there are more and more information publishing systems in which a server controls a terminal device to play content. While further meeting user needs and simplifying user operations, monitoring of the terminal device by the server is essential, and in particular, monitoring and checking of the accuracy of the content played by the terminal device is particularly important. SUMMARY

[0003] To solve at least one of the above problems, the first aspect of the present application provides a method for monitoring content played by a device, applied to a server, comprising:

[0004] generating and publishing a play plan message, the play plan message comprising a plan identifier, the plan identifier being used to uniquely represent a play plan corresponding to the play plan message;

[0005] generating watermark information according to a play plan request sent by a terminal device and storing the watermark information, and sending a storage address of the watermark information and a storage address of the play plan to the terminal device, so that the terminal device downloads and plays the watermark information and the play plan, the play plan request being generated after the terminal device receives the play plan message, the play plan request comprising the plan identifier and a terminal device identifier used to uniquely represent the terminal device;

[0006] receiving a screenshot checking request sent by the terminal device and checking the watermark information of a screenshot in the screenshot checking request, and in response to a failure of the watermark information checking, closing the terminal device, the screenshot being obtained by the terminal device performing a screenshot operation on content played by the terminal device according to a preset time interval.

[0007] Further, the generating and publishing of the play plan message further comprises:

[0008] receiving a plurality of materials and respectively storing each material in a storage server, and obtaining a material storage address of each material in the storage server;

[0009] forming a play program according to at least one material, the play program comprising a program identifier, a material identifier of each material, and material play information of each material;

[0010] forming the play plan and the plan identifier according to at least one program, and storing in the storage server, the play plan comprising program play information of each program and a plan type;

[0011] generating the play plan message according to the MQTT protocol and publishing.

[0012] Further, the generating the watermark information according to the play plan request sent by the terminal device and storing, and sending the storage address of the watermark information and the storage address of the play plan to the terminal device further comprises:

[0013] According to the terminal device identifier in the play plan request, searching a pre-stored terminal information comparison table to obtain the play information of the terminal device, the terminal information comparison table comprising the terminal device identifier and the play information corresponding to the terminal device identifier;

[0014] According to the play information of the terminal device and the play plan corresponding to the plan identifier, generating the watermark information;

[0015] Storing the watermark information on a storage server and obtaining the watermark storage address of the storage server.

[0016] Further, the play information comprises the resolution of the terminal device, and the generating the watermark information according to the play information of the terminal device and the play plan corresponding to the plan identifier further comprises:

[0017] According to the resolution of the terminal device, the pre-set watermark position, the play plan and the play program respectively, generating the watermark information corresponding to the play program, so that the terminal device superimposes the watermark information to the play program and plays.

[0018] Further, the watermark information comprises watermark content and watermark pictures, and the generating the watermark information corresponding to the play program according to the resolution of the terminal device, the play program and the pre-set watermark position respectively further comprises:

[0019] Forming the watermark content from at least one of the encrypted value of the material content, the program identifier, the plan identifier, the program play information and the plan type;

[0020] Mapping the watermark content to each watermark pixel corresponding to the watermark position;

[0021] Forming the watermark picture according to the resolution of the terminal device, the watermark position and each watermark pixel, so that the terminal device superimposes the watermark picture to the play program and plays.

[0022] Further, the mapping the watermark content to each watermark pixel corresponding to the watermark position further comprises:

[0023] splitting the watermark content into watermark sub-contents according to the number of the watermark pixels;

[0024] mapping the watermark sub-contents into pixel channels of each watermark pixel according to the watermark position.

[0025] Further, the watermark information is perceptual watermark, and the step of mapping the watermark sub-contents into pixel channels of each watermark pixel according to the watermark position further comprises: mapping the watermark sub-contents into color channels of each watermark pixel, and setting transparency channels of the each watermark pixel as full coverage.

[0026] Or

[0027] The watermark information is visual watermark, and the step of mapping the watermark sub-contents into pixel channels of each watermark pixel according to the watermark position further comprises: mapping the watermark sub-contents into transparency channels or color channels of each watermark pixel.

[0028] Further, the screenshot verification request comprises the terminal device identifier, and the step of receiving the screenshot verification request sent by the terminal device and verifying the watermark information of the screenshot in the screenshot verification request further comprises:

[0029] obtaining a play plan, watermark information corresponding to the play plan, and watermark content corresponding to the watermark information from the storage server according to the terminal device identifier;

[0030] obtaining the resolution of the terminal device and the watermark position according to the terminal device identifier, and obtaining the position of each watermark pixel;

[0031] obtaining each watermark pixel, verification watermark sub-content of the each watermark pixel, and splicing the verification watermark sub-contents to form verification watermark content from the screenshot according to the position of each watermark pixel;

[0032] verifying the verification watermark content according to the watermark content.

[0033] The second aspect of the present application provides a monitoring method for device playing content, applied to a terminal device, comprising:

[0034] receiving a play plan message and sending a play plan request to a server, so that the server generates watermark information according to the play plan message and the play plan request and stores the watermark information, the play plan message is generated and published by the server, and the play plan message comprises a plan identifier, and the play plan request comprises the plan identifier and a terminal device identifier of the terminal device;

[0035] download the watermark information corresponding to the download address and the play plan corresponding to the plan identifier according to the download address sent by the server, and play the watermark information and the play plan;

[0036] According to the preset time interval, the content played is screened to obtain a screenshot, and a screenshot verification request is sent to the server, so that the server verifies the watermark information of the screenshot, and the terminal device is closed in response to the watermark information verification failure.

[0037] Further, the screenshot verification request sent to the server further comprises:

[0038] The screenshot function is set in the Android Framework layer of the terminal device, and the screenshot function comprises a screenshot operation according to a preset time interval to obtain a screenshot of the content played, and a screenshot verification request is sent to the server.

[0039] The third aspect of the application provides a monitoring server for playing content of a device, comprising a message unit, a watermark generation unit, a watermark verification unit and a controller, wherein the controller is configured to generate and publish a play plan message through the message unit, the play plan message comprising a plan identifier, the plan identifier being used to uniquely represent a play plan corresponding to the play plan message.

[0040] The watermark information is generated and stored by the watermark generation unit according to the play plan request sent by the terminal device, and the storage address of the watermark information and the storage address of the play plan are sent to the terminal device, so that the terminal device downloads and plays the watermark information and the play plan, the play plan request being generated after the terminal device receives the play plan message, the play plan request comprising the plan identifier and a terminal device identifier used to uniquely represent the terminal device.

[0041] The watermark verification unit receives the screenshot verification request sent by the terminal device and verifies the watermark information of the screenshot in the screenshot verification request, and the terminal device is closed in response to the watermark information verification failure, the screenshot being obtained by the terminal device according to a preset time interval to screen the content played.

[0042] The fourth aspect of the application provides a terminal device, comprising a communication request unit, a play unit, a screenshot unit and a processor, wherein the processor is configured to:

[0043] receive a play plan message through the communication request unit and send a play plan request to the server, so that the server generates watermark information according to the play plan message and the play plan request and stores the watermark information, the play plan message is generated and published by the server, and the play plan message includes a plan identifier, and the play plan request includes the plan identifier and a terminal device identifier of the terminal device;

[0044] download the watermark information corresponding to the download address and the play plan corresponding to the plan identifier according to the download address sent by the server through the communication request unit, and play the watermark information and the play plan through the playing unit;

[0045] take screenshots of the played content at preset time intervals through the screenshot unit to obtain screenshots, and send a screenshot verification request to the server through the communication request unit, so that the server verifies the watermark information of the screenshots and closes the terminal device in response to a watermark information verification failure.

[0046] The fifth aspect of the application provides a computer readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the method of the first aspect;

[0047] Alternatively

[0048] The program is executed by a processor to implement the method of the second aspect.

[0049] The sixth aspect of the application provides a computer device, comprising a memory, a processor and a computer program stored on the memory and executable on the processor,

[0050] The processor executes the program to implement the method of the first aspect;

[0051] Alternatively

[0052] The processor executes the program to implement the method of the second aspect.

[0053] The beneficial effects of the application are as follows:

[0054] The application formulates a device content monitoring method, a monitoring server and a terminal device to solve the existing problems, generates watermark information on the server, so that the terminal device downloads and simultaneously plays the watermark and the play plan, the server analyzes the watermark in the screenshots reported by the terminal device and verifies the authenticity of the watermark, and controls the terminal device according to the verification result, thereby realizing monitoring of the play content of the terminal device, making up for the problems in the related art, effectively improving the monitoring efficiency, and having a wide application prospect. BRIEF DESCRIPTION OF DRAWINGS

[0055] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0056] Figure 1 A flow chart of the monitoring method according to an embodiment of the present application is shown;

[0057] Figure 2 A swim lane diagram of the monitoring method according to an embodiment of the present application is shown;

[0058] Figure 3 A structural block diagram of the monitoring server according to an embodiment of the present application is shown;

[0059] Figure 4 A flow chart of the monitoring method according to another embodiment of the present application is shown;

[0060] Figure 5 A structural block diagram of the terminal device according to an embodiment of the present application is shown;

[0061] Figure 6 A schematic diagram of the watermark pixel according to an embodiment of the present application is shown;

[0062] Figure 7 A structural schematic diagram of a computer device according to another embodiment of the present application is shown. DETAILED DESCRIPTION

[0063] In order to more clearly illustrate the present application, the present application will be further described below in conjunction with preferred embodiments and drawings. In the drawings, similar components are denoted by the same reference signs. Those skilled in the art should understand that the following specific description is illustrative rather than limiting, and should not limit the protection scope of the present application.

[0064] According to the above problems, as shown in the drawings, an embodiment of the present application provides a monitoring method of device playing content applied to a server, comprising: Figure 1 generating and publishing a playing plan message, wherein the playing plan message comprises a plan identifier, and the plan identifier is used to uniquely represent a playing plan corresponding to the playing plan message;

[0065]

[0066] ​According to the playing plan request sent by the terminal device, watermark information is generated and stored, and the storage address of the watermark information and the storage address of the playing plan are sent to the terminal device, so that the terminal device downloads and plays the watermark information and the playing plan, the playing plan request is generated after the terminal device receives the playing plan message, and the playing plan request includes the plan identifier and a terminal device identifier for uniquely representing the terminal device.

[0067] The terminal device sends a screenshot verification request, and the watermark information of the screenshot in the screenshot verification request is verified, and the terminal device is closed in response to the watermark information verification failure, and the screenshot is obtained by the terminal device according to a preset time interval.

[0068] The embodiment generates watermark information on the server side, so that the terminal device downloads and simultaneously plays the watermark and the playing plan, the server side parses the watermark in the screenshot reported by the terminal device and verifies the authenticity of the watermark, and controls the terminal device according to the verification result, thereby realizing monitoring of the playing content of the terminal device, making up for the problems in the related art, effectively improving the monitoring efficiency, and having a wide application prospect.

[0069] In one specific example, as shown in Figure 2 to realize monitoring of the terminal device, specifically including the following steps.

[0070] First, generate and publish a playing plan message.

[0071] In the embodiment, the server side can be a server, for example, a local server, a remote server or a cloud server, and the server side stores the received material information, makes programs, forms a playing plan, and publishes a playing plan message. Specifically includes:

[0072] First, the server side receives multiple materials and respectively stores each material in a storage server, and obtains the material storage address of each material in the storage server.

[0073] In the embodiment, the server side receives externally transmitted materials, such as video, image, audio and other formats, and stores the materials in the storage server. The storage server of the embodiment uses a server installed with Minio to distribute the storage of various materials and respectively returns the storage address of each material. Minio is an open source high-availability distributed object storage service component, which can provide a distributed deployment solution to realize high reliability and high availability of resource storage.

[0074] Secondly, the server side forms a playing program according to at least one material, and the playing program includes a program identifier, a material identifier, and material playing information of each material.

[0075] In the embodiment, the server edits and arranges the materials to form a play program, which can include a plurality of materials, such as a play order and a play number of the plurality of materials; or can include only one material, such as a video or an image. The play program further includes a program identifier uniquely representing the program, a material identifier uniquely representing each material, and material play information of each material, i.e., play order information of each material.

[0076] Again, the server forms the play plan and a plan identifier according to at least one program, and stores the play plan in the storage server. The play plan includes program play information and a plan type of each program.

[0077] In the embodiment, the server further forms a play plan and a plan identifier uniquely representing the plan according to the play program produced, and stores the play plan. The play plan can include one or more play programs, and the play plan further includes program play information, such as play time of each program in a play plan, and a plan type, such as a normal plan, an inserted plan, or a filler plan.

[0078] Finally, the server generates the play plan message according to the MQTT protocol and publishes the play plan message.

[0079] In the embodiment, the server publishes the play plan through an MQTT message queue. Specifically, the server forms a play plan message according to the play plan, and publishes the message. The play plan message includes a plan identifier, so that a terminal device subscribing to the message receives the message and performs subsequent operations.

[0080] Secondly, the terminal device generates a play plan request.

[0081] Thirdly, the terminal device sends the play plan request to the server.

[0082] In the embodiment, the terminal device subscribes to and receives the play plan message published by the server, and requests a download address of the play plan from the server according to the plan identifier, i.e., generates a play plan request including the plan identifier and a terminal device identifier uniquely representing the terminal device. The terminal device identifier in the embodiment is a Mac address of the terminal device.

[0083] Fourthly, the server generates watermark information according to the play plan request.

[0084] In the embodiment, the server generates a watermark according to the play plan request including the unique identifier of the terminal device, i.e., generates a watermark corresponding to the terminal device, to prevent malicious cracking or forgery of the watermark, and effectively improve the accuracy of monitoring the play content. Specifically, the method includes:

[0085] First, according to the terminal device identifier in the play plan request, the pre-stored terminal information table is looked up to obtain the play information of the terminal device, and the terminal information table includes the terminal device identifier and the play information corresponding to the terminal device identifier.

[0086] In the embodiment, each terminal device is pre-registered in the server, and the play information of the terminal device, such as the model, screen size and resolution of the terminal device, and the play-related parameters are stored in the terminal information table of the server. After the server receives the play plan request, the play information of the terminal device is obtained from the terminal information table according to the terminal device identifier, for example, the resolution of the terminal device is obtained.

[0087] Second, the watermark information is generated according to the play information of the terminal device and the play plan corresponding to the plan identifier.

[0088] In the embodiment, the server obtains the content of the play plan according to the plan identifier, and generates the corresponding watermark in combination with the resolution of the terminal device, so as to facilitate the terminal device to play.

[0089] Specifically, the play information includes the resolution of the terminal device, and the server generates the watermark information corresponding to the play program according to the resolution of the terminal device, the pre-set watermark position, the play plan and the play program, so that the terminal device superimposes the watermark information on the play program and plays.

[0090] In the embodiment, considering the influence of the watermark on the play content, especially the influence on the content of different play programs, the corresponding watermark is further generated according to the play program in the play plan, the setting position of the watermark, and in combination with the resolution of the terminal device, so as to facilitate the terminal device to play.

[0091] In an optional embodiment, the watermark information includes watermark content and watermark pictures, and the server further includes:

[0092] First, at least one of the encrypted value of the material content, the program identifier, the plan identifier, the program play information and the plan type is formed into the watermark content.

[0093] In the embodiment, the server generates the corresponding watermark content according to the terminal device and each program of the play plan, for example, generates the watermark content according to the plan identifier, the program identifier and the plan type of the play plan, and specifically: the plan type is a 1-bit decimal integer, for example, 1 for a normal plan, 2 for an inserted plan and 3 for a filler plan; the plan identifier is a 10-bit decimal integer, for example, the plan identifier is 10, and a date is added in front to prevent a supplement 0 error after conversion, for example, the 10-bit data of the plan identifier is 2022090110, and the conversion into 32 is 1s8d9bu; similarly, the program identifier is a 10-bit decimal integer, for example, the program identifier is 15, and a date is added in front to prevent a supplement 0 error after conversion, for example, the 10-bit data of the program identifier is 2022090115, and the conversion into 32 is 1s8d9c3; and the watermark content of the normal plan of the plan type is: 1s8d9bu1s8d9c31.

[0094] It should be noted that the embodiment is only used to illustrate the specific implementation of the present application, and the present application does not specifically limit the formation of the watermark content, including but not limited to at least one of the encrypted value of the material content, the program identifier, the plan identifier, the program play information (for example, a timestamp including a play time) and the plan type, and a person skilled in the art should select an appropriate way to form the watermark content corresponding to the terminal device and the play program according to the actual application requirement, which will not be described here.

[0095] Secondly, the watermark content is mapped into each watermark pixel corresponding to the watermark position;

[0096] In the embodiment, the corresponding plurality of watermark pixels are selected according to the watermark position, and the obtained watermark content is set in the watermark pixels, so that the terminal device can obtain the watermark content by analyzing the screenshot after playing.

[0097] In an optional embodiment, the server splits the watermark content into watermark sub-contents according to the number of the watermark pixels; and maps the watermark sub-contents into the pixel channels of each watermark pixel according to the watermark position.

[0098] In the embodiment, for example, 15 watermark pixels are used to represent the watermark content, and in the case of minimal display impact, the watermark content is split into 15 watermark sub-contents and set in the 15 watermark pixels, for example, the 15-bit 32-ary watermark content, each watermark sub-content is a 1-bit 32-ary number, and each watermark pixel represents a part of the watermark sub-content.

[0099] Considering that the watermark is a non-perceptual watermark, in an optional embodiment, the server maps the watermark sub-contents into the color channels of each watermark pixel, and sets the transparency channel of each watermark pixel to be completely covered.

[0100] In the present embodiment, the imperceptible watermark refers to not affecting the normal display of the playing program, and the viewing user cannot perceive the watermark on the screen. For the characteristics of the imperceptible watermark, as shown in the following table, the watermark position is set on the four edges of the screen, and 15 pixel points are selected as watermark pixels, and the watermark content is set in the watermark pixels and forms a watermark picture. Figure 6

[0101] In the present embodiment, the other pixels of the four edges of the screen are set to black, and the watermark content is set in the watermark pixels. Specifically, each pixel point has R (red), G (green), B (blue), and A (alpha) four attributes, wherein R, G, and B respectively correspond to the numerical values of the red, yellow, and blue channels, each channel occupies 8 bits, a total of 24 bits, and contains all color information. A is used to represent the transparency channel, wherein A=0 is completely transparent, A=1 is completely covered, and the intermediate value represents semi-transparent. In the present embodiment, the A channel is set to 1, that is, completely covering the display content of the terminal device, and the watermark is generated by adding watermark content in one of the R, G, and B channels, thereby effectively preserving the data of the pixel A channel.

[0102] Still taking the above watermark content 1s8d9bu1s8d9c31 as an example, taking the s character as an example, s represents the decimal 28, and replacing the B channel, then the pixel (0, 0, 0) will be changed to (0, 0, 28). In the present embodiment, the watermark pixels are uniformly dispersed on the four edges according to the width and height of the resolution. Taking 1920*1080 as an example, there are a total of 5996 pixel points on the four edges, that is, (1920+1080)*2–4, and one pixel can represent a 32-bit number, so 15 pixels are needed, and the 15 pixels will be uniformly dispersed on the four edges, that is, 3-4 pairs of pixel points on each edge, thereby effectively preventing the abnormality that can be seen by the naked eye caused by the accumulation of setting watermark pixels, and realizing the imperceptible watermark.

[0103] In an optional embodiment, the other pixels of the four edges are set to transparent, that is, only using the color value of one color channel of the 15 watermark pixels on the screen edge to represent the watermark, that is, minimizing the impact on the playing content.

[0104] Considering that the watermark is a visual watermark, in an optional embodiment, the server further maps the watermark sub-content to the transparency channel or color channel of each watermark pixel.

[0105] In the present embodiment, considering the demand for visual watermark, for example, displaying a watermark logo, such as a television station logo, in a certain area on the upper right corner of the screen, some pixels are selected as watermark pixels in the visual watermark, and the watermark sub-content is respectively split into each watermark pixel, so as to set the watermark content in the visual watermark to reduce the perception of the user to the watermark.​

[0106] Specifically, for example, the visual watermark is a three-color logo of a television station, 15 pixels are selected and dispersed in the three-color logo, and the watermark sub-content is mapped to the A channel or one of the RGB channels of each watermark pixel, so as to realize the visual watermark.

[0107] It is worth noting that the server also generates a default watermark corresponding to each terminal device and sends it to the corresponding terminal device. The default watermark is a watermark irrelevant to the playing content of the terminal device, which is used when the terminal device has no playing content, further improving the accuracy of the server monitoring the playing content of the terminal device.

[0108] Third, the watermark picture is formed according to the resolution of the terminal device, the watermark position, and each watermark pixel, so that the terminal device superimposes the watermark picture on the playing program and plays it.

[0109] In this embodiment, the server forms a watermark picture from each watermark pixel, so that the terminal device superimposes the watermark picture on the display content of the playing program when playing.

[0110] Specifically, taking the superposition of two pictures A and B as an example, for example, the upper layer is a watermark picture and the lower layer is display content of playing, the original RGB component without ALPHA component needs to be calculated first, and then added with A component. For example, picture A is superimposed on picture B:

[0111] Each pixel point of picture A is denoted as R(A), G(A), and B(A), each pixel point of picture B is denoted as R(B), G(B), and B(B), and each pixel point after superposition is denoted as R, G, and B. According to the pixel point superposition formula, the superposition result is: R = alpha * R(B) + (1-alpha) * R(A); G = alpha * G(B) + (1-alpha) * G(A); B = alpha * B(B) + (1-alpha) * B(A). Taking the above imperceptible watermark as an example, when the A channel of the watermark pixel is set to 1, i.e. completely covering the display content of the lower layer picture B, when the four edges are set to black, only 15 points of the B channel value of the watermark content in the 5996 pixel points, the human eye cannot distinguish and perceive, thereby realizing the imperceptible watermark. Similarly, even if the four edges are not set to black, since the 15 watermark pixels are dispersedly arranged, the human eye cannot perceive; for example, in the visual watermark, the watermark pixels are dispersedly arranged relative to the pixels included in the visual logo, and the human eye cannot perceive the existence of the watermark.

[0112] In the embodiment, by setting the watermark content in the watermark pixels, the speed of watermark generation, analysis and verification can be improved by avoiding the need to add watermarks by identifying non-content contour pixels in the image in the related art; at the same time, the large amount of calculation caused by the generation of watermarks by deep learning in the related art can be avoided, and the training of the model can be avoided to avoid damaging the video playback effect, further improve the watermark generation efficiency, and improve the user experience.

[0113] Finally, the watermark information is stored on the storage server and the watermark storage address of the storage server is obtained.

[0114] In the embodiment, the service end stores the generated watermark information in the storage server, and obtains the storage address of the watermark.

[0115] In the fifth step, the service end sends the watermark address and the material address of each program involved in the play plan to the device terminal.

[0116] In the embodiment, the service end sends the watermark address and the material address to the device terminal in response to the play plan request sent by the device terminal.

[0117] In the sixth step, the device terminal downloads each program of the play plan and the corresponding watermark.

[0118] In the seventh step, the device terminal plays the watermark and the play plan simultaneously.

[0119] In the embodiment, the device terminal downloads the watermark picture and each material according to the download address, and plays according to the play time and play order according to the play plan.

[0120] In the eighth step, the device terminal performs a screenshot operation according to a preset time interval to obtain a screenshot.

[0121] In the embodiment, during the playing process, the device terminal performs a screenshot operation according to a preset time interval to obtain a screenshot, for example, a screenshot operation once a minute.

[0122] Considering the instability of the screenshot operation in the related art, in an optional embodiment, the terminal device sets a screenshot function in the Framework layer of its Android system, which includes performing a screenshot operation on the content played according to a preset time interval to obtain a screenshot, and sending a screenshot verification request to the service end.

[0123] In the embodiment, the screenshot function is arranged in the Framework layer of the Android system of the terminal device, the application of the Framework layer is written in the Android source code, and the screenshot function is effective when the terminal device is started, so that the stable monitoring function can be effectively realized. In addition, the screenshot function is arranged in the Framework layer, and the Android system background cannot stop the process, so that the stable monitoring function can be realized even if the specific program is turned off. Specifically, compared with the unstable factors caused by the arrangement of the APP in the related art, for example, the monitoring of the playing content of the terminal device is cracked and damaged due to the decompilation of the APP, and the monitoring is out of control due to the non-starting of the APP, the dependence of the screenshot operation on the APP itself can be avoided.

[0124] In the ninth step, the terminal device sends the screenshot to the server.

[0125] In the tenth step, the server analyzes the screenshot and verifies the watermark.

[0126] In the embodiment, the server analyzes and verifies the screenshot sent by the terminal device. Specifically, the following steps are included.

[0127] Firstly, the screenshot verification request includes the terminal device identifier, and the server obtains the playing plan, the watermark information corresponding to the playing plan, and the watermark content corresponding to the watermark information from the storage server according to the terminal device identifier.

[0128] In the embodiment, the server obtains the watermark content from the storage server according to the playing plan parameter and the terminal device identifier in the screenshot verification request.

[0129] Secondly, the resolution of the terminal device and the watermark position are obtained according to the terminal device identifier, and the positions of the watermark pixels are obtained.

[0130] In the embodiment, the server obtains the terminal device parameters such as the resolution and the watermark position according to the terminal device identifier in the screenshot verification request, so as to obtain the specific positions of the watermark pixels.

[0131] Thirdly, each watermark pixel, the verification watermark sub-content of each watermark pixel, and the verification watermark content formed by splicing each verification watermark sub-content are taken out from the screenshot according to the positions of the watermark pixels.

[0132] In the embodiment, the server obtains each watermark pixel from the screenshot, and analyzes the verification watermark content in the screenshot according to the watermark generation rule.

[0133] Finally, the verification watermark content is verified according to the watermark content.

[0134] In this embodiment, the server compares the obtained watermark content with the parsed verification watermark content. If the two are consistent, the server does not take any action, and the terminal device plays normally.

[0135] In the eleventh step, the server responds to the watermark verification failure by sending a command to the device terminal.

[0136] In this embodiment, if the watermark verification result is inconsistent, the server sends a shutdown command to the device terminal, and the device terminal stops playback. It is worth noting that in actual operation, multiple verifications are usually performed; for example, the device terminal is shut down if the watermark content is different from the verified watermark content three times consecutively.

[0137] Corresponding to the monitoring methods provided in the above embodiments, one embodiment of this application also provides a monitoring server that implements the above monitoring methods. Since the monitoring server provided in this application corresponds to the monitoring methods provided in the above embodiments, the previous implementation methods are also applicable to the monitoring server provided in this embodiment, and will not be described in detail in this embodiment.

[0138] like Figure 3 As shown, one embodiment of the present invention provides a monitoring server, including a message unit, a watermark generation unit, a watermark verification unit, and a controller, wherein the controller is configured to generate and publish a playback plan message through the message unit, the playback plan message including a plan identifier, the plan identifier being used to uniquely identify the playback plan corresponding to the playback plan message;

[0139] The watermark generation unit generates and stores watermark information based on the playback plan request sent by the terminal device, and sends the storage address of the watermark information and the storage address of the playback plan to the terminal device, so that the terminal device downloads and plays the watermark information and the playback plan. The playback plan request is generated by the terminal device after receiving the playback plan message, and the playback plan request includes the plan identifier and the terminal device identifier used to uniquely identify the terminal device.

[0140] The watermark verification unit receives a screenshot verification request sent by the terminal device and verifies the watermark information of the screenshot in the screenshot verification request. In response to the failure of the watermark information verification, the terminal device is closed. The screenshot is obtained by the terminal device taking screenshots of the content it is playing at preset time intervals.

[0141] In the embodiment, the monitoring server generates watermark information, so that the terminal device downloads and simultaneously plays the watermark and the play plan, the monitoring server parses the watermark in the screenshot reported by the terminal device and verifies the authenticity of the watermark, and controls the terminal device according to the verification result, thereby monitoring the play content of the terminal device, making up for the problems in the related art, effectively improving the monitoring efficiency, and having a wide application prospect.

[0142] Based on the above monitoring method applied to the server, as shown in Figure 4 An embodiment of the present application also provides a monitoring method applied to a terminal device, which comprises the following steps:

[0143] receiving a play plan message and sending a play plan request to the server, so that the server generates watermark information according to the play plan message and the play plan request and stores the watermark information, the play plan message being generated and published by the server, the play plan message comprising a plan identifier, and the play plan request comprising the plan identifier and a terminal device identifier of the terminal device;

[0144] downloading the watermark information corresponding to the download address and the play plan corresponding to the plan identifier according to the download address sent by the server, and playing the watermark information and the play plan;

[0145] performing a screenshot operation on the played content at a preset time interval to obtain a screenshot, and sending a screenshot verification request to the server, so that the server verifies the watermark information of the screenshot, and closes the terminal device in response to a verification failure of the watermark information.

[0146] In the embodiment, the monitoring server generates watermark information, so that the terminal device downloads and simultaneously plays the watermark and the play plan, the monitoring server parses the watermark in the screenshot reported by the terminal device and verifies the authenticity of the watermark, and controls the terminal device according to the verification result, thereby monitoring the play content of the terminal device, making up for the problems in the related art, effectively improving the monitoring efficiency, and having a wide application prospect.

[0147] In an optional embodiment, the performing a screenshot operation on the played content at a preset time interval to obtain a screenshot, and sending a screenshot verification request to the server further comprises:

[0148] setting a screenshot function in an Android Framework layer of the terminal device, the screenshot function comprising the performing a screenshot operation on the played content at a preset time interval to obtain a screenshot, and sending a screenshot verification request to the server.

[0149] In the embodiment, the screenshot function is arranged in the Framework layer of the Android system of the terminal device, the application of the Framework layer is written in the Android source code, and the screenshot function is effective when the terminal device is started, so that the stable monitoring function can be effectively realized. In addition, the screenshot function is arranged in the Framework layer, and the Android system background cannot stop the process, so that the stable monitoring function can be realized even after a specific program is turned off. Specifically, compared with the unstable factors caused by the arrangement of the APP in the related art, such as the cracking and damage of the monitoring of the playing content of the terminal device caused by the decompilation of the APP, the uncontrolled monitoring caused by the non-starting of the APP, and the like, the screenshot operation can avoid the dependence of the APP itself.

[0150] Corresponding to the monitoring method provided in the above embodiments, one embodiment of the present application further provides a terminal device for implementing the above monitoring method. Since the terminal device provided in the embodiment of the present application corresponds to the monitoring method provided in the above several embodiments, the preceding embodiments are also applicable to the terminal device provided in the embodiment of the present application, which will not be described in detail in the embodiment.

[0151] As shown in Figure 5 , one embodiment of the present application further provides a terminal device for implementing the above monitoring method,

[0152] including a communication request unit, a playing unit, a screenshot unit and a processor, wherein the processor is configured to:

[0153] The communication request unit receives a playing plan message and sends a playing plan request to a server, so that the server generates watermark information according to the playing plan message and the playing plan request and stores the watermark information, the playing plan message is generated and published by the server, and the playing plan message includes a plan identifier, the playing plan request includes the plan identifier and a terminal device identifier of the terminal device;

[0154] The communication request unit downloads the watermark information corresponding to the download address and the playing plan corresponding to the plan identifier according to the download address sent by the server, and the playing unit plays the watermark information and the playing plan;

[0155] The screenshot unit performs a screenshot operation on the played content according to a preset time interval to obtain a screenshot, and the communication request unit sends a screenshot verification request to the server, so that the server verifies the watermark information of the screenshot, and closes the terminal device in response to a failure of the watermark information verification.

[0156] In the embodiment, the watermark information is generated by the server end, so that the terminal device downloads and simultaneously plays the watermark and the playing plan, the monitoring server parses the watermark in the screenshot reported by the terminal device and verifies the authenticity of the watermark, and controls the terminal device according to the verification result, so as to realize the monitoring of the playing content of the terminal device, make up for the problems in the related art, effectively improve the monitoring efficiency, and have a wide application prospect.

[0157] Another embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to realize the device playing content monitoring method.

[0158] In actual application, the computer readable storage medium can adopt any combination of one or more computer readable media. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination thereof. More specific examples (non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the embodiment, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or component.

[0159] The computer readable signal medium can include a data signal propagated in a baseband or as a part of a carrier wave, in which a computer readable program code is borne. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium other than the computer readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or component.

[0160] The program code contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination thereof.

[0161] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0162] As shown in Figure 7 FIG. 1, another embodiment of the present application provides a schematic diagram of a computer device. Figure 7 The computer device 12 shown is but one example of a computing environment and should not be construed to limit the scope of functionality or use of embodiments of the present application.

[0163] As shown in Figure 7 FIG. 1, the computer device 12 is representative of a general computing device. Components of the computer device 12 can include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that couples various system components including system memory 28 and processing unit 16.

[0164] The bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration bus, a processor or local bus using any of a variety of bus architectures. By way of example, these architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0165] The computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by the computer device 12 and includes both volatile and non-volatile media, removable and non-removable media.

[0166] System memory 28 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 can further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a "hard drive"). Figure 7 Although not shown, computer device 12 can employ other, different or Figure 7 additional hardware and / or software modules that can be used in conjunction with the computer device 12, including but not limited to a microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.

[0167] Program / utility 40, having a set (at least one) of program modules 42, can be stored in memory 28 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data, each or some combination thereof, can include implementation of a network environment. Program modules 42 generally carry out the functions and / or methodologies of embodiments of the application as described herein.

[0168] Computer device 12 can also communicate with one or more external devices 14 such as a keyboard or a pointing device, displays 24, etc.; one or more devices that enable a user to interact with computer device 12; and / or one or more devices that enable computer device 12 to communicate with one or more other computing devices. Such communication can be via input / output (I / O) interfaces 22. Still yet, computer device 12 can communicate with one or more networks, such as a local area network (LAN), a wide area network (WAN), and / or the Internet, through network adapter 20. As Figure 7 illustrated, network adapter 20 can communicate with the other components of computer device 12 through bus 18. It should be understood that although not shown, other hardware and / or software components could be used in conjunction with computer device 12. Examples, include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc. Figure 7

[0169] ​The processor unit 16 performs various function applications and data processing by running programs stored in the system memory 28, such as implementing a monitoring method for a device playing content according to an embodiment of the present application.

[0170] Obviously, the above-mentioned embodiments of the present application are only examples for clearly explaining the present application, and are not intended to limit the embodiments of the present application. Other different forms of changes or variations can be made on the basis of the above-mentioned description for those skilled in the art, and it is impossible to enumerate all the embodiments here. Any changes or variations derived from the technical solutions of the present application still fall within the protection scope of the present application.

Claims

1. A method for monitoring content played on a device, characterized in that, Applied to the server side, including: Generate and publish a playback plan message, the playback plan message including a plan identifier, the plan identifier being used to uniquely identify the playback plan corresponding to the playback plan message; Watermark information is generated and stored according to the playback plan request sent by the terminal device. The storage address of the watermark information and the storage address of the playback plan are sent to the terminal device, so that the terminal device downloads and plays the watermark information and the playback plan. The playback plan request is generated by the terminal device after receiving the playback plan message. The playback plan request includes the plan identifier and the terminal device identifier used to uniquely identify the terminal device. The terminal device receives a screenshot verification request and verifies the watermark information of the screenshot in the screenshot verification request. If the watermark information verification fails, the terminal device is closed. The screenshot is obtained by the terminal device taking screenshots of the content it is playing at preset time intervals. The steps for generating watermark information based on the playback plan request sent by the terminal device include: The playback information of the terminal device is obtained by searching a pre-stored terminal information lookup table based on the terminal device identifier in the playback plan request. The terminal information lookup table includes the terminal device identifier and the playback information corresponding to the terminal device identifier. The playback information includes the resolution of the terminal device. Based on the resolution of the terminal device, the preset watermark position, the playback plan, and the playback program, watermark information corresponding to the playback program is generated respectively, so that the terminal device can overlay the watermark information onto the playback program and play it. The watermark information includes watermark content and watermark image. The watermark content is mapped to each watermark pixel corresponding to the watermark position. The watermark image is formed based on the resolution of the terminal device, the watermark position, and each watermark pixel. The watermark pixels are scattered. The screenshots obtained by the terminal device from the content it is playing at preset time intervals include: the screenshots are obtained by the terminal device from the Android Framework layer and the content it is playing at preset time intervals; The mapping of the watermark content to each watermark pixel corresponding to the watermark position includes: splitting the watermark content into watermark sub-content according to the number of watermark pixels; and mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position. The monitoring method further includes: generating a default watermark corresponding to each terminal device, and sending it to the corresponding terminal device so that the terminal device uses the default watermark when there is no content being played, wherein the default watermark is a watermark unrelated to the content being played on the terminal device.

2. The monitoring method according to claim 1, characterized in that, The generation and publication of the playback schedule message further includes: Receive multiple media files and store each media file separately on the storage server; obtain the media storage address of each media file on the storage server. A playback program is formed based on at least one material, and the playback program includes a program identifier, material identifiers, and material playback information for each material; The playback plan and plan identifier are generated based on at least one program and stored on the storage server. The playback plan includes program playback information and plan type for each program. The playback plan message is generated and published according to the MQTT protocol.

3. The monitoring method according to claim 2, characterized in that, The step of generating watermark information corresponding to the playback program based on the resolution of the terminal device, the preset watermark position, the playback plan, and the playback program further includes: The watermark content is formed by at least one of the following: the encrypted value of the material content, the program identifier, the plan identifier, the program playback information, and the plan type. The watermark content is mapped to each watermark pixel corresponding to the watermark position; The watermark image is formed based on the resolution of the terminal device, the watermark position, and each watermark pixel, so that the terminal device can overlay the watermark image onto the program and play it.

4. The monitoring method according to claim 3, characterized in that, The watermark information is an imperceptible watermark. The step of mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position further includes: mapping the watermark sub-content to the color channel of each watermark pixel, and setting the transparency channel of each watermark pixel to be completely covered. or The watermark information is a visual watermark, and the step of mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position further includes: mapping the watermark sub-content to the transparency channel or color channel of each watermark pixel.

5. The monitoring method according to claim 4, characterized in that, The screenshot verification request includes the terminal device identifier, and receiving the screenshot verification request sent by the terminal device and verifying the watermark information of the screenshot in the screenshot verification request further includes: The playback plan, the watermark information corresponding to the playback plan, and the watermark content corresponding to the watermark information are obtained from the storage server according to the terminal device identifier. The resolution of the terminal device and the watermark position are obtained based on the terminal device identifier, and the position of each watermark pixel is obtained. Based on the position of each watermark pixel, extract each watermark pixel and the verification watermark sub-content of each watermark pixel from the screenshot, and then concatenate the verification watermark sub-contents to form the verification watermark content. The verification watermark content is verified based on the watermark content.

6. A method for monitoring content played on a device, characterized in that, Applied to terminal devices, including: The system receives a playback plan message and sends a playback plan request to the server, so that the server generates and stores watermark information based on the playback plan message and the playback plan request. The playback plan message is generated and published by the server and includes a plan identifier. The playback plan request includes the plan identifier and the terminal device identifier of the terminal device. Download the watermark information corresponding to the download address and the playback plan corresponding to the plan identifier according to the download address sent by the server, and play the watermark information and the playback plan. The system takes screenshots of the content being played at preset time intervals and sends screenshot verification requests to the server so that the server can verify the watermark information of the screenshots and shut down the terminal device if the watermark information verification fails. The steps for the server to generate watermark information based on the playback plan message and playback plan request include: The playback information of the terminal device is obtained by searching a pre-stored terminal information lookup table based on the terminal device identifier in the playback plan request. The terminal information lookup table includes the terminal device identifier and the playback information corresponding to the terminal device identifier. The playback information includes the resolution of the terminal device. Based on the resolution of the terminal device, the preset watermark position, the playback plan, and the playback program, watermark information corresponding to the playback program is generated respectively, so that the terminal device can overlay the watermark information onto the playback program and play it. The watermark information includes watermark content and watermark image. The watermark content is mapped to each watermark pixel corresponding to the watermark position. The watermark image is formed based on the resolution of the terminal device, the watermark position, and each watermark pixel. The watermark pixels are scattered. The step of taking screenshots of the content being played at preset time intervals and sending screenshot verification requests to the server further includes: setting a screenshot function in the Android Framework layer of the terminal device, wherein the screenshot function includes taking screenshots of the content being played at preset time intervals and sending screenshot verification requests to the server; The mapping of the watermark content to each watermark pixel corresponding to the watermark position includes: splitting the watermark content into watermark sub-content according to the number of watermark pixels; and mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position. The monitoring method further includes: the server generating a default watermark corresponding to each terminal device and sending it to the corresponding terminal device so that the terminal device uses the default watermark when there is no content being played, wherein the default watermark is a watermark unrelated to the content being played on the terminal device.

7. A monitoring server for content played on a device, characterized in that, It includes a message unit, a watermark generation unit, a watermark verification unit, and a controller, wherein the controller is configured to generate and publish a playback plan message through the message unit, the playback plan message including a plan identifier, the plan identifier being used to uniquely identify the playback plan corresponding to the playback plan message; The watermark generation unit generates and stores watermark information based on the playback plan request sent by the terminal device, and sends the storage address of the watermark information and the storage address of the playback plan to the terminal device, so that the terminal device downloads and plays the watermark information and the playback plan. The playback plan request is generated by the terminal device after receiving the playback plan message, and the playback plan request includes the plan identifier and the terminal device identifier used to uniquely identify the terminal device. The watermark verification unit receives a screenshot verification request sent by the terminal device and verifies the watermark information of the screenshot in the screenshot verification request. In response to the failure of the watermark information verification, the terminal device is closed. The screenshot is obtained by the terminal device taking screenshots of the content it is playing at preset time intervals. The watermark generation unit generates watermark information based on the playback plan request sent by the terminal device, including: The playback information of the terminal device is obtained by searching a pre-stored terminal information lookup table based on the terminal device identifier in the playback plan request. The terminal information lookup table includes the terminal device identifier and the playback information corresponding to the terminal device identifier. The playback information includes the resolution of the terminal device. Based on the resolution of the terminal device, the preset watermark position, the playback plan, and the playback program, watermark information corresponding to the playback program is generated respectively, so that the terminal device can overlay the watermark information onto the playback program and play it. The watermark information includes watermark content and watermark image. The watermark content is mapped to each watermark pixel corresponding to the watermark position. The watermark image is formed based on the resolution of the terminal device, the watermark position, and each watermark pixel. The watermark pixels are scattered. The screenshots obtained by the terminal device from the content it is playing at preset time intervals include: the screenshots are obtained by the terminal device from the Android Framework layer and the content it is playing at preset time intervals; The mapping of the watermark content to each watermark pixel corresponding to the watermark position includes: splitting the watermark content into watermark sub-content according to the number of watermark pixels; and mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position. The controller is also configured to generate a default watermark corresponding to each terminal device and send it to the corresponding terminal device so that the terminal device uses the default watermark when there is no content being played. The default watermark is a watermark that is unrelated to the content being played by the terminal device.

8. A terminal device, characterized in that, It includes a communication request unit, a playback unit, a screenshot unit, and a processor, wherein the processor is configured as follows: The communication request unit receives a playback plan message and sends a playback plan request to the server, so that the server generates and stores watermark information based on the playback plan message and the playback plan request. The playback plan message is generated and published by the server and includes a plan identifier. The playback plan request includes the plan identifier and the terminal device identifier of the terminal device. The communication request unit downloads the watermark information corresponding to the download address and the playback plan corresponding to the plan identifier according to the download address sent by the server, and plays the watermark information and playback plan through the playback unit; The screenshot unit takes screenshots of the content being played at preset time intervals and sends screenshot verification requests to the server through the communication request unit, so that the server can verify the watermark information of the screenshot and close the terminal device in response to the failure of watermark information verification. The server generates watermark information based on the playback plan message and playback plan request, including: The playback information of the terminal device is obtained by searching a pre-stored terminal information lookup table based on the terminal device identifier in the playback plan request. The terminal information lookup table includes the terminal device identifier and the playback information corresponding to the terminal device identifier. The playback information includes the resolution of the terminal device. Based on the resolution of the terminal device, the preset watermark position, the playback plan, and the playback program, watermark information corresponding to the playback program is generated respectively, so that the terminal device can overlay the watermark information onto the playback program and play it. The watermark information includes watermark content and watermark image. The watermark content is mapped to each watermark pixel corresponding to the watermark position. The watermark image is formed based on the resolution of the terminal device, the watermark position, and each watermark pixel. The watermark pixels are scattered. The screenshot unit performs a screenshot operation on the content being played at a preset time interval to obtain screenshots, including: using the Android Framework layer of the terminal device to perform a screenshot operation on the content being played at a preset time interval to obtain screenshots. The mapping of the watermark content to each watermark pixel corresponding to the watermark position includes: splitting the watermark content into watermark sub-content according to the number of watermark pixels; and mapping the watermark sub-content to the pixel channel of each watermark pixel according to the watermark position. The processor is also configured to use a default watermark generated by the server, corresponding to each terminal device, and sent by the server to the corresponding terminal device when there is no playback content. The default watermark is a watermark that is unrelated to the playback content of the terminal device.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-5; or When the program is executed by the processor, it implements the method as described in claim 6.

10. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 1-5; or When the processor executes the program, it implements the method as described in claim 6.

Images