A method and system for monitoring screen device playback, and storage medium

Abstract

The present application discloses a method and system for monitoring screen device playback, and a storage medium. The method for monitoring screen device playback includes: a web client obtains a device identifier of a monitored device, generates a start monitoring instruction according to the device identifier of the monitored device, and sends the start monitoring instruction to a web server; the web server receives the start monitoring instruction, obtains the device identifier of the monitored device from the start monitoring instruction, and sends the start monitoring instruction to a screen device corresponding to the device identifier of the monitored device; the screen device captures a screen image at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and sends the screenshot image information to the web server; the web server sends the screenshot image information to the web client; the web client displays according to the screenshot image information. The solution provided by the present disclosure can overcome the problem of high monitoring cost in related technologies.

Description

Technical Field

[0001] The present application relates to but is not limited to the field of monitoring technology, and in particular to a method and system for monitoring screen device playback, and a storage medium. Background Art

[0002] Media control systems are widely used in transportation, finance, shopping malls, supermarkets and other scenarios. Media control systems usually include screen devices. In actual usage scenarios, operation managers need to use some means to patrol and monitor the playback status of screen devices in the media control system and whether the playback content is legal and compliant. Summary of the invention

[0003] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0004] In a first aspect, an embodiment of the present disclosure provides a method for monitoring screen device playback, which is applied to a system including a web page server, at least one screen device, and at least one web page client corresponding to the web page server, the method comprising:

[0005] The web client obtains the device identification of the monitored device, generates a start monitoring instruction according to the device identification of the monitored device, and sends the start monitoring instruction to the web server;

[0006] The web page server receives the start monitoring instruction, obtains the device identification of the monitored device from the start monitoring instruction, and sends the start monitoring instruction to the screen device corresponding to the device identification of the monitored device;

[0007] The screen device end captures screen images at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and sends the screenshot image information to the web page server end;

[0008] The web page server sends the screenshot image information to the web page client;

[0009] The web client performs display according to the screenshot image information.

[0010] In an exemplary embodiment, before the web client obtains the device identification of the monitored device, the method further includes:

[0011] The screen device establishes a device connection channel with the web page server and generates an identifier of the device connection channel, and sends its own device identifier to the web page server through the device connection channel;

[0012] The webpage server updates the first monitoring table according to the device identifier and the identifier of the device connection channel; the first monitoring table records the corresponding relationship between the device identifier and the identifier of the device connection channel;

[0013] The web client receives the device monitoring instruction, establishes a client connection channel with the web server and generates an identifier of the client connection channel; the device monitoring instruction includes the device identifier of the monitored device;

[0014] The web client obtains the device identification of the monitored device, including: obtaining the device identification of the monitored device from the device monitoring instruction;

[0015] After the webpage server receives the start monitoring instruction, the method further includes:

[0016] The webpage server obtains the device identification of the monitored device from the start monitoring instruction, and updates the second monitoring table according to the device identification of the monitored device and the identification of the client connection channel; the second monitoring table records the correspondence between the device identification of the monitored device and the identification of the client connection channel;

[0017] The web page server communicates with the web page client via the client connection channel, and the web page server communicates with the screen device via the device connection channel.

[0018] In an exemplary embodiment, the web page server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, including: the web page server searches for the device identifier corresponding to the device identifier of the monitored device from the first monitoring table, obtains the identifier of the device connection channel corresponding to the found device identifier from the first monitoring table, determines the device connection channel according to the identifier of the device connection channel, and sends the start monitoring instruction to the corresponding screen device through the determined device connection channel;

[0019] The web page server sends the screenshot image information to the web page client, including: the web page server obtains the device identification of the monitored device corresponding to the screen device end from the second monitoring table, and sends the screenshot image information to the web page client through the client connection channel corresponding to the device identification of the monitored device.

[0020] In an exemplary embodiment, before the screen device sends the screenshot image information to the web page server, the method further includes:

[0021] The web server sets up a file storage service;

[0022] The screen device sends the screenshot image information to the web page server, including:

[0023] The screen device sends the screenshot image information to the file storage service, receives the image path returned by the file storage service, and sends the image path to the web page server through the device connection channel;

[0024] The web page server receives the image path, and sends the image path to the web page client through the client connection channel;

[0025] The web client displays according to the screenshot image information including:

[0026] The web client retrieves the screenshot image information from the file storage service according to the image path, and displays the screenshot image information.

[0027] In an exemplary embodiment, after the web page server receives the image path, the method further includes: the web page server stores image path information, the image path information including the image path and the time when the image path is obtained;

[0028] After the screen device sends the image path to the web page server through the device connection channel, the method further includes:

[0029] When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0030] The web page server receives the playback monitoring instruction, obtains a picture path set according to the playback monitoring instruction, and sends the picture path set to the web page client through the client connection channel at the preset frequency in the time sequence of obtaining the picture paths; the picture path set includes all picture paths after the playback time point corresponding to the device identifier of the monitored device;

[0031] The web client obtains the screenshot image information from the file storage service according to the image path in the image path set, and displays the screenshot image information.

[0032] In an exemplary embodiment, after the webpage server receives the playback monitoring instruction, the process further includes:

[0033] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the monitored device identifier in the second monitoring table;

[0034] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0035] When the web page server determines that there is a client connection channel identifier corresponding to the device identifier in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop push instruction, it stops sending the picture path corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0036] In an exemplary embodiment, the image path information further includes a device identifier corresponding to the image path;

[0037] After the webpage server receives the playback monitoring instruction, the method further includes:

[0038] When the web page server detects that there is no picture path corresponding to the device identifier in the picture path set, it sends a re-monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier;

[0039] After receiving the re-monitoring instruction, the screen device continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client displays according to the screenshot image information.

[0040] In an exemplary embodiment, after the webpage server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, the method further includes:

[0041] When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction from the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0042] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0043] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service, and deletes the image path information corresponding to the device identifier of the monitored device; when the screen device receives the stop monitoring instruction, it stops capturing screen images;

[0044] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service; when the screen device receives the second stop push instruction, it stops sending the image path corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0045] In an exemplary embodiment, after the screen device sends the screenshot image information to the web page server, the method further includes:

[0046] The web page server stores image information, including screenshot image information and the time when the screenshot image was obtained;

[0047] After the webpage server sends the screenshot image information to the webpage client, the method further includes:

[0048] When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0049] The web page server receives the playback monitoring instruction, obtains a screenshot image information set according to the playback monitoring instruction, and sends the screenshot image information set to the web page client through the client connection channel at the preset frequency in the time sequence of obtaining the screenshot image information; the screenshot image information set includes all screenshot image information after the playback time point corresponding to the device identifier of the monitored device;

[0050] The web client performs display according to the screenshot image information.

[0051] In an exemplary embodiment, after the webpage server receives the playback monitoring instruction, the process further includes:

[0052] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0053] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0054] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop push instruction, it stops sending the screenshot image information corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0055] In an exemplary embodiment, the picture information further includes a device identification corresponding to the picture path;

[0056] After the webpage server receives the playback monitoring instruction, the method further includes:

[0057] When the webpage server detects that there is no screenshot image information corresponding to the device identifier in the screenshot image information set, the webpage server sends a re-monitoring instruction to the corresponding screen device via the device connection channel corresponding to the device identifier;

[0058] After receiving the re-monitoring instruction, the screen device continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client displays according to the screenshot image information.

[0059] In an exemplary embodiment, after the webpage server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, the method further includes:

[0060] When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction from the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0061] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0062] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends the second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the web page server; when the screen device receives the second stop monitoring instruction, it stops capturing screen images;

[0063] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device; when the screen device receives the second stop push instruction, it stops sending the screenshot image corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0064] In an exemplary embodiment, after the screen device captures the screen image at a preset frequency to obtain the screenshot image information, the method further includes: the screen device calls a compression algorithm to compress the screenshot image information to obtain compressed screenshot image information;

[0065] The screen device sends the screenshot image information to the web page server through the device connection channel, including: the screen device sends the compressed screenshot image information to the web page server through the device connection channel.

[0066] In an exemplary embodiment, the preset frequency is 10 to 26 frames per second.

[0067] In a second aspect, the embodiments of the present disclosure further provide a system for monitoring screen device playback, which is applied to a system including a web page server, at least one screen device, and at least one web page client corresponding to the web page server;

[0068] The web client is configured to obtain the device identification of the monitored device, generate a start monitoring instruction according to the device identification of the monitored device, and send the start monitoring instruction to the web server; and is also configured to display according to the screenshot image information;

[0069] The web page server is configured to receive the start monitoring instruction, obtain the device identification of the monitored device from the start monitoring instruction, and send the start monitoring instruction to the screen device corresponding to the device identification of the monitored device; and is also configured to send the screenshot image information to the web page client;

[0070] The screen device end is configured to capture screen images at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and send the screenshot image information to the web page server end.

[0071] In a third aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium is used to store computer program instructions, wherein when the computer program instructions are executed, the method for monitoring screen device playback described in any of the above embodiments can be implemented.

[0072] Other aspects will be apparent upon reading and understanding the drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] The accompanying drawings are used to provide a further understanding of the technical solution of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the technical solution of the present disclosure and do not constitute a limitation on the technical solution of the present disclosure. The shapes and sizes of the components in the accompanying drawings do not reflect the actual proportions and are only intended to illustrate the contents of the present disclosure.

[0074] Figure 1 Shown is a flow chart of a method for monitoring screen device playback provided by an embodiment of the present disclosure;

[0075] Figure 2Shown is a flow chart of a method for monitoring screen device playback provided by an exemplary embodiment of the present disclosure;

[0076] Figure 3 Shown is a flow chart of another method for monitoring screen device playback provided by an exemplary embodiment of the present disclosure;

[0077] Figure 4 Shown is a schematic diagram of the structure of a system for monitoring screen device playback provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0078] In order to make the purpose, technical scheme and advantages of the present invention clearer, the embodiments of the present invention will be described in detail in conjunction with the accompanying drawings below. Note that the embodiments can be implemented in a plurality of different forms. A person of ordinary skill in the art can easily understand the fact that the method and content can be transformed into various forms without departing from the purpose and scope of the present invention. Therefore, the present invention should not be interpreted as being limited to the contents described in the following embodiments. In the absence of conflict, the embodiments in the present invention and the features in the embodiments can be arbitrarily combined with each other.

[0079] Unless otherwise defined, the technical terms or scientific terms used in the embodiments disclosed in this disclosure should be understood by people with ordinary skills in the field to which the invention belongs. The "first", "second" and similar words used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprising" and similar words always cover the elements or false positives that appear after the word and their equivalents, without excluding other elements or false positives.

[0080] At present, in order to solve the monitoring problem, a streaming media service is usually used to achieve it. The specific implementation method is as follows: the Web client sends a monitoring request to the business server, the business server requests a streaming address from the streaming media server, and then the business server encapsulates the set frame rate, resolution, streaming address and other parameters into a streaming instruction and sends it to the software of the screen device terminal. The software of the screen device terminal calls the streaming service to send the collected data (also called streaming) to the streaming media server through the Real Time Messaging Protocol (abbreviated as RTMP) protocol. The streaming media server transcodes the data collected by the software of the screen device terminal into a streaming address of the HTTP-FLV protocol (HTTP is the full name of HyperText Transfer Protocol in English, and the full name of Hypertext Transfer Protocol in Chinese; FLV is the full name of FLASHVIDEO in English, which is a video format; the HTTP-FLV protocol is used for information transmission in which the audio and video data is first encapsulated into the FLV format and then transmitted to the client through the HTTP protocol) and sends it to the business server. The Web client needs to obtain the streaming address from the business server in a polling or long connection manner, and then the Web client calls the streaming media player to play according to the streaming address. This monitoring method has certain technical implementation thresholds and requires the deployment of a streaming media server with higher configuration, resulting in higher monitoring costs.

[0081] The present disclosure provides a method for monitoring screen device playback, which can be applied to a system including a web page server, at least one screen device, and at least one web page client corresponding to the web page server. The method may include:

[0082] The web client obtains the device identification of the monitored device, generates a start monitoring instruction according to the device identification of the monitored device, and sends the start monitoring instruction to the web server;

[0083] The web page server receives the start monitoring instruction, obtains the device identification of the monitored device from the start monitoring instruction, and sends the start monitoring instruction to the screen device corresponding to the device identification of the monitored device;

[0084] The screen device end captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and sends the screenshot image information to the web page server end;

[0085] The web server sends the screenshot image information to the web client;

[0086] The web client displays the screenshot information.

[0087] The embodiment of the present disclosure provides a method for monitoring the playback of a screen device. The web client sends a start monitoring instruction to the web server, which then sends the start monitoring instruction to the screen device. The screen device captures a screen image according to the start monitoring instruction and sends the screenshot image information obtained by capturing the screen image to the web server. The web server sends the screenshot image information to the web client, which displays the screenshot image information, thereby monitoring the playback content and playback status of the screen device. The embodiment of the present disclosure provides a method for monitoring the playback of a screen device. The web client obtains the screenshot image information of the screen device through the web server to monitor the screen device. The technical implementation threshold is low, and there is no need to deploy a streaming media server with a high configuration. The cost of monitoring the playback of the screen device is reduced to a great extent, overcoming the problem of high monitoring cost in related technologies.

[0088] like Figure 1 As shown, it is a flow chart of a method for monitoring screen device playback provided by an embodiment of the present disclosure. The method for monitoring screen device playback may include steps S1-S5:

[0089] Step S1: The web client obtains the device identification of the monitored device, generates a start monitoring instruction according to the device identification of the monitored device, and sends the start monitoring instruction to the web server;

[0090] Step S2: The web page server receives the start monitoring instruction, obtains the device identification of the monitored device from the start monitoring instruction, and sends the start monitoring instruction to the screen device corresponding to the device identification of the monitored device;

[0091] Step S3: the screen device captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and sends the screenshot image information to the web page server;

[0092] Step S4: the web server sends the screenshot image information to the web client;

[0093] Step S5: The web client displays the screenshot information.

[0094] In the disclosed embodiment, in the above step S5, the web client calls the player to display according to the screenshot image information, thereby realizing the monitoring of the playback content and playback status of the screen device end.

[0095] In an exemplary embodiment, in the above step S1, before the web client obtains the device identification of the monitored device, steps S101-S103 may also be included:

[0096] Step S101: the screen device establishes a device connection channel with the web page server and generates an identifier of the device connection channel, and sends its own device identifier to the web page server through the device connection channel;

[0097] Step S102: the web server updates the first monitoring table according to the device identifier and the identifier of the device connection channel; the first monitoring table records the correspondence between the device identifier and the identifier of the device connection channel; in the embodiment of the present disclosure, the first monitoring table may record multiple device identifiers and identifiers of the device connection channels corresponding to the multiple device identifiers one by one;

[0098] Step S103: the web client receives the device monitoring instruction, establishes a client connection channel with the web server, and generates an identifier of the client connection channel; the device monitoring instruction includes the device identifier of the monitored device; in the embodiment of the present disclosure, the web client receiving the device monitoring instruction may include: the web client receiving trigger information of the monitoring device triggered by the user, and receiving the device identifier of the monitored device input by the user;

[0099] Accordingly, in the above step S1, the web client obtains the device identification of the monitored device, which may include: obtaining the device identification of the monitored device from the device monitoring instruction;

[0100] In the above step S2, after the web page server receives the start monitoring instruction, the following steps may also be performed: the web page server obtains the device identification of the monitored device from the start monitoring instruction, and updates the second monitoring table according to the device identification of the monitored device and the identification of the client connection channel; the second monitoring table records the correspondence between the device identification of the monitored device and the identification of the client connection channel; in the embodiment of the present disclosure, the second monitoring table may record multiple device identifications and identifications of the client connection channels corresponding to the multiple device identifications, wherein each device identification may correspond to identifications of multiple client connection channels;

[0101] In the above steps S1 to S4, the web page server communicates with the web page client through the client connection channel, and the web page server communicates with the screen device through the device connection channel.

[0102] In an exemplary embodiment, in the above step S2, the web page server sends a start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, which may include: the web page server searches for a device identifier corresponding to the device identifier of the monitored device from the first monitoring table, and obtains an identifier of a device connection channel corresponding to the found device identifier from the first monitoring table, determines a device connection channel according to the identifier of the device connection channel, and sends the start monitoring instruction to the corresponding screen device through the determined device connection channel;

[0103] In the above step S4, the web server sends the screenshot image information to the web client, which may include: the web server obtains the device identifier of the monitored device corresponding to the screen device from the second monitoring table, and sends the screenshot image information to the web client through the client connection channel corresponding to the device identifier of the monitored device.

[0104] In the embodiment of the present disclosure, the device identification of each monitored device in the second monitoring table can correspond to the identifications of multiple client connection channels, and the web page server can send the screenshot image information to multiple web page clients corresponding to the identifications of multiple client connection channels corresponding to the device identification of the monitored device, thereby achieving that multiple web page clients can monitor the playback content and playback status of the same screen device.

[0105] In an exemplary embodiment, the screen device side may include screen device side hardware and screen device side software, and the above step S101 may include: the screen device side software automatically starts when the screen device side hardware is turned on, and the screen device side software is continuously running through a daemon process; after the screen device side software is started, a device side connection channel is established with the web page server side, and an identifier of the device connection channel is generated, and its own device identifier is sent to the web page server side through the established device connection channel. In the embodiment of the present disclosure, the device identifier can be any one or more of the screen device side address, network card ID, CPU ID, motherboard ID, and mac address obtained by the screen device side, or the device identifier can be obtained by calculation through the screen device side software, and the present disclosure does not limit it here.

[0106] In an exemplary embodiment, the above step S102 may include: the web server adds the device identifier and the identifier of the device connection channel to the first monitoring table, such as the added device identifier is 00-15-5D-86-E2-63, the identifier of the device connection channel is ChannelID: c2, and the first monitoring table is shown in Table 1:

[0107] Table 1

[0108] Equipment identification Identifier of the device connection channel 00-15-5D-F9-C6-FD ChannelID: c1 00-15-5D-86-E2-63 ChannelID: c2 ... ...

[0109] In Table 1, the device identifier 00-15-5D-F9-C6-FD and the identifier of the device connection channel ChannelID: c1 originally exist. The web server performs real-time maintenance on the first monitoring table shown in Table 1. Each time a new screen device is added to establish a connection with the web server, the web server will add the device identifier and the identifier of the device connection channel corresponding to the screen device to the first monitoring table shown in Table 1. In the first monitoring table shown in Table 1, the identifier of each device connection channel corresponds to one of the device identifiers, that is, the first monitoring table may include multiple device identifiers and multiple device connection channel identifiers, and the multiple device identifiers and the multiple device connection channel identifiers are in a one-to-one correspondence.

[0110] In an exemplary embodiment, the above step S103 may include: the web client receives the trigger information of the monitoring device triggered by the user, receives the device identification of the monitored device input by the user, establishes a client connection channel with the web server, and generates an identification of the client connection channel. In the embodiment of the present disclosure, the device identification of the monitored device input by the user may be selected or input by the user in the web client, and the web client may obtain the device identification of the monitored device through other means, which is not limited in the present disclosure.

[0111] In an exemplary embodiment, the web server updates the second monitoring table according to the device identifier of the monitored device and the identifier of the client connection channel, which may include: the web server adds the device identifier of the monitored device and the identifier of the client connection channel to the second monitoring table, such as the device identifier of the monitored device added is 00-15-5D-86-E2-63, and the identifier of the client connection channel is ChannelID: c8, as shown in Table 2:

[0112] Table 2

[0113]

[0114] In Table 2, the device identification 00-15-5D-F9-C6-FD, and the identification ChannelID: c3 and ChannelID: c3 of the device connection channel corresponding to the device identification 00-15-5D-F9-C6-FD exist before the update. The web server performs real-time maintenance on the second monitoring table shown in Table 2. Each time a new web client establishes a connection with the web server, the web server will add the identification of the client connection channel corresponding to the web client to the position corresponding to the device identification of the monitored device in the second monitoring table shown in Table 2. In the second monitoring table shown in Table 2, the identification of each client connection channel corresponds to the device identification of one of the monitored devices, and the device identification of each monitored device can correspond to multiple web clients, that is, the second monitoring table can include the device identifications of multiple monitored devices and the identifications of multiple client connection channels, and the device identification of each monitored device corresponds to one or more identifications of the client connection channels, and the identification of each client connection channel corresponds to the device identification of one of the monitored devices.

[0115] In the disclosed embodiment, it can be seen from the monitoring table shown in Table 2 that each screen device end can be monitored by multiple web clients. The device identification in Table 1 and the identification of the monitored device in Table 2 are in a corresponding relationship. For example, the device identification 00-15-5D-86-E2-63 in Table 1 and the identification 00-15-5D-86-E2-63 of the monitored device in Table 2 correspond to the same screen device end.

[0116] In the disclosed embodiment, the client connection channel and the device connection channel may be a websocket connection channel. The websocket connection channel is a long connection, which enables the screen device to continuously push screenshot image information to the web client through the web server, so that the web client can achieve the visual effect of displaying dynamic images when displaying according to the screenshot image information.

[0117] In an exemplary embodiment, before the screen device sends the screenshot image information to the web page server in the above step S3, the following steps may also be included:

[0118] The web server sets up a file storage service; in the present disclosed embodiment, the operation of the web server setting up a file storage service can be performed in a step before step S3, such as in step S1 or step S2, or before step S1, or in step S3 and before the screen device sends the screenshot image information to the web server in step S3.

[0119] In the above step S3, the screen device sends the screenshot image information to the web page server, which may include steps S31-S32:

[0120] Step S31: the screen device sends the screenshot image information to the file storage service, receives the image path returned by the file storage service, and sends the image path to the web page server through the device connection channel;

[0121] Step S32: The web page server receives the image path, and sends the image path to the web page client through the client connection channel.

[0122] The above step S5 may include: the web client retrieves the screenshot image information from the file storage service according to the image path, and displays the screenshot image information.

[0123] In an exemplary embodiment, the web server sets up a file storage service, which may include: the web server can quickly set up a file storage service based on an open source solution, for example, the web server can set up a file storage technology based on a fast distributed file storage system (Fast Distributed File System, abbreviated as FastDFS) or based on MinIO technology, wherein FastDFS is an open source lightweight distributed file system, and MinIO is an open source object storage server. The web server can use other technologies to set up a file storage service, not limited to FastDFS technology or MinIO technology.

[0124] In the disclosed embodiment, after receiving the image path, the web client can obtain the corresponding screenshot image information from the file storage service according to the image path for playback. For example, the image path may be http: / / 10.10.239.183:8082 / blog / demo / 1b48ab32cd206ea75186a2a83394f2f0.jpg.

[0125] In an exemplary embodiment, in the above step S32, after the web server receives the picture path, the method for monitoring the screen device playback may further include: the web server stores the picture path information, the picture path information including the picture path and the time of obtaining the picture path;

[0126] After the screen device sends the picture path to the web page server through the device connection channel in the above step S31, the method for monitoring the screen device playback may further include:

[0127] Step H11: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0128] Step H12: The web server receives the playback monitoring instruction, obtains a picture path set according to the playback monitoring instruction, and sends the picture path set to the web client through the client connection channel at a preset frequency in the time sequence of obtaining the picture paths; the picture path set includes all picture paths after the playback time point corresponding to the device identification of the monitored device; the web client obtains the screenshot picture information from the file storage service according to the picture path in the picture path set, and displays it according to the screenshot picture information.

[0129] For example, when the screen device starts playing at 10:00 a.m. on the same day, the web client receives a replay monitoring instruction, and the replay time is 9:00 a.m. on the same day, then what is replayed is the screenshot image information between 9:00 and 10:00 a.m. on the same day.

[0130] In the disclosed embodiment, the above steps H11 to H12 can be performed in any of the above steps S3 to S5. That is, in step S3, the screen device end captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and then receives the replay instruction to replay. In the disclosed embodiment, the above steps S3 to S5 are a cyclic operation process, that is, the screen device end always captures the screen image at a preset frequency, and each time the screen image is captured and the screenshot image information is obtained, it will be sent to the web server. Each time the web server receives the screenshot image information, it will send it to the web client, and the web client will display it according to the screenshot image information received each time.

[0131] In the disclosed embodiment, after the file storage service is set up, the screenshot image information is saved through the file storage service, which greatly reduces the storage burden of the web server. Since the web server no longer bears the storage work of the screenshot image information, the processing efficiency can be improved in the process of playing the content on the monitoring screen device, thereby improving the monitoring efficiency. In addition, since the file storage service can correspond to multiple web server ends, rather than being limited to a certain web server end, the scope of the web client in the monitoring screen device is expanded to a certain extent. In the application of the monitoring screen device end, the web server end can be expanded according to actual needs, and the expanded web server end can also access the file storage service, which increases the operational flexibility and convenience of the monitoring screen device.

[0132] In an exemplary embodiment, after the web server receives the playback monitoring instruction in the above step H12, the method for monitoring the playback of the screen device may further include:

[0133] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0134] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0135] When the web page server determines that there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop push instruction, it stops sending the image path corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0136] In an exemplary embodiment, the image path information also includes a device identifier corresponding to the image path; in the embodiment of the present disclosure, the screenshot image information sent by the screen device to the file storage service may include a device identifier, and the file storage service may carry the device identifier when sending the image path to the screen device.

[0137] After the web server receives the playback monitoring instruction in the above step H12, the method for monitoring the playback of the screen device may further include steps L11-L12:

[0138] Step L11: When the web server detects that there is no image path corresponding to the device identifier in the image path set, it sends a re-monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier; for example, when the screen device plays to 10:00 a.m. on the same day, the web client receives a replay monitoring instruction, and the replay time point is 9:00 a.m. on the same day, then what is replayed is the screenshot image information between 9:00 and 10:00 a.m. on the same day. After replaying the screenshot image information at 10:00 a.m. on the same day, there is no image path corresponding to the device identifier in the image path set.

[0139] Step L12: After the screen device receives the re-monitoring instruction, it continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client calls and displays according to the screenshot image information. For example, starting to review at 10:00 am on the same day, the review time point is 9:00 am on the same day, the review time is one hour, and the screenshot information at 10:00 am on the same day is reviewed at 11:00 am on the same day. The screen device receives the re-monitoring instruction at 11:00 am on the same day or after 11:00 am on the same day. The screen device starts to re-monitor after receiving the re-monitoring instruction, that is, it starts to re-monitor according to the re-monitoring instruction from 11:00 am on the same day or after 11:00 am on the same day.

[0140] In an exemplary embodiment, after the webpage server sends a start monitoring instruction to the screen device corresponding to the device identifier of the monitored device in the above step S2, the method for monitoring the screen device playback may further include steps T11-T12:

[0141] Step T11: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction in the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0142] Step T12: the web server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0143] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service, and deletes the image path information corresponding to the device identifier of the monitored device; when the screen device receives the stop monitoring instruction, it stops capturing screen images;

[0144] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service; when the screen device receives the second stop push instruction, it stops sending the image path corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0145] In the disclosed embodiment, when the web page server receives the second stop push instruction, it deletes all the screenshots corresponding to the device identifier from the storage service, which can save the storage space of the storage service and avoid insufficient storage space due to the storage of a large number of screenshots by the storage service. When the web page server receives the second stop push instruction, it deletes the image path information corresponding to the device identifier of the monitored device stored in itself, which can save the storage space of the web page server and avoid insufficient server space due to the storage of the deleted image path information.

[0146] In the disclosed embodiment, the above steps T11 to T12 can be performed in any of the above steps S3 to S5. That is, in step S3, the screen device end captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and then receives the second stop monitoring instruction to execute the stop monitoring operation.

[0147] In an exemplary embodiment, after the screen device sends the screenshot image information to the web page server in the above step S3, the method for monitoring the screen device playback may further include:

[0148] The web server stores the image information, including the screenshot image information and the time when the screenshot image was obtained;

[0149] After the above step S4, the method for monitoring screen device playback may further include steps H21-H22:

[0150] Step H21: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0151] Step H22: The web server receives the playback monitoring instruction, obtains a screenshot image information set according to the playback monitoring instruction, and sends the screenshot image information set to the web client through the client connection channel at a preset frequency in the time sequence of obtaining the screenshot image information; the screenshot image information set includes all screenshot image information after the playback time point corresponding to the device identifier of the monitored device; the web client displays according to the screenshot image information.

[0152] In the disclosed embodiment, the above steps H21-H22 can be performed in any of the above steps S3-S5. That is, in step S3, the screen device end captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and then receives the replay instruction to replay. In the disclosed embodiment, the above steps S3-S5 are a cyclic operation process, that is, the screen device end always captures the screen image at a preset frequency, and each time the screen image is captured and the screenshot image information is obtained, it will be sent to the web server. Each time the web server receives the screenshot image information, it will send it to the web client, and the web client will display it according to the screenshot image information received each time.

[0153] In an exemplary embodiment, after the web server receives the playback monitoring instruction in step H22, the method for monitoring the playback of the screen device may further include:

[0154] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0155] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0156] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop push instruction, it stops sending the screenshot image information corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0157] In an exemplary embodiment, the above-mentioned picture information also includes a device identifier corresponding to the picture path;

[0158] After the web server receives the playback monitoring instruction in the above step H22, the method for monitoring the playback of the screen device may further include steps L21-L22:

[0159] Step L21: When the webpage server detects that there is no screenshot image information corresponding to the device identifier in the screenshot image information set, it sends a re-monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier;

[0160] Step L22: After receiving the re-monitoring instruction, the screen device continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client displays according to the screenshot image information.

[0161] In an exemplary embodiment, after the webpage server sends a start monitoring instruction to the screen device corresponding to the device identifier of the monitored device in the above step S2, the method for monitoring the screen device playback may further include steps T21-T22:

[0162] Step T21: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction in the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0163] Step T22: the web server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0164] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the web page server; when the screen device receives the second stop monitoring instruction, it stops capturing screen images;

[0165] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device; when the screen device receives the second stop push instruction, it stops sending the screenshot image corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0166] In the disclosed embodiment, upon receiving the second stop push instruction, the web server deletes all screenshots corresponding to the device identifier, thereby saving storage space of the web server and preventing the web server from running out of storage space due to storing a large number of screenshots.

[0167] In the disclosed embodiment, the above steps T21 to T22 can be performed in any of the above steps S3 to S5. That is, in step S3, the screen device end captures the screen image at a preset frequency according to the start monitoring instruction to obtain the screenshot image information, and then receives the second stop monitoring instruction to stop monitoring.

[0168] In an exemplary embodiment, after the screen device captures the screen pictures at a preset frequency to obtain the screenshot pictures, the method may further include: the screen device calls a compression algorithm to compress the screenshot pictures to obtain compressed screenshot pictures;

[0169] The screen device sends the screenshot image to the web page server through the device connection channel, which may include: the screen device sends the compressed screenshot image to the web page server through the device connection channel.

[0170] In the disclosed embodiments, the replay monitoring instruction and the second stop monitoring instruction received by the web client are both received by the client due to user operations. For example, the web client receives the replay monitoring instruction after the user clicks the replay button on the web client or drags the progress bar of the playback screen of the web client to a time point before the current playback time point (replay time point); the web client receives the second stop monitoring instruction when the user clicks the stop monitoring button on the web client or closes the web client.

[0171] In the disclosed embodiment, the screen device compresses the screenshot image using a compression algorithm to reduce the file size and save network and storage resources.

[0172] In an exemplary embodiment, the preset frequency is 10 to 26 frames per second. For example, the preset frequency is 20 frames per second.

[0173] A method for monitoring screen device playback is described in detail below. Figure 2 As shown, in order to adopt the solution of building a file storage service, the method for monitoring screen device playback may include steps 101 to 112:

[0174] Step 101: The screen device is turned on, the screen device software in the screen device is started, and the screen device software is kept running through a daemon process.

[0175] Step 102: the screen device establishes a device connection channel with the web page server and generates an identifier of the device connection channel, and sends its own device identifier to the web page server through the device connection channel.

[0176] Step 103: The webpage server updates the first monitoring table according to the device identifier and the identifier of the device connection channel.

[0177] In an exemplary embodiment, the web server updates the first monitoring table according to the device identifier and the identifier of the device connection channel, which may include: the web server adds the device identifier and the identifier of the device connection channel to the first monitoring table. The first monitoring table is shown in Table 1 above and will not be described in detail here.

[0178] Step 104: the web client receives the device monitoring instruction, establishes a client connection channel with the web server, and generates an identifier of the client connection channel; the device monitoring instruction includes the device identifier of the monitored device.

[0179] In an exemplary embodiment, step 104 may include: the web client receives a device monitoring instruction based on a user operation, establishes a client connection channel with the web server, and generates an identifier of the connection channel. In the embodiment of the present disclosure, the device monitoring instruction includes a device identifier of the monitored device, and the device identifier of the monitored device may be obtained by the web client receiving a user selection or user input, or the device identifier may be obtained through other means, which is not specifically limited in the present disclosure.

[0180] Step 105: The web client generates a start monitoring instruction according to the device identification of the monitored device, and sends the start monitoring instruction to the web server.

[0181] Step 106: The webpage server updates the second monitoring table according to the device identifier of the monitored device and the identifier of the client connection channel.

[0182] In an exemplary embodiment, the web server updates the second monitoring table according to the device identification of the monitored device and the identification of the client connection channel, which may include: the web server adds the device identification of the monitored device and the identification of the client connection channel to the second monitoring table. Specific reference is made to Table 2 above, which will not be repeated here.

[0183] Step 107: the web page server finds the corresponding device identifier from the first monitoring table according to the device identifier of the monitored device in the start monitoring instruction, and sends the start monitoring instruction to the screen device via the connection channel corresponding to the device connection channel identifier corresponding to the device identifier.

[0184] Step 108: The screen device captures the screen image at a preset frequency to obtain the screenshot image information, compresses the screenshot image information using a compression algorithm to obtain a compressed screenshot image, and sends the compressed screenshot image information to the file storage service.

[0185] Step 109: The file storage service generates an image path according to the compressed screenshot image information, stores the compressed screenshot image information, and sends the image path to the screen device end.

[0186] Step 110: The screen device sends the image path to the web page server through the device connection channel.

[0187] Step 111: The web server sends the image path to the web client through the client connection channel.

[0188] In step 111, the web page server finds the identifier of the corresponding monitored device from the above Table 2 through the device identifier, finds the identifier of the client connection channel corresponding to the device identifier of the monitored device, and sends the image path to the web page client through the client connection channel corresponding to the identifier of the found client connection channel. In the embodiment of the present disclosure, when there are multiple identifiers of the client connection channel corresponding to the device identifier of the monitored device in Table 2, the web page server can send the image path to the multiple identifiers of the client connection channels corresponding to the device identifier of the monitored device.

[0189] Step 112: The web client obtains the screenshot image information from the file storage service according to the image path, and calls the player to display the screenshot image information.

[0190] In an exemplary embodiment, before the above step 108, the method for monitoring screen device playback may further include: the web server sets up a file storage service.

[0191] In an exemplary embodiment, after the screen device sends the image path to the web server through the device connection channel in the above step 110, the web server receives the image path. After the web server receives the image path, the method for monitoring the screen device playback may further include: the web server stores the image path information, the image path information including the image path and the time of obtaining the image path;

[0192] Accordingly, after the above step 109, the method for monitoring the screen device playback may further include:

[0193] Step A1: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0194] Step A2: The web server receives the playback monitoring instruction, obtains a picture path set according to the playback monitoring instruction, and sends the picture path set to the web client through the client connection channel at a preset frequency in the time sequence of obtaining the picture paths; the picture path set includes all picture paths after the playback time point corresponding to the device identification of the monitored device; the web client obtains the screenshot picture information from the file storage service according to the picture path in the picture path set, and displays it according to the screenshot picture information.

[0195] In the disclosed embodiment, after the file storage service is established, the screenshots are saved through the file storage service, which greatly reduces the storage burden of the web page server and improves the monitoring efficiency.

[0196] In an exemplary embodiment, after the web server receives the playback monitoring instruction in step A2, the method for monitoring the playback of the screen device may further include:

[0197] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0198] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0199] When the web page server determines that there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop push instruction, it stops sending the image path corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0200] In an exemplary embodiment, after the above step 108, the method for monitoring screen device playback may further include:

[0201] Step C1: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction in the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0202] Step C2: the web server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0203] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service, and deletes the image path information corresponding to the device identifier of the monitored device; when the screen device receives the stop monitoring instruction, it stops capturing screen images;

[0204] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service; when the screen device receives the second stop push instruction, it stops sending the image path corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0205] In the disclosed embodiment, the above steps 108 to 112 are executed in a loop until the first stop monitoring instruction or the second stop monitoring instruction is received.

[0206] Another method for monitoring screen device playback is described in detail below. Figure 3 As shown, in order to not adopt the solution of building a file storage service, the method for monitoring screen device playback may include steps 201 to 211:

[0207] Step 201: the screen device is turned on, the screen device software in the screen device is started, and the screen device software is kept running through a daemon process.

[0208] Step 202: the screen device establishes a device connection channel with the web page server and generates an identifier of the device connection channel, and sends the device identifier to the web page server through the device connection channel.

[0209] Step 203: The webpage server updates the first monitoring table according to the device identifier and the identifier of the device connection channel.

[0210] In an exemplary embodiment, the web server updates the first monitoring table according to the device identifier and the identifier of the device connection channel, which may include: the web server adds the device identifier and the identifier of the device connection channel to the first monitoring table. The first monitoring table is shown in Table 1 above and will not be described in detail here.

[0211] Step 204: the web client receives the device monitoring instruction, establishes a client connection channel with the web server, and generates an identifier of the client connection channel; the device monitoring instruction includes the device identifier of the monitored device.

[0212] In an exemplary embodiment, the web client receives a device monitoring instruction, establishes a client connection channel with the web server, and generates an identifier of the client connection channel, which may include: the web client receives a device monitoring instruction based on a user operation, establishes a client connection channel with the web server, and generates an identifier of the connection channel. In the embodiment of the present disclosure, the device monitoring instruction includes a device identifier of the monitored device, and the device identifier of the monitored device may be obtained by the web client receiving a user selection or user input, or the device identifier may be obtained through other means, which is not specifically limited in the present disclosure.

[0213] Step 205: The web client generates a start monitoring instruction according to the device identifier, and sends the start monitoring instruction to the web server.

[0214] Step 206: The webpage server updates the second monitoring table according to the device identifier of the monitored device and the identifier of the client connection channel.

[0215] In an exemplary embodiment, the web server updates the second monitoring table according to the device identification of the monitored device and the identification of the client connection channel, which may include: the web server adds the device identification of the monitored device and the identification of the client connection channel to the second monitoring table. Please refer to Table 2 above for details, which will not be repeated here. In the embodiment of the present disclosure, if the second monitoring table shown in Table 2 above already contains the device identification of the monitored device, then the identification of the client connection channel is added to the identification column of the client connection channel corresponding to the device identification of the monitored device.

[0216] Step 207: the web page server finds the corresponding device identifier from the first monitoring table according to the device identifier of the monitored device in the start monitoring instruction, and sends the start monitoring instruction to the screen device via the connection channel corresponding to the device connection channel identifier corresponding to the device identifier.

[0217] Step 208: The screen device captures the screen image at a preset frequency to obtain the screenshot image information, and compresses the screenshot image information using a compression algorithm to obtain the compressed screenshot image information.

[0218] Step 209: The screen device sends the compressed screenshot image to the web page server through the device connection channel.

[0219] Step 210: The web page server sends the compressed screenshot image information to the web page client through the client connection channel.

[0220] Step 211: The web client calls the player to display the compressed screenshot image information.

[0221] In an exemplary embodiment, after the web page server obtains the screenshot image information, the method may further include: the web page server stores the image information, the image information including the screenshot image and the time when the screenshot image is obtained;

[0222] After the above step 210, the method for monitoring screen device playback may further include steps A11 and A12:

[0223] Step A11: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device;

[0224] Step A12: The web server receives the playback monitoring instruction, obtains a screenshot image information set according to the playback monitoring instruction, and sends the screenshot image information set to the web client through the client connection channel at a preset frequency in the order of the time in which the screenshot image information was obtained; the screenshot image information set includes all screenshot image information after the playback time point corresponding to the device identifier of the monitored device; the web client calls the player to display according to the screenshot image.

[0225] In an exemplary embodiment, after the web server receives the playback monitoring instruction in the above step A12, the method for monitoring the playback of the screen device may further include:

[0226] The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0227] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image;

[0228] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop push instruction, it stops sending the screenshot image information corresponding to the web client that sent the playback monitoring instruction to the web page server.

[0229] In an exemplary embodiment, after the above step 209, the method for monitoring screen device playback may further include steps B11-B12:

[0230] Step B11: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction in the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device;

[0231] Step B12: the web server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table;

[0232] When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the web page server; when the screen device receives the second stop monitoring instruction, it stops capturing screen images;

[0233] When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device; when the screen device receives the second stop push instruction, it stops sending the screenshot image corresponding to the web client that sent the second stop monitoring instruction to the web page server.

[0234] In the embodiment of the present disclosure, the above steps 208 to 211 are executed in a loop until the first stop monitoring instruction or the second stop monitoring instruction is received.

[0235] The disclosed embodiment also provides a system for monitoring screen device playback, such as Figure 4 As shown, it can be applied to a system including a web page server 11, at least one screen device 13, and at least one web page client 12 corresponding to the web page server;

[0236] The web client 12 is configured to obtain the device identification of the monitored device, generate a start monitoring instruction according to the device identification of the monitored device, and send the start monitoring instruction to the web server 11; and is also configured to display according to the screenshot image information;

[0237] The web server 11 is configured to receive a start monitoring instruction, obtain a device identification of the monitored device from the start monitoring instruction, and send the start monitoring instruction to the screen device 13 corresponding to the device identification of the monitored device; and is also configured to send the screenshot image information to the web client 12;

[0238] The screen device end 13 is configured to capture screen images at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and send the screenshot image information to the web page server end 11.

[0239] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium is used to store computer program instructions, wherein the computer program instructions, when executed, can implement the method for monitoring screen device playback described in any of the above embodiments.

[0240] The embodiment of the present application provides a method and system for monitoring the playback of a screen device, and a storage medium. The web client sends a start monitoring command to the web server, and the web server sends the start monitoring command to the screen device. The screen device captures a screen image according to the start monitoring command and sends the screenshot image information obtained by capturing the screen image to the web server. The web server sends the screenshot image information to the web client, and the web client displays it according to the screenshot image information, thereby monitoring the playback content and playback status of the screen device. The method for monitoring the playback of a screen device provided by the present disclosure, the web client obtains the screenshot image information of the screen device through the web server to monitor the screen device. The technical implementation threshold is low, and there is no need to deploy a streaming media server with a high configuration, which greatly reduces the cost of monitoring the playback of the screen device and overcomes the problem of high monitoring cost in related technologies.

[0241] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0242] The drawings of the embodiments of the present application only involve the structures involved in the embodiments of the present application, and other structures can refer to the general design.

[0243] In the absence of conflict, the embodiments of the present invention, that is, the features in the embodiments, may be combined with each other to obtain new embodiments.

[0244] Although the embodiments disclosed in the present invention are as above, the contents described are only embodiments adopted to facilitate understanding of the present invention and are not intended to limit the present invention. Any technician in the field to which the present invention belongs can make any modifications and changes in the form and details of implementation without departing from the spirit and scope disclosed in the present invention, but the patent protection scope of the present invention shall still be subject to the scope defined in the attached claims.

Claims

1. A method for monitoring screen device playback, characterized in that: The method is applied to a system including a web page server, at least one screen device, and at least one web page client corresponding to the web page server, wherein the web page server can be connected to multiple screen devices and multiple corresponding web page clients in communication, and the playback content of one screen device can be monitored by one or more web page clients; the method includes: The web client obtains the device identification of the monitored device, generates a start monitoring instruction according to the device identification of the monitored device, and sends the start monitoring instruction to the web server; The web page server receives the start monitoring instruction, obtains the device identification of the monitored device from the start monitoring instruction, and sends the start monitoring instruction to the screen device corresponding to the device identification of the monitored device; The screen device end captures screen images at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and sends the screenshot image information to the web page server end; The web page server sends the screenshot image information to the web page client; The web client displays according to the screenshot image information; The webpage server performs real-time maintenance on the first monitoring table. Each time a screen device is added to establish a connection with the webpage server, the webpage server adds the device identifier and the identifier of the device connection channel corresponding to the screen device to the first monitoring table. The first monitoring table can include multiple device identifiers and multiple device connection channel identifiers, and the multiple device identifiers and the multiple device connection channel identifiers are in a one-to-one correspondence relationship. The webpage server performs real-time maintenance on the second monitoring table. Each time a new webpage client establishes a connection with the webpage server, the webpage server adds the identifier of the client connection channel corresponding to the webpage client to the position corresponding to the device identifier of the monitored device in the second monitoring table. In the second monitoring table, the identifier of each client connection channel corresponds to the device identifier of one of the monitored devices, and each device identifier of the monitored device can correspond to multiple webpage clients. The web page server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, including: the web page server searches for the device identifier corresponding to the device identifier of the monitored device from the first monitoring table, obtains the identifier of the device connection channel corresponding to the found device identifier from the first monitoring table, determines the device connection channel according to the identifier of the device connection channel, and sends the start monitoring instruction to the corresponding screen device through the determined device connection channel; the first monitoring table records the corresponding relationship between the device identifier and the identifier of the device connection channel; The web page server sends the screenshot image information to the web page client, including: the web page server obtains the device identification of the monitored device corresponding to the screen device end from the second monitoring table, and sends the screenshot image information to the web page client through the client connection channel corresponding to the device identification of the monitored device; the second monitoring table records the correspondence between the device identification of the monitored device and the identification of the client connection channel.

2. The method according to claim 1, characterized in that Before the web client obtains the device identification of the monitored device, the method further includes: The screen device establishes a device connection channel with the web page server and generates an identifier of the device connection channel, and sends its own device identifier to the web page server through the device connection channel; The webpage server updates the first monitoring table according to the device identifier and the identifier of the device connection channel; The web client receives the device monitoring instruction, establishes a client connection channel with the web server and generates an identifier of the client connection channel; the device monitoring instruction includes the device identifier of the monitored device; The web client obtains the device identification of the monitored device, including: obtaining the device identification of the monitored device from the device monitoring instruction; After the webpage server receives the start monitoring instruction, the method further includes: The webpage server obtains the device identification of the monitored device from the start monitoring instruction, and updates the second monitoring table according to the device identification of the monitored device and the identification of the client connection channel; The web page server communicates with the web page client via the client connection channel, and the web page server communicates with the screen device via the device connection channel.

3. The method according to claim 2, characterized in that Before the screen device sends the screenshot image information to the web page server, the method further includes: The web server sets up a file storage service; The screen device sends the screenshot image information to the web page server, including: The screen device sends the screenshot image information to the file storage service, receives the image path returned by the file storage service, and sends the image path to the web page server through the device connection channel; The web page server receives the image path, and sends the image path to the web page client through the client connection channel; The web client displays according to the screenshot image information including: The web client retrieves the screenshot image information from the file storage service according to the image path, and displays the screenshot image information.

4. The method according to claim 3, characterized in that After the web page server receives the image path, the method further includes: the web page server stores the image path information, wherein the image path information includes the image path and the time when the image path is obtained; After the screen device sends the image path to the web page server through the device connection channel, the method further includes: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device; The web page server receives the playback monitoring instruction, obtains a picture path set according to the playback monitoring instruction, and sends the picture path set to the web page client through the client connection channel at the preset frequency in the time sequence of obtaining the picture paths; the picture path set includes all picture paths after the playback time point corresponding to the device identifier of the monitored device; The web client obtains the screenshot image information from the file storage service according to the image path in the image path set, and displays the screenshot image information.

5. The method according to claim 4, characterized in that After the webpage server receives the playback monitoring instruction, the method further includes: The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the monitored device identifier in the second monitoring table; When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image; When the web page server determines that there is a client connection channel identifier corresponding to the device identifier in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the identifier of the device connection channel; when the screen device receives the first stop push instruction, it stops sending the picture path corresponding to the web client that sent the playback monitoring instruction to the web page server.

6. The method according to claim 5, characterized in that The image path information also includes a device identifier corresponding to the image path; After the webpage server receives the playback monitoring instruction, the method further includes: When the web page server detects that there is no picture path corresponding to the device identifier in the picture path set, it sends a re-monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier; After receiving the re-monitoring instruction, the screen device continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client displays according to the screenshot image information.

7. The method according to claim 4, characterized in that After the webpage server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, the method further includes: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction from the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device; The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table; When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service, and deletes the image path information corresponding to the device identifier of the monitored device; when the screen device receives the stop monitoring instruction, it stops capturing screen images; When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the file storage service; when the screen device receives the second stop push instruction, it stops sending the image path corresponding to the web client that sent the second stop monitoring instruction to the web page server.

8. The method according to claim 2, characterized in that: After the screen device sends the screenshot image information to the web page server, the method further includes: The webpage server stores image information, including screenshot image information and the time when the screenshot image is obtained; After the webpage server sends the screenshot image information to the webpage client, the method further includes: When the web client receives the playback monitoring instruction, it sends the playback monitoring instruction to the web server through the client connection channel; the playback monitoring instruction includes the playback time point and the device identifier of the monitored device; The web page server receives the playback monitoring instruction, obtains a screenshot image information set according to the playback monitoring instruction, and sends the screenshot image information set to the web page client through the client connection channel at the preset frequency in the time sequence of obtaining the screenshot image information; the screenshot image information set includes all screenshot image information after the playback time point corresponding to the device identifier of the monitored device; The web client performs display according to the screenshot image information.

9. The method according to claim 8, characterized in that After the webpage server receives the playback monitoring instruction, the method further includes: The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table; When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop monitoring instruction, it stops capturing the screen image; When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a first stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device; when the screen device receives the first stop push instruction, it stops sending the screenshot image information corresponding to the web client that sent the playback monitoring instruction to the web page server.

10. The method according to claim 9, characterized in that The image information also includes a device identifier corresponding to the image path; After the webpage server receives the playback monitoring instruction, the method further includes: When the webpage server detects that there is no screenshot image information corresponding to the device identifier in the screenshot image information set, the webpage server sends a re-monitoring instruction to the corresponding screen device via the device connection channel corresponding to the device identifier; After receiving the re-monitoring instruction, the screen device continues to capture screen images at a preset frequency to obtain screenshot image information, and sends the screenshot image information to the web server through the device connection channel; the web server sends the screenshot image information to the web client through the client connection channel; the web client displays according to the screenshot image information.

11. The method according to claim 8, characterized in that After the webpage server sends the start monitoring instruction to the screen device corresponding to the device identifier of the monitored device, the method further includes: When the web client receives the second stop monitoring instruction, it sends the second stop monitoring instruction to the web server through the client connection channel, and the web server deletes the client connection channel identifier corresponding to the web client that sends the second stop monitoring instruction from the second monitoring table; the second stop monitoring instruction includes the device identifier of the monitored device; The webpage server obtains the identifier of the corresponding device connection channel from the first monitoring table according to the device identifier of the monitored device, and determines whether there is a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table; When the web page server determines that there is no client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends the second stop monitoring instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device from the web page server; when the screen device receives the second stop monitoring instruction, it stops capturing screen images; When the web page server determines that there is still a client connection channel identifier corresponding to the device identifier of the monitored device in the second monitoring table, the web page server sends a second stop push instruction to the corresponding screen device through the device connection channel corresponding to the device identifier of the monitored device, and deletes all screenshot image information corresponding to the device identifier of the monitored device; when the screen device receives the second stop push instruction, it stops sending the screenshot image corresponding to the web client that sent the second stop monitoring instruction to the web page server.

12. A system for monitoring screen device playback, characterized in that: Applicable to a system comprising a web page server, at least one screen device, and at least one web page client corresponding to the web page server, wherein the web page server can be connected to multiple screen devices and multiple corresponding web page clients in communication, and the playback content of one screen device can be monitored by one or more web page clients; The web client is configured to obtain the device identification of the monitored device, generate a start monitoring instruction according to the device identification of the monitored device, and send the start monitoring instruction to the web server; and is also configured to display according to the screenshot image information; The web page server is configured to receive the start monitoring instruction, obtain the device identification of the monitored device from the start monitoring instruction, and send the start monitoring instruction to the screen device corresponding to the device identification of the monitored device; and is also configured to send the screenshot image information to the web page client; The first monitoring table is maintained in real time. Each time a screen device is added to establish a connection with the webpage server, the webpage server adds the device identifier and the identifier of the device connection channel corresponding to the screen device to the first monitoring table. The first monitoring table can include multiple device identifiers and multiple device connection channel identifiers, and the multiple device identifiers and the multiple device connection channel identifiers are in a one-to-one correspondence relationship. The second monitoring table is maintained in real time. Each time a new web client is connected to the web server, the web server adds the identifier of the client connection channel corresponding to the web client to the position corresponding to the device identifier of the monitored device in the second monitoring table. In the second monitoring table, the identifier of each client connection channel corresponds to the device identifier of one of the monitored devices, and each device identifier of the monitored device can correspond to multiple web clients. Searching for a device identifier corresponding to the device identifier of the monitored device from the first monitoring table, and obtaining an identifier of a device connection channel corresponding to the found device identifier from the first monitoring table, determining a device connection channel according to the identifier of the device connection channel, and sending the start monitoring instruction to the corresponding screen device end through the determined device connection channel, and recording the corresponding relationship between the device identifier and the identifier of the device connection channel in the first monitoring table; Obtaining the device identification of the monitored device corresponding to the screen device end from the second monitoring table, sending the screenshot image information to the web client through the client connection channel corresponding to the device identification of the monitored device, and recording the corresponding relationship between the device identification of the monitored device and the identification of the client connection channel in the second monitoring table; The screen device end is configured to capture screen images at a preset frequency according to the start monitoring instruction to obtain screenshot image information, and send the screenshot image information to the web page server end.

13. A computer-readable storage medium, characterized in that: The storage medium is used to store computer program instructions, wherein the computer program instructions can implement the monitoring screen device playback method described in any one of claims 1 to 11 when executed.

Images