Video polling playing method and device, electronic equipment and storage medium

Abstract

The invention provides a video polling playing method and device, electronic equipment and a storage medium, and relates to the technical field of video monitoring. The method comprises the following steps: responding to a playing request for polling playing of a video initiated by a video polling server, and obtaining a real-time video to be polled and played indicated by the playing request; and then determining a hotspot value corresponding to the real-time video, and determining a playing priority of the real-time video based on the hotspot value. Wherein the hotspot value represents the concerned degree of the real-time video. And next, sorting the real-time videos in a descending order according to the playing priorities to obtain a video playing list, and sending the video playing list to target display equipment for polling playing. According to the method provided by the invention, the real-time performance of video polling playing is ensured, and meanwhile, the flexibility and intelligence in the video polling playing process are improved.

Description

Technical Field

[0001] The present application relates to the field of video surveillance technology, and in particular to a video patrol playback method, device, electronic device and storage medium. Background Art

[0002] Video round-robin playback refers to the technology of playing multiple videos in sequence on a screen. With the development of video cloud related technologies, video round-robin playback technology can be applied to various scenarios, such as security prevention, education, medical care, food hygiene, emergency management, environmental protection, etc.

[0003] Due to the different needs of different fields and industries, different strategies, priorities and split-screen layouts need to be considered when applying video carousel playback technology. At present, traditional video carousel playback technology is usually decided and configured by the client itself. The client actively requests to obtain the video playlist from the server regularly, and plays the video in a carousel according to the code logic implemented internally.

[0004] Therefore, the existing technology is not real-time enough, and it is difficult to dynamically update the video playlist, which in turn affects the flexibility and intelligence of the video round-robin playback. Summary of the invention

[0005] The present application provides a video round-robin playback method, device, electronic device and storage medium to solve the technical problems of insufficient real-time performance, inflexibility and intelligence of video round-robin playback in the prior art.

[0006] In a first aspect, the present application provides a video round-robin playback method, comprising:

[0007] In response to a play request initiated by a video patrol server, obtaining a real-time video to be patrolled and played indicated by the play request; wherein the play request is used to instruct the patrol play of the video;

[0008] Determine a hotspot value corresponding to the real-time video, and determine a playback priority of the real-time video based on the hotspot value; wherein the hotspot value represents the degree of attention paid to the real-time video;

[0009] According to the play priority, the real-time videos are sorted in descending order to obtain a video play list; and the video play list is sent to a target display device for round-robin play.

[0010] Optionally, determining a hotspot value corresponding to the real-time video, and determining a playback priority of the real-time video based on the hotspot value includes:

[0011] The real-time video is grouped based on preset rules to obtain a plurality of video combinations; wherein the types of the plurality of video combinations include an alarm patrol group, a manual patrol group, and an automatic patrol group;

[0012] Determine the hotspot value of the real-time video in the video combination; wherein the hotspot value of the real-time video in the video combination of the alarm patrol group is greater than the hotspot value of the real-time video in the video combination of the manual patrol group, and the hotspot value of the real-time video in the video combination of the manual patrol group is greater than the hotspot value of the real-time video in the video combination of the automatic patrol group;

[0013] Based on the type of the video combination and the hotspot value of the real-time video in the video combination, the play priority of the real-time video is determined.

[0014] Optionally, grouping the real-time videos based on a preset rule to obtain multiple video combinations includes:

[0015] Determining the playback content of the real-time video and the preset focus content of the playback request;

[0016] If the playback content includes the preset content of interest, the real-time video is classified into the video combination of the manual patrol group; if the playback content does not include the preset content of interest, the real-time video is classified into the video combination of the automatic patrol group;

[0017] If the playback content includes preset alarm content, the real-time video is divided into the video combination of the alarm patrol group.

[0018] Optionally, the method further includes:

[0019] Acquire a first target real-time video waiting to be played in the video playlist, and determine a video combination to which the first target real-time video belongs;

[0020] Based on the video combination to which the first target real-time video belongs, a video window layout of the target display device is determined; and according to the video window layout, the first target real-time video is played on the target display device.

[0021] Optionally, playing the first target real-time video on the target display device according to the video window layout includes:

[0022] Determine at least one video playback window included in the video window layout, and determine the resolution of the video playback window;

[0023] The first target real-time video is transcoded based on the resolution, and the transcoded first target real-time video is played in the at least one video playback window.

[0024] Optionally, the method further includes:

[0025] Acquire a second target real-time video currently being played by the target display device;

[0026] If the second target real-time video belongs to the manual patrol group and / or the automatic patrol group, the second target real-time video is monitored;

[0027] When it is detected that the playback content of the second target real-time video includes the preset alarm content, the second target real-time video is divided into the alarm patrol group.

[0028] Optionally, the method further includes:

[0029] Obtain the historical number of times the real-time video is played within a preset historical time period, and determine the historical hotspot value corresponding to each playback of the real-time video within the preset historical time period;

[0030] Based on the historical number of playbacks and the historical hotspot value, determine the historical average playback duration of the real-time video in the preset historical time period;

[0031] Based on the historical average play time, the play time of the real-time video in the round-robin play is determined.

[0032] In a second aspect, the present application provides a video patrol playback device, comprising:

[0033] An acquisition module, used for responding to a play request initiated by a video patrol server, and acquiring a real-time video to be played in a patrol mode indicated by the play request; wherein the play request is used to instruct the video to be played in a patrol mode;

[0034] A determination module, used to determine a hotspot value corresponding to the real-time video, and determine the playback priority of the real-time video based on the hotspot value; wherein the hotspot value represents the degree of attention paid to the real-time video;

[0035] A sorting module, used to sort the real-time videos in descending order according to the play priority to obtain a video play list;

[0036] The playing module is used to send the video playlist to the target display device for round-robin playing.

[0037] Optionally, the determination module further includes: a grouping module, configured to group the real-time video based on a preset rule to obtain a plurality of video combinations; wherein the types of the plurality of video combinations include an alarm patrol group, a manual patrol group, and an automatic patrol group;

[0038] The determination module is further used to determine the hotspot value of the real-time video in the video combination; wherein the hotspot value of the real-time video in the video combination of the alarm patrol group is greater than the hotspot value of the real-time video in the video combination of the manual patrol group, and the hotspot value of the real-time video in the video combination of the manual patrol group is greater than the hotspot value of the real-time video in the video combination of the automatic patrol group;

[0039] Based on the type of the video combination and the hotspot value of the real-time video in the video combination, the play priority of the real-time video is determined.

[0040] Optionally, the determination module is further used to determine the playback content of the real-time video and the preset focus content of the playback request;

[0041] The grouping module is also used to classify the real-time video into the video combination of the manual patrol group if the playback content includes the preset focus content; classify the real-time video into the video combination of the automatic patrol group if the playback content does not include the preset focus content; and classify the real-time video into the video combination of the alarm patrol group if the playback content includes the preset alarm content.

[0042] Optionally, the acquisition module is further used to acquire the first target real-time video waiting to be played in the video play list;

[0043] The determination module is further used to determine the video combination to which the first target real-time video belongs; based on the video combination to which the first target real-time video belongs, determine the video window layout of the target display device;

[0044] The playing module is further used to play the first target real-time video on the target display device according to the video window layout.

[0045] Optionally, the determination module is further used to determine at least one video playback window included in the video window layout, and determine the resolution of the video playback window;

[0046] The playback module further includes: a processing module, which is used to transcode the first target real-time video based on the resolution, and play the transcoded first target real-time video in the at least one video playback window.

[0047] Optionally, the acquisition module is further used to acquire a second target real-time video currently being played by the target display device;

[0048] The determination module further includes: a monitoring module, configured to monitor the second target real-time video if the second target real-time video belongs to the manual patrol group and / or the automatic patrol group;

[0049] The grouping module is further configured to classify the second target real-time video into the alarm patrol group when it is detected that the playback content of the second target real-time video includes preset alarm content.

[0050] Optionally, the acquisition module is further used to acquire the historical playback times of the real-time video within a preset historical time period;

[0051] The determination module is further used to determine the historical hotspot value corresponding to each playback of the real-time video within the preset historical time period;

[0052] Based on the historical number of playbacks and the historical hotspot value, determine the historical average playback duration of the real-time video in the preset historical time period;

[0053] Based on the historical average playback duration, the playback duration of the real-time video in the round-robin playback is determined.

[0054] In a third aspect, the present application provides an electronic device, including:

[0055] Memory and processor;

[0056] Wherein, the memory stores computer-executable instructions;

[0057] The processor executes the computer-executable instructions stored in the memory to implement the video round-robin playback method as described in the first aspect and various possible implementations.

[0058] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer execution instructions are stored. When the computer execution instructions are executed by a processor, they are used to implement the video patrol playback method as described in the first aspect and various possible implementation methods.

[0059] In a fifth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the video patrol playback method as described in the first aspect and various possible implementation methods.

[0060] The video patrol playback method, device, electronic device and storage medium provided in the present application respond to the playback request initiated by the video patrol server, wherein the playback request is used to indicate the video to be played in a patrol mode. The video patrol server initiating the playback request is a real-time communication method, which allows the video patrol server to update and push the latest real-time video in real time, ensuring the real-time nature of the video patrol playback. Next, the real-time video to be played in a patrol mode indicated by the playback request is obtained, and the hotspot value corresponding to the real-time video is determined. The playback priority of the real-time video is determined based on the hotspot value, wherein the hotspot value represents the degree of attention paid to the real-time video. Furthermore, each real-time video is sorted in descending order according to the playback priority to obtain a video play list, and then the video play list is sent to the target display device for patrol playback. During the patrol playback process, the video patrol server can dynamically adjust the playback order of the real-time videos in the video play list according to the latest data or events, thereby improving the flexibility and intelligence of the video patrol playback process. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0062] Figure 1 This is an application scenario diagram of the video round-robin playback method of the prior art;

[0063] Figure 2 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 1 ;

[0064] Figure 3 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 2 ;

[0065] Figure 4 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 3 ;

[0066] Figure 5 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 1 ;

[0067] Figure 6 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 2 ;

[0068] Figure 7 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 3 ;

[0069] Figure 8A schematic diagram of the structure of a video patrol playback device provided in an embodiment of the present application;

[0070] Fig. 9 This is a hardware structure diagram of the electronic device provided for this application.

[0071] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0073] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in sequences other than those illustrated or described herein, for example.

[0074] In the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0075] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0076] Video round-robin technology can display multiple video contents in a limited display space without manual switching. The round-robin technology can be applied not only to traditional security prevention fields, but also to operating room monitoring, ward monitoring and other scenarios in the medical field, classroom teaching monitoring, campus safety management and other scenarios in the education field, food processing, kitchen monitoring and other scenarios in the food hygiene field, fire alarm, rapid response, disaster assessment and other scenarios in the emergency management field, and environmental monitoring, pollution source monitoring and other scenarios in the environmental protection field.

[0077] Due to the different needs of different fields and industries, different strategies, priorities and split-screen layouts need to be considered when applying video patrol playback technology. For example, in security monitoring, it may be necessary to give priority to playing videos in high-risk areas; in the education field, it may be necessary to play video content in the order of the teaching plan.

[0078] Video carousel playback not only involves the sequential playback of videos, but also involves how to display multiple videos on one screen at the same time. For example, in medical monitoring, it may be necessary to display videos from multiple wards at the same time; in environmental monitoring, it may be necessary to place videos of important monitoring points in a more prominent position.

[0079] In traditional technology, Figure 1 The application scenario diagram of the video round-robin playback method in the prior art is as follows: Figure 1 As shown in the figure, the traditional video patrol playback architecture includes the client, streaming media server, Internet Protocol Camera (IPC), and server patrol interface. Among them, IPC is the streaming data source responsible for collecting videos; the streaming media server is used to process, transmit and manage videos; the client is used to play videos. The server patrol interface is a set of interfaces or methods provided by the streaming media server, allowing the client to interact with the streaming media server; through these interfaces, the streaming media server can accept requests and return responses.

[0080] Specifically, the client needs to send requests to the server regularly to obtain the latest video playlist, which is usually a periodic process, such as requesting once every few minutes or hours. After that, the streaming server sends the video playlist to the client at one time. The client screens and sorts the videos in the video playlist and determines the order and method of video playback according to the code logic written in the client. Among them, the code logic inside the client is pre-set, usually static, and not easy to adjust according to external changes.

[0081] Since the client needs to request updates periodically instead of getting updates in real time, the video playlist is not updated in a timely manner and important updates may be missed between two requests. In addition, the video playlist is not updated dynamically, making it difficult to quickly respond to updates or users' immediate needs, which means that the playback content cannot be adjusted instantly based on real-time data or events.

[0082] Due to the lack of real-time and dynamic update capabilities, the system cannot adjust the playback strategy based on user behavior, environmental changes or other dynamic factors, that is, it is limited in flexibility and intelligence.

[0083] In response to the above technical problems, the inventors took into account that the video round-robin playback request initiated by the client is a regular request, and the preset playback logic of the client makes it difficult to dynamically adjust the playback order of the video playlist. Based on this, the inventors thought that the server can push updates to the client in real time, so they initiate a video round-robin playback request through the server to ensure the real-time nature of the video round-robin playback. At the same time, the server can also flexibly adjust the playback strategy and content based on the real-time video obtained to ensure that users can obtain important information in a timely manner. Through real-time adjustments, the server can better respond to external changes and user needs, improving the flexibility and intelligence level of video round-robin playback.

[0084] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0085] An embodiment of the present application provides a video round-robin playback method. Figure 2 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 1 ,like Figure 2 As shown, the video round-robin playback method includes:

[0086] S201. In response to a play request initiated by a video patrol server, obtain a real-time video to be patrolled and played indicated by the play request.

[0087] The video patrol server is a server responsible for managing and scheduling video playback, and the playback request initiated by the video patrol server is used to instruct the video to be played in a patrol manner.

[0088] The video patrol server usually establishes a network connection with the video source through a protocol such as Real-Time Streaming Protocol (RTSP) or HyperText Transfer Protocol (HTTP). After the network connection is successfully established, the video patrol server sends a play request to the video source and receives real-time video from the video source. The video source can be an IPC or a streaming media server.

[0089] S202: Determine a hotspot value corresponding to the real-time video, and determine a playback priority of the real-time video based on the hotspot value.

[0090] The hotspot value is an indicator calculated based on multiple factors, such as the number of viewers, viewing time, user interaction frequency, etc., which is used to quantify the degree of attention paid to the real-time video. The playback priority determines the order or importance of the real-time video in the round-robin playback or resource allocation. Specifically, the real-time video with a high hotspot value is given a higher playback priority.

[0091] It should be noted that, when different management strategies or priority rules need to be applied to different types of real-time videos, the acquired real-time videos can be grouped to simplify the subsequent processing flow. In a possible implementation, the real-time videos can be grouped based on preset rules to obtain multiple video combinations, wherein the types of the multiple video combinations include alarm patrol groups, manual patrol groups, and automatic patrol groups.

[0092] Specifically, the playback content of the real-time video and the preset attention content of the playback request initiated by the video patrol server are determined. If the playback content includes the preset attention content, the real-time video is divided into the video combination of the manual patrol group; if the playback content does not include the preset attention content, the real-time video is divided into the video combination of the automatic patrol group; if the playback content includes the preset alarm content, the real-time video is divided into the video combination of the alarm patrol group.

[0093] Explanatory, the hotspot value of the real-time video in each video combination enables the video patrol server to adjust the order and frequency of video playback according to the user's interests and behaviors to increase the playback probability of the real-time videos that the user is interested in. For example, if a real-time video is frequently watched by a user over a period of time, the video patrol server can increase its playback priority in the video playlist so that the user can see it more easily.

[0094] For key video objects, the video patrol server can increase the number of times they are played to meet the user's attention to specific content. For example, in some security monitoring scenarios, videos of important areas can be played more frequently to detect abnormal situations in a timely manner.

[0095] Therefore, the hotspot value of the real-time video in the video combination can be determined, and the playback priority of the real-time video can be determined according to the type of the video combination and the hotspot value of the real-time video in the video combination. Among them, the hotspot value of the real-time video in the video combination of the alarm patrol group is greater than the hotspot value of the real-time video in the video combination of the manual patrol group, and the hotspot value of the real-time video in the video combination of the manual patrol group is greater than the hotspot value of the real-time video in the video combination of the automatic patrol group. This means that the video patrol server can automatically adjust the playback priority of the video playlist, and in an emergency, the real-time video in the alarm patrol group will be played to the user first, providing the user with more timely information.

[0096] For example, the hotspot value of the real-time video in the video combination of the alarm patrol group is the highest, and its hotspot value is between 80-100; followed by the real-time video in the video combination of the manual patrol group, and its hotspot value is between 40-79; and finally the real-time video in the video combination of the manual patrol group, and its hotspot value is between 1-39.

[0097] It can be understood that grouping real-time videos can help create an association table structure to facilitate management and query of grouping information and related attributes of real-time videos, as well as determine the association relationship between real-time videos. For example, the main camera shoots the core factory building of the factory, and the other associated cameras shoot the main roads of the core factory building. The shooting content of each camera can be determined by manual configuration.

[0098] S203. Sort the real-time videos in descending order according to the play priority to obtain a video play list; and send the video play list to the target display device for round-robin play.

[0099] It should be explained that the hotspot values ​​of the real-time videos included in each type of video combination will be different. According to the numerical value of the hotspot value of the real-time video, it can be determined that the order of the real-time videos in the video playlist is the real-time videos of the alarm patrol group, the real-time videos of the manual patrol group, and the real-time videos of the automatic patrol group. In other words, the real-time videos in the video playlist are sorted in descending order according to the hotspot value.

[0100] In a specific example, Figure 3 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 2 ,like Figure 3 As shown, looping through the video playlist to play the real-time video on the target display device includes the following steps:

[0101] S301, sorting the real-time videos in descending order according to the play priority to obtain a video play list;

[0102] S302, obtaining a real-time video from the video playlist, and traversing in descending order according to the play priority;

[0103] For example, the hotspot value of the first real-time video in the video playlist can be set to 100. If the hotspot value of a real-time video obtained from the video playlist is 76, it means that the real-time videos with hotspot values ​​of 77-100 have been traversed, and the real-time videos with hotspot values ​​less than 76 are traversed.

[0104] S303, determining whether the real-time video obtained from the video playlist belongs to the alarm patrol group;

[0105] If yes, execute S304; if no, execute S305.

[0106] S304, generating a video window layout for the real-time video of the alarm patrol group on the target display device, and executing S309;

[0107] S305, determining whether the real-time video obtained from the video playlist belongs to the manual patrol group;

[0108] If yes, execute S306; if no, execute S307.

[0109] S306, generating a video window layout for the real-time video of the manual patrol group on the target display device, and executing S309;

[0110] S307, determining whether the real-time video obtained from the video playlist belongs to the automatic patrol group;

[0111] If yes, execute S308; if no, end the traversal.

[0112] S308, generating a video window layout for the real-time video of the automatic patrol group on the target display device, and executing S309;

[0113] S309, outputting the real-time video to the target display device to play the real-time video on the target display device;

[0114] S310: After the target display device finishes playing, return to S302 and continue to send new real-time video to the target display device.

[0115] It can be seen that the logic of video patrol playback is as follows: after obtaining the video playlist, the video patrol server starts the video patrol service, traverses the video playlist, obtains a real-time video from the video playlist each time, and continuously outputs the real-time video to the target display device to play the real-time video on the target display device. After the target display device finishes playing, it notifies the video patrol server and waits in a loop for the video patrol server to send a new real-time video. This cycle continues until all real-time videos in the video playlist are traversed, and the video patrol server notifies the target display device that the patrol playback is over.

[0116] Next, the video patrol server will re-acquire the new video playlist and restart the new traversal logic to realize the automatic video patrol playback function. The target display device is only responsible for loop playback, while the video patrol server takes on most of the video patrol logic functions, which can better manage and schedule resources, while reducing the complexity and resource consumption of the target display device. For example, the video patrol server can select the appropriate real-time video for distribution according to the needs and performance of different target display devices to improve the quality and stability of video playback.

[0117] It should be noted that when the real-time video in each type of video combination is played on the target display device, the corresponding video window layout may also be different. Specifically, the first target real-time video waiting to be played in the video play list is obtained, and the video combination to which the first target real-time video belongs is determined. According to the video combination to which the first target real-time video belongs, the video window layout of the target display device is determined, and then the first target real-time video is played on the target display device based on the video window layout.

[0118] Explanatory, the video window layout of the target display device includes multiple types, such as picture-in-picture layout, primary-secondary layout, low-split screen equal layout, medium-split screen equal layout, high-split screen equal layout, and ultra-high-split screen equal layout. Among them, the picture-in-picture layout is mostly used in video conferencing or communication scenarios, and the primary-secondary layout refers to a large video playback window and multiple small video playback windows. Low-split screen equal layouts include 2×2 and 3×3 video window layouts, medium-split screen equal layouts include 4×4 and 5×4 video window layouts, high-split screen equal layouts include 6×4 and 6×6 video window layouts, and ultra-high-split screen equal layouts include 8×6, 7×7, and 8×8 video window layouts. The specific number of video playback windows contained in different video window layouts is not limited here.

[0119] Taking the real-time video in the alarm patrol group as an example, a four-split screen, i.e., 2×2 video window layout, is usually adopted for playback on the target display device. In a specific example, if the video patrol server obtains the real-time video of the alarm patrol group from the video playlist, it is determined whether the next real-time video to be obtained is still the real-time video of the alarm patrol group. If the real-time videos obtained by the video patrol server four times in a row all belong to the alarm patrol group, a 2×2 video window layout is generated on the target display device. If the real-time videos obtained by the video patrol server four times in a row also include real-time videos of the manual patrol group and / or the automatic patrol group, the corresponding video window layout is generated on the target display device according to actual needs.

[0120] Specifically, Figure 4 Schematic diagram of the process of the video patrol playback method provided in the embodiment of the present application Figure 3 ,like Figure 4 As shown, the specific steps for the video patrol server to obtain real-time video from the video playlist are as follows:

[0121] S401, obtaining a real-time video from a video playlist;

[0122] S402, determining whether the real-time video belongs to an alarm patrol group;

[0123] If not, execute S403; if so, execute S404.

[0124] S403, generating a corresponding video window layout on the target display device according to actual needs;

[0125] S404, obtaining the next real-time video of the real-time video from the video play list;

[0126] S405, determining whether the next real-time video belongs to the alarm patrol group;

[0127] If not, execute S403; if so, execute S406.

[0128] S406, determining whether the number of real-time videos obtained from the video playlist is less than or equal to 4;

[0129] If not, execute S407; if so, execute S401.

[0130] S407: Generate a 2×2 video window layout on the target display device.

[0131] It is understandable that the video window layout generated on the target display device includes at least one video playback window. Each video playback window is regarded as an independent display unit, and different resolutions can be specified for each video playback window to adapt to different real-time videos or display requirements and obtain the best viewing effect. Among them, the resolution of each video playback window is determined by the total resolution of the target display device and the video window layout. Further, the real-time video is transcoded according to the resolution of each video playback window to adjust the resolution of the real-time video to a resolution suitable for playback in the corresponding video playback window, thereby ensuring that the real-time video has the best clarity and compatibility when playing.

[0132] In a possible implementation, at least one video play window included in the video window layout is determined, and the resolution of the video play window is determined. Based on the resolution, a first target real-time video waiting to be played in the video play list is transcoded, and the transcoded first target real-time video is played in the at least one video play window.

[0133] Explanatory, after the first target real-time video is transcoded, it is also necessary to perform decoding processing when playing in the video playback window. In a specific example, if the transcoding and decoding process adopts the advanced video coding H264 standard, the transcoding calculation amount is 5-10 times the decoding calculation amount, usually about 7 times; if the transcoding and decoding process adopts the high-efficiency video coding H265 standard, the transcoding calculation amount is 3-10 times the decoding calculation amount, usually about 6 times. In addition, the transcoding calculation amount in the high-efficiency video coding H265 standard is 2-5 times the transcoding calculation amount in the advanced video coding H264 standard, and the decoding calculation amount in the high-efficiency video coding H265 standard is 1.5-2 times the decoding calculation amount in the advanced video coding H264 standard.

[0134] Generally speaking, real-time video can be transcoded according to different resolutions to obtain the main stream, sub-stream and / or grand-stream of the real-time video. In a possible implementation, Figure 5 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 1 ,like Figure 5As shown, if the video window layout of the target display device is a single-screen layout, the original real-time video or the main video corresponding to the main code stream of the real-time video can be played directly. If the video window layout of the target display device is a low-split screen equal-division layout, the sub-video corresponding to the sub-code stream of the real-time video and / or the grandson video corresponding to the grandson code stream can be played. If the video window layout of the target display device is a primary-secondary layout, the large video playback window can play the main video corresponding to the main code stream of the real-time video, and multiple small video playback windows can play the sub-video corresponding to the sub-code stream of the real-time video. If the video window layout of the target display device is a medium-split screen equal-division layout or a high-split screen equal-division layout, the sub-video corresponding to the sub-code stream of the real-time video and / or the grandson video corresponding to the grandson code stream can be played. If the video window layout of the target display device is an ultra-high-split screen equal-division layout, it is necessary to use picture synthesis and mixing mode to achieve smooth video playback. Among them, the resolution of the target display device can be 1080p, 2k or 4k. How to select a suitable real-time video for playback according to the video window layout of the target display device is determined by the actual playback requirements, and this application does not make specific restrictions.

[0135] In a specific embodiment, when the resolution of the video playback window is 4k, 2k, 1080p, or 720p, the original real-time video can be played. When the resolution of the video playback window is 1080p or 720p, the main code stream of the real-time video can be decoded to obtain the main video of the real-time video and played in the video playback window; when the resolution of the video playback window is 480p or 360p, the sub-code stream of the real-time video can be decoded to obtain the sub-video of the real-time video and played in the video playback window; when the resolution of the video playback window is 240p or 144p, the sub-code stream of the real-time video can be decoded to obtain the sub-video of the real-time video and played in the video playback window.

[0136] It should be noted that when the real-time video of the manual patrol group and the automatic patrol group is played on the target display device, the preset alarm content may suddenly appear. At this time, the real-time video of the manual patrol group and / or the automatic patrol group being played needs to be divided into the alarm patrol group. Specifically, the real-time video of the second target currently being played by the target display device is obtained. If the second target real-time video belongs to the manual patrol group and / or the automatic patrol group, the second target real-time video is monitored. When it is detected that the playback content of the second target real-time video includes the preset alarm content, the second target real-time video is divided into the alarm patrol group.

[0137] Since the video patrol server can complete the reception, analysis and processing of real-time videos, after the real-time videos of the manual patrol group and / or the automatic patrol group are divided into the alarm patrol group, the video patrol server can modify the hotspot values ​​of these real-time videos in real time.

[0138] It should be understood that when the target display device performs a round-robin playback of the real-time video, it is also necessary to determine the playback duration of the real-time video. Specifically, the historical playback times of the real-time video in a preset historical time period are obtained, and the historical hotspot values ​​corresponding to each playback of the real-time video in the preset historical time period are determined. Based on the historical playback times and the historical hotspot values, the historical average playback duration of the real-time video in the preset historical time period is determined, and further based on the historical average playback duration, the playback duration of the real-time video in the round-robin playback is determined.

[0139] In a specific example, the number of historical playbacks of the real-time video within a preset historical time period is determined. , and the historical hotspot values ​​corresponding to each playback of the real-time video within the preset historical time period , and then calculate the average value of the historical hotspot value ,in, The real-time videos in the video playlist are prioritized by the average percentage of historical hotspot values, and the historical average play time of the real-time videos in the preset historical time period is determined. Then, the play time of the real-time video in the patrol play is determined based on the preset patrol play time and the historical average play time.

[0140] For example, the video patrol server sends a 10-minute video patrol playback task to the target display device. Assuming that the total number of videos played in the 10 minutes is real-time videos, then according to calculation, it can be determined that the playing time of real-time video 1 is 60 seconds, the playing time of real-time video 2 is 50 seconds, , real-time video The playback time of The target display device will perform round-robin playback in turn according to the above playback duration. The video patrol playback is completed when all real-time videos have been played. The video patrol server sends other video patrol playback tasks again until the target display device actively stops the patrol, and then the video patrol playback will end.

[0141] In summary, Figure 6 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 2 ,like Figure 6As shown, the video patrol playback architecture of the present application includes IPC, streaming media server, intelligent recognition server, transcoding server, video patrol server, and target display device. Among them, the intelligent recognition server interacts with the streaming media server and the video patrol server to analyze and classify the real-time video; the transcoding server interacts with the streaming media server and the video patrol server to transcode the real-time video to obtain the main code stream, sub-code stream and grandchild code stream of the real-time video. The target display device can be a web page, an Android or iOS mobile terminal, and a personal computer PC terminal.

[0142] Figure 7 Application scenarios of the video round-robin playback method provided in the embodiment of the present application Figure 3 ,like Figure 7 As shown, assuming that the total resolution of the target display device is 1080p, 2k or 4k. According to the total resolution of the target display device and the video window layout, the real-time video is transcoded and played on at least one video playback window of the target display device.

[0143] For example, if the video window layout of the target display device is a primary-secondary layout, the main video corresponding to the main code stream of the real-time video is played in the large video playback window, and multiple small video playback windows play the grandson videos corresponding to the grandson code streams of the real-time video. If the video window layout of the target display device is a single-screen layout, the main video corresponding to the main code stream of the real-time video is played. If the video window layout of the target display device is 2×2, the sub-video corresponding to the sub-code stream of the real-time video and / or the grandson video corresponding to the grandson code stream are played. If the video window layout of the target display device is 6×6, the grandson video corresponding to the grandson code stream of the real-time video is played.

[0144] The video patrol playback method provided by the present application responds to the playback request initiated by the video patrol server, wherein the playback request is used to indicate the video to be played in a patrol. The video patrol server initiates a playback request, which is a real-time communication method, allowing the video patrol server to update and push the latest real-time video in real time, ensuring the real-time nature of the video patrol playback. Next, the real-time video to be played in a patrol indicated by the playback request is obtained, and the real-time video is grouped based on the preset rules to obtain three types of video combinations: alarm patrol group, manual patrol group, and automatic patrol group. After that, the hotspot value of the real-time video in each type of video combination is determined, and the playback priority of the real-time video is determined based on the type of video combination and the hotspot value of the real-time video, wherein the hotspot value represents the degree of attention paid to the real-time video. Further, each real-time video is sorted in descending order according to the playback priority to obtain a video play list, and the video play list is sent to the target display device. The video window layout of the target display device is determined, and whether the real-time video needs to be transcoded according to the video window layout is determined, and the transcoded real-time video and / or the original real-time video are played in a patrol on the target display device. During the process of patrol playback, the video patrol server can dynamically adjust the playback order of real-time videos in the video playlist according to the latest data or events, thereby improving the flexibility and intelligence of the video patrol playback process.

[0145] Figure 8 A schematic diagram of the structure of a video playback device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the video round-robin playback device 800 includes: an acquisition module 801, a determination module 802, a sorting module 803, and a playback module 804;

[0146] The acquisition module 801 is used to respond to the play request initiated by the video patrol server and obtain the real-time video to be played in patrol indicated by the play request; wherein the play request is used to instruct the video to be played in patrol;

[0147] The determination module 802 is used to determine the hotspot value corresponding to the real-time video, and determine the playback priority of the real-time video based on the hotspot value; wherein the hotspot value represents the degree of attention paid to the real-time video;

[0148] The sorting module 803 is used to sort the real-time videos in descending order according to the play priority to obtain a video play list;

[0149] The playing module 804 is used to send the video playlist to the target display device for round-robin playing.

[0150] Optionally, the determination module 802 further includes: a grouping module 805, which is used to group the real-time video based on a preset rule to obtain a plurality of video combinations; wherein the types of the plurality of video combinations include an alarm patrol group, a manual patrol group, and an automatic patrol group;

[0151] The determination module 802 is further used to determine the hotspot value of the real-time video in the video combination; wherein the hotspot value of the real-time video in the video combination of the alarm patrol group is greater than the hotspot value of the real-time video in the video combination of the manual patrol group, and the hotspot value of the real-time video in the video combination of the manual patrol group is greater than the hotspot value of the real-time video in the video combination of the automatic patrol group;

[0152] The play priority of the real-time video is determined based on the type of the video combination and the hotspot value of the real-time video in the video combination.

[0153] Optionally, the determination module 802 is further used to determine the playback content of the real-time video and the preset focus content of the playback request;

[0154] The grouping module 805 is also used to classify the real-time video into the video combination of the manual patrol group if the playback content includes preset attention content; if the playback content does not include the preset attention content, the real-time video is classified into the video combination of the automatic patrol group; if the playback content includes preset alarm content, the real-time video is classified into the video combination of the alarm patrol group.

[0155] Optionally, the acquisition module 801 is further used to acquire the first target real-time video waiting to be played in the video play list;

[0156] The determination module 802 is further used to determine the video combination to which the first target real-time video belongs; based on the video combination to which the first target real-time video belongs, determine the video window layout of the target display device;

[0157] The playing module 804 is further configured to play the first target real-time video on the target display device according to the video window layout.

[0158] Optionally, the determination module 802 is further configured to determine at least one video playback window included in the video window layout, and determine a resolution of the video playback window;

[0159] The playing module 804 further includes: a processing module 806, which is used to transcode the first target real-time video based on the resolution, and play the transcoded first target real-time video in at least one video playing window.

[0160] Optionally, the acquisition module 801 is further configured to acquire a second target real-time video currently being played by the target display device;

[0161] The determination module 802 further includes: a monitoring module 807, which is used to monitor the second target real-time video if the second target real-time video belongs to the manual patrol group and / or the automatic patrol group;

[0162] The grouping module 805 is further configured to group the second target real-time video into an alarm patrol group when it is detected that the playback content of the second target real-time video includes preset alarm content.

[0163] Optionally, the acquisition module 801 is further used to obtain the historical playback times of the real-time video within a preset historical time period;

[0164] The determination module 802 is further used to determine the historical hotspot value corresponding to each playback of the real-time video within a preset historical time period;

[0165] Based on the historical playback times and historical hotspot values, determine the historical average playback duration of the displayed real-time video within a preset historical time period;

[0166] Based on the historical average playback duration, determine the playback duration of the real-time video in the patrol playback.

[0167] The video round-robin playback device provided in the embodiment of the present application can be used to execute the video round-robin playback method in any of the above embodiments. Its implementation principle and technical effects are similar and will not be repeated here.

[0168] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software calling through processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software calling through processing elements, and some modules can be implemented in the form of hardware. In addition, all or part of these modules can be integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0169] Fig. 9 The hardware structure diagram of the electronic device provided in this application. Fig. 9 As shown, the electronic device 900 includes:

[0170] Processor 901 and memory 902;

[0171] Memory stores computer-executable instructions;

[0172] The processor executes the computer-executable instructions stored in the memory 902, so that the electronic device executes the video round-robin playback method as described above.

[0173] It should be understood that the processor 901 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), or application-specific integrated circuits (ASIC). A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor. The memory 902 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (NVM), such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a disk, or an optical disk.

[0174] The electronic device provided in the embodiment of the present application can be used to execute the video patrol playback method provided in any of the above method embodiments. Its implementation principle and technical effects are similar and will not be repeated here.

[0175] The embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the video patrol playback method as described above.

[0176] The embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it is used to implement the video patrol playback method as described above.

[0177] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0178] It should be further noted that, although the various steps in the flowchart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0179] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present application can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0180] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present application may be integrated into one unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0181] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. Unless otherwise specified, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. Unless otherwise specified, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory (RRAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), an enhanced dynamic random access memory (EDRAM), a high-bandwidth memory (HBM), a hybrid memory cube (HMC), etc.

[0182] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0183] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0184] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0185] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A video round-robin playback method, characterized in that: include: In response to a play request initiated by a video patrol server, obtaining a real-time video to be patrolled and played indicated by the play request, wherein the play request is used to instruct the patrol play of the video; Determine a hotspot value corresponding to the real-time video, and determine a playback priority of the real-time video based on the hotspot value; wherein the hotspot value represents the degree of attention paid to the real-time video; According to the play priority, the real-time videos are sorted in descending order to obtain a video play list; and the video play list is sent to a target display device for round-robin play.

2. The method according to claim 1, characterized in that: The determining of the hotspot value corresponding to the real-time video, and determining the playback priority of the real-time video based on the hotspot value, includes: The real-time video is grouped based on preset rules to obtain a plurality of video combinations; wherein the types of the plurality of video combinations include an alarm patrol group, a manual patrol group, and an automatic patrol group; Determine the hotspot value of the real-time video in the video combination; wherein the hotspot value of the real-time video in the video combination of the alarm patrol group is greater than the hotspot value of the real-time video in the video combination of the manual patrol group, and the hotspot value of the real-time video in the video combination of the manual patrol group is greater than the hotspot value of the real-time video in the video combination of the automatic patrol group; Based on the type of the video combination and the hotspot value of the real-time video in the video combination, the play priority of the real-time video is determined.

3. The method according to claim 2, characterized in that The real-time videos are grouped based on a preset rule to obtain a plurality of video combinations, including: Determining the playback content of the real-time video and the preset focus content of the playback request; If the playback content includes the preset content of interest, the real-time video is classified into the video combination of the manual patrol group; if the playback content does not include the preset content of interest, the real-time video is classified into the video combination of the automatic patrol group; If the playback content includes preset alarm content, the real-time video is divided into the video combination of the alarm patrol group.

4. The method according to claim 2, characterized in that: The method further comprises: Acquire a first target real-time video waiting to be played in the video playlist, and determine a video combination to which the first target real-time video belongs; Based on the video combination to which the first target real-time video belongs, a video window layout of the target display device is determined; and according to the video window layout, the first target real-time video is played on the target display device.

5. The method according to claim 4, characterized in that Playing the first target real-time video on the target display device according to the video window layout includes: Determine at least one video playback window included in the video window layout, and determine the resolution of the video playback window; The first target real-time video is transcoded based on the resolution, and the transcoded first target real-time video is played in the at least one video playback window.

6. The method according to any one of claims 2 to 5, characterized in that The method further comprises: Acquire a second target real-time video currently being played by the target display device; If the second target real-time video belongs to the manual patrol group and / or the automatic patrol group, the second target real-time video is monitored; When it is detected that the playback content of the second target real-time video includes the preset alarm content, the second target real-time video is divided into the alarm patrol group.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Obtain the historical number of times the real-time video is played within a preset historical time period, and determine the historical hotspot value corresponding to each playback of the real-time video within the preset historical time period; Based on the historical number of playbacks and the historical hotspot value, determine the historical average playback duration of the real-time video in the preset historical time period; Based on the historical average play time, the play time of the real-time video in the round-robin play is determined.

8. A video playback device, characterized in that: include: An acquisition module, used for responding to a play request initiated by a video patrol server, and acquiring a real-time video to be played in a patrol mode indicated by the play request; wherein the play request is used to instruct the video to be played in a patrol mode; A determination module, used to determine a hotspot value corresponding to the real-time video, and determine the playback priority of the real-time video based on the hotspot value; wherein the hotspot value represents the degree of attention paid to the real-time video; A sorting module, used to sort the real-time videos in descending order according to the play priority to obtain a video play list; The playing module is used to send the video playlist to the target display device for round-robin playing.

9. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the video round-robin playback method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the video round-robin playback method according to any one of claims 1 to 7.

Images