A method and system for intelligent video monitoring real-time display alarm video picture

Abstract

The application discloses a kind of intelligent video monitoring real-time display alarm video picture method and system, and the monitoring video code stream obtained is screened initially to alarm event, and whether the possibility of actual alarm event occurs is judged by preliminary screening to monitoring video;If preliminary screening judges that there is the possibility of actual alarm event, then start to detect and identify actual alarm event to video code stream, and simultaneously, according to the video address contained in the preliminary screening result, video source is preloaded, and the start preparation of the video source is completed;If actual alarm event occurs by continuing to detect and identify, then according to the actual alarm event, the video source corresponding to the start preparation completed is obtained, and alarm video picture is played instantly in client side.According to the alarm preliminary screening result, the video source that possibly occurs alarm event is pre-started preparation work in client side, and once alarm event occurs, client side can not wait for start process, and alarm picture is presented immediately.

Description

Technical Field

[0001] This invention relates to the field of intelligent monitoring technology, specifically to a method and system for real-time display of alarm video footage in intelligent video monitoring. Background Technology

[0002] Many current video surveillance systems are now intelligent, capable of automatically identifying incidents in video footage and immediately pushing these incidents as alarm messages to the video surveillance system's client program (which can be a specially developed client program or a browser program running on the monitoring center staff's computer). The messages are then displayed on the monitoring center staff's computer screen or on the large screen in the monitoring center. These types of surveillance systems are increasingly being used in industries such as power.

[0003] Upon seeing the aforementioned alarm message, monitoring center staff typically and immediately check the live video feed from the camera corresponding to the alarm location. In this scenario, if the video feed on the monitoring center staff's computer or the monitoring center's large screen could be automatically switched to the feed from the camera at the location of the alarm the moment it occurs, the user experience of the video surveillance system would be further enhanced.

[0004] In both scenarios, the client needs to display the alarm video feed in real time. However, this requires the client program to establish a network connection with the real-time video source (camera, network video recorder (NVR), or video streaming server), establish a streaming session, acquire and cache the first frame of the video stream, and decode the first frame. These processes mean that there is a significant delay between when staff see the alarm video feed and when the alarm occurs, resulting in insufficient real-time performance. This delay is even more pronounced when the network is congested. In power applications and similar scenarios, those few seconds of delay often represent crucial moments in the alarm's occurrence. Reducing the delay between the client-side alarm video feed and the alarm's occurrence is the technical problem this invention aims to solve. Summary of the Invention

[0005] To address this issue, the present invention provides a method and system for real-time display of alarm video footage in intelligent video surveillance, thereby resolving the problem of delay in the display of alarm video footage by the client in existing intelligent video surveillance systems relative to the time of the alarm occurrence.

[0006] To achieve the above objectives, the present invention provides the following technical solution:

[0007] According to a first aspect of the present invention, a method for real-time display of alarm video footage in intelligent video surveillance is provided, the method comprising:

[0008] Perform initial screening of alarm events on the acquired surveillance video streams to determine whether there is a possibility that an actual alarm event has occurred in the surveillance video.

[0009] If the initial screening determines that there is a possibility of an actual alarm event, then the detection and identification of the actual alarm event is initiated on the video stream. At the same time, the video source is preloaded according to the video address contained in the initial screening result to complete the preparation for the start-up of the video source.

[0010] If an actual alarm event is detected through continued detection, the corresponding video source that has completed the start-up preparation is obtained based on the actual alarm event, and the alarm video screen is played on the client in real time.

[0011] If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released.

[0012] Furthermore, the method also includes:

[0013] While starting the detection and identification of actual alarm events in the video stream, the initial screening results are pushed to the client so that the client can preload the video source according to the video address contained in the initial screening results and complete the preparation for the video source to start playing.

[0014] If an actual alarm event is detected through continued detection, the actual alarm event information is sent to the client so that the client can obtain the corresponding video source that has completed the start-up preparation based on the actual alarm event and play the alarm video screen in real time.

[0015] Furthermore, the method also includes:

[0016] Continue to perform initial screening of the monitoring video streams. If it is found that the video no longer has the potential to trigger an alarm, then terminate the playback of the initially screened video source and release the corresponding video resources.

[0017] Furthermore, the method also includes:

[0018] Establish and maintain a fixed video channel between the client and the server;

[0019] On the server side, the video source is preloaded based on the initial screening results. When an actual alarm event occurs, the video source corresponding to the actual alarm event is forwarded to the client through the fixed video channel for real-time playback of the alarm video.

[0020] Furthermore, the method also includes:

[0021] If the initial screening finds too many video sources that may simultaneously trigger alarm events, resulting in insufficient client buffer resources, then the preloading and playback of video sources with low alarm levels will be stopped, and video frames with high alarm levels will be loaded first.

[0022] According to a second aspect of the present invention, a system for real-time display of alarm video feeds in intelligent video surveillance is provided, the system comprising:

[0023] The alarm screening module is used to perform initial screening of alarm events on the acquired monitoring video stream, and to determine whether there is a possibility that an actual alarm event has occurred in the monitoring video.

[0024] The preloading module is used to detect and identify actual alarm events in the video stream if the initial screening determines that there is a possibility of an actual alarm event. At the same time, it preloads the video source according to the video address contained in the initial screening result to complete the preparation for the start-up of the video source.

[0025] The video playback control module is used to obtain the corresponding video source that has completed the start-up preparation and play the alarm video screen on the client in real time if an actual alarm event is detected by continued detection.

[0026] If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released.

[0027] Furthermore, the preloading module is specifically used to push the preliminary screening results to the client while starting the detection and identification of actual alarm events on the video stream, so that the client can preload the video source according to the video address contained in the preliminary screening results and complete the preparation for the start of playback of the video source.

[0028] The video playback control module is used to send the actual alarm event information to the client if an actual alarm event is detected through continued detection, so that the client can obtain the corresponding video source that has completed the start-up preparation and play the alarm video screen in real time according to the actual alarm event.

[0029] Furthermore, the alarm screening module is specifically used for:

[0030] Continue to perform initial screening of the monitoring video streams. If it is found that the video no longer has the potential to trigger an alarm, then terminate the playback of the initially screened video source and release the corresponding video resources.

[0031] According to a third aspect of the present invention, a computer storage medium is provided, the computer storage medium containing one or more program instructions, the one or more program instructions being executed by a system for intelligent video surveillance that displays alarm video images in real time as described in any of the preceding claims.

[0032] The present invention has the following advantages:

[0033] This invention proposes a method and system for real-time display of alarm video feeds in intelligent video surveillance. The method involves initial screening of the acquired surveillance video stream for alarm events to determine if an actual alarm event is likely to occur. If the initial screening indicates a possibility of an actual alarm event, detection and identification of the actual alarm event are initiated in the video stream. Simultaneously, video sources are pre-loaded based on the video addresses contained in the initial screening results, completing the preparation for playback of the video sources. If an actual alarm event is detected, the corresponding video source that has completed playback preparation is obtained based on the actual alarm event, and the alarm video feed is played instantly on the client side. Based on the initial alarm screening results, the client side pre-prepares for playback of video sources that may trigger alarm events. Once an alarm event actually occurs, the client side can immediately display the alarm feed without waiting for the playback process to begin. Attached Figure Description

[0034] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely exemplary, and those skilled in the art can derive other embodiments based on the provided drawings without creative effort.

[0035] Figure 1 This is a flowchart illustrating a method for real-time display of alarm video footage in intelligent video surveillance, as provided in Embodiment 1 of the present invention.

[0036] Figure 2 This is a flowchart illustrating the specific implementation of a method for real-time display of alarm video footage in intelligent video surveillance, as provided in Embodiment 1 of the present invention. Detailed Implementation

[0037] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0038] Example 1

[0039] like Figure 1 and Figure 2 As shown in the figure, this embodiment proposes a method for real-time display of alarm video footage in intelligent video surveillance, the method comprising:

[0040] S100. Perform preliminary screening of alarm events on the acquired surveillance video stream to determine whether there is a possibility of an actual alarm event occurring in the surveillance video.

[0041] For example, identifying "people in the video" in the video stream can serve as an initial screening for "people falling to the ground" alarm events.

[0042] Other examples:

[0043] (1) The initial screening algorithm is "the scene has changed" (this is a faster and simpler algorithm), but what may actually happen later is more specific such as "someone has broken in" or "there are small animals". When the person is still far away in the scene, "the scene has changed" can be detected, but because the person is relatively far away, it will take several seconds or minutes for the person to get closer before "someone" can be detected.

[0044] (2) The initial screening algorithm is "someone detected", while the actual alarm event is "stranger detected". Among them, "someone detected" is easier and faster than "stranger detected". The latter requires comparing the faces in the video with the registered faces one by one. Only when all the comparisons are not consistent can "stranger be detected".

[0045] The video image detection algorithm used in this embodiment is existing technology and will not be described in detail here.

[0046] S200. If the initial screening determines that there is a possibility of an actual alarm event, the initial screening result will be pushed to the client while the detection and identification of the actual alarm event is started on the video stream, so that the client can preload the video source according to the video address contained in the initial screening result and complete the preparation for the video source to start playing.

[0047] For example, if the initial screening detects that there are people in the video, while starting the "person falling" algorithm to identify the video stream, the initial screening result of the video with "people in the video" is immediately pushed to the client. The client then completes the playback preparation work for the video source in the initial screening result in the background.

[0048] The loading process is dynamic, ensuring that the bitstream in the buffer contains the latest frames. (If the buffer is full, the oldest frames in the buffer are released, and the freed-up space is used to store the latest received video frames.)

[0049] S300. If an actual alarm event is detected through continued detection, the actual alarm event information is sent to the client so that the client can obtain the corresponding video source that has completed the start-up preparation based on the actual alarm event and play the alarm video screen in real time.

[0050] If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released.

[0051] The client locates the video source containing the alarm event information from the initial screening of video sources that have already completed the pre-playback preparation steps, and immediately displays it on the screen. Since the previous steps have already completed the pre-playback preparation for the alarm video source, the user does not need to wait and can immediately watch the video.

[0052] For example, the detection and recognition of "person falling to the ground" continues. If "person falling to the ground" actually occurs, an alarm event information is pushed to the client. The client finds the video source corresponding to "person falling to the ground" from the video sources that have completed the start-up preparation work in step three and immediately displays it on the screen.

[0053] Furthermore, the method also includes:

[0054] S400: Continue to perform initial screening of the monitored video stream. If it is found that the video no longer has the possibility of triggering an alarm, push the corresponding information to the client so that the client can terminate the start-up of the initially screened video source and release the corresponding video resources.

[0055] If the initial screening detects too many video sources that may simultaneously trigger alarm events, leading to insufficient client buffer resources, then the preloading and playback of video sources with low alarm levels will be stopped, and video frames with high alarm levels will be loaded first. Of course, in general, it's unlikely that many alarms will occur simultaneously, and the buffer resources will be sufficient.

[0056] In this embodiment, a fixed video channel can also be established and maintained between the client and the server. This video channel only plays once and does not require switching. The server performs the switching and preloading of the video source and the server in advance based on the initial screening results of the algorithm. When an alarm actually occurs, the server immediately forwards the bitstream of the video source where the alarm occurs directly to the client through the aforementioned fixed video channel.

[0057] Example 2

[0058] Corresponding to Embodiment 1 above, this embodiment proposes a system for real-time display of alarm video feeds in intelligent video surveillance, the system comprising:

[0059] The alarm screening module is used to perform initial screening of alarm events on the acquired monitoring video stream, and to determine whether there is a possibility that an actual alarm event has occurred in the monitoring video.

[0060] The preloading module is used to detect and identify actual alarm events in the video stream if the initial screening determines that there is a possibility of an actual alarm event. At the same time, it preloads the video source according to the video address contained in the initial screening result to complete the preparation for the start-up of the video source.

[0061] The video playback control module is used to obtain the corresponding video source that has completed the start-up preparation and play the alarm video screen on the client in real time if an actual alarm event is detected by continued detection.

[0062] If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released.

[0063] Furthermore, the preloading module is specifically used to push the preliminary screening results to the client while starting the detection and identification of actual alarm events on the video stream, so that the client can preload the video source according to the video address contained in the preliminary screening results and complete the preparation for the start of playback of the video source.

[0064] The video playback control module is used to send the actual alarm event information to the client if an actual alarm event is detected through continued detection, so that the client can obtain the corresponding video source that has completed the start-up preparation and play the alarm video screen in real time according to the actual alarm event.

[0065] Furthermore, the alarm screening module is specifically used for:

[0066] Continue to perform initial screening of the monitoring video streams. If it is found that the video no longer has the potential to trigger an alarm, then terminate the playback of the initially screened video source and release the corresponding video resources.

[0067] The functions performed by each component in the intelligent video surveillance system for real-time display of alarm video images provided in this embodiment of the invention have been described in detail in the above embodiment 1, so they will not be repeated here.

[0068] Example 3

[0069] Corresponding to the above embodiments, this embodiment proposes a computer storage medium containing one or more program instructions, which are used by a system for real-time display of alarm video images in intelligent video surveillance to execute the method of Embodiment 1.

[0070] Although the present invention has been described in detail above with general descriptions and specific embodiments, modifications or improvements can be made to it, which will be obvious to those skilled in the art. Therefore, all such modifications or improvements made without departing from the spirit of the present invention fall within the scope of protection claimed by the present invention.

Claims

1. A method for intelligent video surveillance real-time display of alarm video pictures, characterized in that, The method includes: Perform initial screening of alarm events on the acquired surveillance video streams to determine whether there is a possibility that an actual alarm event has occurred in the surveillance video. If the initial screening determines that there is a possibility of an actual alarm event, then the detection and identification of the actual alarm event is initiated on the video stream. At the same time, the video source is preloaded according to the video address contained in the initial screening result to complete the preparation for the start-up of the video source. If an actual alarm event is detected through continued detection, the corresponding video source that has completed the start-up preparation is obtained based on the actual alarm event, and the alarm video screen is played on the client in real time. If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released. The method further includes: While starting the detection and identification of actual alarm events in the video stream, the initial screening results are pushed to the client so that the client can preload the video source according to the video address contained in the initial screening results and complete the preparation for the video source to start playing. If an actual alarm event is detected through continued detection, the actual alarm event information is sent to the client so that the client can obtain the corresponding video source that has completed the start-up preparation based on the actual alarm event and play the alarm video screen in real time. Alternatively, a fixed video channel can be established and maintained between the client and the server; the server can preload the video source based on the initial screening results, and when an actual alarm event occurs, the video source corresponding to the actual alarm event can be forwarded to the client through the fixed video channel for real-time playback of the alarm video.

2. The method for real-time display and alarm of video picture in intelligent video surveillance according to claim 1, characterized in that, The method further includes: Continue to perform initial screening of the monitoring video streams. If it is found that the video no longer has the potential to trigger an alarm, then terminate the playback of the initially screened video source and release the corresponding video resources.

3. The method for real-time display and alarm of video image in intelligent video surveillance according to claim 1, characterized in that, The method further includes: If the initial screening finds too many video sources that may simultaneously trigger alarm events, resulting in insufficient client buffer resources, then the preloading and playback of video sources with low alarm levels will be stopped, and video frames with high alarm levels will be loaded first.

4. A system for intelligent video surveillance real-time display of alarm video pictures, characterized in that, The system includes: The alarm screening module is used to perform initial screening of alarm events on the acquired monitoring video stream, and to determine whether there is a possibility that an actual alarm event has occurred in the monitoring video. The preloading module is used to initiate the detection and identification of actual alarm events in the video stream if the initial screening determines that there is a possibility of an actual alarm event occurring. Simultaneously, it preloads the video source based on the video address contained in the initial screening results, preparing the video source for playback. While initiating the detection and identification of actual alarm events in the video stream, it pushes the initial screening results to the client, allowing the client to preload the video source based on the video address contained in the initial screening results, preparing the video source for playback. If an actual alarm event is detected and identified, the actual alarm event information is sent to the client, allowing the client to obtain the corresponding video source that has completed playback preparation and play the alarm video immediately. Alternatively, it establishes and maintains a fixed video channel between the client and the server; the server preloads the video source based on the initial screening results, and when an actual alarm event occurs, it forwards the video source corresponding to the actual alarm event to the client through the fixed video channel for immediate playback of the alarm video. The video playback control module is used to obtain the corresponding video source that has completed the start-up preparation and play the alarm video screen on the client in real time if an actual alarm event is detected by continued detection. If no actual alarm event is detected through continued detection, the pre-loaded video frame will not be displayed, and the latest video frame will be loaded while the old video frame will be released.

5. The system for real-time display and alarm of video image in intelligent video surveillance according to claim 4, characterized in that, The alarm screening module is further used for: Continue to perform initial screening of the monitoring video streams. If it is found that the video no longer has the potential to trigger an alarm, then terminate the playback of the initially screened video source and release the corresponding video resources.

6. A computer storage medium, characterized in that, The computer storage medium contains one or more program instructions, which are used by a system for intelligent video surveillance that displays alarm video images in real time to execute the method as described in any one of claims 1-3.

Images