A media data linkage method based on event alarm

Abstract

A media data linkage method based on event alarms comprises a video cloud platform composed of an alarm capability open platform, a view library and a video platform. A server with video frame extraction capability is deployed in the video cloud platform. An application platform transmits alarm signals and linkage media data based on the GAT1400 standard with the view library, the alarm capability open platform and the video platform. The video cloud platform realizes video transmission with a camera based on GBT28181. The application platform first analyzes the pushed snapshot images. If the alarm event is found to be true, the short video can be linked and pulled for video analysis to confirm the specific circumstances of the alarm event. If the alarm event is a false alarm, it can be ignored, thereby reducing the overall bandwidth consumption and reducing the overall corresponding delay of the system.

Description

Technical Field

[0001] The present invention relates to the technical field of video surveillance, and in particular to a media data linkage method based on event alarm. Background Art

[0002] The video management platform is a software platform that gathers cameras and manages them in a unified manner. It has the capabilities of device access management, video preview control, video storage, and streaming media forwarding. Through the video management platform, users can view the live video of the monitored area in real time, or trace back related events through the video.

[0003] Camera devices can be connected to the video management platform in a variety of ways, generally including the national standard GB / T28181, the international standard ONVIF, and the private protocols of various equipment manufacturers.

[0004] GB / T28181 is a national standard in the video field drafted by my country's Ministry of Public Security in conjunction with a number of domestic units. This standard specifies the basic and security requirements for the interconnection structure, transmission, exchange, and control of public security video surveillance networking systems, as well as technical requirements such as control, transmission processes, and protocol interfaces.

[0005] In addition to providing access to the national standard, most camera manufacturers on the market also provide private protocols based on their own devices. The R&D of the video management platform can connect to the camera through the SDK provided by the device manufacturer to achieve functions similar to the national standard.

[0006] At present, most of the video management platforms and camera devices on the market use the GB / T28181 protocol for docking in order to facilitate the unified access of cameras and seamless up and down cascading between platforms. In the GB / T28181 protocol, some specific alarms are defined, such as: 1 for manual video alarm, 2 for moving target detection alarm, 3 for remnant detection alarm, 4 for object removal detection alarm, 5 for line detection alarm, 6 for intrusion detection alarm, etc. After detecting the corresponding alarm, the camera device will issue an alarm through the enumeration value specified in the protocol. However, when applied in actual use scenarios, it is generally necessary to capture pictures when an alarm occurs, or pull video streams after receiving an alarm for AI or manual analysis. The current protocol does not have provisions for linked pictures and videos. If an alarm is checked after it occurs, due to the delay between the platforms, it cannot meet the real-time requirements of the application.

[0007] If private protocol access is adopted, although private protocols can generally provide snapshot images of alarm events, the video management platform needs to be modified. Different camera manufacturers have different access protocols, which means that the video management platform needs to be connected with them one by one, which is not convenient for seamless business expansion. At the same time, the provision of alarm open capabilities belongs to the needs of the application side. Modifying this part of the function in the underlying video capability platform will lead to strong coupling between application business and underlying capabilities, unclear functional division, and increase the complexity of the underlying video platform, affecting the stability of the platform and making it inconvenient for later maintenance. Summary of the invention

[0008] The purpose of the present invention is to provide a media data linkage method based on event alarm in view of the deficiencies of the prior art, which has high decoupling performance, can reduce overall bandwidth consumption, and reduce the overall delay of the system.

[0009] The technical solution of the present invention is: a media data linkage method based on event alarm, comprising a video cloud platform composed of an alarm capability open platform, a view library and a video platform, a server with video frame extraction capability is deployed in the video cloud platform, an application platform transmits alarm signals and linkage media data based on the GAT1400 standard with the view library, the alarm capability open platform and the video platform, and the video cloud platform realizes video transmission with a camera based on GBT28181, thereby forming a data linkage system, and the data linkage method of the system is as follows:

[0010] 1) The application platform subscribes to alarm events in the view library;

[0011] 2) The alarm capability open platform subscribes to the alarm events of the camera device and obtains the video stream of the camera device;

[0012] 3) The alarm capability open platform analyzes the alarm signal of the alarm event and extracts the snapshot image at the time when the alarm occurs in the video stream;

[0013] 4) The alarm capability open platform pushes the analyzed alarm events and captured images to the view library through the scene event interface;

[0014] 5) The view library pushes alarm events and captured images to application platforms that have subscribed to relevant alarm events;

[0015] 6) The alarm capability open platform decodes and extracts the frame picture of the specified time in the stored video recording, and pushes the frame picture to the corresponding application platform through the view library. The application platform analyzes whether the alarm event is true based on the frame picture. If true, it proceeds to the next step, otherwise, it waits for the next frame picture;

[0016] 7) The alarm capability open platform slices the video stream in the specified time period into short videos and pushes the short videos to the corresponding application platform through the view library.

[0017] Furthermore, the alarm capability open platform transmits signals with the camera through the SDK interface.

[0018] Furthermore, the alarm capability open platform sinks part of the pressure to the edge nodes to share the center's pressure.

[0019] Furthermore, the alarm capability open platform is cascaded with the video platform through GBT28181 for signal transmission.

[0020] Furthermore, the alarm capability open platform adopts an asynchronous return method, and if the asynchronously returned parameter verification is correct, a corresponding serial number is returned.

[0021] The beneficial effects of adopting the above technical solution are as follows: the alarm capability open platform of the method is connected with the alarm event signal of the camera device, and can push frame-extracted pictures to the application platform, and can also provide the application platform with short videos assembled in a specified time period. Therefore, when the upper layer has a business application with an alarm demand, the application platform first analyzes the pushed snapshot pictures. If the alarm event is found to be true, the short video can be pulled for video analysis to confirm the specific circumstances of the alarm event. If the alarm event is a false alarm, it can be ignored, thereby reducing the overall bandwidth consumption and the overall corresponding delay of the system. At the same time, the various business modules of the method are interfaced with each other, and the data is connected through the GAT1400 protocol or interface, which is untied from the specific business scenario and has high decoupling.

[0022] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is a signal diagram of Example 1;

[0024] Figure 2 This is a signal schematic diagram of Example 2;

[0025] Figure 3 This is a signal diagram of Example 3. DETAILED DESCRIPTION

[0026] See also Figures 1 to 3 , a media data linkage method based on event alarm, including a video cloud platform composed of an alarm capability open platform, a view library and a video platform, a cloud server with video frame extraction capability is deployed in the video cloud platform, an application platform performs signal transmission and linkage media data transmission based on the GAT1400 standard with the view library, the alarm capability open platform and the video platform, and the video cloud platform realizes video transmission with a camera based on GBT28181, thereby forming a data linkage system,

[0027] Embodiment 1, as Figure 1 As shown in the figure, the cloud server is connected to the camera through the SDK interface, and can subscribe to various alarm events supported by the camera and obtain the camera's video stream for storage. The video stream is in H.264 encoding format, so it is stored in GOP (minimum playable video segment) units, which is convenient for indexing pictures at a certain moment and splicing videos. This method is suitable for scenarios where the camera and the alarm capability open platform can have two-way access and intercommunication, or the device does not support the national standard.

[0028] Embodiment 2, as Figure 2 As shown in the figure, the centralized access of the cloud center facilitates unified storage and management, but as the access volume increases, the storage and bandwidth of cloud services will increase dramatically, which will gradually swell the entire system and affect the stability of the platform. Therefore, after the cloud center access reaches a certain level, it is possible to consider sinking the capability platform to the edge node, and then still use the SDK access method. The edge node can be a server deployed in a certain range of areas, or an edge computing box deployed in a specific small area.

[0029] Embodiment 3, as Figure 3 As shown in the figure, a cloud server with video frame extraction capability is deployed in the computer room of the video cloud center. Because the camera has been connected to the video platform through the national standard GBT28181, it is possible to connect to various alarm events supported by the camera through the national standard cascade method, so that the video platform can be connected to the alarm capability open platform based on GBT28181. After the cascade is established, the camera video stream is obtained for storage at the same time, and the duration depends on the size of the hard disk.

[0030] This approach is more universal and loosely decoupled, because all direct communications between different business components are done through standard protocols or open interfaces. The video platform does not require any modification, is decoupled from specific business scenarios, and can be seamlessly copied to other business scenarios.

[0031] The specific linkage steps are as follows:

[0032] 1) The application platform subscribes to alarm events in the view library;

[0033] 2) The alarm capability open platform subscribes to the alarm events of the camera device through the SDK interface or GBT28181 cascade, and obtains the video stream of the camera device;

[0034] 3) The alarm capability open platform parses the alarm signal corresponding to the alarm event according to the alarm field, and extracts the snapshot image at the time when the alarm occurs in the video stream;

[0035] 4) The alarm capability open platform pushes the analyzed alarm events and captured images to the view library through the scene event interface;

[0036] 5) The view library pushes alarm events and captured images to application platforms that have subscribed to relevant alarm events;

[0037] 6) The application platform requests the alarm capability open platform to push the relevant frame images at a certain moment based on the received alarm events and captured images;

[0038] 7) The alarm capability open platform pushes the extracted frame images to the view library through the scene event interface based on the GAT1400 standard;

[0039] 8) The alarm event and the frame-drawing picture are then pushed to the application platform that has subscribed to the relevant alarm event through the view library. The application platform performs AI analysis on the frame-drawing picture to determine whether the alarm event is true. If true, it proceeds to the next step. Otherwise, it ignores this alarm and continues to wait for the next frame-drawing picture.

[0040] 9) The application platform requests the alarm capability open platform to push a short video of a certain time period of the alarm event, which is within the storage period of the server;

[0041] 10) After the alarm capability open platform receives the request from the application platform, it uses an asynchronous return method because video synthesis takes time. If the parameter verification is correct, it returns a serial number, which is used as a unique representation;

[0042] 11) The alarm capability open platform slices and synthesizes the video stream of the time period in the background to generate a short video, and pushes the short video and serial number to the view library through the scene event interface;

[0043] 12) The view library then pushes the short video and serial number to the application platform, allowing the application platform to perform correlation analysis on the short video based on the serial number.

[0044] In Example 1, the camera needs to transmit two streams, one to the central video cloud platform for storage, and one to the central SDK server for storage, so the bandwidth from the camera side to the video cloud platform will be doubled. However, because it can be directly connected to the manufacturer's private SDK, the connection time is short, and the video management platform does not need any changes to perform highly centralized management of the business;

[0045] In Example 2, the camera also needs to transmit two streams, one to the central video cloud platform for storage, and the other to the edge SDK server for storage. Compared with Method 1, the business can be decentralized and the cross-domain bandwidth can be reduced.

[0046] In Example 3, the camera only transmits one stream directly to the central video cloud platform for storage. The alarm capability exposure platform only needs to be cascaded with the video platform in the intranet through the national standard, without the need to pull the stream from the device end a second time, reducing the Internet connection bandwidth from the external network to the intranet, and is also the most standardized method.

[0047] The media data linkage and capability exposure method based on visual alarm designed by this method provides three different deployment methods, covering national standard access cascade, SDK access and cloud-edge deployment methods. The deployment method can be flexibly selected according to the needs of actual application scenarios to adapt to a variety of different business scenarios, and provide the application system with more efficient and convenient event alarm capabilities. This method covers the cloud and edge in all aspects according to business needs, and can fully utilize the camera alarm capabilities, as well as the linkage alarm to capture pictures and short videos and provide open capabilities to the outside world.

Claims

1. A media data linkage method based on event alarm, characterized in that: The system includes a video cloud platform composed of an alarm capability open platform, a view library and a video platform. A server with video frame extraction capability is deployed in the video cloud platform. An application platform transmits signals with the view library, the alarm capability open platform and the video platform based on the GAT1400 standard. The video cloud platform transmits signals with the camera based on GBT28181, thereby forming a data linkage system. The data linkage method of the system is as follows: 1) The application platform subscribes to alarm events in the view library; 2) The alarm capability open platform subscribes to the alarm events of the camera and obtains the video stream of the camera; 3) The alarm capability open platform analyzes the alarm signal of the alarm event and extracts the snapshot image at the time when the alarm occurs in the video stream; 4) The alarm capability open platform pushes the analyzed alarm events and captured images to the view library through the scene event interface; 5) The view library pushes alarm events and captured images to application platforms that have subscribed to relevant alarm events; 6) The alarm capability open platform decodes and extracts the frame picture of the specified time in the stored video recording, and pushes the frame picture to the corresponding application platform through the view library. The application platform analyzes whether the alarm event is true based on the frame picture. If true, it proceeds to the next step, otherwise, it waits for the next frame picture; 7) The alarm capability open platform slices the video stream in the specified time period into short videos and pushes the short videos to the corresponding application platform through the view library.

2. The method for media data linkage based on event alarm according to claim 1, characterized in that: The alarm capability open platform transmits signals to the camera through the SDK interface.

3. The media data linkage method based on event alarm according to claim 1, characterized in that: In order to share the pressure on the center, the alarm capability open platform sinks part of the capabilities to the edge computing nodes. The edge nodes are servers deployed in a certain area, or edge computing boxes deployed in a specific small area.

4. The method for media data linkage based on event alarm according to claim 1, characterized in that: The video platform transmits signals with the camera and the alarm capability open platform through GBT28181.

5. The method for media data linkage based on event alarm according to claim 1, characterized in that: The alarm capability open platform adopts an asynchronous return method. If the asynchronous return parameter verification is correct, a corresponding serial number will be returned.

Images