A multi-video monitoring display method based on AR cascade

Abstract

The present invention relates to the field of video surveillance technology, and specifically discloses a multi-video surveillance display method based on AR cascade, which includes: obtaining multiple surveillance scene pictures, wherein each surveillance scene picture is provided with a scene tag, and the scene tag can record the scene information of the current surveillance scene picture and the platform shared resource information cascaded therewith; when the scene tag on the surveillance scene picture is triggered, it can switch to the scene surveillance picture cascaded therewith, wherein, if the current surveillance scene picture is a lower-level platform surveillance scene picture, the scene surveillance picture cascaded therewith includes the upper-level platform surveillance scene picture, and if the current scene surveillance picture is an upper-level platform surveillance scene picture, the scene surveillance picture cascaded therewith includes the lower-level platform surveillance scene picture. The multi-video surveillance display method based on AR cascade provided by the present invention can intuitively and efficiently realize the display of multiple video surveillance pictures.

Description

Technical Field

[0001] The present invention relates to the field of video surveillance technology, and in particular to a multi-video surveillance display method based on AR cascade. Background Art

[0002] In the prior art, multiple cameras are usually installed in a certain area, and the real-time images of each point are transmitted for monitoring, where each camera corresponds to a monitoring scene. The monitoring business is usually managed in the form of a camera list. Each camera in the list corresponds to a monitoring scene. By selecting different camera tags in the list, the corresponding monitoring scene image can be retrieved. This monitoring business management method has the following disadvantages: First, there is a lack of intuitive location positioning for the entire monitoring area; second, when there is no abnormal situation, multiple monitoring scenes are displayed on one screen at the same time, and each scene image is small, which is not conducive to the staff to observe the scene; third, the monitoring personnel need to manually switch the scene, which is inefficient and inconvenient when there are many monitoring scenes; fourth, this monitoring method usually requires more display equipment, which is too expensive. Summary of the invention

[0003] The present invention provides a multi-video surveillance display method based on AR cascade, which solves the problem in the related art that efficient and intuitive multi-video surveillance display cannot be achieved.

[0004] As one aspect of the present invention, a multi-video monitoring display method based on AR cascade is provided, which includes:

[0005] Acquire multiple monitoring scene pictures, wherein each monitoring scene picture is provided with a scene tag, and the scene tag can record the scene information of the current monitoring scene picture and the platform shared resource information cascaded therewith;

[0006] When the scene tag on the monitoring scene screen is triggered, it can switch to the scene monitoring screen cascaded with it.

[0007] Among them, if the current monitoring scene screen is the monitoring scene screen of the lower-level platform, the scene monitoring screen cascaded with it includes the monitoring scene screen of the upper-level platform; if the current scene monitoring screen is the monitoring scene screen of the upper-level platform, the scene monitoring screen cascaded with it includes the monitoring scene screen of the lower-level platform.

[0008] Furthermore, the platform shared resource information includes: device basic information resources, intelligent application data resources and business label resources.

[0009] Furthermore, the basic information resources of the equipment include: high-point panoramic video points, ordinary video points, international codes of face devices, international codes of snap-on devices and point organizations.

[0010] Furthermore, the intelligent application data resources include: face pictures, body pictures, vehicle snapshot pictures, structured data and alarm information.

[0011] Furthermore, the business tag resources include: linkage tags, place attribute tags and environmental resource tags.

[0012] Furthermore, it also includes:

[0013] Establish communication connection with 3D-GIS;

[0014] Trigger the high-point monitoring icon on the three-dimensional map in 3D-GIS to switch to the panoramic screen.

[0015] Furthermore, it also includes:

[0016] Trigger an AR high point monitoring point in the high point monitoring list on the side of the monitoring scene screen to switch from the current AR high point monitoring point to another AR high point monitoring point.

[0017] Furthermore, it also includes:

[0018] Establish communication connections with multiple surrounding application systems to achieve cross-regional resource sharing.

[0019] Furthermore, the communication connection with multiple peripheral application systems includes:

[0020] A session channel, a media stream channel and a data channel are established between each surrounding application system, wherein the session channel and the media stream channel comply with the GB / T 28181-2016 technical specification, and the data channel complies with the GA / T 1400.4-2017 technical specification.

[0021] The multi-video monitoring display method based on AR cascade provided by the present invention provides a scene tag on each monitoring scene screen, triggers the scene tag on the monitoring scene screen to switch to the scene monitoring screen cascaded therewith, and this multi-video monitoring display method based on AR cascade can intuitively and efficiently realize the display of the monitoring scene screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present invention but do not constitute a limitation of the present invention. In the accompanying drawings:

[0023] Figure 1 A flowchart of a multi-video monitoring display method based on AR cascade provided by the present invention.

[0024] Figure 2This is the AR cascade flow chart provided by the present invention. DETAILED DESCRIPTION

[0025] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is only a part of the embodiment of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so as to describe the embodiments of the present invention described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] In this embodiment, a multi-video monitoring display method based on AR cascade is provided. Figure 1 is a flow chart of a multi-video monitoring display method based on AR cascade according to an embodiment of the present invention, such as Figure 1 As shown, including:

[0029] S110, obtaining a plurality of monitoring scene pictures, wherein each monitoring scene picture is provided with a scene tag, and the scene tag can record scene information of the current monitoring scene picture and platform shared resource information cascaded therewith;

[0030] When the scene tag on the monitoring scene screen is triggered, it can switch to the scene monitoring screen cascaded with it.

[0031] Among them, if the current monitoring scene screen is the monitoring scene screen of the lower-level platform, the scene monitoring screen cascaded with it includes the monitoring scene screen of the upper-level platform; if the current scene monitoring screen is the monitoring scene screen of the upper-level platform, the scene monitoring screen cascaded with it includes the monitoring scene screen of the lower-level platform.

[0032] It should be noted that augmented reality (AR) technology is an emerging technology that superimposes computer-generated virtual information on the user's real world. It is an important branch of virtual reality technology and a new human-computer interaction technology. Through AR technology, participants can interact with virtual objects in real time to gain a wonderful visual experience, and can break through space, time and other objective limitations to experience something that cannot be experienced in the real world. It improves the user's perception of the real world, gives video surveillance a new form, and allows users to obtain target information more realistically and comprehensively.

[0033] In an embodiment of the present invention, label information is added to a scene screen to provide adjacent AR monitoring point information in different monitoring ranges, and the button function on the label in the current AR scene can be used to switch to another AR high point scene with one click.

[0034] The multi-video monitoring display method based on AR cascade provided in an embodiment of the present invention provides a scene tag on each monitoring scene screen, triggers the scene tag on the monitoring scene screen to switch to the scene monitoring screen cascaded therewith, and this multi-video monitoring display method based on AR cascade can intuitively and efficiently realize the display of the monitoring scene screen.

[0035] Specifically, the platform shared resource information includes: device basic information resources, intelligent application data resources and business label resources.

[0036] More specifically, the basic information resources of the equipment include: high-point panoramic video points, ordinary video points, international codes of face devices, international codes and point organizations of snap-on devices. The intelligent application data resources include: face pictures, body pictures, vehicle snapshot pictures, structured data and alarm information. The business tag resources include: linkage tags, place attribute tags and environmental resource tags.

[0037] It should be noted that the "Technical Requirements for Information Transmission, Exchange and Control of Public Security Video Surveillance Network System" (GB / T28181-2016) currently followed by the industry can already standardize the cascading issues related to video streams, basic equipment information and organizational administrative agency codes. The "Interface Protocol Requirements for Part 4 of Public Security Video Image Information Application System" (GA / T 1400.4-2017) also puts forward cascading requirements for images and structured data related to smart applications. However, the industry still lacks a unified cascading standard for various added and customized AR tags. Through a full understanding of various standards, insight into industry development trends, and combined with practical experience in actual projects, this solution supplements and expands the cascading standard specifications of AR tag fields by extending the GA / T1400-2017 protocol, striving to lead and promote the development of the industry on the basis of following the national standard.

[0038] As another specific embodiment of the present invention, it also includes:

[0039] Establish communication connection with 3D-GIS;

[0040] Trigger the high-point monitoring icon on the three-dimensional map in 3D-GIS to switch to the panoramic screen.

[0041] In the implementation method, by connecting to 3D-GIS, you can click on the high point monitoring icon on the three-dimensional map to switch the panoramic picture. This method is closest to the existing hanging map combat method, and the switching space span is the largest.

[0042] As another specific embodiment of the present invention, it also includes:

[0043] Trigger an AR high point monitoring point in the high point monitoring list on the side of the monitoring scene screen to switch from the current AR high point monitoring point to another AR high point monitoring point.

[0044] It should be understood that by establishing a side AR high point monitoring list bar, click to switch, switch from one AR high point monitoring point to another AR high point monitoring point. This implementation method is most convenient for instant switching across a large space.

[0045] In the embodiment of the present invention, three scene screen switching modes can be realized through AR cascading. It is a comprehensive map display method with integrated high, medium, low and ground video image linkage, which breaks through the limitations of traditional video presentation and map display separation. In the form of three-dimensional real-scene intuitive map, it provides a set of high-efficiency application system with full real-scene visualization for actual combat command decision-making and disposal, realizing the goals of real-time picture mapping, information data labeling, and image information simulation, and effectively improving the efficiency of actual combat command decision-making and disposal.

[0046] Additionally, it includes:

[0047] Establish communication connections with multiple surrounding application systems to achieve cross-regional resource sharing.

[0048] More specifically, a session channel, a media stream channel and a data channel are established with each surrounding application system, wherein the session channel and the media stream channel comply with the GB / T 28181-2016 technical specification, and the data channel complies with the GA / T 1400.4-2017 technical specification.

[0049] It is understandable that the AR high-point networking application system realizes the sharing of cross-regional system resources, as well as information transmission, exchange, and control through the IP transmission network and surrounding application systems, forming interconnection between networked systems. The networked system should establish three transmission channels when performing audio and video transmission and control: session channel, media stream channel, and data channel. The session channel and media stream channel comply with the GB / T 28181-2016 technical specification and meet the exchange and control requirements; the data channel complies with the GA / T1400.4-2017 technical specification, and users transmit pictures and structured data. In addition, AR tag information is uploaded through the subscription notification method in the GA / T 1400.3-2017 protocol, which is implemented by extending the attribute content field in the subscription and notification objects. The cascading process is shown in the figure:

[0050] The video streams, signaling data, and point resource data generated in the AR high-point networking application system are managed by the resource management service in a unified manner. Through the video networking gateway, in accordance with GB / T28181-2016, data cascade sharing is achieved with the upper-level video networking gateway, and shared data resources are provided to the upper-level AR service component through the upper-level platform resource management service. The data, pictures (people and vehicle snapshots, alarms) related to smart applications, and various business tags of AR high-point applications are shared in a cascade with the upper-level view library gateway component through the view library gateway component, in accordance with GA / T 1400-2017 and its above-mentioned extended protocols, and pictures and data resources related to smart applications and AR tags are provided to the upper-level AR service component through the upper-level platform resource management service.

[0051] In summary, the multi-video monitoring display method based on AR cascade provided in the embodiment of the present invention can realize the functions of cascade sharing of high-point video points, cascade sharing of tags, and cascade sharing of control capabilities related to tags.

[0052] Among them, the cascade sharing of high-point video points specifically includes: the high-point panoramic video points registered and added by the subordinate platform can be cascaded to the superior platform, so that the superior platform can click on the resources to view real-time video and video playback; the cascade sharing of AR tag information specifically includes: the AR tag information added in the business operation of the subordinate platform can be shared by cascading to the superior platform, and the superior platform can also add AR tags to the high-point resources of the subordinate cascade to realize business tag association. The editing operations such as adding, deleting, and modifying tags on the superior and subordinate platforms can be cascaded to complete information synchronization; the cascade sharing of PTZ (abbreviation of Pan / Tilt / Zoom, indicating all-round movement and lens zoom and zoom control) and control capabilities specifically includes: the superior platform can obtain the PTZ information of the subordinate platform points in real time, and after the subordinate platform PTZ rotates, it will actively upload the PTZ information to the superior platform; set a target tag for a point for the subordinate platform, and the PTZ can rotate to the position when the tag is added. At the same time, the PTZ device can also track the movement of the target tag in real time as needed.

[0053] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present invention, but the present invention is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and essence of the present invention, and these modifications and improvements are also considered to be within the scope of protection of the present invention.

Claims

1. A multi-video monitoring display method based on AR cascade, characterized in that: include: Acquire multiple monitoring scene pictures, wherein each monitoring scene picture is provided with a scene tag, and the scene tag can record the scene information of the current monitoring scene picture and the platform shared resource information cascaded therewith; When the scene tag on the monitoring scene screen is triggered, it can switch to the scene monitoring screen cascaded with it. Among them, if the current monitoring scene screen is a monitoring scene screen of the lower-level platform, the scene monitoring screen cascaded therewith includes the monitoring scene screen of the upper-level platform; if the current scene monitoring screen is a monitoring scene screen of the upper-level platform, the scene monitoring screen cascaded therewith includes the monitoring scene screen of the lower-level platform; The platform shared resource information includes: equipment basic information resources, intelligent application data resources and business label resources; The basic information resources of the equipment include: high-point panoramic video points, ordinary video points, international codes of face devices, international codes of snap-on devices and point organizations; Among them, it also includes: Establish communication connection with 3D-GIS; Trigger the high-point monitoring icon on the 3D map in 3D-GIS to switch to the panoramic view; Among them, it also includes: Trigger an AR high point monitoring point in the high point monitoring list on the side of the monitoring scene screen to switch from the current AR high point monitoring point to another AR high point monitoring point; Among them, the multi-video monitoring display method based on AR cascade can realize: cascade sharing function of high-point video points, cascade sharing function of tags, and cascade sharing function of control capabilities related to tags; The cascade sharing function of the high-point video points specifically includes: the high-point panoramic video points registered and added by the lower-level platform can be cascaded to the upper-level platform, so that the upper-level platform can click on the resource to view the real-time video and video playback; The cascading sharing function of the tags specifically includes: the AR tag information added in the business operation of the lower-level platform can be cascaded to the upper-level platform for sharing, and the upper-level platform can also add AR tags to the high-point resources of the lower-level cascade to realize business tag association; the upper and lower platforms can cascade to complete information synchronization for adding, deleting, and modifying tags; Among them, the cascade sharing function of control capabilities related to tags specifically includes: the upper-level platform can obtain the PTZ information of the lower-level platform points in real time. After the lower-level platform pan / tilt rotates, it will actively upload the PTZ information to the upper-level platform; a target tag of a point is set for the lower-level platform, and the pan / tilt can rotate to the position when the tag is added. At the same time, the pan / tilt device can also track the movement of the target tag in real time as needed.

2. The multi-video monitoring display method based on AR cascade according to claim 1 is characterized in that: The intelligent application data resources include: face pictures, body pictures, vehicle snapshot pictures, structured data and alarm information.

3. The multi-video monitoring display method based on AR cascade according to claim 1 is characterized in that: The business tag resources include: linkage tags, place attribute tags and environmental resource tags.

4. The multi-video monitoring display method based on AR cascade according to any one of claims 1 to 3, characterized in that: Also includes: Establish communication connections with multiple surrounding application systems to achieve cross-regional resource sharing.

5. The multi-video monitoring display method based on AR cascade according to claim 4 is characterized in that: The communication connection with multiple peripheral application systems includes: A session channel, a media stream channel and a data channel are established between each surrounding application system, wherein the session channel and the media stream channel comply with the GB / T 28181-2016 technical specification, and the data channel complies with the GA / T 1400.4-2017 technical specification.

Images