A cross-network video fusion monitoring system

Abstract

The application provides a cross-network video fusion monitoring system, which comprises a main network and multiple auxiliary networks; the main network and the multiple auxiliary networks each comprise a corresponding video monitoring system and a video monitoring terminal; the main network and the multiple auxiliary networks are not directly connected; the monitoring video signals in the auxiliary networks are decoded and then input into the main network through video signal lines; the main network comprises a video fusion module and a dispatching control module; the video fusion module displays the fused monitoring pictures after inputting the decoded video signals from each network; and the dispatching control module controls the switching of the video signals input into the video fusion module. The system uses the internal monitoring systems and monitoring terminals of each network, and uses the video fusion matrix and the dispatching control module to meet the cross-network interconnection requirements, realize the unified dispatching and comprehensive integration of different network videos, and save the modification cost of each network to the maximum extent.

Description

TECHNICAL FIELD

[0001] The present application relates to a monitoring system, in particular to a cross-network video fusion monitoring system. BACKGROUND

[0002] With the rapid development of computer technology and video processing technology, video monitoring technology plays an increasingly important role in the field of social security. How to use video monitoring technology to reduce the loss caused by natural disasters and human injuries and effectively protect the safety of human production and life has become a research hotspot.

[0003] Based on the consideration of different network levels, sometimes the direct interconnection between different local area networks is required, and the requirement of physical isolation or one-way conduction is usually met, which brings certain difficulties to the unified scheduling and display of cross-network distributed video monitoring. At the same time, there are great differences in the monitoring architecture, transmission mode and codec method used by different network monitoring. If video scheduling and video integrated monitoring are realized on the lower layer network, adaptive modification of each network is required, resulting in high modification cost.

[0004] Based on the consideration of the interconnection constraint and modification cost between different networks, a system capable of meeting the unified fusion of cross-network video monitoring needs to be designed. The system can meet the network interconnection requirement and realize the unified scheduling and integrated display of different network monitoring pictures. SUMMARY

[0005] The technical problem to be solved by the present application is to provide a cross-network video fusion monitoring system to solve the problems of the prior art.

[0006] In order to solve the above technical problems, the present application discloses a cross-network video fusion monitoring system, comprising: a main network and an auxiliary network; the main network and the auxiliary network internally comprise respective corresponding video monitoring systems and video monitoring terminals; the main network and the auxiliary network do not directly interconnect, and the monitoring video signals in the auxiliary network are decoded and then connected to the main network through a video signal line;

[0007] The main network comprises: a main network video monitoring system, a main network video monitoring terminal, a video analysis module, a video fusion module and a scheduling control module; wherein the main network video monitoring system and the main network video monitoring terminal generate main network video signals; the video fusion module accesses auxiliary network video signals and main network video signals and performs monitoring picture fusion display; the scheduling control module controls the switching of the video signals accessed by the video fusion module; the video analysis module obtains original video information through the video matrix in the video fusion module and performs identification analysis, and outputs the identification analysis result to the video matrix as one of the video sources of the video matrix;

[0008] The auxiliary network includes: a first auxiliary network and a second auxiliary network; wherein, the first auxiliary network includes: a first auxiliary network video surveillance system and a second monitoring terminal; the first auxiliary network video surveillance system includes: a second streaming media server and a second video acquisition terminal, the second video acquisition terminal acquires monitoring video signals and transmits them to the second streaming media server, and the second monitoring terminal obtains monitoring video signals from the second streaming media server and transmits them to the video fusion module in the main network through a video transmission cable; the second auxiliary network includes: a multi-channel decoder and a third video acquisition terminal, the input of the multi-channel decoder is connected to the third video acquisition terminal, and the output of the multi-channel decoder is connected to the video fusion module in the main network through a video transmission cable.

[0009] Beneficial effects:

[0010] This invention integrates video feeds from monitoring systems within different networks without altering the existing network monitoring architecture. It meets cross-network interconnection requirements through a video fusion matrix and scheduling control module. Connections between networks are made via video cables, and cross-network communication is unidirectional, complying with network hierarchy management requirements. Videos from different networks are uniformly scheduled and integrated through the video fusion matrix and scheduling module, enabling unified playback on user terminals. Minimal modifications to existing networks minimize costs for upgrading each network. The system integrates geographic information services with video surveillance, achieving convenient and intuitive video scheduling. Attached Figure Description

[0011] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments, and the advantages of the present invention in the above and / or other aspects will become clearer.

[0012] Figure 1 This is a schematic diagram of the system structure of the present invention.

[0013] Figure 2 This is a schematic diagram of the monitoring screen of the integrated display scenario 1 of the present invention.

[0014] Figure 3 This is a schematic diagram of the monitoring screen in the integrated display scenario 2 of the present invention. Detailed Implementation

[0015] A cross-network video fusion monitoring system, such as Figure 1 As shown, it includes: a main network and a secondary network; the main network and the secondary network each contain their respective video surveillance systems and video surveillance terminals; the main network and the secondary network do not have direct network communication, and the video surveillance signals in the secondary network are decoded and then connected to the main network through video signal lines;

[0016] The main network comprises a main network video monitoring system, a main network video monitoring terminal, a video analysis module, a video fusion module and a dispatching control module; wherein the main network video monitoring system and the main network video monitoring terminal generate main network video signals; the video fusion module accesses auxiliary network video signals and the main network video signals, and performs monitoring picture fusion display; the dispatching control module performs switching control on the video signals accessed by the video fusion module; the video analysis module obtains original video information through a video matrix in the video fusion module and performs identification analysis, and outputs the identification analysis result to the video matrix as one of video sources of the video matrix;

[0017] The auxiliary network comprises a first auxiliary network and a second auxiliary network; wherein the first auxiliary network comprises a first auxiliary network video monitoring system and a second monitoring terminal; the first auxiliary network video monitoring system comprises a second stream media server and a second video acquisition terminal, the second video acquisition terminal acquires monitoring video signals and transmits them to the second stream media server, and the second monitoring terminal obtains the monitoring video signals from the second stream media server and transmits them to the video fusion module in the main network through a video transmission cable; the second auxiliary network comprises a multi-channel decoder and a third video acquisition terminal, the input of the multi-channel decoder is connected with the third video acquisition terminal, and the output of the multi-channel decoder is connected with the video fusion module in the main network through a video transmission cable.

[0018] The number of the second video acquisition terminals is more than one; the number of the third video acquisition terminals is more than one; and the number of the video transmission cables is more than one, which is set according to the number of the second video acquisition terminals and the third video acquisition terminals.

[0019] The video fusion module comprises a video matrix and a monitoring large screen.

[0020] The video matrix comprises a control port, an input port and an output port; the input port is connected with the main network video monitoring system and the first auxiliary network video monitoring system through a video transmission cable; the video matrix constructs a display scene, the display scene contains pictures of monitoring video signals input by each network video monitoring system; the control port is connected with the dispatching control module in the main network, so as to realize switching display of different scenes;

[0021] The monitoring large screen is connected with the output port of the video matrix through a video transmission cable, and displays different scene pictures output by the video matrix.

[0022] The main network video monitoring system realizes monitoring video point access in a hierarchical cascading manner by using a stream media server, and comprises a total node stream media server, a branch node stream media server and a first video acquisition terminal.

[0023] The main network video monitoring terminal is connected with a total node streaming media server of the main network video monitoring system, acquires video coding data of the first video acquisition terminal, decodes and displays the video coding data, and is connected with an input end of a video matrix through a video transmission cable.

[0024] The number of the first video acquisition terminals is more than one, and the number of the branch node streaming media servers is more than one, which are configured according to the first video acquisition terminals.

[0025] The video analysis module comprises a video analysis server and a video analysis client.

[0026] The video analysis server is connected with an output end of the video matrix through a video transmission cable, acquires to-be-analyzed video data, is connected with the video analysis client through a network cable, and sends a video analysis result; the video analysis client comprises an analysis display output end and an analysis control end, the analysis display output end is connected with an input end of the video matrix through a video transmission cable, and the analysis control end is connected with the dispatching control module through a network cable.

[0027] The dispatching control module comprises a dispatching server, a geographic information server, a one-way network lock and a geographic information dispatching terminal.

[0028] The dispatching server is connected with the main network monitoring terminal through a network cable, sends a video stream taking instruction to realize that the main network monitoring terminal acquires a specified video stream in the main network video monitoring system, is connected with the second streaming media server in the first auxiliary network through the one-way network lock, sends a video source switching instruction to the second streaming media server, realizes that the second monitoring terminal decodes and displays a specified video source, and is connected with the video matrix through a serial network, realizes that the output end of the video matrix switches different inputs and scenes.

[0029] The dispatching server comprises basic information and geographic information of all video acquisition terminals in the main network and the auxiliary network.

[0030] The geographic information dispatching terminal is connected with the dispatching server through a network cable, acquires geographic information and geographic information of all video acquisition terminals from the dispatching server and displays the geographic information, and a video output port of the geographic information dispatching terminal is connected with an input end of the video matrix through a video transmission cable.

[0031] Embodiment:

[0032] As Figure 1As shown, the cross-network video fusion monitoring system of the present application comprises a main network and a plurality of auxiliary networks. Due to different network levels, the networks cannot be directly connected, but can be unidirectionally connected and unidirectionally transmit simple scheduling commands. Meanwhile, the devices between the networks can be connected through video cables.

[0033] The main network and the plurality of auxiliary networks each comprise a corresponding video monitoring system and a video monitoring terminal. The main network and the plurality of auxiliary networks are not directly connected. The monitoring video signals in the auxiliary networks are decoded and then connected to the main network through video signal lines. The main network comprises a video fusion module and a scheduling control module. The video fusion module displays the fused monitoring pictures after the video signals decoded from the networks are connected. The scheduling control module controls the switching of the video signals connected to the video fusion module.

[0034] The auxiliary networks comprise auxiliary network I and auxiliary network II. The auxiliary network I video monitoring system comprises a streaming media server II, a monitoring terminal II and a video acquisition terminal II. The monitoring terminal II obtains multi-point monitoring data from the streaming media server II, and the video is transmitted using the GB / T28181 protocol or the RTSP protocol. The monitoring terminal II can switch all the connected monitoring videos in the streaming media server II, and can also receive external control messages to realize remote video switching. The monitoring terminal II is connected to the video fusion module through an HDMI video transmission cable.

[0035] The auxiliary network II comprises a multi-channel decoder and a video acquisition terminal III. The input of the multi-channel decoder is connected to the multi-channel video acquisition terminal III through a network, and the encoded video data is transmitted through a network protocol. The multi-channel decoder decodes the input video signals, and the multi-channel output end is connected to the video fusion module through a plurality of HDMI video transmission cables (8-20 video outputs) to output the decoded video. The video output by each HDMI is fixedly corresponding to the video input end.

[0036] The video fusion module comprises a video matrix and a monitoring large screen. The video matrix comprises a control port, a plurality of HDMI input ports and a plurality of HDMI output ports. The plurality of HDMI input ports are connected to the main network monitoring terminal and the auxiliary network monitoring terminal through HDMI video transmission cables, so as to realize the fusion switching of different input monitoring. Different display scenes are constructed in the video matrix, the video pictures of the input ends are contained in the display scenes, and the scenes are combined according to the monitoring display needs. The monitoring large screen is connected to the output port of the video matrix through an HDMI video transmission cable, and the different scene pictures output by the video matrix are displayed on the monitoring large screen. The control port of the video matrix is connected to the scheduling control module in the main network, so as to realize the switching display of different scenes and video sources in the scheduling control module.

[0037] The main network comprises a main network monitoring system and a main network monitoring terminal. The main network monitoring system adopts a multi-layer streaming media server cascade mode to realize multi-monitoring video point access, comprising a total node streaming media server, a multi-stage branch node streaming media server and a video acquisition terminal I. The video acquisition terminal I is a plurality of different types of network cameras. The streaming media servers and the video acquisition terminal I are connected through the GB / T28181 protocol or the RTSP protocol for monitoring video transmission. The main network monitoring terminal is installed with a video monitoring software, connected with the total node streaming media server of the main network monitoring system, and obtains the video coding data of any video acquisition terminal I through the GB / T28181 protocol or the RTSP protocol. The video monitoring software simultaneously receives external scheduling instructions to realize remote video scheduling switching. The video monitoring software displays the video coding data after decoding. The main network monitoring terminal is connected with the video matrix input end through an HDMI video transmission cable.

[0038] The scheduling control module in the main network comprises a scheduling server, a geographic information server, a one-way gate and a geographic information scheduling terminal. The scheduling server adopts a BS architecture to provide scheduling services, which is connected with the main network monitoring terminal through a network cable, and can send a video switching instruction to realize that the main network monitoring terminal obtains any specified video stream of the main network monitoring system. The scheduling server is connected with the streaming media server II in the auxiliary network I through a one-way gate, and sends a video source switching instruction to the streaming media server II to realize that the monitoring terminal II decodes and displays the video of the specified video source. The scheduling server is connected with the video matrix through a serial port to realize the switching of the video matrix output end to different inputs and scenes. The geographic information server is connected with the scheduling server through a network to provide basic geographic information services for the scheduling server.

[0039] The scheduling server contains the basic information and geographic information of all video acquisition terminals in the main network and the auxiliary network, and the data is stored in the database in the scheduling server. The geographic information scheduling terminal is a client of the scheduling server, connected with the scheduling server through a network cable, and obtains the GIS geographic information and the geographic information of all video acquisition terminals from the scheduling server in the form of a browser client, and displays them in the form of a GIS map and a monitoring point. The user performs a video scheduling operation through the geographic information scheduling terminal, and the geographic information scheduling terminal sends a scheduling operation instruction to the scheduling server. The scheduling instruction information comprises the network of the monitoring point, the monitoring point ID, the monitoring point national standard code and the like. The scheduling server finally completes the video switching scheduling of the main network, the auxiliary network and the video matrix. The video output port of the geographic information scheduling terminal is connected with the video matrix output end through an HDMI video cable.

[0040] The main network further comprises a video analysis module, which comprises a video analysis server and a video analysis client. The video analysis server is connected with the video matrix output end through an HDMI video cable to obtain video data to be analyzed. The video analysis server is connected with the video analysis client through a network cable to send video analysis results. The video analysis client further comprises an analysis display output end and an analysis control end. The analysis display output end is connected with the video matrix input end through an HDMI video cable. The analysis control end is connected with the dispatch server through a network cable to receive remote analysis control instructions sent by the dispatch server. The dispatch server can simultaneously control the matrix output to switch video signals input to the video analysis server.

[0041] As shown in Figure 2 , Figure 3 indicated, in actual use, various monitoring scenes can be constructed in the video matrix. As shown in Figure 2 indicated, in the monitoring scene 1, the monitoring picture is divided into multiple areas for simultaneous display. The A area is fixed as the display input of the geographic information dispatch terminal; the B area is fixed as the display input of the monitoring terminal in the main network; the C area is fixed as the display input of the monitoring terminal II in the auxiliary network I; the D area is fixed as the display picture of any one of the multiple decoders in the auxiliary network II, and the specific display path is controlled by the matrix; the E area is fixed as the display picture of the video analysis client; and the F area is fixed as the output picture of the video analysis client. The user selects any point for monitoring picture viewing on the geographic information dispatch terminal. If the monitoring point belongs to the main network, the dispatch server sends a control instruction to the monitoring terminal in the main network, the monitoring terminal in the main network performs corresponding point video retrieval, and finally the corresponding monitoring picture is displayed on the B area. If the monitoring point belongs to the auxiliary network I, the dispatch server sends a control instruction to the auxiliary network media server II, the media server II obtains the corresponding monitoring video and pushes it to the monitoring terminal II, and finally the corresponding monitoring picture is displayed on the C area. If the monitoring point belongs to the auxiliary network II, the dispatch server directly sends a control instruction to the video matrix to control the display picture of the corresponding one of the multiple decoders. If the user selects a monitoring point picture for video analysis, the dispatch server first controls the monitoring terminal and then controls the video matrix to input the corresponding monitoring terminal into the video analysis server. In this way, the unified dispatch and fusion of the video monitoring pictures in different networks are finally completed.

[0042] As shown in Figure 3As shown, in the monitoring scenario 2, the monitoring display is in the form of picture-in-picture. The bottom picture M is fixed as the corresponding geographic information dispatch terminal display input, and the geographic information operation terminal is always displayed, and the display content includes a map picture and point information of each monitored point. When a specific monitoring picture is manually viewed, the dispatch server controls the matrix switching to output picture N. The display content of picture N is the picture corresponding to the specific monitoring point selected by the user, and the dispatch mode is similar to the control mode of scenario 1. First, the matrix switching is controlled to make picture N correspond to the output of the corresponding monitoring terminal or multi-channel decoder. If it is a monitoring terminal, the dispatch server further controls the monitoring terminal to display the corresponding monitoring point picture through network messages.

[0043] The switching between scenario 1 and scenario 2 is realized by the dispatch server controlling the video matrix, and the scenario picture is displayed on the monitoring large screen.

[0044] In the specific implementation, the present application provides a computer storage medium and a corresponding data processing unit, wherein the computer storage medium can store a computer program, and the computer program can run the invention content of the cross-network video fusion monitoring system and part or all of the steps in each embodiment when executed by the data processing unit. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.

[0045] Those skilled in the art can clearly understand that the technical solutions in the embodiments of the present application can be realized by means of a computer program and its corresponding general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a computer program, i.e., a software product, which can be stored in a storage medium, including a plurality of instructions for causing a device (which can be a personal computer, a server, a single-chip microcomputer, a MUU, or a network device, etc.) containing a data processing unit to execute the method described in each embodiment or some parts of the embodiments of the present application.

[0046] The present application provides a cross-network video fusion monitoring system, and there are many methods and ways to realize the technical solutions. The above description is only the preferred embodiment of the present application, and it should be pointed out that for ordinary skilled persons in the technical field, without departing from the principles of the present application, some improvements and refinements can be made, which should be regarded as the protection scope of the present application. The components not explicitly described in the embodiments can be realized by using existing technology.

Claims

1. A cross-network video fusion monitoring system, characterized in that, include: The main network and the auxiliary network; each of the main network and the auxiliary network contains its own corresponding video surveillance system and video surveillance terminal. There is no direct network connection between the main network and the auxiliary network. The monitoring video signal in the auxiliary network is decoded and then connected to the main network through a video signal cable. The main network includes: a main network video surveillance system, a main network video surveillance terminal, a video analysis module, a video fusion module, and a scheduling and control module. The main network video surveillance system and the main network video surveillance terminal generate the main network video signal. The video fusion module connects to the auxiliary network video signal and the main network video signal to perform fused display of the surveillance footage. The scheduling and control module controls the switching of the video signals connected to the video fusion module. The video analysis module acquires raw video information through the video matrix in the video fusion module, performs identification and analysis, and outputs the results of the identification and analysis to the video matrix as one of the video sources for the video matrix. The auxiliary network includes: a first auxiliary network and a second auxiliary network; wherein, the first auxiliary network includes: a first auxiliary network video surveillance system and a second monitoring terminal; the first auxiliary network video surveillance system includes: a second streaming media server and a second video acquisition terminal, the second video acquisition terminal acquires monitoring video signals and transmits them to the second streaming media server, and the second monitoring terminal obtains monitoring video signals from the second streaming media server and transmits them to the video fusion module in the main network through a video transmission cable; the second auxiliary network includes: a multi-channel decoder and a third video acquisition terminal, the input of the multi-channel decoder is connected to the third video acquisition terminal, and the output of the multi-channel decoder is connected to the video fusion module in the main network through a video transmission cable; The scheduling control module includes: a scheduling server, a geographic information server, a one-way gateway, and a geographic information scheduling terminal. The dispatch server is connected to the main network monitoring terminal via a network cable, and sends video stream retrieval commands to enable the main network monitoring terminal to obtain a specified video stream from the main network video monitoring system. The dispatch server is connected to the second streaming media server in the first auxiliary network via a one-way network gateway, and sends video source switching commands to the second streaming media server to enable the second monitoring terminal to decode and display the video from the specified video source. The dispatch server is connected to the video matrix via a serial network to control the switching of different inputs and scenes at the output end of the video matrix. The scheduling server contains basic information and geographic information of all video acquisition terminals in the main network and the auxiliary network; The geographic information dispatch terminal is connected to the dispatch server via a network cable, and obtains and displays geographic information and geographic information of all video acquisition terminals from the dispatch server; the video output port of the geographic information dispatch terminal is connected to the video matrix input terminal via a video transmission cable.

2. The cross-network video convergence monitoring system of claim 1, wherein, The number of the second video acquisition terminal is one or more; the number of the third video acquisition terminal is one or more; the number of the video transmission cable is one or more, and the number is set according to the number of the second video acquisition terminal and the third video acquisition terminal.

3. The cross-network video convergence monitoring system of claim 2, wherein, The video fusion module includes: a video matrix and a monitoring screen; The video matrix comprises a control port, an input port and an output port; the input port is connected with the main network video monitoring system and the first auxiliary network video monitoring system through a video transmission cable; the video matrix constructs a display scene, the display scene comprises pictures of monitoring video signals input by each network video monitoring system; the control port is connected with a dispatching control module in the main network to realize switching display of different scenes; The monitoring large screen is connected with the output port of the video matrix through a video transmission cable to display different scene pictures output by the video matrix.

4. The cross-network video convergence monitoring system of claim 3, wherein, The main network video monitoring system adopts a streaming media server hierarchical cascade mode to realize monitoring video point access, and comprises a total node streaming media server, a branch node streaming media server and a first video acquisition terminal.

5. The cross-network video convergence monitoring system of claim 4, wherein, The main network video monitoring terminal is connected with the total node streaming media server of the main network video monitoring system to acquire video coding data of the first video acquisition terminal; The main network video monitoring terminal displays the video coding data after decoding; The main network video monitoring terminal is connected with the input port of the video matrix through a video transmission cable.

6. The cross-network video convergence monitoring system of claim 5, wherein, The number of the first video acquisition terminal is more than one; the number of the branch node streaming media server is more than one, and the branch node streaming media server is configured according to the first video acquisition terminal.

7. The cross-network video convergence monitoring system of claim 6, wherein, The video analysis module comprises a video analysis server and a video analysis client; The video analysis server is connected with the output port of the video matrix through a video transmission cable to acquire video data to be analyzed; the video analysis server is connected with the video analysis client through a network cable to send a video analysis result; the video analysis client comprises an analysis display output end and an analysis control end, the analysis display output end is connected with the input port of the video matrix through a video transmission cable, and the analysis control end is connected with the dispatching control module through a network cable.

Images