Camera remote operation and maintenance method and system based on national standard, and medium

Abstract

The invention discloses a national standard-based camera remote operation and maintenance method and system and a medium. The method comprises the following steps: acquiring image information shot by an IPC camera, and sending the image information to a video monitoring module for Web display, equipment management, historical video-on-demand, video storage, video distribution and video screenshot; and the video operation and maintenance module performs non-video stream analysis, network flow analysis, video stream frame rate analysis and equipment fault analysis according to historical video on demand, video screenshots and equipment response to obtain an operation and maintenance evaluation index, and matches a corresponding operation and maintenance scheme. According to the invention, IPC video equipment management and control are carried out based on a national standard protocol, and videos are pushed to a specified video monitoring module through a specified format protocol; according to the method, video stream-free analysis, network flow analysis, video stream frame rate analysis and equipment fault analysis are adopted, the problems of blurred screen and half screen caused by network congestion or video stream frame rate mismatching in national standard-based camera remote operation and maintenance are positioned, the workload of video operation and maintenance personnel is reduced, and the personnel focus on solving related problems.

Description

Technical Field

[0001] The present invention relates to the technical field of remote automated operation and maintenance of cameras, and in particular to a camera remote operation and maintenance method, system and medium based on national standards. Background Art

[0002] The camera remote operation and maintenance management system uses deep learning, intelligent recognition and other technologies to realize the intelligent operation and maintenance of power grid IPC video surveillance equipment. Power grid IPC video surveillance equipment is widely distributed in power plants, substations, distribution rooms and other indoor and outdoor areas. The monitoring range and span are large. It is impossible to complete the operation and maintenance of IPC cameras manually. Therefore, it is of great significance to build an automated remote operation and maintenance system. At present, video surveillance uses multiple video streams to play on a playback interface at the same time. The high frame rate leads to a decrease in the decoding ability of the player, and also causes video delays or freezes. Because the high frame rate means that more pictures are recorded per second, this will cause the size of the video file to increase significantly, requiring more storage space. Although the high frame rate can provide a smoother visual effect, if the device performance is insufficient, it may cause freezes during playback, affecting the smoothness of playback. Summary of the invention

[0003] Purpose of the invention: The present invention aims to provide a camera remote operation and maintenance method based on national standards that solves the problems of video distorted screen, half screen, black screen or inconsistent streaming frame rate; another purpose of the present invention is to provide a camera remote operation and maintenance system and medium based on national standards.

[0004] Technical solution: The camera remote operation and maintenance method based on national standards described in the present invention comprises the following steps:

[0005] (1) Obtain image information captured by the IPC camera and send it to the video monitoring module;

[0006] (2) The video surveillance module performs Web display, device management, historical video on demand, video storage, video distribution, and video screenshots;

[0007] (3) The video operation and maintenance module sends scheduled on-demand tasks and problem screenshot tasks to the video monitoring module. It performs no-video-stream analysis, network traffic analysis, video stream frame rate analysis, and device fault analysis based on historical video on-demand, video screenshots, and device responses to obtain an operation and maintenance evaluation index, and matches the corresponding operation and maintenance plan based on the operation and maintenance evaluation index.

[0008] Furthermore, the analysis of no video stream is as follows: obtain the historical video and timed on-demand video sent by the video surveillance module, monitor the national standard interactive signaling in real time, judge whether the signaling interaction is correct based on the log information, and determine whether the camera sends the video stream or the IPC device collects the video abnormally.

[0009] Further, the network traffic analysis is as follows: obtain a video screenshot dataset, use a deep learning model to classify the screenshots, obtain the corresponding video stream with key information frame loss based on the distorted screen or half-screen screenshots, and determine the corresponding network congestion level. The deep learning model is preferably a CNN model.

[0010] Furthermore, the video stream frame rate analysis is as follows: obtain N seconds of video stream through the video monitoring module, take screenshots every 1 second, obtain the timestamp information of each screenshot through OCR technology, and sort them, and judge whether the video stream frame rate meets the standard requirements based on the time difference. The national standard recommends that the frame rate be set to 25, that is, 25 frames are played in 1 second.

[0011] Furthermore, the device failure analysis is as follows: an IPC device heartbeat detection mechanism is used. If the device does not respond for more than a threshold number of times, the device fails and goes offline.

[0012] Furthermore, a danger warning index is set, and signal alarms, network alarms, player alarms, and video stream alarms are issued based on the danger warning index; and the alarm information is pushed to business personnel in real time through WebSocket, built into to-do items, and saved in the Redis database until the camera operation and maintenance is completed.

[0013] The camera remote operation and maintenance system based on the national standard of the present invention includes:

[0014] IPC video surveillance module, used to manage and control IPC video devices based on the national standard GB / T28181-2011 and national standard GB / T28181-2016 protocols, so that the video is pushed to the specified video surveillance module through the specified format protocol;

[0015] Video monitoring module, used to receive image information captured by IPC cameras, and perform Web display, device management, historical video on demand, video storage, video distribution and video screenshots;

[0016] The video operation and maintenance module is used to send tasks to the video surveillance module, receive image data information from the video surveillance module, perform video flow analysis, network traffic analysis, video flow frame rate analysis and equipment failure analysis, obtain the operation and maintenance evaluation index, and match the corresponding operation and maintenance plan according to the operation and maintenance evaluation index.

[0017] Furthermore, the video operation and maintenance module includes

[0018] No-stream judgment module, used for no-video-stream analysis;

[0019] Network problem module, used for network traffic analysis;

[0020] Video problem module, used for video stream frame rate analysis;

[0021] Equipment failure module, used for equipment failure analysis;

[0022] The early warning module is used to determine whether the operation and maintenance evaluation index exceeds the danger warning index, and issue an early warning if it exceeds the danger warning index.

[0023] The computer device of the present invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the steps of the above method are implemented when the processor executes the computer program.

[0024] The computer-readable storage medium of the present invention stores a computer program thereon, and the computer program implements the steps of the above method when executed by a processor.

[0025] Beneficial effects: Compared with the prior art, the present invention has the following significant advantages: 1. The present invention manages and controls IPC video equipment based on the national standard GB / T28181-2011 and the national standard GB / T28181-2016 protocol, so that the video is pushed to the specified video monitoring module through the specified format protocol; 2. The present invention adopts non-video stream analysis, network traffic analysis, video stream frame rate analysis and equipment fault analysis, which solves the problems of flowery screen and half-screen caused by network congestion or video stream frame rate mismatch in the remote operation and maintenance of cameras based on the national standard. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a structural schematic diagram of the camera remote operation and maintenance system of the present invention. DETAILED DESCRIPTION

[0027] The present invention will be further described below in conjunction with the accompanying drawings.

[0028] The camera remote operation and maintenance method based on the national standard of the present invention comprises the following steps:

[0029] (1) Obtain image information captured by the IPC camera and send it to the video monitoring module;

[0030] (2) The video surveillance module performs Web display, device management, historical video on demand, video storage, video distribution, and video screenshots;

[0031] (3) The video operation and maintenance module sends scheduled on-demand tasks and problem screenshot tasks to the video monitoring module. It performs no-video-stream analysis, network traffic analysis, video stream frame rate analysis, and device fault analysis based on historical video on-demand, video screenshots, and device responses to obtain an operation and maintenance evaluation index, and matches the corresponding operation and maintenance plan based on the operation and maintenance evaluation index.

[0032] The no video stream analysis is specifically as follows: obtain historical videos and timed on-demand videos sent by the video surveillance module, monitor the national standard interactive signaling in real time, judge whether the signaling interaction is correct based on the log information, and determine whether the camera sends video streams or the IPC device collects videos abnormally.

[0033] The network traffic analysis is specifically as follows: obtaining a video screenshot dataset, using a deep learning model to classify the screenshots, obtaining the corresponding video stream with key information frame loss based on the flowery or half-screen screenshots, and determining the corresponding network congestion level.

[0034] The video stream frame rate analysis is specifically as follows: a 10-second video stream is obtained through a video monitoring module, a screenshot is taken every 1 second, the timestamp information of each screenshot is obtained through OCR technology, and the screenshots are sorted, and the video stream frame rate is judged according to the time difference whether it meets the standard requirements.

[0035] The specific analysis of device failure is as follows: The IPC device heartbeat detection mechanism is used. If the device does not respond after exceeding the threshold number of times, the device fails and goes offline.

[0036] The danger warning index is set, and signal warning, network warning, player warning, and video stream warning are issued according to the danger warning index; and the warning information is pushed to the business personnel in real time through WebSocket, constructed into to-do items, and saved in the Redis database until the camera operation and maintenance is completed.

[0037] The camera remote operation and maintenance system based on the national standard of the present invention includes:

[0038] IPC video surveillance module, used to manage and control IPC video devices based on the national standard GB / T28181-2011 and national standard GB / T28181-2016 protocols, so that the video is pushed to the specified video surveillance module through the specified format protocol;

[0039] The video monitoring module is used to receive the image information captured by the IPC camera, and perform Web display, device management, historical video on demand, video storage, video distribution, and video screenshots. In the video monitoring module, the IPC camera management can be realized through the Web end, and the new camera can be registered to the system to facilitate the search and use of the device; the camera can call the front-end video information collected by the IPC camera in real time through the Web end, and play or store it according to demand; the corresponding camera recording information can be configured through the Web end, and real-time and scheduled recording can be performed, and the storage of the recording can be specified; historical video on demand and screenshots can be realized through the Web end.

[0040] The video operation and maintenance module is used to send tasks to the video monitoring module, receive image data information from the video monitoring module, perform video flow analysis, network traffic analysis, video flow frame rate analysis, and equipment failure analysis, obtain the operation and maintenance evaluation index, and match the corresponding operation and maintenance plan according to the operation and maintenance evaluation index. The video operation and maintenance module includes

[0041] The no-stream judgment module is used for no-video-stream analysis: obtaining historical videos and scheduled on-demand videos sent by the video surveillance module, monitoring the national standard interactive signaling in real time, judging whether the signaling interaction is correct based on the log information, and determining whether the video stream sent by the camera or the video collected by the IPC device is abnormal.

[0042] The network problem module is used for network traffic analysis: multiple video streams are opened at the same time, and a video screenshot data set is obtained. The video is automatically played for 3 seconds, and images are collected every 1 second and cut into videos. The deep learning model is used to classify and identify the cut images. In the identification results, each image has a distorted screen, indicating that the video packet data is lost during the transmission of the video stream, resulting in a distorted screen. The distorted screen display degree of the video stream is divided through deep learning. The more severe the distorted screen degree, the more congested the network.

[0043] The video problem module is used for video stream frame rate analysis: when the network is not congested, the video stream is obtained through the video monitoring module, and screenshots are taken every 1 second through the front-end player. The timestamp information of each screenshot is obtained through OCR technology. If there is a difference between the playback time before and after the timestamp and the screenshot time, it can be determined that the video stream setting information does not meet the national standard requirements.

[0044] The device failure module is used for device failure analysis: it uses the IPC device heartbeat detection mechanism. If the device does not respond after exceeding the threshold number of times, the device fails and goes offline.

[0045] The early warning module is used to determine whether the operation and maintenance assessment index exceeds the danger warning index and issue an alarm: set the danger warning index, and issue signal alarms, network alarms, player alarms, and video stream alarms based on the danger warning index; and push the alarm information to business personnel in real time through WebSocket, build it into an agent task, and save it in the Redis database until the camera operation and maintenance is completed.

[0046] The computer device of the present invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the steps of the above method are implemented when the processor executes the computer program.

[0047] The computer-readable storage medium of the present invention stores a computer program thereon, and the computer program implements the steps of the above method when executed by a processor.

Claims

1. A camera remote operation and maintenance method based on national standards, characterized in that: The following steps are involved: (1) Obtain image information captured by the IPC camera and send it to the video monitoring module; (2) The video surveillance module performs Web display, device management, historical video on demand, video storage, video distribution, and video screenshots; (3) The video operation and maintenance module sends scheduled on-demand tasks and problem screenshot tasks to the video monitoring module. It performs no-video-stream analysis, network traffic analysis, video stream frame rate analysis, and device fault analysis based on historical video on-demand, video screenshots, and device responses to obtain an operation and maintenance evaluation index, and matches the corresponding operation and maintenance plan based on the operation and maintenance evaluation index.

2. The camera remote operation and maintenance method based on national standards according to claim 1 is characterized in that: The specific analysis of no video stream is as follows: obtain the historical video and timed on-demand video sent by the video surveillance module, monitor the national standard interactive signaling in real time, judge whether the signaling interaction is correct based on the log information, and determine whether the video stream sent by the camera or the video collected by the IPC device is abnormal.

3. According to the national standard-based camera remote operation and maintenance method of claim 1, it is characterized in that: The network traffic analysis is as follows: obtain a video screenshot dataset, use a deep learning model to classify the screenshots, obtain the corresponding video stream with key information frame loss based on the flowery or half-screen screenshots, and determine the corresponding network congestion level.

4. The camera remote operation and maintenance method based on national standards according to claim 1 is characterized in that: The video stream frame rate analysis is as follows: obtain N seconds of video stream through the video monitoring module, take screenshots every 1 second, obtain the timestamp information of each screenshot through OCR technology, sort them, and judge whether the video stream frame rate meets the standard requirements based on the time difference.

5. The camera remote operation and maintenance method based on national standards according to claim 1 is characterized in that: The specific analysis of device failure is as follows: The IPC device heartbeat detection mechanism is used. If the device does not respond after exceeding the threshold number of times, the device fails and goes offline.

6. The camera remote operation and maintenance method based on national standards according to claim 1 is characterized in that: Set the danger warning index, and issue signal alarm, network alarm, player alarm, and video stream alarm according to the danger warning index; push the alarm information to business personnel in real time through WebSocket, build it into to-do items, and save it in the Redis database until the camera operation and maintenance is completed.

7. A camera remote operation and maintenance system based on national standards, characterized in that: include: IPC video surveillance module, used to manage and control IPC video devices based on the national standard GB / T28181-2011 and national standard GB / T28181-2016 protocols, so that the video is pushed to the specified video surveillance module through the specified format protocol; Through testing, it is determined that the player can play the maximum number of video streams under the standard national standard protocol; Video monitoring module, used to receive image information captured by IPC cameras, and perform Web display, device management, historical video on demand, video storage, video distribution and video screenshots; The video operation and maintenance module is used to send tasks to the video surveillance module, receive image data information from the video surveillance module, perform video flow analysis, network traffic analysis, video flow frame rate analysis and equipment failure analysis, obtain the operation and maintenance evaluation index, and match the corresponding operation and maintenance plan according to the operation and maintenance evaluation index.

8. The camera remote operation and maintenance system based on national standards according to claim 7 is characterized in that: The video operation and maintenance module includes No-stream judgment module, used for no-video-stream analysis; Network problem module, used for network traffic analysis; Video problem module, used for video stream frame rate analysis; Equipment failure module, used for equipment failure analysis; The early warning module is used to determine whether the operation and maintenance evaluation index exceeds the danger warning index, and issue an early warning if it exceeds the danger warning index.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images