A monitoring video transmission method, device, equipment and medium

Abstract

The present invention discloses a monitoring video transmission method, device, equipment and medium. When a video segment interval acquisition instruction sent by a media server is received or the movement state of a manipulator meets a preset acquisition state, a plurality of monitoring video segments are collected by a manipulator at intervals; each monitoring video segment is spliced ​​to obtain a monitoring video; the current receiving window specification of the media server is queried, the network status between the media server and the optical fiber remote self-healing system is detected, and the attribute parameters of the monitoring video are obtained; the transmission mode of the monitoring video is determined according to the receiving window specification, the network status and the attribute parameters; if the transmission mode of the monitoring video is not direct transmission, a video compression operation is performed on the attribute parameters to obtain a compressed video and transmit it to the media server. The present invention solves the technical problems of high pressure on monitoring video transmission, low transmission efficiency, high network occupancy rate during the transmission process, and failure to ensure complete and effective transmission of the monitoring video.

Description

Technical Field

[0001] The present invention relates to the technical field of video transmission, and in particular to a monitoring video transmission method, device, equipment and medium. Background Art

[0002] In recent years, as my country's national strength has gradually grown, the Internet has developed rapidly in all aspects. Today, optical fiber communication has gradually entered the public's sight. The optical fiber remote self-healing system is a device based on a manipulator to automatically plug and unplug the remote optical fiber flange head. The manipulator can move vertically and horizontally, and plug and unplug the optical fiber flange head through the optical fiber clamp at the front end of the manipulator to switch the optical fiber routing line.

[0003] The existing optical fiber remote self-healing system generally does not have a camera device and cannot remotely monitor unexpected situations and emergencies occurring outside the system. Even if the existing optical fiber remote self-healing system adds a remote monitoring function, due to the need for long-term monitoring, each optical fiber remote self-healing system will generate a large amount of monitoring videos, and the media server will receive a large amount of monitoring videos, resulting in high pressure on monitoring video transmission, low transmission efficiency, high network occupancy during the transmission process, and the inability to ensure the complete and effective transmission of monitoring videos. Summary of the invention

[0004] The present invention provides a monitoring video transmission method, device, equipment and medium, which are applied to an optical fiber remote self-healing system. The optical fiber remote self-healing system is communicatively connected to a media server. The optical fiber remote self-healing system is provided with a manipulator, which solves the technical problems that even if the existing optical fiber remote self-healing system adds a remote monitoring function, each optical fiber remote self-healing system will generate a large number of monitoring videos due to the need for long-term monitoring, and the media server will receive a large number of monitoring videos, resulting in high pressure on monitoring video transmission, low transmission efficiency, high network occupancy during the transmission process, and inability to ensure complete and effective transmission of monitoring videos.

[0005] The present invention provides a monitoring video transmission method, comprising:

[0006] When a video segment interval acquisition instruction sent by the media server is received or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals;

[0007] splicing the surveillance video segments according to the acquisition order to obtain the surveillance video;

[0008] Query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video;

[0009] Determining a transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameters;

[0010] If the transmission mode of the monitoring video is not direct transmission, a video compression operation is performed on the attribute parameters to obtain a compressed monitoring video and transmit it to the media server.

[0011] Optionally, when the video segment interval acquisition instruction sent by the media server is received or the movement state of the manipulator meets the preset acquisition state, before the step of using the manipulator to collect multiple monitoring video segments at intervals, the step includes:

[0012] When receiving the movement state information of the manipulator, the movement state information is sent to the media server and a video segment interval acquisition instruction is generated;

[0013] The media server is used to send the video segment interval collection instruction.

[0014] Optionally, the step of splicing the surveillance video segments according to the acquisition order to obtain the surveillance video includes:

[0015] Performing image recognition operations on each of the surveillance video segments in the order of acquisition to generate corresponding video interruption images and video change trends;

[0016] The video interruption screen, the video change trend and the associated monitoring video segments are spliced ​​to obtain a spliced ​​video;

[0017] Performing a frame interpolation operation on the splicing position in the spliced ​​video to obtain a frame interpolation video;

[0018] A dynamic encoding operation is performed on the interpolated frame video to obtain a monitoring video.

[0019] Optionally, the step of querying the current receiving window specification of the media server, detecting the network status data between the media server and the optical fiber remote self-healing system, and obtaining the attribute parameters of the monitoring video includes:

[0020] Query the current receiving window specification of the media server;

[0021] Sending a plurality of network test packets to the media server and detecting the reception status of the network test packets to obtain network status data between the media server and the optical fiber remote self-healing system;

[0022] Performing a data analysis operation on the surveillance video to obtain attribute parameters of the surveillance video.

[0023] Optionally, the transmission mode includes direct transmission and compressed transmission, and the step of determining the transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameter includes:

[0024] Matching the receiving window specification with the attribute parameter to obtain a matching result;

[0025] Determine the network status between the media server and the optical fiber remote self-healing system according to the network status data;

[0026] When the matching result and the network status meet the preset transmission condition, determining that the transmission mode of the surveillance video is direct transmission;

[0027] When the matching result or the network condition does not meet the preset transmission condition, it is determined that the transmission mode of the surveillance video is compressed transmission.

[0028] Optionally, if the transmission mode of the surveillance video is not direct transmission, the step of performing a video compression operation on the attribute parameter to obtain a compressed surveillance video and transmitting the compressed surveillance video to the media server includes:

[0029] If the transmission mode of the monitoring video is not direct transmission, performing a simulated transmission operation on the receiving window specification, the network status data and the attribute parameters to obtain a recommended transmission size;

[0030] Calculate the percentage of the size of the surveillance video and the recommended transmission size to obtain a target compression ratio;

[0031] Using various video sub-attributes in the attribute parameters to match corresponding preset condition rules respectively to obtain a compressed matching result;

[0032] According to the compression matching result, the attribute parameters are compressed by matching the corresponding compression rule in the preset compression rule set to obtain a compressed monitoring video;

[0033] If the compressed surveillance video is adapted to the target compression rate and the video quality of the compressed surveillance video meets a preset video quality condition, the compressed surveillance video is transmitted to the media server.

[0034] Optionally, the attribute parameters include video length, video size, video format, resolution, frame rate and bit rate;

[0035] The preset compression rule set includes vector quantization rules, format conversion rules, resolution compression rules, bit rate compression rules, frame rate compression rules, video size processing rules and video segmentation rules.

[0036] A second aspect of the present invention provides a monitoring video transmission device, comprising:

[0037] A video segment acquisition module, configured to use the manipulator to collect multiple surveillance video segments at intervals when receiving a video segment interval acquisition instruction sent by the media server or the movement state of the manipulator meets a preset acquisition state;

[0038] A video segment splicing module is used to splice each of the monitoring video segments according to the acquisition order to obtain a monitoring video;

[0039] A video data acquisition module is used to query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video;

[0040] A transmission mode determination module, used to determine the transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameters;

[0041] The transmission compressed video module is used to perform a video compression operation on the attribute parameters if the transmission mode of the monitoring video is not direct transmission, obtain the compressed monitoring video and transmit it to the media server.

[0042] A third aspect of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the monitoring video transmission method as described in any one of the above items.

[0043] A fourth aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed, implements the monitoring video transmission method as described in any one of the above items.

[0044] It can be seen from the above technical solutions that the present invention has the following advantages:

[0045] The optical fiber remote self-healing system is connected to the media server in communication. The optical fiber remote self-healing system is provided with a manipulator. When receiving the video segment interval acquisition instruction sent by the media server or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals; each monitoring video segment is spliced ​​according to the acquisition order to obtain the monitoring video; the current receiving window specification of the media server is queried, the network status data between the media server and the optical fiber remote self-healing system is detected, and the attribute parameters of the monitoring video are obtained; the transmission mode of the monitoring video is determined according to the receiving window specification, the network status data and the attribute parameters; if the transmission mode of the monitoring video is not direct transmission, the video compression operation is performed on the attribute parameters to obtain the compressed monitoring video and transmit it to the media server. The technical problem that even if the existing optical fiber remote self-healing system adds a remote monitoring function, each optical fiber remote self-healing system will generate a large number of monitoring videos due to the need for long-term monitoring, and the media server will receive a large number of monitoring videos, resulting in high pressure on the transmission of monitoring videos, low transmission efficiency, high network occupancy rate during the transmission process, and inability to ensure the complete and effective transmission of monitoring videos is solved. The pressure of monitoring video transmission is effectively alleviated, the transmission efficiency is improved, the network occupancy rate is reduced, and the complete and effective transmission of monitoring videos is ensured. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0047] Figure 1 A flowchart of a monitoring video transmission method provided in Embodiment 1 of the present invention;

[0048] Figure 2 A flowchart of a monitoring video transmission method provided in Embodiment 2 of the present invention;

[0049] Figure 3 This is a structural block diagram of a monitoring video transmission device provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0050] The embodiments of the present invention provide a monitoring video transmission method, device, equipment and medium, which are used to solve the technical problems that even if the existing optical fiber remote self-healing system adds a remote monitoring function, due to the need for long-term monitoring, each optical fiber remote self-healing system will generate a large amount of monitoring videos, and the media server will receive a large amount of monitoring videos, resulting in high pressure on monitoring video transmission, low transmission efficiency, high network occupancy during the transmission process, and inability to ensure complete and effective transmission of the monitoring video.

[0051] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] See also Figure 1 , Figure 1 A flowchart of the steps of a monitoring video transmission method provided by an embodiment of the present invention.

[0053] The present invention provides a monitoring video transmission method, comprising:

[0054] Step 101: When a video segment interval collection instruction sent by a media server is received or the movement state of the manipulator meets a preset collection state, a plurality of monitoring video segments are collected by the manipulator at intervals.

[0055] The preset acquisition state refers to the pre-setting and selection of the acquisition mode of the surveillance video. The acquisition modes of the surveillance video include continuously turning on the camera, turning on the camera after the manipulator receives a moving command, and turning on the camera only when there is abnormal vibration or obstruction in the movement of the manipulator. If the movement state of the manipulator meets one of the acquisition modes, the interval acquisition of multiple surveillance video segments is performed.

[0056] It should be noted that a monitoring video transmission method protected by the present application is applied to a fiber optic remote self-healing system, which is communicatively connected to a media server. Since the fiber optic remote self-healing system is remotely operated, the operator cannot obtain the status of the equipment in real time. In order to detect sudden accidents as early as possible and avoid damage to the fiber optic remote self-healing system, a manipulator is provided in the fiber optic remote self-healing system. A camera is also provided at the front end of the manipulator to obtain real-time images through the camera to form multiple monitoring videos of rated duration.

[0057] In an embodiment of the present invention, the optical fiber remote self-healing system is communicatively connected to the media server, and the optical fiber remote self-healing system is provided with a manipulator. When a video segment interval collection instruction sent by the media server is received or the movement state of the manipulator meets the preset collection state, the manipulator is used to collect multiple monitoring video segments at intervals.

[0058] Step 102: splice the surveillance video segments according to the acquisition order to obtain the surveillance video.

[0059] It should be noted that the surveillance video segments need to be spliced ​​in the order in which they are collected and according to the receiving window size of the media server to prevent the surveillance video from being out of order or skipping frames during playback.

[0060] In the embodiment of the present invention, each monitoring video segment is spliced ​​according to the acquisition order to obtain the monitoring video.

[0061] Step 103: query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video.

[0062] The receive window specification refers to the sequence number table of video frames that the receiver is allowed to receive. Only video frames sent within the receive window can be received by the receiver. Other frames outside the window will be discarded. The receive window specification is defined by the server.

[0063] It should be noted that the network status data includes information on whether the network is connected, as well as real-time parameters of network upload and download, network bandwidth, network response time, network packet loss rate, network jitter and network throughput.

[0064] In the embodiment of the present invention, the current receiving window specification of the media server is queried, the network status data between the media server and the optical fiber remote self-healing system is detected, and the attribute parameters of the monitoring video are obtained.

[0065] Step 104: Determine the transmission mode of the monitoring video according to the receiving window specification, network status data and attribute parameters.

[0066] In the embodiment of the present invention, the transmission mode of the monitoring video is determined according to the receiving window specification, the network status data and the attribute parameters.

[0067] Step 105: If the transmission mode of the surveillance video is not direct transmission, a video compression operation is performed on the attribute parameters to obtain a compressed surveillance video and transmit it to the media server.

[0068] It should be noted that the monitoring video transmission method claimed for protection in this application improves the way monitoring video is generated, processed and transmitted. The monitoring video is processed into a form suitable for transmission based on comprehensive consideration of the receiving window specifications and network conditions of the media server to ensure that the monitoring video can be completely and effectively transmitted to the media server under various circumstances.

[0069] In the embodiment of the present invention, if the transmission mode of the monitoring video is not direct transmission, a video compression operation is performed on the attribute parameters to obtain a compressed monitoring video and transmit it to the media server.

[0070] In an embodiment of the present invention, the optical fiber remote self-healing system is connected to the media server in communication, and the optical fiber remote self-healing system is provided with a manipulator. When receiving the video segment interval acquisition instruction sent by the media server or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals; each monitoring video segment is spliced ​​according to the acquisition order to obtain the monitoring video; the current receiving window specification of the media server is queried, the network status data between the media server and the optical fiber remote self-healing system is detected, and the attribute parameters of the monitoring video are obtained; according to the receiving window specification, the network status data and the attribute parameters, the transmission mode of the monitoring video is determined; if the transmission mode of the monitoring video is not direct transmission, the attribute parameters are performed on the video compression operation to obtain the compressed monitoring video and transmit it to the media server. The technical problem that even if the existing optical fiber remote self-healing system adds a remote monitoring function, each optical fiber remote self-healing system will generate a large number of monitoring videos due to the need for long-term monitoring, and the media server will receive a large number of monitoring videos, resulting in high pressure on the transmission of the monitoring video, low transmission efficiency, high network occupancy during the transmission process, and inability to ensure the complete and effective transmission of the monitoring video is solved. It effectively alleviates the pressure of surveillance video transmission, improves transmission efficiency, reduces network occupancy, and ensures the complete and effective transmission of surveillance video.

[0071] See also Figure 2 , Figure 2 A flowchart of the steps of a monitoring video transmission method provided in Embodiment 2 of the present invention.

[0072] The present invention provides a monitoring video transmission method, comprising:

[0073] Step 201: When the movement state information of the robot is received, the movement state information is sent to the media server and a video segment interval acquisition instruction is generated.

[0074] It should be noted that when the optical fiber remote self-healing system receives the movement status information of the manipulator, the optical fiber remote self-healing system sends the received movement status information to the media server, and the media server generates a video interval acquisition instruction after receiving the movement status information.

[0075] In the embodiment of the present invention, when the optical fiber remote self-healing system receives the movement status information of the manipulator, the optical fiber remote self-healing system sends the received movement status information to the media server, and after receiving the movement status information, the media server generates a video interval acquisition instruction.

[0076] Step 202: Use the media server to send a video segment interval collection instruction.

[0077] It should be noted that after the media server generates the video interval collection instruction, it sends the video segment interval collection instruction to the optical fiber remote self-healing system.

[0078] In the embodiment of the present invention, the media server generates a video interval acquisition instruction and sends the video segment interval acquisition instruction to the optical fiber remote self-healing system.

[0079] Step 203: When a video segment interval acquisition instruction sent by the media server is received or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals.

[0080] It should be noted that since the manipulator is in a stationary state most of the time when no fault occurs, the camera will be started only when the manipulator is in an active state to obtain the video segment. It saves more storage space. In actual operation, in order to ensure the accuracy of the action and protect the optical fiber interface and the optical fiber flange head, the movement speed of the manipulator will be relatively slow. In order to reduce the overall size of the monitoring video, this application adopts the method of collecting video segments with intervals by the camera. The video segments collected at intervals, the duration and interval of the video segments can be adjusted according to the actual usage, and are not specifically limited here. At the same time, the method of continuously shooting multiple pictures can be used to replace the video segment, so that the size of the original collected video of the monitoring video is smaller.

[0081] In the embodiment of the present invention, when a video segment interval collection instruction sent by a media server is received or the movement state of the manipulator meets the preset collection state, the manipulator is used to collect multiple monitoring video segments at intervals.

[0082] Step 204: splice the surveillance video segments according to the acquisition order to obtain the surveillance video.

[0083] Further, step 204 may include the following sub-steps:

[0084] Step S41: perform image recognition operations on each surveillance video segment according to the acquisition sequence to generate corresponding video interruption images and video change trends.

[0085] The video change trend refers to the change of video frames of adjacent surveillance video segments obtained by performing image recognition operations.

[0086] It should be noted that each video segment is input into the artificial intelligence model in the order of acquisition to perform image recognition on each video segment to obtain the video interruption screen and video change trend corresponding to each video segment. The artificial intelligence model predicts the video frame content at the next moment based on the input video frame sequence. The input is multiple video frames, and the output is the video frame at the next moment. The artificial intelligence model in this embodiment can be a prediction network or other artificial intelligence network that predicts other image types. As long as the above functions can be achieved, there is no specific limitation on this in this embodiment.

[0087] In the embodiment of the present invention, the image recognition operation is performed on each monitoring video segment according to the acquisition order to generate the corresponding video interruption screen and video change trend.

[0088] Step S42: splicing the video interruption screen, the video change trend and the associated monitoring video segments to obtain a spliced ​​video.

[0089] In the embodiment of the present invention, the video interruption picture, the video change trend and the associated monitoring video segments are spliced ​​to obtain a spliced ​​video.

[0090] Step S43: performing a frame interpolation operation on the splicing position in the spliced ​​video to obtain a frame interpolated video.

[0091] It should be noted that, first, based on every two adjacent video segments, an intermediate frame connecting the two video segments is intelligently generated, and an artificial intelligence video segment deep synthesis algorithm is used to fill the intermediate frame between the video segments to achieve intelligent frame filling. Among them, the artificial intelligence video segment deep synthesis algorithm refers to a technology that uses generative synthesis algorithms represented by deep learning and virtual reality to produce images, videos and other information, including image enhancement and other technologies. The artificial intelligence video segment deep synthesis algorithm in this embodiment can be an artificial intelligence algorithm of other video restoration types. As long as the above functions can be achieved, this embodiment does not make specific limitations on this.

[0092] In the embodiment of the present invention, a frame interpolation operation is performed on the splicing position in the spliced ​​video to obtain a frame interpolation video.

[0093] Step S44: Perform dynamic encoding operation on the supplemented frame video to obtain a monitoring video.

[0094] Dynamic encoding refers to using a higher sampling rate for complex dynamic images and a lower sampling rate for static images, making rational use of resources to achieve the effect of having both image quality and file size.

[0095] It should be noted that the surveillance video after frame supplementation is re-encoded by dynamic encoding to form a smooth surveillance video.

[0096] In the embodiment of the present invention, the video after frame supplementation is re-encoded by dynamic encoding to obtain a smooth monitoring video.

[0097] Step 205: query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video.

[0098] Further, step 205 may include the following sub-steps:

[0099] Step S51: query the current receiving window specification of the media server.

[0100] It should be noted that the size of the receiving window is defined by the media server, so the current size of the receiving window of the media server can be directly obtained by querying.

[0101] In the embodiment of the present invention, the current receiving window specification of the media server is queried.

[0102] Step S52: Send multiple network test packets to the media server and detect the reception status of the network test packets to obtain network status data between the media server and the optical fiber remote self-healing system.

[0103] It should be noted that the optical fiber remote self-healing system sends a number of network test packets to the media server, and obtains network status data after detecting the status of the media server receiving the network test packets.

[0104] In the embodiment of the present invention, the optical fiber remote self-healing system sends a number of network test packets to the media server, and obtains network status data after detecting the status of the media server receiving the network test packets.

[0105] Step S53: Perform data analysis operations on the surveillance video to obtain attribute parameters of the surveillance video.

[0106] It should be noted that the optical fiber remote self-healing system performs data analysis on the surveillance video and reads the attribute parameters of the surveillance video according to the data analysis results, wherein the attribute parameters include video length, video size, video format, resolution, frame rate and bit rate.

[0107] In the embodiment of the present invention, the optical fiber remote self-healing system performs data analysis on the monitoring video, and reads the attribute parameters of the monitoring video according to the data analysis result.

[0108] Step 206: Determine the transmission mode of the monitoring video according to the receiving window specification, network status data and attribute parameters.

[0109] Further, step 206 may include the following sub-steps:

[0110] Step S61: Match the receiving window specification and attribute parameters to obtain a matching result.

[0111] It should be noted that the receiving window size of the media server needs to be matched with the size of the monitoring video, and the matching results include the matching of the receiving window size and the size of the monitoring video and the mismatch of the receiving window size and the size of the monitoring video.

[0112] In the embodiment of the present invention, the receiving window specification and the attribute parameter are matched to obtain a matching result.

[0113] Step S62: Determine the network status between the media server and the optical fiber remote self-healing system according to the network status data.

[0114] It should be noted that by detecting network interference, packet loss, etc., it is determined whether the network condition between the media server and the optical fiber remote self-healing system is stable. Since the network in the suburbs may not be stable for a long time, when the network condition is unstable, it will affect the transmission efficiency and integrity of the surveillance video after transmission, that is, it will affect the ability of the media server to actually receive the surveillance video.

[0115] In the embodiment of the present invention, the network status between the media server and the optical fiber remote self-healing system is determined according to the network status data.

[0116] Step S63: When the matching result and the network status meet the preset transmission conditions, the transmission mode of the surveillance video is determined to be direct transmission.

[0117] It should be noted that the transmission mode includes direct transmission and compressed transmission. If the matching result is that the receiving window size matches the size of the monitoring video and the network condition is stable, the monitoring video is directly transmitted to the media server through the optical fiber remote self-healing system.

[0118] In the embodiment of the present invention, if the matching result is that the receiving window size matches the size of the monitoring video and the network condition is in a stable state, the monitoring video is directly transmitted to the media server through the optical fiber remote self-healing system.

[0119] Step S64: When the matching result or the network condition does not meet the preset transmission condition, the transmission mode of the surveillance video is determined to be compressed transmission.

[0120] It should be noted that if the matching result is that the receiving window size and the monitoring video size do not match or the network condition is unstable, even if the monitoring video size matches the server receiving window, there may be a situation where the network environment is not suitable for direct transmission. In this case, the monitoring video needs to be compressed before transmission.

[0121] In the embodiment of the present invention, when the matching result or the network condition does not meet the preset transmission condition, it is determined that the transmission mode of the surveillance video is compressed transmission.

[0122] Step 207: If the transmission mode of the surveillance video is not direct transmission, a video compression operation is performed on the attribute parameters to obtain a compressed surveillance video and transmit it to the media server.

[0123] Further, step 207 may include the following sub-steps:

[0124] Step S71: If the transmission mode of the monitoring video is not direct transmission, a simulated transmission operation is performed on the receiving window specification, network status data and attribute parameters to obtain a recommended transmission size.

[0125] It should be noted that if the transmission mode of the monitoring video is not direct transmission, the receiving window specification, network status data and attribute parameters are respectively input into the video transmission operation model, and the video transmission operation model is used to perform simulated transmission operation. According to the simulated transmission operation result, the recommended transmission size of the monitoring video is obtained, wherein the video transmission operation model is used to simulate transmission, and the impact on the current network transmission capacity and the actual reception of the media server is calculated to calculate the size of the video file that can be transmitted stably in a single complete manner, and then compared with the attribute parameters of the monitoring video. If it is smaller than the current size of the monitoring video, the recommended transmission size is output. The video transmission operation model in this embodiment can be a transmission operation model of other video operation size types, as long as the above functions can be achieved, and this is not specifically limited in this embodiment.

[0126] In the embodiment of the present invention, if the transmission mode of the monitoring video is not direct transmission, a simulated transmission operation is performed on the receiving window specification, network status data and attribute parameters to obtain a recommended transmission size.

[0127] Step S72: Calculate the percentage of the size of the surveillance video and the recommended transmission size to obtain a target compression ratio.

[0128] It should be noted that the target compression rate is the percentage of the recommended transmission size (target size after video compression) and the surveillance video size (size before video compression). Generally, the smaller the target compression rate, the better. However, the smaller the compression, the longer the decompression time.

[0129] In the embodiment of the present invention, the size of the surveillance video and the percentage of the recommended transmission size are calculated to obtain the target compression rate.

[0130] Step S73: Match each type of video sub-attribute in the attribute parameter with the corresponding preset condition rule to obtain a compressed matching result.

[0131] It should be noted that each type of video sub-attribute in the attribute parameter is matched with the corresponding preset condition rule, that is, the video length, video size, video format, resolution, frame rate and bit rate are matched with the corresponding preset condition rule, and each preset threshold and parameter condition in the preset condition rule can be set as needed, and no specific limitation is made here. In this embodiment, the preset threshold in the preset condition rule is set to whether the bit rate is greater than 15000, whether the frame rate is greater than 60 frames per second, whether the resolution is greater than 720P, whether the video length is greater than 5 minutes, whether the video format is RMVB format, whether the video size is greater than 300M, or whether there is a code book for the monitoring video. Since the matching is performed sequentially, only one preset condition rule needs to be hit, that is, when any video sub-attribute in the attribute parameter is greater than the preset threshold, is not in RMVB format, or has a code book, it will be classified into the compression matching result.

[0132] In the embodiment of the present invention, various types of video sub-attributes in the attribute parameters are matched with corresponding preset condition rules to obtain a compressed matching result.

[0133] Step S74: Compress the attribute parameters by matching the corresponding compression rules in the preset compression rule set according to the compression matching result to obtain a compressed monitoring video.

[0134] It should be noted that the preset compression rule set includes vector quantization rules, format conversion rules, resolution compression rules, bit rate compression rules, frame rate compression rules, video size processing rules and video segmentation rules. The bit rate processing rules are used to compress the bit rate when the bit rate is greater than the preset bit rate threshold; the frame rate processing rules are used to compress the frame rate when the frame rate is greater than the preset frame rate threshold; the resolution processing rules are used to compress the resolution when the resolution is greater than the preset resolution threshold; the video segmentation processing rules are used to compress the video length when the video length is greater than the preset video length threshold; the format conversion rules are used to convert the video format into the RMVB format when the video format does not belong to the RMVB format; the video size processing rules are used to compress the video size when the video size is greater than the preset video size threshold; the vector quantization rules are used to perform vector quantization when a code book exists in the surveillance video, wherein vector quantization refers to two-dimensional or even multi-dimensional quantization, and two or more amplitudes determine a quantization result.

[0135] Furthermore, each compression rule causes video quality loss after compressing the video. The video quality loss rate of the video processing method corresponding to the preset compression rule set is calculated respectively, and a corresponding weight value is assigned according to the loss rate. The weight value is assigned by the user, and can also be automatically assigned through direct association with the calculation result. For example, when the loss rate is 2%, the weight value is automatically assigned to 98, and when the loss rate is 5%, the weight value is automatically assigned to 95. The lower the video quality loss, the higher the weight value, and the more preferred the compression rule is to compress the surveillance video. The associated compression rules are sorted in sequence from high to low according to the weight value to form a preset compression rule set that is judged in series. The corresponding compression rules are matched according to the compression matching results for compression. Since the video quality loss rate of each compression rule after video compression in this embodiment is relatively fixed and belongs to the prior art, it will not be described in detail here.

[0136] In the embodiment of the present invention, the attribute parameters are compressed by matching the corresponding compression rules in the preset compression rule set according to the compression matching result to obtain the compressed monitoring video.

[0137] Step S75: If the compressed surveillance video is compatible with the target compression rate and the video quality of the compressed surveillance video meets the preset video quality condition, the compressed surveillance video is transmitted to the media server.

[0138] It should be noted that if a single compression rule cannot meet the target compression rate or when a single compression rule causes the surveillance video quality to be too low, then the various video sub-attributes in the attribute parameters are combined and matched with the preset condition rules, and then the surveillance video is compressed accordingly through one or more compression rules to obtain a surveillance video that meets the target compression rate.

[0139] Furthermore, before the compressed surveillance video is transmitted, a media server is used to test the network congestion situation. At the end of the current transmission period, the media server determines the input parameters to be input into the trained network congestion control model based on the target feature parameters corresponding to each type of video sub-attribute in the attribute parameters of the compressed surveillance video obtained during the current transmission period. The input parameters are input into the network congestion control model to obtain the next transmission period. The end time of the current transmission period is the start time of the next transmission period, so as to avoid a large number of different optical fiber remote self-healing systems from transmitting surveillance videos to the media server at the same time.

[0140] In the embodiment of the present invention, if the compressed monitoring video is adapted to the target compression rate and the video quality of the compressed monitoring video meets the preset video quality condition, the compressed monitoring video is transmitted to the media server.

[0141] In an embodiment of the present invention, when the mobile state information of the manipulator is received, the mobile state information is sent to the media server and a video segment interval acquisition instruction is generated; the media server is used to send the video segment interval acquisition instruction; when the video segment interval acquisition instruction sent by the media server is received or the mobile state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals; each monitoring video segment is spliced ​​according to the acquisition order to obtain the monitoring video; the current receiving window specification of the media server is queried, the network status data between the media server and the optical fiber remote self-healing system is detected, and the attribute parameters of the monitoring video are obtained; according to the receiving window specification, the network status data and the attribute parameters, the transmission mode of the monitoring video is determined; if the transmission mode of the monitoring video is not direct transmission, the attribute parameters are performed on the video compression operation to obtain the compressed monitoring video and transmit it to the media server. The present invention solves the technical problems that even if the existing optical fiber remote self-healing system adds a remote monitoring function, each optical fiber remote self-healing system will generate a large amount of monitoring videos due to the need for long-term monitoring, and the media server will receive a large amount of monitoring videos, resulting in high pressure on the monitoring video transmission, low transmission efficiency, high network occupancy during the transmission process, and failure to ensure the complete and effective transmission of the monitoring video. It effectively alleviates the pressure of surveillance video transmission, improves transmission efficiency, reduces network occupancy, and ensures the complete and effective transmission of surveillance video.

[0142] See also Figure 3 , Figure 3 This is a structural block diagram of a monitoring video transmission device provided in Embodiment 3 of the present invention.

[0143] The video segment acquisition module 301 is used to use the manipulator to collect multiple monitoring video segments at intervals when a video segment interval acquisition instruction sent by the media server is received or the movement state of the manipulator meets the preset acquisition state.

[0144] The video segment splicing module 302 is used to splice the monitoring video segments according to the acquisition order to obtain the monitoring video.

[0145] The video data acquisition module 303 is used to query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video.

[0146] The transmission mode determination module 304 is used to determine the transmission mode of the monitoring video according to the receiving window specification, network status data and attribute parameters.

[0147] The transmission compressed video module 305 is used to perform a video compression operation on the attribute parameters if the transmission mode of the monitoring video is not direct transmission, obtain the compressed monitoring video and transmit it to the media server.

[0148] Furthermore, it also includes:

[0149] The acquisition instruction generation module is used to send the movement status information to the media server and generate a video segment interval acquisition instruction when receiving the movement status information of the robot.

[0150] The acquisition instruction sending module is used to use the media server to send video segment interval acquisition instructions.

[0151] Furthermore, the video segment splicing module 302 includes:

[0152] The image recognition submodule is used to perform image recognition operations on each surveillance video segment in the order of acquisition, and generate corresponding video interruption pictures and video change trends.

[0153] The video merging submodule is used to splice the video interruption screen, video change trend and related monitoring video segments to obtain a spliced ​​video.

[0154] The frame-interpolation video submodule is used to perform a frame-interpolation operation on the splicing position in the spliced ​​video to obtain the frame-interpolation video.

[0155] The encoding video submodule is used to perform dynamic encoding operations on the interpolated frame video to obtain a monitoring video.

[0156] Furthermore, the video data acquisition module 303 includes:

[0157] The query window specification submodule is used to query the current receiving window specification of the media server.

[0158] The network data acquisition submodule is used to send multiple network test packets to the media server and detect the reception status of the network test packets, so as to obtain the network status data between the media server and the optical fiber remote self-healing system.

[0159] The data analysis submodule is used to perform data analysis operations on the surveillance video to obtain attribute parameters of the surveillance video.

[0160] Further, the transmission mode determination module 304 includes:

[0161] The parameter matching submodule is used to match the receiving window specifications and attribute parameters to obtain matching results.

[0162] The network status determination submodule is used to determine the network status between the media server and the optical fiber remote self-healing system according to the network status data.

[0163] A direct transmission submodule is selected to determine that the transmission mode of the surveillance video is direct transmission when the matching result and the network status meet the preset transmission conditions.

[0164] A compression transmission submodule is selected to determine that the transmission mode of the surveillance video is compression transmission when the matching result or the network condition does not meet the preset transmission conditions.

[0165] Further, the transmission compressed video module 305 includes:

[0166] The simulation operation submodule is used to perform simulation transmission operation on the receiving window specification, network status data and attribute parameters to obtain the recommended transmission size if the transmission mode of the monitoring video is not direct transmission.

[0167] The compression rate calculation submodule is used to calculate the percentage of the size of the surveillance video and the recommended transmission size to obtain the target compression rate.

[0168] The matching result submodule is used to match various video sub-attributes in the attribute parameters with corresponding preset condition rules to obtain compressed matching results.

[0169] The compression processing submodule is used to compress the attribute parameters by matching the corresponding compression rules in the preset compression rule set according to the compression matching result to obtain the compressed monitoring video.

[0170] The video transmission submodule is used to transmit the compressed monitoring video to the media server if the compressed monitoring video is adapted to the target compression rate and the video quality of the compressed monitoring video meets the preset video quality conditions.

[0171] In an embodiment of the present invention, in an embodiment of the present invention, the optical fiber remote self-healing system is connected to the media server in communication, and the optical fiber remote self-healing system is provided with a manipulator. When receiving the video segment interval acquisition instruction sent by the media server or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals; splicing each monitoring video segment according to the acquisition order to obtain the monitoring video; querying the current receiving window specification of the media server, detecting the network status data between the media server and the optical fiber remote self-healing system, and obtaining the attribute parameters of the monitoring video; determining the transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameters; if the transmission mode of the monitoring video is not direct transmission, performing a video compression operation on the attribute parameters, obtaining a compressed monitoring video and transmitting it to the media server. The present invention solves the problem that even if the existing optical fiber remote self-healing system adds a remote monitoring function, each optical fiber remote self-healing system will generate a large number of monitoring videos due to the need for long-term monitoring, and the media server will receive a large number of monitoring videos, resulting in high pressure on the transmission of the monitoring video, low transmission efficiency, high network occupancy during the transmission process, and the inability to ensure the complete and effective transmission of the monitoring video. It effectively alleviates the pressure of surveillance video transmission, improves transmission efficiency, reduces network occupancy, and ensures the complete and effective transmission of surveillance video.

[0172] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, modules and sub-modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0173] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0174] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0175] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0176] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0177] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A monitoring video transmission method, characterized in that: Applied to an optical fiber remote self-healing system, the optical fiber remote self-healing system is communicatively connected to a media server, the optical fiber remote self-healing system is provided with a manipulator, and the method comprises: When a video segment interval acquisition instruction sent by the media server is received or the movement state of the manipulator meets the preset acquisition state, the manipulator is used to collect multiple monitoring video segments at intervals; splicing the surveillance video segments according to the acquisition order to obtain the surveillance video; Query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video; Determining a transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameters; If the transmission mode of the monitoring video is not direct transmission, performing a video compression operation on the attribute parameters to obtain a compressed monitoring video and transmit it to the media server; The step of splicing the surveillance video segments according to the acquisition order to obtain the surveillance video includes: Performing image recognition operations on each of the surveillance video segments in the order of acquisition to generate corresponding video interruption images and video change trends; The video interruption screen, the video change trend and the associated monitoring video segments are spliced ​​to obtain a spliced ​​video; Performing a frame interpolation operation on the splicing position in the spliced ​​video to obtain a frame interpolation video; Performing a dynamic encoding operation on the interpolated frame video to obtain a monitoring video; If the transmission mode of the surveillance video is not direct transmission, the step of performing a video compression operation on the attribute parameters to obtain a compressed surveillance video and transmitting the compressed surveillance video to the media server includes: If the transmission mode of the monitoring video is not direct transmission, performing a simulated transmission operation on the receiving window specification, the network status data and the attribute parameters to obtain a recommended transmission size; Calculate the percentage of the size of the surveillance video and the recommended transmission size to obtain a target compression ratio; Using various video sub-attributes in the attribute parameters to match corresponding preset condition rules respectively to obtain a compressed matching result; According to the compression matching result, the attribute parameters are compressed by matching the corresponding compression rule in the preset compression rule set to obtain a compressed monitoring video; If the compressed surveillance video is adapted to the target compression rate and the video quality of the compressed surveillance video meets the preset video quality condition, transmitting the compressed surveillance video to the media server; The recommended transmission size is the size after video compression, and the size of the monitoring video is the size before video compression; The attribute parameters include video length, video size, video format, resolution, frame rate and bit rate; The preset compression rule set includes vector quantization rules, format conversion rules, resolution compression rules, bit rate compression rules, frame rate compression rules, video size processing rules and video segmentation rules.

2. The monitoring video transmission method according to claim 1, characterized in that: Before the step of using the manipulator to collect multiple surveillance video segments at intervals when receiving the video segment interval collection instruction sent by the media server or the movement state of the manipulator meets the preset collection state, the method includes: When receiving the movement state information of the manipulator, the movement state information is sent to the media server and a video segment interval acquisition instruction is generated; The media server is used to send the video segment interval collection instruction.

3. The monitoring video transmission method according to claim 1, characterized in that: The step of querying the current receiving window specification of the media server, detecting the network status data between the media server and the optical fiber remote self-healing system, and obtaining the attribute parameters of the monitoring video includes: Query the current receiving window specification of the media server; Sending a plurality of network test packets to the media server and detecting the reception status of the network test packets to obtain network status data between the media server and the optical fiber remote self-healing system; Performing a data analysis operation on the surveillance video to obtain attribute parameters of the surveillance video.

4. The monitoring video transmission method according to claim 1, characterized in that: The transmission mode includes direct transmission and compressed transmission. The step of determining the transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameter includes: Matching the receiving window specification with the attribute parameter to obtain a matching result; Determine the network status between the media server and the optical fiber remote self-healing system according to the network status data; When the matching result and the network status meet the preset transmission condition, determining that the transmission mode of the surveillance video is direct transmission; When the matching result or the network condition does not meet the preset transmission condition, it is determined that the transmission mode of the surveillance video is compressed transmission.

5. A monitoring video transmission device applied to the monitoring video transmission method according to claim 1, characterized in that: Applied to an optical fiber remote self-healing system, the optical fiber remote self-healing system is communicatively connected with a media server, the optical fiber remote self-healing system is provided with a manipulator, and the device comprises: A video segment acquisition module, configured to use the manipulator to collect multiple surveillance video segments at intervals when receiving a video segment interval acquisition instruction sent by the media server or the movement state of the manipulator meets a preset acquisition state; A video segment splicing module is used to splice each of the monitoring video segments according to the acquisition order to obtain a monitoring video; A video data acquisition module is used to query the current receiving window specification of the media server, detect the network status data between the media server and the optical fiber remote self-healing system, and obtain the attribute parameters of the monitoring video; A transmission mode determination module, used to determine the transmission mode of the monitoring video according to the receiving window specification, the network status data and the attribute parameters; The transmission compressed video module is used to perform a video compression operation on the attribute parameters if the transmission mode of the monitoring video is not direct transmission, obtain the compressed monitoring video and transmit it to the media server.

6. An electronic device, characterized in that: It comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the monitoring video transmission method as described in any one of claims 1 to 4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed, the monitoring video transmission method according to any one of claims 1 to 4 is implemented.

Images