Camera video access optimization method

Abstract

The invention discloses a camera video access optimization method, relates to the technical field of wireless communication, and solves the technical problems that the size of a plug-flow video affects the plug-flow effect, the bandwidth delay is too large due to the fact that the plug-flow video is too large, and user watching is further affected. The method comprises the following steps: acquiring a current network transmission bandwidth, analyzing by synthesizing the current network transmission bandwidth, classifying camera videos, analyzing and processing different camera videos obtained by classification, performing segmentation processing in combination with slicing duration corresponding to the videos in the analysis process, and performing transmission analysis on segmented videos obtained by segmentation. According to the method, the corresponding codec specifications are synthesized for comprehensive flow pushing analysis, on one hand, reasonable transmission segmentation processing can be carried out according to the network bandwidth, on the other hand, flow pushing can be carried out by adapting to the processing conditions of different codec, and the overall flow pushing quality and the flow pushing efficiency are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless communications, and in particular to a camera video access optimization method. Background Art

[0002] With the widespread application of mobile communication technology, there is a large demand for video transmission or live streaming in the 5G wireless communication environment.

[0003] According to Chinese patent application number CN202310929822.7, a method for optimizing the video streaming experience in a 5G environment is disclosed, which overcomes the problems of freezes and black screens in video transmission or live streaming caused by unstable transmission rate in a 5G wireless communication environment in the prior art, and includes the following steps: customizing ABR and reading the bit rate parameter file; calculating the current network throughput and the current bit rate upper limit parameter, and updating the bit rate parameter file; determining whether there is a new bit rate parameter, and determining the bit rate parameter used for video streaming based on the judgment result; referencing ABR in DASH and initiating an HTTP request.

[0004] When some existing camera videos are connected to streaming, the overall video streaming will be affected by many factors. At the same time, during the streaming process, the size of the streaming video also determines the effect of the streaming. If the streaming video is too large, it will cause a large bandwidth delay, which will further affect the user's viewing experience. Summary of the invention

[0005] In view of the deficiencies in the prior art, the present invention provides a camera video access optimization method, which solves the problem that the size of the pushed streaming video affects the streaming effect, and that too large a pushed streaming video causes excessive bandwidth delay, further affecting user viewing.

[0006] To achieve the above objectives, the present invention is implemented by the following technical scheme: a camera video access optimization method, the method specifically comprising the following steps: Step 1: Capture the camera video, obtain the bit rate of the captured video, compare the video bit rates, classify the camera video into high bit rate video and low bit rate video, and generate video classification information; Step 2: Process the high bit rate video in the video classification information, determine the segmentation standard according to the difference of the single frame images of the video, and segment the high bit rate video according to the segmentation standard to obtain the segmented video; Step 3: Analyze the obtained segmented video, analyze the slice duration corresponding to the segmented video, and perform secondary segmentation processing on the segmented video according to the standard duration, and generate secondary segmentation information at the same time, and then use the secondary segmentation information to access the push stream to generate push stream information; Step 4: Process the low-bitrate video in the video classification information, analyze the transmission speed, and periodically monitor the transmission speed to determine the transmission standard. At the same time, combine the specifications of the codec to transmit and push the stream, and generate the push stream information.

[0007] As a further solution of the present invention: the specific method of classifying the camera video in step 1 to obtain high bit rate video and low bit rate video is: Collect camera video, obtain the video bit rate corresponding to the camera video, and obtain the current network transmission bandwidth. If the video bit rate is greater than the current network transmission bandwidth, the corresponding camera video is classified as a high-bitrate video. Conversely, if the video bit rate is less than the current network transmission bandwidth, the corresponding camera video is classified as a low-bitrate video, and video classification information is generated.

[0008] As a further solution of the present invention: the specific method of segmenting the high bit rate video according to the segmentation standard in step 2 to obtain the segmented video is: The high-bitrate video in the video classification information is obtained, and then the high-bitrate video is split into single frames. At the same time, the split single-frame images are analyzed, and the differences between two adjacent frames are compared. If there is no difference between the two adjacent frames, the corresponding two frames are combined. Otherwise, if there is a difference between the two adjacent frames, the difference image is used for segmentation, and the corresponding segmentation node is generated. At the same time, all the images before the segmentation node are combined to obtain the segmented video. In this way, the high-bitrate video is segmented to obtain multiple groups of segmented videos, and the segmented videos are labeled as i, and i=1, 2, ..., j, where j represents the number of segmented videos.

[0009] As a further solution of the present invention: the specific method of analyzing the obtained segmented video in step 3 is: Get all the segmented videos i, and get the slice duration corresponding to the segmented video i as Ti, then get the standard duration, and compare the slice duration Ti of the segmented video with the standard duration. If the slice duration Ti of the segmented video is greater than the standard duration, a secondary segmentation signal is generated. Otherwise, if the slice duration Ti of the segmented video is less than the standard duration, a direct access signal is generated, and the segmented video is directly accessed and pushed, and the push information is generated.

[0010] As a further solution of the present invention: the specific method of analyzing the secondary segmentation processing signal in step 3 is: The segmented video corresponding to the secondary segmentation signal is obtained and recorded as the video to be analyzed a, and a=1, 2, ..., b, where b represents the number of videos to be analyzed, and the video to be analyzed a is secondary segmented according to the standard duration to obtain two video segments to be analyzed, recorded as a1 and a2, and the minimum slice duration is obtained as Tmin, and the minimum slice duration Tmin is compared with the slice duration Ta2 corresponding to the video segment a2 to be analyzed.

[0011] As a further solution of the present invention: the specific method of comparing the minimum slice duration Tmin with the slice duration Ta2 corresponding to the video segment a2 to be analyzed in step 3 is: If the slice duration Ta2 of the video segment a2 to be analyzed is greater than the minimum slice duration Tmin, it will not be processed and will be directly connected to the streaming. Conversely, if the slice duration Ta2 of the video segment a2 to be analyzed is less than the minimum slice duration Tmin, the video a to be analyzed will be re-segmented based on the minimum slice duration Tmin as the segmentation standard, and will be directly connected to the streaming, and the streaming information will be generated at the same time.

[0012] As a further solution of the present invention: the specific method of processing the low bit rate video to generate streaming information in step 4 is: The definition corresponding to the low-bit-rate video is obtained, and the current transmission speed is obtained. At the same time, the current transmission speed is monitored and analyzed with t as the time period, and the transmission speed at which the current transmission speed is stable within the time period t is obtained and recorded as the standard speed. Then the specifications of the codec are obtained, and the corresponding upload speed is obtained according to the definition corresponding to the low-bit-rate video. At the same time, the upload speed is compared with the standard speed. If the upload speed is greater than the standard speed, no processing is performed, and the low-bit-rate video is directly connected to the push stream, and the push stream information is generated. On the contrary, if the upload speed is less than the standard speed, the low-bit-rate video is segmented based on the upload speed to obtain segmented videos, and the segmented videos are connected to the push stream, and the push stream information is generated.

[0013] The present invention provides a camera video access optimization method. Compared with the prior art, it has the following beneficial effects: The present invention analyzes the bit rate corresponding to the camera video and analyzes it in combination with the current network transmission bandwidth, classifies the camera video, and then analyzes and processes the different camera videos obtained by classification. In the process of analysis, segmentation is performed in combination with the slice duration corresponding to the video, and transmission analysis is performed on the segmented videos obtained by segmentation. Comprehensive streaming analysis is performed in combination with the corresponding codec specifications. On the one hand, reasonable transmission segmentation processing can be performed according to the network bandwidth, and on the other hand, it can adapt to the processing conditions of different codecs for streaming, thereby improving the overall streaming quality and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a method diagram of the present invention; Figure 2 This is the codec specification diagram of the present invention; Figure 3 This is the third-party SDK video docking flow chart of the present invention; Figure 4 This is the nginx push-pull stream service access flow chart of the present invention. DETAILED DESCRIPTION

[0015] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0016] See also Figures 1 to 4 , the present application provides a camera video access optimization method, the method specifically comprises the following steps: Step 1: Capture the camera video, obtain the bit rate of the captured video, and compare the video bit rates to classify the camera video into high bit rate video and low bit rate video, and generate video classification information at the same time. The specific classification method is as follows: The camera video is obtained by collecting the video through the camera, and the video bit rate corresponding to the camera video is obtained. The video bit rate is expressed as the number of data bits transmitted per unit time during data transmission. The general unit is kbps, that is, kilobits per second. A more popular understanding is the sampling rate. The larger the sampling rate per unit time, the higher the accuracy, and the closer the processed file is to the original file. At the same time, the current network transmission bandwidth is obtained, and the video bit rate is compared with the current network transmission bandwidth. If the video bit rate is greater than the current network transmission bandwidth, the corresponding camera video is classified as a high bit rate video. Conversely, if the video bit rate is less than the current network transmission bandwidth, the corresponding camera video is classified as a low bit rate video, and video classification information is generated at the same time.

[0017] Step 2: Process the high bit rate video in the video classification information, and determine the segmentation standard according to the difference of the single frame image of the video, and segment the high bit rate video according to the segmentation standard to obtain the segmented video, and the specific method of obtaining the segmented video is: The high-bitrate video in the video classification information is obtained, and then the high-bitrate video is split into single frames. Specifically, the continuous video stream is decomposed into a series of static image frames, and the split single-frame images are analyzed at the same time. The difference between two adjacent frames is compared, and the difference comparison here is specifically similarity matching. If there is no difference between the two adjacent frames, the corresponding two frames are combined. Conversely, if there is a difference between the two adjacent frames, the difference images are segmented and the corresponding segmentation nodes are generated. The existence of the difference here indicates that the similarity between the two adjacent frames is greater than a preset value, and the specific value of the preset value is set by the operator. This segmentation node marks a transition point in the video content, such as scene switching or the occurrence of important actions. At the same time, all images before the segmentation node are combined to obtain a segmented video. In this way, the high-bitrate video is segmented to obtain multiple groups of segmented videos, and the segmented videos are labeled as i, and i=1, 2, ..., j, where j represents the number of segmented videos.

[0018] For example, the duration of a high-bitrate video is 30 seconds. First, the high-bitrate video is split into single frames to obtain static image frames, and then the static image frames are compared and analyzed for similarity in sequence. After comparison, it is found that there is a difference in the static image frame at the 3rd second. Therefore, the high-bitrate video is segmented using the 3rd second static image frame as the segmentation node to obtain a segmented video. The duration of the segmented video is 3 seconds. In this way, the high-bitrate videos are analyzed one by one.

[0019] Step 3: Analyze the obtained segmented video, analyze the slice duration corresponding to the segmented video, and perform secondary segmentation processing on the segmented video with the standard duration, and generate secondary segmentation information at the same time, and then use the secondary segmentation information to access the push stream to generate the push stream information, and the specific method of generating the secondary segmentation information is: Get all the segmented videos i, and get the slice duration corresponding to the segmented video i as Ti, where the slice duration Ti represents the video duration of the corresponding segmented video, then get the standard duration, and the standard duration represents the optimal transmission under this slice duration, and compare the slice duration Ti of the segmented video with the standard duration. If the slice duration Ti of the segmented video is greater than the standard duration, it means that the segmented video needs to be segmented twice and a secondary segmentation signal is generated. On the contrary, if the slice duration Ti of the segmented video is less than the standard duration, it means that the segmented video does not need to be segmented twice and a direct access signal is generated. In this case, the segmented video can be directly accessed and pushed, and push information is generated at the same time. Then, the generated secondary segmentation signal is processed to obtain the segmented video corresponding to the secondary segmentation signal and record it as the video to be analyzed a, where a=1, 2, ..., b, where b represents the number of videos to be analyzed, and the video to be analyzed is secondary segmented with the standard duration to obtain two video segments to be analyzed, recorded as a1 and a2. Specifically, the video segments to be analyzed obtained after secondary segmentation with the standard duration have a slicing duration of one segment being the standard duration, and a slicing duration of the other segment being the remaining duration after the standard duration is removed from the video to be analyzed, which is equivalent to the video segment to be analyzed a2 in the present application. At the same time, the minimum slicing duration is obtained, recorded as Tmin, and the minimum slicing duration Tmin is compared with the slicing duration Ta2 corresponding to the video segment to be analyzed a2; and the value of the minimum slicing duration is set by the operator. If the video slicing duration is too short (for example, the slicing length is 1 second), the player has to request the CDN every second, which consumes a lot of player and CDN resources.

[0020] If the slice duration Ta2 of the video segment a2 to be analyzed is greater than the minimum slice duration Tmin, it will not be processed and will be directly connected to the streaming. On the contrary, if the slice duration Ta2 of the video segment a2 to be analyzed is less than the minimum slice duration Tmin, the video a to be analyzed will be re-segmented based on the minimum slice duration Tmin as the segmentation standard, and will be directly connected to the streaming, and the streaming information will be generated at the same time. Specifically, the segmentation here results in two groups of segmented videos.

[0021] For example, the slice duration of the video segment a2 to be analyzed is less than the minimum slice duration. Therefore, multiple requests to the CDN are required during subsequent streaming. This streaming method will cause excessive consumption of CDN resources, which will further affect the overall upload efficiency. In this case, the video to be analyzed will be segmented according to the minimum slice duration. For example, if the minimum slice duration is 4s, two groups of segmented videos will be obtained after segmentation, and the slice duration of one group of segmented videos is 4s, while the slice duration of the other group is the remaining duration.

[0022] Step 4: Process the low-bitrate video in the video classification information, analyze the transmission speed, and periodically monitor the transmission speed to determine the transmission standard. At the same time, combine the specifications of the codec to transmit and push the stream, and generate the corresponding push stream information. The specific method of generating the push stream information is as follows: The definition corresponding to the low bit rate video is obtained, and the current transmission speed is obtained. At the same time, the current transmission speed is monitored and analyzed with t as the time period. The transmission speed at which the current transmission speed is stable within the time period t is obtained and recorded as the standard speed. The stability here means that the transmission speed variation range is within the preset value range. At the same time, the specific value of the preset value is set by the operator. Then the codec specifications are obtained, and the codec specifications here are as shown in the attached Figure 2As shown, H.264, VP8, VP9, ​​and AV1 represent different codec models, and the corresponding upload speed is obtained according to the clarity corresponding to the low-bit rate video, and the upload speed is compared with the standard speed. If the upload speed is greater than the standard speed, no processing is performed, and the low-bit rate video is directly connected to the push stream, and the push stream information is generated. On the contrary, if the upload speed is less than the standard speed, the low-bit rate video is segmented based on the upload speed to obtain segmented videos, and the segmented videos are connected to the push stream, and the push stream information is generated.

[0023] Assume that the ideal upload speed calculated based on the SD video quality and the selected H.264 codec is 2Mbps. If the monitored upload speed is greater than or equal to the standard speed of 2.5Mbps, the system will not perform additional processing, directly access the low-bitrate video and generate the corresponding streaming information. This means that the current network conditions are good enough to support barrier-free video playback. However, if the monitored upload speed is less than the standard speed of 2.5Mbps, such as only 1.8Mbps, the system will take adaptive measures. Specifically, the actual upload speed will be used as the new standard to segment the low-bitrate video to reduce the demand for data transmission. The segmented video segments are then connected to the streaming, and the streaming information is generated at the same time.

[0024] Some of the data in the above formulas are dimensionless and numerically calculated. Meanwhile, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.

[0025] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A camera video access optimization method, characterized in that: The method specifically comprises the following steps: Step 1: Capture the camera video, obtain the bit rate of the captured video, compare the video bit rates, classify the camera video into high bit rate video and low bit rate video, and generate video classification information; Step 2: Process the high bit rate video in the video classification information, determine the segmentation standard according to the difference of the single frame images of the video, and segment the high bit rate video according to the segmentation standard to obtain the segmented video; Step 3: Analyze the obtained segmented video, analyze the slice duration corresponding to the segmented video, and perform secondary segmentation processing on the segmented video according to the standard duration, and generate secondary segmentation information at the same time, and then use the secondary segmentation information to access the push stream to generate push stream information; Step 4: Process the low-bitrate video in the video classification information, analyze the transmission speed, and periodically monitor the transmission speed to determine the transmission standard. At the same time, combine the specifications of the codec to transmit and push the stream, and generate the push stream information.

2. The camera video access optimization method according to claim 1, characterized in that: The specific method of classifying the camera video to obtain high bit rate video and low bit rate video in step 1 is: Collect camera video, obtain the video bit rate corresponding to the camera video, and obtain the current network transmission bandwidth. If the video bit rate is greater than the current network transmission bandwidth, the corresponding camera video is classified as a high-bitrate video. Conversely, if the video bit rate is less than the current network transmission bandwidth, the corresponding camera video is classified as a low-bitrate video, and video classification information is generated.

3. The camera video access optimization method according to claim 1, characterized in that: The specific method of segmenting the high bit rate video according to the segmentation standard in step 2 to obtain the segmented video is: Get the high-bitrate video in the video classification information, then split the high-bitrate video into single frames, analyze the split single-frame images, compare the differences between two adjacent frames, and if there is no difference between the two adjacent frames, combine the corresponding two frames. Otherwise, if there is a difference between the two adjacent frames, segment them with the difference images, generate the corresponding segmentation nodes, and combine all the images before the segmentation nodes to obtain the segmented video; In this way, the high bit rate video is segmented to obtain multiple groups of segmented videos, and the segmented videos are labeled as i, where i=1, 2, ..., j, where j represents the number of segmented videos.

4. The camera video access optimization method according to claim 1, characterized in that: The specific method of analyzing the obtained segmented video in step 3 is: Get all the segmented videos i, and get the slice duration corresponding to the segmented video i as Ti, then get the standard duration, and compare the slice duration Ti of the segmented video with the standard duration. If the slice duration Ti of the segmented video is greater than the standard duration, a secondary segmentation signal is generated. Otherwise, if the slice duration Ti of the segmented video is less than the standard duration, a direct access signal is generated, and the segmented video is directly accessed and pushed, and the push information is generated.

5. The camera video access optimization method according to claim 4, characterized in that: The specific method of analyzing the secondary segmentation processing signal in step 3 is: The segmented video corresponding to the secondary segmentation signal is obtained and recorded as the video to be analyzed a, and a=1, 2, ..., b, where b represents the number of videos to be analyzed, and the video to be analyzed a is secondary segmented according to the standard duration to obtain two video segments to be analyzed, recorded as a1 and a2, and the minimum slice duration is obtained as Tmin, and the minimum slice duration Tmin is compared with the slice duration Ta2 corresponding to the video segment a2 to be analyzed.

6. The camera video access optimization method according to claim 5, characterized in that: The specific method of comparing the minimum slice duration Tmin with the slice duration Ta2 corresponding to the video segment a2 to be analyzed in step 3 is: If the slice duration Ta2 of the video segment a2 to be analyzed is greater than the minimum slice duration Tmin, it will not be processed and will be directly connected to the streaming. Conversely, if the slice duration Ta2 of the video segment a2 to be analyzed is less than the minimum slice duration Tmin, the video a to be analyzed will be re-segmented based on the minimum slice duration Tmin as the segmentation standard, and will be directly connected to the streaming, and the streaming information will be generated at the same time.

7. The camera video access optimization method according to claim 1, characterized in that: The specific method of processing the low bit rate video to generate streaming information in step 4 is: The definition corresponding to the low-bit-rate video is obtained, and the current transmission speed is obtained. At the same time, the current transmission speed is monitored and analyzed with t as the time period, and the transmission speed at which the current transmission speed is stable within the time period t is obtained and recorded as the standard speed. Then the specifications of the codec are obtained, and the corresponding upload speed is obtained according to the definition corresponding to the low-bit-rate video. At the same time, the upload speed is compared with the standard speed. If the upload speed is greater than the standard speed, it will not be processed, and the low-bit-rate video will be directly connected to the push stream, and the push stream information will be generated. On the contrary, if the upload speed is less than the standard speed, the low-bit-rate video will be segmented based on the upload speed to obtain segmented videos, and the segmented videos will be connected to the push stream, and the push stream information will be generated.

Images