Method for controlling smooth display of video

By monitoring network bandwidth in a security video system and dynamically adjusting video parameters, the video lag caused by limited network bandwidth and jitter is solved, the smoothness and real-timeness of the video are achieved, and the user experience is improved.

CN119052573APending Publication Date: 2024-11-29BEIJING CSVISION TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411019330.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

In the case of limited network bandwidth and deterioration of jitter, existing security video systems are difficult to ensure the smoothness and real-timeness of video, resulting in poor user experience.

Method used

By monitoring network bandwidth in front-end devices, dynamically adjusting the bitrate, resolution and frame rate of video, and buffering when necessary, ensuring video fluency and real-timeness. Specific steps include detecting bandwidth changes, adjusting video parameters step by step according to packet loss and out of order, or performing buffering to achieve stable playback of the video.

Benefits of technology

It realizes that the smoothness and real-time videos are ensured in the changing network environment, improves the user experience, and meets the video playback needs under various network conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119052573A_ABST
    Figure CN119052573A_ABST
Patent Text Reader

Abstract

The invention relates to a method for controlling smooth display of a video, and the method comprises the steps: S1, receiving network video data through front-end equipment, and monitoring a network bandwidth; s2, if the bandwidth is low, continuing S3; if the bandwidth is gradually increased, continuing S5; if the bandwidth fluctuates, indicating that the bandwidth is unstable and needs to be buffered, and continuing S7; s3, if packet loss and disorder do not occur and QoS is normal, returning to S1; otherwise, entering S4; s4, if it is detected that the degree of packet loss disorder does not reach the low-speed warning threshold value, directly returning to S1; otherwise, sequentially controlling the front-end equipment step by step to reduce the code rate, the resolution and the frame rate to try to eliminate the packet loss and disorder conditions, and then returning to S1; s5, if packet loss and disorder do not occur and QoS is normal, returning to S1; otherwise, entering S6; s6, if it is detected that the degree of packet loss out-of-order does not reach the high-speed warning threshold value, directly returning to S1; otherwise, sequentially controlling the front-end equipment to increase the code rate, the resolution and the frame rate step by step so as to try to eliminate the packet loss and disorder conditions, and then returning to S1.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the fields of security monitoring and video streaming media, and in particular to a method for controlling smooth display of a video. Background Art

[0002] As high-definition video becomes more and more popular in the security industry, the demand for network bandwidth is also increasing. However, due to factors such as network bandwidth limitations and network jitter, video playback freezes are becoming more and more common. How to ensure smooth video display and provide a better user experience when video freezes caused by limited network bandwidth and worsening network jitter?

[0003] QoS (Quality of Service) refers to the ability of a network to use various basic technologies to provide better service for specified network communications. It is a network security mechanism and a technology used to solve problems such as network delay and congestion. It is often used to evaluate the quality of network data transmission. Ensuring QoS is very important for networks with limited capacity, especially for streaming multimedia applications.

[0004] At present, security videos and ordinary streaming videos have similarities and differences. Specifically, (A) the similarity is that both are based on the video encoding algorithm of the tag standard and are played through the network; (B) the difference is that the acquisition, encoding, transmission, decoding and display of security videos are basically carried out simultaneously. Therefore, while ensuring fluency, we must also try to ensure real-time performance.

[0005] However, in today's security systems, there is a lack of software control methods to ensure video smoothness and real-time performance when network environments are abnormal (network jitter, limited bandwidth), resulting in poor user perception and experience. Summary of the invention

[0006] In view of the above technical problems in the related art, the present disclosure proposes a method for controlling smooth display of video, which can overcome the above deficiencies in the prior art.

[0007] To achieve the above technical objectives, the technical solution of the present disclosure is implemented as follows: The present disclosure provides a method for controlling smooth display of a video, comprising the following steps: S1: The front-end device receives network video data and monitors the network bandwidth; S2: If it is detected that the bandwidth is low or gradually decreases within the unit time period, continue to S3; if it is detected that the bandwidth gradually increases within the unit time period, continue to S5; if it is detected that the bandwidth fluctuates within the unit time period, it means that the bandwidth is unstable and needs to be buffered, then continue to S7; S3: If there is no packet loss or disorder and the QoS is normal, return to S1; otherwise, enter S4; S4: If the level of packet loss disorder detected does not reach the low-speed warning threshold (indicating that it has not reached the level that needs to be processed), it returns directly to S1; otherwise, it controls the front-end device to reduce the bit rate, resolution, and frame rate step by step to try to eliminate the packet loss disorder, and then returns to S1; S5: If there is no packet loss or disorder and the QoS is normal, return to S1; otherwise, enter S6; S6: If the level of packet loss disorder detected does not reach the high-speed warning threshold (indicating that it has not reached the level that needs to be processed), it returns directly to S1; otherwise, it controls the front-end device to increase the bit rate, resolution, and frame rate step by step to try to eliminate the packet loss disorder, and then returns to S1; S7: In the front-end device, the network video data is buffered and returned to S1. The buffering method of S7 can be implemented by the existing technology, or by the preferred solution of the present disclosure.

[0008] Preferably, the specific steps of S4 are: S4.1: If the degree of packet loss disorder detected does not reach the low-speed warning threshold, directly return to S1; otherwise, continue to S4.2; S4.2: First, control the front-end device to only reduce the bit rate; S4.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; otherwise, the process continues to S4.4; S4.4: Then, controlling the front-end device to further reduce the bit rate and resolution simultaneously; S4.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; otherwise, the process continues to S4.6; S4.6: Finally, continue to control the front-end device to further reduce the bit rate, resolution, and frame rate simultaneously; S4.7: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; otherwise, the process returns to S4.6.

[0009] Preferably, the specific steps of S6 are: S6.1: If the degree of packet loss disorder detected does not reach the high-speed warning threshold, directly return to S1; otherwise, continue to S6.2; S6.2: First, control the front-end device to only increase the bit rate; S6.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; otherwise, the process continues to S6.4; S6.4: Then, controlling the front-end device to further increase the bit rate and resolution simultaneously; S6.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; otherwise, the process continues to S6.6; S6.6: Finally, continue to control the front-end device to further increase the bit rate, resolution, and frame rate simultaneously; S6.7: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; otherwise, the process returns to S6.6.

[0010] Preferably, the specific manner of performing buffer processing in S7 is: S7.1: Obtain the current bit rate and frame rate from the front-end device, and allocate a buffer in the front-end device accordingly; S7.2: receiving network video data, performing IP frame sequence analysis according to the encoding type of the network video data, and sequentially placing the acquired IP frame data into the buffer; S7.3: judging the upper and lower limits of the buffer according to the operating status of the front-end device, thereby ensuring that the network video data is between the upper and lower limits of the buffer; S7.4: Control the playback of network video data according to the playback rules to achieve smooth display of the controlled video.

[0011] Preferably, in S7.2, the encoding type includes H264 / H265 / MPEG4, etc.

[0012] Preferably, the unit time period is determined according to actual needs, and is preferably 10-20 seconds.

[0013] Preferably, the front-end device is preferably a PC.

[0014] Preferably, the front-end device plays the network video data through a player.

[0015] Preferably, the low-speed warning threshold and the high-speed warning threshold are determined according to actual needs. Preferably, the low-speed warning threshold = 20%, and the high-speed warning threshold = 30%. The low-speed warning threshold is used to indicate that when the bandwidth is low, the packet loss disorder reaches a critical percentage value that needs to be processed; the high-speed warning threshold is used to indicate that when the bandwidth is high, the packet loss disorder reaches a critical percentage value that needs to be processed. Both belong to the prior art and are used to indicate the critical value that needs to process network data transmission anomalies. The present disclosure does not propose improvements to the low-speed warning threshold or the high-speed warning threshold.

[0016] Preferably, in S2, if it is detected that the bandwidth is low or gradually decreases within a unit time period, a buffer can be set and appropriately lengthened, and a video extraction strategy can be formulated to ensure that the video can be displayed smoothly without lag under low bandwidth conditions, and then continue to S3.

[0017] Preferably, in S2, if it is detected that the bandwidth gradually increases within a unit time period, a buffer zone can be set first and shortened appropriately, and a video extraction strategy can be formulated to ensure low-latency display of the video under high bandwidth conditions, and then continue to S5.

[0018] Preferably, in S2, if it is detected that the bandwidth fluctuates within a unit time period, indicating that the bandwidth is unstable, the buffer size can be flexibly adjusted according to network conditions to ensure that the low latency expectation is achieved while ensuring smooth operation, and then continue to S7.

[0019] Beneficial effects of the present disclosure: The present disclosure realizes the smooth display of real-time monitoring video based on dynamic control of timestamps, thereby being more suitable for the smooth playback of security videos with changing network conditions, and improving the video browsing experience. When the network environment of the security system is abnormal (network jitter, limited bandwidth), the present disclosure ensures the smoothness and real-time performance of the video through software control methods. The network environment adaptive algorithm adopted by the present disclosure satisfies the smooth playback and display of real-time monitoring videos under various network conditions, and improves the terminal user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 The present invention is a logic flow chart of the method for controlling smooth video display described in the present invention.

[0022] Figure 2 This is a logic flow chart of S4 described in the present disclosure.

[0023] Figure 3 It is a logic flow chart of S6 described in the present disclosure. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure.

[0025] like Figure 1-3As shown, in order to facilitate the understanding of the above technical solutions of the present disclosure, the above technical solutions of the present disclosure are described in detail below through specific usage methods.

[0026] The method for controlling smooth video display disclosed in the present invention is characterized by comprising the following steps: S1: The front-end device receives network video data and monitors the network bandwidth; S2: If it is detected that the bandwidth is low or gradually decreases within the unit time period, continue to S3; if it is detected that the bandwidth gradually increases within the unit time period, continue to S5; if it is detected that the bandwidth fluctuates within the unit time period, it means that the bandwidth is unstable and needs to be buffered, then continue to S7; S3: If there is no packet loss or disorder and the QoS is normal, return to S1; otherwise, enter S4; S4: If the degree of packet loss disorder is detected but does not reach the low-speed warning threshold, it returns directly to S1; otherwise, it controls the front-end device to reduce the bit rate, resolution, and frame rate step by step to try to eliminate the packet loss disorder, and then returns to S1; S5: If there is no packet loss or disorder and the QoS is normal, return to S1; otherwise, enter S6; S6: If the level of packet loss disorder is detected but does not reach the high-speed warning threshold, directly return to S1; otherwise, control the front-end device to increase the bit rate, resolution, and frame rate step by step to try to eliminate the packet loss disorder, and then return to S1; S7: In the front-end device, the network video data is buffered and returned to S1. The buffering method of S7 can be implemented by the existing technology, or by the preferred solution of the present disclosure. S4 and S6 are relative operations.

[0027] In one embodiment, the specific steps of S4 are: S4.1: If the degree of packet loss disorder detected does not reach the low-speed warning threshold, directly return to S1; otherwise, continue to S4.2; S4.2: First, control the front-end device to only reduce the bit rate; S4.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; otherwise, the process continues to S4.4; S4.4: Then, controlling the front-end device to further reduce the bit rate and resolution simultaneously; S4.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; otherwise, the process continues to S4.6; S4.6: Finally, continue to control the front-end device to further reduce the bit rate, resolution, and frame rate simultaneously; S4.7: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; otherwise, the process returns to S4.6.

[0028] In one embodiment, the specific steps of S6 are: S6.1: If the degree of packet loss disorder detected does not reach the high-speed warning threshold, directly return to S1; otherwise, continue to S6.2; S6.2: First, control the front-end device to only increase the bit rate; S6.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; otherwise, the process continues to S6.4; S6.4: Then, controlling the front-end device to further increase the bit rate and resolution simultaneously; S6.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; otherwise, the process continues to S6.6; S6.6: Finally, continue to control the front-end device to further increase the bit rate, resolution, and frame rate simultaneously; S6.7: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; otherwise, the process returns to S6.6.

[0029] In one embodiment, the specific manner in which S7 performs buffering is: S7.1: Obtain the current bit rate and frame rate from the front-end device, and allocate a buffer in the front-end device accordingly; S7.2: receiving network video data, performing IP frame sequence analysis according to the encoding type of the network video data, and sequentially placing the acquired IP frame data into the buffer; S7.3: judging the upper and lower limits of the buffer according to the operating status of the front-end device, thereby ensuring that the network video data is between the upper and lower limits of the buffer; S7.4: Control the playback of network video data according to the playback rules to achieve smooth display of the controlled video.

[0030] In one embodiment, in S7.2, the encoding type includes H264 / H265 / MPEG4, etc.

[0031] In one embodiment, the unit time period is determined according to actual needs, and is preferably 10-20 seconds.

[0032] In one embodiment, the front-end device is preferably a PC.

[0033] In one embodiment, the front-end device plays the network video data through a player.

[0034] In a certain embodiment, the low-speed warning threshold and the high-speed warning threshold are determined according to actual needs. Preferably, the low-speed warning threshold = 20%, and the high-speed warning threshold = 30%. The low-speed warning threshold is used to indicate that when the bandwidth is low, the packet loss disorder reaches a critical percentage value that needs to be processed; the high-speed warning threshold is used to indicate that when the bandwidth is high, the packet loss disorder reaches a critical percentage value that needs to be processed. Both belong to the prior art and are used to indicate the critical value that needs to handle network data transmission anomalies. The present disclosure does not propose improvements to the low-speed warning threshold or the high-speed warning threshold.

[0035] In one embodiment, in S2, if it is detected that the bandwidth is low or gradually decreases within a unit time period, a buffer can be set and appropriately lengthened, and a video extraction strategy can be formulated to ensure that the video can be displayed smoothly without freezing under low bandwidth conditions, and then continue to S3. This can also be implemented using existing technologies.

[0036] In one embodiment, in S2, if it is detected that the bandwidth gradually increases within a unit time period, a buffer can be set and shortened appropriately, and a video extraction strategy can be formulated to ensure that the video can be displayed with low latency under high bandwidth conditions, and then continue to S5. This can also be implemented using existing technologies.

[0037] In one embodiment, in S2, if it is detected that the bandwidth fluctuates within a unit time period, indicating that the bandwidth is unstable, the buffer size can be flexibly adjusted according to the network conditions to ensure that the low latency expectation is achieved while ensuring smoothness, and then continue to S7. This can also be implemented using existing technologies.

[0038] In summary, through the unique design of the present disclosure, the present disclosure realizes the smooth display of real-time monitoring video based on dynamic control of timestamps, thereby being more suitable for the smooth playback of security videos with changing network conditions, and improving the video browsing experience. When the network environment of the security system is abnormal (network jitter, bandwidth limitation), the present disclosure ensures the smoothness and real-time performance of the video through software control methods. The network environment adaptive algorithm adopted by the present disclosure satisfies the smooth playback and display of real-time monitoring videos under various network conditions, and improves the terminal user experience.

[0039] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure should be included in the protection scope of the present disclosure.

Claims

1. A method for controlling smooth video display, characterized in that: The following steps are involved: S1: The front-end device receives network video data and monitors the network bandwidth; S2: If it is detected that the bandwidth is low or gradually decreases within the unit time period, continue to S3; if it is detected that the bandwidth gradually increases within the unit time period, continue to S5; if it is detected that the bandwidth fluctuates within the unit time period, it means that the bandwidth is unstable and needs to be buffered, then continue to S7; S3: If there is no packet loss or disorder and the QoS is normal, return to S1; Otherwise, go to S4; S4: If the degree of packet loss disorder detected does not reach the low-speed warning threshold, directly return to S1; Otherwise, the front-end device is controlled to reduce the bit rate, resolution, and frame rate step by step to try to eliminate the packet loss disorder, and then return to S1; S5: If there is no packet loss or disorder and the QoS is normal, return to S1; otherwise, enter S6; S6: If the degree of packet loss disorder detected does not reach the high-speed warning threshold, directly return to S1; Otherwise, the front-end device is controlled to increase the bit rate, resolution, and frame rate step by step to try to eliminate packet loss and disorder, and then return to S1; S7: In the front-end device, the network video data is buffered and returned to S1.

2. The method according to claim 1, characterized in that The specific steps of S4 are: S4.1: If the degree of packet loss disorder detected does not reach the low-speed warning threshold, directly return to S1; otherwise, continue to S4.2; S4.2: First, control the front-end device to only reduce the bit rate; S4.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; Otherwise, continue with S4.4; S4.4: Then, controlling the front-end device to further reduce the bit rate and resolution simultaneously; S4.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; Otherwise, continue with S4.6; S4.6: Finally, continue to control the front-end device to further reduce the bit rate, resolution, and frame rate simultaneously; S4.7: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; Otherwise, return to S4.

6.

3. The method according to claim 1, characterized in that The specific steps of S6 are: S6.1: If the degree of packet loss disorder detected does not reach the high-speed warning threshold, directly return to S1; otherwise, continue to S6.2; S6.2: First, control the front-end device to only increase the bit rate; S6.3: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate and the process returns to S1; otherwise, the process continues to S6.4; S6.4: Then, controlling the front-end device to further increase the bit rate and resolution simultaneously; S6.5: If the packet loss disorder phenomenon of the network disappears or decreases, the transmission is performed according to the current bit rate and resolution, and the process returns to S1; otherwise, the process continues to S6.6; S6.6: Finally, continue to control the front-end device to further increase the bit rate, resolution, and frame rate simultaneously; S6.7: If the packet loss disorder phenomenon of the network disappears or decreases, transmission is performed according to the current bit rate, resolution, and frame rate, and the process returns to S1; otherwise, the process returns to S6.

6.

4. The method according to claim 1, characterized in that: The specific method of the buffering process in S7 is as follows: S7.1: Obtain the current bit rate and frame rate from the front-end device, and allocate a buffer in the front-end device accordingly; S7.2: receiving network video data, performing IP frame sequence analysis according to the encoding type of the network video data, and sequentially placing the acquired IP frame data into the buffer; S7.3: judging the upper and lower limits of the buffer according to the operating status of the front-end device, thereby ensuring that the network video data is between the upper and lower limits of the buffer; S7.4: Control the playback of network video data according to the playback rules to achieve smooth display of the controlled video.

5. The method according to claim 4, characterized in that In the S7.2, the encoding type includes H264 / H265 / MPEG4.

6. The method according to claim 1, characterized in that The front-end device is a PC, and the unit time period is 10-20 seconds.

7. The method according to claim 1, characterized in that The low-speed warning threshold = 20%, the high-speed warning threshold = 30%; the low-speed warning threshold is used to indicate that when the bandwidth is low, the packet loss disorder reaches the critical percentage that needs to be processed; the high-speed warning threshold is used to indicate that when the bandwidth is high, the packet loss disorder reaches the critical percentage that needs to be processed.

8. The method according to claim 1, characterized in that In S2, if it is detected that the bandwidth is low or gradually decreases within a unit time period, a buffer is first set and appropriately lengthened, and a video extraction strategy is formulated to ensure that the video can be displayed smoothly without lag under low bandwidth conditions, and then continue to S3.

9. The method according to claim 1, characterized in that: In S2, if it is detected that the bandwidth gradually increases within a unit time period, a buffer is first set and shortened appropriately, and a video extraction strategy is formulated to ensure that the video can be displayed with low latency under high bandwidth conditions, and then continue to S5.

10. The method according to claim 1, characterized in that In S2, if it is detected that the bandwidth fluctuates within a unit time period, indicating that the bandwidth is unstable, the buffer size is flexibly adjusted according to the network conditions to ensure that the low latency expectation is achieved while ensuring smoothness, and then continue to S7.