Bank remote monitoring video acquisition system and method thereof

Abstract

The invention relates to the technical field of telecommunication, in particular to a bank remote monitoring video acquisition system and method, and the method comprises the steps: obtaining the maximum time delay, the jitter value and the packet loss rate during the transmission of a bank remote monitoring video within a first preset time period before the current moment; according to the maximum time delay, the jitter value and the packet loss probability, determining the instability degree of the network in the first preset time period; determining a first adjustment redundancy rate at the current moment; and determining a real-time video code rate of the current moment according to the CPU total load and the CPU load of all moments in the current moment and the first predetermined time period, and the first adjustment redundancy rates of all moments in the current moment and the first predetermined time period, and performing forward error correction processing on the remote monitoring video transmitted at the current moment based on the first adjustment redundancy rates and the real-time video code rate. According to the invention, the setting accuracy of the redundancy rate parameter is improved, and the smooth video transmission effect is further optimized.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of electric communication technology, in particular to a bank remote monitoring video acquisition system and method thereof. BACKGROUND

[0002] In the financial security system, the bank monitoring system as the core infrastructure of risk prevention and control and event tracing has strict requirements on the real-time, continuity and stability of video transmission. The network environment of the bank monitoring scene is often complex and changeable, and some branches and self-service sites are located in remote areas, relying on broadband or wireless private network to transmit data. The data transmission between the core room and each site needs to pass through multiple network links, and problems such as link congestion and device forwarding delay often occur, which will all cause data packet loss. Video stream is composed of continuous data packets, and even a small amount of packet loss can cause picture freezing, screen flashing or buffer interruption.

[0003] In some scenarios, forward error correction technology can effectively reduce the video freezing frequency and ensure transmission continuity by embedding redundant information in the data packet to enable the receiving end to recover the lost data without requesting retransmission. However, the current mainstream forward error correction implementation scheme has technical limitations: the adjustment of its redundancy rate is only based on unstable state parameters such as the current network packet loss rate and delay, and lacks consideration of the system resource carrying capacity. The addition and analysis of redundant information need to occupy the central processing unit (CPU) computing power of the terminal, and the higher the redundancy rate, the larger the data transmission volume, which not only consumes more bandwidth resources, but also increases the CPU load. When the network fluctuation intensifies, the traditional method will blindly increase the redundancy rate to resist packet loss, but it does not assess whether the current CPU can bear the additional computing pressure. If the CPU load is close to the upper limit, too high a redundancy rate will increase the data analysis delay, which in turn causes new video freezing; if the redundancy rate is not adjusted enough, it cannot effectively resist the impact of packet loss. Therefore, the traditional method only focuses on the network state and ignores the adjustment of the system resource matching, resulting in insufficient precision of the redundancy rate parameter setting, and ultimately failing to achieve the ideal smooth video transmission effect, which is difficult to meet the requirements of bank monitoring on transmission quality. SUMMARY

[0004] In order to solve the technical problem of insufficient precision of the redundancy rate parameter setting, which in turn leads to poor smooth video transmission effect, the purpose of the present application is to provide a bank remote monitoring video acquisition system and method thereof.

[0005] To solve the above technical problems, the technical solutions adopted are as follows:

[0006] In a first aspect, the embodiments of the present application provide a bank remote monitoring video acquisition method, comprising: obtaining a maximum delay, a jitter value and a packet loss rate of bank remote monitoring video transmission in a first predetermined period before a current time; determining a network instability degree in the first predetermined period according to the maximum delay, the jitter value and the packet loss rate; determining a first adjustment redundancy rate of the current time according to a CPU total load of all times in the first predetermined period, a CPU load of the current time for remote monitoring video transmission and the network instability degree; determining a real-time video code rate of the current time according to the CPU total load of all times in the first predetermined period, the CPU load, the first adjustment redundancy rate of each time in the first predetermined period and the current time, and performing forward error correction processing on the remote monitoring video transmitted at the current time based on the first adjustment redundancy rate and the real-time video code rate.

[0007] Optionally, the determining of the network instability degree in the first predetermined period according to the maximum delay, the jitter value and the packet loss rate comprises: determining a network congestion degree in the first predetermined period according to the maximum delay and the jitter value; and determining the network instability degree in the first predetermined period according to the packet loss rate and the network congestion degree.

[0008] Optionally, the determining of the network congestion degree in the first predetermined period according to the maximum delay and the jitter value comprises: obtaining a maximum delay of the bank remote monitoring video transmission at the current time and a maximum jitter value in the jitter values in all the first predetermined periods before the current time, and a first predetermined period adjacent to the current time; and determining the network congestion degree in the first predetermined period adjacent to the current time according to the maximum delay, the jitter values in the first predetermined period and the maximum jitter value.

[0009] Optionally, the determining of the network instability degree in the first predetermined period according to the packet loss rate and the network congestion degree comprises: determining a maximum packet loss rate in the packet loss rates in all the first predetermined periods before the current time, and a maximum network congestion degree in the network congestion degrees in all the first predetermined periods before the current time; and determining the network instability degree in the first predetermined period adjacent to the current time according to the packet loss rate and the network congestion degree of the first predetermined period adjacent to the current time before the current time, the maximum packet loss rate and the maximum network congestion degree.

[0010] Optionally, the first adjustment redundancy rate of the current time is determined according to the total CPU load of the current time and all times within the first predetermined period, the CPU load of the current time when the remote monitoring video transmission is performed, and the instability degree of the network within the first predetermined period, comprising: determining a first increasing degree of the redundancy rate of the current time according to the total CPU load of the current time and all times within the first predetermined period, the CPU load of the current time when the remote monitoring video transmission is performed, and the instability degree of the network within the first predetermined period; adjusting the initial redundancy rate of the current time when the remote monitoring video transmission is performed based on the first increasing degree of the redundancy rate, to obtain a second adjustment redundancy rate; determining a second increasing degree of the redundancy rate of the current time to meet future changes according to the second adjustment redundancy rate of the current time and the second adjustment redundancy rates of all times within the second predetermined period before the current time; and adjusting the second adjustment redundancy rate of the current time again by using the second increasing degree, to obtain the first adjustment redundancy rate of the current time.

[0011] Optionally, the first increasing degree of the redundancy rate of the current time is determined according to the total CPU load of the current time and all times within the first predetermined period, the CPU load of the current time when the remote monitoring video transmission is performed, and the instability degree of the network within the first predetermined period, comprising: determining a minimum total CPU load in the total CPU load of the current time and all times within the first predetermined period; and determining the first increasing degree of the redundancy rate of the current time according to the total CPU load of the current time, the minimum total CPU load, the CPU load, and the instability degree of the network within the first predetermined period.

[0012] Optionally, the second increasing degree of the redundancy rate of the current time to meet future changes is determined according to the second adjustment redundancy rate of the current time and the second adjustment redundancy rates of all times within the second predetermined period before the current time, comprising: determining a first difference value between the second adjustment redundancy rates of adjacent times of the current time and all times within the second predetermined period before the current time, the first difference value being a difference value between the second adjustment redundancy rate of a later time and the second adjustment redundancy rate of an earlier time; determining a first number of first difference values greater than a preset value and a second number of all first difference values; determining a second difference value between the second adjustment redundancy rate of the current time and the second adjustment redundancy rate of the earliest time of the second predetermined period; and determining the second increasing degree of the redundancy rate of the current time to meet future changes according to the first number, the second number, and the second difference value.

[0013] Optionally, the determining the real-time video code rate of the current time according to the total CPU load of all times in the first predetermined period, the CPU load of the current time, and the first adjustment redundancy rate of each time in the first predetermined period comprises: determining a video code rate reduction degree of the current time for remote monitoring video transmission according to the total CPU load of all times in the first predetermined period, the CPU load of the current time for remote monitoring video transmission, and the first adjustment redundancy rate of each time in the first predetermined period; and adjusting the video code rate reference value based on the video code rate reduction degree to obtain the real-time video code rate of the current time.

[0014] Optionally, the determining the video code rate reduction degree of the current time for remote monitoring video transmission according to the total CPU load of all times in the first predetermined period, the CPU load of the current time for remote monitoring video transmission, and the first adjustment redundancy rate of each time in the first predetermined period comprises: determining a minimum total CPU load in the total CPU load of all times in the first predetermined period and a maximum adjustment redundancy rate in the first adjustment redundancy rate of each time in the first predetermined period; and determining the video code rate reduction degree of the current time for remote monitoring video transmission according to the total CPU load of the current time, the minimum total CPU load, the CPU load, the maximum adjustment redundancy rate, and the first adjustment redundancy rate of the current time.

[0015] In a second aspect, an embodiment of the present application provides a bank remote monitoring video acquisition system, comprising: a processor and a memory; wherein the memory is used to store a computer program which can run on the processor; and the processor is used to execute the program stored in the memory to realize the steps of the bank remote monitoring video acquisition method mentioned in the first aspect.

[0016] The application has the following beneficial effects: according to the basic information feedback of the maximum time delay, jitter value and packet loss rate during the transmission of remote monitoring video frames, the embodiment of the application analyzes the stability of the network during video transmission, can more accurately capture the historical law and current situation of network fluctuations, and provides reliable data support for redundancy rate adjustment. Further, the application takes the CPU load into account in the consideration of redundancy rate adjustment. By combining the total CPU load in the current moment and the first predetermined period, the exclusive CPU load during video transmission, and determining the first adjustment redundancy rate on the basis of evaluating the degree of network instability, the problem of CPU overload caused by blindly increasing the redundancy rate in the traditional scheme is effectively avoided. Both the redundancy can be moderately increased to resist packet loss when the network fluctuates, and the redundancy overhead can be controlled through the CPU load constraint, realizing the dynamic balance between network anti-packet loss demand and CPU bearing capacity, improving the accuracy of redundancy rate parameter setting. In addition, the application also determines the real-time video code rate by fusing the CPU load and redundancy rate data, and then implements forward error correction processing in combination with the first adjustment redundancy rate, forming a dual optimization mechanism of redundancy rate and code rate. On the one hand, accurate redundancy rate adjustment greatly reduces the video lag under unstable network, ensuring the continuity and real-time of monitoring video, and realizing ideal smooth transmission effect of video; on the other hand, dynamically adaptive video code rate can match the current network bandwidth and CPU performance, and can also maintain the video clarity to meet the monitoring demand, avoiding the problems of transmission pressure caused by too high code rate or blurred picture caused by too low code rate. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, and the advantages thereof, a brief introduction will be given to the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only show some embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0018] Figure 1 A flowchart of a bank remote monitoring video acquisition method provided by an embodiment of the application;

[0019] Figure 2 A structural schematic diagram of a bank remote monitoring video acquisition system provided by an embodiment of the application. DETAILED DESCRIPTION

[0020] In order to further clarify the technical means and effects taken by the present application to achieve the predetermined inventive purpose, the specific implementation, structure, features and effects of a bank remote monitoring video acquisition system and method according to the present application are described in detail below in combination with the drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" do not necessarily refer to the same embodiment. In addition, the specific features, structures or characteristics in one or more embodiments can be combined in any suitable form.

[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs.

[0022] The scenario targeted by the embodiments of the present application is that forward error correction enables the receiving end to recover the lost data by itself when encountering partial network packet loss by adding redundant information in the data packet, without the need to request retransmission. This significantly reduces video stuttering and buffering times, guarantees the continuity and real-time nature of video streaming, and greatly improves the viewing experience under unstable networks. The present application analyzes the stability of the network during video frame transmission according to the basic information feedback. The redundancy rate during video frame transmission is adjusted according to the busy situation of task processing in the system and the network stability performance. The redundancy rate is reasonably adjusted according to the transmission performance changes of the video after the redundancy rate adjustment at consecutive time. The video code rate is adjusted correspondingly in the case of excessive redundancy rate to ensure the normal transmission of video data.

[0023] The specific scheme of the bank remote monitoring video acquisition method provided by the present application is described in detail below in combination with the drawings.

[0024] Embodiment one:

[0025] Please refer to Figure 1 which shows the flowchart of the bank remote monitoring video acquisition method provided by one embodiment of the present application, including:

[0026] Step S101, acquiring the maximum delay, jitter value and packet loss rate during the transmission of the bank remote monitoring video in a first predetermined time period before the current time.

[0027] Specifically, the first predetermined time period in the embodiments of the present application can be determined according to the actual scene. The length of the first time period in the embodiments of the present application is set to 30 minutes, and the specific process of division is as follows: 30 minutes is calculated from the current time as the first predetermined time period of the current time. The interval between time points can be determined according to the actual situation, which is set to 20ms in the embodiments of the present application.

[0028] Further, in acquiring the maximum delay, jitter value and packet loss rate, the embodiment of the application acquires remote video stream transmission indexes through a real-time transport control protocol (RTCP), the receiving end analyzes the RTP packet sequence number, counts the number of lost packets, and periodically feeds back the acquired packet loss rate to the sending end through the "fraction lost (instantaneous packet loss rate)" and "cumulative number of packets lost (cumulative packet loss number)" fields in the RTCP Receiver Report (RR) packet. Then the sending end sends the network time protocol timestamp (NTP) when sending the RTCP Sender Report (SR) packet to the receiving end, the receiving end restores the Last SR timestamp (last sender report timestamp) in the RR packet and the receiving end processing delay Delaysince last SR (delay since the last sender report) to calculate and acquire the delay (Round-Trip Time, RTT). Finally, the receiving end calculates the variance of the change interval of the continuous RTP packet arrival time, smoothes it using a first-order filter, obtains the jitter value during video data transmission, and sends the obtained result to the sending end by filling it into the "interarrival jitter" field of the RR packet.

[0029] In step S102, the instability degree of the network in the first predetermined period is determined according to the maximum delay, jitter value and packet loss rate.

[0030] Specifically, when the bank's monitoring master control system acquires real-time video or historical video that has not been uploaded for remote monitoring in real time, the video data transmission may be blocked due to the instability of the network. To ensure smooth playback of remote video data when the network is unstable, the time loss of data retransmission when packets are lost can be reduced by carrying redundant packets in the video frame transmission through the forward error correction method. However, carrying redundant packets will increase the bandwidth overhead during transmission. Therefore, the redundancy rate should be adjusted according to the real-time network situation. When the delay, jitter and packet loss rate during video frame transmission occur more frequently and to a greater extent, the current network is more unstable. Therefore, the embodiment of the application judges the stability of the network according to the feedback of the delay, jitter value and packet loss rate during remote monitoring video transmission.

[0031] Further, as an optional embodiment of the present application, the determining of the network instability degree in the first predetermined period according to the maximum time delay, the jitter value and the packet loss rate comprises: determining the network congestion degree in the first predetermined period according to the maximum time delay and the jitter value; and determining the network instability degree in the first predetermined period according to the packet loss rate and the network congestion degree.

[0032] Specifically, when determining the network congestion degree in the first predetermined period, as an optional embodiment of the present application, first, the maximum time delay in the remote monitoring video transmission of the bank in the first predetermined period adjacent to the current time and the maximum jitter value in all jitter values in the first predetermined period before the current time are obtained; and then the network congestion degree in the first predetermined period adjacent to the current time is determined according to the maximum time delay, the jitter value in the first predetermined period and the maximum jitter value.

[0033] Specifically, the first predetermined period in the embodiment of the present application is taken as 30 minutes, and all the first predetermined periods before the current time in the embodiment of the present application include the period of 30 minutes forward from the current time and the period of 30 minutes corresponding to other time before the current time. The current time i is taken as an example in the embodiment of the present application, and the maximum time delay in the remote monitoring video transmission of the bank in the period of 30 minutes forward from the current time i is denoted as , and the jitter value in the period of 30 minutes forward from the current time i is denoted as . The jitter value is compared with the jitter values in the periods of 30 minutes of other times to obtain the maximum jitter value . When the maximum time delay is larger, the difference between the jitter value in the period of 30 minutes corresponding to the current time i and the maximum jitter value is smaller, the delay is more unstable, the delay time is longer, and the network congestion is more serious. Therefore, the network congestion degree in the first predetermined period corresponding to the current time i is calculated by the following formula in the embodiment of the present application:

[0034]

[0035] In the above formula, denotes the network congestion degree in the first predetermined period corresponding to the current time i. denotes the maximum time delay in the remote monitoring video transmission of the bank in the first predetermined period forward from the current time i. denotes the maximum jitter value. denotes the jitter value in the first predetermined period forward from the current time i. is to prevent the denominator from being 0.

[0036] Furthermore, in determining the network instability level within a first predetermined time period, as an optional embodiment of the present invention, the maximum packet loss rate among all packet loss rates within the first predetermined time periods before the current time, and the maximum network congestion level among all network congestion levels within the first predetermined time periods before the current time are first determined; then, based on the packet loss rate and network congestion level, the maximum packet loss rate and the maximum network congestion level of the first predetermined time periods adjacent to the current time before the current time, the network instability level within the first predetermined time period adjacent to the current time is determined.

[0037] Specifically, this embodiment of the invention obtains the packet loss rate within the first predetermined time period corresponding to the current time i. The maximum packet loss rate under different first predetermined time periods was obtained by comparison. The packet loss rate within the first predetermined time period corresponding to the current time i. Compared to the maximum packet loss rate ratio The larger the value, the greater the network congestion level within the first predetermined time period corresponding to the current time i. Compare the maximum network congestion levels within different first scheduled time periods The difference The smaller the time frame, the more severe the network congestion, packet loss, and network instability within the first predetermined time period. To ensure smooth video playback, the transmitted video frames should carry more redundant data. Therefore, this embodiment of the invention uses the following formula to calculate the network instability within the first predetermined time period adjacent to the current time:

[0038]

[0039] In the above formula, This indicates the degree of network instability within the first predetermined time period corresponding to the current time i. This represents the packet loss rate within the first predetermined time period corresponding to the current time i. This indicates the maximum packet loss rate. This indicates the maximum level of network congestion. This represents the network congestion level within the first predetermined time period corresponding to the current time i. Where, when The larger the value, the more unstable the network becomes within the first predetermined time period corresponding to the current time i, and the more likely data packet loss will occur.

[0040] Step S103: Determine the first adjustment redundancy rate for the current moment based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load during remote monitoring video transmission at the current moment, and the network instability.

[0041] Specifically, to ensure smooth playing of remote video when the network is unstable, the redundancy rate of the transmitted video frame should be increased, so that the video frame data is directly obtained from the redundant data when the packet is lost, avoiding the time consumption of retransmission. However, the carrying of redundant data will certainly increase the bandwidth overhead. When the CPU task is more and the load is larger, other tasks will seize the CPU calculation period originally belonging to the video encoder, so that the encoding speed decreases. To ensure real-time performance, it is not suitable to use too large redundancy rate at this time. Conversely, when the CPU load is smaller, a relatively abundant redundancy rate can be used to ensure the smoothness of video acquisition when the network is unstable. Therefore, the embodiment of the present application determines the change degree of the video transmission bandwidth overhead according to the size of the current overall load in the CPU and the proportion of video transmission in the CPU, and adjusts the redundancy rate of the video frame transmission in combination with the stability of the network. The change of the feedback data after the redundancy rate is adjusted at the continuous time is used to adjust the redundancy rate again.

[0042] Further, as an optional embodiment of the present application, the first adjustment redundancy rate at the current time is determined according to the total CPU load at the current time and all times within the first predetermined period, the CPU load during remote monitoring video transmission at the current time, and the instability degree of the network within the first predetermined period, comprising: determining the first increase degree of the redundancy rate at the current time according to the total CPU load at the current time and all times within the first predetermined period, the CPU load during remote monitoring video transmission at the current time, and the instability degree of the network within the first predetermined period; adjusting the initial redundancy rate during remote monitoring video transmission at the current time based on the first increase degree of the redundancy rate to obtain a second adjustment redundancy rate; determining the second increase degree of the redundancy rate that meets the future change according to the second adjustment redundancy rate at the current time and the second adjustment redundancy rate at all times within the second predetermined period before the current time; and adjusting the second adjustment redundancy rate at the current time again by using the second increase degree to obtain the first adjustment redundancy rate at the current time.

[0043] Specifically, the embodiment of the present application first obtains the total CPU load in the CPU at the current time i , compares the total CPU load in the CPU at the current time i with the minimum value of the total CPU load at all times within the first predetermined period , and then obtains the proportion of the CPU load during remote monitoring video transmission at the current time i in the total CPU load at the current time i . When the difference between the total CPU load at the current time i and the minimum value of the total CPU load is smaller, and the CPU load transmission proportion during remote monitoring video transmission at the current time i is smaller , the redundancy rate at the current time i is smaller . The greater the first increasing degree of the redundancy rate is, the smaller the current load of the CPU is, and the main processing is the transmission of the remote monitoring video, so the current increasing degree of the transmission bandwidth of the remote monitoring video is greater, and a greater redundancy rate can be used. Therefore, as an optional embodiment of the present application, the first increasing degree of the redundancy rate at the current time is determined according to the total CPU load at the current time and all times within the first predetermined period, the CPU load when the remote monitoring video is transmitted at the current time, and the instability degree of the network within the first predetermined period, comprising: determining the minimum total CPU load in the total CPU load at the current time and all times within the first predetermined period; determining the first increasing degree of the redundancy rate at the current time according to the total CPU load at the current time, the minimum total CPU load, the CPU load, and the instability degree of the network within the first predetermined period.

[0044] Specifically, the first increasing degree of the redundancy rate at the current time is calculated by the following formula:

[0045]

[0046] In the above formula, represents the first increasing degree of the redundancy rate at the current time i. represents the total CPU load in the CPU at the current time i. represents the minimum value of the total CPU load in the CPU at the current time i and the total CPU load at all times within the first predetermined period. represents the instability degree of the network within the first predetermined period corresponding to the current time i. represents the proportion of the CPU load when the remote monitoring video is transmitted at the current time i in the total CPU load at the current time i. is to prevent the denominator from being 0. Wherein, represents the increasing degree of the transmission bandwidth of the remote monitoring video at the current time i. When the increasing degree of the transmission bandwidth is greater, and the instability degree of the network within the first predetermined period corresponding to the current time i is greater, at this time, in order to ensure smooth video acquisition, a greater redundancy rate can be used, that is, is greater.

[0047] Further, in order to facilitate calculation, the maximum and minimum normalization is used to normalize to obtain the normalized first increasing degree , the value range of which can be [0, 5], and it participates in subsequent calculation.

[0048] Further, when the first increasing degree of the redundancy rate The greater the adjustment, the greater the redundancy rate used. Therefore, the embodiment of the present application adjusts the initial redundancy rate for remote monitoring video transmission at the current time according to the following formula to obtain a second adjusted redundancy rate:

[0049]

[0050] In the above formula, represents the second adjusted redundancy rate at the current time i for remote monitoring video transmission. represents the normalized first increase of the redundancy rate at the current time i. represents the initial redundancy rate at the current time for remote monitoring video transmission, which can be determined according to the actual scene, and in the embodiment of the present application, the value is 5%.

[0051] Further, the network instability and CPU load can change in real time, and obtaining the redundancy rate with the information at the current time may not meet the future requirements for smooth remote video data transmission. Therefore, the embodiment of the present application predicts the future network situation according to the adjustment size change of the redundancy rate obtained at consecutive times, and adjusts the redundancy rate size used in the future to meet the transmission requirements of video data. Therefore, as an optional embodiment of the present application, according to the second adjusted redundancy rate at the current time and the second adjusted redundancy rate at all times within the second predetermined period before the current time, the second increase of the redundancy rate to meet the future changes comprises: determining the first difference between the second adjusted redundancy rate at the current time and the second adjusted redundancy rate at the adjacent time within the second predetermined period before the current time, the first difference being the difference between the second adjusted redundancy rate at the later time and the second adjusted redundancy rate at the earlier time; determining the first number of all first differences greater than a preset value and the second number of all first differences; determining the second difference between the second adjusted redundancy rate at the current time and the second adjusted redundancy rate at the earliest time of the second predetermined period; and determining the second increase of the redundancy rate to meet the future changes according to the first number, the second number and the second difference.

[0052] Specifically, the length of the second predetermined period in the embodiment of the present application can be less than the length of the first predetermined period, which can be determined according to the actual scene, and in the embodiment of the present application, the value is 10 minutes. The preset value can be 0. The embodiment of the present application first obtains the second adjusted redundancy rate calculated by the above steps at different times within the second predetermined period within 10 minutes before the current time i. Then, the first difference between the second adjusted redundancy rate at the adjacent time m-1 and the second adjusted redundancy rate at the adjacent time m is calculated . Then, the first number of the first differences between the second adjusted redundancy rates at the adjacent times is calculated The second quantity of the first difference between the second adjustment redundancy rate obtained at all adjacent times. ratio Secondly, calculate the second adjustment redundancy rate at the current time within the second predetermined time period. The second adjustment redundancy rate with the earliest time of the second predetermined time period The second difference between Among them, when the ratio Larger, and the difference When the redundancy rate is higher, within a 10-minute timeframe, to ensure smooth video playback, the second adjustment redundancy rate is significantly increased. This indicates a high degree of network instability, causing video playback stuttering, and there is a high probability that network instability will worsen. To ensure smooth video playback even with future network changes, the current redundancy rate should be increased even further. Therefore, this embodiment of the invention uses the following formula to calculate the second increase in redundancy rate at the current time i to satisfy future changes:

[0053]

[0054] In the above formula, This indicates that at the current time i, the redundancy rate is increased to the second degree to meet future changes. This represents the first number of first differences in the magnitude of the second adjustment redundancy rate obtained at adjacent time points that are greater than 0. The second quantity represents the first difference between the second adjustment redundancy rates at all adjacent time points. This represents the second adjustment redundancy rate at the current time i. The second adjustment redundancy rate represents the earliest time of the second predetermined time period.

[0055] Furthermore, to facilitate subsequent calculations, this embodiment of the invention utilizes a maximum-minimum normalization pair. After normalization, the normalized second increase is obtained. Its range is [0, 0.5].

[0056] Furthermore, when When the value is larger, the second adjustment redundancy rate at the current time i is... Furthermore, the redundancy should be increased further to meet the need for stable video playback during future network fluctuations. Therefore, this embodiment of the invention uses the following formula to calculate the first adjustment redundancy rate at the current time i:

[0057]

[0058] In the above formula, This represents the first adjustment redundancy rate at the current time i. The second adjustment redundancy rate at the current time i. The second increase degree of the redundancy rate at the current time i after normalization, which satisfies the future change.

[0059] In step S104, the real-time video code rate at the current time is determined according to the CPU total load at the current time and all times within the first predetermined period, the CPU load, the first adjustment redundancy rate at the current time and each time within the first predetermined period, and the remote monitoring video transmitted at the current time is subjected to forward error correction processing based on the first adjustment redundancy rate and the real-time video code rate.

[0060] Specifically, when the processing task in the CPU is too much, the existence of other tasks will make the transmissible bandwidth smaller when the remote data is transmitted, but when the network is unstable, a larger redundancy rate is still needed to make the video play smoothly, at this time, to ensure the normal transmission of data, the video code rate of the transmitted video frame should be reduced to maintain the video fluency in the way of weakening the video definition. Therefore, the embodiment of the present application judges whether to correct the video code rate according to the increase degree of the current video data transmission bandwidth and the size of the redundancy rate after the secondary modification.

[0061] Further, as an optional embodiment of the present application, determining the real-time video code rate at the current time according to the CPU total load at the current time and all times within the first predetermined period, the CPU load, the first adjustment redundancy rate at the current time and each time within the first predetermined period includes: determining the video code rate reduction degree when the remote monitoring video is transmitted at the current time according to the CPU total load at the current time and all times within the first predetermined period, the CPU load when the remote monitoring video is transmitted at the current time, the first adjustment redundancy rate at the current time and each time within the first predetermined period; adjusting the video code rate reference value based on the video code rate reduction degree to obtain the real-time video code rate at the current time.

[0062] Specifically, the embodiment of the present application obtains the increase degree of the transmission bandwidth of the remote monitoring video at the current time i by the above-mentioned embodiment. The increase degree of the transmission bandwidth of the remote monitoring video at the current time i. The CPU total load in the CPU at the current time i. The minimum value of the CPU total load at the current time i and the CPU total load at all times within the first predetermined period, that is, the minimum CPU total load. The proportion of the CPU load when the remote monitoring video is transmitted at the current time i in the CPU total load at the current time i. In order to prevent the denominator from being 0.

[0063] Further, the embodiment of the present application compares the first adjustment redundancy rate of the current time i with the maximum adjustment redundancy rate of the first adjustment redundancy rates of all times within the first predetermined time period .

[0064] Further, when the increase degree of the transmission bandwidth is smaller , the difference between the first adjustment redundancy rate of the current time i and the maximum adjustment redundancy rate is smaller , the bandwidth that can be allocated to the video transmission cannot meet the requirement of the current redundancy rate, and therefore the video code rate should be correspondingly reduced to reduce the bandwidth cost of the transmitted video data, so that the data can be normally transmitted. Therefore, as an optional embodiment of the present application, the video code rate reduction degree of the remote monitoring video transmission at the current time is determined according to the total CPU load of all times within the current time and the first predetermined time period, the CPU load of the remote monitoring video transmission at the current time, the first adjustment redundancy rate of all times within the current time and the first predetermined time period, which comprises: determining the minimum total CPU load in the total CPU load of all times within the current time and the first predetermined time period, and the maximum adjustment redundancy rate in the first adjustment redundancy rates of all times within the current time and the first predetermined time period; and determining the video code rate reduction degree of the remote monitoring video transmission at the current time according to the total CPU load of the current time, the minimum total CPU load, the CPU load, the maximum adjustment redundancy rate and the first adjustment redundancy rate of the current time.

[0065] Specifically, the video code rate reduction degree of the remote monitoring video transmission at the current time i is calculated by the following formula:

[0066]

[0067] In the above formula, represents the video code rate reduction degree of the remote monitoring video transmission at the current time i. represents the total CPU load in the CPU at the current time i. represents the minimum total CPU load, which is the minimum value of the total CPU load in the CPU at the current time i and the total CPU load of all times within the first predetermined time period. represents the proportion of the CPU load of the remote monitoring video transmission at the current time i in the total CPU load at the current time i. represents the first adjustment redundancy rate of the current time i. represents the maximum adjustment redundancy rate in the first adjustment redundancy rates of all times within the first predetermined time period. is to prevent the denominator from being 0.

[0068] Furthermore, for ease of calculation, embodiments of the present invention utilize the maximum-minimum normalization pair. Normalization is performed to obtain the normalized video bitrate reduction during remote monitoring video transmission at the current time i. Its range is [0, 0.5].

[0069] Furthermore, when The larger the value, the greater the decrease in video bitrate at current time i. The video bitrate reference value in this embodiment can be determined based on the actual scenario; in this embodiment, it is 3000 kbps. Therefore, this embodiment uses the following formula to calculate the real-time video bitrate at current time i:

[0070]

[0071] In the above formula, This represents the real-time video bitrate at the current moment i. This indicates a reference value for the video bitrate. This represents the degree of reduction in video bitrate during remote monitoring video transmission at the current time i after normalization.

[0072] Furthermore, this embodiment of the invention uses the above method to obtain the real-time video bitrate and the first adjusted redundancy rate of the uploaded video at different times during remote monitoring. The obtained real-time video bitrate and the first adjusted redundancy rate are then transmitted to the remote monitoring system via RTCP packets.

[0073] Furthermore, video data is acquired through remote monitoring. Remote monitoring extracts fields such as stream_id (stream identifier), action (operation behavior), and value (parameter value) from the parsed data packets. Here, stream_id represents the identifier of the video stream, action represents the processing actions performed on the video stream, such as adjusting redundancy and video bitrate adaptation, and value represents the initial redundancy adjustment and real-time video bitrate that need to be adjusted. Then, the encoder's application programming interface (API) is called to dynamically adjust parameters such as video bitrate and redundancy, restarting the process with the new parameters (initial redundancy adjustment, real-time video bitrate). A new video stream is generated using forward error correction, and the new video stream is further encoded using a graphics processing unit (GPU).

[0074] Further, the encoded data is transmitted to the client by the router in the RTSP protocol. After the client receives the network data packet, the protocol is first resolved (such as resolving the RTSP), and the pure H.264 / H.265 code stream is obtained, and then sent to the decoder. The compressed code stream is restored to the original YUV / RGB image sequence through the decoding of the decoder. The decoded original YUV / RGB image sequence is written into a file and stored in a database.

[0075] The embodiment of the application analyzes the stability of the network during video transmission according to the basic information feedback of the maximum time delay, jitter value and packet loss rate during remote monitoring video frame transmission, can more accurately capture the historical law and current situation of network fluctuations, and provides reliable data support for redundancy rate adjustment. Further, the CPU load is considered as a factor in the adjustment of the redundancy rate. By combining the total CPU load in the current moment and the first predetermined period, the exclusive CPU load during video transmission, the first adjustment redundancy rate is determined on the basis of evaluating the degree of network instability, effectively avoiding the CPU overload problem caused by blindly increasing the redundancy rate in the traditional scheme. Both the redundancy is moderately increased to resist packet loss when the network fluctuates, and the redundancy overhead is controlled by the CPU load, realizing the dynamic balance between network anti-packet loss demand and CPU bearing capacity, and improving the accuracy of the redundancy rate parameter setting. In addition, the real-time video code rate is determined by fusing the CPU load and the redundancy rate data, and then the forward error correction processing is implemented in combination with the first adjustment redundancy rate, forming a dual optimization mechanism of redundancy rate and code rate. On the one hand, the accurate adjustment of the redundancy rate greatly reduces the video lag under unstable network, ensures the continuity and real-time of the monitoring video, and realizes the ideal smooth transmission effect of the video; on the other hand, the dynamically adapted video code rate can match the current network bandwidth and CPU performance, and can also maintain the video clarity to meet the monitoring demand, avoiding the problems of transmission pressure caused by too high code rate or blurred picture caused by too low code rate.

[0076] Further, the embodiment of the application analyzes the stability of the network during video transmission according to the basic information feedback of the maximum time delay, jitter value and packet loss rate during video frame transmission. The redundancy rate during video frame transmission is adjusted according to the busy situation of task processing in the system and the network stability performance. The redundancy rate is reasonably adjusted according to the transmission performance change of the video after the redundancy rate adjustment at the continuous moment. The video code rate is adjusted correspondingly in the case of excessive redundancy rate, to ensure the normal transmission of video data, so that the real-time video in remote monitoring can be smoothly obtained by the client in the case of unstable network, and the problem events in the bank can be discovered more timely.

[0077] Embodiment two:

[0078] Corresponding to the bank remote monitoring video acquisition method provided by the above embodiment, based on the same technical concept, the embodiment of the present application also provides a bank remote monitoring video acquisition system, which is used to execute the above bank remote monitoring video acquisition method, Figure 2 The structural schematic diagram of a bank remote monitoring video acquisition system provided by an embodiment of the present application is shown in Figure 2 The bank remote monitoring video acquisition system can have great difference due to different configurations or performances, and can include one or more processors 201 and memories 202, the memory 202 is used to store computer programs executable on the processor 201, and the processor 201 is used to execute the programs stored in the memory 202 to realize each step in the above Figure 1 Method embodiment. Among them, the memory 202 can be temporary storage or persistent storage. The application stored in the memory 202 can include one or more modules (not shown in the figure), each module can include a series of computer executable instructions in the bank remote monitoring video acquisition system.

[0079] Further, the processor 201 can be configured to communicate with the memory 202 and execute a series of computer executable instructions in the memory 202 on the bank remote monitoring video acquisition system. The bank remote monitoring video acquisition system can also include one or more power supplies 203, one or more wired or wireless network interfaces 204, one or more input / output interfaces 205, and one or more keyboards 206.

[0080] Specifically in the present embodiment, the bank remote monitoring video acquisition system includes a processor, a communication interface, a memory and a communication bus; wherein the processor, the communication interface and the memory complete the communication among each other through the bus; the memory is used to store computer programs; the processor is used to execute the programs stored in the memory to realize each step in the above Figure 1 Method embodiment, and has the beneficial effects of the above method embodiments. To avoid repetition, the embodiment of the present application will not be described here.

[0081] It should be noted that the bank remote monitoring video acquisition system provided by the embodiment of the present application and the bank remote monitoring video acquisition method provided by the embodiment of the present application are based on the same application concept, so the specific implementation of this embodiment can refer to the implementation of the aforementioned bank remote monitoring video acquisition method, and has the same or similar beneficial effects, and the repeated parts will not be described here.

[0082] It should be noted that the above-mentioned embodiments of the present application are only for the purpose of description, and do not represent the advantages and disadvantages of the embodiments. The processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-task processing and parallel processing are also possible or can be advantageous.

[0083] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments.

[0084] The embodiment of the present application also proposes a computer readable storage medium, the computer readable medium stores one or more programs, when the bank remote monitoring video acquisition system including a plurality of application programs executes the one or more programs, the bank remote monitoring video acquisition system executes Figure 1 The method disclosed in the embodiment and the functions and advantages of each method in the foregoing method embodiments are not described here again.

[0085] The computer readable storage medium includes read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc.

Claims

1. A method for remote monitoring video acquisition in banks, characterized in that, The method for acquiring remote monitoring video of a bank includes: Obtain the maximum latency, jitter, and packet loss rate of the bank's remote monitoring video transmission during the first predetermined time period before the current moment; The network instability level within the first predetermined time period is determined based on the maximum latency, the jitter value, and the packet loss rate. The first adjustment redundancy rate is determined based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load during remote monitoring video transmission at the current moment, and the instability of the network. Based on the total CPU load at the current time and all times within the first predetermined time period, the CPU load, and the first adjusted redundancy rate at the current time and each time within the first predetermined time period, the real-time video bitrate at the current time is determined, and forward error correction processing is performed on the remote monitoring video transmitted at the current time based on the first adjusted redundancy rate and the real-time video bitrate.

2. The bank remote monitoring video acquisition method according to claim 1, characterized in that, Determining the network instability level within the first predetermined time period based on the maximum latency, the jitter value, and the packet loss rate includes: The network congestion level within the first predetermined time period is determined based on the maximum latency and the jitter value. The degree of network instability during the first predetermined time period is determined based on the packet loss rate and the network congestion level.

3. The bank remote monitoring video acquisition method according to claim 2, characterized in that, Determining the network congestion level within the first predetermined time period based on the maximum latency and the jitter value includes: The maximum latency of remote monitoring video transmission of the bank during the current time and the first predetermined time period adjacent to the current time is obtained, as well as the maximum jitter value among all jitter values ​​in the first predetermined time period before the current time; Based on the maximum latency, the jitter value within the first predetermined time period, and the maximum jitter value, the network congestion level within the first predetermined time period adjacent to the current time is determined.

4. The bank remote monitoring video acquisition method according to claim 2, characterized in that, Determining the network instability level within the first predetermined time period based on the packet loss rate and the network congestion level includes: Determine the maximum packet loss rate among all packet loss rates in all first predetermined time periods before the current time, and the maximum network congestion level among all network congestion levels in all first predetermined time periods before the current time; The instability of the network within the first predetermined time period adjacent to the current time is determined based on the packet loss rate and network congestion level of the first predetermined time period preceding the current time, the maximum packet loss rate, and the maximum network congestion level.

5. The bank remote monitoring video acquisition method according to claim 1, characterized in that, The step of determining the first adjustment redundancy rate at the current moment based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load during remote monitoring video transmission at the current moment, and the network instability includes: The first increase in redundancy rate at the current moment is determined based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load when remote monitoring video transmission is performed at the current moment, and the network instability within the first predetermined time period. Based on the first increase in the redundancy rate, the initial redundancy rate during remote monitoring video transmission at the current moment is adjusted to obtain a second adjusted redundancy rate. Based on the second adjustment redundancy rate at the current moment and the second adjustment redundancy rates at all moments within the second predetermined time period prior to the current moment, determine the second increase in redundancy rate at the current moment to satisfy future changes; The second adjustment redundancy rate at the current moment is adjusted again using the second increase degree to obtain the first adjustment redundancy rate at the current moment.

6. The bank remote monitoring video acquisition method according to claim 5, characterized in that, The step of determining the first increase in redundancy rate at the current moment based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load during remote monitoring video transmission at the current moment, and the network instability within the first predetermined time period includes: Determine the minimum total CPU load among the total CPU load at the current time and all times within the first predetermined time period; The first increase in redundancy rate at the current moment is determined based on the current total CPU load, the minimum total CPU load, the CPU load, and the network instability during the first predetermined time period.

7. The bank remote monitoring video acquisition method according to claim 5, characterized in that, The step of determining the second increase degree of the redundancy rate to meet future changes at the current time based on the second adjustment redundancy rate at the current time and the second adjustment redundancy rates at all times within the second predetermined period prior to the current time includes: Determine a first difference between the second adjustment redundancy rates of adjacent times within a second predetermined time period prior to the current time and the current time, wherein the first difference is the difference between the second adjustment redundancy rate of the next time and the second adjustment redundancy rate of the previous time. Determine the first number of all first differences that are greater than a preset value and the second number of all first differences; Determine the second difference between the second adjustment redundancy rate at the current time and the second adjustment redundancy rate at the earliest time of the second predetermined time period; Based on the first quantity, the second quantity, and the second difference, the current moment is determined to be the second degree of increase in redundancy rate to meet future changes.

8. The bank remote monitoring video acquisition method according to any one of claims 1-7, characterized in that, The step of determining the real-time video bitrate at the current moment based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load, and the first adjusted redundancy rate at the current moment and each moment within the first predetermined time period includes: Based on the total CPU load at the current time and all times within the first predetermined time period, the CPU load when remotely monitoring video transmission is performed at the current time, and the first adjustment redundancy rate at each time within the first predetermined time period, the degree of reduction in video bitrate when remotely monitoring video transmission is performed at the current time is determined. The video bitrate reference value is adjusted based on the degree of reduction in video bitrate to obtain the real-time video bitrate at the current moment.

9. The bank remote monitoring video acquisition method according to claim 8, characterized in that, The step of determining the degree of video bitrate reduction during remote monitoring video transmission at the current moment based on the total CPU load at the current moment and all moments within the first predetermined time period, the CPU load during remote monitoring video transmission at the current moment, and the first adjustment redundancy rate at each moment within the first predetermined time period includes: Determine the minimum total CPU load among the total CPU load at the current time and all times within the first predetermined time period, and the maximum adjustment redundancy rate among the first adjustment redundancy rates at each time within the current time and the first predetermined time period; The degree of video bitrate reduction during remote monitoring video transmission at the current moment is determined based on the current total CPU load, the minimum total CPU load, the CPU load, the maximum adjustment redundancy rate, and the first adjustment redundancy rate at the current moment.

10. A remote monitoring video acquisition system for banks, characterized in that, include: Processor and memory; wherein the memory is used to store computer programs that can run on the processor; A processor is used to execute a program stored in memory to implement the steps of the bank remote monitoring video acquisition method as described in any one of claims 1-9.

Images