A computer network data encryption security protection method, device and system

Abstract

The present invention relates to the field of data processing technology, and specifically to a computer network data encryption security protection method, device and system, including receiving video stream data; decoding and parsing the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a sequence number corresponding to each key frame; analyzing the missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all key frames, wherein the missing key frames are key frames lost during the transmission process; and requesting the authorization end to adjust the key frame density in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp. The present invention analyzes the video stream, identifies and feeds back the number and time of missing key frames, and combines the network status to optimize the interpolation and improve the video fluency. In a high-latency network, the playback effect is improved and the video is encrypted by adjusting the number of interpolation frames; in a low-latency network, bandwidth waste and network congestion are reduced.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a computer network data encryption security protection method, device and system. Background Art

[0002] Video content may contain commercial secrets, personal privacy or other sensitive information, so it is necessary to encrypt the video. Video encryption is a technology used to protect the security of video content. It prevents unauthorized access and tampering by converting video data into a form that only authorized users can decrypt and view. This encryption technology is widely used in content protection and digital rights management (DRM) to ensure the security of video content during transmission and storage. In video encryption, you usually choose to encrypt the entire video stream or only key frames (such as IDR frames). IDR frames are the key point of video decoding, and it is particularly important to ensure their security.

[0003] However, during the video transmission process, the loss of IDR frames will lead to decoding errors of subsequent video streams, thereby affecting the video viewing experience. However, the existing technology only inserts frames at fixed intervals, which leads to the problem of wasting bandwidth. Summary of the invention

[0004] In order to solve the above technical problems, the purpose of the present invention is to provide a computer network data encryption security protection method, device and system. In order to achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0005] In a first aspect, the present invention provides a computer network data encryption security protection method for an authorized user terminal, the method comprising: receiving video stream data; decoding and parsing the video stream data to obtain a video stream, the video stream comprising at least one key frame and a timestamp and a sequence number corresponding to each key frame; obtaining missing key frames in the video stream based on analysis of the timestamps and sequence numbers corresponding to all the key frames, the missing key frames being key frames lost during transmission; and requesting adjustment of the key frame density in the untransmitted video stream data to the authorized terminal based on the network status, the number of missing key frames and the timestamp.

[0006] In combination with the first aspect, in a possible implementation method, based on the network status, the number of missing key frames and the timestamp, a request is made to the authorization end to adjust the key frame density in the untransmitted video stream data, including: obtaining multiple network delay values, wherein the network delay values ​​are all obtained during the period of receiving the video stream data; calculating a network volatility assessment value based on all the network delay values; calculating a key frame density based on the network volatility assessment value and the supplementary frame density, wherein the supplementary frame density is calculated by the number of missing key frames and the timestamp; and sending the key frame density to the authorization end.

[0007] In combination with the first aspect, in a possible implementation, the missing key frames in the video stream are obtained based on the timestamps and sequence numbers corresponding to all the key frames, and then the method further includes: performing frame filling processing on the missing key frames to obtain video stream data of the filled frames.

[0008] In combination with the first aspect, in a possible implementation method, the number of missing key frames is greater than or equal to one, and the missing key frames are supplemented to obtain complete video stream data, including: determining one by one whether the timestamp of each missing key frame is less than a first preset threshold; if the timestamp of all the missing key frames is less than the first preset threshold, re-requesting the complete video stream data from the authorization end; otherwise, supplementing frames are generated based on two adjacent frames of each missing key frame to obtain complete video stream data, and the two adjacent frames are two key frames that are located one before and one after the missing key frame in time sequence.

[0009] In combination with the first aspect, in a possible implementation method, a complement frame is generated based on two adjacent frames of each missing key frame, including: counting the number of missing key frames; calculating the loss frequency based on the timestamp corresponding to each missing key frame and the number of missing key frames; when the loss frequency is less than a second preset threshold, performing linear interpolation calculation based on the image data of the two adjacent frames to obtain the complement frame; when the loss frequency is greater than or equal to the second preset threshold, calculating the complement frame based on the change of pixels in the image data of the two adjacent frames.

[0010] In combination with the first aspect, in a possible implementation method, a complement frame is obtained based on the calculation of pixel changes in the image data of the two adjacent frames, including: calculating the estimated position of each pixel in the complement frame one by one based on a first preset formula and the image data of the two adjacent frames; calculating the estimated pixel value of each pixel in the complement frame one by one based on a second preset formula and the image data of the two adjacent frames; and constructing the complement frame based on the estimated position and the estimated pixel value of each pixel in the complement frame.

[0011] In the second aspect, the present invention also provides a computer network data encryption security protection device, including: a video receiving module, used to receive video stream data; a frame parsing module, used to decode and parse the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a serial number corresponding to each key frame; a key frame extraction module, used to analyze the missing key frames in the video stream based on the timestamps and serial numbers corresponding to all the key frames, wherein the missing key frames are key frames lost during the transmission process; a request module, used to request the authorization end to adjust the key frame density in the untransmitted video stream data based on the network status, the number of the missing key frames and the timestamp.

[0012] In combination with the second aspect, in a possible implementation, the request module includes: a delay acquisition module, used to obtain multiple network delay values, and the network delay values ​​are all obtained during the period of receiving video stream data; a volatility calculation module, used to calculate the network volatility evaluation value based on all the network delay values; a density module, used to calculate the key frame density based on the network volatility evaluation value and the loss frequency, and the loss frequency is calculated by the number of missing key frames and timestamps; a sending module, used to send the key frame density to the authorization end.

[0013] In combination with the second aspect, in a possible implementation manner, it further includes: a frame filling module, which is used to fill in the missing key frames to obtain video stream data of the filled frames.

[0014] In a third aspect, the present invention also provides a computer network data encryption security protection system, comprising: a memory for storing a computer program; and a processor for implementing the steps of any one of the above-mentioned computer network data encryption security protection methods when executing the computer program.

[0015] The present invention has the following beneficial effects:

[0016] The present invention first performs an in-depth data analysis on the input video stream to identify the missing key frames. By analyzing the number of missing key frames and their specific location and time in the video stream, combined with real-time feedback on the current network status, the present invention can send relevant data to the authorized end. These data will be used to trigger the authorized end to perform weighted optimization on the number of interpolated frames, thereby effectively improving the density of key frames in the non-transmitted video stream. In the case of high latency in network transmission, the present invention can flexibly adjust the number of interpolated frames to enhance the smoothness of video playback. In the case of low latency in network transmission, the present invention can reduce unnecessary consumption of broadband resources and reduce the possibility of network congestion, thereby optimizing the overall network transmission efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A flowchart of a computer network data encryption security protection method provided by Embodiment 1 of the present invention;

[0019] Figure 2 This is a schematic diagram of a video stream without missing key frames according to Embodiment 1 of the present invention;

[0020] Figure 3 A schematic diagram of a video stream with a high frame loss frequency according to Embodiment 1 of the present invention;

[0021] Figure 4 A schematic diagram of a video stream with a low frame loss frequency according to Embodiment 1 of the present invention;

[0022] Figure 5 A schematic flow chart of step S4 provided in Example 1 of the present invention;

[0023] Figure 6 A schematic flow chart of step S5 provided in Example 1 of the present invention;

[0024] Figure 7 This is a schematic diagram of the structure of the computer network data encryption security protection device described in Example 2 of the present invention;

[0025] Figure 8 This is a schematic diagram of the structure of the computer network data encryption security protection system described in Example 3 of the present invention. DETAILED DESCRIPTION

[0026] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following is a detailed description of a computer network data encryption security protection method, device and system proposed by the present invention, its specific implementation method, structure, features and effects in combination with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.

[0027] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0028] To facilitate the understanding of those skilled in the art, the specific scenario targeted by the present invention is as follows: In order for video content providers to better control access to content and effectively reduce the risk of video piracy, video encryption becomes a key measure. In the process of encrypting videos, the authorized end usually gives priority to encrypting IDR frames (Intra Domain Routing frames). This is because IDR frames are the starting point for video decoding and contain key data necessary for reconstructing video content. If an attacker can access these frames, they may obtain the starting point for decoding, thereby bypassing the video protection mechanism. When an IDR frame is lost, it will cause video stream decoding errors, which will seriously affect the viewing experience. Therefore, the authorized user end needs to determine the time and location of the IDR frame loss, use frame filling technology to replace the frame after the lost position with a new IDR frame, and determine the interval and number of inserted frames according to the specific needs of the video, thereby completing the encrypted transmission processing of the video.

[0029] In the specific implementation of the present invention, the authorization end generally refers to a cloud server, which is responsible for managing and distributing authorization information and sending video stream data. The authorization user end refers to the program used by the user after successfully logging into his account, which can receive the authorization information and video stream data from the cloud server and perform decoding and parsing operations based on the video stream data.

[0030] Embodiment 1:

[0031] The specific scheme of a computer network data encryption security protection method provided by the present invention is described in detail below with reference to the accompanying drawings.

[0032] See also Figure 1 , which shows a flow chart of a computer network data encryption security protection method provided by an embodiment of the present invention, which is used to authorize a user terminal, including steps S1 to S5.

[0033] S1. Receive video stream data.

[0034] S2. Decode and parse the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a sequence number corresponding to each key frame.

[0035] Specifically, the key frame mentioned in this embodiment is the IDR frame. In the video stream transmission process, the IDR frame plays a vital role. As a key frame, the IDR frame does not depend on the previous frame, which means that the authorized user end can decode the video stream independently from the IDR frame without relying on the previous frame. This feature greatly reduces the decoding errors caused by the loss or damage of the previous frame data, ensuring the continuity and integrity of the video. In the video stream, the IDR frame also acts as a recovery point. When the previous data is lost or damaged due to network problems or other reasons, the IDR frame enables the decoder to restart the correct decoding, thereby restoring the continuous playback of the video. Since packet loss is a common phenomenon in network transmission, the IDR frame is particularly important in this case. It helps to resynchronize the decoder after packet loss, thereby reducing playback interruptions and image quality problems. By using IDR frames, the processing and playback of video data becomes simpler, especially in the case of unstable network conditions, it can effectively ensure the smooth playback of the video stream and a good user experience.

[0036] S3. Analyze and obtain missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames, where the missing key frames are key frames lost during the transmission process.

[0037] Generally speaking, video streams are usually transmitted at fixed time intervals (e.g., 30 frames per second). Therefore, in this embodiment, the timestamp and sequence number of the missing key frame are firstly calculated, so that the time interval of the interpolation frame to be inserted can be more accurately calculated, ensuring that the interpolation frame processing can be consistent with the playback speed of the original video stream, thereby avoiding obvious changes in the playback speed or incoherent images.

[0038] S4. Perform frame-filling processing on the missing key frames to obtain frame-filled video stream data.

[0039] Among them, in this embodiment, different methods are used to process the interpolation frames in different situations. Step S4 specifically includes: judging whether the timestamp of each missing key frame is less than the first preset threshold one by one, if the timestamp of all the missing key frames is less than the first preset threshold, then re-requesting the complete video stream data from the authorization end; otherwise, generating interpolation frames based on two adjacent frames of each missing key frame to obtain the complete video stream data, the two adjacent frames are respectively the two key frames located one before and one after the missing key frame in time sequence.

[0040] That is, in this embodiment, in view of the IDR frame loss in the received video stream, combined with the corresponding timestamp and sequence number of the IDR frame in the video stream, the lost position of the IDR frame can be obtained according to the lost IDR frame sequence number. When the lost position of the IDR frame is in the front section of the video stream, a request is made to retransmit the video stream; when the lost position of the IDR frame is not in the front section of the video stream, the loss frequency of the IDR frame is determined, and the lost IDR frame in the transmitted video stream is supplemented. Among them, the front end of the video stream is defined as the first 1% of the video stream in this embodiment. At the same time, for those skilled in the art, other numerical ratios can also be used, and no specific restrictions are made in this embodiment.

[0041] Meanwhile, in this embodiment, considering that different frequencies of IDR frame loss may have different effects on video quality, the most ideal one is as follows: Figure 2 The video stream diagram without missing key frames is shown in Figure 2 The horizontal line from left to right represents the time sequence, and the vertical line represents an IDR frame. However, the actual situation is changeable, and there may be a video stream with a high frame loss frequency, such as Figure 3 As shown in , more frequent frame additions may be required to keep the video smooth and natural. Video streams with low frame loss frequencies may also appear, such as Figure 4 As shown, it is not necessary to add frames so frequently to keep the video smooth and natural. Therefore, when an IDR frame in a video is lost, it is not only necessary to accurately identify and determine the position of the lost IDR frame in the video stream, but also to determine the frequency of frame loss, that is, the number of lost IDR frames and the intervals between them, and finally take corresponding frame-adding measures.

[0042] Therefore, see Figure 5 , the figure shows that in this embodiment, step S4 also includes steps S41 to S44.

[0043] S41. Obtain the number of missing key frames based on the sequence numbers corresponding to the missing key frames.

[0044] S42: Calculate the loss frequency based on the timestamp corresponding to each missing key frame and the number of the missing key frames.

[0045] Therefore, in this embodiment, the time between the first key frame and the last key frame included in the received video stream is taken as the total time, and the loss frequency is calculated based on the total number of IDR frames included in the received video stream. Specifically, the calculation formula for the loss frequency is as follows:

[0046] ;

[0047] in, Indicates the frequency of key frame loss in the received video stream; Indicates the number of missing key frames in the received video stream; Indicates the difference between the timestamps of the first key frame and the last key frame in the transmitted video stream.

[0048] In this embodiment, it is considered that key frame losses of different frequencies may have different effects on video quality. Therefore, see step S43 and step S44 for details.

[0049] S43: When the loss frequency is less than a second preset threshold, a linear interpolation calculation is performed based on the image data of the two adjacent frames to obtain a supplementary frame.

[0050] In this embodiment, when the loss frequency is less than 1, the loss of IDR frames has no impact on the viewing of the video stream. Therefore, in this embodiment, for the video stream with low-frequency frame loss, the image data of adjacent frames are used to generate new IDR frames, i.e., fill frames.

[0051] Specifically, the linear interpolation formula in this embodiment is as follows:

[0052] ;

[0053] in, Indicates the generated The first supplementary frame is also called the lost keyframes; Indicates the lost The key frame before the key frame; Indicates the lost The timestamp corresponding to each key frame; Indicates the lost The timestamp corresponding to the previous key frame of the key frame; Indicates the lost The timestamp corresponding to the next key frame after the key frame; Indicates the lost The keyframe after the keyframe.

[0054] In the above calculation formula, represents the time interpolation factor, represents the difference between two key frames located one after the other in the timing sequence of the missing key frame, and the generated first value is obtained by multiplying the time interpolation factor and the difference between the two key frames. A fill frame.

[0055] S44: When the loss frequency is greater than or equal to a second preset threshold, a supplementary frame is obtained by calculation based on pixel changes in the image data of the two adjacent frames.

[0056] In this implementation, when the loss frequency is greater than or equal to 1, the loss of the key frame has a greater impact on the viewing of the video stream, and linear interpolation cannot meet the loss of the current key frame. Therefore, in this embodiment, for the video stream with high-frequency frame loss, the movement between the pixels in the previous and next key frames is used to generate a supplementary frame. Therefore, this step includes steps S441 to S443.

[0057] S441. Calculate the estimated position of each pixel in the complement frame one by one based on a first preset formula and the image data of the two adjacent frames.

[0058] Specifically, in this step, the first preset formula is as follows:

[0059] ;

[0060] in, Indicates the first The estimated position of the pixel point can also be called the The pixel is lost in The estimated position in keyframes; Indicates the lost The keyframe before the keyframe The position of the pixel; Indicates the lost The key frame after the key frame The position of the pixel; Indicates the lost The timestamp corresponding to each key frame; Indicates the lost The timestamp corresponding to the previous key frame of the key frame; Indicates the lost The timestamp of the key frame following the key frame.

[0061] In the above calculation formula, The pixels are in the lost The positions of the previous key frame and the next key frame of the key frame can be identified by the existing target recognition algorithm, and the specific implementation process is not described in detail in this embodiment. The pixels at the edge of the previous keyframe may not appear in the lost keyframe. For the situation in the next key frame after the first key frame, those skilled in the art can ignore the pixels located at the edge and no longer appearing according to the situation, so that the size of the supplementary frame will be slightly reduced. Therefore, on this basis, it is only necessary to stretch the lost first key frame in equal proportion. keyframe size.

[0062] S442: Calculate the estimated pixel value of each pixel in the complement frame one by one based on a second preset formula and the image data of the two adjacent frames.

[0063] Specifically, in this step, the second preset formula is as follows:

[0064] ;

[0065] in, Indicates the generated The first supplementary frame is also called the lost keyframes; Indicates the lost The keyframe before the keyframe The pixel value of a pixel; Indicates the lost The key frame after the key frame The pixel value of a pixel; Indicates the lost The total number of pixels in the previous key frame.

[0066] In the above calculation formula, the linear interpolation method is used to first confirm that Pixel point The position of the supplementary frame, and then assign the same weight to each of them to get the The pixel value of each pixel in the supplemented frame is calculated to overcome the problem of serious information loss when the loss frequency is high.

[0067] S443: construct the supplemented frame based on the estimated position and the estimated pixel value of each pixel point in the supplemented frame.

[0068] That is, in this embodiment, the missing key frames are supplemented to restore the complete video stream data to ensure the continuity and integrity of the video playback.

[0069] S5. Requesting the authorization end to adjust the density of key frames in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp.

[0070] In this embodiment, it is considered that due to the loss of key frames in the transmitted video stream, this situation may have a significant impact on the subsequent frames that are not transmitted. If a key frame is lost, the decoder will not be able to correctly decode all subsequent frames that depend on the key frame, which may cause problems such as screen tearing, image distortion or playback interruption. Although the lost key frames have been supplemented in this embodiment, the results obtained by the above processing are not the original content. Therefore, in this embodiment, in order to avoid these negative effects and ensure the continuity and visual quality of video playback, it is also necessary to modify the density of key frames of the untransmitted video.

[0071] Specifically, for key frames in the untransmitted video, the density of key frames determines the distribution of key frames in the video stream, which directly affects the needs of video recovery and frame interpolation. The frequency of key frame loss in the transmitted video directly affects the needs of video recovery and frame interpolation. If the frequency of key frame loss in the transmitted video is high, then the untransmitted video also needs to be interpolated proportionally to make up for these lost key frames. The key frame density in the untransmitted video needs to be determined based on the frequency of frame loss in the transmitted video. Specifically, the key frame density of the untransmitted video should be proportional to the frequency of key frame loss in the transmitted video. This is because lost key frames will cause the decoding chain to break. The density of interpolated frames needs to be adjusted according to the frequency of lost key frames to ensure that enough key frames can be correctly inserted into the untransmitted video stream for recovery.

[0072] At the same time, in this embodiment, it is taken into account that in the process of video streaming transmission, factors such as network traffic fluctuations, congestion, and routing changes may cause the variability of video streaming data transmission. The influence of these factors will cause network delays, resulting in jitter and freezes in the video stream. When the delay increases, the real-time performance of the video stream will decrease, which will make the video playback experience less than ideal. Specifically, higher delays may cause video playback to lag significantly behind actual real-time events. For example, in live video, delays will cause a time difference between the picture seen by the audience and the actual event. High delays may also cause discontinuous video playback, and the picture may become stuck or frozen, especially in poor network conditions or frequent frame loss. This effect is particularly obvious.

[0073] In addition, latency will increase the need for buffering and interpolation. The buffering mechanism is to store a certain amount of data in advance during playback to cope with sudden network fluctuations. However, higher latency may increase the buffering time, thereby extending the time it takes for the video to start playing. Interpolation is to insert additional frames when frame loss or discontinuity occurs to maintain the smoothness of video playback.

[0074] Therefore, participate Figure 6, the figure shows that step S5 in this embodiment also includes steps S51-S54.

[0075] S51. Obtain multiple network delay values, where all of the network delay values ​​are obtained during a period of receiving video stream data.

[0076] S52: Calculate a network volatility assessment value based on all the network delay values.

[0077] Specifically, in the embodiment, the network volatility evaluation value calculation formula is as follows:

[0078] ;

[0079] in, Indicates the network volatility assessment value; Indicates The network delay value of times; Indicates the total number of network delay values; Indicates the maximum value of the network delay value; Indicates the minimum value among the network delay values.

[0080] In the above calculation formula, Indicates the fluctuation difference of network delay value. Indicates the average value of network delay. When the fluctuation difference of network delay value is larger, it can represent the current network change more. When the average value of network delay value is larger, it represents the average state of current video stream transmission. By dividing the fluctuation difference of network delay value by the average value of network delay value, the instability of network or the change of bandwidth can be better expressed.

[0081] S53. Calculate the key frame density based on the network volatility evaluation value and the supplementary frame density, where the supplementary frame density is calculated from the number of missing key frames and timestamps.

[0082] Specifically, in this embodiment, the calculation formula of key frame density is as follows:

[0083] ;

[0084] in, Indicates the key frame density; Indicates the network volatility assessment value; Indicates the density of interpolation frames; Indicates the number of missing key frames in the received video stream; Indicates the difference between the timestamps of the first key frame and the last key frame in the transmitted video stream; Indicates the number of key frame sequence numbers in the video stream that have not been transmitted; Indicates the difference between the timestamps of the first key frame and the last key frame in the untransmitted video stream.

[0085] In the above calculation formula, In the above calculation formula, Indicates the frequency of key frame loss in the received video stream. Indicates the density of key frames in the untransmitted video stream. In this embodiment, the loss frequency is used as a weight to correct the original key frame density of the untransmitted video stream. The volatility evaluation value B of network performance reflects the instability of the network or the change of bandwidth, which directly affects the transmission quality and reliability of video data. The greater the volatility, the higher the probability of transmission interruption or packet loss. The frame filling strategy needs to be adjusted according to the actual state of the network. The frame filling density is calculated based on the demand under normal network conditions. In actual situations, network fluctuations will change this demand. Therefore, using B as a weight can adjust the frame filling density to adapt to the current network state.

[0086] Therefore, the density of frame interpolation can be dynamically adjusted by using the network volatility assessment value B as a weight. A higher network volatility assessment value B indicates a higher demand for frame interpolation to maintain video quality; a lower network volatility assessment value B indicates a more stable network and less demand for frame interpolation.

[0087] S54: Send the key frame density to the authorization end.

[0088] Finally, in this embodiment, a request can be sent to the authorized end based on the key frame density, and the key frame density in the subsequent unsent video stream can be changed to the authorized user end request target, thereby improving the robustness of video transmission, reducing the screen artifacts, freezes or unnatural frame skipping phenomena of the authorized user end, and completing the frame supplement of the video stream under the encryption and security protection of the video.

[0089] In this embodiment, for the transmission process of the encrypted and securely protected video stream, when the IDR frame is lost, it will cause video stream decoding errors, which will seriously affect the viewing experience. This embodiment determines the timestamp and sequence number of the missing key frame, adopts the frame filling technology, and replaces the frame after the lost position with a new IDR frame. When there is a network transmission delay, the frame filling strategy is adjusted to improve the smoothness of the video playback and complete the transmission of the video stream under the condition of encrypted and secure protection.

[0090] Embodiment 2:

[0091] like Figure 7 As shown, this embodiment provides a computer network data encryption security protection device, the device comprising:

[0092] The video receiving module is used to receive video stream data.

[0093] The frame parsing module is used to decode and parse the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a sequence number corresponding to each key frame.

[0094] The key frame extraction module is used to analyze the missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames, and the missing key frames are key frames lost during the transmission process.

[0095] The frame interpolation module is used to interpolate the missing key frames to obtain interpolated video stream data.

[0096] The request module is used to request the authorization end to adjust the density of key frames in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp.

[0097] In some specific embodiments, the request module includes:

[0098] The delay acquisition module is used to acquire multiple network delay values, and the network delay values ​​are all acquired during the period of receiving video stream data.

[0099] The volatility calculation module is used to calculate a network volatility evaluation value based on all the network delay values.

[0100] A density module is used to calculate the key frame density based on the network volatility evaluation value and the loss frequency, and the loss frequency is calculated by the number and timestamp of the missing key frames.

[0101] The sending module is used to send the key frame density to the authorization end.

[0102] It should be noted that, regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0103] Embodiment 3:

[0104] Corresponding to the above method embodiment, this embodiment also provides a computer network data encryption security protection system. The computer network data encryption security protection system described below and the computer network data encryption security protection method described above can be referenced to each other.

[0105] Figure 8 FIG. 8 is a block diagram of a computer network data encryption security protection system 800 according to an exemplary embodiment. Figure 8As shown, the computer network data encryption security protection system 800 may include: a processor 801 and a memory 802. The computer network data encryption security protection system 800 may also include one or more of a multimedia component 803, an I / O interface 804, and a communication component 805.

[0106] The processor 801 is used to control the overall operation of the computer network data encryption security protection system 800 to complete all or part of the steps in the above-mentioned computer network data encryption security protection method. The memory 802 is used to store various types of data to support the operation of the computer network data encryption security protection system 800. These data may include, for example, instructions for any application or method operating on the computer network data encryption security protection system 800, as well as application-related data, such as contact data, sent and received messages, pictures, audio, video, etc. The memory 802 can be implemented by any type of volatile or non-volatile storage system or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or optical disk. The multimedia component 803 may include a screen and an audio component. The screen may be, for example, a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in the memory 802 or sent via the communication component 805. The audio component also includes at least one speaker for outputting audio signals. The I / O interface 804 provides an interface between the processor 801 and other interface modules, and the above-mentioned other interface modules can be keyboards, mice, buttons, etc. These buttons can be virtual buttons or physical buttons. The communication component 805 is used for wired or wireless communication between the computer network data encryption security protection system 800 and other systems. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 805 can include: Wi-Fi module, Bluetooth module, NFC module.

[0107] In an exemplary embodiment, the computer network data encryption security protection system 800 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing systems (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to execute the above-mentioned computer network data encryption security protection method.

[0108] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, and when the program instructions are executed by a processor, the steps of the above-mentioned computer network data encryption security protection method are implemented. For example, the computer-readable storage medium can be the above-mentioned memory 802 including program instructions, and the above-mentioned program instructions can be executed by the processor 801 of the computer network data encryption security protection system 800 to complete the above-mentioned computer network data encryption security protection method.

[0109] It should be noted that the sequence of the above embodiments of the present invention is only for description and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0110] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

Claims

1. A computer network data encryption security protection method for authorizing a user terminal, characterized in that: The method comprises: Receive video stream data; Decoding and parsing the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a sequence number corresponding to each key frame; Obtaining missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames, wherein the missing key frames are key frames lost during the transmission process; Requesting the authorization end to adjust the density of key frames in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp; Requesting the authorization end to adjust the density of key frames in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp, including: Acquire multiple network delay values, where the network delay values ​​are all obtained during a period of receiving video stream data; Calculate a network volatility assessment value based on all the network delay values; The key frame density is calculated based on the network volatility evaluation value and the supplementary frame density, and the supplementary frame density is calculated by the number and timestamp of the missing key frames; Sending key frame density to the authorization end; The method further includes: obtaining missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames; and obtaining missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames. Performing frame interpolation processing on the missing key frames to obtain interpolated frame video stream data; The network volatility assessment value is calculated as follows: ； in, Indicates the network volatility assessment value; Indicates The network delay value of times; Indicates the total number of network delay values; Indicates the maximum value of the network delay value; Indicates the minimum value among network delay values; The key frame density is calculated as follows: ； in, Indicates the key frame density; Indicates the network volatility assessment value; Indicates the density of interpolation frames; Indicates the number of missing key frames in the received video stream; Indicates the difference between the timestamps of the first key frame and the last key frame in the transmitted video stream; Indicates the number of key frame sequence numbers in the video stream that have not been transmitted; Indicates the difference between the timestamps of the first key frame and the last key frame in the untransmitted video stream.

2. The computer network data encryption security protection method according to claim 1, characterized in that: The number of the missing key frames is greater than or equal to one, and the missing key frames are supplemented to obtain supplemented frame video stream data, including: Determine one by one whether the timestamp of each missing key frame is less than a first preset threshold value. If the timestamps of all the missing key frames are less than the first preset threshold value, re-request the complete video stream data from the authorization end; otherwise, generate supplementary frames based on the two adjacent frames of each missing key frame to obtain the complete video stream data, and the two adjacent frames are respectively the two key frames that are located one before and one after the missing key frame in time sequence.

3. The computer network data encryption security protection method according to claim 2 is characterized in that: Generating a supplementary frame based on two adjacent frames of each missing key frame, comprising: Count the number of missing keyframes; The loss frequency is calculated based on the timestamp corresponding to each missing key frame and the number of the missing key frames; When the loss frequency is less than a second preset threshold, performing linear interpolation calculation based on the image data of the two adjacent frames to obtain a supplementary frame; When the loss frequency is greater than or equal to a second preset threshold, a supplementary frame is calculated based on pixel changes in the image data of the two adjacent frames.

4. The computer network data encryption security protection method according to claim 3 is characterized in that: The interpolation frame is obtained based on the pixel change in the image data of the two adjacent frames, including: Calculating the estimated position of each pixel in the supplemented frame one by one based on a first preset formula and the image data of the two adjacent frames; Calculating the estimated pixel value of each pixel in the supplemented frame one by one based on a second preset formula and the image data of the two adjacent frames; The supplemented frame is constructed based on the estimated position and the estimated pixel value of each pixel in the supplemented frame.

5. A computer network data encryption security protection device, the device is used to implement the steps of the computer network data encryption security protection method according to any one of claims 1 to 4, characterized in that: include: A video receiving module, used for receiving video stream data; A frame parsing module, used for decoding and parsing the video stream data to obtain a video stream, wherein the video stream includes at least one key frame and a timestamp and a sequence number corresponding to each key frame; A key frame extraction module, used for analyzing the missing key frames in the video stream based on the timestamps and sequence numbers corresponding to all the key frames, wherein the missing key frames are key frames lost during the transmission process; The request module is used to request the authorization end to adjust the density of key frames in the untransmitted video stream data based on the network status, the number of missing key frames and the timestamp.

6. The computer network data encryption security protection device according to claim 5, characterized in that: The request module includes: A delay acquisition module, used to acquire multiple network delay values, wherein the network delay values ​​are all acquired during the period of receiving video stream data; A volatility calculation module, used to calculate a network volatility assessment value based on all the network delay values; A density module, configured to calculate a key frame density based on the network volatility evaluation value and a loss frequency, wherein the loss frequency is calculated from the number and timestamp of the missing key frames; The sending module is used to send the key frame density to the authorization end.

7. The computer network data encryption security protection device according to claim 5, characterized in that: Also includes: The frame interpolation module is used to interpolate the missing key frames to obtain interpolated video stream data.

8. A computer network data encryption security protection system, characterized in that: include: Memory for storing computer programs; A processor, used to implement the steps of the computer network data encryption security protection method as described in any one of claims 1 to 4 when executing the computer program.

Images