Video codec based on satellite high-delay channel transmission

By implementing detailed video preprocessing flow and video compression technology in the video codec, the problems of poor video quality, reduced transmission capability and decoder delay are solved, and efficient video data processing and adaptive transmission are achieved.

CN119854462APending Publication Date: 2025-04-18SHANGHAI YIRUIDE INFORMATION TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510334743.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-20
Publication Date
2025-04-18

AI Technical Summary

Technical Problem

The prior art fails to effectively process video data in video codecs, resulting in poor video quality, reduced transmission capability and data transmission delay in the decoder.

Method used

By implementing a detailed video preprocessing process in a video codec, including noise processing, inter-frame differential processing and image scaling processing, combined with video compression technology and adaptive packaging format, the transmission and decoding process of video data is optimized.

Benefits of technology

Improve video processing efficiency, ensure the improvement of video quality, reduce encoding complexity and data volume, and at the same time adapt to transmission protocols and packaging formats in different environments, reducing the delay in the decoder.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119854462A_ABST
    Figure CN119854462A_ABST
Patent Text Reader

Abstract

The invention discloses a video codec based on satellite high-delay channel transmission, relates to the technical field of video codec, and aims to solve the problem of poor transmission effect in the process of transmitting video data from an encoder to a decoder. According to the method, header information of video packaging data is analyzed in detail through the decoder, key information such as a timestamp, a serial number and the effective load length of the data is extracted, an accurate basis is provided for subsequent data recombination, intra-frame decoding focuses on data recovery in a single frame, and the decoding efficiency is improved. According to inter-frame decoding, redundant data are reduced through inter-frame correlation, so that the decoding speed is increased, the calculation complexity is reduced, the steps of noise processing, inter-frame differential processing, image scaling processing and the like are organically combined, a complete video preprocessing process is formed, the video processing efficiency can be greatly improved, and the decoding speed is increased. And the packaging format is confirmed according to the transmission requirement of the satellite transmission channel, so that different satellite transmission protocols and packaging formats can be flexibly adapted.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of video codecs, and in particular to a video codec based on satellite high-delay channel transmission. Background Art

[0002] A video codec is a hardware and software technology used to encode and decode video data. Its purpose is to reduce the size of video data for storage or transmission over a network while maintaining the quality of the video as much as possible so that the decompressed video is visually acceptable to the user.

[0003] The Chinese patent application with publication number CN101483775B discloses a method for transmitting a video stream between a video encoder and a video decoder through a wireless bidirectional channel, wherein the video frame is encoded mainly by determining a prediction (M) of a defined partition of a video frame of the video stream, the prediction (M) being based on: at least one reference area of ​​a reference frame of the video stream; a motion vector associated with the reference area; and a weighting factor associated with the reference area; wherein the difference between the partition and the corresponding predicted partition (M) is obtained to establish a partition residual; the encoded video stream with the partition residual is transmitted to a video decoder to decode the predicted partition (M), and the decoded partition (A) of the video frame is formed by combining the decoded predicted partition and the corresponding partition residual; the transmission error probability (PA) of the decoded partition (A) is fed back to the video encoder, and the transmission error probability is used in the cost function (J) of the motion estimation algorithm of the decoded partition (A) as the reference area. Although the above patent application solves the problem of data transmission between the video encoder and the video decoder, the following problems still exist in actual operation: 1. No further data processing and quality optimization are performed on the acquired video data, resulting in poor quality of the original video data.

[0004] 2. The encoder does not effectively compress and encapsulate the video data, resulting in reduced transmission capacity of the video data.

[0005] 3. The received video data is not decapsulated and decoded according to the compression and encapsulation standards in the decoder, resulting in data transmission delay in the decoder. Summary of the invention

[0006] The purpose of the present invention is to provide a video codec based on satellite high-latency channel transmission. The decoder performs detailed analysis on the header information of the video encapsulation data, extracts key information such as the timestamp, serial number and data payload length, and provides an accurate basis for subsequent data reorganization. Intra-frame decoding focuses on data recovery within a single frame, while inter-frame decoding uses the correlation between frames to reduce redundant data, thereby speeding up the decoding speed and reducing the computational complexity. By organically combining steps such as noise processing, inter-frame difference processing and image scaling processing to form a complete video preprocessing process, the efficiency of video processing can be greatly improved. The encapsulation format is confirmed according to the transmission requirements of the satellite transmission channel, and it can flexibly adapt to different satellite transmission protocols and encapsulation formats, which can solve the problems in the prior art.

[0007] To achieve the above object, the present invention provides the following technical solutions: The video codec based on satellite high-latency channel transmission includes the following steps: S1: Encoder video reception: The encoder receives the original video data and converts the format of the received original video data to obtain the video data to be processed after the format conversion is completed; S2: Video data processing: preprocessing the video data to be processed, including noise processing, inter-frame difference processing and image scaling processing, and obtaining the target video data after the preprocessing is completed; S3: video data compression and quantization: compressing the target video data using video compression technology, adjusting the quantization level of the compressed target video data, and obtaining quantized video data after the quantization level adjustment is completed; S4: Video data delay encapsulation: Segment the quantized video data and encapsulate them into video data packets. Prepare the video data packets for transmission according to the encapsulation format of satellite transmission, and obtain video encapsulation data after the transmission preparation. S5: Decoder receives and decapsulates: The decoder receives the video encapsulation data from the satellite transmission channel, and decapsulates the received video encapsulation data. During the decapsulation process, the video encapsulation data is checked, and after the video encapsulation data is decapsulated, the video decapsulation data is obtained. S6: decoding and quantization of received data: the decoder uses the same video compression technology as the encoder to compress and restore the video decapsulation data, and obtains the video decoding data after compression and restoration; S7: receiving data delay compensation: the decoder performs delay compensation processing on the timestamp information in the video decoding data, and obtains standard transmission video data after the delay compensation processing.

[0008] Preferably, the encoder in S1 receives the original video data and converts the format of the received original video data, including: The encoder receives raw video data from a video source through a wired or wireless connection. The video source includes a camera, a recording and broadcasting system, a storage device, or a video acquisition device. The encoder converts the received raw video data into raw video data in a standard format; When the original video data is converted to a standard format, it also includes color space conversion, resolution adjustment, and frame rate adjustment; After the standard format conversion is completed, the video data to be processed is obtained.

[0009] Preferably, the video data to be processed is preprocessed in S2, and the preprocessing includes noise processing, frame difference processing and image scaling processing, including: The video data to be processed is subjected to noise processing. The noise processing is to analyze the noise characteristics in the video data to be processed, and select a denoising algorithm according to the noise characteristics. The denoising algorithm includes a median filter, a bilateral filter or a filtering method based on a wavelet transform. After the denoising algorithm is confirmed to be completed, the video data to be processed is subjected to noise processing; Perform inter-frame difference processing on the video data to be processed. The inter-frame difference processing is to calculate the difference between consecutive frames and identify the motion vector. For the motion area in the video data to be processed whose motion change threshold is within the qualified range, the coding granularity is reduced. For the motion area in the video data to be processed whose motion change threshold is beyond the qualified range, high-precision coding is performed. Performing image scaling processing on the video data to be processed, wherein the image scaling processing is to scale the resolution of the video data to be processed by using a selected interpolation algorithm according to the target transmission bandwidth and the requirements of the display device, and the difference algorithm includes bilinear interpolation or bicubic interpolation; After the noise processing, inter-frame difference processing and image scaling processing of the video data to be processed are completed, the target video data is obtained.

[0010] Preferably, the resolution of the video data to be processed is scaled using a selected interpolation algorithm, including: Extracting the required parameters corresponding to the target transmission bandwidth; The required parameters corresponding to the target transmission bandwidth include bandwidth capacity and original resolution of the video data to be processed; Extracting a frame rate synchronization parameter corresponding to the target transmission bandwidth; wherein the frame rate synchronization parameter includes a reference frame rate and a transmission frame rate corresponding to the video data to be processed; Extracting the theoretical maximum bit rate, dynamic code adjustment ratio, actual bandwidth deviation and target reference bandwidth corresponding to the target transmission bandwidth; wherein the dynamic code adjustment ratio is set to a fluctuation tolerance of ±15%; Obtaining a first target resolution adjustment coefficient using the required parameters corresponding to the target transmission bandwidth, the frame rate synchronization parameters, the actual bandwidth deviation, the target reference bandwidth, the theoretical maximum bit rate, and the dynamic bit adjustment ratio; The first target resolution adjustment coefficient is obtained by the following formula: ; Among them, K 01 represents the first target resolution adjustment coefficient; C represents the bandwidth capacity; η represents the bandwidth utilization factor, and the bandwidth utilization factor has a value range of 0.85-1.2; C max represents the theoretical maximum bit rate; ΔC represents the actual bandwidth deviation; C t Indicates the target reference bandwidth; F c Indicates the transmission frame rate; F b represents the reference frame rate; erfc represents the sign of the complementary error function; W c Indicates the original resolution of the video data to be processed; W r Indicates the preset resolution reference value; Retrieving display operation parameters corresponding to the display device, and using the display operation parameters to obtain a second target resolution adjustment coefficient; Using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient, obtaining a target resolution corresponding to the video data to be processed and matching the target transmission bandwidth and the requirements of the display device; The resolution of the video data to be processed is scaled according to the target resolution using a selected interpolation algorithm.

[0011] Preferably, calling the display operation parameters corresponding to the display device and using the display operation parameters to obtain the second target resolution adjustment coefficient includes: Extracting display operation parameters corresponding to the display device, wherein the display operation parameters include native resolution and actual effective bandwidth corresponding to a display interface; Extracting timing parameters corresponding to the display device, wherein the timing parameters include a vertical refresh rate, a horizontal synchronization frequency, and a pixel clock; Obtaining a second target resolution adjustment coefficient using display operation parameters, timing parameters and pixel clock corresponding to the display device; The second target resolution adjustment coefficient is obtained by the following formula: ; Among them, K 02 represents the second target resolution adjustment coefficient; B represents the actual effective bandwidth corresponding to the display interface; W n and H nThey represent the horizontal resolution and vertical resolution corresponding to the native resolution respectively; V represents the vertical refresh rate; P represents the pixel clock; H represents the vertical refresh rate; f represents the horizontal synchronization frequency; x represents the bandwidth margin dynamic correction index; W s and H s They respectively represent the horizontal resolution and vertical resolution corresponding to the original resolution of the video data to be processed; erf represents the sign of the error function.

[0012] Preferably, using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain a target resolution corresponding to the to-be-processed video data that matches the target transmission bandwidth and the requirements of the display device includes: Retrieving a first target resolution adjustment coefficient and a second target resolution adjustment coefficient; Retrieve the preset initial compression ratio; The initial compression ratio is adjusted using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain an adjusted compression ratio; The adjusted compression ratio is obtained by the following formula: ; Among them, S represents the adjusted compression ratio; S c Indicates the preset initial compression ratio; K 01 Indicates the first target resolution adjustment coefficient; K 02 represents the second target resolution adjustment coefficient; Obtaining a target resolution using the adjusted compression ratio; The target resolution is obtained by the following formula: ; Among them, W m Indicates the target resolution; S indicates the adjusted compression ratio; W c Indicates the original resolution of the video data to be processed.

[0013] Preferably, in S3, the target video data is compressed by using a video compression technology, and the quantization level of the compressed target video data is adjusted, including: Determine the compression standard of the target video data according to the video content characteristics and transmission requirements of the target video data, wherein the video content characteristics and transmission requirements are retrieved from the video rule database; First, the target video data is divided into a number of macroblocks, where a macroblock is a certain area in the target video data, and the area includes a luminance component and a chrominance component; After the macroblock division is completed, intra-frame compression and inter-frame compression are performed. Intra-frame compression is to use discrete cosine transform to convert the pixel value of the spatial domain to the frequency domain, and transform and encode the brightness component and chrominance component of each macroblock respectively. Discrete cosine transform concentrates the energy in the image of the target video data on the corresponding coefficients, quantizes the corresponding coefficients, and encodes the quantized coefficients using entropy coding technology. The entropy coding method includes Huffman coding, arithmetic coding or exponential Golomb coding. At the same time, a loop filter is introduced in the coding process. After entropy coding is completed, intra-frame compressed and quantized data is obtained; Inter-frame compression is to find the best matching area in the reference frame for each macroblock and calculate the motion vector. According to the motion vector, the corresponding macroblock is obtained from the reference frame as the prediction macroblock, and the prediction macroblock is compared with the current macroblock to obtain the prediction error. The prediction error is transformed and quantized, and the motion vector and the quantized transform coefficient are entropy coded. After the entropy coding is completed, the inter-frame compressed and quantized data is obtained; The data compressed and quantized within a frame and the data compressed and quantized between frames are uniformly labeled as quantized video data.

[0014] Preferably, the quantized video data is segmented and encapsulated into video data packets in S4, and the video data packets are prepared for transmission according to the encapsulation format of satellite transmission, including: confirming the channel transmission volume of the satellite transmission channel, wherein the channel transmission volume of the satellite transmission channel is obtained from a database; The quantized video data is subjected to structured processing, and the header information, the payload and the tail information of the quantized video data are obtained after the structured processing; Dividing the quantized video data into a number of fixed-size data segments according to the channel transmission capacity, wherein the fixed size of each data segment does not exceed the channel transmission capacity; determining a packaging format according to a transmission requirement of a satellite transmission channel, wherein the transmission requirement of the satellite transmission channel is obtained from a database; Integrate each data segment with the structured header information according to the encapsulation format, and obtain an encapsulated video data packet after the integration is completed; The video data packets are stored in the buffer of the satellite transmission channel, and the video encapsulation data are obtained after the storage is completed.

[0015] Preferably, the decoder in S5 receives the video encapsulation data from the satellite transmission channel, and decapsulates the received video encapsulation data, and performs data inspection on the video encapsulation data during the decapsulation process, including: The decoder establishes a data receiving port through a satellite communication system and a transmission device, and after the data receiving port is established, the video encapsulation data is received; After receiving the video encapsulation data, the video encapsulation data is checked using the CRC check technology. If the check fails, the decoder issues an instruction to request retransmission of the missing or damaged data segment; The decoder decapsulates the received video encapsulation data. Decapsulation means that the decoder parses the header information in the video encapsulation data and obtains the timestamp, sequence number and payload length of the data in the header information after parsing. Then extract the payload from the video encapsulation data, reorganize the extracted payload according to the header information, and the decoder reorganizes the received multiple video data packets into continuous original quantized video data in the correct order according to the sequence number of the video data packet; The video encapsulation data is timestamped during the decapsulation process, and the frames are sorted and synchronized according to the timestamps. After the frame sorting and synchronization adjustment are completed, the video decapsulation data is obtained.

[0016] Preferably, the decoder in S6 uses the same video compression technology as the encoder to compress and restore the video decapsulation data, including: The compression standard in the encoder is obtained, and the decoder performs intra-frame decoding and inter-frame decoding on the video decapsulation data according to the compression standard of the encoder; Intra-frame decoding is to perform entropy decoding on the video decapsulation data, wherein the decoder and the encoder use the same entropy decoding method; after entropy decoding of the video decapsulation data, the quantization coefficients of the video decapsulation data are obtained, the quantization coefficients are inversely quantized, and the inversely quantized quantization coefficients are converted back to pixel values ​​in the spatial domain using an inverse discrete cosine transform; after inverse discrete cosine transform, a reconstructed video frame of the video decapsulation data is obtained, and after the video frame is reconstructed, the intra-frame decoding of the video decapsulation data is completed; Inter-frame decoding is that the decoder extracts motion vector information from the video unpacking data, uses the motion vector to extract the prediction macroblock from the reference frame, then performs entropy decoding on the prediction error, inversely quantizes the decoded prediction error data, converts the quantization system of the inversely quantized prediction error into an error value in the spatial domain, adds the decoded prediction error to the prediction macroblock, and reconstructs the video frame. After the video frame is reconstructed, the inter-frame decoding of the video unpacking data is completed; The video decapsulation data after inter-frame decoding and intra-frame decoding is sorted according to the timestamp and sequence number, and the synchronization of the video frames is adjusted according to the timestamp; After the synchronization adjustment is completed, the video decoding data is obtained; The decoder in S7 performs delay compensation processing on the timestamp information in the video decoding data, including: The decoder confirms the timestamp information of each video frame in the video decoding data; Combining the timestamp information with the network delay statistics, the network delay statistics are obtained from the database; The delay compensation value required for each frame is calculated by combining the timestamp information and the network delay statistics, and the calculated compensation value is added to the timestamp information. After the addition is completed, the actual playback order of the video is obtained; The video frames are sorted according to the timestamps obtained after compensation. During the video playback, the timestamps are used to ensure the synchronization of audio and video. At the same time, during the video playback process, the playback status and user feedback are collected and monitored in real time, and a user feedback mechanism is established.

[0017] Compared with the prior art, the present invention has the following beneficial effects: 1. The video codec based on satellite high-latency channel transmission provided by the present invention can reduce the coding granularity of the motion area where the motion change threshold is within the qualified range, thereby reducing the coding complexity and improving the coding efficiency; and high-precision coding is performed on the areas with large motion changes, thereby ensuring that the details of these areas are not lost, thereby reducing the amount of encoded data while ensuring the video quality. By organically combining the steps of noise processing, inter-frame difference processing and image scaling processing to form a complete video preprocessing process, the efficiency of video processing can be greatly improved.

[0018] 2. The video codec based on satellite high-latency channel transmission provided by the present invention, the division of macroblocks and the application of intra-frame and inter-frame compression technology enable the solution to adapt to video data of different resolutions and complexities, confirm the encapsulation format according to the transmission requirements of the satellite transmission channel, and integrate each data segment with the structured header information accordingly. It can flexibly adapt to different satellite transmission protocols and encapsulation formats, ensuring that data can be correctly transmitted in different environments.

[0019] 3. The video codec based on satellite high-latency channel transmission provided by the present invention, the decoder performs a detailed analysis of the header information of the video encapsulation data, extracts key information such as the timestamp, sequence number and data payload length, and provides an accurate basis for subsequent data reconstruction. Intra-frame decoding focuses on data recovery within a single frame, while inter-frame decoding uses the correlation between frames to reduce redundant data, thereby speeding up the decoding speed and reducing the computational complexity. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of the operation steps of a video codec for high-latency channel transmission according to the present invention; Figure 2 The present invention is a schematic diagram of the operation flow of a video codec for high-latency channel transmission. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] In order to solve the problem in the prior art that the encoder does not further process and optimize the quality of the acquired video data after acquiring the video data, thereby resulting in poor quality of the original video data, please refer to Figure 1 and Figure 2 , this embodiment provides the following technical solutions: The video codec based on satellite high-latency channel transmission includes the following steps: S1: Encoder video reception: The encoder receives the original video data and converts the format of the received original video data to obtain the video data to be processed after the format conversion is completed; Among them, the format conversion through the encoder can convert the original video data into a unified standard format, simplifying the subsequent video processing process; S2: Video data processing: preprocessing the video data to be processed, including noise processing, inter-frame difference processing and image scaling processing, and obtaining the target video data after the preprocessing is completed; Among them, by organically combining the steps of noise processing, inter-frame difference processing and image scaling processing to form a complete video preprocessing process, the efficiency of video processing can be greatly improved; S3: video data compression and quantization: compressing the target video data using video compression technology, adjusting the quantization level of the compressed target video data, and obtaining quantized video data after the quantization level adjustment is completed; Among them, compressed video data is easier to manage and back up, which can save a lot of time and energy; S4: Video data delay encapsulation: Segment the quantized video data and encapsulate them into video data packets. According to the encapsulation format of satellite transmission, prepare the video data packets for transmission, and obtain video encapsulation data after the transmission preparation. Among them, confirming the encapsulation format according to the transmission requirements of the satellite transmission channel can ensure that the data can be correctly transmitted in different environments; S5: Decoder receives and decapsulates: The decoder receives the video encapsulation data from the satellite transmission channel, and decapsulates the received video encapsulation data. During the decapsulation process, the video encapsulation data is checked, and after the video encapsulation data is decapsulated, the video decapsulation data is obtained; Among them, the decoder checks the timestamp in the video encapsulation data to ensure that the timestamp information of each data packet is accurate; S6: decoding and quantization of received data: the decoder uses the same video compression technology as the encoder to compress and restore the video decapsulation data, and obtains the video decoding data after compression and restoration; Among them, through accurate motion vector extraction and prediction error processing, the decoder can correct slight data corruption that may occur during transmission or storage to a certain extent, improving the robustness of decoding; S7: receiving data delay compensation: the decoder performs delay compensation processing on the timestamp information in the video decoding data, and obtains standard transmission video data after the delay compensation processing; Among them, the delay compensation value required for each frame is calculated by combining the timestamp information and network delay statistics, and added to the timestamp information, which effectively compensates for the audio and video synchronization problem caused by network delay.

[0023] The encoder in S1 receives the original video data and converts the format of the received original video data, including: The encoder receives raw video data from a video source through a wired or wireless connection. The video source includes a camera, a recording and broadcasting system, a storage device, or a video acquisition device. The encoder converts the received raw video data into raw video data in a standard format; When the original video data is converted to a standard format, it also includes color space conversion, resolution adjustment, and frame rate adjustment; After the standard format conversion is completed, the video data to be processed is obtained.

[0024] Specifically, the encoder converts the raw video data into a standard format, which greatly enhances the compatibility and interoperability of the video data. Different devices, platforms or software may support different video formats, but video data in a standard format can be more easily identified, read and processed in these environments. During the standard format conversion process, the encoder performs operations such as color space conversion, resolution adjustment and frame rate adjustment. These operations help optimize the video quality to make it more in line with specific playback or transmission requirements. For example, adjusting the resolution can ensure that the video is displayed in the best way on different devices, while adjusting the frame rate can improve the smoothness and dynamic effects of the video. Through the encoder for format conversion, the raw video data can be converted into a unified standard format, which simplifies the subsequent video processing process because there is no need for additional conversion or adaptation of video data in different formats.

[0025] The video data to be processed in S2 is preprocessed, and the preprocessing includes noise processing, inter-frame difference processing and image scaling processing, including: The video data to be processed is subjected to noise processing. The noise processing is to analyze the noise characteristics in the video data to be processed, and select a denoising algorithm according to the noise characteristics. The denoising algorithm includes a median filter, a bilateral filter or a filtering method based on a wavelet transform. After the denoising algorithm is confirmed to be completed, the video data to be processed is subjected to noise processing; Perform inter-frame difference processing on the video data to be processed. The inter-frame difference processing is to calculate the difference between consecutive frames and identify the motion vector. For the motion area in the video data to be processed whose motion change threshold is within the qualified range, the coding granularity is reduced. For the motion area in the video data to be processed whose motion change threshold is beyond the qualified range, high-precision coding is performed. Performing image scaling processing on the video data to be processed, wherein the image scaling processing is to scale the resolution of the video data to be processed by using a selected interpolation algorithm according to the target transmission bandwidth and the requirements of the display device, and the difference algorithm includes bilinear interpolation or bicubic interpolation; After the noise processing, inter-frame difference processing and image scaling processing of the video data to be processed are completed, the target video data is obtained.

[0026] Specifically, by using median filtering, bilateral filtering or filtering methods based on wavelet transform, the noise in the video can be effectively removed, making the video picture clearer and improving the viewing experience. By calculating the difference between consecutive frames, the motion area can be identified and processed, making the motion picture smoother and reducing the picture blur or distortion caused by motion changes. The coding particles of the motion area with a motion change threshold within the qualified range can be reduced, which can reduce the coding complexity and improve the coding efficiency. High-precision coding of areas with large motion changes can ensure that the details of these areas are not lost, thereby reducing the amount of encoded data while ensuring the video quality. According to the requirements of the target transmission bandwidth and display device, the video resolution can be scaled using algorithms such as bilinear interpolation or bicubic interpolation to ensure that the video can maintain a good display effect in different devices and network environments. This flexibility enables video data to better adapt to various application scenarios. By organically combining steps such as noise processing, inter-frame difference processing and image scaling processing to form a complete video preprocessing process, the efficiency of video processing can be greatly improved. At the same time, the synergy between these processing steps can further improve the overall quality of the video.

[0027] Specifically, the resolution of the video data to be processed is scaled using a selected interpolation algorithm, including: Extracting the required parameters corresponding to the target transmission bandwidth; The required parameters corresponding to the target transmission bandwidth include bandwidth capacity and original resolution of the video data to be processed; Extracting a frame rate synchronization parameter corresponding to the target transmission bandwidth; wherein the frame rate synchronization parameter includes a reference frame rate and a transmission frame rate corresponding to the video data to be processed; Extracting the theoretical maximum bit rate, dynamic code adjustment ratio, actual bandwidth deviation and target reference bandwidth corresponding to the target transmission bandwidth; wherein the dynamic code adjustment ratio is set to a fluctuation tolerance of ±15%; Obtaining a first target resolution adjustment coefficient using the required parameters corresponding to the target transmission bandwidth, the frame rate synchronization parameters, the actual bandwidth deviation, the target reference bandwidth, the theoretical maximum bit rate, and the dynamic bit adjustment ratio; The first target resolution adjustment coefficient is obtained by the following formula: ; Among them, K 01 represents the first target resolution adjustment coefficient; C represents the bandwidth capacity; η represents the bandwidth utilization factor, and the bandwidth utilization factor has a value range of 0.85-1.2; C max represents the theoretical maximum bit rate; ΔC represents the actual bandwidth deviation; C t Indicates the target reference bandwidth; F c Indicates the transmission frame rate; F b represents the reference frame rate; erfc represents the sign of the complementary error function; W c Indicates the original resolution of the video data to be processed; W r Indicates the preset resolution reference value; Retrieving display operation parameters corresponding to the display device, and using the display operation parameters to obtain a second target resolution adjustment coefficient; Using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient, obtaining a target resolution corresponding to the video data to be processed and matching the target transmission bandwidth and the requirements of the display device; The resolution of the video data to be processed is scaled according to the target resolution using a selected interpolation algorithm.

[0028] The technical effect of the above technical solution is: by extracting the required parameters corresponding to the target transmission bandwidth (such as bandwidth capacity, original resolution of the video data to be processed), the solution can adaptively adjust the resolution of the video data to match the available network bandwidth. This helps to ensure the smoothness of video transmission and avoid buffering or freezing caused by insufficient bandwidth. Extracting frame rate synchronization parameters (base frame rate and transmission frame rate) enables the video to maintain frame rate stability during transmission, thereby avoiding screen tearing or synchronization problems caused by frame rate mismatch. At the same time, by adjusting the resolution, the solution can maintain the video quality as much as possible while maintaining frame rate stability. By introducing a dynamic code adjustment ratio (set to a fluctuation tolerance of ±15%) and an actual bandwidth deviation, the solution can dynamically adjust the bit rate of the video data to adapt to fluctuations in the network bandwidth. This enhances the fault tolerance of the solution, enabling it to provide better video transmission quality even when the network is unstable. By retrieving the display operation parameters corresponding to the display device and using these parameters to obtain the second target resolution adjustment coefficient, the solution can ensure that the video data is displayed at the best resolution on a specific display device. This helps to improve the user experience and enable video content to present the best visual effects on different devices. The target resolution obtained by using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient is combined with the selected interpolation algorithm to scale the resolution of the video data to be processed. This method not only improves the efficiency of video scaling, but also ensures that the scaled video data can meet the requirements of the target transmission bandwidth and display device in terms of quality and resolution.

[0029] In summary, this technical solution achieves efficient and adaptive adjustment of video data resolution by comprehensively considering multiple factors such as network bandwidth, frame rate synchronization, and display device adaptation. This helps to improve the smoothness, stability, and image quality of video transmission, thereby providing users with a better video viewing experience.

[0030] Specifically, calling the display operation parameters corresponding to the display device, and using the display operation parameters to obtain the second target resolution adjustment coefficient includes: Extracting display operation parameters corresponding to the display device, wherein the display operation parameters include native resolution and actual effective bandwidth corresponding to a display interface; Extracting timing parameters corresponding to the display device, wherein the timing parameters include a vertical refresh rate, a horizontal synchronization frequency, and a pixel clock; Obtaining a second target resolution adjustment coefficient using display operation parameters, timing parameters and pixel clock corresponding to the display device; The second target resolution adjustment coefficient is obtained by the following formula: ; Among them, K02 represents the second target resolution adjustment coefficient; B represents the actual effective bandwidth corresponding to the display interface; W n and H n They represent the horizontal resolution and vertical resolution corresponding to the native resolution respectively; V represents the vertical refresh rate; P represents the pixel clock; H represents the vertical refresh rate; f represents the horizontal synchronization frequency; x represents the bandwidth margin dynamic correction index; W s and H s They respectively represent the horizontal resolution and vertical resolution corresponding to the original resolution of the video data to be processed; erf represents the sign of the error function.

[0031] The technical effect of the above technical solution is: by extracting the display operating parameters of the display device (such as the native resolution and the actual effective bandwidth corresponding to the display interface) and timing parameters (such as vertical refresh rate, horizontal synchronization frequency and pixel clock), the solution can accurately understand the performance and limitations of the display device. This helps to ensure that when the video data is transmitted to the display device, it can be displayed at the resolution and refresh rate that is most suitable for the device, thereby improving the picture quality and user experience. Utilizing the actual effective bandwidth of the display interface and the bandwidth margin dynamic correction index x, the solution can dynamically adjust the resolution of the video data to adapt to the bandwidth limitations of the display device. This helps to prevent screen freezes or distortion problems caused by insufficient bandwidth, while ensuring smooth transmission of video data. By calculating the second target resolution adjustment coefficient K 02 , the solution can accurately adjust the resolution of the video data to be processed according to the specific parameters of the display device. This adjustment not only takes into account the native resolution and bandwidth limitations of the display device, but also takes into account the impact of timing parameters on video display, thereby ensuring the best presentation effect of video data on the display device. The solution can be applied to display devices of different models and specifications, and only the corresponding display operation parameters and timing parameters need to be extracted. This flexibility enables the solution to be widely used in various video transmission and display scenarios to meet the needs of different users. By accurately adapting the display device and optimizing the video data, the solution can enhance the user experience when watching videos. Whether it is the clarity, smoothness or refresh rate of the picture, it can be significantly improved, allowing users to enjoy a more realistic and delicate video viewing effect.

[0032] In summary, this technical solution achieves precise adjustment and optimization of video data resolution by comprehensively considering multiple factors such as display operation parameters, timing parameters, and pixel clock of the display device. This helps to improve the presentation effect of the video on the display device and enhance the user experience satisfaction.

[0033] Specifically, using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain a target resolution corresponding to the to-be-processed video data that matches the target transmission bandwidth and the requirements of the display device includes: Retrieving a first target resolution adjustment coefficient and a second target resolution adjustment coefficient; Retrieve the preset initial compression ratio; The initial compression ratio is adjusted using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain an adjusted compression ratio; The adjusted compression ratio is obtained by the following formula: ; Among them, S represents the adjusted compression ratio; S c Indicates the preset initial compression ratio; K 01 Represents the first target resolution adjustment coefficient; K 02 represents the second target resolution adjustment coefficient; Obtaining a target resolution using the adjusted compression ratio; The target resolution is obtained by the following formula: ; Among them, W m Indicates the target resolution; S indicates the adjusted compression ratio; W c Indicates the original resolution of the video data to be processed.

[0034] The technical effect of the above technical solution is: the solution comprehensively considers the first target resolution adjustment coefficient (K 01 ) and the second target resolution adjustment coefficient (K 02 ), for the preset initial compression ratio (S c) to obtain an adjusted compression ratio (S) that meets the target transmission bandwidth requirements and adapts to the characteristics of the display device. This comprehensive adjustment method ensures that the video data can maintain the best resolution and image quality during transmission and display. By adjusting the compression ratio, the solution can reduce the size of video data as much as possible while ensuring the video quality, thereby optimizing the video transmission efficiency. This helps to reduce the network bandwidth occupancy and improve the smoothness and stability of video transmission. The solution can dynamically adjust the resolution of video data according to different display devices and network bandwidth conditions. This dynamic adaptation capability enables video data to present the best visual effects in various environments, enhancing the adaptability and compatibility of the video. By accurately calculating and adjusting the target resolution, the solution can ensure that the video is played at the most suitable resolution on the display device. This not only improves the clarity and fineness of the picture, but also avoids the picture distortion or freeze caused by resolution mismatch, thereby improving the user's viewing experience. The solution simplifies the operation process of video resolution adjustment through a formulaic calculation method. By simply entering the relevant parameter values, the target resolution and the adjusted compression ratio can be quickly calculated, reducing the difficulty and complexity of the operation.

[0035] In summary, the technical solution comprehensively considers the target transmission bandwidth and the requirements of the display device, and uses the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to adjust the initial compression ratio, thereby obtaining a target resolution that meets the transmission requirements and is suitable for the display device. This solution not only optimizes the video transmission efficiency, but also enhances the adaptability and compatibility of the video, and improves the user's viewing experience.

[0036] In order to solve the problem in the prior art that the encoder does not effectively compress and encapsulate the video data, thereby reducing the transmission capacity of the video data, please refer to Figure 1 and Figure 2 , this embodiment provides the following technical solutions: In view of compressing the target video data by using the video compression technology in S3, the quantization level of the compressed target video data is adjusted, including: Determine the compression standard of the target video data according to the video content characteristics and transmission requirements of the target video data, wherein the video content characteristics and transmission requirements are retrieved from the video rule database; First, the target video data is divided into a number of macroblocks, where a macroblock is a certain area in the target video data, and the area includes a luminance component and a chrominance component; After the macroblock division is completed, intra-frame compression and inter-frame compression are performed. Intra-frame compression is to use discrete cosine transform to convert the pixel value of the spatial domain to the frequency domain, and transform and encode the brightness component and chrominance component of each macroblock respectively. Discrete cosine transform concentrates the energy in the image of the target video data on the corresponding coefficients, quantizes the corresponding coefficients, and encodes the quantized coefficients using entropy coding technology. The entropy coding method includes Huffman coding, arithmetic coding or exponential Golomb coding. At the same time, a loop filter is introduced in the coding process. After entropy coding is completed, intra-frame compressed and quantized data is obtained; Inter-frame compression is to find the best matching area in the reference frame for each macroblock and calculate the motion vector. According to the motion vector, the corresponding macroblock is obtained from the reference frame as the prediction macroblock, and the prediction macroblock is compared with the current macroblock to obtain the prediction error. The prediction error is transformed and quantized, and the motion vector and the quantized transform coefficient are entropy coded. After the entropy coding is completed, the inter-frame compressed and quantized data is obtained; The data compressed and quantized within a frame and the data compressed and quantized between frames are uniformly labeled as quantized video data.

[0037] Specifically, through video compression technology, the size of video data can be significantly reduced, thereby saving storage space. Compressed video data is easier to transmit, especially in a network environment with limited bandwidth, which can reduce transmission costs and improve transmission efficiency. The introduction of technologies such as loop filters in the compression process helps to reduce distortion and blurring during the compression process, thereby maintaining good video quality. By transform encoding and quantizing the luminance component and chrominance component of the macroblock, the key information in the video can be more effectively retained, while removing redundant information. The compression standard can be determined according to the video content characteristics and transmission requirements of the target video data to meet the needs of different scenarios. The division of macroblocks and the application of intra-frame and inter-frame compression technology enable the scheme to adapt to video data of different resolutions and complexities. The redundant information and error detection code mechanisms introduced in the encoding process enable the scheme to have strong error recovery capabilities during network transmission. This helps to ensure that video data can still be played normally in a poor network environment, reducing freezes and screen distortion. The compressed video data is easier to manage and back up, which can save a lot of time and energy. At the same time, the compressed video data is also easier to recover, which helps to ensure the integrity and security of the data.

[0038] In S4, the quantized video data is segmented and encapsulated into video data packets, and the video data packets are prepared for transmission according to the encapsulation format of satellite transmission, including: confirming the channel transmission volume of the satellite transmission channel, wherein the channel transmission volume of the satellite transmission channel is obtained from a database; The quantized video data is subjected to structured processing, and the header information, the payload and the tail information of the quantized video data are obtained after the structured processing; Dividing the quantized video data into a number of fixed-size data segments according to the channel transmission capacity, wherein the fixed size of each data segment does not exceed the channel transmission capacity; determining a packaging format according to a transmission requirement of a satellite transmission channel, wherein the transmission requirement of the satellite transmission channel is obtained from a database; Integrate each data segment with the structured header information according to the encapsulation format, and obtain an encapsulated video data packet after the integration is completed; The video data packets are stored in the buffer of the satellite transmission channel, and the video encapsulation data are obtained after the storage is completed.

[0039] Specifically, the channel transmission volume of the satellite transmission channel is confirmed, and the quantized video data is divided into several fixed-size data segments accordingly. This processing method can ensure that the size of each data segment does not exceed the transmission capacity of the channel, thereby avoiding data loss or damage during transmission and improving transmission efficiency. By performing structured processing on the quantized video data, the header information, payload and tail information of the data are obtained. This processing method helps to effectively manage and control the data during transmission and ensure the integrity and accuracy of the data. At the same time, the data description and metadata contained in the header information can help the receiving end to correctly decode and restore the data after receiving it. The encapsulation format is confirmed according to the transmission requirements of the satellite transmission channel, and each data segment is integrated with the structured header information accordingly. It can flexibly adapt to different satellite transmission protocols and encapsulation formats, ensuring that data can be correctly transmitted in different environments. The encapsulated video data packets are stored in the buffer of the satellite transmission channel, which helps to optimize the data storage and transmission process. The buffer can temporarily store the data to be transmitted to ensure the continuity and stability of the data during transmission. At the same time, this processing method also helps to reduce the delay and jitter of data during transmission. By segmenting and packaging the quantized video data and performing necessary management and control during the transmission process, the security and reliability of transmission can be significantly improved. In addition, satellite transmission itself has the characteristics of wide coverage and long transmission distance, which also helps to ensure that data can be correctly transmitted in different geographical environments.

[0040] In order to solve the problem in the prior art that after receiving the video data from the encoder, the decoder does not decapsulate and decode the received video data according to the compression and encapsulation standards in the decoder, thereby causing data transmission delay in the decoder, please refer to Figure 1 and Figure 2 , this embodiment provides the following technical solutions: The decoder in S5 receives the video encapsulation data from the satellite transmission channel and decapsulates the received video encapsulation data. During the decapsulation process, the video encapsulation data is checked, including: The decoder establishes a data receiving port through a satellite communication system and a transmission device, and after the data receiving port is established, the video encapsulation data is received; After receiving the video encapsulation data, the CRC check technology is used to check the video encapsulation data. If the check fails, the decoder sends an instruction to request retransmission of the missing or damaged data segment; wherein the CRC check technology is a cyclic redundancy check, which is an error detection method widely used in the field of digital communications; The decoder decapsulates the received video encapsulation data. Decapsulation means that the decoder parses the header information in the video encapsulation data and obtains the timestamp, sequence number and payload length of the data in the header information after parsing. Then extract the payload from the video encapsulation data, reorganize the extracted payload according to the header information, and the decoder reorganizes the received multiple video data packets into continuous original quantized video data in the correct order according to the sequence number of the video data packet; The video encapsulation data is timestamped during the decapsulation process, and the frames are sorted and synchronized according to the timestamps. After the frame sorting and synchronization adjustment are completed, the video decapsulation data is obtained.

[0041] Specifically, the decoder quickly establishes a data receiving port through a satellite communication system and transmission equipment to ensure timely reception of video encapsulation data. The received video encapsulation data is strictly checked using CRC verification technology, which can accurately identify and request retransmission of missing or damaged data segments, thereby ensuring the integrity and accuracy of the data. The decoder performs detailed analysis of the header information of the video encapsulation data, extracts key information such as timestamps, sequence numbers, and payload length of the data, and provides an accurate basis for subsequent data reorganization. The payload is extracted according to the header information, and multiple data packets are correctly reorganized into continuous original quantized video data according to the sequence number of the data packet to ensure the integrity and continuity of the video data. During the decapsulation process, the decoder checks the timestamp in the video encapsulation data to ensure that the timestamp information of each data packet is accurate. The frames are sorted and synchronized according to the timestamp information to eliminate the problem of frame disorder or loss caused by transmission delay or data packet loss, thereby ensuring the smoothness and continuity of video playback. By requesting retransmission of missing or damaged data segments, the error rate in the data transmission process is effectively reduced, and the reliability of data transmission is improved. The sophisticated data verification and reorganization process further enhances the stability and accuracy of data transmission, ensuring that the video data can be transmitted to the decoder end in a complete and accurate manner.

[0042] The decoder in S6 uses the same video compression technology as the encoder to compress and restore the video decapsulation data, including: The compression standard in the encoder is obtained, and the decoder performs intra-frame decoding and inter-frame decoding on the video decapsulation data according to the compression standard of the encoder; Intra-frame decoding is to perform entropy decoding on the video decapsulation data, wherein the decoder and the encoder use the same entropy decoding method; after entropy decoding of the video decapsulation data, the quantization coefficients of the video decapsulation data are obtained, the quantization coefficients are inversely quantized, and the inversely quantized quantization coefficients are converted back to pixel values ​​in the spatial domain using an inverse discrete cosine transform; after inverse discrete cosine transform, a reconstructed video frame of the video decapsulation data is obtained, and after the video frame is reconstructed, the intra-frame decoding of the video decapsulation data is completed; Inter-frame decoding is that the decoder extracts motion vector information from the video unpacking data, uses the motion vector to extract the prediction macroblock from the reference frame, then performs entropy decoding on the prediction error, inversely quantizes the decoded prediction error data, converts the quantization system of the inversely quantized prediction error into an error value in the spatial domain, adds the decoded prediction error to the prediction macroblock, and reconstructs the video frame. After the video frame is reconstructed, the inter-frame decoding of the video unpacking data is completed; The video decapsulation data after inter-frame decoding and intra-frame decoding is sorted according to the timestamp and sequence number, and the synchronization of the video frames is adjusted according to the timestamp; After the synchronization adjustment is completed, the video decoding data is obtained.

[0043] Specifically, since the decoder fully complies with the compression standard of the encoder, including using the same entropy decoding method, inverse quantization process, and inverse discrete cosine transform, this ensures that the video data can highly restore the original video information after decoding, ensuring the video quality, and can process video data compressed by a specific encoder, which means that as long as the encoder and decoder use the same compression standard, the decoder can successfully decode any video data generated by the encoder, which enhances the compatibility and flexibility of the system. The division of labor between intra-frame decoding and inter-frame decoding improves the efficiency of video decoding. Intra-frame decoding focuses on data recovery within a single frame, while inter-frame decoding uses the correlation between frames to reduce redundant data, thereby speeding up decoding and reducing computational complexity. Through precise motion vector extraction and prediction error processing, the decoder can correct minor data corruption that may occur during transmission or storage to a certain extent, improving the robustness of decoding. During the decoding process, the decoded video frames are sorted and synchronized according to the timestamp and sequence number, ensuring the smoothness and temporal continuity of video playback, which is crucial for the video viewing experience.

[0044] The decoder in S7 performs delay compensation processing on the timestamp information in the video decoding data, including: The decoder confirms the timestamp information of each video frame in the video decoding data; Combining the timestamp information with the network delay statistics, the network delay statistics are obtained from the database; The delay compensation value required for each frame is calculated by combining the timestamp information and the network delay statistics, and the calculated compensation value is added to the timestamp information. After the addition is completed, the actual playback order of the video is obtained; The video frames are sorted according to the timestamps obtained after compensation. During the video playback, the timestamps are used to ensure the synchronization of audio and video. At the same time, during the video playback process, the playback status and user feedback are collected and monitored in real time, and a user feedback mechanism is established.

[0045] Specifically, by confirming the timestamp information of each video frame in the video decoding data, the accuracy and integrity of the timestamp are ensured. This helps the decoder to accurately identify the playback time of each video frame during the decoding process, and calculates the delay compensation value required for each frame by combining the timestamp information and network delay statistics, and adds it to the timestamp information. This step effectively compensates for the audio and video asynchrony caused by network delay, so that the real playback order of the video can be restored. During the video playback process, the video frames are sorted by the compensated timestamps to ensure the synchronous playback of the audio and video content. This greatly improves the user's viewing experience and avoids the trouble of inconsistent audio and video content. Through user feedback and real-time monitoring data, the decoder can dynamically adjust the playback strategy, such as adjusting the buffering time, changing the decoding rate, etc., to adapt to different network environments and user needs. This flexibility makes video playback smoother and more stable, and ensures the accuracy and integrity of video data through strict timestamp confirmation and delay compensation calculation. This helps to reduce playback problems caused by data errors or loss and improve the reliability and stability of the system.

[0046] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0047] While the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that many changes, modifications, substitutions and variations can be made to the embodiments without departing from the principles and spirit of the invention.

Claims

1. A video codec based on satellite high-latency channel transmission, characterized in that: The steps include: S1: Encoder video reception: The encoder receives the original video data and converts the format of the received original video data to obtain the video data to be processed after the format conversion is completed; S2: Video data processing: preprocessing the video data to be processed, including noise processing, inter-frame difference processing and image scaling processing, and obtaining the target video data after the preprocessing is completed; S3: video data compression and quantization: compressing the target video data using video compression technology, adjusting the quantization level of the compressed target video data, and obtaining quantized video data after the quantization level adjustment is completed; S4: Video data delay encapsulation: Segment the quantized video data and encapsulate them into video data packets. Prepare the video data packets for transmission according to the encapsulation format of satellite transmission, and obtain video encapsulation data after the transmission preparation. S5: Decoder receives and decapsulates: The decoder receives the video encapsulation data from the satellite transmission channel, and decapsulates the received video encapsulation data. During the decapsulation process, the video encapsulation data is checked, and after the video encapsulation data is decapsulated, the video decapsulation data is obtained. S6: decoding and quantization of received data: the decoder uses the same video compression technology as the encoder to compress and restore the video decapsulation data, and obtains the video decoding data after compression and restoration; S7: receiving data delay compensation: the decoder performs delay compensation processing on the timestamp information in the video decoding data, and obtains standard transmission video data after the delay compensation processing.

2. The video codec based on satellite high-latency channel transmission according to claim 1, characterized in that: The encoder in S1 receives the original video data and converts the format of the received original video data, including: The encoder receives raw video data from a video source through a wired or wireless connection. The video source includes a camera, a recording and broadcasting system, a storage device, or a video acquisition device. The encoder converts the received raw video data into raw video data in a standard format; When the original video data is converted to a standard format, it also includes color space conversion, resolution adjustment, and frame rate adjustment; After the standard format conversion is completed, the video data to be processed is obtained.

3. The video codec based on satellite high-latency channel transmission according to claim 2, characterized in that: The video data to be processed in S2 is preprocessed, and the preprocessing includes noise processing, inter-frame difference processing and image scaling processing, including: The video data to be processed is subjected to noise processing. The noise processing is to analyze the noise characteristics in the video data to be processed, and select a denoising algorithm according to the noise characteristics. The denoising algorithm includes a median filter, a bilateral filter or a filtering method based on a wavelet transform. After the denoising algorithm is confirmed to be completed, the video data to be processed is subjected to noise processing; Perform inter-frame difference processing on the video data to be processed. The inter-frame difference processing is to calculate the difference between consecutive frames and identify the motion vector. For the motion area in the video data to be processed whose motion change threshold is within the qualified range, the coding granularity is reduced. For the motion area in the video data to be processed whose motion change threshold is beyond the qualified range, high-precision coding is performed. Performing image scaling processing on the video data to be processed, wherein the image scaling processing is to scale the resolution of the video data to be processed by using a selected interpolation algorithm according to the target transmission bandwidth and the requirements of the display device, and the difference algorithm includes bilinear interpolation or bicubic interpolation; After the noise processing, inter-frame difference processing and image scaling processing of the video data to be processed are completed, the target video data is obtained.

4. The video codec based on satellite high-latency channel transmission according to claim 3, characterized in that: The resolution of the processed video data is scaled using a selected interpolation algorithm, including: Extracting the required parameters corresponding to the target transmission bandwidth; The required parameters corresponding to the target transmission bandwidth include bandwidth capacity and original resolution of the video data to be processed; Extracting a frame rate synchronization parameter corresponding to the target transmission bandwidth; wherein the frame rate synchronization parameter includes a reference frame rate and a transmission frame rate corresponding to the video data to be processed; Extracting the theoretical maximum bit rate, dynamic code adjustment ratio, actual bandwidth deviation and target reference bandwidth corresponding to the target transmission bandwidth; wherein the dynamic code adjustment ratio is set to a fluctuation tolerance of ±15%; Obtaining a first target resolution adjustment coefficient using the required parameters corresponding to the target transmission bandwidth, the frame rate synchronization parameters, the actual bandwidth deviation, the target reference bandwidth, the theoretical maximum bit rate, and the dynamic bit adjustment ratio; The first target resolution adjustment coefficient is obtained by the following formula: ; Among them, K 01 represents the first target resolution adjustment coefficient; C represents the bandwidth capacity; η represents the bandwidth utilization factor, and the bandwidth utilization factor has a value range of 0.85-1.2; C max represents the theoretical maximum bit rate; ΔC represents the actual bandwidth deviation; C t Indicates the target reference bandwidth; F c Indicates the transmission frame rate; F b represents the reference frame rate; erfc represents the sign of the complementary error function; W c Indicates the original resolution of the video data to be processed; W r Indicates the preset resolution reference value; Retrieving display operation parameters corresponding to the display device, and using the display operation parameters to obtain a second target resolution adjustment coefficient; Using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient, obtaining a target resolution corresponding to the video data to be processed and matching the target transmission bandwidth and the requirements of the display device; The resolution of the video data to be processed is scaled according to the target resolution using a selected interpolation algorithm.

5. The video codec based on satellite high-delay channel transmission according to claim 4, characterized in that: Retrieving display operation parameters corresponding to the display device, and using the display operation parameters to obtain a second target resolution adjustment coefficient, including: Extracting display operation parameters corresponding to the display device, wherein the display operation parameters include native resolution and actual effective bandwidth corresponding to a display interface; Extracting timing parameters corresponding to the display device, wherein the timing parameters include a vertical refresh rate, a horizontal synchronization frequency, and a pixel clock; Obtaining a second target resolution adjustment coefficient using display operation parameters, timing parameters and pixel clock corresponding to the display device; The second target resolution adjustment coefficient is obtained by the following formula: ; Among them, K 02 represents the second target resolution adjustment coefficient; B represents the actual effective bandwidth corresponding to the display interface; W n and H n They represent the horizontal resolution and vertical resolution corresponding to the native resolution respectively; V represents the vertical refresh rate; P represents the pixel clock; H represents the vertical refresh rate; f represents the horizontal synchronization frequency; x represents the bandwidth margin dynamic correction index; W s and H s They respectively represent the horizontal resolution and vertical resolution corresponding to the original resolution of the video data to be processed; erf represents the sign of the error function.

6. The video codec based on satellite high-delay channel transmission according to claim 4, characterized in that: Using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain a target resolution corresponding to the to-be-processed video data and matching the target transmission bandwidth and the requirements of the display device, includes: Retrieving a first target resolution adjustment coefficient and a second target resolution adjustment coefficient; Retrieve the preset initial compression ratio; The initial compression ratio is adjusted using the first target resolution adjustment coefficient and the second target resolution adjustment coefficient to obtain an adjusted compression ratio; The adjusted compression ratio is obtained by the following formula: ; Among them, S represents the adjusted compression ratio; S c Indicates the preset initial compression ratio; K 01 Represents the first target resolution adjustment coefficient; K 02 represents the second target resolution adjustment coefficient; Obtaining a target resolution using the adjusted compression ratio; The target resolution is obtained by the following formula: ; Among them, W m Indicates the target resolution; S indicates the adjusted compression ratio; W c Indicates the original resolution of the video data to be processed.

7. The video codec based on satellite high-delay channel transmission according to claim 3, characterized in that: In view of compressing the target video data by using the video compression technology in S3, the quantization level of the compressed target video data is adjusted, including: Determine the compression standard of the target video data according to the video content characteristics and transmission requirements of the target video data, wherein the video content characteristics and transmission requirements are retrieved from the video rule database; First, the target video data is divided into a number of macroblocks, where a macroblock is a certain area in the target video data, and the area includes a luminance component and a chrominance component; After the macroblock division is completed, intra-frame compression and inter-frame compression are performed. Intra-frame compression is to use discrete cosine transform to convert the pixel value of the spatial domain to the frequency domain, and transform and encode the brightness component and chrominance component of each macroblock respectively. Discrete cosine transform concentrates the energy in the image of the target video data on the corresponding coefficients, quantizes the corresponding coefficients, and encodes the quantized coefficients using entropy coding technology. The entropy coding method includes Huffman coding, arithmetic coding or exponential Golomb coding. At the same time, a loop filter is introduced in the coding process. After entropy coding is completed, intra-frame compressed and quantized data is obtained; Inter-frame compression is to find the best matching area in the reference frame for each macroblock and calculate the motion vector. According to the motion vector, the corresponding macroblock is obtained from the reference frame as the prediction macroblock, and the prediction macroblock is compared with the current macroblock to obtain the prediction error. The prediction error is transformed and quantized, and the motion vector and the quantized transform coefficient are entropy coded. After the entropy coding is completed, the inter-frame compressed and quantized data is obtained; The data compressed and quantized within a frame and the data compressed and quantized between frames are uniformly labeled as quantized video data.

8. The video codec based on satellite high-latency channel transmission according to claim 7, characterized in that: In S4, the quantized video data is segmented and encapsulated into video data packets, and the video data packets are prepared for transmission according to the encapsulation format of satellite transmission, including: confirming the channel transmission volume of the satellite transmission channel, wherein the channel transmission volume of the satellite transmission channel is obtained from a database; The quantized video data is subjected to structured processing, and the header information, the payload and the tail information of the quantized video data are obtained after the structured processing; Dividing the quantized video data into a number of fixed-size data segments according to the channel transmission capacity, wherein the fixed size of each data segment does not exceed the channel transmission capacity; determining a packaging format according to a transmission requirement of a satellite transmission channel, wherein the transmission requirement of the satellite transmission channel is obtained from a database; Integrate each data segment with the structured header information according to the encapsulation format, and obtain an encapsulated video data packet after the integration is completed; The video data packets are stored in the buffer of the satellite transmission channel, and the video encapsulation data are obtained after the storage is completed.

9. The video codec based on satellite high-latency channel transmission according to claim 8, characterized in that: The decoder in S5 receives the video encapsulation data from the satellite transmission channel and decapsulates the received video encapsulation data. During the decapsulation process, the video encapsulation data is checked, including: The decoder establishes a data receiving port through a satellite communication system and a transmission device, and after the data receiving port is established, the video encapsulation data is received; After receiving the video encapsulation data, the video encapsulation data is checked using the CRC check technology. If the check fails, the decoder issues an instruction to request retransmission of the missing or damaged data segment; The decoder decapsulates the received video encapsulation data. Decapsulation means that the decoder parses the header information in the video encapsulation data and obtains the timestamp, sequence number and payload length of the data in the header information after parsing. Then extract the payload from the video encapsulation data, reorganize the extracted payload according to the header information, and the decoder reorganizes the received multiple video data packets into continuous original quantized video data in the correct order according to the sequence number of the video data packet; The video encapsulation data is timestamped during the decapsulation process, and the frames are sorted and synchronized according to the timestamps. After the frame sorting and synchronization adjustment are completed, the video decapsulation data is obtained.

10. The video codec based on satellite high-latency channel transmission according to claim 9, characterized in that: The decoder in S6 uses the same video compression technology as the encoder to compress and restore the video decapsulation data, including: The compression standard in the encoder is obtained, and the decoder performs intra-frame decoding and inter-frame decoding on the video decapsulation data according to the compression standard of the encoder; Intra-frame decoding is to perform entropy decoding on the video decapsulation data, wherein the decoder and the encoder use the same entropy decoding method; after entropy decoding of the video decapsulation data, the quantization coefficients of the video decapsulation data are obtained, the quantization coefficients are inversely quantized, and the inversely quantized quantization coefficients are converted back to pixel values ​​in the spatial domain using an inverse discrete cosine transform; after inverse discrete cosine transform, a reconstructed video frame of the video decapsulation data is obtained, and after the video frame is reconstructed, the intra-frame decoding of the video decapsulation data is completed; Inter-frame decoding is that the decoder extracts motion vector information from the video unpacking data, uses the motion vector to extract the prediction macroblock from the reference frame, then performs entropy decoding on the prediction error, inversely quantizes the decoded prediction error data, converts the quantization system of the inversely quantized prediction error into an error value in the spatial domain, adds the decoded prediction error to the prediction macroblock, and reconstructs the video frame. After the video frame is reconstructed, the inter-frame decoding of the video unpacking data is completed; The video decapsulation data after inter-frame decoding and intra-frame decoding is sorted according to the timestamp and sequence number, and the synchronization of the video frames is adjusted according to the timestamp; After the synchronization adjustment is completed, the video decoding data is obtained; The decoder in S7 performs delay compensation processing on the timestamp information in the video decoding data, including: The decoder confirms the timestamp information of each video frame in the video decoding data; Combining the timestamp information with the network delay statistics, the network delay statistics are obtained from the database; The delay compensation value required for each frame is calculated by combining the timestamp information and the network delay statistics, and the calculated compensation value is added to the timestamp information. After the addition is completed, the actual playback order of the video is obtained; The video frames are sorted according to the timestamps obtained after compensation. During the video playback, the timestamps are used to ensure the synchronization of audio and video. At the same time, during the video playback process, the playback status and user feedback are collected and monitored in real time, and a user feedback mechanism is established.

Citation Information

Patent Citations

  • Process for delivering a video stream over a wireless bidirectional channel between a video encoder and a video decoder

    CN101483775B

  • HEVC-based bit rate control method for motion region detection

    CN106604029A

  • Audio and video signal processing system and video conference terminal equipment using same

    CN119211474A

  • Cross-platform real-time central control screen projection instrument display method

    CN119544897A

  • Method for image temporal and spatial resolution processing based on code rate control

    WO2010078759A1