A Chromaticity Residual Coding Optimization Method and System Based on Privatized Syntax
By converting the YUV444 format to the YUV420 format and optimizing the encoding using proprietary frame-level and macroblock syntax, the high complexity of YUV444 encoding is solved, achieving efficient image and video transmission.
Patent Information
- Application Number
- CN202311635484.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-01
- Publication Date
- 2025-11-14
- Estimated Expiration
- 2043-12-01
AI Technical Summary
The existing YUV444 encoding format has significantly improved encoding complexity and compression rate, resulting in low efficiency in the network transmission of high-quality video and images.
A chroma residual coding optimization method based on proprietary syntax is adopted. By converting the YUV444 format to the YUV420 format, a UV residual image is generated using a single-channel encoder. Zero frames or skipped encodings are identified through preset frame-level and macroblock syntax, thereby increasing the priority of zero macroblocks and skipped macroblocks and reducing coding complexity.
Without affecting image quality, it improves the encoding compression rate and reduces encoding complexity, thereby enhancing the network transmission efficiency of high-quality images and videos.
Smart Images

Figure CN117676166B_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of image and video processing, specifically relating to a chroma residual coding optimization method and system based on privatized syntax. Background Technology
[0002] In high-quality image and video processing, the YUV format is a commonly used pixel format that represents luminance and chrominance components separately. Common formats include YUV420, YUV422, and YUV444. However, the limitations of YUV420 are becoming increasingly apparent. Due to its limitations in color sampling, YUV420 struggles to meet the demands of applications requiring higher color depth, saturation, and detail fidelity. To address these limitations, higher sampling rate video formats, such as YUV422 and YUV444, are currently preferred in video coding. Compared to YUV420, YUV422 and YUV444 have higher chrominance sampling rates. This means that in YUV444, each luminance sample is accompanied by a corresponding chrominance sample, enabling more accurate capture of the original color information in images and videos, thus improving image and video quality and fidelity.
[0003] However, when using YUV444, the complexity of encoded chroma information is four times that of YUV420. With the amount of chroma information increasing exponentially, the encoding complexity also increases. Therefore, if the commonly used H264 / H265 standard syntax is used to compress chroma, the encoding complexity will increase significantly, and the encoding compression rate will be low, resulting in lower network transmission efficiency for high-quality video and images. Summary of the Invention
[0004] This invention proposes a chroma residual coding optimization method and system based on privatized syntax, which improves the coding compression rate and reduces the coding complexity, making the network transmission of high-quality video and images more efficient.
[0005] A first aspect of the present invention provides a chroma residual coding optimization method based on a proprietary syntax, the method comprising:
[0006] A first image is acquired, and the first image is converted from a first YUV format to a second YUV format to obtain second YUV format data; wherein, the chromaticity information of the first YUV format is greater than the chromaticity information of the second YUV format;
[0007] The second YUV format data is encoded and transmitted through a single-channel encoder to obtain a UV residual image; wherein, the single channel includes a U component channel and a V component channel;
[0008] The UV residual image is transmitted to the chroma private encoder. The frame type of the UV residual image is identified by the preset frame-level syntax, and the frames that meet the preset type are encoded to obtain the optimized residual image.
[0009] Based on the optimized residual image, the type of macroblocks in the optimized residual image is identified through a preset macroblock syntax, and macroblocks that meet the preset type are encoded to obtain an optimized chroma bitstream;
[0010] The optimized chroma code stream is transmitted over the network.
[0011] The above scheme converts the high-quality image data to be compatible with the YUV420 encoder, then removes some useless syntax and adds image feature syntax through preset frame-level syntax, thereby increasing the image compression rate. It also improves the priority of special macroblocks through preset macroblock syntax, resulting in an optimized chroma bitstream. This reduces the encoding complexity of the chroma bitstream without affecting image quality, making the transmission efficiency of high-quality images higher.
[0012] In one possible implementation of the first aspect, the first image is converted from a first YUV format to a second YUV format to obtain second YUV format data, specifically as follows:
[0013] The YUV444 format data of the first image is converted into YUV420 format data by resampling.
[0014] The above scheme converts the data of the first image into YUV420 format data, so that the format of the image data can be used for encoding by most encoders.
[0015] In one possible implementation of the first aspect, the second YUV format data is encoded and transmitted using a single-channel encoder to obtain a UV residual image, specifically as follows:
[0016] The second YUV format data is encoded by an encoder containing U component channels and V component channels to obtain the third YUV format data; wherein, the third YUV format data is the second YUV format data that has been lost during the encoding process.
[0017] The third YUV format data is sampled into YUV444 format to obtain the fourth YUV format data;
[0018] The pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image.
[0019] The above scheme processes the pixels of the second YUV format data through a preset processing function to obtain a UV residual image that conforms to the standard, providing data support for the subsequent optimization process.
[0020] In one possible implementation of the first aspect, the pre-defined processing function is specifically as follows:
[0021] The pixel value u' corresponding to the UV residual image is obtained according to the preset processing function. The specific formula is as follows:
[0022]
[0023] Where u1 is the pixel value of the fourth YUV format data, u ori These are the pixel values of the first image.
[0024] In one possible implementation of the first aspect, the UV residual image is transmitted to a chroma-proprietary encoder. The frame type of the UV residual image is identified through a preset frame-level syntax, and frames that meet the preset type are encoded to obtain an optimized residual image. Specifically:
[0025] The UV residual image is transmitted to the chroma private encoder. The frame type of the UV residual image is identified by the image feature syntax of the preset frame-level syntax. Then the UV residual image is encoded to obtain the optimized residual image.
[0026] Specifically, if the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and not encoded; otherwise, the current frame of the UV residual image is encoded.
[0027] The above scheme uses a preset frame-level syntax to determine the frames of the UV residual image. Zero frames or skip frames are not encoded, while other types of frames are encoded. This reduces the complexity of encoding and helps to improve encoding efficiency.
[0028] In one possible implementation of the first aspect, based on the optimized residual image, the type of macroblocks within the optimized residual image is identified through a preset macroblock syntax, and macroblocks satisfying the preset type are encoded to obtain an optimized chroma bitstream, specifically:
[0029] Based on the optimized residual image, the priority of zero macroblocks and skip macroblocks is increased through a preset macroblock syntax, and the type of macroblocks in the optimized residual image is identified. Then, the optimized residual image is encoded to obtain an optimized chroma bitstream.
[0030] Specifically, if the current macroblock of the optimized residual image is of type zero or skip, the current macroblock of the optimized residual image is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded.
[0031] The above scheme improves the priority of zero macroblocks and skip macroblocks by using a preset macroblock syntax. It does not encode the zero macroblocks and skip macroblocks of the optimized residual image, which reduces the encoding complexity and the size of the chroma bitstream, making it easier to transmit the chroma bitstream and improving the transmission efficiency of high-quality images.
[0032] A second aspect of the present invention provides a chroma residual coding optimization system based on a proprietary syntax, the system comprising: a data conversion module, a data transmission module, a frame-level optimization module, a macroblock optimization module, and a chroma bitstream transmission module;
[0033] The data conversion module is used to acquire a first image and convert the first image from a first YUV format to a second YUV format to obtain second YUV format data; wherein the chromaticity information of the first YUV format is greater than the chromaticity information of the second YUV format.
[0034] The data transmission module is used to encode and transmit the second YUV format data through a single-channel encoder to obtain a UV residual image; wherein, the single channel includes a U component channel and a V component channel;
[0035] The frame-level optimization module is used to transmit the UV residual image to the chroma private encoder, identify the frame type of the UV residual image through a preset frame-level syntax, and encode the frames that meet the preset type to obtain the optimized residual image.
[0036] The macroblock optimization module is used to identify the type of macroblocks in the optimized residual image according to the preset macroblock syntax, and encode the macroblocks that meet the preset type to obtain the optimized chroma bitstream.
[0037] The chroma bitstream transmission module is used to transmit the optimized chroma bitstream to the network.
[0038] In one possible implementation of the second aspect, the data conversion module includes: a format conversion unit;
[0039] The format conversion unit is used to convert the YUV444 format data of the first image into YUV420 format data by resampling.
[0040] In one possible implementation of the second aspect, the data transmission module includes: a residual image processing unit;
[0041] The residual image processing unit is used to encode the second YUV format data through an encoder containing U component channels and V component channels to obtain third YUV format data; wherein, the third YUV format data is the second YUV format data that has been lost during encoding; the third YUV format data is sampled into YUV444 format to obtain fourth YUV format data; and the pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image.
[0042] In one possible implementation of the second aspect, the frame-level optimization module includes: a frame-level coding unit;
[0043] The frame-level coding unit is used to transmit the UV residual image to the chroma private encoder. Through the image feature syntax of the preset frame-level syntax, the frame type of the UV residual image is identified, and then the UV residual image is encoded to obtain the optimized residual image.
[0044] Specifically, if the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and not encoded; otherwise, the current frame of the UV residual image is encoded.
[0045] In one possible implementation of the second aspect, the macroblock optimization module includes: a macroblock coding unit;
[0046] The macroblock coding unit is used to improve the priority of zero macroblocks and skip macroblocks and identify the type of macroblocks in the optimized residual image according to the optimized residual image through a preset macroblock syntax, and then encode the optimized residual image to obtain an optimized chroma bitstream.
[0047] Specifically, if the current macroblock of the optimized residual image is of type zero or skip, the current macroblock of the optimized residual image is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded. Attached Figure Description
[0048] To more clearly illustrate the technical solution of the present invention, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0049] Figure 1 This is a schematic diagram illustrating the specific process of a chroma residual coding optimization method based on a proprietary syntax, according to a certain embodiment of the present invention.
[0050] Figure 2This is a schematic diagram of a YUV format of a chroma residual coding optimization method based on a proprietary syntax, provided by an embodiment of the present invention.
[0051] Figure 3 This is a structural diagram of a chroma residual coding optimization system based on a proprietary syntax, provided by a certain embodiment of the present invention. Detailed Implementation
[0052] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0053] It should be understood that the step numbers used in the text are for ease of description only and are not intended to limit the order in which the steps are performed.
[0054] like Figure 1 As shown, Figure 1 This invention provides a schematic flowchart of a chroma residual coding optimization method based on a proprietary syntax, which includes steps S1 to S5, as detailed below:
[0055] Step S1: Acquire a first image and convert the first image from a first YUV format to a second YUV format to obtain second YUV format data;
[0056] In this step, the first image is acquired, obtaining its YUV444 format data. Since the current encoder is only compatible with YUV420 format data, the YUV444 format data needs to be converted to YUV420 format data.
[0057] To better illustrate the relationship between YUV444 format data and YUV420 format data, Figure 2 This diagram illustrates the YUV format of a chroma residual coding optimization method based on proprietary syntax provided by this invention. As shown, Y represents the luminance information of the image, and UV represents the chroma information of the image. Therefore, the chroma information of YUV444 format data is greater than that of YUV420 and YUV422 format data, resulting in higher image quality expressed using YUV444 format data.
[0058] Step S2: The second YUV format data is encoded and transmitted through a single-channel encoder to obtain a UV residual image;
[0059] In this step, the second YUV format data is encoded by an encoder containing U component channels and V component channels to obtain the third YUV format data; wherein, the third YUV format data is the second YUV format data that has been lost during the encoding process.
[0060] The third YUV format data is sampled into YUV444 format to obtain the fourth YUV format data;
[0061] The pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image; wherein, the preset processing function judges the residual of the pixels of the second YUV format data and determines the processing method based on the value of the residual.
[0062] The specific formula for the preset processing function is as follows:
[0063]
[0064] Where u' is the pixel value of the UV residual image, u1 is the pixel value of the fourth YUV format data, and u ori These are the pixel values of the first image.
[0065] Step S3: The UV residual image is transmitted to the chroma private encoder. The frame type of the UV residual image is identified by the preset frame-level syntax, and the frames that meet the preset type are encoded to obtain the optimized residual image.
[0066] In this step, after the UV residual image is transmitted to the chroma private encoder, the frame type of the UV residual image is identified by the image feature syntax of the preset frame-level syntax; the preset frame-level syntax deletes some useless syntax and improves the encoding compression rate.
[0067] For UV residual images, when the pixel values of the images are very close (solid color or pixel values differ by less than 10), the proportion of all-zero blocks in the UV residual image is relatively large. In order to improve the compression ratio, a zero-frame syntax is added to the frame-level syntax. The zero-frame syntax means that the residual of the current frame is 0. The skip-frame syntax is also very important in the encoding, so the skip-frame syntax is also added to the frame-level syntax.
[0068] Therefore, the preset frame-level syntax first identifies the zero frame and skip frame of the UV residual image. If the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and not encoded; otherwise, the current frame of the UV residual image is encoded. Encoding is performed using the preset frame-level syntax to obtain the optimized residual image.
[0069] In some embodiments, step S3 includes:
[0070] The default frame-level syntax is designed as follows:
[0071]
[0072]
[0073] The newly added image feature syntax is as follows:
[0074] slice_type: Indicates the type of slice. If the value is 0, it is a P-frame; if the value is 1, it is an I-frame; if the value is 2, it is an IDR frame. Among them, P-frames are forward-predicted frames, which are predicted from previous P-frames or I-frames; I-frames are internally coded frames, which can be encoded independently without referring to other images; IDR frames are I-frames, and are I-frames that need to be cleared from the reference frame management list.
[0075] chroma_type: Indicates the type of chroma. If the value is 0, it is the U component; if the value is 1, it is the V component; if the value is 2, it means that the slice contains both U and V components.
[0076] frame_type: Indicates the type of the current frame, where 0 is a normal encoded frame, 1 is a skip frame, and 2 is a zero frame.
[0077] Step S4: Based on the optimized residual image, identify the type of macroblocks in the optimized residual image through a preset macroblock syntax, and encode the macroblocks that meet the preset type to obtain the optimized chroma bitstream;
[0078] In this step, based on the optimized residual image, the priority of zero macroblocks and skip macroblocks is increased through a preset macroblock syntax, and the type of macroblocks in the optimized residual image is identified. Then, the optimized residual image is encoded to obtain an optimized chroma bitstream.
[0079] Specifically, if the current macroblock of the optimized residual image is of type zero or skip, the current macroblock of the optimized residual image is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded.
[0080] Because the proportion of zero macroblocks in the optimized residual image is relatively high, skipping zero macroblocks during encoding can reduce the amount of encoding and improve encoding efficiency.
[0081] In some embodiments, step S4 includes:
[0082] The default macroblock syntax is designed as follows:
[0083]
[0084]
[0085] The following content has been added to the default macro block syntax:
[0086] mb_zero_run: The number of consecutive zero macroblocks;
[0087] mb_zero_flag: Determines whether the current macroblock is a zero macroblock.
[0088] If the current macroblock is determined to be of type zero or skip, there is no need for subsequent macroblock_layer() decoding. This not only reduces the complexity of encoding and decoding and increases the encoding and decoding capabilities of the terminal, but also reduces the bitstream size without affecting image quality, improving transmission efficiency and enabling some less powerful hardware terminals to support chroma residual decoding and YUV444 image display.
[0089] Step S5: Transmit the optimized chroma bitstream to the network.
[0090] Furthermore, in order to implement the chroma residual coding optimization system based on the proprietary syntax corresponding to the above method embodiments, and to achieve the corresponding functional and technical effects, Figure 3 A structural diagram of a chroma residual coding optimization system based on a proprietary syntax is provided. For ease of explanation, only the parts relevant to this embodiment are shown. The chroma residual coding optimization system based on a proprietary syntax provided in this embodiment includes:
[0091] The data conversion module 201 is used to acquire a first image and convert the first image from a first YUV format to a second YUV format to obtain second YUV format data; wherein the chromaticity information of the first YUV format is greater than the chromaticity information of the second YUV format.
[0092] The data transmission module 202 is used to encode and transmit the second YUV format data through a single-channel encoder to obtain a UV residual image; wherein, the single channel includes a U component channel and a V component channel.
[0093] The frame-level optimization module 203 is used to transmit the UV residual image to the chroma private encoder, identify the frame type of the UV residual image through the preset frame-level syntax, and encode the frames that meet the preset type to obtain the optimized residual image.
[0094] The macroblock optimization module 204 is used to identify the type of macroblocks in the optimized residual image according to the optimized residual image through a preset macroblock syntax, and to encode the macroblocks that meet the preset type to obtain an optimized chroma bitstream.
[0095] The chroma bitstream transmission module 205 is used to transmit the optimized chroma bitstream to the network.
[0096] In some embodiments, the data conversion module 201 includes:
[0097] The format conversion unit is used to first acquire the first image and obtain its YUV444 format data. Because the current encoder is only compatible with YUV420 format data, it is necessary to convert the YUV444 format data to YUV420 format data.
[0098] In some embodiments, the data transmission module 202 includes:
[0099] The residual image processing unit is used to encode the second YUV format data through an encoder containing U component channels and V component channels to obtain third YUV format data; wherein, the third YUV format data is the second YUV format data that has been lost during encoding; the third YUV format data is sampled into YUV444 format to obtain fourth YUV format data; and the pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image; wherein, the preset processing function judges the residual of the pixels of the second YUV format data and determines the processing method based on the value of the residual.
[0100] In some embodiments, the frame-level optimization module 203 includes:
[0101] The frame-level coding unit is used to transmit the UV residual image to the chroma proprietary encoder. It identifies the frame type of the UV residual image through the image feature syntax of the preset frame-level syntax, and then encodes the UV residual image to obtain the optimized residual image. Specifically, if the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and no encoding is performed; otherwise, the current frame of the UV residual image is encoded.
[0102] For UV residual images, when the pixel values of the images are very close (solid color or pixel values differ by less than 10), the proportion of all-zero blocks in the UV residual image is relatively large. In order to improve the compression ratio, a zero-frame syntax is added to the frame-level syntax. The zero-frame syntax means that the residual of the current frame is 0. The skip-frame syntax is also very important in the encoding, so the skip-frame syntax is also added to the frame-level syntax.
[0103] In some embodiments, the macroblock optimization module 204 includes:
[0104] The macroblock coding unit is used to prioritize zero and skip macroblocks based on the optimized residual image using a preset macroblock syntax, identify the type of macroblocks in the optimized residual image, and then encode the optimized residual image to obtain an optimized chroma bitstream. Specifically, if the current macroblock of the optimized residual image is of type zero or skip, the current macroblock is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded.
[0105] Because the proportion of zero macroblocks in the optimized residual image is relatively high, skipping zero macroblocks during encoding can reduce the amount of encoding and improve encoding efficiency.
[0106] This embodiment proposes a chroma residual coding optimization method and system based on a proprietary syntax: A first image is acquired and converted from a first YUV format to a second YUV format to obtain second YUV format data; the second YUV format data is encoded and transmitted through a single-channel encoder to obtain a UV residual image; the UV residual image is transmitted to a proprietary chroma encoder, where the frame type of the UV residual image is identified using a preset frame-level syntax, and frames satisfying the preset type are encoded to obtain an optimized residual image; based on the optimized residual image, the type of macroblocks within the optimized residual image is identified using a preset macroblock syntax, and macroblocks satisfying the preset type are encoded to obtain an optimized chroma bitstream, which is then transmitted to the network. Its beneficial effects include: improved coding compression ratio and reduced coding complexity, resulting in higher efficiency for high-quality video and image network transmission.
[0107] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention in detail. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. In particular, it should be noted that any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention for those skilled in the art.
Claims
1. A chroma residual coding optimization method based on privatized syntax, characterized in that, include: A first image is acquired, and the first image is converted from a first YUV format to a second YUV format to obtain second YUV format data; wherein, the chromaticity information of the first YUV format is greater than that of the second YUV format, and the first YUV format is YUV444 format; The second YUV format data is encoded and transmitted through a single-channel encoder to obtain a UV residual image. Specifically, the second YUV format data is encoded through an encoder containing U component channels and V component channels to obtain third YUV format data. The third YUV format data is the second YUV format data that has been lost during encoding. The third YUV format data is sampled into YUV444 format to obtain fourth YUV format data. The pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image. The single channel includes U component channels and V component channels, and the fourth YUV format is YUV444 format. The UV residual image is transmitted to a proprietary chroma encoder. The frame type of the UV residual image is identified using a preset frame-level syntax, and frames that meet the preset type are encoded to obtain an optimized residual image. Specifically, encoding frames that meet the preset type involves: if the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and not encoded; otherwise, the current frame of the UV residual image is encoded. A zero frame is a frame with a residual of 0. Based on the optimized residual image, the type of macroblocks within the optimized residual image is identified through a preset macroblock syntax, and macroblocks that satisfy the preset type are encoded to obtain an optimized chroma bitstream; wherein, the encoding of macroblocks that satisfy the preset type specifically means: if the current macroblock of the optimized residual image is of type zero or skip type, the current macroblock of the optimized residual image is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded; wherein, a macroblock of type zero is a macroblock that makes up a zero frame; The optimized chroma code stream is transmitted over the network.
2. The chroma residual coding optimization method based on privatized syntax according to claim 1, characterized in that, The step of converting the first image from the first YUV format to the second YUV format to obtain second YUV format data specifically involves: The YUV444 format data of the first image is converted into YUV420 format data by resampling.
3. The chroma residual coding optimization method based on privatized syntax according to claim 1, characterized in that, The preset processing function is specifically as follows: The pixel value u' corresponding to the UV residual image is obtained according to the preset processing function. The specific formula is as follows: Where u1 is the pixel value of the fourth YUV format data, u ori These are the pixel values of the first image.
4. The chroma residual coding optimization method based on privatized syntax according to claim 1, characterized in that, The process of transmitting the UV residual image to a proprietary chroma encoder, identifying the frame type of the UV residual image using a preset frame-level syntax, and encoding frames that meet the preset type to obtain an optimized residual image is as follows: The UV residual image is transmitted to a proprietary chroma encoder. The frame type of the UV residual image is identified using a preset frame-level image feature syntax. Then, the UV residual image is encoded to obtain an optimized residual image.
5. The chroma residual coding optimization method based on privatized syntax according to claim 1, characterized in that, The process involves identifying the type of macroblocks within the optimized residual image using a preset macroblock syntax, and encoding macroblocks that meet the preset type to obtain an optimized chroma bitstream. Specifically: Based on the optimized residual image, the priority of zero macroblocks and skip macroblocks is increased through a preset macroblock syntax, and the type of macroblocks in the optimized residual image is identified. Then, the optimized residual image is encoded to obtain an optimized chroma bitstream.
6. A chroma residual coding optimization system based on a proprietary syntax, characterized in that, include: Data conversion module, data transmission module, frame-level optimization module, macroblock optimization module, and chroma bitstream transmission module; The data conversion module is used to acquire a first image and convert the first image from a first YUV format to a second YUV format to obtain second YUV format data; wherein the chromaticity information of the first YUV format is greater than that of the second YUV format, and the first YUV format is YUV444 format; The data transmission module is used to encode and transmit the second YUV format data through a single-channel encoder to obtain a UV residual image. Specifically, the second YUV format data is encoded through an encoder containing U component channels and V component channels to obtain third YUV format data; wherein, the third YUV format data is the second YUV format data that has been lost during encoding; the third YUV format data is sampled into YUV444 format to obtain fourth YUV format data; the pixels of the fourth YUV format data are processed by a preset processing function to obtain a UV residual image; wherein, the single channel includes U component channels and V component channels, and the fourth YUV format is YUV444 format; The frame-level optimization module is used to transmit the UV residual image to the chroma proprietary encoder, identify the frame type of the UV residual image through a preset frame-level syntax, and encode the frames that meet the preset type to obtain the optimized residual image; wherein, the encoding of the frames that meet the preset type specifically means: if the current frame of the UV residual image is a zero frame or a skip frame, the current frame of the UV residual image is skipped and not encoded; otherwise, the current frame of the UV residual image is encoded; wherein, a zero frame is a frame with a residual of 0; The macroblock optimization module is used to identify the type of macroblocks in the optimized residual image according to a preset macroblock syntax, and to encode macroblocks that meet the preset type to obtain an optimized chroma bitstream; wherein, the encoding of macroblocks that meet the preset type specifically means: if the current macroblock of the optimized residual image is of type zero or skip, the current macroblock of the optimized residual image is skipped and not encoded; otherwise, the current macroblock of the optimized residual image is encoded; wherein, the macroblock of type zero is the macroblock that makes up the zero frame; The chroma bitstream transmission module is used to transmit the optimized chroma bitstream to the network.
7. The chroma residual coding optimization system based on privatized syntax according to claim 6, characterized in that, The data conversion module includes: a format conversion unit; The format conversion unit is used to convert the YUV444 format data of the first image into YUV420 format data by resampling.
8. The chroma residual coding optimization system based on privatized syntax according to claim 6, characterized in that, The frame-level optimization module includes: a frame-level coding unit; The frame-level coding unit is used to transmit the UV residual image to the chroma private encoder. Through the image feature syntax of the preset frame-level syntax, the frame type of the UV residual image is identified, and then the UV residual image is encoded to obtain the optimized residual image.
9. The chroma residual coding optimization system based on privatized syntax according to claim 6, characterized in that, The macroblock optimization module includes: a macroblock coding unit; The macroblock encoding unit is used to improve the priority of zero macroblocks and skip macroblocks and identify the type of macroblocks in the optimized residual image by using a preset macroblock syntax, based on the optimized residual image, and then encode the optimized residual image to obtain an optimized chroma bitstream.
Citation Information
Patent Citations
Image transmission method, device and system
CN113382240A
Residual error skipping coding and decoding method and device
CN116156167A