Image transmission method and device based on hierarchical coding and storage medium

Abstract

The invention relates to an image transmission method and device based on layered coding and a storage medium, and the method comprises the steps: a coding unit receives a YUV444 format image, carries out the transcoding and chroma extraction, and obtains a basic coding layer and a chroma enhancement layer; the transmission unit uses the basic coding layer and the chroma enhancement layer as independent coding streams and sends the coding streams to a decoding unit; a decoding unit receives and decodes the basic coding layer coding stream and the chroma enhancement layer coding stream to obtain a basic image and a color enhancement image; the decoding unit reconstructs the base image and the color enhanced image into a YUV444 format image. According to the image transmission method based on layered coding, the problem of YUV420 color distortion is solved by independently transmitting chroma high-frequency information.

Description

Technical Field

[0001] The present invention relates to the field of image coding and decoding, and in particular to an image transmission method, device and storage medium based on layered coding. Background Art

[0002] At present, scenarios such as remote office and distance education have increasingly higher requirements for image transmission quality, but due to bandwidth constraints, it is often necessary to make a trade-off between image quality and transmission efficiency. The traditional YUV444 format can provide high-fidelity colors, but it occupies a large bandwidth and is not suitable for low-bandwidth environments; although the YUV420 format occupies a small bandwidth, the color reproduction is low and it is difficult to meet high-fidelity requirements; existing layered coding schemes (such as SVC) usually layer the same data, increasing the complexity of the base layer and affecting image clarity; there is a lack of effective solutions to achieve color enhancement while ensuring basic image quality. Summary of the invention

[0003] The present invention provides an image transmission method, device and storage medium based on layered coding, aiming to solve at least one of the technical problems existing in the prior art.

[0004] The technical solution of the present invention is a method, device and storage medium for image transmission based on layered coding. The method for image transmission based on layered coding is applied to an image transmission device based on layered coding. The image transmission device based on layered coding comprises a coding unit, a transmission unit and a decoding unit connected in sequence, wherein: the coding unit comprises: an input module for receiving a YUV444 format image and performing format separation on the YUV444 format image; a base layer coding module for converting the YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer coding module is connected to the output of the input module; an enhancement layer extraction module for calculating the YUV444 format image; The chromaticity difference between the YUV420 format image and the YUV420 format image is used to extract the enhancement information, and the enhancement layer extraction module is connected to the output of the base layer encoding module; the enhancement layer encoding module is used to independently encode the enhancement information and output the enhancement layer data stream, and the enhancement layer encoding module is connected to the output of the enhancement layer extraction module; the decoding unit includes: a base layer decoding module, which is used to decode the base layer data stream and restore the base image, and the base layer decoding module is connected to the output of the transmission unit; an enhancement layer decoding module, which is used to decode the enhancement layer data stream and reconstruct the high-frequency chromaticity information, and the enhancement layer decoding module is connected to the output of the base layer decoding module; an image fusion module, which is used to merge the base layer data stream and the enhancement layer data stream and output a high-fidelity image, and the image fusion module is connected to the output of the enhancement layer decoding module. The image transmission method based on layered coding includes the following steps: S100, the encoding unit receives the YUV444 format image and performs transcoding and chroma extraction to obtain a basic encoding layer and a chroma enhancement layer; S200, the transmission unit sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit; S300, a decoding unit receives and decodes a base coding layer coding stream and a chroma enhancement layer coding stream to obtain a base image and a color enhanced image; S400: The decoding unit reconstructs the basic image and the color enhanced image into a YUV444 format image.

[0005] Further, the step S100 includes the following steps: S110, down-sampling the YUV444 format image into a YUV420 format image, and encoding the YUV420 format image to obtain a basic coding layer; S120, extracting chroma profile information from the YUV444 format image, combining the chroma profile information into a YUV420 format image, and encoding the YUV420 format image as a chroma enhancement layer; S130, compressing the YUV420 format image data stream of the base coding layer and the chroma enhancement layer respectively; S140: Based on a Predetermined Time Standards (PTS), time synchronization is performed on the base coding layer and the chroma enhancement layer.

[0006] Further, in the step S110, the luminance (Y) component maintains the original resolution, while the resolution of the chrominance (U, V) components is reduced by half, and when the YUV444 format image is downsampled to the YUV420 format image, the luminance (Y) component remains unchanged, and the U and V components are downsampled by 2x2 blocks of pixels on average to generate a YUV420 format image of the base coding layer; In the step S120, when extracting the chromaticity profile information from the YUV444 format image, the high-frequency components of the chromaticity (U, V) are calculated, the difference between the chromaticity in the YUV444 format image and the YUV420 format image is extracted, the chromaticity high-frequency components are used as an enhancement layer to quantize the difference, and the result is converted into a YUV420 format image.

[0007] Further, in step S200, The encoding unit sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit through the transmission unit based on a combination of one or more of adaptive technology, differentiated transmission strategy and independent use of U / V chroma profile information for transmission technology.

[0008] Furthermore, the adaptive technology includes dynamic bit rate control, multi-level coding and scalability, QOS-based optimized transmission strategy, real-time image quality assessment and adjustment, and device adaptive adjustment technology; The differentiated transmission strategy is to prioritize the transmission of key image information under limited network conditions and bandwidth resources, and to perform differentiated processing on different coding layers according to factors such as network conditions and transmission paths, including: differentiation between base layer and enhancement layer, priority of base layer and on-demand transmission of enhancement layer, where: The difference between the base layer and the enhancement layer is that the base layer usually contains key brightness information (Y component). Even under bandwidth limit conditions, the transmission of the base layer can ensure the most basic smooth video display, while the enhancement layer mainly enhances the color information (U, V components) and can be transmitted when the bandwidth is high, thereby improving the visual effect; the base layer is prioritized, that is, when the bandwidth is insufficient, only the base layer is transmitted to ensure the basic clarity of the image; the enhancement layer is transmitted on demand, that is, if the network bandwidth allows, the enhancement layer is transmitted only to improve the image color effect; The independent use of U / V chromaticity profile information for transmission technology includes: independent encoding and transmission of chromaticity profile information, independent use of U profile information, independent use of V profile information, and joint use of U / V profile information, wherein: Independent encoding and transmission of chroma contour information: The contour information of U and V components (UResidual and VResidual) is encoded and transmitted as a separate enhancement layer. According to needs, you can choose to transmit only U contour information, V contour information, or both at the same time; using U contour information alone means that for scenes where red, green and other colors need to be enhanced, only the contour information of the U component is transmitted to reduce the amount of data; using V contour information alone means that if only blue and other colors need to be enhanced, you can choose to transmit only the contour information of the V component; using U / V contour information together means that when there is sufficient bandwidth, the complete U and V contour information is transmitted to achieve a higher color enhancement effect.

[0009] Further, the step S300 includes the following steps: S310, based on the code stream transmission mode of the transmission unit and the Predetermined Time Standards (PTS) for frame correspondence, the decoding unit synchronously receives and decodes the basic coding layer code stream and / or the chroma enhancement layer code stream; S320, decoding the basic coding layer code stream to generate a basic image, where the basic image is a YUV420 format image; S330 , decoding the chroma enhancement layer code stream to generate a color enhanced image, where the color enhanced image is a YUV420 format image.

[0010] Further, in step S310, The number of chroma enhancement layers and / or corresponding color enhancement images is at least one.

[0011] Further, the step S400 includes: S410, matching the basic image and the corresponding color enhanced image based on a Predetermined Time Standards (PTS); S420 , synthesizing the basic image and the corresponding color enhanced image to obtain a YUV444 format image.

[0012] Further, in step S420, The YUV444 format image is synthesized by extracting the chroma profile information and reconstructing the chroma (U, V) components using an interpolation algorithm.

[0013] Furthermore, the present invention also provides an image transmission device based on layered coding, which is used to execute the image transmission method based on layered coding. The image transmission device based on layered coding includes an encoding unit, a transmission unit and a decoding unit connected in sequence, wherein: The encoding unit comprises: An input module, used for receiving YUV444 format images and performing format separation on the YUV444 format images; A base layer encoding module, used for converting a YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer encoding module is connected to the output of the input module; An enhancement layer extraction module, used to calculate the chrominance difference between the YUV444 format image and the YUV420 format image, and extract enhancement information, the enhancement layer extraction module is connected to the output of the base layer encoding module; An enhancement layer encoding module, used to independently encode the enhancement information and output an enhancement layer data stream, wherein the enhancement layer encoding module is connected to the output of the enhancement layer extraction module; The decoding unit comprises: A base layer decoding module, used for decoding the base layer data stream and restoring the base image, the base layer decoding module being connected to the output of the transmission unit; An enhancement layer decoding module, used for decoding the enhancement layer data stream and reconstructing high-frequency chrominance information, wherein the enhancement layer decoding module is connected to the output of the base layer decoding module; The image fusion module is used to merge the base layer data stream and the enhancement layer data stream to output a high-fidelity image. The image fusion module is connected to the output of the enhancement layer decoding module.

[0014] Furthermore, the present invention also provides a computer-readable storage medium storing program instructions, wherein the program instructions are executed by a processor to implement the image transmission method based on layered coding.

[0015] The beneficial effects of the present invention are: The image transmission method based on layered coding solves the problem of YUV420 color distortion by independently transmitting chromaticity high-frequency information, reduces bandwidth occupancy, achieves high-fidelity transmission, ensures basic image clarity, supports flexible transmission strategies, provides selective color enhancement, and can adapt to different bandwidth environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 The figure is an overall flow chart of the image transmission method based on layered coding.

[0017] Figure 2 The figure is a schematic diagram of the overall flow chart of the image transmission method based on layered coding.

[0018] Figure 3 A schematic diagram of the encoding process in an image transmission method based on layered coding.

[0019] Figure 4 A schematic diagram of the decoding process in the image transmission method based on layered coding.

[0020] Figure 5 A schematic diagram of an image transmission device based on layered coding.

[0021] Figure numerals, 100, encoding unit; 110, input module; 120, base layer encoding module; 130, enhancement layer extraction module; 140, enhancement layer encoding module; 200, transmission unit; 300, decoding unit; 310, base layer decoding module; 320, enhancement layer decoding module; 330, image fusion module. DETAILED DESCRIPTION

[0022] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments and features in the embodiments of this application can be combined with each other without conflict.

[0023] It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature, or it may be indirectly fixed or connected to the other feature. In addition, the descriptions of up, down, left, right, top, bottom, etc. used in the present invention are only relative to the relative positional relationship of the components of the present invention in the drawings.

[0024] In addition, unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art. The terms used in this specification are only for describing specific embodiments, not for limiting the present invention. The term "and / or" used herein includes any combination of one or more related listed items.

[0025] It should be understood that, although the terms first, second, third, etc. may be used to describe various elements in the present disclosure, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, without departing from the scope of the present disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.

[0026] Reference Figures 1 to 5 In some embodiments, the technical solution of the present invention is a method, device and storage medium for image transmission based on layered coding, wherein the method for image transmission based on layered coding is applied to an image transmission device based on layered coding, wherein the image transmission device based on layered coding comprises an encoding unit 100, a transmission unit 200 and a decoding unit 300 connected in sequence, wherein: the encoding unit 100 comprises: an input module 110, for receiving a YUV444 format image and performing format separation on the YUV444 format image; a base layer encoding module 120, for converting the YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer encoding module 120 is connected to the output of the input module 110; an enhancement layer extraction module 130, for calculating the YUV444 format image; The enhancement layer extraction module 130 is connected to the output of the base layer encoding module 120; the enhancement layer encoding module 140 is used to independently encode the enhancement information and output the enhancement layer data stream. The enhancement layer encoding module 140 is connected to the output of the enhancement layer extraction module 130; the decoding unit 300 includes: a base layer decoding module 310, which is used to decode the base layer data stream and restore the base image. The base layer decoding module 310 is connected to the output of the transmission unit 200; an enhancement layer decoding module 320, which is used to decode the enhancement layer data stream and reconstruct the high-frequency chromaticity information. The enhancement layer decoding module 320 is connected to the output of the base layer decoding module 310; an image fusion module 330, which is used to merge the base layer data stream and the enhancement layer data stream and output a high-fidelity image. The image fusion module 330 is connected to the output of the enhancement layer decoding module 320. Figures 1 to 4 , the image transmission method based on layered coding comprises the following steps: S100, the encoding unit 100 receives a YUV444 format image and performs transcoding and chroma extraction to obtain a base coding layer and a chroma enhancement layer; S200, the transmission unit 200 sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit 300; S300, the decoding unit 300 receives and decodes the base coding layer coding stream and the chroma enhancement layer coding stream to obtain a base image and a color enhanced image; S400 , the decoding unit 300 reconstructs the basic image and the color enhanced image into a YUV444 format image.

[0027] The beneficial effects of the present invention are: The image transmission method based on layered coding solves the problem of YUV420 color distortion by independently transmitting chromaticity high-frequency information, reduces bandwidth occupancy, achieves high-fidelity transmission, ensures basic image clarity, supports flexible transmission strategies, provides selective color enhancement, and can adapt to different bandwidth environments.

[0028] In a specific embodiment, the image transmission method based on layered coding includes the following steps: YUV444 is downsampled to YUV420, and the image in YUV420 format is encoded as the basic coding layer; chroma profile information is extracted from the YUV444 format, and the chroma profile information is combined into an image in YUV420 format, which is encoded as an enhancement layer; PTS is used between layers for time synchronization; the base layer and the enhancement layer are respectively sent to the decoding end as independent coding streams; the decoding end receives a base layer code stream and multiple enhancement layer code streams, and decodes them; the base layer code stream is decoded to generate a YUV420 image as the base image; the enhancement layer code stream is decoded to generate corresponding YUV420 images as color enhanced images; the base image uses PTS to find the corresponding color enhanced image, and synthesizes the final YUV444 image.

[0029] Among them, the difference between YUV444 format image and YUV420 format image is: YUV444 format image: The brightness and chrominance components of each pixel are stored independently, providing the highest quality but with high bandwidth requirements.

[0030] YUV420 format image: The horizontal and vertical sampling rates of the chrominance components are halved, which reduces bandwidth requirements but reduces color reproduction.

[0031] Importance of chromaticity processing: Chromaticity is a key factor affecting the visual effect of an image. The image transmission method based on layered coding solves the problem of color distortion of YUV420 format images by independently transmitting chromaticity high-frequency information.

[0032] Layered coding technology: Modern video coding (such as SVC, HEVC) uses layered coding to adapt to bandwidth changes. The uniqueness of the image transmission method based on layered coding is that the enhancement layer only contains necessary high-frequency information, optimizing transmission efficiency.

[0033] The image transmission method based on layered coding converts a YUV444 format image into a basic coding layer of a YUV420 format image, extracts chroma contour information as a chroma enhancement layer, and uses independent coding streams to transmit the basic coding layer coding stream and the chroma enhancement layer coding stream respectively. The decoding unit 300 intelligently reconstructs an approximate YUV444 format image effect.

[0034] Further, refer to Figure 1 and Figure 3 , the step S100 includes the following steps; S110, down-sampling the YUV444 format image into a YUV420 format image, and encoding the YUV420 format image to obtain a basic coding layer; S120, extracting chroma profile information from the YUV444 format image, combining the chroma profile information into a YUV420 format image, and encoding the YUV420 format image as a chroma enhancement layer; S130, based on the H.264 encoder, compressing the YUV420 format image data stream of the base coding layer and the chroma enhancement layer respectively; S140: Based on a Predetermined Time Standards (PTS), time synchronization is performed on the base coding layer and the chroma enhancement layer.

[0035] Further, refer to Figure 1 and Figure 3 In step S110, the brightness (Y) component maintains the original resolution, while the resolution of the chrominance (U, V) components is reduced by half. When the YUV444 format image is downsampled to the YUV420 format image, the brightness (Y) component remains unchanged, and the U and V components are downsampled by 2x2 blocks of pixels on average to generate a YUV420 format image of the base coding layer; In the step S120, when extracting the chromaticity profile information from the YUV444 format image, the high-frequency components of the chromaticity (U, V) are calculated, the difference between the chromaticity in the YUV444 format image and the YUV420 format image is extracted, the chromaticity high-frequency components are used as an enhancement layer to quantize the difference, and the result is converted into a YUV420 format image.

[0036] The encoding unit 100 receives a YUV444 format image and performs format separation; completes YUV420 conversion and encoding, and outputs a base layer data stream; calculates chromaticity differences, extracts enhancement information; independently encodes the enhancement information, and outputs an enhancement layer data stream.

[0037] Further, refer to Figure 1 and Figure 2 In the step S200, The encoding unit 100 sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit 300 through the transmission unit 200 based on a combination of one or more of adaptive technology, differentiated transmission strategy and independent use of U / V chroma profile information for transmission technology.

[0038] Further, refer to Figure 1 and Figure 2 The adaptive technologies include dynamic bit rate control, multi-level coding and scalability, QOS-based optimized transmission strategy, real-time image quality assessment and adjustment, and device adaptive adjustment technology; The differentiated transmission strategy is to prioritize the transmission of key image information under limited network conditions and bandwidth resources, and to perform differentiated processing on different coding layers according to factors such as network conditions and transmission paths, including: differentiation between base layer and enhancement layer, priority of base layer and on-demand transmission of enhancement layer, where: The difference between the base layer and the enhancement layer is that the base layer usually contains key brightness information (Y component). Even under bandwidth limit conditions, the transmission of the base layer can ensure the most basic smooth video display, while the enhancement layer mainly enhances the color information (U, V components) and can be transmitted when the bandwidth is high, thereby improving the visual effect; the base layer is prioritized, that is, when the bandwidth is insufficient, only the base layer is transmitted to ensure the basic clarity of the image; the enhancement layer is transmitted on demand, that is, if the network bandwidth allows, the enhancement layer is transmitted only to improve the image color effect; The independent use of U / V chromaticity profile information for transmission technology includes: independent encoding and transmission of chromaticity profile information, independent use of U profile information, independent use of V profile information, and joint use of U / V profile information, wherein: Independent encoding and transmission of chroma contour information: The contour information of U and V components (UResidual and VResidual) is encoded and transmitted as a separate enhancement layer. According to needs, you can choose to transmit only U contour information, V contour information, or both at the same time; using U contour information alone means that for scenes where red, green and other colors need to be enhanced, only the contour information of the U component is transmitted to reduce the amount of data; using V contour information alone means that if only blue and other colors need to be enhanced, you can choose to transmit only the contour information of the V component; using U / V contour information together means that when there is sufficient bandwidth, the complete U and V contour information is transmitted to achieve a higher color enhancement effect.

[0039] The base coding layer and the chroma enhancement layer are synchronously sent to the decoding unit 300 based on a predetermined time standard system (PTS).

[0040] In a specific embodiment, in order to adaptively optimize image quality and bandwidth usage under different network conditions and device performance, adaptive technology, differentiated transmission strategy and independent use of U / V chromaticity profile information for transmission technology are adopted.

[0041] Among them, adaptive technologies include: dynamic bitrate control (Adaptive Bitrate Control), multi-level coding and scalability, QOS (Quality of Service)-based optimized transmission strategy, real-time image quality evaluation and adjustment, and device adaptive adjustment technology. A. Adaptive Bitrate Control Basic idea: Dynamically adjust the encoding bit rate according to the real-time bandwidth, delay and packet loss to ensure video quality while avoiding freezes caused by low bandwidth.

[0042] Specific implementation: (1) The quality and bit rate of the coding layer (base coding layer and / or chroma enhancement layer) are adjusted by real-time detection of network bandwidth and latency. In the case of low bandwidth, the base coding layer is transmitted first, and the enhancement layer is compressed or skipped appropriately; in the case of sufficient bandwidth, the chroma enhancement layer can be transmitted with high quality to improve color and detail effects.

[0043] (2) Bandwidth feedback mechanism: The client or receiver dynamically adjusts the amount of data sent based on the bandwidth information and feedback received. For example, TCP's congestion control mechanism or UDP's adaptive adjustment is used to ensure the smoothness and quality of video streaming transmission.

[0044] B. Multi-level coding and scalability Image layering: During encoding, the YUV420 image and chroma profile information (U, V component difference) are divided into different coding layers (base coding layer and chroma enhancement layer). Each layer can be transmitted, decoded and displayed independently according to network conditions.

[0045] Basic coding layer: Contains the most basic image information, ensuring that a clearer image can be transmitted even in low bandwidth conditions.

[0046] Chroma enhancement layer: Improves the color and detail quality of the image, especially when the bandwidth is high, the chroma enhancement layer will be turned on during transmission.

[0047] Selective transmission of chroma enhancement layer: Depending on the bandwidth conditions, choose whether to transmit the enhancement layer. When transmitting the enhancement layer, you can also selectively transmit only U / V chroma information or complete profile data.

[0048] C. Optimize transmission strategy based on QOS (Quality of Service) QOS strategy: Select different QOS strategies for different transmission paths (for example, wired, wireless, 5G networks, etc.) to ensure data stability and low latency.

[0049] High bandwidth guarantee: For network environments with sufficient bandwidth, the transmission quality of the enhancement layer can be improved to ensure high-quality video display.

[0050] D. Real-time image quality assessment and adjustment Quality-aware algorithm: Uses a machine learning-based algorithm to evaluate video image quality and adjusts encoding parameters based on visual perception evaluation results.

[0051] Adaptive enhancement layer adjustment: Based on the feedback from image quality assessment, the transmission strategy of the enhancement layer is adjusted in real time. For example, if the image quality is good and the bandwidth allows, the enhancement layer can provide high-quality chromaticity profile information; if the network conditions are poor, the enhancement layer may not be transmitted or a lower quality enhancement layer may be transmitted.

[0052] E. Device Adaptive Adjustment Client device adaptation: Automatically adjust the number of transmitted image layers and quality based on the decoding and display capabilities of the client device (such as screen resolution, display technology, hardware decoding support, etc.).

[0053] For low-end devices, the transmission burden of the enhancement layer can be reduced, or even the base layer can be used directly; while for high-end devices, a higher quality enhancement layer can be transmitted to provide a color effect closer to YUV444.

[0054] Among them, the specific applications of differentiated transmission and selective transmission include: Differentiated transmission means giving priority to the transmission of key image information when network conditions and bandwidth resources are limited, and performing differentiated processing on different coding layers based on factors such as network conditions and transmission paths.

[0055] Differentiation between base layer and enhancement layer: The base layer usually contains key brightness information (Y component). Even under bandwidth limit conditions, the transmission of the base layer can ensure the most basic smooth video display. The enhancement layer mainly enhances color information (U, V components) and can be transmitted when the bandwidth is higher, thereby improving the visual effect.

[0056] Base layer priority: When bandwidth is insufficient, only the base layer is transmitted to ensure the basic clarity of the image.

[0057] Enhanced layer is transmitted on demand: if the network bandwidth allows, the enhanced layer is transmitted to improve the image color effect.

[0058] Selective transmission based on bandwidth conditions: Selective transmission refers to intelligently selecting which coding layers and data parts to transmit based on real-time changes in network bandwidth: Low bandwidth: In this case, the YUV420 image data of the base layer is mainly transmitted, and the transmission of the enhancement layer is reduced. The transmission of the enhancement layer can even be completely omitted to ensure smooth playback.

[0059] High bandwidth: Can transmit complete enhancement layers, improve image quality, and provide color effects close to YUV444.

[0060] Medium bandwidth: Consider transmitting only part of the enhancement layer data (for example, only transmitting the U and V contour information) to save bandwidth while ensuring a certain degree of color enhancement.

[0061] Among them, independent use of U / V chromaticity profile information technology includes: Independent encoding and transmission of chroma profile information: After being encoded, the profile information of the U and V components (UResidual and VResidual) can be transmitted as a separate enhancement layer. Depending on the needs, you can choose to transmit only the U profile information, the V profile information, or both at the same time.

[0062] Use U contour information alone: ​​For scenes that need to enhance red, green and other colors, only transmit the contour information of the U component to reduce the amount of data.

[0063] Use V contour information alone: ​​If you only need to enhance colors such as blue, you can choose to transmit only the contour information of the V component.

[0064] Combined use of U / V profile information: When bandwidth is sufficient, complete U and V profile information is transmitted to achieve higher color enhancement effects.

[0065] Through this selective transmission, the transmission efficiency can be maximized under conditions of limited bandwidth, and the enhancement effect can be adjusted according to different scenarios and needs.

[0066] The adaptive technology effect and differentiated transmission strategy are to adapt to different bandwidth, equipment and scene requirements by dynamically adjusting the coding layer, bit rate and transmission strategy. Through fine control and intelligent selection, it can still maintain high video quality when bandwidth is limited, and improve image details and color effects when bandwidth conditions are good.

[0067] Further, refer to Figure 1 and Figure 4 , the step S300 comprises the following steps: S310, based on the code stream transmission mode of the transmission unit 200 and the Predetermined Time Standards (PTS) for frame correspondence, the decoding unit 300 synchronously receives and decodes the base coding layer code stream and / or the chroma enhancement layer code stream; S320, decoding the basic coding layer code stream to generate a basic image, where the basic image is a YUV420 format image; S330 , decoding the chroma enhancement layer code stream to generate a color enhanced image, where the color enhanced image is a YUV420 format image.

[0068] Specifically, the decoding unit 300 decodes the base layer data stream to restore the base image; decodes the enhancement layer data stream to reconstruct the high-frequency chrominance information; and merges the base layer and enhancement layer information to output a high-fidelity image.

[0069] Further, refer to Figure 1 and Figure 4 In step S310, The number of chroma enhancement layers and / or corresponding color enhancement images is at least one.

[0070] Further, refer to Figure 1 and Figure 4 , the step S400 comprises: S410, matching the basic image and the corresponding color enhanced image based on a Predetermined Time Standards (PTS); S420 , synthesizing the basic image and the corresponding color enhanced image to obtain a YUV444 format image.

[0071] Further, refer to Figure 1 and Figure 4 In step S420, The YUV444 format image is synthesized by extracting the chroma profile information and reconstructing the chroma (U, V) components using an interpolation algorithm.

[0072] Further, refer to Figure 5 The present invention further proposes an image transmission device based on layered coding, which is used to execute the image transmission method based on layered coding. The image transmission device based on layered coding comprises an encoding unit 100, a transmission unit 200 and a decoding unit 300 connected in sequence, wherein: The encoding unit 100 comprises: An input module 110, for receiving a YUV444 format image and performing format separation on the YUV444 format image; A base layer encoding module 120, used for converting a YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer encoding module 120 is connected to the output of the input module 110; An enhancement layer extraction module 130, used to calculate the chrominance difference between the YUV444 format image and the YUV420 format image, and extract enhancement information. The enhancement layer extraction module 130 is connected to the output of the base layer encoding module 120; An enhancement layer encoding module 140, used to independently encode the enhancement information and output an enhancement layer data stream, wherein the enhancement layer encoding module 140 is connected to the output of the enhancement layer extraction module 130; The decoding unit 300 comprises: A base layer decoding module 310, used to decode the base layer data stream and restore the base image, the base layer decoding module 310 is connected to the output of the transmission unit 200; An enhancement layer decoding module 320, used to decode the enhancement layer data stream and reconstruct high-frequency chrominance information, the enhancement layer decoding module 320 is connected to the output of the base layer decoding module 310; The image fusion module 330 is used to merge the base layer data stream and the enhancement layer data stream to output a high-fidelity image. The image fusion module 330 is connected to the output of the enhancement layer decoding module 320 .

[0073] Furthermore, the present invention also provides a computer-readable storage medium storing program instructions, wherein the program instructions are executed by a processor to implement the image transmission method based on layered coding.

[0074] The above is only a preferred embodiment of the present invention. The present invention is not limited to the above implementation. As long as the technical effect of the present invention is achieved by the same means, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the scope of protection of the present disclosure. All should belong to the protection scope of the present invention. Within the protection scope of the present invention, its technical scheme and / or implementation method can have various modifications and changes.

Claims

1. A method for image transmission based on layered coding, wherein the method for image transmission based on layered coding is applied to an image transmission device based on layered coding, wherein the image transmission device based on layered coding comprises an encoding unit (100), a transmission unit (200) and a decoding unit (300) connected in sequence, wherein: The encoding unit (100) comprises: an input module (110) for receiving a YUV444 format image and performing format separation on the YUV444 format image; a base layer encoding module (120) for converting the YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer encoding module (120) is connected to the output of the input module (110); an enhancement layer extraction module (130) for calculating the chromaticity difference between the YUV444 format image and the YUV420 format image and extracting enhancement information, wherein the enhancement layer extraction module (130) is connected to the output of the base layer encoding module (120); an enhancement layer encoding module (140) for independently encoding the enhancement information and outputting an enhancement layer data stream, wherein the enhancement layer encoding module (140) is connected to the output of the enhancement layer extraction module (130); the decoding unit (300) comprises: a base layer decoding module (310) for decoding the base layer data stream and restoring the base image, wherein the base layer decoding module (311) is connected to the output of the enhancement layer extraction module (130); 0) is connected to the output of the transmission unit (200); an enhancement layer decoding module (320) is used to decode the enhancement layer data stream and reconstruct high-frequency chrominance information, and the enhancement layer decoding module (320) is connected to the output of the base layer decoding module (310); an image fusion module (330) is used to merge the base layer data stream and the enhancement layer data stream to output a high-fidelity image, and the image fusion module (330) is connected to the output of the enhancement layer decoding module (320), characterized in that the image transmission method based on layered coding includes the following steps: S100, the encoding unit (100) receives a YUV444 format image and performs transcoding and chroma extraction to obtain a basic coding layer and a chroma enhancement layer; S200, the transmission unit (200) sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit (300); S300, the decoding unit (300) receives and decodes a base coding layer coding stream and a chroma enhancement layer coding stream to obtain a base image and a color enhanced image; S400, the decoding unit (300) reconstructs the basic image and the color enhanced image into a YUV444 format image.

2. The image transmission method based on layered coding according to claim 1, characterized in that: The step S100 includes the following steps: S110, down-sampling the YUV444 format image into a YUV420 format image, and encoding the YUV420 format image to obtain a basic coding layer; S120, extracting chroma profile information from the YUV444 format image, combining the chroma profile information into a YUV420 format image, and encoding the YUV420 format image as a chroma enhancement layer; S130, compressing the YUV420 format image data stream of the base coding layer and the chroma enhancement layer respectively; S140. Perform time synchronization on the base coding layer and the chroma enhancement layer based on a predetermined time standard system.

3. The image transmission method based on layered coding according to claim 2, characterized in that: In the step S110, the luminance (Y) component maintains the original resolution, while the resolution of the chrominance (U, V) components is reduced by half. When the YUV444 format image is downsampled to the YUV420 format image, the luminance (Y) component remains unchanged, and the U and V components are downsampled by 2x2 blocks of pixels on average to generate a YUV420 format image of the base coding layer; In the step S120, when extracting the chromaticity profile information from the YUV444 format image, the high-frequency components of the chromaticity (U, V) are calculated, the difference between the chromaticity in the YUV444 format image and the YUV420 format image is extracted, the chromaticity high-frequency components are used as an enhancement layer to quantize the difference, and the result is converted into a YUV420 format image.

4. The image transmission method based on layered coding according to claim 1, characterized in that: In the step S200, The encoding unit (100) sends the base coding layer and the chroma enhancement layer as independent coding streams to the decoding unit (300) through the transmission unit (200) based on a combination of one or more of an adaptive technology, a differentiated transmission strategy and an independent use of U / V chroma profile information for transmission technology.

5. The image transmission method based on layered coding according to claim 4, characterized in that: The adaptive technologies include dynamic bit rate control, multi-level coding and scalability, QOS-based optimized transmission strategy, real-time image quality assessment and adjustment, and device adaptive adjustment technology; The differentiated transmission strategy is to prioritize the transmission of key image information under limited network conditions and bandwidth resources, and to perform differentiated processing on different coding layers according to factors such as network conditions and transmission paths, including: differentiation between base layer and enhancement layer, priority of base layer and on-demand transmission of enhancement layer, where: The difference between the base layer and the enhancement layer is that the base layer usually contains key brightness information (Y component). Even under bandwidth limit conditions, the transmission of the base layer can ensure the most basic smooth video display, while the enhancement layer mainly enhances the color information (U, V components) and can be transmitted when the bandwidth is high, thereby improving the visual effect; the base layer is prioritized, that is, when the bandwidth is insufficient, only the base layer is transmitted to ensure the basic clarity of the image; the enhancement layer is transmitted on demand, that is, if the network bandwidth allows, the enhancement layer is transmitted only to improve the image color effect; The independent use of U / V chromaticity profile information for transmission technology includes: independent encoding and transmission of chromaticity profile information, independent use of U profile information, independent use of V profile information, and joint use of U / V profile information, wherein: Independent encoding and transmission of chroma contour information: After the contour information of U and V components is encoded, it is transmitted as a separate enhancement layer. According to the needs, you can choose to transmit only U contour information, V contour information, or both at the same time; using U contour information alone means that for scenes where red, green and other colors need to be enhanced, only the contour information of the U component is transmitted to reduce the amount of data; using V contour information alone means that if only blue and other colors need to be enhanced, you can choose to transmit only the contour information of the V component; using U / V contour information together means that when there is sufficient bandwidth, the complete U and V contour information is transmitted to achieve a higher color enhancement effect.

6. The image transmission method based on layered coding according to claim 1, characterized in that: The step S300 includes the following steps: S310, based on the code stream transmission mode of the transmission unit (200) and the predetermined time standard system, the decoding unit (300) synchronously receives and decodes the basic coding layer code stream and / or the chroma enhancement layer code stream; S320, decoding the basic coding layer code stream to generate a basic image, where the basic image is a YUV420 format image; S330 , decoding the chroma enhancement layer code stream to generate a color enhanced image, where the color enhanced image is a YUV420 format image.

7. The image transmission method based on layered coding according to claim 1, characterized in that: The step S400 includes: S410, matching the basic image and the corresponding color enhanced image based on a predetermined time standard system; S420 , synthesizing the basic image and the corresponding color enhanced image to obtain a YUV444 format image.

8. The image transmission method based on layered coding according to claim 7, characterized in that: In the step S420, The YUV444 format image is synthesized by extracting the chroma profile information and reconstructing the chroma (U, V) components using an interpolation algorithm.

9. An image transmission device based on layered coding, used to execute the image transmission method based on layered coding as claimed in any one of claims 1 to 8, characterized in that: The image transmission device based on layered coding comprises a coding unit (100), a transmission unit (200) and a decoding unit (300) which are connected in sequence, wherein: The encoding unit (100) comprises: An input module (110), used for receiving a YUV444 format image and performing format separation on the YUV444 format image; A base layer encoding module (120), used for converting a YUV444 format image into a YUV420 format image and encoding it, and outputting a base layer data stream, wherein the base layer encoding module (120) is connected to the output of the input module (110); An enhancement layer extraction module (130), used to calculate the chromaticity difference between the YUV444 format image and the YUV420 format image, and extract enhancement information, the enhancement layer extraction module (130) being connected to the output of the base layer encoding module (120); An enhancement layer encoding module (140), used to independently encode the enhancement information and output an enhancement layer data stream, the enhancement layer encoding module (140) being connected to the output of the enhancement layer extraction module (130); The decoding unit (300) comprises: A base layer decoding module (310), used for decoding a base layer data stream and restoring a base image, the base layer decoding module (310) being connected to an output of the transmission unit (200); An enhancement layer decoding module (320), used for decoding the enhancement layer data stream and reconstructing high frequency chrominance information, the enhancement layer decoding module (320) being connected to the output of the base layer decoding module (310); The image fusion module (330) is used to merge the base layer data stream and the enhancement layer data stream to output a high-fidelity image. The image fusion module (330) is connected to the output of the enhancement layer decoding module (320).

10. A computer-readable storage medium storing program instructions, wherein the program instructions, when executed by a processor, implement the method according to any one of claims 1 to 8.

Images