Preprocessing method, computer equipment, medium and chip for image coding

Abstract

The present application relates to the field of computer technology and provides a preprocessing method, computer equipment, medium and chip for image coding. The method includes: receiving a first image; processing the first image according to the brightness level and the chromaticity level, thereby obtaining a first brightness map and a first chromaticity map of the first image respectively; dividing the first brightness map based on the first encoding maximum resolution of the first encoding chip to obtain a plurality of first brightness map blocks, and downsampling the first chromaticity map according to the first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first encoding maximum resolution, selectively dividing the downsampled first chromaticity map to obtain a plurality of downsampled first chromaticity map blocks. In this way, the preprocessing result of the first image is used for encoding through the first encoding chip, which helps to improve encoding efficiency and picture quality.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a preprocessing method, computer equipment, medium and chip for image coding. Background Art

[0002] With the development of ultra-high-definition display technology and video recording technology, large-size ultra-high-definition television display terminal devices and intelligent terminal devices with ultra-high-definition video recording functions have been widely used. For this reason, it is often necessary to display ultra-high-definition image and video data to users, or to transmit ultra-high-definition image and video data from one node to another. For image and video data with ultra-high-definition resolution, if a coding chip with corresponding ultra-high-definition resolution processing capability is used for image coding, the problem of high chip cost and large chip area is faced, which is not conducive to integrating the coding chip into various devices. Low-end and mid-end coding chips generally do not support the processing capability of ultra-high-definition resolution, such as 4K coding capability and 8K coding capability. In the prior art, the resolution of the original image and video data is reduced, and then encoded using a low-end and mid-end coding chip, and then an upsampling algorithm such as pixel interpolation is performed at the decoding end, and finally played at ultra-high-definition resolution such as 4K resolution and 8K resolution. However, because the resolution of the original image and video data is reduced at the source, this leads to information loss. Even if the picture quality is improved by an upsampling algorithm such as pixel interpolation, there is still blurry details or unreality on the picture. In addition, from the source of ultra-high-definition image and video data, such as the live broadcast site or the server of the program content provider, to the TV display terminal device that is finally displayed to the user, the entire transmission chain may pass through multiple transmission nodes, such as data distribution nodes and network transmission nodes. These transmission nodes may involve repeated encoding and decoding of the image and video data to be transmitted. Therefore, it is necessary to consider the differences in image encoding processing capabilities of different transmission nodes, as well as the impact on the image quality finally presented to the user.

[0003] To this end, the present application provides a preprocessing method, computer equipment, medium and chip for image coding, which are used to address the technical difficulties in the prior art. Summary of the invention

[0004] In a first aspect, the present application provides a preprocessing method for image coding. The preprocessing method includes: receiving a first image, wherein the first image has a first image resolution; processing the first image according to the brightness level and the chromaticity level, thereby obtaining a first brightness map of the first image and a first chromaticity map of the first image respectively; dividing the first brightness map based on the first maximum encoding resolution of the first encoding chip to obtain a plurality of first brightness map blocks, wherein the resolution of the maximum first brightness map block among the plurality of first brightness map blocks is not higher than the first maximum encoding resolution, and downsampling the first chromaticity map according to a first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first maximum encoding resolution, selectively dividing the downsampled first chromaticity map to obtain a plurality of downsampled first chromaticity map blocks; using the plurality of first brightness map blocks and the downsampled first chromaticity map as the preprocessing result of the first image, or using the plurality of first brightness map blocks and the plurality of downsampled first chromaticity map blocks as the preprocessing result of the first image, and the preprocessing result of the first image is used for encoding through the first encoding chip.

[0005] Through the first aspect of the present application, the additional cost of hardware upsampling is avoided, and there is no need to simulate or approximate the information loss caused by reducing the resolution through highly complex algorithm operations. The picture resolution is improved by block segmentation and coding multiplexing; the brightness information of the first image and the chromaticity information of the first image are respectively extracted from the first image, so that the first brightness map and the first chromaticity map obtained respectively display the first image from the brightness level and the chromaticity level, and the first brightness map and the first chromaticity map are respectively processed by corresponding processes, thereby retaining the original information of the first brightness map, and catering to the needs of users who are more sensitive to changes in brightness information, which is helpful to improve coding efficiency and improve picture quality. The resolution of the first chromaticity map is reduced to obtain the first chromaticity map after downsampling, which is helpful to adapt the encoding chip with low-resolution encoding capabilities and improve the encoding speed. At the same time, the impact of image distortion is controlled by standardizing the first compression ratio. In addition, by selectively dividing the first chromaticity map after downsampling based on the maximum resolution of the first encoding, the encoding capability of the encoding chip and the resolution of the original image can be flexibly adapted. By preprocessing the original high-resolution image (including image frames in the video data) to adapt the processing capability of the encoding chip, the image encoding efficiency is improved, and mature encoding chips adapted to low-resolution images can also be used to perform image and video encoding operations.

[0006] In a possible implementation of the first aspect of the present application, when the image resolution of the downsampled first chromaticity map is higher than the first encoding maximum resolution, the downsampled first chromaticity map is divided to obtain the multiple downsampled first chromaticity map blocks, and the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks are used as the preprocessing results of the first image; when the image resolution of the downsampled first chromaticity map is not higher than the first encoding maximum resolution, the downsampled first chromaticity map is not divided, and the multiple first luminance map blocks and the downsampled first chromaticity map are used as the preprocessing results of the first image.

[0007] In a possible implementation manner of the first aspect of the present application, the first compression ratio is not higher than fifty percent, and the image resolution of the first chromaticity diagram after downsampling is determined based on the first image resolution and the first compression ratio.

[0008] In a possible implementation of the first aspect of the present application, the preprocessing result of the first image is encoded by the first encoding chip to obtain multiple code streams, and the multiple code streams are marked, synchronized and packaged to obtain the encoding result of the first image.

[0009] In a possible implementation manner of the first aspect of the present application, the first image resolution is 4K resolution or 8K resolution, and the first encoding maximum resolution is 1080P.

[0010] In a possible implementation of the first aspect of the present application, the first image is processed according to the brightness level and the chromaticity level to obtain a first brightness map of the first image and a first chromaticity map of the first image, respectively, including: determining a triplet of each pixel in the first image, the triplet including a first element representing brightness and a second element and a third element representing chromaticity, using the first element representing brightness in the triplet of each pixel in the first image to construct a first brightness map of the first image, and using the second element and the third element representing chromaticity in the triplet of each pixel in the first image to construct a first chromaticity map of the first image.

[0011] In a possible implementation manner of the first aspect of the present application, the first image is in RGB image format, and the triplet of each pixel in the first image is obtained based on a conversion formula from RGB image format to YUV image format.

[0012] In a possible implementation of the first aspect of the present application, the transmission chain of the first image is associated with multiple transmission nodes, the first encoding chip is deployed on the first transmission node among the multiple transmission nodes, and the preprocessing method is applied to preprocess the first image received by the first transmission node through the first encoding chip on the first transmission node before image encoding.

[0013] In a possible implementation of the first aspect of the present application, the multiple transmission nodes include an image and video recording node, an image and video compression node, an image and video distribution node, a network transmission node, a terminal device receiving node, and an image and video decompression node.

[0014] In a possible implementation manner of the first aspect of the present application, the first transmission node is any transmission node among the multiple transmission nodes, and the first encoding maximum resolution of the first encoding chip represents the encoding processing capability of the first transmission node.

[0015] In a second aspect, an embodiment of the present application further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements a method according to any one of the implementation modes of any of the above aspects when executing the computer program.

[0016] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a computer device, the computer device executes a method according to any one of the implementation methods of any of the above aspects.

[0017] In a fourth aspect, an embodiment of the present application further provides a computer program product, which includes instructions stored on a computer-readable storage medium, and when the instructions are executed on a computer device, the computer device executes a method according to any one of the implementation methods of any of the above aspects.

[0018] In a fifth aspect, an embodiment of the present application also provides a preprocessing chip for image encoding. The preprocessing chip includes: a receiving module, which is used to receive a first image, wherein the first image has a first image resolution; a first processing module, which is used to process the first image according to a luminance level and a chrominance level, thereby obtaining a first luminance map of the first image and a first chrominance map of the first image respectively; a second processing module, which is used to: divide the first luminance map based on a first encoding maximum resolution of a first encoding chip to obtain a plurality of first luminance map blocks, wherein the resolution of the maximum first luminance map block among the plurality of first luminance map blocks is not higher than the first encoding maximum resolution, and downsample the first chrominance map according to a first compression ratio to obtain a downsampled first chrominance map, and then, based on the first encoding maximum resolution, selectively divide the downsampled first chrominance map to obtain a plurality of downsampled first chrominance map blocks; an output module, which is used to: use the plurality of first luminance map blocks and the downsampled first chrominance map as the preprocessing result of the first image, or use the plurality of first luminance map blocks and the plurality of downsampled first chrominance map blocks as the preprocessing result of the first image, wherein the preprocessing result of the first image is used for encoding by the first encoding chip.

[0019] Through the fifth aspect of the present application, the additional cost of hardware upsampling is avoided, and there is no need to simulate or approximate the information loss caused by reducing the resolution through highly complex algorithm operations. The picture resolution is improved by block segmentation and coding multiplexing; the brightness information of the first image and the chromaticity information of the first image are respectively extracted from the first image, so that the first brightness map and the first chromaticity map obtained respectively display the first image from the brightness level and the chromaticity level, and the first brightness map and the first chromaticity map are respectively processed by corresponding processes, thereby retaining the original information of the first brightness map, and catering to the needs of users who are more sensitive to changes in brightness information, which is helpful to improve coding efficiency and improve picture quality. The resolution of the first chromaticity map is reduced to obtain the first chromaticity map after downsampling, which is helpful to adapt the encoding chip with low-resolution encoding capabilities and improve the encoding speed. At the same time, the impact of image distortion is controlled by standardizing the first compression ratio. In addition, by selectively dividing the first chromaticity map after downsampling based on the maximum resolution of the first encoding, the encoding capability of the encoding chip and the resolution of the original image can be flexibly adapted. By preprocessing the original high-resolution image (including image frames in the video data) to adapt the processing capability of the encoding chip, the image encoding efficiency is improved, and mature encoding chips adapted to low-resolution images can also be used to perform image and video encoding operations.

[0020] In a possible implementation of the fifth aspect of the present application, when the image resolution of the downsampled first chromaticity map is higher than the first encoding maximum resolution, the second processing module divides the downsampled first chromaticity map to obtain the multiple downsampled first chromaticity map blocks, and the output module uses the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks as the preprocessing result of the first image; when the image resolution of the downsampled first chromaticity map is not higher than the first encoding maximum resolution, the second processing module does not divide the downsampled first chromaticity map, and the output module uses the multiple first luminance map blocks and the downsampled first chromaticity map as the preprocessing result of the first image.

[0021] In a possible implementation of the fifth aspect of the present application, the preprocessing result of the first image is encoded by the first encoding chip to obtain multiple code streams, and the multiple code streams are marked, synchronized and packaged to obtain the encoding result of the first image. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0023] Figure 1 A schematic diagram of a flow chart of a preprocessing method for image coding provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of a preprocessing chip for image encoding provided in an embodiment of the present application;

[0025] Figure 3 A schematic diagram of a transmission chain of a first image provided in an embodiment of the present application;

[0026] Figure 4 A schematic diagram of the structure of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0028] It should be understood that, in the description of this application, "at least one" means one or more, and "a plurality of" means two or more. In addition, unless otherwise specified, the words "first", "second", etc. are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0029] Figure 1 The following is a flow chart of a preprocessing method for image coding provided in an embodiment of the present application. Figure 1 As shown, the pretreatment method includes the following steps.

[0030] Step S110: receiving a first image, wherein the first image has a first image resolution.

[0031] Step S120: Process the first image according to the brightness level and the chromaticity level, so as to obtain a first brightness map of the first image and a first chromaticity map of the first image respectively.

[0032] Step S130: Based on the first encoding maximum resolution of the first encoding chip, divide the first luminance map to obtain a plurality of first luminance map blocks, the resolution of the maximum first luminance map block among the plurality of first luminance map blocks is not higher than the first encoding maximum resolution, and downsample the first chromaticity map according to a first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first encoding maximum resolution, selectively divide the downsampled first chromaticity map to obtain a plurality of downsampled first chromaticity map blocks.

[0033] Step S140: Use the multiple first luminance image blocks and the downsampled first chromaticity image blocks as the preprocessing results of the first image, or use the multiple first luminance image blocks and the multiple downsampled first chromaticity image blocks as the preprocessing results of the first image, and the preprocessing results of the first image are used for encoding through the first encoding chip.

[0034] See also Figure 1 , Figure 1The preprocessing method for image coding shown can be applied to applications such as ultra-high-definition display and ultra-high-definition image and video recording, and is used to preprocess ultra-high-definition image and video data before image and video coding operations, so that the preprocessed image and video data, such as preprocessed images, preprocessed video frames, etc., can be used for image and video coding operations through low-end and mid-end chips, which generally do not support the processing capabilities of ultra-high-definition resolutions. For example, ultra-high-definition image and video data have ultra-high-definition resolutions such as 4K resolution and 8K resolution. If a coding chip with corresponding ultra-high-definition resolution processing capabilities is used for image coding, it faces problems such as high chip cost and large chip footprint, and is not conducive to integrating the coding chip into various devices. In applications such as ultra-high-definition display and ultra-high-definition image and video recording, from the source of ultra-high-definition image and video data, such as the live broadcast site or the server of the program content provider, to the TV display terminal device that is finally displayed to the user, the entire transmission chain may pass through multiple transmission nodes, such as data distribution nodes and network transmission nodes. These transmission nodes may involve repeated encoding and decoding of the image and video data to be transmitted. Therefore, it is necessary to consider the differences in the image encoding processing capabilities of different transmission nodes, as well as the impact on the image quality finally displayed to the user. Figure 1 A detailed description of each step is shown, Figure 1 The preprocessing method for image coding shown in the figure shows how to preprocess the original high-resolution image (including image frames in video data) to adapt the processing capability of the coding chip, thereby improving the image coding efficiency. It can also use mature coding chips adapted to low-resolution images to perform image and video coding operations.

[0035] Continue reading Figure 1In step S110, a first image is received, wherein the first image has a first image resolution. Here, the first image is image data in high-resolution original image video data or an image frame in video data that needs to be encoded. In some examples, the first image resolution refers to a high resolution used in applications such as ultra-high-definition display and ultra-high-definition image and video recording, such as 4K resolution and 8K resolution. In some examples, the first image resolution may refer to any resolution higher than the processing capability of the encoding chip. For example, if the capability of the encoding chip is adapted to 1080P resolution, the first image resolution may refer to any resolution higher than 1080P resolution, such as 1980P resolution. When the image resolution of the image to be encoded is higher than the processing capability of the encoding chip used for image encoding (such as the maximum encoding resolution of the encoding chip), it means that the image data to be processed exceeds the processing capability range of the encoding chip in design, and therefore cannot be supported by the encoding capability of the encoding chip, which may result in encoding errors and low encoding efficiency. If the original image data is subjected to a resolution reduction operation to reduce the pixel density, that is, the original high-resolution image is converted into a low-resolution image, this means the loss of image information. Although the image quality can be subsequently improved through restoration algorithms or resolution enhancement operations, such as increasing the pixel density through upsampling algorithms such as pixel interpolation, the use of algorithms to infer or approximate the lost information still results in blurred details or unreality on the image.

[0036] Continue reading Figure 1, after step S110, step S120 is performed. In step S120, the first image is processed according to the brightness level and the chromaticity level, so as to obtain a first brightness map of the first image and a first chromaticity map of the first image respectively. Here, the first brightness map includes the brightness information of the first image, that is, the grayscale value, and the first brightness map can be, for example, a black and white image, and the first chromaticity map includes the chromaticity information of the first image, that is, the hue and saturation. Processing the first image according to the brightness level and the chromaticity level means extracting the brightness information of the first image and the chromaticity information of the first image from the first image respectively, so that the first brightness map and the first chromaticity map obtained in this way respectively show the first image from the brightness level and the chromaticity level. In this way, the first brightness map and the first chromaticity map can be processed respectively by performing corresponding processing flows on the first brightness map and the first chromaticity map, so as to utilize the principle that the sensitivity of the human eye to chromaticity is lower than the sensitivity of the human eye to brightness (this is because the number of cells in the human eye used to identify brightness is generally greater than the number of cells used to identify chromaticity), so as to realize image encoding of high-resolution images on the basis of encoding chips adapted to low-resolution encoding capabilities, thereby improving encoding efficiency and picture quality. It should be understood that in step S120, the first image can be processed according to the brightness level and the chromaticity level by any suitable algorithm, model, hardware and circuit, so as to obtain the first brightness map of the first image and the first chromaticity map of the first image respectively. In some examples, the first image can be in YUV data format, and each pixel on the high-resolution original image can be represented as a YUV triple, where Y represents brightness, that is, grayscale value, and U and V represent chromaticity, that is, hue and saturation. In this way, the first brightness map can be constructed by extracting Y of each pixel, and the first chromaticity map can be constructed by extracting U and V of each pixel. In other examples, the first image can be in RGB data format, that is, corresponding to the data format of the three primary colors (red, green, and blue), and the first image in YUV data format can be obtained by the conversion formula from RGB data format to YUV data format, and then the brightness information and chromaticity information are extracted therefrom respectively to obtain the first brightness map of the first image and the first chromaticity map of the first image respectively. In other examples, two neural network models or two neural network branches may be used to respectively perform feature extraction of brightness feature information and feature extraction of chromaticity feature information, thereby obtaining a first brightness map of the first image and a first chromaticity map of the first image, respectively.

[0037] Continue reading Figure 1, after step S120, execute step S130. In step S130, based on the first maximum encoding resolution of the first encoding chip, the first brightness map is divided to obtain a plurality of first brightness map blocks, the resolution of the largest first brightness map block in the plurality of first brightness map blocks is not higher than the first maximum encoding resolution, and the first chromaticity map is downsampled according to the first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first maximum encoding resolution, the downsampled first chromaticity map is selectively divided to obtain a plurality of downsampled first chromaticity map blocks. In order to flexibly adapt the encoding capability of any encoding chip, how to process the first brightness map is regulated based on the first maximum encoding resolution of the first encoding chip. By dividing the first brightness map to obtain a plurality of first brightness map blocks, and ensuring that the resolution of the largest first brightness map block in the plurality of first brightness map blocks is not higher than the first maximum encoding resolution, the encoding capability of the first encoding chip can be fully utilized, while ensuring that the resolution of each brightness map block in the plurality of first brightness map blocks does not exceed the first maximum encoding resolution. Therefore, the first encoding chip can handle the encoding operation of each brightness map block in the multiple first brightness map blocks. Here, the first brightness map can be divided in any suitable manner to obtain multiple first brightness map blocks, such as dividing in the horizontal direction, dividing in the vertical direction, or using a predetermined division template such as a four-grid template or a nine-grid template. Multiple first brightness map blocks can have the same size, or can have different sizes. The resolution of the largest first brightness map block among the multiple first brightness map blocks is generally the highest. Therefore, by standardizing the resolution of the largest first brightness map block among the multiple first brightness map blocks to be no higher than the first encoding maximum resolution, the processing capability of the first encoding chip is adapted. For example, the first brightness map may have a resolution of 3K times 2K, and the maximum resolution of the first encoding of the first encoding chip is 1080P resolution (for example, an encoding chip adapted to an image with a resolution of 1920x1080P). By equally dividing the first brightness map into four blocks, the resolution of the maximum first brightness map block is 1.5K times 1K, so the horizontal resolution and vertical resolution of each block can be adapted to the processing capacity of the first encoding chip. Considering the principle that the human eye is less sensitive to chromaticity than to brightness (this is because the number of cells in the human eye used to identify brightness is generally greater than the number of cells used to identify chromaticity), therefore, based on the maximum resolution of the first encoding of the first encoding chip, the first brightness map is divided to obtain a plurality of first brightness map blocks, so that the original information of the first brightness map is retained, and the needs of users who are more sensitive to changes in brightness information are also met, which helps to improve encoding efficiency and picture quality.In addition, in step S130, the first chromaticity diagram is downsampled according to the first compression ratio to obtain the downsampled first chromaticity diagram, and then, based on the first maximum encoding resolution, the downsampled first chromaticity diagram is selectively divided to obtain multiple downsampled first chromaticity diagram blocks. Here, the first compression ratio means reducing the resolution of the original image according to a certain ratio, such as 20%, 30%, 50%, which will cause the loss of information in the original image. In order to control the impact of image distortion, the first compression ratio for downsampling should not exceed 50%, which means that the original resolution of the first chromaticity diagram is compressed by half at most, for example, the original 8K resolution is compressed to 4K resolution. In order to flexibly adapt to the encoding capacity of any encoding chip, how to process the first chromaticity diagram is regulated based on the first encoding maximum resolution of the first encoding chip, and considering that the original resolution of the first chromaticity diagram is unknown, for this reason, based on the first maximum encoding resolution, the downsampled first chromaticity diagram is selectively divided to obtain multiple downsampled first chromaticity diagram blocks. In this way, when the first chromaticity diagram is downsampled according to the first compression ratio, the resolution of the downsampled first chromaticity diagram obtained thereby may still be higher than the first maximum encoding resolution. For example, the original resolution of the first chromaticity diagram is 8K resolution. After being downsampled according to a compression ratio of up to 50%, the resolution of the downsampled first chromaticity diagram obtained thereby is 4K resolution, which is still higher than the first maximum encoding resolution of 1080P resolution. By standardizing that the resolution of the largest downsampled first chromaticity diagram block among multiple downsampled first chromaticity diagram blocks is not higher than the first maximum encoding resolution, the processing capability of the first encoding chip is adapted. Moreover, when the first chromaticity diagram is downsampled according to the first compression ratio, the resolution of the downsampled first chromaticity diagram obtained thereby may not be higher than the first maximum encoding resolution. In this way, it is possible to choose not to divide the downsampled first chromaticity diagram, but to directly use the downsampled first chromaticity diagram, thereby improving the encoding efficiency.

[0038] Continue reading Figure 1, after step S130, execute step S140. In step S140, the multiple first brightness image blocks and the first chromaticity image after downsampling are used as the preprocessing results of the first image, or the multiple first brightness image blocks and the multiple first chromaticity image blocks after downsampling are used as the preprocessing results of the first image, and the preprocessing results of the first image are used for encoding through the first encoding chip. As described above, the brightness information of the first image and the chromaticity information of the first image are respectively extracted from the first image, so that the first brightness image and the first chromaticity image obtained in this way respectively display the first image from the brightness level and the chromaticity level. In this way, the first brightness image and the first chromaticity image can be processed respectively by the corresponding processing flow, so as to utilize the principle that the sensitivity of the human eye to chromaticity is lower than the sensitivity of the human eye to brightness (this is because the number of cells used to identify brightness in the human eye is generally more than the number of cells used to identify chromaticity), so that the image encoding of the high-resolution image can be realized on the basis of the encoding chip adapted to the low-resolution encoding capability, so as to improve the encoding efficiency and the picture quality. Among them, for the first brightness map, that is, the extraction result of the brightness information of the first image, based on the first maximum encoding resolution of the first encoding chip, the first brightness map is divided to obtain multiple first brightness map blocks, so that the original information of the first brightness map is retained, and the user's needs for being sensitive to changes in brightness information are also catered to, which is helpful to improve encoding efficiency and picture quality. For the first chromaticity map, that is, the extraction result of the chromaticity information of the first image, the first chromaticity map is downsampled according to the first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first maximum encoding resolution, the downsampled first chromaticity map is selectively divided to obtain multiple downsampled first chromaticity map blocks. In this way, the resolution of the first chromaticity map is reduced by downsampling to obtain a downsampled first chromaticity map, which helps to adapt to the encoding chip with low resolution encoding capability and improve the encoding speed. At the same time, the influence of image distortion is controlled by standardizing the first compression ratio, and the downsampled first chromaticity map is selectively divided based on the first maximum encoding resolution, so as to achieve flexible adaptation of the encoding capability of the encoding chip and the resolution of the original image.

[0039] In conclusion, Figure 1The preprocessing method for image coding shown in the figure avoids the additional cost of hardware upsampling, and does not need to simulate or approximate the information loss caused by reducing the resolution through highly complex algorithm operations, and improves the picture resolution through block segmentation and coding multiplexing; extracts the brightness information of the first image and the chromaticity information of the first image from the first image, respectively, so that the first brightness image and the first chromaticity image obtained respectively show the first image from the brightness level and the chromaticity level, and performs corresponding processing flows on the first brightness image and the first chromaticity image, respectively, retains the original information of the first brightness image, and also caters to the needs of users who are more sensitive to changes in brightness information, which is helpful to improve coding efficiency and improve picture quality. Sampling reduces the resolution of the first chromaticity map to obtain the first chromaticity map after downsampling, which helps to adapt the encoding chip with low-resolution encoding capabilities and improve the encoding speed. At the same time, by standardizing the first compression ratio, it is possible to control the impact of image distortion. In addition, by selectively dividing the first chromaticity map after downsampling based on the maximum resolution of the first encoding, it is possible to flexibly adapt the encoding capability of the encoding chip and the resolution of the original image. By preprocessing the original high-resolution image (including image frames in the video data) to adapt the processing capability of the encoding chip, it is possible to improve the image encoding efficiency, and mature encoding chips adapted to low-resolution images can also be used to perform image and video encoding operations.

[0040] See also Figure 1 In a possible implementation, when the image resolution of the downsampled first chromaticity map is higher than the first maximum encoding resolution, the downsampled first chromaticity map is divided to obtain the multiple downsampled first chromaticity map blocks, and the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks are used as the preprocessing result of the first image; when the image resolution of the downsampled first chromaticity map is not higher than the first maximum encoding resolution, the downsampled first chromaticity map is not divided, and the multiple first luminance map blocks and the downsampled first chromaticity map are used as the preprocessing result of the first image. In some embodiments, the first compression ratio is not higher than fifty percent, and the image resolution of the downsampled first chromaticity map is determined based on the first image resolution and the first compression ratio. In this way, the resolution of the first chromaticity map is reduced by downsampling to obtain the downsampled first chromaticity map, which is helpful to adapt the encoding chip with low resolution encoding capability and improve the encoding speed. At the same time, by standardizing the first compression ratio, the impact of image distortion is controlled. Moreover, by selectively dividing the downsampled first chromaticity map based on the first encoding maximum resolution, flexible adaptation of the encoding capability of the encoding chip and the resolution of the original image is achieved.

[0041] In a possible implementation, the preprocessing result of the first image is encoded by the first encoding chip to obtain multiple code streams, and the multiple code streams are marked, synchronized and packaged to obtain the encoding result of the first image. In this way, by preprocessing the original high-resolution image (including the image frame in the video data), the processing capability of the encoding chip is adapted to improve the image encoding efficiency, and the mature encoding chip adapted to low-resolution images can also be used to perform image and video encoding operations.

[0042] In a possible implementation, the first image resolution is 4K resolution or 8K resolution, and the first maximum encoding resolution is 1080P. In this way, by preprocessing the original high-resolution image (including the image frame in the video data), the processing capability of the encoding chip is adapted to improve the image encoding efficiency, and the mature encoding chip adapted to low-resolution images can also be used to perform image and video encoding operations.

[0043] In a possible implementation, the first image is processed according to the brightness level and the chromaticity level, so as to obtain a first brightness map of the first image and a first chromaticity map of the first image respectively, including: determining a triplet of each pixel in the first image, the triplet including a first element representing brightness and a second element and a third element representing chromaticity, using the first element representing brightness in the triplet of each pixel in the first image to construct a first brightness map of the first image, and using the second element and the third element representing chromaticity in the triplet of each pixel in the first image to construct a first chromaticity map of the first image. In some embodiments, the first image is in RGB image format, and the triplet of each pixel in the first image is obtained based on a conversion formula from RGB image format to YUV image format. In this way, the brightness information of the first image and the chromaticity information of the first image are extracted from the first image respectively, and the first brightness map and the first chromaticity map obtained in this way respectively show the first image from the brightness level and the chromaticity level. In this way, the first brightness image and the first chromaticity image can be processed accordingly, respectively, so as to utilize the principle that the human eye is less sensitive to chromaticity than to brightness (this is because the number of cells in the human eye used to identify brightness is generally greater than the number of cells used to identify chromaticity). Therefore, based on the encoding chip adapted to the low-resolution encoding capability, image encoding of high-resolution images can be achieved, thereby improving encoding efficiency and picture quality.

[0044] In a possible implementation, the transmission chain of the first image is associated with a plurality of transmission nodes, the first encoding chip is deployed on a first transmission node among the plurality of transmission nodes, and the preprocessing method is applied to preprocess the first image received by the first transmission node by the first encoding chip on the first transmission node before image encoding. Here, the plurality of transmission nodes may each use a different encoding chip, and therefore may have different encoding processing capabilities. For example, some transmission nodes may support encoding of images with a 4K resolution, while another transmission node may not support encoding of images with a 4K resolution. On these transmission nodes, it may involve repeated encoding and decoding of the image video data to be transmitted, so it is necessary to consider the differences in the image encoding processing capabilities of different transmission nodes, as well as the impact on the image quality ultimately presented to the user. Figure 1 The preprocessing method for image coding shown in the figure regulates how to process the first luminance map based on the first coding maximum resolution of the first coding chip in order to flexibly adapt to the coding capability of any coding chip. Also, it regulates how to process the first chrominance map based on the first coding maximum resolution of the first coding chip. Thus, on the basis of the coding chip that is adapted to the low-resolution coding capability, image coding of high-resolution images can be achieved, thereby improving coding efficiency and enhancing picture quality.

[0045] In some embodiments, the multiple transmission nodes include image and video recording nodes, image and video compression nodes, image and video distribution nodes, network transmission nodes, terminal device receiving nodes, and image and video decompression nodes. In some embodiments, the first transmission node is any transmission node among the multiple transmission nodes, and the first encoding maximum resolution of the first encoding chip represents the encoding processing capability of the first transmission node. It should be understood that the multiple transmission nodes can be of any composition and connection relationship, and can also be limited to only a part of the transmission chain. Figure 1 The preprocessing method for image coding shown in the figure realizes image coding of high-resolution images on the basis of a coding chip adapted to low-resolution coding capabilities, thereby improving coding efficiency and enhancing picture quality.

[0046] Figure 2 A schematic diagram of a preprocessing chip for image coding provided in an embodiment of the present application. Figure 2As shown, the pre-processing chip includes: a receiving module 210, used to receive a first image, wherein the first image has a first image resolution; a first processing module 220, used to process the first image according to the brightness level and the chromaticity level, thereby respectively obtaining a first brightness map of the first image and a first chromaticity map of the first image; a second processing module 230, used to: based on the first encoding maximum resolution of the first encoding chip, divide the first brightness map to obtain a plurality of first brightness map blocks, the resolution of the maximum first brightness map block in the plurality of first brightness map blocks is not higher than the first encoding maximum resolution, and downsample the first chromaticity map according to a first compression ratio to obtain a downsampled first chromaticity map, and then, based on the first encoding maximum resolution, selectively divide the downsampled first chromaticity map to obtain a plurality of downsampled first chromaticity map blocks; an output module 240, used to: use the plurality of first brightness map blocks and the downsampled first chromaticity map as the preprocessing result of the first image, or use the plurality of first brightness map blocks and the plurality of downsampled first chromaticity map blocks as the preprocessing result of the first image. The preprocessing result of the first image is used for encoding by the first encoding chip.

[0047] In conclusion, Figure 2 The pre-processing chip shown avoids the extra cost of hardware upsampling, and does not need to simulate or approximate the information loss caused by reducing the resolution through highly complex algorithm operations. The picture resolution is improved by block segmentation and coding multiplexing. The brightness information of the first image and the chromaticity information of the first image are respectively extracted from the first image, so that the first brightness image and the first chromaticity image obtained respectively display the first image from the brightness level and the chromaticity level, and the first brightness image and the first chromaticity image are respectively processed by corresponding processes, so that the original information of the first brightness image is retained, and the needs of users who are more sensitive to changes in brightness information are met, which is helpful to improve coding efficiency and improve picture quality. The resolution of the first chromaticity map is lowered to obtain the first chromaticity map after downsampling, which is helpful to adapt the encoding chip with low-resolution encoding capability and improve the encoding speed. At the same time, the influence of image distortion is controlled by standardizing the first compression ratio. Moreover, by selectively dividing the first chromaticity map after downsampling based on the maximum resolution of the first encoding, the encoding capability of the encoding chip and the resolution of the original image can be flexibly adapted. By preprocessing the original high-resolution image (including the image frame in the video data) to adapt the processing capability of the encoding chip, the image encoding efficiency is improved, and mature encoding chips adapted to low-resolution images can also be used to perform image and video encoding operations.

[0048] See also Figure 2In a possible implementation, when the image resolution of the downsampled first chromaticity map is higher than the first encoding maximum resolution, the second processing module 230 divides the downsampled first chromaticity map to obtain the multiple downsampled first chromaticity map blocks, and the output module 240 uses the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks as the preprocessing result of the first image; when the image resolution of the downsampled first chromaticity map is not higher than the first encoding maximum resolution, the second processing module 230 does not divide the downsampled first chromaticity map, and the output module 240 uses the multiple first luminance map blocks and the downsampled first chromaticity map as the preprocessing result of the first image. In this way, the resolution of the first chromaticity map is reduced by downsampling to obtain the downsampled first chromaticity map, which is helpful to adapt the encoding chip with low resolution encoding capability and improve the encoding speed. At the same time, by standardizing the first compression ratio, the impact of image distortion is controlled. Moreover, by selectively dividing the downsampled first chromaticity map based on the first encoding maximum resolution, flexible adaptation of the encoding capability of the encoding chip and the resolution of the original image is achieved.

[0049] In a possible implementation, the preprocessing result of the first image is encoded by the first encoding chip to obtain multiple code streams, and the multiple code streams are marked, synchronized and packaged to obtain the encoding result of the first image. In this way, by preprocessing the original high-resolution image (including the image frame in the video data), the processing capability of the encoding chip is adapted to improve the image encoding efficiency, and the mature encoding chip adapted to low-resolution images can also be used to perform image and video encoding operations.

[0050] Figure 3 A schematic diagram of a transmission chain of a first image provided in an embodiment of the present application. Figure 3 As shown, the transmission chain of the first image is associated with multiple transmission nodes, the first encoding chip is deployed on the first transmission node among the multiple transmission nodes, and the preprocessing method is applied to preprocess the first image received by the first transmission node by the first encoding chip on the first transmission node before image encoding. The multiple transmission nodes include an image and video recording node 310, an image and video compression node 320, an image and video distribution node 330, a network transmission node 340, a terminal device receiving node 350, and an image and video decompression node 360. Here, the first transmission node is any transmission node among the multiple transmission nodes, and the first encoding maximum resolution of the first encoding chip represents the encoding processing capability of the first transmission node.

[0051] See also Figure 1 , Figure 2 and Figure 3 , these transmission nodes may involve repeated encoding and decoding of the image and video data to be transmitted, so it is necessary to consider the differences in the image encoding processing capabilities of different transmission nodes and the impact on the image quality ultimately presented to the user. Figure 1 The preprocessing method for image coding shown in Figure 2 The preprocessing chip for image encoding shown in the figure regulates how to process the first luminance map based on the first encoding maximum resolution of the first encoding chip in order to be able to flexibly adapt to the encoding capability of any encoding chip. Also, it regulates how to process the first chrominance map based on the first encoding maximum resolution of the first encoding chip. Thus, on the basis of the encoding chip that is adapted to the low-resolution encoding capability, image encoding of high-resolution images can be achieved, thereby improving encoding efficiency and enhancing picture quality.

[0052] Figure 4 4 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application, and the computing device 400 includes: one or more processors 410, a communication interface 420 and a memory 430. The processor 410, the communication interface 420 and the memory 430 are interconnected via a bus 440. Optionally, the computing device 400 may also include an input / output interface 450, and the input / output interface 450 is connected to an input / output device for receiving parameters set by a user, etc. The computing device 400 can be used to implement some or all of the functions of the device embodiment or system embodiment in the above-mentioned embodiment of the present application; the processor 410 can also be used to implement some or all of the operating steps of the method embodiment in the above-mentioned embodiment of the present application. For example, the specific implementation of the computing device 400 performing various operations can refer to the specific details in the above-mentioned embodiments, such as the processor 410 is used to perform some or all of the steps in the above-mentioned method embodiment or some or all of the operations in the above-mentioned method embodiment. For another example, in an embodiment of the present application, the computing device 400 may be used to implement part or all of the functions of one or more components in the above-mentioned apparatus embodiment. In addition, the communication interface 420 may be specifically used to perform the communication functions necessary to implement the functions of these apparatuses and components, and the processor 410 may be specifically used to perform the processing functions necessary to implement the functions of these apparatuses and components.

[0053] It should be understood that Figure 4The computing device 400 may include one or more processors 410, and the multiple processors 410 may provide processing capabilities in a parallel connection mode, a serial connection mode, a serial-parallel connection mode, or any connection mode, or the multiple processors 410 may form a processor sequence or a processor array, or the multiple processors 410 may be divided into a main processor and an auxiliary processor, or the multiple processors 410 may have different architectures such as a heterogeneous computing architecture. In addition, Figure 4 The computing device 400 shown in the figure, and the related structural description and functional description are exemplary and non-limiting. In some exemplary embodiments, the computing device 400 may include Figure 4 More or fewer components may be shown, or some components may be combined or separated, or may have a different arrangement of components.

[0054] The processor 410 may have a variety of specific implementation forms. For example, the processor 410 may include a central processing unit (CPU), a graphic processing unit (GPU), a neural-network processing unit (NPU), a tensor processing unit (TPU) or a data processing unit (DPU), etc., and the embodiment of the present application does not specifically limit it. The processor 410 may also be a single-core processor or a multi-core processor. The processor 410 may be a combination of a CPU and a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof. The processor 410 may also be implemented using a logic device with built-in processing logic alone, such as an FPGA or a digital signal processor (DSP). The communication interface 420 may be a wired interface or a wireless interface for communicating with other modules or devices. The wired interface may be an Ethernet interface, a local interconnect network (LIN), etc., and the wireless interface may be a cellular network interface or a wireless local area network interface, etc.

[0055] The memory 430 may be a non-volatile memory, such as a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The memory 430 may also be a volatile memory, which may be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM). The memory 430 may also be used to store program codes and data, so that the processor 410 calls the program codes stored in the memory 430 to execute some or all of the operation steps in the above method embodiment, or to execute the corresponding functions in the above device embodiment. Figure 4 Show more or fewer components, or have different component configurations.

[0056] The bus 440 may be a peripheral component interconnect express (PCIe) bus, an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), etc. The bus 440 may be divided into an address bus, a data bus, a control bus, etc. In addition to the data bus, the bus 440 may also include a power bus, a control bus, and a status signal bus, etc. However, for the sake of clarity, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0057] The method and device provided in the embodiments of the present application are based on the same inventive concept. Since the principles of solving the problems in the methods and devices are similar, the embodiments, implementation methods, examples or implementation methods of the methods and devices can refer to each other, and the repeated parts will not be repeated. The embodiments of the present application also provide a system, which includes multiple computing devices, and the structure of each computing device can refer to the structure of the computing device described above. The functions or operations that can be implemented by the system can refer to the specific implementation steps in the above method embodiments and / or the specific functions described in the above device embodiments, which will not be repeated here.

[0058] The present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a computer device (such as one or more processors), the method steps in the above method embodiment can be implemented. The specific implementation of the processor of the computer-readable storage medium in executing the above method steps can refer to the specific operations described in the above method embodiment and / or the specific functions described in the above device embodiment, which will not be repeated here.

[0059] It should be understood by those skilled in the art that the embodiments of the present application may be provided as methods, systems, or computer program products. The present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. The embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any other combination. When implemented using software, the above embodiments may be implemented in whole or in part in the form of a computer program product. The present application may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. The computer program product includes one or more computer instructions. When the computer program instructions are loaded or executed on a computer, the process or function described in the embodiments of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. Computer-readable storage media can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more available media. Available media can be magnetic media (such as floppy disks, hard disks, tapes), optical media, or semiconductor media. Semiconductor media can be solid-state hard disks, random access memory, flash memory, read-only memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, registers, or any other form of suitable storage media.

[0060] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. Each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0061] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. The steps in the method of the embodiment of the present application can be adjusted in order, merged or deleted according to actual needs; the modules in the system of the embodiment of the present application can be divided, merged or deleted according to actual needs. If these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A preprocessing method for image coding, characterized in that: The pretreatment method comprises: Receiving a first image, wherein the first image has a first image resolution; Processing the first image according to a luminance level and a chrominance level, thereby obtaining a first luminance map of the first image and a first chrominance map of the first image respectively; Based on a first encoding maximum resolution of a first encoding chip, the first luminance image is divided to obtain a plurality of first luminance image blocks, wherein a resolution of a maximum first luminance image block among the plurality of first luminance image blocks is not higher than the first encoding maximum resolution, and the first chrominance image is downsampled according to a first compression ratio to obtain a downsampled first chrominance image, and then, based on the first encoding maximum resolution, the downsampled first chrominance image is selectively divided to obtain a plurality of downsampled first chrominance image blocks; Using the multiple first luminance image blocks and the downsampled first chrominance image as the preprocessing result of the first image, or using the multiple first luminance image blocks and the multiple downsampled first chrominance image blocks as the preprocessing result of the first image, the preprocessing result of the first image is used for encoding by the first encoding chip, The using of the multiple first luminance map blocks and the downsampled first chromaticity map as the preprocessing result of the first image, or the using of the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks as the preprocessing result of the first image, specifically includes: when the image resolution of the downsampled first chromaticity map is higher than the first encoding maximum resolution, dividing the downsampled first chromaticity map to obtain the multiple downsampled first chromaticity map blocks, and using the multiple first luminance map blocks and the multiple downsampled first chromaticity map blocks as the preprocessing result of the first image; when the image resolution of the downsampled first chromaticity map is not higher than the first encoding maximum resolution, not dividing the downsampled first chromaticity map, and using the multiple first luminance map blocks and the downsampled first chromaticity map as the preprocessing result of the first image. Among them, the transmission chain of the first image is associated with multiple transmission nodes, the first encoding chip is deployed on the first transmission node among the multiple transmission nodes, and the preprocessing method is applied to preprocess the first image received by the first transmission node through the first encoding chip on the first transmission node before image encoding.

2. The pretreatment method according to claim 1, characterized in that The first compression ratio is not higher than fifty percent, and the image resolution of the first chromaticity diagram after downsampling is determined based on the first image resolution and the first compression ratio.

3. The pretreatment method according to claim 1, characterized in that: The preprocessing result of the first image is encoded by the first encoding chip to obtain a plurality of code streams, and the plurality of code streams are marked, synchronized and packaged to obtain the encoding result of the first image.

4. The pretreatment method according to claim 1, characterized in that: The first image resolution is 4K resolution or 8K resolution, and the first encoding maximum resolution is 1080P.

5. The pretreatment method according to claim 1, characterized in that: The first image is processed according to the brightness level and the chromaticity level to obtain a first brightness map of the first image and a first chromaticity map of the first image respectively, including: determining a triplet of each pixel in the first image, the triplet including a first element representing brightness and a second element and a third element representing chromaticity, using the first element representing brightness in the triplet of each pixel in the first image to construct a first brightness map of the first image, and using the second element and the third element representing chromaticity in the triplet of each pixel in the first image to construct a first chromaticity map of the first image.

6. The pretreatment method according to claim 5, characterized in that: The first image is in RGB image format, and the triplet of each pixel in the first image is obtained based on a conversion formula from RGB image format to YUV image format.

7. The pretreatment method according to claim 1, characterized in that: The multiple transmission nodes include an image and video recording node, an image and video compression node, an image and video distribution node, a network transmission node, a terminal device receiving node, and an image and video decompression node.

8. The pretreatment method according to claim 1, characterized in that: The first transmission node is any transmission node among the multiple transmission nodes, and the first encoding maximum resolution of the first encoding chip represents the encoding processing capability of the first transmission node.

9. A computer device, characterized in that: The computer device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, which, when executed on a computer device, cause the computer device to perform the method according to any one of claims 1 to 8.

11. A preprocessing chip for image coding, characterized in that: The pre-processing chip comprises: A receiving module, configured to receive a first image, wherein the first image has a first image resolution; A first processing module, configured to process the first image according to a luminance level and a chrominance level, thereby obtaining a first luminance map of the first image and a first chrominance map of the first image respectively; A second processing module is configured to: divide the first luminance image based on a first encoding maximum resolution of a first encoding chip to obtain a plurality of first luminance image blocks, wherein a resolution of a maximum first luminance image block among the plurality of first luminance image blocks is not higher than the first encoding maximum resolution, and downsample the first chrominance image according to a first compression ratio to obtain a downsampled first chrominance image, and then, based on the first encoding maximum resolution, selectively divide the downsampled first chrominance image to obtain a plurality of downsampled first chrominance image blocks; an output module, configured to: use the plurality of first luminance image blocks and the downsampled first chrominance image as a preprocessing result of the first image, or use the plurality of first luminance image blocks and the plurality of downsampled first chrominance image blocks as a preprocessing result of the first image, The use of the multiple first luminance image blocks and the downsampled first chromaticity image as the preprocessing result of the first image, or the use of the multiple first luminance image blocks and the multiple downsampled first chromaticity image blocks as the preprocessing result of the first image, specifically includes: when the image resolution of the downsampled first chromaticity image is higher than the first encoding maximum resolution, the second processing module divides the downsampled first chromaticity image to obtain the multiple downsampled first chromaticity image blocks, and the output module uses the multiple first luminance image blocks and the multiple downsampled first chromaticity image blocks as the preprocessing result of the first image; when the image resolution of the downsampled first chromaticity image is not higher than the first encoding maximum resolution, the second processing module does not divide the downsampled first chromaticity image, and the output module uses the multiple first luminance image blocks and the downsampled first chromaticity image as the preprocessing result of the first image. The preprocessing result of the first image is used for encoding by the first encoding chip. Among them, the transmission chain of the first image is associated with multiple transmission nodes, the first encoding chip is deployed on the first transmission node among the multiple transmission nodes, and the preprocessing method is applied to preprocess the first image received by the first transmission node through the first encoding chip on the first transmission node before image encoding.

12. The pre-processing chip according to claim 11, characterized in that: The preprocessing result of the first image is encoded by the first encoding chip to obtain a plurality of code streams, and the plurality of code streams are marked, synchronized and packaged to obtain the encoding result of the first image.

Images