Image processing method and image processing apparatus

Abstract

An image processing apparatus includes an image encoder, a memory, and an image decoder. The image encoder receives an input image frame, obtains luminance information and color information from the input image frame, respectively, encodes the luminance information to generate an encoded luminance frame, and encodes the color information to generate an encoded color frame. The memory, coupled to the image encoder, includes a first memory portion, a second memory portion, and a third memory portion. The first memory portion stores the encoded luminance frame, and either the second memory portion or the third memory portion stores the encoded color frame. The image decoder, coupled to the memory, reads the encoded luminance frame from the first memory portion for decoding, and reads the encoded color frame from either the second memory portion or the third memory portion for decoding.

Description

Technical Field

[0001] This invention relates to image processing, and in particular to an image processing method and an image processing apparatus for enhancing image processing performance. Background Technology

[0002] A display device is a device for displaying image data. Image data can be stored in various formats. YUV format is a commonly used format, where each pixel is represented by a luma component and a chroma component. When transmitting an image in the NV12 format of YUV, the luma components of all pixels are transmitted first, followed by the chroma components. In related technologies conforming to the Motion Joint Photographic Experts Group (MJPEG) and Moving Picture Experts Group (MPEG) standards, the luma and chroma components of all pixels are encoded into the same compressed file. Due to the limited memory of the image decoder, when the luma components of all pixels need to be transmitted, the image decoder needs to decode the compressed file once to generate the luma components of all pixels; when the chroma components of all pixels need to be transmitted, the image decoder needs to decode the compressed file again to generate the chroma components of all pixels. If the original image decoder could generate 60 frames per second, due to the need for two decoding operations, the number of frames generated per second will be halved to 30, significantly reducing performance.

[0003] Furthermore, since the memory cannot be released until all the color components of all pixels have been decoded, the memory space must be large enough to store compressed files of at least two images. Half of the storage space is used to temporarily store the compressed file that is being decoded, and the other half is used to temporarily store the newly written compressed file, which significantly increases the required storage space. Summary of the Invention

[0004] This invention provides an image processing method, including receiving a first input image frame, obtaining first brightness information and first color information from the first input image frame, encoding the first brightness information to generate a first encoded brightness frame, encoding the first color information to generate a first encoded color frame, writing the first encoded brightness frame to a first memory portion of a memory, writing the first encoded color frame to a second memory portion of a memory, and reading the first encoded brightness frame from the first memory portion to decode the first encoded brightness frame. Furthermore, the image processing method further includes, when decoding the first encoded brightness frame, receiving a second input image frame, obtaining second brightness information and second color information from the second input image frame, encoding the second brightness information to generate a second encoded brightness frame, encoding the second color information to generate a second encoded color frame, writing the second encoded brightness frame to a first memory portion of a memory, and writing the second encoded color frame to a third memory portion of a memory.

[0005] This invention also provides an image processing apparatus, including an image encoder, a memory, and an image decoder. The image encoder receives a first input image frame, acquires first luminance information and first color information from the first input image frame, encodes the first luminance information to generate a first encoded luminance frame, and encodes the first color information to generate a first encoded color frame. The memory is coupled to the image encoder and includes a first memory portion, a second memory portion, and a third memory portion. The first memory portion stores the first encoded luminance frame, and the second memory portion stores the first encoded color frame. The image decoder is coupled to the memory and reads the first encoded luminance frame from the first memory portion to decode the first encoded luminance frame. The image encoder is further configured to, when decoding the first encoded luminance frame, receive a second input image frame, acquire second luminance information and second color information from the second input image frame, encode the second luminance information to generate a second encoded luminance frame, encode the second color information to generate a second encoded color frame, write the second encoded luminance frame to the first memory portion of the memory, and write the second encoded color frame to the third memory portion of the memory. Attached Figure Description

[0006] Figure 1 This is a block diagram of an image processing device according to an embodiment of the present invention.

[0007] Figure 2 for Figure 1 A flowchart of an image processing method applicable to an image processing device.

[0008] Figure 3A for Figure 1 A schematic diagram of an image processing device transmitting YUV frames.

[0009] Figure 3B for Figure 1 A schematic diagram of the image processing device performing brightness processing.

[0010] Figure 3C for Figure 1 A schematic diagram of the image processing device performing color processing.

[0011] Figure 4 This is a block diagram of another image processing device according to an embodiment of the present invention.

[0012] Figure 5A and Figure 5B for Figure 4 A flowchart of an image processing method applicable to an image processing device. Detailed Implementation

[0013] Figure 1 This is a block diagram of an image processing apparatus 1 according to an embodiment of the present invention. The image processing apparatus 1 can convert the frame rate of an input image frame IMGi to generate and transmit output image frames IMG0 in various formats to a display device or processor. The display device can be a television, computer screen, tablet computer, smartphone, or other display device. The processor can be a graphics processor, central processing unit, or other types of processor. The image processing apparatus 1 can support the Universal Serial Bus Video Class (UVC) standard to transmit the output image frame IMG0. The input image frame IMGi and the output image frame IMG0 can be still images or video images, and can be YUV image frames including luminance and chrominance information, such as YUV420 image frames. The format, frame rate, and resolution of the input image frame IMGi and the output image frame IMG0 can be the same or different. For example, the input image frame IMGi can be in NV12 format, with a frame rate of 30 frames per second and a resolution of 4K ultra-high definition (UHD); the output image frame IMGo can be in NV12 format, with a frame rate of 60 frames per second and a resolution of 4K UHD.

[0014] When the output image frame IMG0 is transmitted in a planar format, such as NV12, the image processing device 1 must first transmit all the luminance information in the output image frame IMG0 before transmitting the color information. In this embodiment, the image processing device 1 can encode the luminance and color information in the input image frame IMG0 separately. When the luminance information in the output image frame IMG0 needs to be transmitted, only the encoded luminance information is decoded and transmitted. Similarly, when the color information in the output image frame IMG0 needs to be transmitted, only the encoded color information is decoded and transmitted. This reduces the number of decoding operations, lowers the required computing power, and enhances image processing performance.

[0015] Image processing apparatus 1 may include an image encoder 10, a memory 12, and an image decoder 14. The memory 12 is coupled to the image encoder 10, and the image decoder 14 is coupled to the memory 12. The image encoder 10 and the image decoder 14 may support the Motion Joint Photographic Experts Group (MJPEG) standard, the Moving Picture Experts Group (MPEG) standard, or other image compression standards.

[0016] Image encoder 10 can receive an input image frame IMGi from a video source, which may be a TV tuner card, camera, video recorder, image storage media, or other digital image source. The input image frame IMGi may include multiple luminance information and multiple color information. The luminance information may be the luminance component of each pixel in the input image frame IMGi, and the color information may be the chroma component of each pixel in the input image frame IMGi. Image encoder 10 can obtain the multiple luminance information and the multiple color information from the input image frame IMGi respectively, encode the multiple luminance information to generate an encoded luminance frame, encode the multiple color information to generate an encoded color frame, and store the encoded luminance frame and the encoded color frame separately in memory 12. In some embodiments, the multiple luminance information may be all the luminance information in the input image frame IMGi, and the multiple color information may be all the color information in the input image frame IMGi.

[0017] The memory 12 may include a first memory portion and a second memory portion. The first memory portion may store encoded luminance frames, and the second memory portion may store encoded color frames. The memory 12 may be a frame buffer, having sufficient space to simultaneously store both encoded luminance frames and encoded color frames. The space of the second memory portion may be smaller than the space of the first memory portion.

[0018] When transmitting the output image frame IMGo in NV12 format, the image decoder 14 can read the encoded luminance frame from the first memory portion of the memory 12, decode the encoded luminance frame to generate multiple decoded luminance information, and transmit the multiple decoded luminance information to the display device via the UVC driver. After transmitting the multiple decoded luminance information, the image decoder 14 can read the encoded color frame from the second memory portion of the memory 12, decode the encoded color frame to generate multiple decoded color information, and transmit the multiple decoded color information to the display device via the UVC driver. The multiple decoded luminance information and the multiple decoded color information can form the output image frame IMGo. In some embodiments, when the image decoder 14 is decoding the encoded luminance frame, the first memory portion of the memory 12 can be released, so the image encoder 10 can write the next encoded luminance frame to the first memory portion of the memory 12. When the image decoder 14 is decoding the encoded color frame, the second memory portion of the memory 12 can be released, so the image encoder 10 can write the next encoded color frame to the second memory portion of the memory 12.

[0019] The luminance information in the input image frame IMGi and the decoded luminance information in the output image frame IMGo can have the same or different frame rates. Similarly, the color information in the input image frame IMGi and the decoded color information in the output image frame IMGo can have the same or different frame rates. For example, the frame rates for the luminance and color information in the input image frame IMGi can be 30 frames per second, and the frame rates for the luminance and color information in the output image frame IMGo can be 60 frames per second.

[0020] The luminance information in the input image frame IMGi and the decoded luminance information in the output image frame IMGo can have the same or different resolutions. Similarly, the color information in the input image frame IMGi and the decoded color information in the output image frame IMGo can have the same or different resolutions. For example, the luminance information in the input image frame IMGi can have a resolution of 4K UHD, and the color information in the input image frame IMGi can have a resolution of 1080p high definition HD. Therefore, the luminance information in the output image frame IMGo can have a resolution of 4K UHD, and the color information in the output image frame IMGo can have a frame rate of 1080p HD.

[0021] In some embodiments, the image processing apparatus 1 can implement the brightness processing function of the display device, such as sharpness processing or local dimming. During sharpness processing, the processor can enhance the contrast of all brightness data in the output image frame IMGi. During local dimming, the display device can drive the backlight module of the display device separately for different areas, thereby enhancing the contrast of the display device and achieving ultra-high image quality. In brightness processing applications, the image processing apparatus 1 only needs to transmit brightness information and does not need to transmit color information to the display device. The image encoder 10 can obtain only this brightness information from the input image frame IMGi, encode this brightness information to generate an encoded brightness frame, and store the encoded brightness frame in the memory 12. Compared to applications that transmit NV12 image frames, since the memory 12 only needs to store the encoded brightness frame, the required storage space of the memory 12 can be equal to the size of the encoded brightness frame, further saving storage space, shortening decoding time, reducing required computing power, and enhancing image processing performance. When it is necessary to transmit brightness information, the image decoder 14 can read the encoded brightness frame from the memory 12, decode the encoded brightness frame to generate multiple decoded brightness information, and transmit the multiple decoded brightness information to the display device to provide brightness processing function.

[0022] In other embodiments, the image processing apparatus 1 can implement the color processing functions of the display device, such as chroma correction processing or saturation correction processing. In color processing applications, the image processing apparatus 1 only needs to transmit color information and does not need to transmit luminance information to the display device. The image encoder 10 can obtain only this color information from the input image frame IMGi, encode this color information to generate an encoded color frame, and store the encoded color frame in the memory 12. Compared with applications that transmit NV12 image frames, since the memory 12 only needs to store the encoded color frame, the required storage space of the memory 12 can be equal to the size of the encoded color frame, further saving storage space, shortening decoding time, reducing the required computing power, and enhancing image processing performance. When color information needs to be transmitted, the image decoder 14 can read the encoded color frame from the memory 12, decode the encoded color frame to generate multiple decoded color information, and transmit the multiple decoded color information to the display device to provide color processing functions.

[0023] Although Figure 1 The description uses the transmission of NV12 image frames according to the UVC standard as an example. The image processing device 1 can also use other communication standards to transmit image frames of other formats, such as YUY2 image frames or RGB444 image frames. In addition, although the preceding paragraph only describes the processing method of a single input image frame IMGi, those skilled in the art can process the luminance information and color information of multiple input image frames IMGi separately according to the technical concept of this invention, and transmit each output image frame IMGi sequentially in the order of transmitting all luminance information first and then all color information.

[0024] Figure 2 This is a flowchart of an image processing method 200 applicable to an image processing apparatus 1. The image processing method 200 includes steps S202 to S216, wherein steps S202 to S208 are used to process and transmit luminance information, and steps S210 to S216 are used to process and transmit color information. Any reasonable changes, orders, or adjustments to the steps fall within the scope of this disclosure. Steps S202 to S216 are described below:

[0025] Step S202: Image encoder 10 receives input image frame IMGi and obtains only brightness information from input image frame IMGi;

[0026] Step S204: The image encoder 10 encodes the luminance information to generate an encoded luminance frame;

[0027] Step S206: The image encoder 10 writes the encoded luminance frame to the first memory portion of the memory 12;

[0028] Step S208: The image decoder 14 reads the encoded luminance frame from the first memory portion and decodes the encoded luminance frame to generate and transmit the decoded luminance information.

[0029] Step S210: The image encoder 10 obtains only color information from the input image frame IMGi;

[0030] Step S212: The image encoder 10 encodes the color information to generate an encoded color frame;

[0031] Step S214: The image encoder 10 writes the encoded color frame to the second memory portion of the memory 12;

[0032] Step S216: The image decoder 14 reads the encoded color frame from the second memory portion and decodes the encoded color frame to generate and transmit the decoded color information.

[0033] Steps S202 to S216 can be applied to transmitting YUV frames, such as YUV frames in NV12 format. Steps S210 to S214 can also be executed before step S208. Step S216 will be executed only after step S208 is completed. Figure 3A This is a schematic diagram of the image processing apparatus 1 for transmitting YUV frames, as shown below. Figure 3A Explain steps S202 to S216.

[0034] When transmitting the luminance information of the YUV frame, the image encoder 10 first obtains only the luminance information from the input image frame IMGi (step S202), and encodes the luminance information according to a predetermined encoding block size to generate encoded luminance information Y121 to Y12N. The encoded luminance information Y121 to Y12N can form an encoded luminance frame. The sizes of the encoded luminance information Y121 to Y12N can be the same or different, N can be a positive integer greater than 1, and the predetermined encoding block size can be 16x16 (step S204). Next, the image encoder 10 writes the encoded luminance information Y121 to Y12N into the first memory portion 121 of the memory 12 (step S206). The image decoder 14 reads and decodes the encoded luminance information Y121 to Y12N in the first memory portion 121, and transmits this decoded luminance information to the display device through the UVC driver (step S208).

[0035] When transmitting color information of YUV frames, the image encoder 10 first obtains color information only from the input image frame IMGi (step S210), and encodes the color information according to a predetermined encoding block size to generate encoded color information C121 to C12N. The encoded color information C121 to C12N can form an encoded color frame. The size of the encoded color information C121 to C12N can be the same or different, and the predetermined encoding block size can be 8x8 (step S212). Next, the image encoder 10 writes the encoded color information C121 to C12N to the second memory portion 122 of the memory 12 (step S214). The image decoder 14 reads and decodes the encoded color information C121 to C12N in the second memory portion 122, and transmits this decoded color information to the display device through the UVC driver (step S216).

[0036] In the application of brightness processing, the image processing device 1 may execute only steps S202 to S208 without executing steps S210 to S216, and write the encoded brightness frame into the memory 12 in step S206. Figure 3B A schematic diagram of brightness processing performed by the image processing device 1 is shown below. Figure 3B The steps S202 to S208 of the image processing apparatus 1 performing brightness processing are explained.

[0037] The image encoder 10 first obtains only luminance information from the input image frame IMGi (step S202), and encodes the luminance information according to a predetermined encoding block size to generate encoded luminance information Y121 to Y12N. The encoded luminance information Y121 to Y12N can form an encoded luminance frame. The sizes of the encoded luminance information Y121 to Y12N can be the same or different, N can be a positive integer greater than 1, and the predetermined encoding block size can be 16x16 (step S204). Next, the image encoder 10 writes the encoded luminance information Y121 to Y12N to the memory 12 (step S206). The image decoder 14 reads and decodes the encoded luminance information Y121 to Y12N in the memory 12, and transmits this decoded luminance information to the processor or display device (step S208). The processor or display device then performs luminance processing based on this decoded luminance information, such as sharpness processing or local dimming. In applications involving brightness processing, the image processing device 1 does not need to process and store the color information in the input image frame IMGi, thereby saving storage space, shortening decoding time, reducing the required computing power, and enhancing image processing performance.

[0038] In color processing applications, the image processing device 1 may execute only steps S210 to S216 without executing steps S202 to S208, and write the encoded color frame into the memory 12 in step S214. Figure 3C A schematic diagram of color processing performed by the image processing apparatus 1 is shown below. Figure 3C The steps S210 to S216 of the image processing apparatus 1 for color processing are explained.

[0039] The image encoder 10 first acquires color information from the input image frame IMGi (step S210), and encodes the color information according to a predetermined encoding block size to generate encoded color information C121 to C12N. The encoded color information C121 to C12N can form an encoded color frame. The sizes of the encoded color information C121 to C12N can be the same or different, N can be a positive integer greater than 1, and the predetermined encoding block size can be 8x8 (step S212). Next, the image encoder 10 writes the encoded color information C121 to C12N to the memory 12 (step S214). The image decoder 14 reads and decodes the encoded color information C121 to C12N in the memory 12, and transmits this decoded color information to the processor or display device (step S216). The processor or display device then performs color processing based on this decoded color information, such as chroma correction processing or saturation correction processing. In color processing applications, the image processing device 1 does not need to process and store the brightness information in the input image frame IMGi, thereby saving storage space, shortening decoding time, reducing the required computing power, and enhancing image processing performance.

[0040] Figure 1 , Figure 2 ,and Figures 3A to 3C The embodiments are used to separately encode the luminance information and color information in the input image frame IMGi. When the luminance information in the image frame needs to be transmitted, only the encoded luminance information is decoded and transmitted. When the color information in the image frame needs to be transmitted, only the encoded color information is decoded and transmitted. This reduces the number of decoding operations, reduces the required computing power, and enhances image processing performance.

[0041] Figure 4 This is a block diagram of another image processing device 4 according to an embodiment of the present invention. Image processing device 4 is similar to image processing device 1, with the main difference being the space management and access method of memory 42. The differences between image processing device 4 and image processing device 1 will be described below.

[0042] The memory 42 may include a first memory portion 421, a second memory portion 422, and a third memory portion 423. The first memory portion 421 may store encoded luminance frames, while the second and third memory portions 422 and 423 may alternately store encoded color frames. Since the amount of color information in a YUV420 image frame is half the amount of luminance information, and the compression ratio of color information can be greater than that of luminance information, the memory size of the first memory portion 421 may exceed the memory size of the second memory portion 422, and the memory size of the third memory portion 423 may also exceed that of the third memory portion 423. The memory size of the second memory portion 422 may be equal to the memory size of the third memory portion 423. In some embodiments, the memory sizes of both the second and third memory portions 422 and 423 may be 1 / 8 the size of the first memory portion 421, further saving memory space in the memory 42.

[0043] After encoding, the image encoder 10 can repeatedly store the encoded luminance frames of multiple input image frames IMGi to the first memory section 421, and sequentially store the encoded color frames of the multiple input image frames IMGi to the second memory section 422 and the third memory section 423. Correspondingly, during decoding, the image decoder 14 can repeatedly read the encoded luminance frames of multiple input image frames IMGi from the first memory section 421, and sequentially read the encoded color frames of multiple input image frames IMGi from the second memory section 422 and the third memory section 423.

[0044] Figure 5A and Figure 5B This is a flowchart of an image processing method 500 applicable to an image processing apparatus 4. The image processing method 500 includes steps S502 to S526, wherein steps S502 to S516 are used to separately process and transmit the first decoded brightness information and the first decoded color information of a first output image frame IMGo, and steps S518 to S526 are used to separately process and transmit the second decoded brightness information and the second decoded color information of a second output image frame IMGo. Any reasonable changes, orders, or adjustments to the steps fall within the scope of this disclosure. Steps S502 to S526 are explained below:

[0045] Step S502: The image encoder 10 receives the first input image frame IMGi and obtains the first brightness information and the first color information from the first input image frame IMGi respectively;

[0046] Step S504: The image encoder 10 encodes the first luminance information to generate a first encoded luminance frame, and encodes the first color information to generate a first encoded color frame.

[0047] Step S506: The image encoder 10 writes the first encoded luminance frame to the first memory portion 421 and writes the first encoded color frame to the second memory portion 422.

[0048] Step S508: The image decoder 14 reads the first encoded luminance frame from the first memory portion 421 to decode the first encoded luminance frame;

[0049] Step S510: When the image decoder 14 decodes the first encoded luminance frame, the image encoder 10 receives the second input image frame IMGi and obtains the second luminance information and the second color information from the second input image frame IMGi respectively.

[0050] Step S512: The image encoder 10 encodes the second luminance information to generate a second encoded luminance frame, and encodes the second color information to generate a second encoded color frame.

[0051] Step S514: The image encoder 10 writes the second encoded luminance frame to the first memory portion 421 and writes the second encoded color frame to the third memory portion 423.

[0052] Step S516: After completing the decoding of the first encoded luminance frame, the image decoder 14 reads the first encoded color frame from the second memory section 422 to decode the first encoded color frame;

[0053] Step S518: The image decoder 14 reads the second encoded luminance frame from the first memory portion 421 to decode the second encoded luminance frame;

[0054] Step S520: When the image decoder 14 decodes the second encoded luminance frame, the image encoder 10 receives the third input image frame IMGi and obtains the third luminance information and the third color information from the third input image frame IMGi respectively.

[0055] Step S522: The image encoder 10 encodes the third luminance information to generate a third encoded luminance frame, and encodes the third color information to generate a third encoded color frame.

[0056] Step S524: The image encoder 10 writes the third encoded luminance frame to the first memory portion 421 and writes the third encoded color frame to the second memory portion 422.

[0057] Step S526: After completing the decoding of the second encoded luminance frame, the image decoder 14 reads the second encoded color frame from the third memory section 423 to decode the second encoded color frame.

[0058] The image processing method 500 is described below in conjunction with the image processing apparatus 4. In step S506, since the first memory portion 421, the second memory portion 422, and the third memory portion 423 do not store data, the image encoder 10 writes the first encoded luminance frame to the first memory portion 421 and the first encoded color frame to the second memory portion 422. In step S508, the image decoder 14 reads the first encoded luminance frame from the first memory portion 421 and decodes the first encoded luminance frame to generate and transmit the first decoded luminance information. Since the first encoded luminance frame has been read but the first encoded color frame has not yet been read, the space in the first memory portion 421 can be released, and the space in the second memory portion 422 is still occupied by the first encoded color frame. Therefore, in steps S510 to S514, while the image decoder 14 decodes the first encoded luminance frame, the image encoder 10 continues to receive the second input image frame IMGi, separately encodes the second luminance information and the second color information of the second input image frame IMGi to generate the second encoded luminance frame and the second encoded color frame, and writes the second encoded luminance frame to the first memory portion 421 and the second encoded color frame to the third memory portion 423. When step S508 is executed, steps S510 to S514 will be performed sequentially. In step S516, the decoding of the first encoded luminance frame is completed, so the image decoder 14 reads the first encoded color frame from the second memory portion 422, and decodes the first encoded color frame to generate and transmit the second decoded color information, thereby completing the transmission of the first output image frame IMGi. Since the first encoded color frame has been read but the second encoded luminance frame and the second encoded color frame have not yet been read, the space of the second memory portion 422 can be released, the space of the first memory portion 421 is still occupied by the second encoded luminance frame, and the space of the third memory portion 423 is still occupied by the second encoded color frame.

[0059] In step S518, the image decoder 14 reads the second encoded luminance frame from the first memory portion 421 and decodes the second encoded luminance frame to generate and transmit the second decoded luminance information. Since the second encoded luminance frame has been read but the second encoded color frame has not yet been read, the space in the first memory portion 421 can be released, and the space in the third memory portion 423 is still occupied by the second encoded color frame. Therefore, in steps S520 to S524, when the image decoder 14 decodes the second encoded luminance frame, the image encoder 10 continues to receive the third input image frame IMGi, separately encodes the third luminance information and the third color information of the third input image frame IMGi to generate the third encoded luminance frame and the third encoded color frame, and writes the third encoded luminance frame into the first memory portion 421 and the third encoded color frame into the second memory portion 422. When step S518 is executed, steps S520 to S524 will be performed sequentially. In step S526, the decoding of the second encoded luminance frame is completed. Therefore, the image decoder 14 reads the second encoded color frame from the third memory section 423 and decodes the second encoded color frame to generate and transmit the second decoded color information, thereby completing the transmission of the second output image frame IMGo. Since the second encoded color frame has been read but the third encoded luminance frame and the third encoded color frame have not yet been read, the space of the third memory section 423 can be released. The space of the first memory section 421 is still occupied by the third encoded luminance frame, and the space of the second memory section 422 is still occupied by the third encoded color frame.

[0060] When processing multiple input image frames IMGi, steps S508 to S516 and steps S518 to S526 can be executed alternately, thereby repeatedly using the first memory portion 421 to store the encoded luminance frames of the multiple input image frames IMGi, and alternately using the second memory portion 422 and the third memory portion 423 to store the encoded color frames of the multiple input image frames IMGi, thereby saving memory space in the memory 42.

[0061] Figure 4 and Figure 5A , Figure 5B The embodiments are used to separately encode the luminance information and color information in the input image frame IMGi, reuse the first memory portion 421 to store the encoded luminance frames of multiple input image frames IMGi, and alternately use the second memory portion 422 and the third memory portion 423 to store the encoded color frames of the multiple input image frames IMGi, thereby saving memory space, reducing the number of decoding times, reducing the required computing power, and enhancing image processing performance.

[0062] The above description is only a preferred embodiment of the present invention. All equivalent changes and modifications made within the scope of the claims of the present invention should be included in the scope of the present invention.

[0063] Explanation of reference numerals in the attached figures:

[0064] 1,4: Image processing device

[0065] 10: Image Encoder

[0066] 12,42: Memory

[0067] 14: Image Decoder

[0068] 200, 500: Image Processing Methods

[0069] S202 to S216, S502 to S526: Steps

[0070] 121,421: First memory section

[0071] 122,422: Second memory section

[0072] 423: Third Memory Section

[0073] C121 to C12N: Encoded color information

[0074] IMGi: Input image frame

[0075] IMGo: Output image frames

[0076] Y121 to Y12N: Encoded luminance information

Claims

1. An image processing method, comprising: Receive the first input image frame; First brightness information and first color information are obtained from the first input image frame, respectively; The first luminance information is encoded to generate a first encoded luminance frame; The first color information is encoded to generate a first encoded color frame; Write the first encoded luminance frame to the first memory portion of the memory; The first encoded color frame is written to the second memory portion of the memory. Read the first encoded luminance frame from the first memory portion to decode the first encoded luminance frame; When decoding the first encoded luminance frame, the second input image frame is received; The second brightness information and the second color information are obtained from the second input image frame, respectively. The second luminance information is encoded to generate a second encoded luminance frame; The second color information is encoded to generate a second encoded color frame; Write the second encoded luminance frame to the first memory portion of the memory; and The second encoded color frame is written to the third memory portion of the memory.

2. The method of claim 1, further comprising: After decoding the first encoded luminance frame, the first encoded color frame is read from the second memory portion to decode the first encoded color frame. Read the second encoded luminance frame from the first memory portion to decode the second encoded luminance frame; When decoding the second encoded luminance frame, the third input image frame is received; The third brightness information and the third color information are obtained from the third input image frame respectively; The third luminance information is encoded to generate a third encoded luminance frame; The third color information is encoded to generate a third-encoded color frame; The third encoded luminance frame is written to the first memory portion of the memory; and The third encoded color frame is written to the second memory portion of the memory.

3. The method of claim 1, wherein the memory size of the first memory portion exceeds the memory size of the second memory portion, and the memory size of the first memory portion exceeds the memory size of the third memory portion.

4. The method of claim 1, wherein the memory size of the second memory portion is equal to the memory size of the third memory portion.

5. An image processing apparatus, comprising: An image encoder is used to receive a first input image frame, obtain first brightness information and first color information from the first input image frame, encode the first brightness information to generate a first encoded brightness frame, and encode the first color information to generate a first encoded color frame. A memory, coupled to the image encoder, includes a first memory portion, a second memory portion, and a third memory portion, wherein the first memory portion is used to store the first encoded luminance frame, and the second memory portion is used to store the first encoded color frame. and An image decoder, coupled to the memory, is used to read the first encoded luminance frame from the first memory portion to decode the first encoded luminance frame; The image encoder is further configured to receive a second input image frame when decoding the first encoded luminance frame, obtain second luminance information and second color information from the second input image frame, encode the second luminance information to generate a second encoded luminance frame, encode the second color information to generate a second encoded color frame, write the second encoded luminance frame to the first memory portion of the memory, and write the second encoded color frame to the third memory portion of the memory.

6. The image processing apparatus of claim 5, wherein The image decoder is also used to read the first encoded color frame from the second memory portion to decode the first encoded color frame after completing the decoding of the first encoded luminance frame, and to read the second encoded luminance frame from the first memory portion to decode the second encoded luminance frame. The image encoder is also configured to receive a third input image frame when decoding the second encoded luminance frame, obtain third luminance information and third color information from the third input image frame respectively, encode the third luminance information to generate a third encoded luminance frame, encode the third color information to generate a third encoded color frame, write the third encoded luminance frame to the first memory portion of the memory, and write the third encoded color frame to the second memory portion of the memory.

7. The image processing apparatus of claim 5, wherein the memory size of the first memory portion exceeds the memory size of the second memory portion, and the memory size of the first memory portion exceeds the memory size of the third memory portion.

8. The image processing apparatus of claim 5, wherein the memory size of the second memory portion is equal to the memory size of the third memory portion.

Images