Image processing method and apparatus

Abstract

An image processing method and apparatus. The method comprises: determining a color value of each original pixel point in an original color image, wherein N original sub-pixels comprised in any origin

Description

Image processing method and device Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image processing method and device. Background Art

[0002] A field-sequential display (FSD), also known as a field-sequential liquid crystal display (LCD), is a new type of liquid crystal display. Unlike conventional LCDs (Liquid Crystal Displays), where each pixel is composed of multiple sub-areas, a FSD consists of a single sub-area. To display color images, another device can process the color image into a monochrome image and send it to the FSD. The FSD controls the liquid crystal and color filter at each pixel, causing the pixels to display different colors of the monochrome image in sequence. This, in conjunction with the human eye's "persistence of vision" effect, creates a color image.

[0003] However, based on the above display principle, field sequential display devices need to use a higher refresh rate than conventional LCDs to display each monochrome image. For example, for RGB images, to achieve the display effect of a conventional LCD with a 90Hz refresh rate, the field sequential display device needs to display the monochrome image at a refresh rate of 270Hz. Accordingly, other devices need to render and transmit 270 frames of image data per second to the field sequential display device. Therefore, in scenarios with higher image clarity (such as when displaying 4K video), the data transmission channel between other devices and the field sequential display device will face greater bandwidth pressure. In addition, since monochrome images often follow corresponding multi-channel rules, such as transmitting red, green, and blue images separately through the three RGB channels, only one of the color data transmitted by the three channels is valid data. Therefore, there is a serious waste of bandwidth in the data transmission process between other devices and the field sequential display device, which may even cause frame drops or freezes during video playback.

[0004] Summary of the Invention

[0005] In view of this, embodiments of the present invention provide an image processing method and apparatus to address the deficiencies in the related art.

[0006] According to a first aspect of an embodiment of the present invention, an image processing method is provided, which is applied to an image coding device, comprising:

[0007] Determining a color value of each original pixel in the original color image, wherein N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;

[0008] Generating mixed images corresponding to N basic colors respectively according to the color values ​​of the respective original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, determining N original pixels in one-to-one correspondence with the N mixed sub-pixels contained in the any mixed pixel in the original color image according to a pixel position mapping relationship, and using the color components corresponding to the any basic color in the color values ​​of the N original pixels as the color components of the corresponding mixed sub-pixels;

[0009] When the generation of a mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

[0010] According to a second aspect of an embodiment of the present invention, an image processing method is provided, which is applied to a field sequential display device. The method includes:

[0011] Upon receiving a mixed image sent in accordance with an image transmission rule conforming to a color model, determining a color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;

[0012] Generating a monochrome image corresponding to any one of the basic colors based on the color values ​​of each of the mixed pixel points, wherein, for N mixed sub-pixels included in any one of the mixed pixel points, determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and using the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points;

[0013] The monochrome image is displayed by controlling a display component of the field sequential display device.

[0014] According to a third aspect of an embodiment of the present invention, an image processing apparatus is provided. The apparatus is applied to an image encoding device. The apparatus includes one or more processors, wherein the processors are configured to:

[0015] Determining a color value of each original pixel in the original color image, wherein N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;

[0016] Generating mixed images corresponding to N basic colors respectively according to the color values ​​of the respective original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, determining N original pixels in one-to-one correspondence with the N mixed sub-pixels contained in the any mixed pixel in the original color image according to a pixel position mapping relationship, and using the color components corresponding to the any basic color in the color values ​​of the N original pixels as the color components of the corresponding mixed sub-pixels;

[0017] When the generation of a mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

[0018] According to a fourth aspect of an embodiment of the present invention, an image processing apparatus is provided. The apparatus is applied to a field sequential display device. The apparatus includes one or more processors, and the processors are configured to:

[0019] Upon receiving a mixed image sent in accordance with an image transmission rule conforming to a color model, determining a color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;

[0020] Generating a monochrome image corresponding to any one of the basic colors based on the color values ​​of each of the mixed pixel points, wherein, for N mixed sub-pixels included in any one of the mixed pixel points, determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and using the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points;

[0021] The monochrome image is displayed by controlling a display component of the field sequential display device.

[0022] According to a fifth aspect of an embodiment of the present invention, an electronic device is provided, including:

[0023] processor;

[0024] a memory for storing processor-executable instructions;

[0025] Wherein, the processor is configured to implement the image processing method described in the first aspect or the second aspect above.

[0026] According to a sixth aspect of an embodiment of the present invention, a non-volatile computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the image processing method described in the first aspect or the second aspect are implemented.

[0027] According to an embodiment of the present invention, an image encoding device first determines the color value of each original pixel in the original color image, and the N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively. The color value of the original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, and N is a positive integer greater than 1; then, mixed images corresponding to N basic colors are generated according to the color values ​​of the original pixel points, wherein, for any mixed pixel in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel are determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values ​​of the N original pixel points are respectively used as the color components of the corresponding mixed sub-pixels; finally, when the generation of the mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

[0028] As mentioned above, in the process of generating a mixed image corresponding to any basic color, for any mixed pixel point in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values ​​of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels. In this way, the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixel points, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point in the mixed image.

[0029] Based on this, when a mixed image is subsequently transmitted to a field-sequential display device according to image transmission rules that conform to the color model, (N-1) / N bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rules, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and improving the utilization of the data transmission channel. Accordingly, after receiving any mixed image, the field-sequential device only needs to decode it to obtain a monochrome image and display it, effectively avoiding frame drops and freezes even in video transmission scenarios.

[0030] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0032] FIG1 is a schematic diagram showing a connection relationship between devices according to an embodiment of the present invention.

[0033] FIG2 is a flowchart showing an image processing method according to an embodiment of the present invention.

[0034] FIG3 is a schematic diagram showing an image processing process according to an embodiment of the present invention.

[0035] FIG4 is a schematic diagram showing a positional relationship between an original sub-pixel and a mixed pixel point according to an embodiment of the present invention.

[0036] FIG5 is a schematic diagram showing an original color image and an encoded mixed image according to an embodiment of the present invention.

[0037] FIG6 is a flowchart showing another image processing method according to an embodiment of the present invention.

[0038] FIG. 7 is a schematic block diagram of an image processing apparatus according to an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0040] The image processing method described in the embodiments of this specification involves two devices: an image encoding device and a field sequential display device. FIG1 is a schematic diagram of a connection relationship between devices provided by an exemplary embodiment. As shown in FIG1 , an image encoding device 101 is connected to a field sequential display device 103 via a data transmission channel 102.

[0041] The image encoding device 101 and the field sequential display device 103 may be separate devices. For example, the image encoding device 101 may be a terminal device used by a user. For example, the terminal device may be a mobile phone, a tablet device, a laptop computer, a PDA (Personal Digital Assistant), a wearable device (such as smart glasses, a smart watch, etc.), a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc.; the field sequential display device 103 may be an independent display device, such as a monitor. In this case, the data transmission channel 102 between the two may be implemented via a cable. Alternatively, the image encoding device 101 and the field sequential display device 103 may be different functional components of the same device. For example, the image encoding device 101 may be a processing component of a display device, and the field sequential display device 103 may be a display component (such as a display screen, etc.) of a display device. In this case, the data transmission channel 102 between the two may be implemented via a bus of the display device or an image data transmission component corresponding to the field sequential display device 103. For example, the image encoding device 101 may be a CPU or a GPU of the above-mentioned device, and the field sequential display device 103 may be a display assembled in the device, which has its own independent controller.

[0042] Furthermore, the data transmission channel 102 can have various forms, such as an interface using DP (DisplayPort), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), VGA (Video Graphics Array), and other interface standards, although this is not limited in the present embodiment. Furthermore, a buffer can be included between the image encoding device 101 and the field sequential display device 103 to facilitate maintaining a relatively stable refresh rate during image playback on the field sequential display device 103.

[0043] In an embodiment of the present specification, the image encoding device 101 can encode the original color image by the image processing method to obtain N mixed images, and then send each mixed image to the field sequential display device 103 through the data transmission channel 102. Correspondingly, the field sequential display device 103 can decode any obtained mixed image by the other processing method to obtain a corresponding monochrome image, and then display the monochrome image locally. It can be understood that for any original color image, after the image encoding device 101 sends the encoded N mixed images to the field sequential display device 103 in sequence, the field sequential display device 103 can decode and display the corresponding monochrome images in sequence, thereby presenting the color display effect of the original color image to the observer with the help of the visual persistence effect of the human eye. The encoding and decoding schemes corresponding to the image processing method of the present invention are described in detail below in conjunction with the accompanying drawings and corresponding embodiments.

[0044] FIG2 is a flow chart of an image processing method according to an exemplary embodiment of the present invention. As shown in FIG2 , the method is applied to an image coding device. Specifically, the method can be implemented by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The image processing method may include the following steps 202-206:

[0045] Step 202: Determine the color value of each original pixel in the original color image. The N original sub-pixels contained in any original pixel correspond to different basic colors of the color model. The color value of any original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, and N is a positive integer greater than 1.

[0046] The original color image described in the embodiments of the present invention can be an independent image. In this case, using this solution, the field sequential display device can repeatedly display multiple monochrome images corresponding to the image to present a color display effect of the image. Alternatively, the original color image can be a video frame image belonging to any video. In this case, using this solution, the field sequential display device can sequentially display multiple monochrome images corresponding to each video frame image of the video to present a color display effect corresponding to the video screen of the video.

[0047] In addition, the color values ​​of the original pixels in the original color image can be represented using values ​​in a color space. The color model corresponding to the color space can be in any form, and the embodiments of the present invention are not limited thereto. For example, the color model can be an RGB model, an RGBW model, a CMYK model, etc., wherein the RGB model includes three primary colors: red, green, and blue; the RGBW model includes four primary colors: red, green, blue, and white; and the CMYK model includes cyan, magenta, yellow, and black.

[0048] Regardless of the color model used, any original pixel in the original color image contains N (N is a positive integer greater than 1) original sub-pixels, and each original sub-pixel corresponds to a different basic color of the color model, wherein the color value of any original pixel can include the color components of the N original sub-pixels for the corresponding basic colors. For example, when the color model of the original color image is an RGB model, N=3, that is, at this time, any original pixel in the image contains original sub-pixels corresponding to the three basic colors of R, G and B, and the color value of the original pixel includes the color components corresponding to these three original sub-pixels, namely R value, G value and B value. In fact, when a conventional LCD is used to display the original color image, each original pixel in the image can correspond to a different pixel in the display screen, and each original sub-pixel in any original pixel can correspond to a different partition of the corresponding pixel that can be independently controlled for display.

[0049] The following description uses the RGB model as an example, in conjunction with Figure 3. As shown in Figure 3, the original color image 301 includes multiple original pixels such as 1, 2, 3, etc. Among them, any original pixel contains three original sub-pixels, such as original pixel 1 contains three original sub-pixels R1, G1, and B1, original pixel 2 contains three original sub-pixels R2, G2, and B2, etc., which will not be repeated here. The original sub-pixels corresponding to different basic colors in Figure 3 are filled with gray backgrounds of different depths for easy distinction.

[0050] Any original sub-pixel in any of the above original pixel points has a color component corresponding to the corresponding basic color. Taking original pixel point 1 as an example, the three original sub-pixels R1, G1 and B1 have corresponding color components for red, green and blue, respectively. The color component of any original sub-pixel does not exceed the value range in the color space corresponding to the RGB model. For example, when the color components corresponding to each basic color in the RGB model are represented by a numerical value with a bit length of 8 bits, the value range of the color component of any original sub-pixel can be [1,256]. For example, the color component of R1 for red can be 0, the color component of G1 for green can be 26, the color component of B1 for blue can be 245, and so on.

[0051] In addition, the color components of the corresponding primary colors corresponding to the original sub-pixels in any original pixel together constitute the color value of the original pixel. For example, the color value of original pixel 1 includes the color components of the original sub-pixels R1, G1, and B1 for red, green, and blue, respectively. In other words, these three color components together constitute the color value of original pixel 1. Therefore, the color value of any original pixel is actually an array containing N values. Therefore, the process of determining the color value of each original pixel in the original color image by the image encoding device is actually the process of reading the color components of the original sub-pixels contained in each original pixel in the image.

[0052] It should also be noted that the arrangement of the original sub-pixels in the original pixel shown in FIG3 is merely exemplary. During the implementation phase of the solution, the original sub-pixels in the same original pixel can be arranged in any manner, and the embodiments of the present invention are not limited thereto. It should also be understood that for any image other than mixed images 3031-3033 in FIG3 , the number marked in any pixel (or sub-pixel) is the number of the pixel (or sub-pixel) in the corresponding image and is used only to distinguish different pixels (or sub-pixels). Any image actually records the color value of any pixel (including the color components of each sub-pixel therein), and the specific value of the color value (or color component) and its number are not necessarily numerically related. For example, the number of any original pixel or original sub-pixel in the original color image 301 is used to identify the pixel or sub-pixel. The data marked in any mixed pixel in the mixed images 3031-3033 is used to identify which original sub-pixel's color component in the original color image 301 corresponds to the color component of the original sub-pixel corresponding to the corresponding base color. For example, the mixed sub-pixel numbered 7 in the red mixed image 3031, this number is used to represent that the color component of the mixed sub-pixel is the color component (corresponding to red) of the red original sub-pixel (numbered 7) in the first original pixel point in the second row of the original color image 301, and will not be repeated.

[0053] Step 204: Generate mixed images corresponding to N basic colors respectively according to the color values ​​of the original pixel points, wherein, for any mixed pixel point in the mixed image corresponding to any basic color, determine N original pixel points in the original color image that correspond one-to-one to the N mixed sub-pixels contained in the any mixed pixel point according to the pixel position mapping relationship, and use the color components for the any basic color in the color values ​​of the N original pixel points as the color components of the corresponding mixed sub-pixels.

[0054] When the color value of each original pixel in the original color image is determined, the image encoding device can generate mixed images corresponding to N basic colors based on the color value. The process of generating a mixed image is essentially a process of sequentially determining the color components of the N mixed sub-pixels contained in each mixed pixel in the mixed image. Specifically, for any mixed pixel containing N mixed sub-pixels in a mixed image corresponding to any basic color, the color components of the N original sub-pixels (each belonging to a different original pixel) in the original color image that correspond one-to-one to the N mixed sub-pixels are used as the color components of the N mixed sub-pixels.

[0055] As shown in FIG3 , all original sub-pixels in the original color image 301 can be divided into three categories according to their primary colors: red original sub-pixels 3021, green original sub-pixels 3022, and blue original sub-pixels 3023. The relative positional relationship between the original sub-pixels in any category remains consistent with the relative positional relationship between the original pixels to which they belong in the original color image 301. However, it should be noted that the red original sub-pixel 3021, green original sub-pixel 3022, and blue original sub-pixel 3023 can be monochrome images generated based on the original sub-pixels corresponding to the respective primary colors, or they can be the result of sub-pixel division at a logical level rather than actual monochrome images.

[0056] The image encoding device can determine the N original pixel points corresponding one-to-one to the N mixed sub-pixels in any mixed pixel point based on the pixel position mapping relationship, and then determine the N original sub-pixels corresponding to any basic color in the N original pixel points as corresponding one-to-one to the corresponding mixed sub-pixels. The pixel position mapping relationship can be used to record the one-to-one correspondence between the position of the original sub-pixel in the original color image and the position of the corresponding mixed sub-pixel in the mixed image. Since any original pixel point contains N original sub-pixels and each original sub-pixel corresponds to a corresponding basic color, the position of any original pixel point in the original color image can be used as the position of the N original sub-pixels in the original color image, that is, for other original pixel points or other pixel points outside the original color image, the original sub-pixels corresponding to each basic color in any original pixel point are in the same position in the original color image. As shown in Figure 3, the original pixel numbered 1 in the original color image 301 contains three original sub-pixels (i.e., red original sub-pixel 1, green original sub-pixel 1, and blue original sub-pixel 1). The positions of these three original sub-pixels in the original color image 301 can be marked with the number "1". The other original sub-pixels are similar to this and will not be repeated here.

[0057] Based on the above pixel position mapping relationship, the image encoding device can generate mixed images corresponding to the three primary colors, namely, red mixed image 3031, green mixed image 3032, and blue mixed image 3033, based on the above red original sub-pixel 3021, green original sub-pixel 3022, and blue original sub-pixel 3023. Taking red mixed image 3031 as an example, the image records the color components of each mixed sub-pixel contained in each mixed pixel point. As can be seen from the color component determination method in step 204, the specific value of the color component of any mixed sub-pixel is the same as the specific value of the color component of the original sub-pixel corresponding to the mixed sub-pixel in the original color image 301. For example, for the first mixed sub-pixel (i.e., red mixed sub-pixel 1) in the first mixed pixel point, the specific value of its color component is the same as the specific value of the color component of the first original sub-pixel (i.e., red original sub-pixel 1) contained in the first original pixel point in the original color image 301; for another example, for the second mixed sub-pixel (i.e., green mixed sub-pixel 2) in the second mixed pixel point, the specific value of its color component is the same as the specific value of the color component of the second original sub-pixel (i.e., green original sub-pixel 2) contained in the second original pixel point in the original color image 301, and no further details will be given.

[0058] In order to ensure that the mixed image corresponding to any basic color generated has the above-mentioned effect, the image encoding device can determine the N original pixel points in the original color image that correspond one-to-one to the N mixed sub-pixels contained in any mixed pixel point according to the position correspondence recorded in the aforementioned pixel position mapping relationship. Specifically, the image encoding device can first determine the encoding scaling factor based on the first size of the original color image and the second size of the mixed image, and determine the second position of the any mixed pixel point in the mixed image. Then, the image encoding device can determine the first position corresponding to the second position in the original color image according to the encoding scaling factor, and then determine the one-to-one correspondence between the N original pixel points at the first position and the N mixed sub-pixels contained in the any mixed pixel point.

[0059] As shown in Figure 3, if the above-mentioned pixel position mapping relationship records: the numbers of each mixed pixel point are positive integers and increase in sequence from left to right and from top to bottom; the three mixed sub-pixels in the mixed pixel point with an odd number correspond to the original sub-pixels in the mixed pixel point with an odd number in the original color image, and the mixed pixel point adjacent to it and located below and to the right of it respectively; the three mixed sub-pixels in the mixed pixel point with an even number correspond to the original sub-pixels in the mixed pixel point with an even number in the original color image, and adjacent to the mixed pixel point with an even number and located below, to the right and in the lower right corner respectively. Based on this, for the three mixed sub-pixels contained in the first (odd) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 1, 7 and 2 in the original color image 301 respectively; for the three mixed sub-pixels contained in the second (even) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 8, 3 and 9 in the original color image 301 respectively. Similarly, for the three mixed sub-pixels contained in the third (odd) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 4, 10, and 5 in the original color image 301. For the three mixed sub-pixels contained in the fourth (even) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 11, 6, and 12 in the original color image 301. The method for determining the other mixed pixels in the red mixed image 3031 and each mixed pixel point in the green mixed pixel point 3032 and the blue mixed pixel point 3033 is similar and will not be repeated here.

[0060] Based on the above pixel position mapping relationship and the first size and the second size, the image encoding device can determine the corresponding encoding scaling factor. Based on the pixel position mapping relationship corresponding to Figure 3, it can be determined that in the process of generating the red mixed image 3031 based on the original color image 301, the three original pixels numbered 1, 7 and 2 are reduced to one mixed pixel (i.e., the pixel composed of the mixed sub-pixels numbered 1, 7 and 2 shown in the red mixed image 3031), and the three original pixels numbered 8, 3 and 9 are reduced to one mixed pixel (i.e., the pixel composed of the mixed sub-pixels numbered 8, 3 and 9 shown in the red mixed image 3031). It can be seen that in the mixed image corresponding to any basic color, the odd-numbered mixed pixel points are synthesized by arranging the three original sub-pixels at the corresponding positions in the original color image in a counterclockwise direction, and the even-numbered mixed pixel points are synthesized by arranging the three original sub-pixels at the corresponding positions in the original color image in a clockwise direction.

[0061] Clearly, for any three original pixels and their corresponding mixed pixel, horizontally, the three original pixels in the original color image correspond to two mixed pixels in the mixed image; vertically, the two original pixels in the original color image correspond to one mixed pixel in the mixed image. This shows that the above encoding method can combine three columns in the original color image into two columns in the mixed image—reducing the number of columns vertically to 2 / 3 of the original number. Simultaneously, two rows in the original color image can be combined into one row in the mixed image—reducing the number of rows vertically to 1 / 2 of the original number. Overall, the data size of any mixed image after encoding is reduced to 1 / 3 of the data size of the original color image before encoding, 1 / 2 * 2 / 3. As shown in Figure 3, if the original color image is a video frame image from a 4K video with a first size of 3840*3840, then the second size of any mixed image generated using the above method is 2560*1920. It will be appreciated that the above dimensions can be used to represent the number of pixels in the original color image and the mixed image. Since any original pixel in the original color image contains three original sub-pixels, and any mixed pixel in the mixed image contains three mixed sub-pixels, the data volume of the color components corresponding to each original sub-pixel in the original color image is 3840*3840*3, and the data volume of the color components corresponding to each mixed sub-pixel in any mixed image is 2560*1920*3. Considering that the image encoding device generates three mixed images (i.e., red mixed image 3031, green mixed image 3032, and blue mixed image 3033), the total data volume of the mixed image generated from the original color image is the same as that of the original color image (3*2560*1920*3=3840*3840*3). That is, the encoded mixed image records all the color components in the original color image. Therefore, this scheme can achieve lossless encoding of the original color image.

[0062] For the N original pixel points that correspond one-to-one to the N mixed sub-pixels in any mixed pixel point, the embodiment of the present invention does not limit their relative positional relationship. For example, the N original pixel points can be continuously adjacent. In this case, the logic for determining the positions of the N original pixel points is relatively simple, which facilitates improving the encoding speed. It can be seen from the above embodiment that the original sub-pixels numbered 1, 7 and 2 are continuously adjacent, and the center point line of the three forms a right triangle. In fact, the original sub-pixels corresponding to the three mixed sub-pixels in the same mixed pixel point in the original color image 301 can also have other relative positional relationships. For any of the mixed images among the red mixed image 3031, the green mixed image 3032, and the blue mixed image 3033, still taking the three mixed sub-pixels contained in the first mixed pixel point in the first row thereof (i.e., the mixed sub-pixel numbered 1) as an example, when the original sub-pixels corresponding to these three mixed sub-pixels are adjacent, the numbers of these three original sub-pixels may be 1, 2, and 3 (in this case, the line connecting the center points of these three original sub-pixels is a horizontal straight line), or 1, 7, and 13 (in this case, the line connecting the center points of these three original sub-pixels is a vertical straight line), or 7, 8, and 9, etc. When the original sub-pixels corresponding to these three mixed sub-pixels are not adjacent, the numbers of these three original sub-pixels may be 1, 8, and 3, or 7, 2, and 9, or 1, 7, and 3, or 1, 3, and 5, etc., which will not be repeated here.

[0063] As can be seen from the aforementioned embodiments, in the process of generating a mixed image based on the color values ​​of each original pixel in the original color image, it is crucial to determine the original sub-pixels corresponding to each mixed sub-pixel. Specifically, the image encoding device can determine the original sub-pixels according to a position formula. The relevant formula is described below with reference to the embodiment shown in FIG3 , using an original color image with a first size of 3840*3840 and a mixed image with a second size of 2560*1920 as an example.

[0064] As previously mentioned, the process of generating a mixed image corresponding to any basic color includes the process of sequentially determining the color components of each mixed sub-pixel in the mixed image for the said any basic color. For any mixed pixel point P with coordinates in.text (in.tex.x, in.tex.y) in the mixed image, the image encoding device needs to determine the three original sub-pixels corresponding to the mixed pixel point in the original color image. To this end, it is first necessary to determine the pixel position cur.pos (cur.pos.x, cur.pos.y) corresponding to the mixed pixel point P in the original color image.

[0065] When the image coding device supports processing integer data (e.g., the image coding scheme is implemented by the CPU of the image coding device), in.tex.x∈[0,2560] and in.tex.y∈[0,1920]; in this case, cur.pos.x∈[0,2560] and cur.pos.y∈[0,1920]. When the image coding device supports processing decimal data in the interval [0,1] (e.g., the image coding device is a GPU), in.tex.x∈[0,1] and in.tex.y∈[0,1]; in this case, cur.pos.x=int(in.tex.x*2560)∈[0,2560) and cur.pos.y=int(in.tex.y*1920)∈[0,1920).

[0066] At this time, the image encoding device can calculate the position coordinates raw[0], raw[1], and raw[2] of the three original pixel points corresponding to the mixed pixel point P in the original color image based on the parity of cur.pos.x. As shown in Figure 4, if cur.pos.x is an odd number, the mixed pixel point P corresponds to the three original pixel points in the left area. At this time, the coordinate calculation formula of these three original pixel points is shown in the following formula (1); if cur.pos.x is an even number, the mixed pixel point P corresponds to the three original pixel points in the right area. At this time, the coordinate calculation formula of these three original pixel points is shown in the following formula (2).

[0067]

[0068]

[0069] As previously mentioned, the image transmission method corresponding to the encoding scheme can be applied to a GPU (i.e., the image encoding device is a GPU). In this scenario, considering that current GPUs can generally process values ​​within the [0, 1] range, the GPU can also normalize the values ​​of the aforementioned first and second sizes, and represent the first and second positions by the normalized coordinate values. In this way, it is possible to ensure that the specific values ​​of the first and second positions are within the [0, 1] range, thereby facilitating the GPU to accurately and efficiently perform encoding processing on the original color image. The aforementioned position coordinates are normalized.

[0070] Corresponding to the above normalization process, the aforementioned position coordinates can also be normalized. The coordinates of the three original pixel points after normalization, raw_rgb[0], raw_rgb[1], and raw_rgb[2], are respectively represented by the following formula (3).

[0071]

[0072] To ensure accurate sampling of the color components of each original sub-pixel, an offset may be added to the coordinate value of the second position so that the offsetted second position is within the original pixel. For example, 0.5 may be added to raw[0], raw[1], and raw[2] as an offset. Specifically, equation (4) may be used to replace equation (3).

[0073]

[0074] At this point, raw_rgb[0], raw_rgb[1], and raw_rgb[2] calculated according to formula (3) or (4) are the position coordinates of the original pixel points corresponding to the mixed pixel point P in the original color image. At this time, the GPU can sample the color components of the corresponding nine original sub-pixels according to these three position coordinates. Specifically, the GPU can read the red, green, and blue color components corresponding to the position coordinates of raw_rgb[0], raw_rgb[1], and raw_rgb[2] respectively. Of course, the color components collected and recorded can also be normalized in advance, that is, the value range of any color component can also be [0,1].

[0075] After sampling and obtaining the color components texColor0, texColor1, and texColor2 of the three original pixels, mixed pixels of corresponding colors are synthesized according to R, G, or B, see formula (5).

[0076]

[0077] At this point, the sampled outColorR is the color component of each mixed sub-pixel in the mixed pixel point P in the red mixed image, outColorG is the color component of each mixed sub-pixel in the mixed pixel point P in the green mixed image, and outColorB is the color component of each mixed sub-pixel in the mixed pixel point P in the blue mixed image. In addition, in addition to including the corresponding three color components, any outColor in formula (5) may also include relevant data such as the transparency value of the corresponding mixed sub-pixel, but this embodiment of the present invention is not limited to this.

[0078] Taking the first and second mixed pixels in the first row of each mixed pixel shown in FIG3 as an example, as shown in FIG4, the number 1 of the first mixed pixel (the numbers of each mixed pixel are not shown in FIG3) is an odd number. According to formula (1), the position coordinates of the original pixel points numbered 1, 7, and 2 in the left area can be calculated. By sampling the color components of each original sub-pixel, the GPU can respectively determine the color components of each mixed sub-pixel in the first mixed pixel point in the first row of the red mixed image 3031, the green mixed image 3032, and the blue mixed image 3033. Similarly, the number 2 of the second mixed pixel is an even number. According to formula (2), the original pixel points numbered 8, 3, and 9 in the right area can be calculated. By sampling the color components of each original sub-pixel, the GPU can respectively determine the color components of each mixed sub-pixel in the second mixed pixel point in the first row of the red mixed image 3031, the green mixed image 3032, and the blue mixed image 3033. In this way, the GPU can sequentially determine the color components of each mixed sub-pixel in the above three mixed images, thereby generating the above three mixed images.

[0079] This concludes the description of the process for generating N mixed images corresponding to an original color image. It should be noted that, for any original color image, the image encoding device can generate the N mixed images corresponding to the image in parallel (e.g., simultaneously generating each mixed image according to the aforementioned equation (5)), or can generate each mixed image sequentially according to a preset order. For example, in the scenario shown in FIG3 , a red mixed image 3031, a green mixed image 3032, and a blue mixed image 3033 are generated sequentially according to the order of R, G, and B. This embodiment of the present invention is not limited to this.

[0080] Figure 5 is a schematic diagram illustrating an original color image and an encoded mixed image according to an embodiment of the present invention. As shown in Figure 5 , FIG5 a is the original color image before encoding, and FIG5 b, c, and d are the encoded red mixed image, green mixed image, and blue mixed image, respectively. It will be understood that for any mixed pixel in any of the aforementioned mixed images, the color components of the multiple mixed sub-pixels in that mixed pixel are actually the color components of the corresponding original sub-pixels in the original color image.

[0081] Step 206, when the generation of the mixed image corresponding to any basic color is completed, the mixed image is sent to the field sequential display device according to the image transmission rules that conform to the color model, so that the field sequential display device generates and displays the monochrome image corresponding to any basic color based on the mixed image.

[0082] After generating N mixed images corresponding to the original color image, the image encoding device may transmit the mixed images to a field-sequential display device according to image transmission rules that conform to the color model. For example, if the original color image conforms to the RGB color model, the image encoding device may transmit each mixed image using the three channels corresponding to the model. Furthermore, the transmission order of the mixed images may be the same as or different from the order in which they were generated, and this is not limited in this embodiment of the present invention.

[0083] In one embodiment, when the original color image is a video frame image belonging to any video, the image encoding device may encode each video frame image sequentially according to the order of each video frame in the video timeline, thereby obtaining N mixed images corresponding to each video frame image, and then sequentially transmit each mixed image in the order of R, G, and B. For example, the three mixed images corresponding to the first video frame image may be transmitted in the order of R, G, and B, and then the three mixed images corresponding to the second video frame image may be transmitted in the order of R, G, and B, etc., and no further details will be given.

[0084] Accordingly, after receiving any mixed image corresponding to any primary color, the field sequential display device can decode the image to generate a monochrome image corresponding to the primary color and locally display the monochrome image. For different images processed by the field sequential display device, the operations of receiving the mixed image, decoding the mixed image, and displaying the monochrome image can be performed in parallel. For any mixed image, it can be processed sequentially in the order of reception, decoding, and display, which will not be further described.

[0085] According to an embodiment of the present invention, an image encoding device first determines the color value of each original pixel in the original color image, and the N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively. The color value of the original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, and N is a positive integer greater than 1; then, mixed images corresponding to N basic colors are generated according to the color values ​​of the original pixel points, wherein, for any mixed pixel in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel are determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values ​​of the N original pixel points are respectively used as the color components of the corresponding mixed sub-pixels; finally, when the generation of the mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

[0086] As mentioned above, in the process of generating a mixed image corresponding to any basic color, for any mixed pixel point in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values ​​of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels. In this way, the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixel points, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point in the mixed image.

[0087] Based on this, when a mixed image is subsequently transmitted to a field-sequential display device according to image transmission rules that conform to the color model, (N-1) / N bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rules, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and improving the utilization of the data transmission channel. Accordingly, after receiving any mixed image, the field-sequential device only needs to decode it to obtain a monochrome image and display it, effectively avoiding frame drops and freezes even in video transmission scenarios.

[0088] For the original color image shown in Figure 3, if the monochrome image transmission method used in related art is adopted, the image encoding device needs to use three channels to transmit the three monochrome images corresponding to the original color image 301. In this case, the actual amount of data transmitted is 3840*3840*3*3, but 3840*3840*3*2 of the data is invalid data (corresponding to two transmission channels), and the channel utilization rate is 33.3%. However, after using the above encoding scheme to generate the three mixed images corresponding to the original color image 301, the image encoding device can use three channels to transmit these three mixed images separately. In this case, the actual amount of data transmitted is 2560*1920*3*3, where all the data are the color components of the corresponding original sub-pixels in the original color image, that is, all are valid data, and the channel utilization rate is 100%. It can be seen that this scheme can achieve lossless encoding of the original color image; compared with the schemes used in related art, it can significantly improve the channel utilization during image transmission, and effectively avoid frame drops or freezes that may occur during video transmission.

[0089] Corresponding to the aforementioned image processing method for decoding the original color image to generate a mixed image, an embodiment of the present invention also proposes another image processing scheme for decoding and displaying the received mixed image, which is described in detail below in conjunction with Figure 6 and related embodiments.

[0090] FIG6 is a flow chart of another image processing method according to an exemplary embodiment of the present invention. As shown in FIG3 , the method is applied to a field sequential display device. The image processing method may include the following steps 602-606:

[0091] Step 602, upon receiving a mixed image sent in accordance with image transmission rules that conform to a color model, determining the color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes the color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1.

[0092] Similar to the previous embodiment, the process of determining the color value of any mixed pixel in the mixed image is the process of determining the color components of each mixed sub-pixel in the mixed pixel for the corresponding primary color. Continuing from the previous embodiment, the image encoding device can send the red mixed image 3031, green mixed image 3032, and blue mixed image 3033 to the field sequential display device in the order of R, G, and B. Accordingly, the field sequential display device can sequentially decode each received mixed image to obtain a corresponding monochrome image.

[0093] Step 604: Generate a monochrome image corresponding to any one of the basic colors based on the color values ​​of the respective mixed pixel points, wherein, for the N mixed sub-pixels contained in any one of the mixed pixel points, determine N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and use the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points.

[0094] Corresponding to the aforementioned encoding process, the process of generating a monochrome image corresponding to any base color from a mixed pixel requires determining the monochrome pixel points corresponding to each mixed sub-pixel in the mixed image in the corresponding monochrome image. For example, for any mixed pixel containing N mixed sub-pixels, N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels can be determined in the monochrome image based on the aforementioned pixel position mapping relationship.

[0095] In one embodiment, the field sequential display device can determine a decoding scaling coefficient based on the third size of the monochrome image and the second size of the mixed image, and determine the second position of any mixed pixel point in the mixed image; then, based on the decoding scaling coefficient, determine a third position corresponding to the second position in the monochrome image, and determine a one-to-one correspondence between the N monochrome pixels at the third position and the N mixed sub-pixels contained in any mixed pixel point.

[0096] Taking the red mixed image 3031 shown in FIG3 as an example, for the first and second mixed pixels in the first row of the mixed pixels, as shown in FIG4 , the number 1 of the first mixed pixel (the numbers of the mixed pixels are not shown in FIG3 ) is an odd number. According to formula (1), the position coordinates of the original pixels numbered 1, 7, and 2 in the left area can be calculated. Therefore, the field sequential display device can use the color components of the mixed sub-pixels recorded in the first mixed pixel as the color values ​​of the monochrome pixels numbered 1, 7, and 2 in the red image 3041. Similarly, the number 2 of the second mixed pixel is an even number. According to formula (2), the position coordinates of the original pixels numbered 8, 3, and 9 in the right area can be calculated. Therefore, the field sequential display device can use the color components of the mixed sub-pixels recorded in the second mixed pixel as the color values ​​of the monochrome pixels numbered 8, 3, and 9 in the red image 3041.

[0097] In this way, the GPU can sequentially determine the color value of each monochrome pixel in the red image 3041, thereby generating the red image 3041. Since each mixed sub-pixel in the red mixed pixel records the color component corresponding to red of the original sub-pixel in the original color image, the color value of each monochrome pixel in the red image 3041 generated in this way corresponds to red, and the red image is therefore the monochrome image of the red mixed image 3031.

[0098] Similarly, a green image 3042 corresponding to the green mixed image 3032 and a blue image 3043 corresponding to the blue mixed image 3033 may be generated respectively in the above manner.

[0099] Step 606: Display the monochrome image by controlling a display component of the field sequential display device.

[0100] The field sequential display device may include a control component and a display component, and any of the above components may be implemented by the software and hardware resources in the field sequential display device. After generating any monochrome image, the field sequential display device may display the monochrome image by controlling the display component. Specifically, the liquid crystal and color film of each pixel in the display component may be controlled, so as to control each pixel to display the corresponding color respectively, so as to display any monochrome image as a whole. It is understandable that the field sequential display device may display monochrome images corresponding to different basic colors in sequence according to a preset order and refresh rate, so as to cooperate with the "visual persistence effect" of the human eye to present the color display effect of the original color image. For details, please refer to the description of the working principle of the field sequential display device in the relevant technology, which will not be repeated here.

[0101] As mentioned above, in the process of generating a mixed image corresponding to any basic color, for any mixed pixel point in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values ​​of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels. In this way, the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixel points, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point in the mixed image.

[0102] Based on this, when a mixed image is subsequently transmitted to a field-sequential display device according to image transmission rules that conform to the color model, (N-1) / N bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rules, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and improving the utilization of the data transmission channel. Accordingly, after receiving any mixed image, the field-sequential device only needs to decode it to obtain a monochrome image and display it, effectively avoiding frame drops and freezes even in video transmission scenarios.

[0103] Corresponding to the above-mentioned embodiment of the image processing method, the present invention also provides an embodiment of an image processing device. The device is applied to an image encoding device, and the device includes one or more processors, and the processors are configured to:

[0104] Determining a color value of each original pixel in the original color image, wherein N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;

[0105] Generating mixed images corresponding to N basic colors respectively according to the color values ​​of the respective original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, determining N original pixels in one-to-one correspondence with the N mixed sub-pixels contained in the any mixed pixel in the original color image according to a pixel position mapping relationship, and using the color components corresponding to the any basic color in the color values ​​of the N original pixels as the color components of the corresponding mixed sub-pixels;

[0106] When the generation of a mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

[0107] In one embodiment, the processor is further configured to:

[0108] determining a coding scaling factor according to a first size of the original color image and a second size of the mixed image, and determining a second position of any mixed pixel point in the mixed image;

[0109] According to the encoding scaling coefficient, a first position corresponding to the second position is determined in the original color image, and a one-to-one correspondence between the N original pixel points at the first position and the N mixed sub-pixels contained in any mixed pixel point is determined.

[0110] In one embodiment, the image encoding device is a graphics processor (GPU), and the processor is further configured to:

[0111] Normalization is performed on the values ​​of the first size and the second size, and the first position and the second position are represented by the normalized coordinate values.

[0112] In one embodiment, the processor is further configured to:

[0113] An offset is added to the coordinate value of the second position so that the offset second position is inside the original pixel point.

[0114] In one embodiment, the N original pixel points in the original color image that correspond one-to-one to the N mixed sub-pixels are continuously adjacent.

[0115] In one embodiment, the color model is an RGB model, and N=3.

[0116] In one embodiment, the original color image is a video frame image belonging to any video.

[0117] Corresponding to the aforementioned embodiment of the image processing method, the present invention further provides another embodiment of an image processing apparatus. The apparatus is applied to a field sequential display device, and includes one or more processors, wherein the processors are configured to:

[0118] Upon receiving a mixed image sent in accordance with an image transmission rule conforming to a color model, determining a color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;

[0119] Generating a monochrome image corresponding to any one of the basic colors based on the color values ​​of each of the mixed pixel points, wherein, for N mixed sub-pixels included in any one of the mixed pixel points, determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and using the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points;

[0120] The monochrome image is displayed by controlling a display component of the field sequential display device.

[0121] In one embodiment, the processor is further configured to:

[0122] determining a decoding scaling factor according to a third size of the monochrome image and a second size of the mixed image, and determining a second position of any mixed pixel point in the mixed image;

[0123] According to the decoded scaling coefficient, a third position corresponding to the second position is determined in the monochrome image, and a one-to-one correspondence between the N monochrome pixels at the third position and the N mixed sub-pixels contained in any mixed pixel is determined.

[0124] An embodiment of the present invention further provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the image processing method described in any of the above embodiments.

[0125] An embodiment of the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which implements the steps of the image processing method described in any of the above embodiments when executed by a processor.

[0126] Regarding the apparatus in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments of the relevant methods and will not be elaborated on here.

[0127] FIG7 is a schematic block diagram of an apparatus 700 for data storage or driving mode determination according to an embodiment of the present invention. For example, apparatus 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0128] 7 , apparatus 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0129] The processing component 702 generally controls the overall operation of the device 700, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or part of the steps of the above-described image processing method. In addition, the processing component 702 may include one or more modules to facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

[0130] The memory 704 is configured to store various types of data to support operations on the device 700. Examples of such data include instructions for any application or method operating on the device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0131] The power supply component 706 provides power to the various components of the device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 700.

[0132] The multimedia component 708 includes a screen that provides an output interface between the device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD), a field sequential display, and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0133] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), which is configured to receive external audio signals when the device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0134] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0135] The sensor assembly 714 includes one or more sensors for providing various aspects of the status assessment of the device 700. For example, the sensor assembly 714 can detect the open / closed state of the device 700, the relative positioning of components, such as the display and keypad of the device 700. The sensor assembly 714 can also detect changes in the position of the device 700 or a component of the device 700, the presence or absence of user contact with the device 700, the orientation or acceleration / deceleration of the device 700, and temperature changes of the device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0136] The communication component 716 is configured to facilitate wired or wireless communication between the device 700 and other devices. The device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 6G NR or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0137] In an exemplary embodiment, the apparatus 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described image processing method.

[0138] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions. The instructions can be executed by the processor 720 of the apparatus 700 to perform the above-mentioned image processing method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0139] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the embodiments disclosed herein. The present invention is intended to cover any variations, uses, or adaptations of the present invention that follow from the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0140] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof, which is limited only by the appended claims.

[0141] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a..." does not exclude the presence of other identical elements in the process, method, article or device that includes the element.

[0142] The above is a detailed introduction to the methods and devices provided in the embodiments of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the methods and core ideas of the present invention. At the same time, for those skilled in the art, according to the ideas of the present invention, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present invention.

Claims

1. An image processing method, applied to an image coding device, comprising: Determining a color value of each original pixel in the original color image, wherein N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1; Generating mixed images corresponding to N basic colors respectively according to the color values ​​of the respective original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, determining N original pixels in one-to-one correspondence with the N mixed sub-pixels contained in the any mixed pixel in the original color image according to a pixel position mapping relationship, and using the color components corresponding to the any basic color in the color values ​​of the N original pixels as the color components of the corresponding mixed sub-pixels; When the generation of a mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

2. The method according to claim 1, wherein determining, in the original color image, N original pixels corresponding one-to-one to the N mixed sub-pixels included in any mixed pixel point based on the pixel position mapping relationship comprises: determining a coding scaling factor according to a first size of the original color image and a second size of the mixed image, and determining a second position of any mixed pixel point in the mixed image; According to the encoding scaling coefficient, a first position corresponding to the second position is determined in the original color image, and a one-to-one correspondence between the N original pixel points at the first position and the N mixed sub-pixels contained in any mixed pixel point is determined.

3. The method according to claim 2, wherein the image encoding device is a graphics processing unit (GPU), and the method further comprises: Normalization is performed on the values ​​of the first size and the second size, and the first position and the second position are represented by the normalized coordinate values.

4. The method according to claim 2, further comprising: An offset is added to the coordinate value of the second position so that the offset second position is inside the original pixel point.

5. The method according to claim 1, wherein the N original pixel points in the original color image corresponding one-to-one to the N mixed sub-pixels are continuously adjacent. The method according to claim 1 , wherein the color model is an RGB model, and N=3. 7 . The method according to claim 1 , wherein the original color image is a video frame image belonging to any video.

8. An image processing method, applied to a field sequential display device, comprising: Upon receiving a mixed image sent in accordance with an image transmission rule conforming to a color model, determining a color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1; Generating a monochrome image corresponding to any one of the basic colors based on the color values ​​of each of the mixed pixel points, wherein, for N mixed sub-pixels included in any one of the mixed pixel points, determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and using the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points; The monochrome image is displayed by controlling a display component of the field sequential display device.

9. The method according to claim 8, wherein determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image according to the pixel position mapping relationship comprises: determining a decoding scaling factor according to a third size of the monochrome image and a second size of the mixed image, and determining a second position of any mixed pixel point in the mixed image; According to the decoded scaling coefficient, a third position corresponding to the second position is determined in the monochrome image, and a one-to-one correspondence between the N monochrome pixels at the third position and the N mixed sub-pixels contained in any mixed pixel is determined.

10. An image processing apparatus, applied to an image coding device, comprising one or more processors, wherein the processors are configured to: Determining a color value of each original pixel in the original color image, wherein N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1; Generate mixed images corresponding to N basic colors according to the color values ​​of the original pixels, where: For any mixed pixel point in the mixed image corresponding to any basic color, determine, in the original color image, N original pixel points that correspond one-to-one to the N mixed sub-pixels contained in the any mixed pixel point according to the pixel position mapping relationship, and use the color components corresponding to the any basic color in the color values ​​of the N original pixel points as the color components of the corresponding mixed sub-pixels; When the generation of a mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device in accordance with image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.

11. An image processing apparatus, the apparatus being applied to a field sequential display device, the apparatus comprising one or more processors, the processors being configured to: Upon receiving a mixed image transmitted according to an image transmission rule conforming to a color model, the color value of each mixed pixel in the mixed image is determined, wherein: The mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes the color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, where N is a positive integer greater than 1; Generating a monochrome image corresponding to any one of the basic colors based on the color values ​​of each of the mixed pixel points, wherein, for N mixed sub-pixels included in any one of the mixed pixel points, determining N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels in the monochrome image based on a pixel position mapping relationship, and using the color components of the N mixed sub-pixels for any one of the basic colors as the color values ​​of the corresponding monochrome pixel points; The monochrome image is displayed by controlling a display component of the field sequential display device.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method according to any one of claims 1-7 or 8-9.

13. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 or 8 to 9 are implemented.

Images