IMAGE PROCESSING METHOD AND DEVICE

Abstract

It relates to image processing methods and apparatus. The method comprises: determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels contained in any original pixel point are each assigned to different primary colors of a color model, wherein their color value comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1; generating mixed images each assigned to the N primary colors depending on the color values ​​of the individual original pixel points, wherein N original pixel points are determined in the original color image, which correspond one-to-one to N mixed subpixels contained in the arbitrary mixed pixel point, and the color component of the color values ​​of the N original pixel points with respect to the arbitrary primary color are each used as color components of the corresponding mixed subpixels;Sending the composite image to a field-sequential display device to display a monochrome image associated with any primary color. According to this method, the bandwidth between an image encoding device and a field-sequential display device can be saved and image freezes can be avoided.

Description

TECHNICAL FIELD

[0001] The present invention relates to the field of image processing technology, and more particularly to image processing methods and apparatus. STATE OF THE ART

[0002] Field-sequential displays (or field-sequential liquid crystal displays) are a new type of liquid crystal display. Unlike a conventional LCD (liquid crystal display), in which a pixel dot is composed of multiple partitions, a pixel dot in a field-sequential display consists of a single partition. To display a color image, another device can process the color image into a monochrome image and send it to the field-sequential display. By controlling the liquid crystals and color films of individual pixel dots, the field-sequential display can control the pixel dots to display monochrome images in different colors sequentially, thus creating a color image display effect in conjunction with the "persistence effect" of the human eye.

[0003] However, based on the above display principle, the field-sequential display device must use a higher refresh rate than traditional LCDs to display individual monochrome images. For example, for RGB images, to achieve the display effect of a traditional LCD at a refresh rate of 90 Hz, the field-sequential display device must display monochrome images at a refresh rate of 270 Hz. Accordingly, other devices must render a 270-frame image per second and transmit the 270-frame image data to the field-sequential display device. Therefore, in high-resolution scenarios (e.g., when displaying 4K video images), the data transmission channels between other devices and the field-sequential display device are subject to relatively large bandwidth pressure. Since monochrome images often still follow a corresponding multi-channel rule, e.g.,Red, green, and blue images are each transmitted through three channels for RGB, among which the color data transmitted by the three channels is only the color data transmitted by one channel is valid data, there is serious bandwidth waste in the process of data transmission between other devices and the field sequential display device, which may even cause frame loss or freeze during video playback. DISCLOSURE OF THE INVENTION

[0004] In view of this, embodiments of the present invention provide image processing methods and apparatus to overcome the deficiencies existing in relevant technology.

[0005] According to a first aspect of the embodiments of the present invention, there is provided an image processing method applied to an image coding apparatus, comprising:

[0006] Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels that any original pixel point contains are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1;

[0007] Generating mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points are determined according to a pixel position mapping relationship in the original color image, which correspond one-to-one to N mixed subpixels contained in the any mixed pixel point, and color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels;

[0008] in the event that the generation of a mixed image assigned to any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model in order to generate and display a monochrome image assigned to any primary color by the field-sequential display device based on the mixed image.

[0009] According to a second aspect of the embodiments of the present invention, there is provided an image processing method applied to a field sequential display device, comprising:

[0010] in the case of receiving a mixed image sent according to an image transmission rule corresponding to a color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is assigned to any primary color of the color model, wherein a color value of any mixed pixel point comprises color components of N mixed subpixels that the any mixed pixel point contains with respect to the any primary color, where N is a positive integer greater than 1;

[0011] Generating a monochrome image associated with the arbitrary primary color depending on the color values ​​of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, N monochrome pixel points that correspond one-to-one to the N mixed subpixels are determined according to a pixel position mapping relationship in the monochrome image, and the color components of the N mixed subpixels with respect to the arbitrary primary color are each used as color values ​​of the corresponding monochrome pixel points;

[0012] Displaying the monochrome image by controlling a display component of the field sequential display device.

[0013] According to a third aspect of the embodiments of the present invention, there is provided an image processing apparatus applied to an image coding apparatus, comprising one or more processors, the processor(s) being configured to:

[0014] Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels contained by any original pixel point are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, wherein N is a positive integer greater than 1;

[0015] Generating mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points are determined according to a pixel position mapping relationship in the original color image, which correspond one-to-one to N mixed subpixels contained in the any mixed pixel point, and color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels;

[0016] in the event that the generation of a mixed image assigned to any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model in order to generate and display a monochrome image assigned to any primary color by the field-sequential display device based on the mixed image.

[0017] According to a fourth aspect of the embodiments of the present invention, there is provided an image processing apparatus applied to a field sequential display device, comprising one or more processors, the processor(s) being configured to:

[0018] in the case of receiving a mixed image sent according to an image transmission rule corresponding to a color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is assigned to any primary color of the color model, wherein a color value of any mixed pixel point comprises color components of N mixed subpixels that the any mixed pixel point contains with respect to the any primary color, where N is a positive integer greater than 1;

[0019] Generating a monochrome image associated with the arbitrary primary color depending on the color value of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, N monochrome pixel points that correspond one-to-one to the N mixed subpixels are determined according to a pixel position mapping relationship in the monochrome image, and the color components of the N mixed subpixels with respect to the arbitrary primary color are each used as color values ​​of the corresponding monochrome pixel points;

[0020] Displaying the monochrome image by controlling a display component of the field sequential display device.

[0021] According to a fifth aspect of the embodiments of the present invention, there is provided an electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the above image processing method according to the first or second aspect.

[0022] According to a sixth aspect of the embodiments of the present invention, a non-transient computer-readable storage medium is presented on which a computer program is stored, wherein, upon execution of the program by a processor, steps of the above image processing method according to the first or second aspect are carried out.

[0023] According to one embodiment of the present invention, an image coding device first determines color values ​​of individual original pixel points in an original color image, wherein N original subpixels contained by any original pixel point are each assigned to different primary colors of a color model, wherein a color value of the original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, wherein N is a positive integer greater than 1.Subsequently, the image coding device generates mixed images each assigned to N primary colors depending on the color values ​​of each original pixel point, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points corresponding one-to-one to N mixed subpixels contained in the any mixed pixel point are determined according to a pixel position mapping relationship in the original color image, and color components of the color values ​​of the N original pixel points with respect to the any primary color are respectively used as color components of the corresponding mixed subpixels.Finally, in the case where the generation of a mixed image associated with any primary color is completed, the image coding device sends the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model, in order to generate and display a monochrome image associated with any primary color from the field-sequential display device based on the mixed image.

[0024] As explained above, during the generation of a mixed image associated with any primary color, for any mixed pixel point in a mixed image associated with any primary color, N original pixel points corresponding one-to-one to N mixed subpixels contained in any mixed pixel point are determined according to a pixel position mapping relationship in the original color image, and the color components of the color values ​​of the N original pixel points with respect to the arbitrary primary color are respectively used as the color components of the corresponding mixed subpixels. In this way, N mixed subpixels in any mixed pixel point in the mixed image are respectively used to record the color component associated with any primary color in different original pixel points; that is,Several color components in the original color image, which are assigned to any primary color, are recorded centrally in a mixed pixel point of the mixed image.

[0025] As a result, in the subsequent process of transmitting a composite image to a field-sequential display device according to the (N-1) / N image transmission rule corresponding to the color model, bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rule, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and increasing the utilization rate of the data transmission channel. Accordingly, after the field-sequential display device receives any composite image, it is sufficient to simply decode and display the monochrome image. In the scenario of transmitting video images, image loss or freezes can also be effectively avoided.

[0026] It is to be understood that the above general description and the following detailed description are only illustrative and explanatory and are not limitative of the present invention. SHORT DESCRIPTION OF THE CHARACTERS

[0027] In order to more clearly explain the technical solutions in the embodiments of the present invention, the figures required for the presentation of the embodiments are briefly presented below. Obviously, the figures in the following description relate only to a few embodiments of the present invention. A person of ordinary skill in the art can derive further figures from these figures without inventive effort. Fig. 1 shows a schematic representation of a connection between devices according to an embodiment of the present invention. Fig. 2 shows a flowchart of an image processing method according to an embodiment of the present invention. Fig. 3 shows a schematic representation of an image processing process according to an embodiment of the present invention. Fig. 4 shows a schematic representation of a positional relationship between original subpixels and mixed pixel points according to an embodiment of the present invention. Fig. 5 is a schematic representation of an original color image and coded blended images according to an embodiment of the present invention. Fig. 6 is a flowchart of another image processing method according to an embodiment of the present invention. Fig. 7 is a schematic block diagram of an image processing apparatus according to an embodiment of the present invention. EMBODIMENTS OF THE INVENTION

[0028] The technical solutions in the embodiments of the present invention are described clearly and completely below with reference to the accompanying figures for the embodiments of the present invention. Obviously, the described embodiments are not all, but only a part, of the embodiments of the present invention. All other embodiments that a person of ordinary skill in the art can derive from the embodiments of the present invention without inventive effort fall within the scope of the present invention.

[0029] The image processing method according to the embodiments of the present description relates to two types of devices: an image coding device and a field sequential display device. Fig. 1 shows a schematic representation of a connection between devices according to an embodiment of the present invention. As in Fig. 1, an image coding device 101 is connected to a field sequential display device 103 via a data transmission channel 102.

[0030] The image coding device 101 and the field-sequential display device 103 can be separate devices. For example, the image coding device 101 can be a terminal device used by the user. For example, the terminal device can be a mobile phone, a tablet device, a laptop computer, a PDA (Personal Digital Assistant), a wearable device (such as smart glasses, smartwatches, or the like), a VR (Virtual Reality) device, an AR (Augmented Reality) device, or the like. The field-sequential display device 103 can be an independent display device, e.g., a display or the like. The data transmission channel 102 between the two can be implemented by cable. Alternatively, the image coding device 101 and the field-sequential display device 103 can also be different functional components in the same device.For example, the image encoding device 101 may be a processing component of a display device, and the field-sequential display device 103 may be a display component (e.g., a display screen or the like) of a display device. The data transmission channel 102 between the two may be implemented by the bus of the display device or an image data transmission component associated with the field-sequential display device 103. For example, the image encoding device 101 may be the CPU or GPU of the aforementioned device, and the field-sequential display device 103 may be a display built into the same device, which itself has an independent controller.

[0031] Furthermore, the data transmission channel 102 can be configured in various forms. For example, its interface can adopt an interface standard such as DP (DisplayPort), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), or VGA (Video Graphics Array), which is not limited to the embodiments of the present invention. Furthermore, a buffer area can be included between the image encoding device 101 and the field-sequential display device 103 so that the field-sequential display device 103 maintains a relatively stable refresh rate during image reproduction.

[0032] In one embodiment of the present description, the image coding device 101 may encode an original color image by the image processing method to obtain N composite images, and then send each composite image to the field-sequential display device 103 via the data transmission channel 102. Accordingly, the field-sequential display device 103 may decode any obtained composite image by the other processing method to obtain a corresponding monochrome image, and then display the monochrome image locally.It should be understood that for any original color image, after the image encoding device 101 sequentially sends the N coded composite images to the field-sequential display device 103, the field-sequential display device 103 can decode and display the corresponding monochrome images sequentially, thereby presenting a color display effect of the original color image to the viewer using the "persistence effect" of the human eye. Encoding and decoding solutions associated with the image processing methods of the present invention are described in detail below in combination with figures and corresponding embodiments.

[0033] Fig. 2 shows a flowchart of an image processing method according to an embodiment of the present invention. As in Fig. As shown in Figure 2, this method is applied to image coding devices. In particular, this method can be implemented by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The image processing method can include the following steps 202-206:

[0034] Step 202: Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels contained by any original pixel point are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1.

[0035] The original color image in the embodiment of the present invention may be an independent image. This approach allows the field-sequential display device to repeatedly display multiple monochrome images associated with the image to present a color display effect of the image. Alternatively, the original color image may be a video frame image belonging to any video. This approach allows the field-sequential display device to sequentially display multiple monochrome images associated with the respective video frame images of the video to present a color display effect of the video frame image associated with the video.

[0036] Furthermore, the color values ​​of the original pixels in the original color image can be represented by assumed values ​​in the color space. The color model associated with the color space can be in any form, which is not limited in the embodiments of the present invention. The color model can be, for example, an RGB model, an RGBW model, a CMYK model, or the like, where the RGB model includes three primary colors: red, green, and blue; the RGBW model includes four primary colors: red, green, blue, and white; and the CMYK model includes cyan, magenta, yellow, and black.

[0037] Regardless of the color model used, any original pixel in the original color image contains N (N is a positive integer greater than 1) original subpixels, each assigned to a different primary color of the color model. A color value of any original pixel contains color components of the N original subpixels related to the corresponding primary color. For example, if the color model of the original color image is the RGB model, N = 3, meaning any original pixel in the image contains original subpixels, each assigned to the three primary colors R, G, and B. The color value of the original pixel contains the color components assigned to the three original subpixels, namely the R value, the G value, and the B value.In practice, when a conventional LCD is used to display the original color image, the respective original pixel points in the image can be respectively assigned to different pixels on the display screen, and respective original subpixels in any original pixel point can be respectively assigned to different partitions in corresponding pixels, where the display can be controlled independently.

[0038] In the following, in combination with Fig. 3 explains the RGB model as an example. As in Fig. 3, an original color image 301 contains a plurality of original pixel points, for example, 1, 2, 3 original pixel points, or the like. Any original pixel point contains three original subpixels, for example, an original pixel point 1 contains three original subpixels: R1, G1, and B1, an original pixel point 2 contains three original subpixels: R2, G2, and B2, and so on, which will not be repeated here. Fig. 3 are the original subpixels assigned to different primary colors, each filled with a background in different shades of gray to easily distinguish them from each other.

[0039] Any original subpixel in the above-mentioned arbitrary original pixel point has a color component associated with the corresponding primary color. As an example, original pixel point 1 is taken, where the three original subpixels R1, G1, and B1 each have color components corresponding to red, green, and blue, respectively. The color component of any original subpixel does not exceed the value range in the color space associated with the RGB model. For example, in the case where the color components corresponding to the respective primary colors are represented by a numerical value with a bit length of 8 bits in the RGB model, the value range of the color component of any original subpixel can be [1, 256]. For example, the color component of R1 related to red can be 0, the color component of G1 related to green B can be 26, the color component of B1 related to blue can be 245, and so on.

[0040] Furthermore, the corresponding respective primary colors of the color components of each original subpixel in any original pixel point together constitute the color value of the original pixel point. For example, the color value of original pixel point 1 includes the color components of the original subpixels R1, G1, and B1, respectively, in terms of red, green, and blue. In other words, these three color components together constitute the color value of original pixel point 1. It can be seen that the color value of any original pixel point actually comprises a data set containing N values. From this, it can be seen that the process of determining the color values ​​of individual original pixel points in the original color image by the image coding device actually refers to the process of reading the color components of the original subpixels that each original pixel point in the image contains.

[0041] It should also be noted that the Fig. 3 is only an example of the arrangement of the individual original subpixels in the original pixel point. During the implementation of the solution, the individual original subpixels in the same original pixel point can be arranged in any way, which is not limited in the embodiments of the present invention. Furthermore, it is understood that for each image, with the exception of the mixed images 3031-3033 in Fig. 3 The number marked in any pixel point (or subpixel) is the number of the pixel point (or subpixel) in the corresponding image, which serves only to distinguish different pixel points (or subpixels). An arbitrary image actually records the color value of any pixel point (including the color components of individual subpixels), which does not necessarily have a numerical relationship between the specific value of the color value (or color component) and its number. For example, the number of any original pixel point or original subpixel in the original color image 301 is used to represent the pixel point or subpixel. On the other hand, the data marked in any mixed pixel point in the mixed images 3031-3033 is used to indicate which color component of the original subpixel in the original color image 301 matches the color component of the mixed pixel point, corresponding to the respective base color.For example, for a mixed subpixel with the number 7 in the red mixed image 3031, the number is used to indicate that the color component of the mixed subpixel is the color component (assigned to red) of the original red subpixel (with the number 7) in the first original pixel point in the second row of the original color image 301.

[0042] Step 204: Generating blended images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any blended pixel point in a blended image assigned to any primary color, N original pixel points corresponding one-to-one to N blended subpixels contained in the any blended pixel point are determined according to a pixel position mapping relationship in the original color image, and the color components of the color values ​​of the N original pixel points with respect to the any primary color are respectively used as color components of the corresponding blended subpixels.

[0043] Once the color values ​​of each original pixel in the original color image are determined, the image coding device can generate composite images corresponding to the N primary colors based on the color values. The process of generating a composite image is essentially a process of sequentially determining the color components of the N composite subpixels contained in each composite pixel in the composite image. Specifically, for any composite pixel in the composite image containing N composite subpixels and associated with any primary color, the color components of the N original subpixels (each corresponding to different original pixels) that correspond one-to-one to the N composite subpixels in the original color image are used as the color components of the N composite subpixels.

[0044] As in Fig. 3, all the original subpixels in the original color image 301 can be divided into three types according to the primary colors, that is, red original subpixels 3021, green original subpixels 3022, and blue original subpixels 3023, wherein the relative positional relationship between the respective original subpixels of each type is consistent with the relative positional relationship of the respective associated original pixel points in the original color image 301. However, it should be noted that the above-mentioned red original subpixels 3021, green original subpixels 3022, and blue original subpixels 3023 may be either a monochrome image generated based on the original subpixels associated with the respective primary colors, or a subpixel division result in a logical sense, rather than an actually generated monochrome image.

[0045] The image coding device can determine N original pixel points that correspond one-to-one to N mixed subpixels in the arbitrary mixed pixel point according to a pixel position mapping relationship, and then determine the N original subpixels assigned to the arbitrary primary color in the N original pixel points as corresponding one-to-one to the corresponding mixed subpixels. The pixel position mapping relationship can be used to record a one-to-one mapping between the position of the original subpixel in the original color image and the position of the corresponding mixed subpixel in the mixed image. Here, since any original pixel point contains N original subpixels, and the original subpixels are each assigned to the corresponding primary color, the position of any original pixel point in the original color image can be regarded as the position of its N original subpixels in the original color image, i.e., with respect to other original pixel points or other pixel points outside the original color image, the original subpixels assigned to the respective primary color in any original pixel point are located at the same position in the original color image. As in . Fig. As shown in Figure 3, the original pixel point labeled 1 in the original color image 301 contains three original subpixels (i.e., red original subpixel 1, green original subpixel 1, and blue original subpixel 1). Thus, the positions where these three original subpixels are located in the original color image 301 can all be designated with the number "1." The same applies to the other original subpixels and will not be repeated here.

[0046] Based on the above pixel position mapping relationship, the image coding apparatus can generate mixed images, each corresponding to the three primary colors, i.e., a red mixed image 3031, a green mixed image 3032, and a blue mixed image 3033, depending on the above red original subpixel 3021, the green original subpixel 3022, and the blue original subpixel 3023. As an example, the red mixed image 3031 is taken, in which the color components of the respective mixed subpixels contained by the respective mixed pixel points are recorded. From the color component determination method in step 204, it can be seen that the specific value of the color component of any mixed subpixel is equal to the specific value of the color component of the original subpixel to which the mixed subpixel in the original color image 301 corresponds. For example, for the first mixed subpixel in the first mixed pixel point (i.e.,For example, for the red mixed subpixel 1), the specific value of its color component is equal to the specific value of the color component of the first original subpixel (i.e., the red original subpixel 1) that the first original pixel point contains in the original color image 301. Also, for the second mixed subpixel in the second mixed pixel point (i.e., the green mixed subpixel 2), the specific value of its color component is equal to the specific value of the color component of the second original subpixel (i.e., the green original subpixel 2) that the second original pixel point contains in the original color image 301. Similar details will not be repeated.

[0047] To ensure that the generated composite image associated with any primary color has the above-mentioned effect, the image coding device may, according to the positional correspondence recorded in the above pixel position mapping relationship, determine N original pixel points in the original color image that correspond one-to-one to N composite subpixels contained in any composite pixel point. Specifically, the image coding device may first determine a coding scaling coefficient depending on a first size of the original color image and a second size of the composite image, and determine a second position where any composite pixel point is located in the composite image.Subsequently, the image coding apparatus may determine a first position in the original color image corresponding to the second position depending on the coding scaling coefficient, and then determine a one-to-one mapping of N original pixel points at the first position and N mixed subpixels contained in the arbitrary mixed pixel point.

[0048] As in Fig. 3 is recorded according to the above pixel position mapping relationship: the digits of the respective mixed pixel points each refer to positive integers and increase sequentially from left to right and from top to bottom; three mixed subpixels in an odd-numbered mixed pixel point respectively correspond to the original subpixels in the mixed pixel point in the odd-numbered column, the mixed pixel points adjacent to it, and located respectively below it and on its right side in the original color image; three mixed subpixels in an even-numbered mixed pixel point respectively correspond to the original subpixels in the mixed pixel points adjacent to the mixed pixel point in the even-numbered column, and located respectively below it, on its right side, and lower right in the original color image.Based on this, for the three mixed subpixels included in the first (odd) pixel point in the first row of the red mixed image 3031, the image coding device can determine that the three mixed subpixels correspond to the red original subpixels in the original pixel points designated by numbers 1, 7, and 2 in the original color image 301, respectively; for the three mixed subpixels included in the second (even) pixel point in the first row of the red mixed image 3031, the image coding device can determine that the three mixed subpixels correspond to the red original subpixels in the original pixel points designated by numbers 8, 3, and 9 in the original color image 301, respectively.Similarly, for the three mixed subpixels included in the third (odd) pixel point in the first row of the red mixed image 3031, the image coding device may determine that the three mixed subpixels correspond to the red original subpixels in the original pixel points labeled 4, 10, and 5 in the original color image 301, respectively; for the three mixed subpixels included in the fourth (even) pixel point in the first row of the red mixed image 3031, the image coding device may determine that the three mixed subpixels correspond to the red original subpixels in the original pixel points labeled 11, 6, and 12 in the original color image 301, respectively. The other mixed pixel points in the red mixed image 3031 and the respective mixed pixel points in the green mixed pixel point 3032 and the blue mixed pixel point 3033 are determined in a similar manner, which will not be repeated here.

[0049] Based on the above pixel position mapping relationship as well as the first size and the second size, the image coding device can determine the corresponding coding scaling coefficient. Based on the Fig. 3, it can be found that in the process of generating the red mixed image 3031 based on the original color image 301, the three original pixel points designated by numbers 1, 7, and 2 are reduced to one mixed pixel point (that is, a pixel point formed from the mixed sub-pixels represented by numbers 1, 7, and 2 in the red mixed image 3031), and the three original pixel points designated by numbers 8, 3, and 9 are reduced to one mixed pixel point (that is, a pixel point formed from the mixed sub-pixels represented by numbers 8, 3, and 9 in the red mixed image 3031).It can be seen that in the mixed image assigned to any primary color, the odd-numbered mixed pixel points are synthesized by arranging the three original subpixels counterclockwise one after another at the corresponding positions in the original color image, and the even-numbered mixed pixel points are synthesized by arranging the three original subpixels clockwise one after another at the corresponding positions in the original color image.

[0050] For any three original pixel points and one blended pixel point associated with them, it is obvious that in the transverse direction, the three original pixel points in the original color image correspond to the two blended pixel points in the blended image, and in the longitudinal direction, two original pixel points in the original color image correspond to one blended pixel point in the blended image. It can be seen that by the above encoding method, three columns in the original color image can be synthesized into two columns in the blended image, changing the number of columns in the longitudinal direction to 2 / 3 of the original number; and at the same time, two rows in the original color image can be synthesized into one row in the blended image, changing the number of rows in the longitudinal direction to 1 / 2 of the original number. In summary, the data amount of any coded blended image is reduced to 1 / 2 * 2 / 3 = 1 / 3 of the data amount of the original color image before encoding.If the original color image is a video frame image in a 4K video and its first size is 3840*3840 as shown in . Fig. 3, the second size of any composite image generated in the above-mentioned manner is 2560 * 1920. It should be understood that the above size can be provided to characterize the number of pixel points in the original color image and the composite image. Since any original pixel point in the original color image contains three original subpixels and any composite pixel point in the composite image contains three composite subpixels, the data amount of the original color image associated with the color components of the respective original subpixels is 3840 * 3840 * 3, and the data amount of the arbitrary composite image associated with the color components of the respective composite subpixels is 2560 * 1920 * 3. Considering that the image coding device generates a total of three composite images (ie,the red composite image 3031, the green composite image 3032 and the blue composite image 3033), there is no difference between the total data amount of the composite image generated on the basis of the original color image and the data amount of the original color image (3 * 2560 * 1920 * 3 = 3840 * 3840 * 3), that is, all color components of the original color image are recorded in the encoded composite image, so this solution enables lossless encoding of the original color image.

[0051] For the N original pixel points that correspond one-to-one to the N blended subpixels in any blended pixel point, their relative positional relationship is not restricted in the embodiments of the present invention. For example, the N original pixel points may be continuously adjacent, making the position determination logic for the N original pixel points relatively simple, facilitating the acceleration of the encoding speed. From the above embodiment, it can be seen that the original subpixels numbered 1, 7, and 2 are continuously adjacent, and the connecting lines from the centers of these three form a right-angled triangle. In fact, the original subpixels to which three blended subpixels in the same blended pixel point each correspond in the original color image 301 may also have other relative positional relationships.For any composite image of the red composite image 3031, the green composite image 3032, and the blue composite image 3033, three composite subpixels (namely, composite subpixels with the number 1) contained in the first composite pixel point in the first row are still cited as an example. If the original subpixels corresponding one-to-one to these three composite subpixels are adjacent, the numbers of the three original subpixels, in addition to the respective numbers 1, 7, and 2, may also be the numbers 1, 2, and 3 (where the connecting line from the centers of these three original subpixels is a transverse line), the numbers 1, 7, and 13 (where the connecting line from the centers of these three original subpixels is a longitudinal line), the numbers 7, 8, and 9, or the like.In the case where the original subpixels corresponding one-to-one to these three mixed subpixels are not adjacent, the digits of the three original subpixels may be the digits 1, 8 and 3, the digits 7, 2 and 9, or the digits 1, 7 and 3, the digits 1, 3 and 5, or the like, which will not be repeated here.

[0052] From the above embodiments, it is clear that in the process of generating a mixed image based on the color values ​​of the individual original pixel points in the original color image, the determination of the original subpixels corresponding to the respective mixed subpixels is of crucial importance. In particular, the image coding device can determine the above-mentioned original subpixels according to the position formula. In the following, in combination with the Fig. 3, an example is explained in which the first size of the original color image is 3840 * 3840 and the second size of the mixed image is 2560 * 1920.

[0053] As mentioned above, the process of generating a blended image associated with an arbitrary primary color involves the process of sequentially determining the color components of each blended subpixel in the blended image with respect to that arbitrary primary color. For any blended pixel point P with coordinates in.text (in.tex.x, in.tex.y) in the blended image, the image encoder must determine the three original subpixels to which the blended pixel point corresponds in the original color image. To do this, the corresponding pixel position cur.pos (cur.pos.x, cur.pos.y) of the blended pixel point P in the original color image must first be determined.

[0054] If the image encoder supports processing integer data (e.g., if the image coding solution is implemented by the image encoder's CPU), in.tex.x ∈ [0,2560], in.tex.y ∈ [0,1920], where cur.pos.x ∈ [0,2560], cur.pos.y ∈ [0,1920]. If the image encoder supports processing decimal data in the interval [0,1] (e.g., the image encoder is a GPU), in.tex.x ∈ [0,1], in.tex.y ∈ [0,1], where cur.pos.x=int(in.tex.x*2560) ∈ [0,2560), and cur.pos.y=int(in.tex.y*1920) ∈ [0,1920).

[0055] Here, the image encoder can calculate the position coordinates raw[0], raw[1], and raw[2] of the three original pixel points in the original color image corresponding to the mixed pixel point P based on the parity of cur.pos.x. If cur.pos.x is an odd number, as in Fig. As shown in Figure 4, the mixed pixel point P corresponds to the three original pixel points in the left area, and the following formula (1) is the coordinate calculation formula for these three original pixel points; when cur.pos.x is an even number, the mixed pixel point P corresponds to the three original pixel points in the right area, and the following formula (2) is the coordinate calculation formula for these three original pixel points. {raw_pos.x=cur.pos.x*3 / 2raw_pos.y=cur.pos.y*2raw[0]=int2(raw_pos.x, raw_pos.y)raw[1]=int2(raw_pos.x, raw_pos.y+1)raw[2]=int2(raw_pos.x+1, raw_pos.y) {raw_pos.x=cur.pos.x*3 / 2+1raw_pos.y=cur.pos.y*2raw[0]=int2(raw_pos.x, raw_pos.y+1)raw[1]=int2(raw_pos.x+1, raw_pos.y)raw[2]=int2(raw_pos.x+1, raw_pos.y+1)

[0056] As mentioned above, the image transfer method corresponding to the coding solution can be applied to GPU (that is, the image coding device is a GPU). Considering that the GPU can usually process values ​​in the interval [0, 1] in the current stage, in this scenario, the GPU can still perform the normalization of the values ​​of the aforementioned first and second quantities, and represent the first and second positions by normalized coordinate values. In this way, it can ensure that the specific values ​​of the first and second positions are in the interval [0, 1], so that the GPU can perform accurate and efficient coding processing for the original color image. The above position coordinates are normalized.

[0057] According to the above normalization, the above-mentioned position coordinates can also be normalized. The coordinates raw_rgb[0], raw_rgb[1], and raw_rgb[2] of the three normalized original pixel points are each referred to the following formula (3). {raw_rgb[0]=float2((raw[0].x) / 3840.f, (raw[0].y) / 3840.f)raw_rgb[1]=float2((raw[1].x) / 3840.f, (raw[1].y) / 3840.f)raw_rgb[2]=float2((raw[2].x) / 3840.f, (raw[2].y) / 3840.f)

[0058] To ensure accurate sampling of the color components for each original subpixel, an offset can be added to the coordinate value of the second position so that the offset second position is within the original pixel point. For example, 0.5 can be added as an offset to raw[0], raw[1], and raw[2]. In particular, formula (3) can be replaced by formula (4). {raw_rgb[0]=float2((raw[0].x+0.5) / 3840.f, (raw[0].y+0.5) / 3840.f)raw_rgb[1]=float2((raw[1].x+0.5) / 3840.f, (raw[1].y+0.5) / 3840.f)raw_rgb[2]=float2((raw[2].x+0.5) / 3840.f, (raw[2].y+0.5) / 3840.f)

[0059] Meanwhile, raw_rgb[0], raw_rgb[1], and raw_rgb[2], calculated according to formulas (3) or (4), are the position coordinates of the respective original pixel points to which the blended pixel point P corresponds in the original color image. Here, the GPU can perform sampler sampling for the color components of the corresponding nine original subpixels according to these three position coordinates. Specifically, the GPU can read the red, green, and blue color components corresponding to the position coordinates of raw_rgb[0], raw_rgb[1], and raw_rgb[2], respectively. Of course, the sampled and recorded color components can also be pre-normalized, i.e., the value range of any color component can also be [0,1].

[0060] After the color components texColor0, texColor1 and texColor2 of the three original pixel points have been obtained by sampling, mixed pixel points of corresponding colors are synthesized according to R, G or B, see formula (5). {outColorR=float4(texColor0.r, texColor1.r, texColor2r)outColorG=float4(texColor0.g, texColo2.g)outColorB=float4(texColor0.b, texColor1.b, texColor2b)

[0061] Until then, the outColorR obtained by sampling refers to the color components of the individual mixed subpixels in the mixed pixel point P in the red mixed image, outColorG refers to the color components of the individual mixed subpixels in the mixed pixel point P in the green mixed image, and outColorB refers to the color components of the individual mixed subpixels in the mixed pixel point P in the blue mixed image. Furthermore, in each OutColor in formula (5), in addition to the corresponding three color components, relevant data such as transparency values ​​of the respective mixed subpixels can also be included, which is not limited in the embodiment of the present invention.

[0062] As an example, a first and a second mixed pixel point are shown in the first row of the respective Fig. 3 shown mixed pixel points. As shown in Fig. 4, the number 1 of the first mixed pixel point (the numbers of the respective mixed pixel points are shown in Fig. 3 not shown) is an odd number. According to formula (1), the position coordinates of the original pixel points in the left area, respectively designated by the numbers 1, 7, and 2, can be calculated. The GPU can determine the color components of the respective mixed subpixels in the first mixed pixel point in the first row in the red mixed image 3031, the green mixed image 3032, and the blue mixed image 3033 by sampling the color components of the respective original subpixels. Similarly, the number 2 of the second mixed pixel point is an odd number. According to formula (2), the original pixel points in the right area, respectively designated by the numbers 8, 3, and 9, can be calculated.The GPU can, by sampling the color components of the respective original subpixels, respectively determine the color components of the respective blended subpixels in the second blended pixel point in the first row in the red blended image 3031, the green blended image 3032, and the blue blended image 3033. In the above manner, the GPU can sequentially determine the color components of the respective blended subpixels in the above three blended images, so that the above three blended images are generated.

[0063] Until now, the process of generating N composite images associated with the original color image has already been presented. It should be noted that for any original color image, the image coding device can either generate N composite images associated with the same image in parallel (e.g., generating respective composite images simultaneously according to the above-mentioned formula (5)), or generate respective composite images in a preset sequence. For example, in the Fig. 3, a red mixed image 3031, a green mixed image 3032, and a blue mixed image 3033 are generated successively in the order R, G, and B. This is not limited in these embodiments of the present invention.

[0064] Fig. 5 is a schematic representation of an original color image and coded mixed images according to an embodiment of the present invention. As in Fig. 5, a is in Fig. 5 the original color image before coding, b, c and d in Fig. 5 are the red composite image, the green composite image, and the blue composite image obtained by encoding, respectively. It should be understood that for any composite pixel point in any of the above composite images, the color components of the multiple composite subpixels in the composite pixel point are actually the color components of the corresponding original subpixels in the original color image.

[0065] Step 206: in the case where the generation of a mixed image associated with any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model, in order to generate and display a monochrome image associated with any primary color by the field-sequential display device based on the mixed image.

[0066] After generating N composite images associated with the original color image, the image coding device can send the composite image to the field-sequential display device according to an image transmission rule corresponding to the color model. For example, if the original color image corresponds to the RGB color model, the image coding device can use three channels corresponding to this model to transmit respective composite images. Furthermore, the transmission order of the individual composite images and their generation order can be the same or different, which is not limited to the embodiments of the present invention.

[0067] In one embodiment, in the case where the original color image is a video frame belonging to an arbitrary video, the image coding apparatus may sequentially encode respective video frame images according to the order of the respective video frame images in the video time axis, thereby obtaining N composite images each corresponding to the respective video frame images. Subsequently, the respective composite images are sequentially transmitted in the order of R, G, and B. For example, first, three composite images corresponding to the first video frame image may be transmitted in the order of R, G, and B, and then three composite images corresponding to the second video frame image may be transmitted in the order of R, G, and B, ... , which will not be repeated here.

[0068] Accordingly, after receiving any composite image associated with any primary color, the field-sequential display device can decode the image to generate a monochrome image associated with the primary color and display the monochrome image locally. For different images processed by the field-sequential display device, the operations of receiving the composite image, decoding the composite image, and displaying the monochrome image can be performed in parallel. For any composite image, it can be processed sequentially according to the aforementioned sequence of receiving, decoding, and displaying, which will not be repeated here.

[0069] According to an embodiment of the present invention, an image coding apparatus first determines color values ​​of individual original pixel points in an original color image, wherein N original subpixels contained by any original pixel point are each assigned to different primary colors of a color model, wherein a color value of the original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, wherein N is a positive integer greater than 1;then it generates mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points corresponding one-to-one to N mixed subpixels contained in the any mixed pixel point are determined according to a pixel position mapping relationship in the original color image, and color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels;Finally, in the event that the generation of a mixed image associated with any primary color is completed, it sends the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model, in order to generate and display a monochrome image associated with any primary color from the field-sequential display device based on the mixed image.

[0070] As explained above, during the generation of a blended image associated with any primary color, for any blended pixel point in a blended image associated with any primary color, N original pixel points corresponding one-to-one to N blended subpixels contained in any blended pixel point are determined according to a pixel position mapping relationship in the original color image, and color components of the color values ​​of the N original pixel points with respect to the arbitrary primary color are respectively used as the color components of the corresponding blended subpixels. In this way, N blended subpixels in any blended pixel point in the blended image are respectively used to record the color component associated with the arbitrary primary color in different original pixel points; that is,Several color components in the original color image that are assigned to any primary color are recorded centrally in a mixed pixel point of the mixed image.

[0071] As a result, in the subsequent process of transmitting a composite image to the field-sequential display device according to the (N-1) / N image transmission rule corresponding to the color model, bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rule, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and increasing the utilization rate of the data transmission channel. Accordingly, after the field-sequential display device receives any composite image, it is sufficient to simply decode and display the monochrome image. In the scenario of transmitting video images, image loss or freezes can also be effectively avoided.

[0072] If for the Fig. 3, the monochrome image transmission method is used in relevant technology, the image coding device must use three channels to respectively transmit the three monochrome images corresponding to the original color image 301. The actual transmitted data amount is 3840 * 3840 * 3 * 3, while 3840 * 3840 * 3 * 2 of the data is invalid data (each allocated to two transmission channels), and the channel utilization rate is 33.3%. After the three composite images corresponding to the original color image 301 have been generated by the above-mentioned coding solution, the image coding device can use three channels to transmit the three composite images respectively, wherein the actual transmitted data amount is 2560 * 1920 * 3 * 3, wherein all data are the color components of the corresponding original subpixels in the original color image, ie, all are valid data, and the channel utilization rate is 100%.It can be seen that this solution enables lossless encoding of the original color image; and that, compared with solutions in relevant technology, the channel utilization rate can be significantly improved and likely image loss or freeze during video image transmission can be effectively avoided.

[0073] According to the above-mentioned image processing method for decoding the original color image to generate a composite image, the embodiments of the present invention present yet another image processing solution for decoding and displaying a received composite image. In the following, in combination with Fig. 6 and associated embodiments are described in detail.

[0074] Fig. 6 is a flowchart of another image processing method according to an embodiment of the present invention. As in Fig. As shown in Figure 3, this method is applied to a field-sequential display device. The image processing method may include the following steps 602-606:

[0075] Step 602: in case of receiving a mixed image sent according to an image transmission rule corresponding to a color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is associated with an arbitrary primary color of the color model, wherein a color value of an arbitrary mixed pixel point comprises color components of N mixed subpixels that the arbitrary mixed pixel point contains with respect to the arbitrary primary color, where N is a positive integer greater than 1.

[0076] Similar to the previous embodiment, the process of determining the color value of any mixed pixel in the mixed image is a process of determining the color components of each mixed subpixel in the mixed pixel with respect to the corresponding primary color. As a result of the previous embodiment, the image encoding device can sequentially send the red mixed image 3031, the green mixed image 3032, and the blue mixed image 3033 to the field-sequential display device in the order of R, G, and B. Accordingly, the field-sequential display device can sequentially decode the respective received mixed images to obtain corresponding monochrome images.

[0077] Step 604: Generating a monochrome image associated with the arbitrary primary color depending on the color values ​​of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, N monochrome pixel points corresponding one-to-one to the N mixed subpixels are determined according to a pixel position mapping relationship in the monochrome image, and color components of the N mixed subpixels with respect to the arbitrary primary color are respectively used as color values ​​of the corresponding monochrome pixel points.

[0078] In the process of generating the monochrome image associated with the arbitrary primary color, corresponding to the above-mentioned coding process, it is necessary to determine monochrome pixel points in the corresponding monochrome image that correspond to the respective blended subpixels in the blended image. For example, for N blended subpixels contained in the arbitrary blended pixel point, according to the aforementioned pixel position mapping relationship in the monochrome image, N monochrome pixel points that correspond one-to-one to the N blended subpixels can be determined.

[0079] In one embodiment, the field-sequential display device may determine a decoding scaling coefficient depending on a third size of the monochrome image and a second size of the mixed image, and determine a second position at which the arbitrary mixed pixel point is located in the mixed image. Subsequently, the field-sequential display device determines a third position in the monochrome image corresponding to the second position according to the decoding scaling coefficient, and determines a one-to-one mapping of N monochrome pixel points at the third position and N mixed subpixels contained in the arbitrary mixed pixel point.

[0080] As an example, the Fig. 3 shown red mixed image 3031. For the first and second mixed pixel point in the first row in the mixed pixel point, as in Fig. 4, the number 1 of the first mixed pixel point (the numbers of the respective mixed pixel points are shown in Fig. 3 not shown) is an odd number. According to formula (1), the position coordinates of the original pixel points in the left area, respectively designated by the numbers 1, 7, and 2, can be calculated. Therefore, the field-sequential display device can use the color components of the respective mixed subpixels recorded in the first mixed pixel point as the color values ​​of the monochrome pixel points with the numbers 1, 7, and 2 in the red image 3041, respectively. Similarly, the number 2 of the second mixed pixel point is an odd number. According to formula (2), the original pixel points in the right area, respectively designated by the numbers 8, 3, and 9, can be calculated. Therefore, the field-sequential display device can use the color components of the respective mixed subpixels recorded in the second mixed pixel point as the color values ​​of the monochrome pixel points with the numbers 8, 3, and 9 in the red image 3041, respectively.

[0081] In the above manner, the GPU can sequentially determine the color values ​​of the individual monochrome pixel points in the red image 3041 and thus obtain the red image 3041. Since in the respective mixed subpixel in the red mixed pixel, the color component of the original subpixel in the original color image is recorded with respect to red, the color values ​​of the respective monochrome pixel points in the red image 3041 generated in the above manner each correspond to red. Therefore, this red image is the monochrome image of the red mixed image 3031.

[0082] Similarly, in the above manner, the green image 3042 corresponding to the green mixed image 3032 and the blue image 3043 corresponding to the blue mixed image 3033 can be generated, respectively.

[0083] Step 606: Displaying the monochrome images by controlling a display component of the field sequential display device.

[0084] The field-sequential display device may include a control component and a display component, and each of the above components may be implemented by software and hardware resources in the field-sequential display device. After an arbitrary monochrome image is generated, the field-sequential display device may display the monochrome image by controlling the display component. Specifically, the liquid crystal and color film of each pixel in the display component may be controlled, thereby controlling each pixel to display a corresponding color, so that an arbitrary monochrome image is displayed as a whole.It is understood that the field-sequential display device can sequentially display monochrome images assigned to different primary colors according to a preset sequence and refresh rate, thus interacting with the "persistence effect" of the human eye to create a color display effect of the original color image. For details, please refer to the information on the working principle of the field-sequential display device in relevant technologies, which will not be repeated here.

[0085] As explained above, during the generation of the mixed image associated with the arbitrary primary color, for any mixed pixel point in the mixed image associated with the arbitrary primary color, N original pixel points corresponding one-to-one to N mixed subpixels contained in the arbitrary mixed pixel point are determined according to the pixel position mapping relationship in the original color image, and color components of the color values ​​of the N original pixel points with respect to the arbitrary primary color are respectively used as the color components of the corresponding mixed subpixels. In this way, N mixed subpixels in any mixed pixel point in the mixed image are respectively used to record the color component associated with the arbitrary primary color in different original pixel points; that is,Several color components in the original color image that are assigned to any primary color are recorded centrally in a mixed pixel point of the mixed image.

[0086] As a result, in the subsequent process of transmitting a composite image to the field-sequential display device according to the image transmission rule (N-1) / N corresponding to the color model, bandwidth can be saved compared to transmitting a corresponding monochrome image according to the same rule, effectively reducing the bandwidth pressure between the image encoding device and the field-sequential display device and increasing the utilization rate of the data transmission channel. Accordingly, after the field-sequential display device receives any composite image, it is sufficient to receive and display only the decoded monochrome image. In the scenario of transmitting video images, image loss or freezes can also be effectively avoided.

[0087] According to the above embodiments of the image processing method, the present invention also provides an image processing apparatus applied to an image coding apparatus, comprising one or more processors, the processor(s) being configured to:

[0088] Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels that any original pixel point contains are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1;

[0089] Generating mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points are determined according to a pixel position mapping relationship in the original color image, which correspond one-to-one to N mixed subpixels contained in the any mixed pixel point, and the color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels;

[0090] in the event that the generation of a mixed image associated with any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model in order to generate and display a monochrome image corresponding to any primary color by the field-sequential display device based on the mixed image.

[0091] In one embodiment, the processor is further configured to:

[0092] Determining a coding scaling coefficient depending on a first size of the original color image and a second size of the blended image, and determining a second position at which the arbitrary blended pixel point is located in the blended image;

[0093] depending on the coding scaling coefficient, determining a first position in the original color image corresponding to the second position, and determining a one-to-one mapping of N original pixel points at the first position and N mixed subpixels contained in the arbitrary mixed pixel point.

[0094] In one embodiment, the image encoding device is a graphics processor GPU, the processor further configured to: Normalize the values ​​of the first quantity and the second quantity, where the first position and the second position are represented by normalized coordinate values.

[0095] In one embodiment, the processor is further configured to: Adding an offset to the coordinate value of the second position so that the offset second position is within the original pixel point.

[0096] In one embodiment, the N original pixel points in the original color image that correspond one-to-one to the N mixed subpixels are continuously adjacent.

[0097] In one embodiment, the color model is an RGB model, where N=3.

[0098] In one embodiment, the original color image is a video frame image associated with any video.

[0099] According to the above embodiments of the image processing method, the present invention provides yet another image processing apparatus applied to a field sequential display device, comprising one or more processors, the processor(s) being configured to:

[0100] in case of receiving a mixed image sent according to the image transmission rule corresponding to the color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is assigned to any primary color of the color model, wherein a color value of any mixed pixel point comprises color components of N mixed subpixels that the any mixed pixel point contains with respect to the any primary color, where N is a positive integer greater than 1;

[0101] Generating a monochrome image associated with the arbitrary primary color depending on the color values ​​of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, N monochrome pixel points that correspond one-to-one to the N mixed subpixels are determined according to a pixel position mapping relationship in the monochrome image, and the color components of the N mixed subpixels with respect to the arbitrary primary color are each used as color values ​​of the corresponding monochrome pixel points;

[0102] Displaying the monochrome image by controlling a display component of the field sequential display device.

[0103] In one embodiment, the processor is further configured to:

[0104] Determining a decoding scaling coefficient depending on a third size of the monochrome image and a second size of the blended image, and determining a second position at which the arbitrary blended pixel point is located in the blended image;

[0105] according to the decoding scaling coefficient, determining a third position in the monochrome image corresponding to the second position, and determining a one-to-one mapping of N monochrome pixel points at the third position and N mixed subpixels contained in the arbitrary mixed pixel point.

[0106] In one embodiment of the present invention, an electronic device is further provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the image processing method according to any of the above embodiments.

[0107] In one embodiment of the present invention, a non-transient computer-readable storage medium is further presented on which a computer program is stored, wherein, upon execution of the program by a processor, steps of the image processing method according to any of the above embodiments are carried out.

[0108] With respect to the devices in the above embodiments, the specific manner in which operations are carried out by the respective modules has already been described in detail in the embodiments of the relevant methods, which need not be explained in more detail here.

[0109] Fig. 7 is a schematic block diagram of a device 700 for data storage or driving mode determination according to an embodiment of the present invention. For example, the device 700 may be a mobile phone, a computer, a digital broadcasting terminal, a message transceiver, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0110] With reference to Fig. 7, the device 700 may include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0111] The processing component 702 typically controls all operation of the device 700, such as operations related to display, telephone calls, data communication, camera operation, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or some steps of the above-mentioned image processing method. Furthermore, the processing component 702 may include one or more modules to facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

[0112] Memory 704 is configured to store various types of data to support operations on device 700. Examples of such data include instructions for any application or method executing on device 700, contact information, phone book data, messages, images, videos, or the like. Memory 704 may be implemented by any type or combination of volatile or non-volatile storage devices, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disc, or an optical disc.

[0113] The power supply component 706 supplies power to the various components of the device 700. The power supply component 706 may include a power management system, one or more power sources, and other components dedicated to generating, managing, and distributing power for the device 700.

[0114] The multimedia component 708 includes a screen that provides an output interface between the device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD), a field-sequential display, and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or swipe, but also detect the duration and pressure associated with the touch or swipe actuation. In some embodiments, the multimedia component 708 includes a front-facing camera and / or a rear-facing camera.When device 700 is in an operating mode, such as a capture mode or a video mode, the front camera and / or rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or may have a focal length and optical zoom capabilities.

[0115] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC) configured to receive external audio signals when the device 700 is in the operating mode, such as call mode, recording mode, and speech recognition mode. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 further includes a speaker for outputting audio signals.

[0116] The I / O interface 712 provides an interface between the processing component 702 and a peripheral interface module. The above peripheral interface module may be a keyboard, a click wheel, a button, or the like. Such buttons may include, but are not limited to, the home button, volume buttons, the start button, and the lock button.

[0117] The sensor component 714 includes one or more sensors for providing a status assessment in various aspects for the device 700. For example, the sensor component 714 can detect the open / closed state of the device 700, the relative positioning of components, for example, the components are the display and the keypad of the device 700. The sensor component 714 can also detect a change in the position of the device 700 or a component of the device 700, the presence or absence of contact of the user with the device 700, the orientation or acceleration / deceleration of the device 700, and a change in the temperature of the device 700. The sensor component 714 can include a proximity sensor configured to detect the presence of nearby objects without physical contact.The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor used in imaging applications. In some embodiments, the sensor component 714 may further include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0118] The communication component 716 is configured to facilitate wired or wireless communication between the device 700 and other devices. The device 700 may access a wireless network based on a communication standard such as WLAN, 2G or 3G, 4G LTE, 6G NR, or a combination thereof. In an exemplary embodiment, the communication component 716 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a near-field communication (NFC) module to facilitate short-range communication.For example, in the NFC module, it can be implemented based on radio frequency identification technology (RFID), infrared data association technology (IrDA), ultra-wideband technology (UWB), Bluetooth technology (BT) and other technologies.

[0119] In an exemplary embodiment, the device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, a microcontroller, microprocessors, or other electronic elements to perform the above-mentioned image processing method.

[0120] In an exemplary embodiment, a non-transient computer-readable storage medium with instructions is also provided, for example, a memory 704 with instructions, wherein the above instructions can be executed by the processor 720 of the device 700 to perform the above image processing method. The non-transient computer-readable storage medium can be, for example, a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, or the like.

[0121] Those skilled in the art can easily devise other embodiments of the present invention upon consideration of the description and practice of the embodiments disclosed herein. The present invention is intended to include all variations, uses, or adaptations of the invention that follow the general principles of the invention and incorporate generally known general knowledge or conventional technical means in the technical field not disclosed in the invention. The description and embodiments are to be considered exemplary only; the true scope and concept of the invention are indicated by the following claims.

[0122] It should be understood that the present invention is not limited to the precise constructions already described above and illustrated in the figures, and various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

[0123] It should be noted that in this text, terms concerning relationships such as "first" and "second," and the like, are used merely to distinguish one entity or operation from another, while no such actual relationship or sequence between those entities or operations is required or implied. The terms "comprise," "include," or any other variation are intended to cover non-exclusive inclusion, such that a process, procedure, article, or device comprising a series of elements may include not only those elements but also other elements not clearly listed, or elements inherent in such a process, procedure, article, or device. Unless further limitations are to be imposed, the term "comprises a...' does not exclude the possibility that other identical elements may be present in the process, procedure, article or device incorporating the specified element.

[0124] The methods and apparatus provided by the embodiments of the present invention are presented in detail above. Specific examples are used throughout to explain the principles and embodiments of the present invention. The explanation of the above embodiments is provided solely to facilitate understanding of the methods and core concepts of the present invention. However, those of ordinary skill in the art may make modifications for specific embodiments and applications based on the concepts of the present invention. In summary, the contents of the description should be understood as limiting the present invention.

Claims

[1] An image processing method applied to an image coding apparatus, comprising: Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels that any original pixel point contains are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1; Generating mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points are determined according to a pixel position mapping relationship in the original color image, which correspond one-to-one to N mixed subpixels contained in the any mixed pixel point, and color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels; in the event that the generation of a mixed image assigned to any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model in order to generate and display a monochrome image assigned to any primary color by the field-sequential display device based on the mixed image. [2] The method of claim 1, wherein determining N original pixel points corresponding one-to-one to N mixed subpixels contained in any mixed pixel point according to the pixel position mapping relationship in the original color image comprises: Determining a coding scaling coefficient depending on a first size of the original color image and a second size of the blended image, and determining a second position at which the arbitrary blended pixel point is located in the blended image; depending on the coding scaling coefficient, determining a first position in the original color image corresponding to the second position, and determining a one-to-one mapping of N original pixel points at the first position and N mixed subpixels contained in the arbitrary mixed pixel point. [3] The method of claim 2, wherein the image coding device is a graphics processor GPU, the method further comprising: Normalize the values ​​of the first quantity and the second quantity, where the first position and the second position are represented by normalized coordinate values. [4] The method of claim 2, further comprising: Adding an offset to the coordinate value of the second position so that the offset second position is within the original pixel point. [5] The method of claim 1, wherein the N original pixel points in the original color image that correspond one-to-one to the N mixed subpixels are continuously adjacent. [6] The method of claim 1, wherein the color model is an RGB model, where N = 3. [7] The method of claim 1, wherein the original color image is a video frame image belonging to any video. [8] An image processing method applied to a field sequential display device, the method comprising: in the case of receiving a mixed image sent according to an image transmission rule corresponding to a color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is assigned to an arbitrary primary color of the color model, wherein a color value of any mixed pixel point comprises color components of N mixed subpixels that the arbitrary mixed pixel point contains with respect to the arbitrary primary color, where N is a positive integer greater than 1; Generating a monochrome image associated with the arbitrary primary color depending on the color values ​​of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, N monochrome pixel points that correspond one-to-one to the N mixed subpixels are determined according to a pixel position mapping relationship in the monochrome image, and the color components of the N mixed subpixels with respect to the arbitrary primary color are each used as color values ​​of the corresponding monochrome pixel points; Displaying the monochrome image by controlling a display component of the field sequential display device. [9] The method of claim 8, wherein determining N monochrome pixel points corresponding one-to-one to the N mixed subpixels according to the pixel position mapping relationship in the monochrome image comprises: Determining a decoding scaling coefficient as a function of a third size of the monochrome image and a second size of the mixed image, and determining a second position at which the arbitrary blended pixel point is located in the blended image; depending on the decoding scaling coefficient, determining a third position in the monochrome image corresponding to the second position, and Determining a one-to-one mapping of N monochrome pixel points at the third position and N mixed subpixels contained in the arbitrary mixed pixel point. [10] An image processing apparatus applied to an image coding apparatus comprising one or more processors, the processor(s) being configured to: Determining color values ​​of individual original pixel points in an original color image, wherein N original subpixels that any original pixel point contains are each assigned to different primary colors of a color model, wherein a color value of any original pixel point comprises color components of the N original subpixels with respect to the corresponding primary color, where N is a positive integer greater than 1; Generating mixed images each assigned to N primary colors depending on the color values ​​of the individual original pixel points, wherein for any mixed pixel point in a mixed image assigned to any primary color, N original pixel points are determined according to a pixel position mapping relationship in the original color image, which correspond one-to-one to N mixed subpixels contained in the any mixed pixel point, and the color components of the color values ​​of the N original pixel points with respect to the any primary color are each used as color components of the corresponding mixed subpixels; in the event that the generation of a mixed image assigned to any primary color is completed, sending the mixed image to a field-sequential display device according to an image transmission rule corresponding to the color model in order to generate and display a monochrome image assigned to any primary color by the field-sequential display device based on the mixed image. [11] An image processing apparatus applied to a field sequential display device comprising one or more processors, the processor(s) being configured to: in the case of receiving a mixed image sent according to an image transmission rule corresponding to a color model, determining color values ​​of individual mixed pixel points in the mixed image, wherein the mixed image is assigned to an arbitrary primary color of the color model, wherein a color value of any mixed pixel point comprises color components of N mixed subpixels that the arbitrary mixed pixel point contains with respect to the arbitrary primary color, where N is a positive integer greater than 1; Generating a monochrome image assigned to the arbitrary primary color depending on the color values ​​of the individual mixed pixel points, wherein for N mixed subpixels that the arbitrary mixed pixel point contains, according to a pixel position mapping relationship in the monochrome image, N monochrome pixel points correspond one-to-one to the N mixed subpixels, are determined, and the color components of the N mixed subpixels with respect to the arbitrary primary color are each used as color values ​​of the corresponding monochrome pixel points; Displaying the monochrome image by controlling a display component of the field sequential display device. [12] Electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the method according to any one of claims 1-7 or 8-9. [13] Non-transient computer-readable storage medium on which a computer program is stored, characterized by that when the program is executed by a processor, steps of the method according to one of claims 1-7 or 8-9 are carried out.

Images