Image display method, device and computer-readable storage medium of a display device

Abstract

The present application provides an image display method, a display device, and a computer-readable storage medium for a display device. The method includes: obtaining a first image with a first resolution; classifying the pixels in the first image according to odd and even rows and columns; using the pixel gaps to perform image downsampling on the first image based on each type of pixel in the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device; displaying the plurality of second images in sequence and offset from each other to obtain an image with an enhanced visible display resolution. In the process of performing image downsampling on the first image, the important factor of the pixel gaps of the display device is introduced in the image display method provided by the present application, making the presented image clearer, thereby improving the display ability of the display device.

Description

Technical Field

[0001] The present invention relates to the field of display technologies, and particularly to an image display method, a device, and a computer-readable storage medium for a display device. Background Art

[0002] Conventional systems or devices for displaying images (such as monitors, projectors, or other imaging systems) generate the displayed image by addressing an array of individual picture elements or pixels arranged in horizontal rows and vertical columns. The resolution of the displayed image is defined as the number of horizontal rows and vertical columns of individual pixels used to form the displayed image. The resolution of the displayed image is affected by the resolution of the display device itself and the resolution of the image data, which is processed by the display device and used to generate the displayed image.

[0003] Typically, in order to increase the resolution of the displayed image, it is necessary to increase the resolution of the display device and the resolution of the image data used to generate the displayed image. However, increasing the resolution of the display device increases the cost and complexity of the display device. Additionally, it may not be possible to obtain and / or it may be difficult to generate higher-resolution image data. Summary of the Invention

[0004] Embodiments of the present invention provide an image display method, a device, and a computer-readable storage medium for a display device to solve the problems of poor display effect and blurred displayed image in existing image display methods.

[0005] To solve the above technical problems, the present invention provides an image display method for a display device, where there is a set-size pixel gap between pixels of the display device. The method includes: obtaining a first image with a first resolution; classifying the pixels in the first image according to odd and even rows and columns; using the pixel gap of the display device, based on each type of pixel in the first image, performing image downsampling on the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device; displaying the plurality of second images in sequence and offset from each other to obtain an image with an enhanced visible display resolution.

[0006] Among them, using the pixel gap, based on each type of pixel in the first image, performing image downsampling on the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device includes:

[0007] Using the pixel gap, establishing a system of equations based on the gray contribution values of the second image pixels and other pixels in their surrounding 3*3 neighborhood to the corresponding pixels of the first image, and then determining the pixel gray information of the second image.

[0008] Among them, an equation set is established according to the following formula, and then the pixel gray-scale information of the second image is obtained:

[0009]

[0010] Among them, N and M respectively represent the number of rows and columns of the second image, L0(x, y) represents the normalized gray-scale value of the pixel (x, y) of the second image, L(x, y) is the normalized gray-scale value of the pixel (x, y) of the first image, and L0(-1 + x, y), L0(x, y - 1), L0(x, y + 1), L0(x + 1, y), L0(x - 1, y - 1), L0(x - 1, y + 1), L0(x + 1, y - 1), L0(x + 1, y + 1) respectively represent the normalized gray-scale values of the pixels (-1 + x, y), (x, y - 1), (x, y + 1), (x + 1, y), (x - 1, y - 1), (x - 1, y + 1), (x + 1, y - 1), (x + 1, y + 1) of the second image, and a represents the pixel size of the display device, which is the ratio of the total size of the pixel and the pixel gap.

[0011] Among them, the successive over-relaxation iteration method is used to obtain the pixel gray-scale information of the second image.

[0012] Among them, classifying the pixels in the first image according to odd and even rows and columns includes:

[0013] The pixels located in the odd rows and odd columns of the first image are classified into one category.

[0014] The pixels located in the odd rows and even columns of the first image are classified into one category.

[0015] The pixels located in the even rows and odd columns of the first image are classified into one category.

[0016] The pixels located in the even rows and even columns of the first image are classified into one category.

[0017] Among them, the first image is the first RGB image, and the second image is the second RGB image.

[0018] Using the pixel gap, image downsampling is performed on the first image based on each category of pixels in the first image to obtain multiple different second images with the second resolution, where the second resolution is consistent with the resolution of the display device, including:

[0019] For the first gray-scale image corresponding to the three channels of the first RGB image with the first resolution, the pixel gap is respectively used, and image downsampling is performed on the first gray-scale image based on each category of pixels in the first gray-scale image to respectively obtain multiple different second gray-scale images corresponding to the three channels.

[0020] Superimpose the second grayscale images corresponding to the three channels to obtain a second RGB image.

[0021] Among them, displaying multiple second images in sequence and offset from each other to obtain an image with enhanced visible display resolution includes:

[0022] Each second image is translated by 1 / 2 pixel unit in a set direction relative to its previous-frame second image.

[0023] To solve the above technical problems, the present invention also provides a display device, which includes a processor, a display device memory connected to the processor, and a display module.

[0024] Among them, the display module is used to display images, program data is stored in the memory, and the processor is used to execute the program data to implement the steps of the above image display method.

[0025] To solve the above technical problems, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above image display method are implemented.

[0026] Through the above solution, the beneficial effect of the present invention is that: in the process of downsampling the first image in the present application, an important factor of the pixel gap of the display device is introduced, so that the obtained second image can better adapt to the pixel gap of the display device, and can prevent problems such as pixel crosstalk when the display device offsets and displays multiple second images, making the presented image clearer, thereby improving the display ability of the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained according to these drawings, where:

[0028] Figure 1 It is a schematic flowchart of an embodiment of the image display method for a display device provided by the present application;

[0029] Figure 2 It is a comparison diagram of the display image effects obtained by using different display image methods respectively;

[0030] Figure 3 It is a schematic structural diagram of an embodiment of the display device provided by the present application;

[0031] Figure 4It is a schematic structural diagram of an embodiment of the computer-readable storage medium provided by this application. Specific Embodiments

[0032] Next, the technical solutions in the embodiments of this application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0033] In the field of image display, the resolution of currently used display devices such as projectors is very limited. When the resolution of the image to be displayed is greater than the resolution of the display device, it is usually necessary to reduce the number of pixels of the image to be displayed to match the resolution of the display device. If the image to be displayed with the reduced number of pixels is directly displayed, it will cause adverse effects such as loss of details in the final displayed image and blurred image. Therefore, it is necessary to increase the visible display resolution of the display device. A typical model for enhancing the resolution of a display device is: decomposing the high-resolution image to be displayed into multiple lower-resolution images, and then displaying these low-resolution images with different offsets and a higher frame rate (such as when playing a video). The principle of this model is: giving full play to the characteristics of the visual persistence of the human eye, trading time for space, and accomplishing things that cannot be accomplished by structure and technology. That is, without increasing the physical resolution of the display device, using the characteristics of the visual persistence of the human eye to improve the visible resolution of the final displayed image. The algorithm for processing and splitting the image to be displayed is the key to the above technology. Different splitting methods will result in completely different display effects. The previously common differential algorithms include: direct frame splitting method, weighted average method, and internal sampling method. However, the above three splitting algorithms may cause the image finally displayed by the display device to be blurred, and the display effect needs to be improved.

[0034] The display device mentioned in this embodiment can be a display connected to a computer host, can be various electronic products with display functions such as mobile phones and tablets, or can be a display system including a projection device. This embodiment does not make any restrictions here.

[0035] Refer to Figure 1 , Figure 1 It is a schematic flowchart of an embodiment of the image display method of the display device provided by this application. It includes the following steps:

[0036] S10: Obtain a first image with a first resolution.

[0037] The first image can be any image to be displayed with a resolution higher than that of the display device. The first image is defined to include any drawing, graphic, and / or text characters, symbols, illustrations, and / or other information representations. The image can be a still image, a series of images, or a video. The term "image" will be used herein and in the claims to refer to a still image, a series of images, a video, or any other image displayed by the display system, unless otherwise specifically stated. The acquisition method can be, for example, downloading from the Internet, receiving from other devices, and so on.

[0038] S20: Classify the pixels in the first image according to odd and even rows and columns.

[0039] Specifically, in order to extract different information in the first image so that when performing image downsampling on the first image subsequently, it can be carried out for different pixel information of the first image, first, a classification operation is performed on the pixels in the first image. Classifying according to odd and even rows and columns means that the pixels in the odd rows and even rows of the first image are respectively divided into different categories and / or the pixels in the odd columns and even columns of the first image are respectively divided into different categories.

[0040] In a specific embodiment, the first image is divided into two categories. Specifically, the pixels located in the odd rows of the first image are divided into one category, and the pixels located in the even rows of the first image are divided into another category. Or the pixels located in the odd columns of the first image are divided into one category, and the pixels located in the even columns of the first image are divided into another category.

[0041] In another specific embodiment, the first image is divided into four categories. Specifically, the pixels located in the odd rows and odd columns of the first image are divided into one category, the pixels located in the odd rows and even columns of the first image are divided into one category, the pixels located in the even rows and odd columns of the first image are divided into one category, and the pixels located in the even rows and even columns of the first image are divided into one category.

[0042] S30: Use the pixel gap to perform image downsampling on the first image based on each category of pixels in the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device.

[0043] In one form of the present application, the second image has a lower resolution than the first image. Thus, the second image is also referred to as a low-resolution image herein, and the first image is also referred to as a high-resolution image herein. Those of ordinary skill in the art should understand that the terms low resolution and high resolution are used here in a comparative manner and are not limited to any specific minimum or maximum number of pixels.

[0044] First, according to the classification results of the pixels of the first image in step S20, downsampling of the first image is performed to obtain multiple different second images. That is to say, the downsampling operation of the first image in this embodiment is based on different pixel information of the first image, so that the obtained second images correspond one by one to each type of pixel of the first image, and all the second images combined can reflect all the pixel information of the first image, that is, it will not cause a large-scale loss of pixel details of the first image.

[0045] In addition, due to technical limitations, the pixels of current display devices are not densely arranged, but there are gaps of a certain size. In this application, the area ratio of the size of the pixel to the total size of the pixel and the gap is called the filling rate. In order to display an image with a higher spatial resolution (such as high-frequency stripes, etc.), the display device of this embodiment utilizes the high-frequency information at the pixel gaps to improve the high-frequency information in the finally displayed high-resolution image. That is, when performing the downsampling operation on the first image, the pixel gaps are taken into account, so that the obtained second images can adapt to the pixel gaps of the display device, and can prevent problems such as pixel crosstalk when the display device offsets and displays multiple second images, making the presented image clearer.

[0046] Specifically, step S30 can utilize the pixel gaps to establish an equation set based on the gray contribution values of the pixels of the second image and other pixels within the 3*3 neighborhood around them to the corresponding pixels of the first image, and then determine the pixel gray information of the second image. That is, an equation set is established according to the following formula, and then the pixel gray information of the second image is obtained:

[0047]

[0048] where x = 1,..., N, y = 1,..., M, N and M respectively represent the number of rows and columns of the second image, L0(x, y) represents the normalized gray value of the pixel (x, y) of the second image, L(x, y) is the normalized gray value of the pixel (x, y) of the first image, L0(-1 + x, y), L0(x, y - 1), L0(x, y + 1), L0(x + 1, y)

[0049] , L0(x - 1, y - 1), L0(x - 1, y + 1), L0(x + 1, y - 1), L0(x + 1, y + 1) respectively represent the normalized gray values of the pixels (-1 + x, y), (x, y - 1), (x, y + 1), (x + 1, y), (x - 1, y - 1), (x - 1, y + 1), (x + 1, y - 1), (x + 1, y + 1) of the second image, and a represents the ratio of the pixel size of the display device to the total size of the pixel and the pixel gap.

[0050] Among them, when a = 1 / 2, the display effect of the first image is the best.

[0051] Optionally, the Gauss - Seidel iteration method is used for solving, and the successive over - relaxation method is applied to accelerate to obtain the pixel gray - level information of the third image.

[0052] The Gauss - Seidel iteration method is one of the common iteration methods for solving linear equations. Generally speaking, the Jacobi iteration method converges too slowly and is rarely used in practice. In the case where the Jacobi iteration method converges very slowly, the Gauss - Seidel iteration method is not significantly faster either. Therefore, to improve the convergence speed, the successive over - relaxation iteration method is obtained by weighted average. Let the linear equation system be:

[0053] a i1 x 1 +a i2 x 2 +…+a in x n =b i (i = 1, 2, …, n)

[0054] The iteration formula of the successive over - relaxation iteration method is:

[0055]

[0056]

[0057] Here it is assumed that a ii ≠0 i (i = 1, 2, …, n). In many cases, it converges faster than the simple iteration method. The difference between it and the simple iteration method lies in that when calculating , it uses the value of that has just been iterated. When the coefficient matrix is strictly diagonally dominant or symmetric positive definite, the Gauss - Seidel iteration method is sure to converge.

[0058] In addition, a middle quantity and an acceleration - convergence parameter ω (restricted to real numbers) are introduced here. This parameter represents the relaxation factor and indicates that can be regarded as and 's weighted average.

[0059] In addition, since the display device cannot exceed its maximum display brightness, the independent variable L0(x, y) of the above - mentioned equation system needs to be greater than 0 and less than 1, and this condition needs to be added to each iteration solution.

[0060] Obviously, there are two adjustable parameters in this algorithm: the relaxation parameter ω and the number of iterations K.

[0061] The relaxation parameter ω affects the convergence speed and the quality of the image. Its typical value ranges from 0.9 to 1.4. A smaller ω value represents a relatively conservative strategy, where the convergence speed and display effect may be negatively affected, but the robustness and adaptability of the system will be enhanced. Conversely, a larger ω value can accelerate the convergence speed of the system, but the robustness and adaptability of the system may decrease.

[0062] For the selection of the number of iterations K, it is necessary to comprehensively consider the convergence speed, the final required expressiveness, the display latency, and the computing power of the system. Generally speaking, K = 1 can achieve a good display effect. If there are sufficient computing resources, a larger K value can be selected, such as K = 2 to 5, which can further improve the display effect and robustness of the system.

[0063] If the first image is the first RGB image and the second image is the second RGB image.

[0064] Then, for the first grayscale image corresponding to the three channels of the first RGB image with the first resolution, the first grayscale image is respectively downsampled based on each type of pixel in the first grayscale image to obtain multiple different second grayscale images corresponding to the three channels respectively.

[0065] The second grayscale images corresponding to the three channels are superimposed to obtain the second RGB image.

[0066] S40: Display multiple second images in sequence and offset from each other to obtain an image with enhanced visible display resolution.

[0067] Optionally, when the display device displays the second image, the display position of each second image is offset by a non-integer number of pixel units relative to the display position of the previous frame of the second image, preferably by a distance of half a pixel.

[0068] For example, the display device splits the first image to be displayed into four sub-frames. When displaying, the second sub-frame is translated half a pixel unit to the right relative to the first sub-frame, the third sub-frame is translated half a pixel unit down relative to the second sub-frame, and the fourth sub-frame is translated half a pixel unit up relative to the third sub-frame to obtain the final image with enhanced visible display resolution.

[0069] Refer to Figure 2 , Figure 2 is a comparison chart of the display image effects obtained by using different display image methods respectively. Among them, the fill rate of the display device is a = 0.9, K = 1, and ω = 1.25. The first column of each row is the first image to be displayed, that is, the original image. The second column of each row is the image directly downsampled to 1 / 2 pixel of the first image. The third column of each row is the image with enhanced visible display resolution obtained by the image display method provided in this application.

[0070] From Figure 2 It can be seen that the resolution of the image with enhanced visible display resolution obtained by using the image display method provided in this application is much higher than that of the image obtained by directly downsampling the first image. Moreover, the difference in resolution between the image with enhanced visible display resolution and the first image, i.e., the original image, is relatively small. Therefore, the image display method provided in this application can significantly improve the visible resolution of the image.

[0071] In the process of downsampling the first image in this embodiment, an important factor of the pixel gap of the display device is introduced, so that the obtained second image can better adapt to the pixel gap of the display device, and problems such as pixel crosstalk that occur when the display device offsets and displays multiple second images can be prevented, making the presented image clearer, thereby improving the display ability of the display device.

[0072] Refer to Figure 3 , Figure 3 FIG. is a schematic structural diagram of an embodiment of a display device provided in this application. The display device 100 includes a processor 120, a display device memory 130 connected to the processor 120, and a display module 110. Among them, the display module 110 is used to display images, the display device memory 130 stores program data, and the processor 120 is used to execute the program data to implement the steps of the above image display method. For example, the display device 100 is specifically a projector.

[0073] In a specific embodiment, the display module 110 receives the second image and sequentially displays the second image to obtain an image with enhanced visible display resolution. More specifically, since each second image is spatially offset from each other, the display module 110 displays the second image at different positions according to the spatial offset of the second image. In this way, when the display module 110 displays the second image corresponding to the first image, they are offset from each other both spatially and temporally, thereby creating an image with enhanced visible display resolution. In one embodiment, the display module 110 optically manipulates the second image to create an image with enhanced visible display resolution.

[0074] Refer to Figure 4 , Figure 4 FIG. is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in this application. A computer program 201 is stored on the computer-readable storage medium 200, and when the computer program 201 is executed by a processor, it implements the steps of the above image display method.

[0075] The computer storage medium 200 can be any available medium or data storage device accessible by a computer, including but not limited to magnetic memories (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical memories (such as CDs, DVDs, BDs, HVDs, etc.), and semiconductor memories (such as ROM, EPROM, EEPROM, non-volatile memory 110 (NANDFLASH), solid state drives (SSD)), etc.

[0076] The image display method provided by this application first classifies the first image, and then uses the pixel gap to perform image downsampling on the first image according to the classification result, so as to obtain multiple different second images. Finally, the multiple second images are displayed in sequence and offset from each other to obtain an image with enhanced visible display resolution. During the process of image downsampling of the first image, the important factor of the pixel gap of the display device is introduced, so that the obtained second images can better adapt to the pixel gap of the display device, and can prevent problems such as pixel crosstalk when the display device offsets and displays multiple second images, making the presented image clearer, thereby improving the display ability of the display device.

[0077] As described above, only the specific implementation manners in this application are described, but the protection scope of this application is not limited thereto. Any transformation or replacement that can be understood and conceived by those familiar with the technology within the technical scope disclosed in this application should be covered within the inclusion scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

1. An image display method for a display device, where there is a pixel gap with a set size between pixels of the display device, Characterized in that, The method includes: Obtaining a first image with a first resolution; Classifying the pixels in the first image according to odd and even rows and columns; Utilizing the pixel gap, and based on each type of pixel in the first image, performing image downsampling on the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device; Displaying the plurality of second images in sequence and offset from each other to obtain an image with an enhanced visible display resolution; The step of utilizing the pixel gap, and based on each type of pixel in the first image, performing image downsampling on the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device includes: Utilizing the pixel gap, establishing a system of equations based on the gray contribution values of the corresponding pixels in the first image by the pixels of the second image and other pixels within the 3*3 neighborhood around them, and then determining the pixel gray information of the second image.

2. The method according to claim 1, Characterized in that, Establishing the system of equations according to the following formula, and then obtaining the pixel gray information of the second image: ， x = 1,..., N, y = 1,..., M; where N and M respectively represent the number of rows and columns of the second image, represent the pixels of the second image of the normalized gray value, is the pixel of the first image of the normalized gray value, respectively represent the pixels of the second image of the normalized gray value, a = pixel size of display device / (pixel size of display device + pixel gap size).

3. The method according to claim 2, Characterized in that: Using the successive over-relaxation iteration method to obtain the pixel gray information of the second image.

4. The method according to claim 1, Characterized in that, The step of classifying the pixels in the first image according to odd and even rows and columns includes: Dividing the pixels located in the odd rows and odd columns of the first image into one category; Dividing the pixels located in the odd rows and even columns of the first image into one category; Dividing the pixels located in the even rows and odd columns of the first image into one category; Dividing the pixels located in the even rows and even columns of the first image into one category.

5. The method according to claim 1, Characterized in that, The first image is a first RGB image, and the second image is a second RGB image; The step of utilizing the pixel gap, and based on each type of pixel in the first image, performing image downsampling on the first image to obtain a plurality of different second images with a second resolution, where the second resolution is consistent with the resolution of the display device, includes: For the first gray images corresponding to the three channels of the first RGB image with the first resolution, respectively utilizing the pixel gap, and based on each type of pixel in the first gray image, performing image downsampling on the first gray image to respectively obtain a plurality of different second gray images corresponding to the three channels; Overlaying the second gray images corresponding to the three channels to obtain the second RGB image.

6. The method according to claim 1, Characterized in that, The step of displaying the plurality of second images in sequence and offset from each other to obtain an image with an enhanced visible display resolution includes: Each of the second images is translated by 1 / 2 pixel unit in a set direction relative to its previous-frame second image.

7. A display device, characterized in that the display device includes a processor, a display device memory connected to the processor, and a display module; wherein, the display module is configured to display images, program data is stored in the memory, and the processor is configured to execute the program data to implement the method according to any one of claims 1-6.

8. The display device according to claim 7, characterized in that the display device is a projector.

9. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1-6 are implemented.

Images