Image splitting method and image display method

Abstract

The present invention provides an image splitting method, which is applied to a display device, wherein the display device forms a projection picture on a projection screen. The image splitting method includes the following steps: obtaining an image to be displayed, wherein the resolution of the image to be displayed is a first resolution; splitting each frame of the image to be displayed into multiple low-resolution sub-frame images with a second resolution, wherein the second resolution is smaller than the first resolution, and calculating the pixel grayscale value of each low-resolution sub-frame image based on the grayscale value of each image to be displayed, thereby obtaining modulation data of each low-resolution sub-frame image. The present invention also provides an image display method including the above-mentioned image splitting method.

Description

[0001] This application is based on the divisional application with application number 201910360885.9 filed on April 30, 2019, and invention name “Image Segmentation Method and Image Display Method”. Technical Field

[0002] The present invention relates to the field of display technology, and in particular to an image splitting method and an image display method. Background Art

[0003] This section is intended to provide a background or context to the detailed description of the invention that is recited in the claims. No admission is made that the description herein is prior art by virtue of its inclusion in this section.

[0004] For image display devices such as projectors, high resolution means more distinguishable details, which has always been the goal pursued in the display field. When displaying images formed by spatial light modulators such as digital micro-mirror devices (DMDs), thin-film-transistor liquid crystal displays (TFT-LCDs), or liquid crystal on silicon (LCoS), the number of pixels of the display image displayed on the screen is usually the same as the number of pixels of the spatial light modulator. The higher the resolution of the spatial light modulator, the higher the resolution of the displayed image, but the corresponding manufacturing cost and the cost of the corresponding optical machine and projection components will increase significantly.

[0005] As an alternative, even without improving the intrinsic resolution of the spatial light modulator, the high-resolution image to be displayed can be split into multiple low-resolution sub-frame images, each of which is composed of multiple low-resolution sub-frame pixels. The imaging positions of the multiple low-resolution sub-frame images are offset from each other by a non-integer number of low-resolution sub-frame pixels. The multiple low-resolution sub-frame images are superimposed to obtain the high-resolution image to be displayed (i.e., the reconstructed image), thereby significantly improving the display resolution.

[0006] There are two common algorithms for splitting a high-resolution image into multiple low-resolution sub-frames: weighted averaging and internal sampling. The core idea of ​​the weighted averaging method is to assign a weighted average of the grayscale values ​​of several adjacent high-resolution pixels (usually using the pixel area ratio as the weight) to the corresponding pixel in the low-resolution sub-frame image. The internal sampling method directly samples a high-resolution pixel from the original high-resolution signal source. In effect, the internal sampling method averages two diagonally adjacent high-resolution pixels to obtain a low-resolution sub-frame pixel.

[0007] See also Figure 1A、 Figure 1B and Figure 1C ,in Figure 1A As the original image, multiple low-resolution sub-frame images are superimposed using the internal sampling method to obtain the following Figure 1B The reconstructed image from Figure 1C It can be seen that the sharpness of the reconstructed image obtained by the internal sampling method is significantly reduced compared with the original image, and the sharp edges are filtered out. In other words, the spatial high-frequency information is selectively filtered out. The internal sampling method is essentially a spatial low-pass filtering operation, and the difference between it and the original image includes the high-frequency edge part.

[0008] See also Figure 1D and Figure 1E , Figure 1D is based on Figure 1A The original image shown is a reconstructed image obtained by weighted averaging. Since each low-resolution subframe pixel in the weighted averaging method is the average result of the four adjacent high-resolution pixels at the corresponding pixel position, it is also a spatial low-pass filtering. Figure 1E It can be seen that the difference between the reconstructed image obtained by the weighted average method and the original image is also the sharp change of high-frequency edge information. Summary of the Invention

[0009] The present invention provides an image splitting method and an image display method, which are applied to a display device, wherein the display device forms a projection image on a projection screen. The image splitting method comprises the following steps:

[0010] Obtaining an image to be displayed, where the resolution of the image to be displayed is a first resolution;

[0011] Each frame of the image to be displayed is split into multiple low-resolution sub-frame images with a second resolution, where the first resolution is twice the second resolution. The pixel grayscale value of each pixel to be displayed and the display time duty cycle of the multiple low-resolution sub-frame images are calculated to obtain the pixel grayscale value of each low-resolution sub-frame image, thereby obtaining the modulation data of each low-resolution sub-frame image.

[0012] An image display method includes the steps of the image splitting method described above. After obtaining the modulation data of each low-resolution sub-frame image, the image display method further includes the following steps:

[0013] In the display period of each frame of the image to be displayed, the image light of the multiple low-resolution sub-frame images is emitted to the projection screen in a timing manner according to the modulation data of each low-resolution sub-frame image, the row directions of the multiple low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images in the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / n low-resolution sub-frame pixels in the row direction and / or column direction, where n>1.

[0014] An image display method, comprising the steps of the image splitting method described above,

[0015] The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having the second resolution is specifically as follows:

[0016] Splitting each frame of the image to be displayed into four low-resolution sub-frame images with a second resolution;

[0017] After obtaining the modulation data of each low-resolution subframe image, the image display method further includes the following steps:

[0018] During the display period of each frame of the image to be displayed, the image light of the multiple low-resolution sub-frame images is emitted to the projection screen in a timing manner according to the modulation data of each low-resolution sub-frame image, the row directions of the multiple low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images among the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / 2 of a low-resolution sub-frame pixel in the row direction and / or column direction.

[0019] An image display method, comprising the steps of the image splitting method described above,

[0020] The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having the second resolution is specifically as follows:

[0021] Splitting each frame of the image to be displayed into two low-resolution sub-frame images with a second resolution;

[0022] After obtaining the modulation data of each low-resolution subframe image, the image display method further includes the following steps:

[0023] In the display period of each frame of the image to be displayed, the image light of the two low-resolution sub-frame images is emitted to the projection screen according to the modulation data timing of each low-resolution sub-frame image, the row directions of the two low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images in the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / 2 of the low-resolution sub-frame pixel in the row direction and the column direction.

[0024] The method of the present invention for calculating the modulation data of a low-resolution sub-frame image obtained by calculating the pixel grayscale value of each pixel to be displayed can better reproduce the high-resolution image to be displayed. The reconstructed image obtained by superimposing multiple low-resolution sub-frame images is less different from the original image, and can effectively avoid the high-frequency filtering phenomenon generated during the image splitting and reorganization process. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments / methods of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments / methods. Obviously, the drawings described below are some embodiments / methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0026] Figure 1A This is the original image.

[0027] Figure 1B is the reconstructed image obtained using the internal sampling method.

[0028] Figure 1C for Figure 1A and Figure 1B The difference between corresponding pixels in .

[0029] Figure 1D is the reconstructed image obtained using the weighted average method.

[0030] Figure 1E for Figure 1A and Figure 1D The difference between corresponding pixels in .

[0031] Figure 2A Schematic diagram of the corresponding relationship between four adjacent pixels to be displayed and the corresponding first low-resolution sub-frame pixels in the first embodiment of the present invention.

[0032] Figure 2B for Figure 2A Schematic diagram of the corresponding relationship between four adjacent pixels to be displayed and the corresponding low-resolution sub-frame pixels.

[0033] Figure 3A This is the first low-resolution sub-frame image in this embodiment.

[0034] Figure 3B This is the second low-resolution sub-frame image in this embodiment.

[0035] Figure 3C This is the third low-resolution sub-frame image in this embodiment.

[0036] Figure 3DThis is the fourth low-resolution sub-frame image in this embodiment.

[0037] Figure 4 A schematic diagram of the structure of the display device.

[0038] Figure 5A This is the original image.

[0039] Figure 5B To utilize Figures 3A-3D The reconstructed image obtained.

[0040] Figure 5C for Figure 5A and Figure 5B The difference between corresponding pixels in .

[0041] Figure 6A Schematic diagram of the corresponding relationship between four adjacent pixels to be displayed and the corresponding first low-resolution sub-frame pixels in the second embodiment.

[0042] Figure 6B for Figure 6A Schematic diagram of the corresponding relationship between four adjacent pixels to be displayed and the corresponding low-resolution sub-frame pixels.

[0043] Figure 7A For Figure 5A is the original image, which is the first low-resolution sub-frame image obtained after limiting the grayscale value in this embodiment.

[0044] Figure 7B For Figure 5A is the original image, and in this embodiment, it is a second low-resolution sub-frame image obtained after limiting the grayscale value.

[0045] Figure 7C For the general Figure 7A and Figure 7B The reconstructed image is obtained by superposition.

[0046] Figure 7D for Figure 7C The difference between the original image.

[0047] Figure 8A This is the original image.

[0048] Figure 8B It is a first low-resolution sub-frame image obtained by using the grayscale values ​​of the pixels to be displayed at the diagonal positions and the non-diagonal positions in this embodiment.

[0049] Figure 8C This is a second low-resolution sub-frame image obtained by using the grayscale values ​​of the pixels to be displayed at the diagonal positions and the non-diagonal positions in this embodiment.

[0050] Figure 8D Based on Figure 8B and Figure 8C And the reconstructed image obtained by the image segmentation method and image display method provided in this embodiment.

[0051] Figure 8E 8A and Figure 8D difference.

[0052] The following specific embodiments will further illustrate the present invention in conjunction with the above-mentioned drawings. DETAILED DESCRIPTION

[0053] In order to more clearly understand the above-mentioned objects, features and advantages of the present invention, the present invention is described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that, in the absence of conflict, the embodiments of the present application and the features therein may be combined with each other.

[0054] The following description sets forth numerous specific details to facilitate a thorough understanding of the present invention. The embodiments described are merely a portion of the embodiments of the present invention, not all of them. All other embodiments derived by persons of ordinary skill in the art based on the embodiments of the present invention without inventive effort are intended to fall within the scope of protection of the present invention.

[0055] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention.

[0056] The present invention provides an image splitting method and an image display method including the image splitting method, which are applied to a display device. Image light emitted by the display device forms a projection picture on a projection screen. The image splitting method provided by the present invention is used to improve the resolution of the display device. It can promote the spatial light modulation device to break through the limitation of the research and development cycle and achieve resolution improvement during the image display process. When a high-resolution spatial light modulation device cannot be purchased due to funding constraints, the method provided by the present invention can be used to split each frame of the display image into multiple low-resolution sub-frame images, and then the multiple low-resolution sub-frame images are superimposed to obtain a high-resolution image to be displayed. This method is conducive to improving the resolution of the display device, will greatly promote the development of the projection industry, and will bring huge economic benefits.

[0057] Implementation Method

[0058] The display device emits image light based on original image data of an image to be displayed (such as a video source) and forms multiple frames of projection images that are continuously displayed on a projection screen. The present invention takes a method for splitting and displaying one frame of an image to be displayed from the multiple frames of projection images as an example. Specifically, the image splitting method provided by the present invention includes the following steps:

[0059] S101: Obtain an image to be displayed, where the image to be displayed includes a plurality of pixels to be displayed in a pixel distribution, and a resolution of the image to be displayed is a first resolution.

[0060] See also Figure 2A The image to be displayed is composed of pixels to be displayed that are distributed in a pixel distribution. Generally, multiple pixels to be displayed are arranged in a rectangular shape along the row direction and the column direction. Different pixels to be displayed are distinguished by addresses. For example, if the image to be displayed is a standard 4K format image, the first resolution is 4096*2160. The row address of each pixel is represented by m, and the column address is represented by n. The pixel address is (m, n), where m and n are both integers, and 0≤m<4096, 0≤n<2160.

[0061] In addition, the original image data of the image to be displayed includes the grayscale values ​​of various primary colors of each pixel to be displayed. Generally, the grayscale values ​​of various primary colors of the original image data are in RGB format and include the grayscale values ​​of the three primary colors of RGB. Taking a certain pixel to be displayed as an example, 50, 100, and 150 are the grayscale values ​​of the three primary colors of the pixel to be displayed. In the present invention, the grayscale value of the pixel to be displayed is recorded as H m，n It should be noted that the grayscale value of each pixel to be displayed can be the grayscale value of any primary color of the pixel to be displayed, or it can be a combination of grayscale values ​​of multiple primary colors of the pixel to be displayed. The addresses of four adjacent pixels to be displayed in a "field" shape can be expressed as (2i-1, 2j-1), (2i-1, 2j), (2i, 2j-1), (2i, 2j), and the grayscale values ​​of the pixels to be displayed corresponding to the above four addresses are recorded as H 2i-1，2j-1 , H 2i-1，2j , H 2i，2j-1 , H 2i，2j .

[0062] S102: Split each frame of the image to be displayed into multiple low-resolution sub-frame images with a second resolution, wherein the second resolution is smaller than the first resolution, and each of the multiple low-resolution sub-frame images includes multiple low-resolution sub-frame pixels distributed in pixels, wherein each pixel to be displayed in the image to be displayed is displayed in a display area on the projection screen, and according to the pixel grayscale value of each pixel to be displayed and the display time duty cycle of the multiple low-resolution sub-frame images obtained by splitting each pixel to be displayed, the pixel grayscale value of any low-resolution sub-frame pixel in each low-resolution sub-frame image is calculated, thereby obtaining the modulation data of each low-resolution sub-frame image.

[0063] Furthermore, the pixel grayscale value of any low-resolution sub-frame pixel in each low-resolution sub-frame image is calculated, including:

[0064] The weighted grayscale value of the corresponding low-resolution sub-frame pixel is obtained according to the pixel grayscale value of each pixel to be displayed. The pixel grayscale value of the corresponding low-resolution sub-frame pixel is calculated using the weighted grayscale value of the corresponding low-resolution sub-frame pixel and the display time duty cycle of the low-resolution sub-frame image to which the corresponding low-resolution sub-frame pixel belongs.

[0065] The weighted grayscale value of a low-resolution sub-frame pixel in the present invention can be the weighted grayscale value of a primary color of the low-resolution sub-frame pixel, or it can be a combination of the weighted grayscale values ​​of multiple primary colors of the low-resolution sub-frame pixel. The weighted grayscale value of a low-resolution sub-frame pixel is related to the grayscale value of the primary color corresponding to the low-resolution sub-frame pixel and the display time duty cycle of the low-resolution sub-frame pixel. The display time duty cycle of the low-resolution sub-frame pixel is the display time duty cycle of the low-resolution sub-frame image to which the low-resolution sub-frame pixel belongs. Specifically, the weighted grayscale value of a low-resolution sub-frame pixel in the present invention is equal to the product of the grayscale value of the primary color corresponding to the low-resolution sub-frame pixel and the display time duty cycle of the corresponding low-resolution sub-frame image.

[0066] According to the principle of conservation of luminous flux, the weighted grayscale value of the corresponding low-resolution sub-frame pixel is obtained according to the pixel grayscale value of each pixel to be displayed. Specifically, the pixel grayscale value of each pixel to be displayed is equal to the sum of the weighted grayscale values ​​of the corresponding low-resolution sub-frame pixels in multiple low-resolution sub-frame images.

[0067] Theoretically, the offset between the imaging positions of any two adjacent low-resolution subframe images can be equidistant. For example, adjacent low-resolution subframe images can be offset by 1 / n of the low-resolution subframe pixels. In this embodiment, n = 2, meaning that if the high-resolution image to be displayed is fixed, multiple low-resolution subframe images with offset imaging positions can be superimposed to achieve the same display effect as the high-resolution image. It should be understood that n does not need to be a fixed integer. A larger n means fewer low-resolution subframe pixels are required, resulting in lower costs. However, this can make image segmentation more difficult and require higher chip reliability. Another type of offset is non-equidistant offset, where adjacent low-resolution subframe images are offset by different distances.

[0068] The image segmentation method provided by the present invention calculates the pixel grayscale value of any low-resolution subframe pixel in each low-resolution subframe image based on the pixel grayscale value of each pixel to be displayed and the display time duty cycle of the multiple low-resolution subframe images, and can better reproduce the high-resolution image to be displayed. The reconstructed image obtained by superimposing multiple low-resolution subframe images is slightly different from the original image. The multiple low-resolution subframe images obtained by the image segmentation method provided by the present invention are superimposed on each other to obtain a reconstructed image, and the resolution of the reconstructed image is the same as the resolution of the image to be displayed.

[0069] In this case, the high-resolution image to be displayed is split into multiple low-resolution sub-frame images that match the resolution of the display device based on the principle of conservation of luminous flux. The second resolution can be the intrinsic resolution of the display device. The second resolution is less than the first resolution, that is, the resolution of the image to be displayed is higher than the intrinsic resolution of the display device. If the display device does not process the original image data of the image to be displayed, but directly modulates the primary color light according to the original image data of each frame of the image to be displayed and obtains a projected image, then the resolution of the projected image is the same as the intrinsic resolution of the display device, and the high resolution of the original image data is not utilized to obtain a high-definition display of the projected image, thereby limiting the wide application of the display device. It is understandable that the second resolution can also be less than the intrinsic resolution of the display device, and the resolution of the reconstructed image is equal to the first resolution.

[0070] See also Figure 2A and Figure 2B In this embodiment, the first resolution is twice the second resolution. That is, on the projection screen, each low-resolution sub-frame pixel and four adjacent pixels to be displayed, arranged in a "field" shape, are illuminated in the same display area on the projection screen. This means that the area of ​​each low-resolution sub-frame pixel is four times that of each pixel to be displayed. This embodiment uses the example of splitting each frame of image to be displayed into four low-resolution sub-frame images with the second resolution for illustration. It is understood that each frame of image to be displayed can also be split into a number other than four low-resolution sub-frame images.

[0071] Specifically, the four low-resolution sub-frame images are respectively a first low-resolution sub-frame image, a second low-resolution sub-frame image, a third low-resolution sub-frame image and a fourth low-resolution sub-frame image. The first low-resolution sub-frame image, the second low-resolution sub-frame image, the third low-resolution sub-frame image and the fourth low-resolution sub-frame image respectively include a plurality of first low-resolution sub-frame pixels, second low-resolution sub-frame pixels, third low-resolution sub-frame pixels and fourth low-resolution sub-frame pixels distributed in pixels. The four pixels to be displayed with addresses (2i-1, 2j-1), (2i-1, 2j), (2i, 2j-1), and (2i, 2j) are displayed in the first display area p on the projection screen, that is, the first display area p is used to display the pictures of the four pixels to be displayed with addresses (2i-1, 2j-1), (2i-1, 2j), (2i, 2j-1), and (2i, 2j). The first display area p is also used to receive light from the first low-resolution sub-frame pixel a, the second low-resolution sub-frame pixel b, the third low-resolution sub-frame pixel c, and the fourth low-resolution sub-frame pixel d, that is, the first low-resolution sub-frame pixel a, the second low-resolution sub-frame pixel b, the third low-resolution sub-frame pixel c, and the fourth low-resolution sub-frame pixel d are superimposed to obtain the pictures of the four pixels to be displayed with addresses (2i-1, 2j-1), (2i-1, 2j), (2i, 2j-1), and (2i, 2j). Since the superposition method of the multiple low-resolution sub-frame images obtained by splitting each frame of the image to be displayed will affect the specific image splitting method and the expression form of the grayscale value of the pixel to be displayed, the image display method used in this embodiment is described here, specifically involving the superposition method of the multiple low-resolution sub-frame images mentioned above. It is understood that within the scope of the spirit or basic characteristics of the present invention, the image splitting method provided by the present invention is also applicable to other image superposition methods. Based on the method of superposing other low-resolution sub-frame images to obtain a high-resolution image to be displayed, the grayscale value expression form of each pixel to be displayed obtained by the image splitting method provided by the present invention will be different.

[0072] In this embodiment, the image display method includes the steps of the above-described image segmentation method. After calculating the modulation data for each low-resolution sub-frame image, during the display period of each frame of the image to be displayed, the image light of the multiple low-resolution sub-frame images is emitted to the projection screen in a timed manner according to the modulation data of each low-resolution sub-frame image. The rows of the multiple low-resolution sub-frame images obtained by segmenting each frame of the image to be displayed are controlled to be parallel to each other. In addition, the imaging positions of any two low-resolution sub-frame images obtained by segmenting any one frame of the image to be displayed are controlled to be offset by 1 / n low-resolution sub-frame pixels in the row and / or column directions, where n>1, thereby ensuring that the imaging positions of the multiple low-resolution sub-frame images have overlapping portions. In this embodiment, n=2. Furthermore, the emission timing of the multiple low-resolution sub-frame images can be controlled. For example, in this embodiment, the imaging positions of any two consecutively emitted low-resolution sub-frame images are controlled to be offset by 1 / n low-resolution sub-frame pixels in the row or column directions.

[0073] Specifically, the row direction and the column direction both include positive and negative directions, such as Figure 2A As shown, the row direction is the horizontal direction in the figure, the column direction is the vertical direction in the figure, the positive direction of the row is the horizontal right direction in the figure, the negative direction of the row is the horizontal left direction in the figure, the positive direction of the column is along the vertical downward direction in the figure, and the negative direction of the column is along the vertical upward direction in the figure. In this embodiment, a light modulation device is used to periodically emit a first low-resolution sub-frame image, a second low-resolution sub-frame image, a third low-resolution sub-frame image and a fourth low-resolution sub-frame image, and the imaging position of the second low-resolution sub-frame image is controlled to be offset by 1 / 2 low-resolution sub-frame pixel in the positive direction of the row direction relative to the imaging position of the first low-resolution sub-frame image; the imaging position of the third low-resolution sub-frame image is controlled to be offset by 1 / 2 low-resolution sub-frame pixel in the positive direction of the column direction relative to the imaging position of the second low-resolution sub-frame image; and the imaging position of the fourth low-resolution sub-frame image is controlled to be offset by 1 / 2 low-resolution sub-frame pixel in the negative direction of the row direction relative to the imaging position of the third low-resolution sub-frame image, that is, the imaging position of the fourth low-resolution sub-frame image is offset by 1 / 2 low-resolution sub-frame pixel in the positive direction of the row relative to the imaging position of the first low-resolution sub-frame image. In one embodiment, the numbers of low-resolution sub-frame pixels offset between continuously emitted different low-resolution sub-frame images are different. For example, the imaging position of the second low-resolution sub-frame image is controlled to be offset by 1 / 2 low-resolution sub-frame pixel in the positive direction of the row direction relative to the imaging position of the first low-resolution sub-frame image; and the imaging position of the third low-resolution sub-frame image is controlled to be offset by 1 / 4 low-resolution sub-frame pixel in the positive direction of the column direction relative to the imaging position of the second low-resolution sub-frame image.

[0074] According to the above-mentioned image display method, the image segmentation method mentioned in the present invention is further described. According to the principle of conservation of luminous flux, the weighted grayscale value of the first low-resolution sub-frame pixel, the weighted grayscale value of the second low-resolution sub-frame pixel, the weighted grayscale value of the third low-resolution sub-frame pixel, and the weighted grayscale value of the fourth low-resolution sub-frame pixel in the four low-resolution sub-frame images are calculated based on the pixel grayscale value of each pixel to be displayed. Furthermore, the pixel grayscale value of each pixel to be displayed is equal to the sum of the weighted grayscale value of the first low-resolution sub-frame pixel, the weighted grayscale value of the second low-resolution sub-frame pixel, the weighted grayscale value of the third low-resolution sub-frame pixel, and the weighted grayscale value of the fourth low-resolution sub-frame pixel projected into the first display area p in the above-mentioned four low-resolution sub-frame images. The weighted grayscale value of each low-resolution sub-frame pixel is equal to the display time duty cycle DT of the low-resolution sub-frame image to which it belongs and the pixel grayscale value L of each low-resolution sub-frame pixel. m，n The product of .

[0075] Specifically, the relationship between the grayscale value of each pixel to be displayed and the weighted grayscale value of the corresponding low-resolution sub-frame pixel satisfies formula 1-4:

[0076] H 2i-1,2j-1 = L 1 i,j DT 1 (Formula 1),

[0077] H 2i-1,2j = L 1 i,j DT 1 + L 2 i,j DT 2 (Formula 2),

[0078] H 2i,2j-1 = L 1 i,j DT 1 + L 4 i,j DT 4 (Formula 3),

[0079] H 2i,2j = L 1 i,j DT 1 +L 2 i,j DT 2 +L 3 i,j DT 3 + L 4 i,j DT 4 (Formula 4).

[0080] Among them, L k i,j represents the grayscale value of the low-resolution sub-frame pixel with address (i, j) in the k-th low-resolution sub-frame image. Specifically, L 1 i,j represents the grayscale value of the pixel at address (i, j) in the first low-resolution sub-frame image, L 2 i,j represents the grayscale value of the second low-resolution sub-frame pixel at address (i, j) in the second low-resolution sub-frame image, L 3 i,j represents the grayscale value of the pixel at address (i, j) in the third low-resolution sub-frame image, L 4 i,j Represents the grayscale value of the fourth low-resolution sub-frame pixel with address (i, j) in the fourth low-resolution sub-frame image.

[0081] DT k represents the display time duty cycle of the kth low-resolution sub-frame image. Specifically, DT 1 DT 2 DT 3 With DT 4 Respectively represent the display time duty ratios of the first low-resolution sub-frame image, the second low-resolution sub-frame image, the third low-resolution sub-frame image, and the fourth low-resolution sub-frame image. In this embodiment, the display time of each low-resolution sub-frame image is the same, so DT 1 =DT 2 =DT 3 =DT 4 = 1 / 4, in other embodiments, the display time of each low-resolution sub-frame image may be different, that is, DT 1 DT 2 DT 3 With DT 4 The data can be set to unequal proportions as needed.

[0082] L k i,j *DT k Represents the weighted grayscale value of the low-resolution sub-frame pixel with address (i, j) in the k-th low-resolution sub-frame image.

[0083] Formula 1-4 is strictly valid only when i=j=1, because when i>1 or j>1, The low-resolution sub-frame pixels corresponding to (k=2, 3, 4) will be displayed in other to-be-displayed areas adjacent to the first display area p. Therefore, the influence between adjacent low-resolution sub-frame pixels needs to be considered. The above formulas 1-4 can be generally expressed as formulas 5-8:

[0084] H 2i-1,2j-1 -L 2 i,j-1 DT 2 -L 3 i-1,j-1 DT 3 -L 4 i-1,j DT 4 = L 1 i,j DT 1 =K 2i-1,2j-1 (Formula 5),

[0085] H 2i-1,2j -L 3 i-1,j DT 3 -L 4 i-1,j DT 4 = L 1 i,j DT 1 + L 2 i,j DT 2 =K 2i-1,2j (Formula 6),

[0086] H 2i,2j-1 -L 2 i-1,j DT 2 -L 3 i,j-1 DT 3 = L 1 i,j DT 1 + L 4 i,j DT 4 =K 2i,2j-1 (Formula 7),

[0087] H 2i,2j = L 1 i,j DT 1 +L 2 i,j DT 2 +L 3 i,j DT 3 + L 4 i,j DT4 =K 2i,2j (Formula 8).

[0088] The expression of formula 1-8 is closely related to the superposition method of multiple low-resolution sub-frames. Based on the use of other image superposition / display methods, the expression of formula 1-8 will be different.

[0089] Formula 5-8 defines a correction factor corresponding to each pixel to be displayed, which is denoted as K. By limiting the range of the correction factor, the grayscale value of each low-resolution sub-frame pixel calculated is guaranteed to be within the range of 0-1. 0,0 = L 0,j = L i,0 =0 (0≤j<2048, 0≤j<1080), solve the correction factor K in turn 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 With K 2i,2j , if K 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 or K 2i,2j If any one of them is 0, then set its value to 0, thereby increasing the gray value L of the low-resolution sub-frame pixel in the low-resolution sub-frame image. i，j The probability is ≥0.

[0090] According to the correction factor (K 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 With K 2i,2j ) and the display time duty cycle DT of the first low-resolution subframe image 1 , calculate the pixel gray value L of the first low-resolution sub-frame pixel corresponding to each pixel to be displayed 1 i,j , which is helpful to solve the obtained L 2 i,j 、L 3 i,j 、L 4 i,j All are non-negative numbers.

[0091] Determine the pixel grayscale value L of the first low-resolution subframe pixel 1 i,j Is it greater than 1? If so, set the pixel grayscale value L of the first low-resolution subframe pixel 1 i,j =1. On this basis, solve L 2 i,j 、L 3 i,j With L 4i,j , and determine the pixel grayscale value L of each low-resolution subframe pixel i，j Is it greater than 1? If so, set the pixel grayscale value L of each low-resolution subframe pixel. i，j is 1. See Figures 3A-3D , the pixel grayscale value of each low-resolution sub-frame pixel in the multiple low-resolution sub-frame images obtained according to the above method is within the physical limit of [0,1].

[0092] According to the above steps, the pixel grayscale value of each low-resolution sub-frame pixel in each low-resolution sub-frame image is solved, thereby obtaining the modulation data of each low-resolution sub-frame image. The modulation data is composed of the pixel grayscale values ​​of all low-resolution sub-frame pixels constituting the corresponding low-resolution sub-frame pixel image.

[0093] During the image display process, according to the modulation data of each low-resolution sub-frame image, the first low-resolution sub-frame image, the second low-resolution sub-frame image, the third low-resolution sub-frame image and the fourth low-resolution sub-frame image are sequentially emitted to the projection screen, or the fourth low-resolution sub-frame image, the third low-resolution sub-frame image, the second low-resolution sub-frame image and the first low-resolution sub-frame image are sequentially emitted to the projection screen.

[0094] In practical applications, according to the modulation data of each low-resolution sub-frame image, a light modulation device with intrinsic resolution can be used to sequentially emit multiple low-resolution sub-frame images to a projection screen.

[0095] See also Figure 4 The display device 100 includes a light source system 101, a light modulation device 102, an optical path translation system 103, a projection optical system 104, and a projection screen 105. The light source system 101 is used to generate various primary color lights. The intrinsic resolution of the light modulation device 102 is the intrinsic resolution of the display device 100. The light modulation device 102 is used to modulate the primary color lights according to the modulation data of each low-resolution sub-frame image to obtain image light for each low-resolution sub-frame image. The optical path translation system 103 sequentially adjusts the transmission direction of the image light of each low-resolution sub-frame image so that the imaging positions of the different low-resolution sub-frame images obtained by splitting a frame of image to be displayed on the projection screen 105 maintain a preset offset. The preset offset is 1 / n of the low-resolution sub-frame pixels, such as 1 / 2 of the low-resolution sub-frame pixels in this embodiment. The projection optical system 104 is used to map the light field with a two-dimensional grayscale distribution emitted by the optical path translation system 103 onto the projection screen 105. The projection optical system 104 can be a projection lens.

[0096] According to the modulation data of each low-resolution sub-frame image obtained by the above-mentioned solution process, the primary color light is modulated by the light modulation device 102 to obtain image light of different low-resolution sub-frame images.

[0097] In one embodiment, before step S102 of the image splitting method, each frame of the image to be displayed is split into multiple primary color sub-frame images, each primary color sub-frame image includes primary color sub-frame pixels with pixel distribution, for example, each frame of the image to be displayed is split into red, green and blue primary color sub-frame images.

[0098] Based on multiple primary color subframe images obtained from an image to be displayed, each primary color subframe image is split into multiple low-resolution subframe images. Each primary color subframe pixel in each primary color subframe image and the corresponding low-resolution pixel in the split low-resolution subframe images are displayed in the same display area on the projection screen. The multiple low-resolution subframe images obtained by splitting each primary color subframe image are superimposed to produce a reconstructed image of the corresponding primary color subframe image. The pixel grayscale value of each pixel to be displayed in each image to be displayed is equal to the combination of the primary color grayscale values ​​of the corresponding primary color subframe pixels in the multiple primary color subframe images. For example, if the three primary color grayscale values ​​of a pixel to be displayed are 50, 100, and 150, then the grayscale values ​​of the corresponding primary color subframe pixels in the red, green, and blue primary color subframe images for the pixel to be displayed are 50, 100, and 150, respectively. The weighted grayscale value and grayscale value of each low-resolution sub-frame pixel in the multiple low-resolution sub-frame images are calculated based on the primary color grayscale value of each primary color sub-frame pixel in each primary color sub-frame image (according to formulas 5-8), thereby obtaining the modulation data of the multiple low-resolution sub-frame images obtained by splitting each primary color sub-frame image.

[0099] In the display device 100, the light source system 101 is configured to emit red, green, and blue primary colors, or a combination of primary colors of other colors. During the period when each primary color light is irradiated by the light modulator 102, the light modulator 102 modulates the primary colors of the same primary color based on the modulation data of the multiple low-resolution sub-frame images obtained by splitting each primary color sub-frame image to produce multiple low-resolution sub-frame images corresponding to each primary color. The light modulator 102 is controlled to time-share the low-resolution sub-frame images corresponding to the different primary color sub-frame images, that is, the light modulator 102 is controlled to emit only one low-resolution sub-frame image obtained by splitting one primary color sub-frame image at a time.

[0100] The optical path translation system 103 is used to sequentially adjust the transmission direction of the image light emitted by the light modulation device 102, and guide the image light of different low-resolution sub-frame images to be projected to different positions on the projection screen 105. For the sake of clarity, Figure 41 and 2 show two beams of image light Ray1 and Ray2 corresponding to two low-resolution sub-frame images respectively irradiating different imaging positions on the projection screen 105 . In this embodiment, the image light corresponding to the other two low-resolution sub-frame images is not shown in the figure.

[0101] To achieve mutually offset imaging positions of multiple low-resolution sub-frame images corresponding to a frame of image to be displayed on projection screen 105, multiple display devices can be used for simultaneous display, with each display device emitting a low-resolution sub-frame image corresponding to a frame of image to be displayed. Alternatively, multiple light modulators can be incorporated into the same display device for simultaneous display. In this embodiment, light modulator 102 sequentially emits multiple low-resolution sub-frame images corresponding to a frame of image to be displayed, i.e., a time-segmented method is used to sequentially display multiple low-resolution sub-frame images using the same light modulator 102 during the display cycle of a frame of image to be displayed. From a cost perspective, using the same light modulator 102 for sequential display is advantageous because there are optically cost-effective methods for shifting image pixels as a whole. These methods can be broadly categorized as mechanical, birefringent, and hybrid.

[0102] Mechanical methods often achieve this by adjusting the deflection angle of a transparent plate relative to the image light. Because the refractive index of the transparent plate (mostly made of glass) is different from that of air, light undergoes multiple refractions when passing through it, causing the image light's exit point to shift relative to its entry point. The amount of this shift is related to the plate's refractive index and deflection angle. Birefringence methods often combine polarization control with this method. When image light enters a birefringent material with a specific crystal axis orientation, light of different polarization states will shift from its exit point. This allows the position of the exiting light to be controlled by sequentially controlling the polarization direction of the polarized light entering the birefringent material. Therefore, this type of element often includes an electrically controlled polarization conversion element, which can be a nonlinear optical crystal or liquid crystal. The hybrid method utilizes a rotating transparent plate with different refractive indices, allowing image light from different low-resolution subframes to be projected onto the plates with different refractive indices, resulting in different imaging positions of the different low-resolution subframes on the projection screen 105.

[0103] In one embodiment, the light modulator 102 is disposed on a preset imaging surface within the display device 100, the preset imaging surface including a first position and a second position. During the display cycle of each frame of the image to be displayed, the light modulator 102 is controlled to be in the first position or the second position, and the light modulator 102 is controlled to modulate at least one low-resolution sub-frame image at both the first position and the second position. In other embodiments, the light modulator 102 can also be controlled to emit image light for at least one low-resolution sub-frame image at more than two different positions on the preset imaging surface. In embodiments where the position of the light modulator 102 is controlled sequentially to achieve different imaging positions for different low-resolution sub-frame images, the optical path translation system 103 can be used or omitted.

[0104] See also Figures 5A-5C As can be seen from the figure, the reconstructed image obtained by using the image splitting method and the image display method in this embodiment is slightly different from the original image. The method of modulating data of the low-resolution sub-frame image calculated based on the principle of conservation of luminous flux in the present invention can better reproduce the high-resolution image to be displayed, and can effectively avoid the high-frequency filtering phenomenon generated in the process of image splitting and reorganization.

[0105] Technically, the reconstructed image is obtained by superimposing multiple low-resolution sub-frame images with a 1 / n (where n > 1) low-resolution sub-frame pixel offset, significantly improving the resolution of the reconstructed image. Cost-effectively, simply adding a low-cost optical path translation system 103 to the original display device can significantly improve the resolution of the output image, thus offering a good cost-effectiveness.

[0106] It can be understood that in actual applications, each frame of the image to be displayed can be split into another number of multiple low-resolution sub-frame images, and the imaging positions of the multiple low-resolution sub-frame images on the projection screen can be offset from each other by a non-integer number of low-resolution sub-frame pixels other than 1 / 2.

[0107] It should be noted that the above step numbers S101 and S102 are used to distinguish the various steps and facilitate reference, and the step numbers S101 and S102 are not used to limit the order in which the steps are implemented.

[0108] Implementation Method

[0109] The main difference between the image display method provided in this embodiment and the image display method provided in the first embodiment is that "the imaging positions of any two low-resolution sub-frame images are offset by 1 / n low-resolution sub-frame pixels in the row direction and / or column direction, n>1." is replaced by "the imaging positions of any two low-resolution sub-frame images are offset by 1 / n low-resolution sub-frame pixels in the row direction and column direction, n>1."

[0110] Accordingly, in one embodiment, step S102 of the image splitting method specifically splits each frame of the image to be displayed into two low-resolution sub-frame images having a second resolution, namely a first low-resolution sub-frame image and a second low-resolution sub-frame image. The first low-resolution sub-frame image includes a plurality of first low-resolution sub-frame pixels distributed in a pixel arrangement, and the second low-resolution sub-frame image includes a plurality of second low-resolution sub-frame pixels distributed in a pixel arrangement.

[0111] See also Figure 6A-Figure 6B Since the second resolution is twice the first resolution, each first / second low-resolution subframe pixel corresponds to four adjacent pixels to be displayed in a "field" pattern. The second low-resolution subframe image is offset by a non-integer number of low-resolution subframe pixels relative to the first low-resolution subframe image along the diagonal direction of the low-resolution subframe pixels. In this embodiment, the imaging positions of the two low-resolution subframe images obtained by splitting each frame of the image to be displayed are controlled to be offset by 1 / n low-resolution subframe pixels in both the row and column directions, where n>1. This means that the second low-resolution subframe image is offset by 1 / n low-resolution subframe pixels relative to the first low-resolution subframe image along the diagonal direction of the low-resolution subframe pixels. In this embodiment, n=2. In other embodiments, the imaging positions of the multiple low-resolution subframe images obtained by splitting each frame of the image to be displayed can be controlled to be offset by a non-integer number of low-resolution subframe pixels other than 1 / 2 in both the row and column directions. This means that the second low-resolution subframe image is offset by a non-integer number of low-resolution subframe pixels other than 1 / 2 in the diagonal direction of the low-resolution subframe pixels relative to the first low-resolution subframe image. In one embodiment, the imaging position of the second low-resolution sub-frame image is offset by different numbers of low-resolution sub-frame pixels in the row direction and the column direction relative to the first low-resolution sub-frame, that is, the second low-resolution sub-frame image is offset along the non-diagonal direction of the first low-resolution sub-frame image.

[0112] According to the principle of conservation of luminous flux, the sum of the weighted grayscale value of the first low-resolution sub-frame pixel and the weighted grayscale value of the second low-resolution sub-frame pixel in the two low-resolution sub-frame images is calculated based on the pixel grayscale value of each pixel to be displayed. The weighted grayscale value of each low-resolution sub-frame pixel is equal to the display time duty cycle DT of the low-resolution sub-frame image to which it belongs and the pixel grayscale value L of the low-resolution sub-frame pixel. m，n The product of .

[0113] Specifically, the relationship between the grayscale value of each pixel to be displayed and the corresponding low-resolution sub-frame pixel satisfies formulas 9-10:

[0114] H 2i-1,2j-1 = L 1 i,j DT 1 (Formula 9),

[0115] H 2i,2j = L 1 i,j DT 1 +L 2 i,j DT 2 (Formula 10). Among them, L k i,j represents the grayscale value of the low-resolution sub-frame pixel with address (i, j) in the k-th low-resolution sub-frame image. Specifically, L 1 i,j represents the grayscale value of the pixel at address (i, j) in the first low-resolution sub-frame image, L 2 i,j Represents the grayscale value of the second low-resolution sub-frame pixel with address (i, j) in the second low-resolution sub-frame image.

[0116] DT k represents the display time duty cycle of the kth low-resolution subframe image. Specifically, DT 1 With DT 2 Respectively represent the display time duty ratios of the first low-resolution sub-frame image and the second low-resolution sub-frame image. In this embodiment, the display time of the two low-resolution sub-frame images is the same, so DT 1 =DT 2 =1 / 2. It can be understood that, in other embodiments, the display time of multiple low-resolution sub-frame images may be different, that is, the display time duty cycles of different low-resolution sub-frame images may be different.

[0117] Formula 9-10 is strictly valid only when i=j=1, because when i>1 or j>1, The low-resolution sub-frame pixels corresponding to (k=2) will be displayed in the adjacent display area of ​​the first display area p. Therefore, the influence between adjacent low-resolution sub-frame pixels needs to be considered. Formulas 9-10 can be generally expressed as Formulas 11-12.

[0118] H 2i-1,2j-1 -L 2 i-1,j-1 DT 2 = L1 i,j DT 1 =K 2i-1,2j-1 (Formula 11),

[0119] H 2i,2j = L 1 i,j DT 1 +L 2 i,j DT 2 =K 2i,2j (Formula 12).

[0120] Formula 11 and Formula 12 define the correction factor corresponding to the pixel to be displayed, which is denoted as K. Let L 0,0 = L 0,j = L i,0 =0 (0≤j<2048, 0≤j<1080), solve the correction factor K in turn 2i-1,2j-1 With K 2i,2j According to the obtained K 2i-1,2j-1 With K 2i,2j The grayscale value of each low-resolution pixel in the low-resolution sub-frame image can be calculated using formulas 11-12.

[0121] By limiting the range of the correction factor, the grayscale value of each low-resolution subframe pixel calculated is guaranteed to be within the range of 0-1, which is beneficial to improving the quality of image reconstruction. i，j Perform clipping, specifically, determine whether at least one correction factor is less than 0, and if so, set the correction factor less than 0 to 0. Specifically, if K 2i-1,2j-1 or K 2i,2j If any one of them is less than 0, then set its value to 0, thereby increasing the grayscale value L of the low-resolution sub-frame pixel in the low-resolution sub-frame image. i，j ≥0. In one embodiment, only K 2i-1,2j-1 Is it less than 0? If so, set it to 0.

[0122] In one embodiment, according to the correction factor (K 2i-1,2j-1 With K 2i,2j ) and the display time duty cycle DT of the first low-resolution subframe image 1 , calculate the pixel gray value L of the first low-resolution sub-frame pixel corresponding to each pixel to be displayed 1 i,j , which is helpful to solve the obtained L 2 i,j Is a non-negative number.

[0123] In one embodiment, the pixel grayscale value L of the first low-resolution subframe pixel can be determined 1 i,j Is it greater than 1? If so, set the pixel grayscale value L of the first low-resolution subframe pixel 1 i,j =1. On this basis, solve L according to formula 12 2 i,j , and determine the pixel grayscale value L of the second low-resolution subframe pixel 2 i,j Is it greater than 1? If so, set the pixel grayscale value L of the second low-resolution subframe pixel 2 i,j =1.

[0124] See also Figures 7A-7D , according to the above gray value solution method, we can get Figure 7A and Figure 7B The two low-resolution sub-frame images shown are Figure 7A and Figure 7B After shifting along the diagonal direction and superimposing, the reconstructed image shown in Figure 7C is obtained. Figure 7D It can be seen that the reconstructed image and the original image have obvious defects on both sides of the diagonal. The reason for the above defects is that in the above solution process, only the pixels to be displayed at the diagonal position (pixel address (i, j)) in the image to be displayed are considered. and The corresponding pixels to be displayed are actually a combination of two low-resolution sub-frame pixels. If the low-resolution sub-frame pixel values ​​are not selected appropriately, there will be a large discontinuity between the recombined pixels to be displayed, resulting in image defects. To further solve the problem of image defects, it is necessary to consider the grayscale values ​​of the high-resolution pixels in the non-diagonal positions in the image to be displayed.

[0125] Specifically, according to formulas 11-12 and the following formulas 13-14, the grayscale values ​​of the pixels to be displayed at the diagonal and non-diagonal positions are used to calculate the grayscale values ​​of the corresponding low-resolution sub-frame pixels.

[0126] H 2i-1,2j -L 2 i-1,j DT 2 = L 1 i,j DT 1 =K 2i-1,2j (Formula 13),

[0127] H 2i,2j-1 -L 2 i,j-1 DT 2 = L 1i,j DT 1 =K 2i,2j-1 (Formula 14).

[0128] According to formula 11-14, the correction factors K corresponding to the pixels to be displayed at the diagonal position and the non-diagonal position are respectively 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 Specifically, the correction factor K corresponding to the pixels to be displayed at the diagonal position and the non-diagonal position is used. 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 The average value of the display time duty cycle DT of the first low-resolution sub-frame image 1 , calculate and obtain the pixel gray value L of the first low-resolution sub-frame pixel corresponding to each pixel to be displayed 1 i,j The pixels to be displayed at the diagonal position and the non-diagonal position correspond to the correction factor K respectively. 2i-1,2j-1 , K 2i-1,2j , K 2i,2j-1 The pixel grayscale value L of the first low-resolution subframe pixel is obtained by calculating the average value of 1 i,j In the process of L, the influence of low-resolution sub-frame pixels at non-diagonal positions on adjacent display areas is taken into account, which helps to avoid image defects such as discontinuity between grayscale values ​​of high-resolution pixels to be displayed in the reconstructed image. It can be understood that in solving L 1 i,j With L 2 i,j In the process, L 1 i,j With L 2 i,j The method mentioned in this embodiment is used to limit the amplitude so that L 1 i,j With L 2 i,j All are in the range [0,1].

[0129] According to the above steps, the pixel grayscale value of each low-resolution sub-frame pixel in the two low-resolution sub-frame images is solved, thereby obtaining the modulation data of each low-resolution sub-frame image. The modulation data is composed of the pixel grayscale values ​​of all low-resolution sub-frame pixels constituting the corresponding low-resolution sub-frame pixel image.

[0130] The structure of the display device in this embodiment is the same as that of the display device 100 in the first embodiment, and Figure 4In this embodiment, during the display cycle of each frame of the image to be displayed, the timing-controlled optical path translation system 103 is used to guide the image light corresponding to the two different low-resolution sub-frame images emitted by the light modulation device 102 to different positions on the projection screen 105. The specific implementation method of the optical path translation system 103 is the same as that of the first embodiment and is not further described here.

[0131] See also Figures 8A-8E ,from Figure 8E It can be seen that the reconstructed image obtained by using the grayscale values ​​of the pixels to be displayed at the diagonal and non-diagonal positions in this embodiment is relatively close to the original image. The method of modulating data of the low-resolution sub-frame image calculated based on the principle of conservation of luminous flux in the present invention can better reproduce the high-resolution image to be displayed, and can effectively avoid the high-frequency filtering phenomenon generated in the process of image splitting and reorganization. The reconstruction effect is better, and the grayscale value continuity of adjacent high-resolution pixels in the reconstructed image is better.

[0132] It should be noted that within the scope of the spirit or basic features of the present invention, the specific solutions applicable to different implementations may also be applicable to each other. In order to save space and avoid repetition, they will not be described here.

[0133] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the invention is defined by the appended claims rather than the above description, and it is intended that all changes that fall within the meaning and scope of the equivalents of the claims be encompassed within the present invention. Any figure marks in the claims should not be regarded as limiting the claims involved. In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple devices stated in a device claim may also be implemented by the same device or system through software or hardware. Words such as first and second are used to indicate names and do not indicate any particular order.

[0134] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not limiting. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. An image splitting method, applied to a display device, wherein the display device forms a projection image on a projection screen, characterized in that: The image segmentation method comprises the following steps: Obtaining an image to be displayed, where the resolution of the image to be displayed is a first resolution; Each frame of the image to be displayed is split into multiple low-resolution sub-frame images with a second resolution, where the first resolution is twice the second resolution. The pixel grayscale value of each pixel to be displayed and the display time duty cycle of the multiple low-resolution sub-frame images are calculated to obtain the pixel grayscale value of each low-resolution sub-frame image, thereby obtaining the modulation data of each low-resolution sub-frame image.

2. The image segmentation method according to claim 1, wherein: The image to be displayed includes a plurality of pixels to be displayed in a pixel distribution, the plurality of low-resolution sub-frame images each include a plurality of low-resolution sub-frame pixels in a pixel distribution, and each pixel to be displayed in the image to be displayed and a corresponding low-resolution sub-frame pixel in the plurality of low-resolution sub-frame images are displayed in the same display area on the projection screen; The calculation to obtain the pixel grayscale value of each low-resolution subframe image includes: The weighted grayscale value of the corresponding low-resolution subframe pixel is obtained according to the grayscale value of each pixel to be displayed, and the pixel grayscale value of the corresponding low-resolution subframe pixel is calculated using the weighted grayscale value of the corresponding low-resolution subframe pixel.

3. The image segmentation method according to claim 2, wherein: The step of obtaining the weighted grayscale value of the corresponding low-resolution subframe pixel according to the grayscale value of each pixel to be displayed includes: The pixel grayscale value of each pixel to be displayed is equal to the sum of the weighted grayscale values ​​of the corresponding low-resolution sub-frame pixels in the multiple low-resolution sub-frame images.

4. The image segmentation method according to claim 2, wherein: The step of obtaining the weighted grayscale value of the corresponding low-resolution subframe pixel according to the grayscale value of each pixel to be displayed includes: It is determined whether a correction factor associated with a weighted grayscale value of at least one low-resolution sub-frame pixel is less than 0; if so, the correction factor is set to 0.

5. The image segmentation method according to claim 4, wherein: The calculating and obtaining the pixel grayscale value of the corresponding low-resolution subframe pixel includes: It is determined whether the pixel grayscale value of each low-resolution sub-frame pixel is greater than 1. If so, the pixel grayscale value of each low-resolution sub-frame pixel is set to 1.

6. The image segmentation method according to claim 5, wherein: The calculating and obtaining the pixel grayscale value of the corresponding low-resolution subframe pixel includes: The pixel grayscale value of the corresponding low-resolution sub-frame pixel in each low-resolution sub-frame image is calculated according to the minimum value or the average value of the multiple correction factors.

7. The image segmentation method according to claim 1, wherein: The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having the second resolution is specifically as follows: Each frame of the image to be displayed is split into two or four low-resolution sub-frame images with a second resolution.

8. The image segmentation method according to any one of claims 1 to 6, wherein: Before splitting each frame of the to-be-displayed image into a plurality of low-resolution sub-frame images with the second resolution, the method includes: Splitting each frame of the image to be displayed into a plurality of primary color sub-frame images, each primary color sub-frame image including primary color sub-frame pixels of pixel distribution; The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having a second resolution includes: According to a plurality of primary color subframe images obtained from an image to be displayed, each primary color subframe image is split into a plurality of low-resolution subframe images, and each primary color subframe pixel in each primary color subframe image and a corresponding low-resolution pixel in the split low-resolution subframe image are displayed in the same display area on the projection screen; The calculation to obtain the pixel grayscale value of each low-resolution subframe image includes: The primary color grayscale value of each primary color subframe pixel in the multiple primary color subframe images and the weighted grayscale value of the low-resolution subframe pixel corresponding to each primary color subframe pixel are obtained according to the pixel grayscale value of each to-be-displayed pixel in each to-be-displayed image.

9. An image display method, characterized in that: The image display method comprises the steps of the image splitting method according to any one of claims 1 to 8, wherein after obtaining the modulation data of each low-resolution sub-frame image, the image display method further comprises the following steps: In the display period of each frame of the image to be displayed, the image light of the multiple low-resolution sub-frame images is emitted to the projection screen in a timing manner according to the modulation data of each low-resolution sub-frame image, the row directions of the multiple low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images in the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / n low-resolution sub-frame pixels in the row direction and / or column direction, where n>1.

10. The image display method according to claim 9, wherein: The step of sequentially emitting the image light of the plurality of low-resolution sub-frame images to the projection screen according to the modulation data of each low-resolution sub-frame image comprises: According to the modulation data of each low-resolution sub-frame image, the primary color light is modulated by a light modulation device to obtain image light of different low-resolution sub-frame images; The optical path translation system is used to sequentially adjust the transmission direction of the image light emitted by the light modulation device, and guide the image light of multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed to be projected onto different positions on the projection screen.

11. The image display method according to claim 10, wherein: The light modulation device is arranged on a preset imaging surface inside the display device, and the preset imaging surface includes a first position and a second position. The method of modulating the primary color light using the light modulation device according to the modulation data of each low-resolution sub-frame image to obtain image light of different low-resolution sub-frame images includes: During the display period of each frame of the image to be displayed, the light modulator is controlled to be in the first position or the second position, and the light modulator is controlled to modulate at least one low-resolution sub-frame image at both the first position and the second position.

12. An image display method, characterized in that: The method comprises the steps of the image segmentation method according to any one of claims 1 or 8, The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having the second resolution is specifically as follows: Splitting each frame of the image to be displayed into four low-resolution sub-frame images with a second resolution; After obtaining the modulation data of each low-resolution subframe image, the image display method further includes the following steps: During the display period of each frame of the image to be displayed, the image light of the multiple low-resolution sub-frame images is emitted to the projection screen in a timing manner according to the modulation data of each low-resolution sub-frame image, the row directions of the multiple low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images among the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / 2 of a low-resolution sub-frame pixel in the row direction and / or column direction.

13. An image display method, characterized in that: The method comprises the steps of the image segmentation method according to any one of claims 1 or 8, The step of splitting each frame of the image to be displayed into a plurality of low-resolution sub-frame images having the second resolution is specifically as follows: Splitting each frame of the image to be displayed into two low-resolution sub-frame images with a second resolution; After obtaining the modulation data of each low-resolution subframe image, the image display method further includes the following steps: In the display period of each frame of the image to be displayed, the image light of the two low-resolution sub-frame images is emitted to the projection screen according to the modulation data timing of each low-resolution sub-frame image, the row directions of the two low-resolution sub-frame images are controlled to be parallel to each other, and the imaging positions of any two low-resolution sub-frame images in the multiple low-resolution sub-frame images obtained by splitting any frame of the image to be displayed are controlled to be offset by 1 / 2 of the low-resolution sub-frame pixel in the row direction and the column direction.

Images