Display module and imaging control method

Abstract

The application discloses a display module and an imaging control method, which are used for providing a super-resolution scheme of a display device. A control component obtains multiple low-resolution images by sub-pixel-level decomposition of a high-resolution image, and then displays the low-resolution images by a display component in time, and then adjusts the position of each frame of image displayed by the display component by a pixel position adjustment component in time, that is, multiple low-resolution images are displayed in time, the visual persistence and visual integration functions of the human eyes are utilized, and the multiple low-resolution images are superimposed in the human eyes, so that the human eyes see a high-resolution image, the sawtooth feeling is reduced by sub-pixel-level decomposition, and the imaging effect is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of optical technology, and particularly to a display module and an imaging control method. BACKGROUND

[0002] Display devices, such as virtual reality (VR) devices, achieve deep immersion by meeting a large angle of view (FOV) and high resolution. The content viewed in currently used VR devices only reaches 10-20 points per degree (PPD), which cannot meet the resolution limit of the human eye 1'(60 PPD), so that the image seen by the user has a screen door effect. To solve the screen door effect of the VR device, on the one hand, a high-resolution display screen can be used, but in order to meet the size requirements of the VR device, a display screen using micro-organic light-emitting diode (micro-OLED) technology is used, but the high-resolution micro-OLED has a high cost. On the other hand, the resolution of the display screen can be indirectly improved by resolution enhancement technology, but there is currently no feasible resolution enhancement scheme applicable to display devices. SUMMARY

[0003] Embodiments of the present application provide a display module and an imaging control method to provide a resolution enhancement scheme for VR devices.

[0004] In a first aspect, embodiments of the present application provide a display module, comprising a display assembly, a pixel position adjustment assembly, and a control assembly, the display assembly comprising a plurality of pixels, each pixel of the plurality of pixels comprising a plurality of sub-pixels; the display assembly is configured to display a plurality of images in time under the control of the control assembly; the plurality of images is obtained by sub-pixel level decomposition of a to-be-displayed image, the resolution of the plurality of images is the same as the resolution of the display assembly, and the resolution of the plurality of images is less than the resolution of the to-be-displayed image; the pixel position adjustment assembly is configured to adjust the position of each image displayed by the display assembly in time under the control of the control assembly; wherein the time for the display assembly to display a first image is synchronized with the time for the pixel position adjustment assembly to adjust the first image, and the first image is any image in the plurality of images. In this way, a plurality of low-resolution images are displayed in time, and the visual persistence and visual integration functions of the human eye are used to make the human eye see a high-resolution image. The to-be-displayed image is decomposed by a sub-pixel level sampling method to improve the smoothness of the edge and reduce the sawtooth effect.

[0005] In one possible design, the pixel position adjustment component includes a polarization converter and a polarization shifting device; the polarization converter is used to adjust the polarization direction of the target polarized light output by the polarization converter in a time-division manner under the control of the control component, the target polarized light carrying one frame of an image in a multi-frame image; the polarization shifting device is used to output the target polarized light at a first position when the polarization direction of the target polarized light output by the polarization converter is a first polarization direction, and to output the target polarized light at a second position when the polarization direction of the target polarized light output by the polarization converter is a second polarization direction.

[0006] In one possible design, the control component is specifically used to receive the image to be displayed, decompose the image to be displayed into multiple frames at the subpixel level, and send the multiple frames to the display component in a time-division manner.

[0007] In one possible design, the polarization shifting device is a birefringent device or a polarization grating. Birefringent devices are non-diffractive devices and do not possess inherent dispersion characteristics; therefore, light passing through a birefringent device will not be dispersed, further improving the imaging effect.

[0008] In one possible design, the polarization converter includes a twisted nematic liquid crystal or an in-plane rotating liquid crystal; or the polarization converter includes a cholesteric liquid crystal and a quarter-wave plate.

[0009] In one possible design, the pixel position adjustment component is a motor.

[0010] In one possible design, the subpixels included in the first pixel of the first image in the multi-frame image are sampled from the subpixels included in at least h adjacent pixels of the image to be displayed; where h is the number of images in the multi-frame image, the first image is any image in the multi-frame image, and the first pixel is any pixel of the first image.

[0011] In one possible design, the pixel value of the first sub-pixel included in the first pixel is determined based on the pixel values ​​of the sub-pixels with the same color as the first sub-pixel included in a defined area of ​​the image to be displayed; the geometric center of the defined area is the sampling position of the first sub-pixel in the image to be displayed.

[0012] In the above design, the sub-pixel value of the sampling location is determined by the sub-pixel values ​​of the same color around the sampling location, which can reduce the appearance of color fringes around the displayed image. In some embodiments, this method may also be used only when determining the sub-pixel values ​​within a defined range around the sampling location.

[0013] In one possible design, the pixel value of the first sub-pixel included in the first pixel is obtained by weighted summation of the pixel values ​​of the sub-pixels with the same color as the first sub-pixel included in the defined area;

[0014] The weight of the sub-pixel included in the set region and having the same color as the first sub-pixel is inversely proportional to the distance between the sub-pixels.

[0015] In a possible design, the pixel value of the first sub-pixel satisfies a condition shown in the following formula:

[0016] q(i,j) = a1*Q(i-1,j) + a2*Q(i,j-1) + a3*Q(i+1,j) + a4*Q(i,j+1) + a5*Q(i,j);

[0017] where q(i,j) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in a pixel point of the image to be displayed, j represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed, Q(i,j) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, and a1, a2, a3, a4, and a5 represent weights respectively.

[0018] In a possible design, the pixel value of the first sub-pixel satisfies a condition shown in the following formula:

[0019] q(i,j+1) = a1*Q(i-1,j) + a2*Q(i,j-1) + a3*Q(i+1,j) + a4*Q(i,j+1)

[0020] + b1*Q(i-1,j+1) + b2*Q(i,j) + b3*Q(i+1,j+1) + b4*Q(i,j+2).

[0021] where q(i,j+1) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in a pixel point of the image to be displayed, j+1 represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed, Q(i,j+1) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, a1, a2, a3, a4, b1, b2, b3, and b4 represent weights respectively.

[0022] In a possible design, the multiple frames of images include a first image and a second image; the control component is specifically configured to input the multiple frames of images to the display component in time division, so that the display component displays the multiple frames of images in time division; the control component controls the pixel position adjustment component to output the first image at a first position in a first time unit, and controls the pixel position adjustment component to output the second image at a second position in a second time unit. The first position and the second position are separated by Px / 2 in a horizontal direction; or, the first position and the second position are separated by Py / 2 in a vertical direction; or, the first position and the second position are separated by Px / 2 in the horizontal direction and the first position and the second position are separated by Py / 2 in the vertical direction; the first time unit and the second time unit are adjacent in time.

[0023] In a possible design, the control component is specifically configured to control the polarization converter to adjust a polarization direction of input target polarized light carrying the first image to be a first polarization direction in a first time unit, and control the polarization converter to adjust a polarization direction of input target polarized light carrying the second image to be a second polarization direction in a second time unit, so that a first position of output target polarized light carrying the first image and a second position of output target polarized light carrying the second image output by the polarization shifting device are separated by Px / 2 in a horizontal direction; Px represents a distance between adjacent pixels of the first image or the second image in the horizontal direction. Through the above design, a horizontal super-resolution implementation manner is provided, which is simple and effective.

[0024] In a possible design, the control component is specifically configured to control the polarization converter to adjust a polarization direction of input target polarized light carrying the first image to be a first polarization direction in a first time unit, and control the polarization converter to adjust a polarization direction of input target polarized light carrying the second image to be a second polarization direction in a second time unit, so that a first position of output target polarized light carrying the first image and a second position of output target polarized light carrying the second image output by the polarization shifting device are separated by Px / 2 in a horizontal direction; Px represents a distance between adjacent pixels of the first image or the second image in the horizontal direction. Through the above design, a horizontal super-resolution implementation manner is provided, which is simple and effective.

[0025] In a possible design, the control component is specifically configured to control the polarization converter to adjust a polarization direction of the input target-polarization light carrying the first image to the first polarization direction in a first time unit, and to adjust a polarization direction of the input target-polarization light carrying the second image to the second polarization direction in a second time unit, so that the first position of the output target-polarization light carrying the first image and the second position of the output target-polarization light carrying the second image are spaced by Py / 2 in the vertical direction and offset by Px / 2 in the horizontal direction, where Py represents a spacing of adjacent pixels of the first image or the second image in the vertical direction, and Px represents a spacing of adjacent pixels of the first image or the second image in the vertical direction. With the above design, a diagonal super-resolution implementation manner is provided, which is simple and effective.

[0026] In a possible design, the polarization converter includes a twisted nematic liquid crystal or an in-plane switching liquid crystal; or the polarization converter includes a cholesteric liquid crystal and a 1 / 4 wave plate.

[0027] In a possible design, the polarization displacement device is a birefringent liquid crystal, and the birefringent liquid crystal is a quartz crystal, a barium borate crystal, a lithium niobate crystal, or a titanium dioxide crystal, or a liquid crystal polymer.

[0028] In a possible design, the display module further includes a folded light path, and the folded light path is located between the display assembly and the pixel position adjustment assembly, and is configured to transmit the target-polarization light carrying any image of the multiple images to the pixel position adjustment assembly.

[0029] In a second aspect, an imaging control method is provided, and the method is applied to a display device, the display device includes a display assembly and a pixel position adjustment assembly, the display assembly includes a plurality of pixels, and each pixel includes a plurality of sub-pixels; the method includes: receiving a to-be-displayed image, and performing sub-pixel-level decomposition on the to-be-displayed image to obtain multiple images; a resolution of each image in the multiple images is the same as a resolution of the display assembly, and a resolution of the multiple images is smaller than a resolution of the to-be-displayed image; and controlling the pixel position adjustment assembly to adjust a position of each image displayed by the display assembly in time sharing manner; wherein a time for the display assembly to display a first image is synchronized with a time for the pixel position adjustment assembly to adjust the first image, and the first image is any image in the multiple images.

[0030] In a possible design, the sub-pixel-level decomposition on the to-be-displayed image to obtain the multiple images includes:

[0031] When a super-resolution mode of the display device is enabled, the to-be-displayed image is decomposed at a sub-pixel level to obtain the multiple images.

[0032] In a possible design, the method further includes:

[0033] When the super-resolution mode of the display device is not enabled, down-sampling the image to be displayed to obtain a to-be-processed image;

[0034] inputting the to-be-processed image to the display component, so that the display component displays the to-be-processed image;

[0035] outputting, by the pixel position adjustment component, the to-be-processed image at the set position.

[0036] In a possible design, a first pixel point in a first image in the plurality of images includes a sub-pixel sampled from sub-pixels included in at least h adjacent pixel points in the image to be displayed;

[0037] wherein h is the number of images in the plurality of images, the first image is any image in the plurality of images, and the first pixel point is any pixel point in the first image.

[0038] In a possible design, a pixel value of a first sub-pixel included in the first pixel point is determined according to pixel values of sub-pixels included in a set region of the image to be displayed and having the same color as the first sub-pixel;

[0039] A geometric center of the set region is a sampling position of the first sub-pixel in the image to be displayed.

[0040] In a possible design, a pixel value of a first sub-pixel included in the first pixel point is obtained by weighted summation of pixel values of sub-pixels included in a set region and having the same color as the first sub-pixel;

[0041] wherein a weight of a sub-pixel included in the set region and having the same color as the first sub-pixel is inversely proportional to a distance between the sub-pixel and the first sub-pixel; and the distance between the sub-pixels is a distance between the sampling position of the first sub-pixel and the sub-pixel having the same color as the first sub-pixel in the image to be displayed.

[0042] In a possible design, the display device is a wearable device, and a size of the set region is related to a distance between the display component and an imaging plane of the wearable device.

[0043] In a possible design, the size of the set region is related to a pixel size of the display component.

[0044] In a possible design, the size of the set region is related to display content of the display component.

[0045] In a possible design, the pixel value of the first sub-pixel satisfies a condition shown in the following formula:

[0046] q(i,j)=α1*Q(i-1,j)+α2*Q(i,j-1)+α3*Q(i+1,j)+α4*Q(i,j+1)+α5*Q(i,j).

[0047] wherein q(i,j) represents the pixel value of the first sub-pixel; i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed; j represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed; Q(i,j) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed; and a1, a2, a3, a4 and a5 represent weights respectively.

[0048] In a possible design, the pixel value of the first sub-pixel satisfies a condition shown in the following formula:

[0049] q(i,j+1) = a1*Q(i-1,j) + a2*Q(i,j-1) + a3*Q(i+1,j) + a4*Q(i,j+1)

[0050] + b1*Q(i-1,j+1) + b2*Q(i,j) + b3*Q(i+1,j+1) + b4*Q(i,j+2).

[0051] wherein q(i,j+1) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed, j+1 represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed, Q(i,j+1) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, and a1, a2, a3, a4, b1, b2, b3 and b4 represent weights respectively.

[0052] In a possible design, the plurality of images include the first image and the second image, and the pixel position adjustment component is controlled to adjust the position of each image displayed by the display component in time, including: inputting the plurality of images to the display component in time, so that the display component displays the plurality of images in time; controlling the pixel position adjustment component to output the first image at a first position in a first time unit, and controlling the pixel position adjustment component to output the second image at a second position in a second time unit; the interval of the first position and the second position in the horizontal direction is Px / 2; or the interval of the first position and the second position in the vertical direction is Py / 2; or the interval of the first position and the second position in the horizontal direction is Px / 2 and the interval of the first position and the second position in the vertical direction is Py / 2; and the first time unit and the second time unit are adjacent in time.

[0053] In a possible design, the pixel position adjustment component includes a polarization converter and a polarization displacement device; and the control of the pixel position adjustment component to output the first image at the first position in the first time unit and to output the second image at the second position in the second time unit includes: control of the polarization converter to adjust the polarization direction of target polarized light generated by the display component when displaying multiple frames of images in time; and control of the polarization displacement device to output the target polarized light at the first position when the polarization direction of the target polarized light output by the polarization converter is a first polarization direction, and to output the target polarized light at the second position when the polarization direction of the target polarized light output by the polarization converter is a second polarization direction.

[0054] In a possible design, the control of the polarization converter to adjust the polarization direction of the target polarized light output in time includes:

[0055] In a possible design, the control of the polarization converter to adjust the polarization direction of the target polarized light output in time includes:

[0056] In a possible design, the first pixel point in the first image includes sub-pixels sampled from sub-pixels included in two horizontally adjacent pixel points in the image to be displayed.

[0057] The second pixel point in the second image includes sub-pixels sampled from sub-pixels included in two horizontally adjacent pixel points.

[0058] The position coordinates of the first pixel point in the first image are the same as the position coordinates of the second pixel point in the second image.

[0059] In a possible design, the control of the polarization converter to adjust the polarization direction of the target polarized light input in time includes:

[0060] The polarization direction of the target polarization light output by the polarization conversion device is controlled to be the first polarization direction in a first time unit, and the polarization direction of the target polarization light output by the polarization conversion device is controlled to be the second polarization direction in a second time unit, so that the first position of the target polarization light output by the polarization shifting device and carrying the first image and the second position of the target polarization light output by the polarization shifting device and carrying the second image are vertically spaced by Py / 2; and Py represents the vertical spacing of adjacent pixels in the first image or the second image.

[0061] In a possible design, the sub-pixels included in the first pixel point in the first image are sampled from the sub-pixels included in two adjacent pixel points in the vertical direction of the image to be displayed;

[0062] The sub-pixels included in the second pixel point in the second image are sampled from the sub-pixels included in two adjacent pixel points in the vertical direction;

[0063] The position coordinates of the first pixel point in the first image are the same as the position coordinates of the second pixel point in the second image.

[0064] In a possible design, the polarization conversion device is controlled to adjust the polarization direction of the target polarization light output by the polarization conversion device in time, and the method comprises the following steps.

[0065] The polarization direction of the target polarization light input by the polarization conversion device is controlled to be the first polarization direction in a first time unit, and the polarization direction of the target polarization light input by the polarization conversion device is controlled to be the second polarization direction in a second time unit, so that the first position of the target polarization light output by the polarization shifting device and carrying the first image and the second position of the target polarization light output by the polarization shifting device and carrying the second image are vertically spaced by Py / 2 and horizontally offset by Px / 2, Py represents the vertical spacing of adjacent pixels in the first image or the second image, and Px represents the horizontal spacing of adjacent pixels in the first image or the second image.

[0066] In a possible design, the sub-pixels included in the first pixel point in the first image are sampled from the sub-pixels included in two adjacent pixel points in the diagonal direction of the image to be displayed;

[0067] The sub-pixels included in the second pixel point in the second image are sampled from the sub-pixels included in two adjacent pixel points in the diagonal direction;

[0068] The position coordinates of the first pixel point in the first image are the same as the position coordinates of the second pixel point in the second image.

[0069] In a third aspect, the embodiments of the present application provide a display module, comprising a display component, at least one adjusting component and a control component; the adjusting component comprises a polarization rotator and a birefringent device; the display component is configured to receive a to-be-processed image and display the to-be-processed image, the resolution of the to-be-processed image being the same as the resolution of the display component; the polarization rotator is configured to adjust the polarization direction of the light beam of each pixel of the to-be-processed image under the control of the control component; the birefringent device is configured to decompose the light beam of each pixel included in the to-be-processed image, output a first target polarized light used for projecting a first sub-image at a first position and output a second target polarized light used for projecting a second sub-image at a second position; wherein the decomposition ratio of a first pixel is different from the decomposition ratio of a second pixel, the first pixel and the second pixel being two pixels with different polarization directions in the to-be-processed image, the decomposition ratio of the first pixel being the ratio of the luminous intensity of the light beam of the first pixel projected on the pixel of the first sub-image to the luminous intensity of the light beam of the first pixel projected on the pixel of the second sub-image, and the decomposition ratio of the second pixel being the ratio of the luminous intensity of the light beam of the second pixel projected on the pixel of the first sub-image to the luminous intensity of the light beam of the second pixel projected on the pixel of the second sub-image. In the embodiments of the present application, the polarization rotator and the birefringent device are combined, and the principle of outputting two light beams by the birefringent device is used to output two sub-images, so that the superposition of the two sub-images is close to the source to-be-displayed image, and the resolution of the display image is improved.

[0070] In a possible design, the position of the first sub-image and the position of the second sub-image are spaced apart by Py / 2 in the vertical direction and / or spaced apart by Px / 2 in the horizontal direction, Py representing the interval of pixels in the vertical direction, and Px representing the interval of pixels in the vertical direction.

[0071] In a possible design, the control component is specifically configured to control the polarization rotator to adjust the polarization direction of the light beam of each sub-pixel included in each pixel.

[0072] In a possible design, the to-be-processed image is obtained by performing down-sampling processing on a to-be-displayed image; and the control component is specifically configured to: estimate the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image according to the luminous intensity of each pixel of the to-be-displayed image; wherein the resolution of the first sub-image and the resolution of the second sub-image are the same and smaller than the resolution of the to-be-displayed image; and control the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image according to the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image.

[0073] In a possible design, the to-be-processed image is obtained by down-sampling the to-be-displayed image; the control component is specifically configured to: estimate and adjust the light-emitting intensity of each pixel of the first sub-image to be projected and the light-emitting intensity of each pixel of the second sub-image to be projected, so that the similarity between the superimposed projected image of the adjusted first sub-image and second sub-image and the to-be-displayed image is greater than a set threshold; the threshold is determined according to the perception ability of the human eye to image difference; and control the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image according to the light-emitting intensity of each pixel of the adjusted first sub-image and the light-emitting intensity of each pixel of the second sub-image.

[0074] In a fourth aspect, an imaging control method is provided, and the method is applied to a wearable device. The wearable device includes a display component and a pixel position adjustment component, and the pixel position adjustment component includes a polarization rotator and a birefringent device. The method includes the following steps: receiving a to-be-displayed image, performing down-sampling on the to-be-displayed image to obtain a to-be-processed image, and inputting the to-be-processed image to the display component, so that the display component emits target polarized light carrying the to-be-displayed image. The target frame image is one of a plurality of images, and the resolution of the to-be-processed image is the same as the resolution of the display component. The polarization direction of the light beam of each pixel of the output to-be-processed image is adjusted by the polarization rotator, so that the birefringent device decomposes the light beam of each pixel included in the to-be-processed image. The first target polarized light used for projecting the first sub-image is output at a first position, and the second target polarized light used for projecting the second sub-image is output at a second position. The decomposition ratio of the first pixel is different from the decomposition ratio of the second pixel. The first pixel and the second pixel are two pixels with different polarization directions in the to-be-processed image. The decomposition ratio of the first pixel is the ratio of the light-emitting intensity of the light beam of the first pixel projected on the pixel of the first sub-image to the light-emitting intensity of the light beam of the first pixel projected on the pixel of the second sub-image. The decomposition ratio of the second pixel is the ratio of the light-emitting intensity of the light beam of the second pixel projected on the pixel of the first sub-image to the light-emitting intensity of the light beam of the second pixel projected on the pixel of the second sub-image.

[0075] In a possible design, the position of the first sub-image and the position of the second sub-image are spaced by Py / 2 in the vertical direction and / or spaced by Px / 2 in the horizontal direction. Py represents the interval of pixels in the vertical direction, and Px represents the interval of pixels in the vertical direction.

[0076] In a possible design, the control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the output to-be-processed image includes: control of the polarization rotator to adjust the polarization direction of the light beam of each sub-pixel included in each pixel of the to-be-processed image.

[0077] In a possible design, the control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises: estimating the luminous intensity of each pixel of the first sub-image to be projected and the luminous intensity of each pixel of the second sub-image to be projected according to the luminous intensity of each pixel of the to-be-displayed image; wherein the first sub-image and the second sub-image have the same resolution and the resolution is smaller than that of the to-be-displayed image; and the control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image is based on the luminous intensity of each pixel of the first sub-image to be projected and the luminous intensity of each pixel of the second sub-image to be projected.

[0078] In a possible design, the control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises: estimating and adjusting the luminous intensity of each pixel of the first sub-image to be projected and the luminous intensity of each pixel of the second sub-image to be projected, so that the similarity between the superimposed projected image of the adjusted first sub-image and the second sub-image and the to-be-displayed image is greater than a set threshold; the threshold is determined according to the perception ability of the human eye to image difference; and the control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image is based on the luminous intensity of each pixel of the adjusted first sub-image and the luminous intensity of each pixel of the second sub-image.

[0079] In a fifth aspect, a control apparatus is provided, which is configured to implement any of the methods in the second aspect or the fourth aspect, and comprises corresponding function modules for implementing the steps in the above methods. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software comprises one or more modules corresponding to the above functions.

[0080] In a sixth aspect, a computer readable storage medium is provided, which stores a computer program or instructions, and when the computer program or instructions are executed by a display device, the display device is caused to perform the method in any possible implementation manner of the second aspect or the fourth aspect.

[0081] In a seventh aspect, a computer program product is provided, which comprises a computer program or instructions, and when the computer program or instructions are executed by a control apparatus, the method in any possible implementation manner of the second aspect or the fourth aspect is implemented. BRIEF DESCRIPTION OF DRAWINGS

[0082] Figure 1A An RGB Stripe arrangement is shown in the figure;

[0083] Figure 1B A pentile RGBG arrangement is shown in the figure;

[0084] Figure 1C Schematic diagram of delta RGB arrangement mode;

[0085] Figure 1D Schematic diagram of pentile RGBW arrangement mode;

[0086] Figure 2 Schematic diagram of display component structure in the embodiment of the application;

[0087] Figure 3A Schematic diagram of display module structure in the embodiment of the application;

[0088] Figure 3B Schematic diagram of display module structure in the embodiment of the application;

[0089] Figure 4 Schematic diagram of diagonal super-resolution principle in the embodiment of the application;

[0090] Figure 5A Schematic diagram of resolution enhancement achieved by combining polarization grating;

[0091] Figure 5B Schematic diagram of resolution enhancement achieved by image pixel offset;

[0092] Figure 6 Schematic diagram of light beam transmission of display module employing birefringent device in the embodiment of the application;

[0093] Figure 7 Schematic diagram of light output principle of birefringent device in the embodiment of the application;

[0094] Figure 8 Relationship between thickness of birefringent device and refractive index difference Δn of o light and e light of birefringent device in the embodiment of the application;

[0095] Figure 9 Schematic diagram of display module structure in the embodiment of the application;

[0096] Figure 10 Schematic diagram of sub-pixel sampling concept in the embodiment of the application;

[0097] Figure 11A Schematic diagram of sampling decomposition of image to be displayed under diagonal super-resolution in the embodiment of the application;

[0098] Figure 11B Schematic diagram of sampling decomposition of image to be displayed under diagonal super-resolution in the embodiment of the application;

[0099] Figure 12 Schematic diagram of sampling decomposition of image to be displayed under vertical super-resolution in the embodiment of the application;

[0100] Figure 13A control timing diagram in the embodiments of the present application;

[0101] Figure 14 A light beam transmission direction diagram in the display module in the embodiments of the present application;

[0102] Figure 15 A low-resolution sub-frame superposition display diagram in the diagonal super-resolution in the embodiments of the present application;

[0103] Figure 16A A to-be-displayed image sampling decomposition diagram in the embodiments of the present application;

[0104] Figure 16B A to-be-displayed image sampling decomposition diagram in the embodiments of the present application;

[0105] Figure 17 A low-resolution sub-frame superposition display diagram in the embodiments of the present application;

[0106] Figure 18 A sub-pixel pixel value calculation principle diagram in the embodiments of the present application;

[0107] Figure 19 A sub-pixel pixel value calculation principle diagram in the embodiments of the present application;

[0108] Figure 20 A display module structure diagram in the embodiments of the present application;

[0109] Figure 21 A display module structure diagram in the embodiments of the present application;

[0110] Figure 22 A polarization light diagram in which a deflection rotator realizes conversion output in the embodiments of the present application;

[0111] Figure 23 A resolution enhancement principle diagram in the embodiments of the present application;

[0112] Figure 24 An imaging control method flow diagram in the embodiments of the present application;

[0113] Figure 25 An imaging control method flow diagram in the embodiments of the present application. DETAILED DESCRIPTION

[0114] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0115] Hereinafter, some terms in the present application will be explained. It should be noted that these explanations are for the convenience of understanding by those skilled in the art, and do not limit the scope of protection required by the present application.

[0116] (1) Near-eye display:

[0117] Display at a close distance from the eye is a display mode of an AR display device or a VR display device.

[0118] (2) Angular resolution, which can also be referred to as spatial resolution, refers to the number of pixel points filled in an average 1-degree angle of a field of view. Before the clarity reaches the limit of the human eye that can be distinguished, the more pixel points filled in a unit area of the field of view, the clearer and more delicate the visual experience. The greater the PPD, the more pixel points filled in a unit area of the field of view, and the clearer the user's experience of the display screen.

[0119] (3) Sub-pixel:

[0120] The smallest image unit on a display screen is a pixel. A pixel is composed of three color sub-pixels. A sub-pixel can also be referred to as a sub-pixel. For example, a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel make up a pixel. The pixel arrangement of the display screen can include RGB stripe arrangement, pentile RGBG arrangement, pentile RGBW arrangement, delta RGB arrangement, and the like.

[0121] Figure 1A RGB Stripe is a common pixel arrangement for traditional display screens, arranged in a long strip, and each pixel contains one R, one G, and one B.

[0122] Figure 1B Pentile RGBG arrangement, each pixel contains two sub-pixels, and the combination of RG and BG appears alternately.

[0123] Figure 1C Delta RGB arrangement, each pixel contains three sub-pixels of RGB, and adjacent two pixels share a sub-pixel, with Figure 1C For example, the first row in the table, pixel 1 and pixel 2 share a blue sub-pixel, and pixel 2 and pixel 3 share a red sub-pixel and a green sub-pixel.

[0124] Figure 1D Pentile RGBW arrangement, each pixel includes a red (R) sub-pixel, a green (G) sub-pixel, a blue (B) sub-pixel, and a white (W) sub-pixel.

[0125] It can be seen that, in the RGB Stripe arrangement mode, three pixels are composed of 9 sub-pixels; in the RGBG arrangement mode, three pixels are composed of 6 sub-pixels; and in the RGB delta arrangement mode, three pixels are composed of 6 sub-pixels. Therefore, when the number of pixels is the same, the RGBG arrangement mode and the RGB delta arrangement mode require fewer sub-pixels than the RGB Stripe arrangement mode.

[0126] Embodiments of the present application are applied to display devices. For example, terminal devices with display screens, such as mobile phones, displays, televisions, and the like. The display device can also be a wearable device. The wearable device can be a near eye display (NED) device, such as a VR glasses or a VR helmet, etc. For example, a user wears a NED device to play games, read, watch movies (or TV series), attend virtual meetings, attend video education, or video shopping, etc.

[0127] In order to realize the effect of seeing a high-resolution image by the human eye with a low-resolution display screen, a resolution enhancement method, also known as super-resolution, can be used to improve the resolution of the low-resolution display screen. Referring to Figure 2 As shown in FIG. 1, a display module structure schematic diagram provided by an embodiment of the present application is shown. The display module includes a display component 100, at least one pixel position adjustment component 200, and a control component 300. Figure 2 In an embodiment, the display module includes one pixel position adjustment component 200. The display component 100 is configured to display an image. The pixel position adjustment component 200 is configured to adjust the position of the image displayed by the display component 100. For example, the display device is a wearable device, and the pixel position adjustment component 200 adjusts the image displayed by the display component 100 to be imaged on a virtual image plane at a certain distance from the display component 100. The display component 100 displays multiple frames of images under the control of the control component 300. The multiple frames of images can be obtained by down-sampling the to-be-displayed image by the control component 300. For example, the control component 300 splits a high-resolution to-be-displayed image into multiple low-resolution images. The resolution of the low-resolution image is the same as the resolution of the display component. The control component 300 sends the multiple low-resolution images to the display component 100 for display in time. The pixel position adjustment component is configured to adjust the position of each frame of image displayed by the display component under the control of the control component; wherein the time for the display component to display the first image is synchronized with the time for the pixel position adjustment component to adjust the first image, and the first image is any image in the multiple frames of images.

[0128] In a possible embodiment, the pixel position adjustment component can be a motor, and the control component 300 controls the mechanical movement of the motor in time to adjust the position of each frame of image displayed by the display component. The motor can be an ultrasonic motor or a servo motor, etc.

[0129] In another possible embodiment, referring to Figure 3A As shown, the pixel position adjustment assembly 200 can include a polarization converter 210 and a polarization displacement device 220. The polarization converter 210 is configured to adjust the polarization direction of a target polarized light output by the polarization converter 210 in time under the control of the control assembly 300, the target polarized light carrying one frame of image in a plurality of frames of image. The polarization displacement device 220 is configured to output the target polarized light at a first position when the polarization direction of the target polarized light output by the polarization converter 210 is a first polarization direction, and output the target polarized light at a second position when the polarization direction of the target polarized light output by the polarization converter 210 is a second polarization direction; wherein the display time of the first image is synchronized with the polarization direction adjustment time of the target polarized light carrying the first image, and the first image is any frame of image in the plurality of frames of image.

[0130] As an example, taking two frames of image as an example, the display module provided by the embodiment of the present application can realize horizontal direction super resolution, or vertical direction super resolution, or diagonal direction super resolution. The horizontal direction super resolution can be understood as that the interval distance of the two frames of image formed by the light beams output by the polarization displacement device in the horizontal direction is Px / 2; the Px represents the interval distance of the adjacent pixels of the two frames of image in the horizontal direction, so as to realize the doubling of the resolution in the horizontal direction. When the horizontal direction super resolution is adopted, the polarization displacement device needs to have the capability of realizing the offset vector (Px / 2, 0). The vertical direction super resolution can be understood as that the interval distance of the two frames of image formed by the light beams output by the polarization displacement device in the vertical direction is Py / 2; the Py represents the interval distance of the adjacent pixels of the two frames of image in the vertical direction, so as to realize the doubling of the resolution in the vertical direction. When the vertical direction super resolution is adopted, the polarization displacement device needs to have the capability of realizing the offset vector (0, Py / 2). The diagonal direction super resolution can be understood as that the interval distance of the two frames of image formed by the light beams output by the polarization displacement device in the vertical direction is Py / 2, and the interval distance of the two frames of image in the horizontal direction is Px / 2; so as to realize the doubling of the resolution. When the diagonal direction super resolution is adopted, the polarization displacement device needs to have the capability of realizing the offset vector (Px / 2, Py / 2). Referring to Figure 4 As shown, taking a 4*4 pixel array as an example (the pixels are arranged in RGB Stipe arrangement), assuming that the polarization displacement device can realize the offset of the offset vector (Px / 2, Py / 2), then the effect of doubling the equivalent display pixel number can be realized by the time division multiplexing. Of course, when the offset vector of the polarization displacement device is (Px / 2, 0), the resolution in the horizontal direction can be doubled. When the offset vector of the polarization displacement device is (0, Py / 2), the resolution in the vertical direction can be doubled. Of course, the offset of the plurality of frames of image can also be realized by connecting a plurality of pixel position adjustment assemblies 200 in series, so as to realize the resolution improvement of more than 2 times.

[0131] Exemplarily, refer to Figure 3B For the convenience of distinguishing, the two pixel position adjustment assemblies are respectively referred to as a first pixel position adjustment assembly 200a and a second pixel position adjustment assembly 200b. The polarization converter in the pixel position adjustment assembly 200a is referred to as a first polarization converter 210a, and the polarization converter in the pixel position adjustment assembly 200b is referred to as a second polarization converter 210b. The polarization displacement device in the pixel position adjustment assembly 200a is referred to as a polarization displacement device 220a, and the polarization displacement device in the pixel position adjustment assembly 200b is referred to as a polarization displacement device 220b.

[0132] The following describes Figure 3A and Figure 3B respectively, to give an exemplary specific implementation scheme. When described as follows, the reference signs of the various components in the display module are no longer exemplified.

[0133] The polarization displacement device can be a polarization grating or a birefringent device.

[0134] In a possible example, the polarization displacement device 220 is taken as a polarization grating 220a. The combination of the polarization grating and the polarization modulation device is adopted to realize resolution enhancement.

[0135] The polarization grating, which can also be referred to as a Pancharatnam-Berry deflector (PBD), is a kind of diffractive optical device. The polarization grating utilizes geometric phase to generate a periodic phase grating structure, so that different directions of +1 order and -1 order diffraction can be generated under different circularly polarized light incidence. Refer to Figure 5A As shown in the figure, the polarization state of the light beam output by the display screen is changed by using an electrically controlled polarization modulation device, so that the light beam input into the polarization grating is deflected. Taking a rectangle as an example for each pixel, P is the interval of the adjacent two pixels in the horizontal direction or the vertical direction. For example, refer to Figure 5B As shown in the figure, taking diagonal super-resolution as an example, the polarization converter and the polarization grating are used to offset each pixel in the image output by the display screen by P in the diagonal direction, and then the images before and after the offset are displayed by time sharing, which is equivalent to increasing the resolution of the image displayed by the display screen by 2 times, and the horizontal interval of the pixels after the offset is P / 2.

[0136] In another possible example, a combination of a polarization converter and a birefringent device is used to shift the light rays carrying an image emitted by a display assembly. The polarization converter can adjust the polarization direction of the input target polarized light in time under the control of a control assembly. The target polarized light is used to carry a low-resolution image. The birefringent device outputs the target polarized light at different positions when the polarization direction of the input target polarized light is different. For example, the birefringent device outputs the target polarized light at a first position when the polarization direction of the target polarized light output by the polarization converter is a first polarization direction, and outputs the target polarized light at a second position when the polarization direction of the target polarized light output by the polarization converter is a second polarization direction, as shown in FIG. 6. It should be noted that, for the same image, for example, a first image in a plurality of images, the display assembly displays the first image at a time, and the polarization converter adjusts the polarization direction of the target polarized light carrying the first image at a time. By displaying a plurality of low-resolution images in time in the above manner, the visual persistence and visual integration functions of the human eye are used to make the human eye see a high-resolution image. Figure 6 It should be noted that, since the polarization grating is a diffractive device, the diffractive device has an inherent dispersion characteristic. The deflection angle of the grating is linearly related to the wavelength of the input light beam, thereby causing the red, green and blue light rays of different wavelengths emitted by the display screen to be dispersed after passing through the polarization grating, resulting in poor imaging effects reaching the human eye, such as the appearance of rainbow edges, making the image seen by the human eye blurred and color distorted. The birefringent device is a non-diffractive device and does not have an inherent dispersion characteristic, so the light rays passing through the birefringent device will not be dispersed, and the imaging effect is better than that of the polarization grating.

[0137] It should be noted that, since the polarization grating is a diffractive device, the diffractive device has an inherent dispersion characteristic. The deflection angle of the grating is linearly related to the wavelength of the input light beam, thereby causing the red, green and blue light rays of different wavelengths emitted by the display screen to be dispersed after passing through the polarization grating, resulting in poor imaging effects reaching the human eye, such as the appearance of rainbow edges, making the image seen by the human eye blurred and color distorted. The birefringent device is a non-diffractive device and does not have an inherent dispersion characteristic, so the light rays passing through the birefringent device will not be dispersed, and the imaging effect is better than that of the polarization grating.

[0138] The display assembly can be a common liquid crystal display (LCD), a common organic light emitting diode display (OLED), or a silicon-based OLED, or other display devices, which are not specifically limited in the present application.

[0139] The polarization converter can be an electronically controlled polarization switch (ECPS). For example, the electronically controlled polarization switch can be any one of nematic liquid crystals, vertical alignment (VA) liquid crystals, in-plane switching (IPS) liquid crystals, twisted nematic liquid crystals (TNLC), electronically controlled nonlinear crystals, or electronically controlled ferroelectric liquid crystals.

[0140] In a possible example, the control component controls the polarization converter to be in an unpowered (i.e., OFF) state for maintaining the polarization direction of the input polarized light, which can be understood as that the polarization direction of the input polarized light is the same as that of the output polarized light, or that the polarization converter only transmits the input polarized light. It should be noted that the light beam may have energy loss when transmitted through a certain optical component, but the information carried in the light beam does not change, and based on this, the present embodiment considers the input polarized light and the output polarized light to be the same polarized light only when the transmission processing is performed. The control component controls the polarization converter to be in a powered state, for example, the applied voltage exceeds the threshold voltage Vc, for rotating the polarization direction of the input polarized light, for example, rotating the polarization direction of the input polarized light by 90 degrees.

[0141] In another possible example, the control component controls the polarization converter to be in a powered state, for example, the applied voltage exceeds the threshold voltage, for maintaining the polarization direction of the input polarized light. The control component controls the polarization converter to be in an unpowered state, for rotating the polarization direction of the input polarized light, for example, rotating the polarization direction of the input polarized light by 90 degrees.

[0142] Taking TNLC as an example, the TNLC is composed of two conductive substrates with a liquid crystal layer in between. When the TNLC is not powered, the polarization direction of the incident polarized light passing through the TNLC is rotated by 90 degrees; when the threshold voltage Vc is applied to the twisted nematic liquid crystal, the liquid crystal molecules in the TNLC stand up, and then the polarization direction of the incident polarized light passing through the TNLC remains unchanged, and the polarized light with the same polarization state as the incident polarized light is still emitted. If the applied voltage is between 0 and Vc, the polarization direction of the incident polarized light beam passing through the TNLC will be rotated by 0-90 degrees, and the specific rotation angle is related to the applied voltage and the specific material of the TNLC.

[0143] In a possible implementation, the control component, for example, can be a processor, a microprocessor, a controller, and the like, for example, can be a general central processing unit (CPU), a general processor, a digital signal processing (DSP), an application specific integrated circuits (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.

[0144] The structure of a birefringent device is described below. Before describing the structure, the principle of a birefringent device will be explained. See [link / reference]. Figure 7 The diagram shows a schematic of a birefringent device. The optical axis of a birefringent device lies in-plane, that is, parallel to the plane of the paper. Depending on the polarization direction of the incident light, the output light from a birefringent device can be divided into o-rays and e-rays. O-rays, also known as ordinary rays, are polarized perpendicular to the plane of incidence. E-rays, also known as extraordinary rays, are polarized in-plane.

[0145] Because the o-ray and e-ray have different refractive indices when propagating in a birefringent device, they will be deflected after passing through the device, for example, by a displacement of 'a'. The magnitude of the displacement 'a' depends on the specifications of the birefringent device. The magnitude of the displacement 'a' also depends on the thickness of the birefringent device and the included angle θ, which is the angle between the optical axis of the birefringent device and the normal to the surface of the birefringent device. For example, the displacement 'a' satisfies the condition shown in the following formula (1):

[0146]

[0147] Where T represents the thickness of the birefringent device, n o n represents the refractive index of the o-ray. e This represents the refractive index of the e-ray.

[0148] Based on the above formula (1), it can be seen that, to achieve the same displacement a, the smaller the thickness of the birefringent device, the larger the refractive index difference Δn between the o-ray and e-ray of the birefringent device. For example, the relationship between the thickness of the birefringent device and the refractive index difference Δn between the o-ray and e-ray of the birefringent device can be found in [reference needed]. Figure 8 As shown, Figure 8 Taking θ = 45° as an example, the applicant discovered through research that, near θ = 45°, the thickness of the birefringent device is minimal for the same refractive index difference Δn.

[0149] Birefringent devices can be made of crystals, such as quartz crystals, barium borate crystals, lithium niobate crystals, or titanium dioxide crystals. Generally, crystals have a relatively low birefringence, resulting in larger VR or AR devices. In this application, liquid crystal can be used as the material for the birefringent device. The high birefringence of liquid crystal materials allows for a thinner birefringent device, making it easier to place in space-constrained VR or AR devices. Exemplarily, the liquid crystal material can be a liquid liquid crystal material or a UV-curable or thermosetting liquid crystal polymer material.

[0150] In one possible implementation, the display module may further include a folded optical path, see [link to relevant documentation]. Figure 9As shown, taking a birefringent device as an example, the display module includes a display component, a polarization converter, a birefringent device, and a folded optical path in sequence according to the beam transmission direction. The folded optical path is used to direct the beam output from the birefringent device to the human eye. Exemplarily, the folded optical path includes a semi-transparent mirror, a reflective polarizer, one or more imaging lenses, and multiple phase films. The phase films can be used to change the polarization state of the incident light. The imaging lens can be a single spherical lens or an aspherical lens, or a combination of multiple spherical or aspherical lenses. The combination of multiple spherical or aspherical lenses can improve the imaging quality of the system and reduce the aberrations of the system. This application can also use other optical path structures to direct the beam output from the birefringent device to the human eye, and this application does not specifically limit this.

[0151] In some embodiments, the image to be displayed is decomposed into multiple low-resolution images. In one possible implementation, when decomposing the image to be displayed into multiple low-resolution images, subpixel sampling can be used to obtain the multiple frames. This involves treating each subpixel in a pixel unit as a separate pixel for sampling, and then calculating the pixel value of the subpixel of each pixel in each frame to obtain the multiple low-resolution images. For example, the SPR (Segmentation Per Second) method can be used to determine this. During subpixel sampling, subpixels can be sampled from multiple adjacent pixels to form a single subpixel.

[0152] For example, see Figure 10 As shown, this example uses an RGB stipe arrangement. For an example of a single diagonal line, see [link to example]. Figure 10 Image (a) shows a schematic diagram illustrating the concept of pixel unit sampling. See also... Figure 10 Figure (b) shows a schematic diagram of the subpixel sampling concept. Figure 10 (c) is a sampling diagram using red, green, and blue subpixel intervals as an example. Figure 10 As can be seen, after adopting subpixel sampling, the diagonal lines become smoother and the jagged edges are reduced. It should be noted that when the display components adopt different subpixel arrangement methods, the maximum resolution improvement achieved by using the solution provided in this application embodiment may be different, as shown in Table 1.

[0153] Table 1

[0154] Subpixel Arrangement RGB Stipe Pentile RGB Pentile RGBW Delta RGB Number of Subpixels in Each Pixel Cell 3 2 4 2 Maximum Resolution Boost Factor 3 2 4 2

[0155] Taking the first image in a multi-frame image as an example, the sub-pixels included in the first pixel of the first image are sampled from the sub-pixels included in at least h adjacent pixels of the image to be displayed. h represents the number of low-resolution images that need to be decomposed from the image to be displayed.

[0156] For example, the number of decomposed low-resolution images is 2. For example, in the implementation of diagonal super-resolution, the image source (with a resolution of P x Q) is resampled to obtain a to-be-displayed image, the resolution of the to-be-displayed image is 2M x 2N, and the resolution of the display component is M x N (P > M, Q > N). A low-resolution image can be formed by a plurality of sub-pixels of every adjacent 4 pixel points. For example, two low-resolution images include a first image and a second image. The sub-pixels included in a first pixel point in the first image are sampled from the sub-pixels included in adjacent 4 pixel points in the to-be-displayed image; the sub-pixels included in a second pixel point in the second image are sampled from the sub-pixels included in adjacent 4 pixel points; and the position coordinates of the first pixel point in the first image and the position coordinates of the second pixel point in the second image are the same. For example, in the RGBStipe arrangement mode. For example, the to-be-displayed image can be decomposed into two images by sub-pixel interval sampling. For example, as shown in FIG. 39, Figure 11A Figure 11A (a) represents the to-be-displayed image before sampling, Figure 11A (b) represents a low-resolution image sub-frame 1 after sampling, Figure 11A (c) represents a low-resolution image sub-frame 2 after sampling. It can be understood that, Figure 11A the R sub-pixel, the G sub-pixel and the B sub-pixel included in each bold rectangular frame in (b) are a pixel point of a sub-frame 1. It should be understood that, Figure 11A is only an example and does not specifically limit the sampling mode. For example, as shown in FIG. 40, Figure 11B Figure 11B (a) represents the to-be-displayed image before sampling, Figure 11B (b) represents a low-resolution image sub-frame 1 after sampling, Figure 11B (c) represents a low-resolution image sub-frame 2 after sampling. It can be understood that, Figure 11B the R sub-pixel, the G sub-pixel and the B sub-pixel included in each bold rectangular frame in (b) are a pixel point of a sub-frame 1.

[0157] ​​For example, in the case of horizontal super-resolution, the image source (resolution P x Q) is resampled to obtain the image to be displayed, and the resolution of the image to be displayed is 2M x N, and the resolution of the display component is M x N. A low-resolution image can be formed by collecting multiple sub-pixels for every two adjacent horizontal pixel points. For example, the resolution is doubled, and in the case of vertical super-resolution, the image source (resolution P x Q) is resampled to obtain the image to be displayed, and the resolution of the image to be displayed is M x 2N, and the resolution of the display component is M x N. A low-resolution image can be formed by collecting multiple sub-pixels for every two adjacent vertical pixel points. For example, in the case of RGB Stipe arrangement, the image to be displayed can be decomposed into two images by sub-pixel interval sampling. For example, as shown in FIG. 4, Figure 12 Figure 12 (a) indicates the image to be displayed before sampling, Figure 12 (b) indicates the low-resolution image sub-frame 1 after sampling, Figure 12 (c) indicates the low-resolution image sub-frame 2 after sampling. It should be understood that Figure 12 is only an example.

[0158] For example, the number of decomposed low-resolution images is 4. For example, in the case of horizontal super-resolution, vertical super-resolution and diagonal super-resolution, the image source (resolution P x Q) is resampled to obtain the image to be displayed, and the resolution of the image to be displayed is 2M x 2N, and the resolution of the display component is M x N. A low-resolution image can be formed by collecting multiple sub-pixels for every four adjacent pixel points.

[0159] ​It should be noted that if the resolution of the image source is not kMxLN, the image source can be resampled to obtain a resolution of kMxLN of the to-be-displayed image. k is a positive integer, L is a positive integer, and the specific values of k and L are determined by the specific resolution enhancement multiple and the super-resolution direction of the system. For example, when the resolution is doubled in the diagonal direction, k = 2 and L = 2. In some embodiments, the resolution of the image source is kMxLN, that is, the image source is the to-be-displayed image. In one possible example, the control component obtains the to-be-displayed image, and then sends the to-be-displayed image to the display component in time division. For example, after the control component obtains the image source, the image source is processed according to the resolution of the image source and the resolution of the display component to obtain a plurality of low-resolution images. In another possible example, the to-be-displayed image can be obtained by a mobile terminal connected to the display device (such as an AR device or a VR device), for example, the mobile terminal obtains the to-be-displayed image according to the resolution of the image source and the resolution of the display component. Then the mobile terminal sends the to-be-displayed image to the control component. In another possible example, the to-be-displayed image can be obtained by a mobile terminal connected to the AR device or the VR device, for example, the mobile terminal obtains the to-be-displayed image according to the resolution of the image source and the resolution of the display component. Then the mobile terminal decomposes the to-be-displayed image into a plurality of low-resolution images, and then sends the to-be-displayed image to the control component, and sends a control signal to the control component to instruct the display component to display the display signal of the plurality of low-resolution images. The mobile terminal can be a mobile phone, a tablet computer, or a personal computer (PC), etc.

[0160] The pixel position adjustment component is described below as an example including a polarization converter and a birefringent device, as shown in Figure 3A and Figure 3B When the pixel position adjustment component adopts other structures, the implementation manner is similar to that of the polarization converter and the birefringent device, and details are not described herein.

[0161] The scheme provided by the embodiments of the present application is described below in combination with the structure of the display module shown in Figure 3A . Taking a resolution enhancement multiple of 2 as an example, the control component or the terminal device can decompose the to-be-displayed image into two low-resolution images. In this embodiment, diagonal super-resolution is taken as an example. The subframes are displayed in time division, and the control component synchronously sends a modulation signal to the polarization converter and sends a display signal to the display component. For example, at T0, as shown in Figure 13 , a high-level alternating current signal is sent to the polarization converter, and a low-resolution image subframe 1 is synchronously sent to the display component. Taking the TNLC as the polarization converter as an example, at T0, as shown in Figure 14As shown, the polarization converter does not convert the polarization direction of the input target polarized light, so that the birefringent device emits O light, i.e. does not shift the position of the input target light beam, see Figure 13 As shown, at T1, see Figure 13 As shown, the control component sends a low-level AC signal to the polarization converter, and synchronously sends low-resolution image subframe 1 to the display component, at T1, the polarization converter converts the polarization direction of the input target polarized light, so that the birefringent device emits e light, i.e. shifts the position of the input target light beam, see Figure 13 As shown, for example, the image transmitted to the human eye through the optical path is equivalent to the superposition of low-resolution image subframe 1 and low-resolution image subframe 2, see Figure 15 As shown. Figure 15 Each bold black box in the figure represents a pixel.

[0162] Using the above method, the equivalent resolution of the display component can be doubled, of course, higher resolution enhancement can also be achieved, but multiple sets of polarization converters and birefringent devices are required. By controlling the azimuth angle between the birefringent device and the display component, resolution enhancement in horizontal, vertical and any direction can be achieved. The resolution enhancement algorithm of the present application uses time-sharing display of low-resolution images, and uses the human eye's visual persistence and visual integration functions to synthesize high-resolution images in the brain, so that the frame rate of the synthesized high-resolution images is reduced by a certain percentage relative to the highest frame rate of the display component.

[0163] As another example, using the RGB Stipe arrangement as an example, the structure of the display module is taken as Figure 3B In the implementation of the present application, the control component or the terminal device can decompose the image to be displayed into 4 low-resolution images. Exemplarily, the first pixel position adjustment component and the second pixel position adjustment component are combined to realize horizontal super-resolution, vertical super-resolution and diagonal super-resolution. In some embodiments, the resolution of the display component is MxN. If the resolution of the image source is not 2Mx2N, the image source can be resampled to obtain the image to be displayed, so that the resolution of the image to be displayed is 2Mx2N. When decomposing the image to be displayed, 4 images can be first collected by sampling, and then the pixel values of the sub-pixels of each pixel point in each image can be further calculated, for example, the SPR method can be used to determine. Taking one image as an example, the sub-pixel values of one pixel point in the image can be obtained by sampling from the sub-pixels included in the adjacent 4 pixel points. Exemplarily, the image to be displayed is decomposed into 4 images by using sub-pixel sampling. For example, see Figure 16A As shown, Figure 16A In (a), the image to be displayed before sampling, Figure 16A(b)-(e) represent low resolution image sub-frames 1 -4 after sampling. Figure 16A By way of example only, and without limitation to the specific sampling approach. For example, see Figure 16B as shown, Figure 16B (a) represents the image to be displayed before sampling, Figure 16B (b)-(e) represent low resolution image sub-frames 1 -4 after sampling. Figure 16B By way of example only, and without limitation to the specific sampling approach.

[0164] It should be understood that the O optical axis of the second birefringent device coincides with the O optical axis of the first birefringent device, and the e optical axis of the second birefringent device is perpendicular to the e optical axis of the first birefringent device. As an example, see Table 1. When the polarization converter is in the off state, the polarization converter does not convert the polarization direction of the input target polarized light, so that the birefringent device emits O light, that is, the input target light beam is not shifted. When the polarization converter is in the on state, the polarization converter converts the polarization direction of the input target polarized light, so that the birefringent device emits e light. When the first birefringent device emits e light, the target light beam is shifted in the horizontal direction, and when the second birefringent device emits e light, the target light beam is shifted in the vertical direction. See Table 1. In the first time unit, the control component controls the display component to display subframe 1, controls the first polarization converter to be in the ON state, and controls the second polarization converter to be in the OFF state. It can be understood that the control component controls the display component to start displaying subframe 1 at T0, and sends a high-level modulation signal to the first polarization converter and the second polarization converter. Thus, the target polarized light carrying subframe 1 does not undergo beam shift after passing through the first birefringent device and the second birefringent device. In the second time unit, that is, when T1 arrives, the control component controls the display component to display subframe 2, controls the first polarization converter to be in the OFF state, and controls the second polarization converter to be in the ON state. It can be understood that the control component controls the display component to start displaying subframe 2 at T1, sends a low-level modulation signal to the first polarization converter, and sends a high-level modulation signal to the second polarization converter. Thus, the target polarized light carrying subframe 2 undergoes beam horizontal shift after passing through the first birefringent device, and no longer continues to shift after passing through the second birefringent device. It can be understood that the target polarized light carrying subframe 2 undergoes beam horizontal shift after passing through the first birefringent device and the second birefringent device. In the third time unit, that is, when T2 arrives, the control component controls the display component to display subframe 3, controls the first polarization converter to be in the ON state, and controls the second polarization converter to be in the OFF state. It can be understood that the control component controls the display component to start displaying subframe 3 at T2, sends a high-level modulation signal to the first polarization converter, and sends a low-level modulation signal to the second polarization converter. Thus, the target polarized light carrying subframe 3 does not undergo beam shift after passing through the first birefringent device, and undergoes beam vertical shift after passing through the second birefringent device. It can be understood that the target polarized light carrying subframe 3 undergoes beam vertical shift after passing through the first birefringent device and the second birefringent device. In the fourth time unit, that is, when T4 arrives, the control component controls the display component to display subframe 4, controls the first polarization converter to be in the OFF state, and controls the second polarization converter to be in the OFF state.It can be understood that the control component controls the display component to start displaying the subframe 4, sends a high-level modulation signal to the first polarization converter, and sends a high-level modulation signal to the second polarization converter at the T3 moment. Thus, the target polarization light carrying the subframe 4 undergoes beam horizontal shift through the first birefringent device and continues to undergo beam vertical shift after passing through the second birefringent device. It can be understood that the target polarization light carrying the subframe 4 undergoes beam diagonal shift after passing through the first birefringent device and the second birefringent device. Then, the image transmitted to the human eye through the optical path is equivalent to the superposition of the low-resolution image subframes 1-low-resolution image subframes 4, as shown in FIG. 4. Figure 17 The low-resolution image subframes above the four arrows are superimposed to obtain the effect below the arrows. It can be seen that the resolution is increased by 4 times.

[0165] It should be noted that the sequence of the display subframes 1-subframes 4 is not specifically limited in the embodiment of the present application.

[0166] Table 1

[0167]

[0168] By using the above method, the equivalent resolution of the display component can be increased by 4 times. In the embodiment of the present application, the resolution enhancement in the horizontal, vertical and any direction can be realized by controlling the azimuth angle between the birefringent device and the display component. The resolution enhancement algorithm of the present application uses time-sharing display of low-resolution images, and uses the visual persistence and visual integration functions of the human eye to synthesize high-resolution images in the brain. Therefore, the frame rate of the synthesized high-resolution images is reduced by a certain percentage relative to the highest frame rate of the display component.

[0169] The embodiment of the present application adopts a sub-pixel level decomposition method to split the image to be displayed. After sub-pixel sampling, the edge will be smoother and the sawtooth feeling will be weaker, but there may be color edge problems. Based on this, in order to weaken the color edge, the embodiment of the present application provides a sub-pixel rendering (SPR) method to determine the pixel value of each sub-pixel of the sample. When determining the pixel value of the sampled sub-pixel, the pixel value of the same color sub-pixel in the setting area around the sampling position can be determined. For example, the pixel value of the setting color sub-pixel of the pixel (i, j) can be determined by weighting the pixel value of the setting color sub-pixel of the pixel (i, j) and the pixel value of the setting color sub-pixel of the surrounding pixel. Exemplarily, the weight of the sub-pixel with the same color as the first sub-pixel color included in the setting area is inversely proportional to the distance between the sub-pixels. The distance between the sub-pixels is the distance between the sub-pixel with the same color as the first sub-pixel color and the first sub-pixel in the sampling position of the image to be displayed.

[0170] In some embodiments, the size of the setting region is related to the distance between the display component and the imaging plane of the wearable device. For example, the greater the distance between the display component and the imaging plane of the wearable device, the greater the size of the setting region. It can be understood that the distance between the display component and the imaging plane of the wearable device is inversely proportional to the size of the setting region. In some embodiments, the size of the setting region is related to the pixel size of the display component. The size of the setting region can be configured according to the pixel size of the display component. In yet other embodiments, the size of the setting region is related to the display content of the display component. For example, the size of the setting region can be adaptively adjusted according to the display content of the display component. For example, if the display content displays more details, the size of the setting region can be increased, and conversely, if the display content displays less details, the size of the setting region can be decreased. For example, the size of the setting region can be adaptively adjusted according to the scene to which the image displayed by the display component belongs. For example, the size of the setting region corresponding to a person scene is greater than the size of the setting region corresponding to a grassland scene.

[0171] In some embodiments, the pixel value of the sub-pixel of the sampled pixel point can be determined using the following formula, taking the first sub-pixel as an example:

[0172] q(i,j) = a1*Q(i-1,j) + a2*Q(i,j-1) + a3*Q(i+1,j) + a4*Q(i,j+1) + a5*Q(i,j);

[0173] wherein q(i,j) represents the pixel value of the first sub-pixel; i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed; j represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed; Q(i,j) represents the pixel value of the sub-pixel of the sampling position of the first sub-pixel in the image to be displayed; a1, a2, a3, a4 and a5 represent weights, respectively.

[0174] In other embodiments, the pixel value of the sub-pixel of the sampled pixel point can be determined using the following formula, taking the first sub-pixel as an example:

[0175] q(i,j+1) = a1*Q(i-1,j) + a2*Q(i,j-1) + a3*Q(i+1,j) + a4*Q(i,j+1)

[0176] + b1*Q(i-1,j+1) + b2*Q(i,j) + b3*Q(i+1,j+1) + b4*Q(i,j+2).

[0177] Where q(i,j+1) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in the image to be displayed, j+1 represents the vertical coordinate of the first sub-pixel in the image to be displayed, Q(i,j+1) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, and α1, α2, α3, α4, β1, β2, β3 and β4 represent weights respectively.

[0178] As an example, taking RGB stripe subpixel arrangement, during the SPR process, the pixel value g(i,j) of the green subpixel at position (i,j) can be jointly determined by the green G component of the pixels within the rhombus formed by the green subpixels at positions (i-2,j), (i-1,j-1), (i,j-2), (i+1,j-1), (i+2,j), (i+1,j+1), (i-1,j+1), and (i,j+2). Exemplarily, green subpixels whose area within the rhombus is no more than 50% are not included in the determination. Based on this, the green subpixel at position (i,j) is determined by a weighted average of the pixel values ​​of the green subpixels at positions (i,j), (i-1,j), (i,j-1), (i+1,j), and (i,j+1).

[0179] For example, g(i,j) = α1*G(i-1,j) + α2*G(i,j-1) + α3*G(i+1,j) + α4*G(i,j+1) + α5*G(i,j). For instance, the weights α1, α2, α3, α4, and α5 corresponding to (i,j), (i-1,j), (i,j-1), (i+1,j), and (i,j+1) can be determined based on the distance between each pixel and the pixel at position (i,j). For example, α1 = α2 = α3 = α4 = 0.125, α5 = 0.5.

[0180] For example, see Figure 18 The pixel value of the green subpixel of pixel (i,j) in the low-resolution subframe 1 shown can be determined by weighting the pixel value of the green subpixel in the pixel at the position of the black dot in the image to be displayed and its own pixel value.

[0181] As another example, the pixel value r(i,j+1) of the red subpixel at position (i,j+1) can be jointly determined by the red R component of the pixels within the rhombus formed by the red subpixels at positions (i-2,j+1), (i-1,j), (i,j-1), (i+1,j), (i+2,j+1), (i+1,j+2), (i,j+3), and (i-1,j+1). Exemplarily, red subpixels whose area within the rhombus is no more than 50% are not included in the determination.

[0182] Based on this, the pixel value of the red sub-pixel of position (i, j+1) is determined by the pixel values of the red sub-pixels of the eight pixels of positions (i-1, j), (i, j-1), (i+1, j), (i, j+1), (i-1, j+1), (i, j), (i+1, j+1), (i, j+2) weighted.

[0183] Exemplarily, the eight pixels can be divided into two categories, the red sub-pixels of the four pixels of positions (i, j+1) surrounding the upper, lower, left and right as the second category, and the red sub-pixels of the remaining pixels as the first category. The weight distribution ratio of the two categories of sub-pixels is 0.5:0.5.

[0184] Then the pixel value r(i, j+1) of the red sub-pixel of position (i, j+1) can be determined by the following way:

[0185] r(i, j+1) = α1*R(i-1, j) + α2*R(i, j-1) + α3*R(i+1, j) + α4*R(i, j+1)

[0186] + β1*R(i-1, j+1) + β2*R(i, j) + β3*R(i+1, j+1) + β4*R(i, j+2).

[0187] The weights corresponding to the eight sub-pixels can be determined by the distances between the geometric centers of the pixels where the eight sub-pixels are located and the red sub-pixel of position (i, j+1). Taking the sub-pixel aspect ratio of 1:3 as an example.

[0188] Exemplarily, the weights corresponding to the eight sub-pixels are determined by the following formulas respectively:

[0189] The first category:

[0190]

[0191]

[0192]

[0193] The second category:

[0194]

[0195]

[0196] Wherein, x represents the relationship between the proportion allocated for calculating the pixel value of the red sub-pixel and the distance; x<0.

[0197] For example, see Figure 19The pixel value of the red sub-pixel of the pixel (i, j+1) of the low-resolution sub-frame 1 shown in the sampling time can be determined by the pixel value of the red sub-pixel in the black dot position pixel in the image to be displayed and the pixel value of itself. And the weight corresponding to the 8 sub-pixels participating in the determination of the pixel value of the red sub-pixel (i, j+1) can be seen from Figure 19 The black solid circle represents the red sub-pixel (i, j+1), and the black dashed hollow circle represents the center position of the 8 pixels of the pixel value of the red sub-pixel (i, j+1). Further, the weight can be determined according to the distance between the black dashed hollow circle and the black solid circle.

[0198] Based on the above-mentioned manner of determining the pixel value of the red sub-pixel, the manner of determining the pixel value b(i, j) of the blue sub-pixel at the position (i, j+1) in the SPR process can be obtained.

[0199] In some embodiments, the application supports the display module working in two working modes. The super-resolution mode and the normal mode. The control component determines the super-resolution mode to be enabled, and performs the super-resolution processing. When the normal mode is determined to be enabled, the resolution is kept unchanged, and the frame rate is not reduced. In this normal mode, the TNLC uniformly keeps the polarization mode of the target polarized light unchanged (or uniformly changes the polarization direction by 90 degrees). In some embodiments, the control component can resample the image source to the resolution of the display component and directly output to the display component. This normal mode can be applied to some high frame rate scenarios, such as games and the like.

[0200] In the embodiments of the application, in order to improve the resolution of the image and improve the imaging effect, another display module is also provided, which realizes super-resolution through a polarization converter and a birefringent device.

[0201] Referring to Figure 20 As shown, the display module includes a display component 2301, a polarization rotator 2302, a birefringent device 2303, and a control component 2304. The display component 2301, the polarization rotator 2302, and the birefringent device 2303 are placed in sequence in the direction of light transmission. Referring to Figure 21As shown, the display module further includes a folded light path 2305. The display component 2301 is configured to display an image. The polarization rotator 2302 can modulate the polarization direction of the incident polarized light according to the amplitude of the voltage signal applied thereto, so as to achieve polarization rotation at any angle, and can achieve pixel or sub-pixel level independent control through the array transistor on the polarization rotator 2302. After the display component 2301 receives a to-be-processed image, the display component 2301 displays the to-be-displayed image. The resolution of the to-be-processed image is the same as the resolution of the display component. The polarization rotator 2302 adjusts the polarization direction of the light beam of each pixel (or each sub-pixel in the pixel) of the to-be-processed image under the control of the control component 2304, and outputs to the birefringent device 2303. The birefringent device 2303 decomposes the light beam of each pixel included in the to-be-processed image, and outputs a first target polarized light for projecting a first sub-image at a first position and a second target polarized light for projecting a second sub-image at a second position. The polarization direction of the polarized light input at different pixel positions can be different, and the decomposition ratio of the two pixels with different polarization directions is also different. The working principle of the birefringent device 2303 can be referred to the description of Figure 6 The birefringent device can output o light and e light according to the different polarization directions of the incident light. The o light can be referred to as ordinary light, and the polarization direction is perpendicular to the incident plane. The e light can also be referred to as extraordinary light, and the polarization direction is in the incident plane. In some embodiments, the birefringent device outputs only o light when inputting a light beam with a certain polarization direction, and outputs only e light when inputting a light beam with another polarization direction. Under the remaining polarization directions, both o light and e light are output. The embodiments of the present application utilize this principle to input target polarized light with different polarization directions in the birefringent device for different pixel or sub-pixel positions, so that the pixels of the two positions output by the birefringent device 2303 are approximately the same or infinitely close to the pixel value of the pixel at the corresponding position of the to-be-displayed image after superposition. Taking a first pixel and a second pixel as an example, the first pixel and the second pixel are two pixels with different polarization directions in the to-be-processed image. The decomposition ratio of the first pixel is different from the decomposition ratio of the second pixel, and the decomposition ratio of the first pixel is the ratio of the light intensity of the pixel in the first sub-image to the light intensity of the pixel in the second sub-image after the light beam of the first pixel is decomposed and projected, and the decomposition ratio of the second pixel is the ratio of the light intensity of the pixel in the first sub-image to the light intensity of the pixel in the second sub-image after the light beam of the second pixel is decomposed and projected.

[0202] The polarization rotator 2302 can be any one of a twisted nematic polarization rotator (TNPR), an in-Plane switching polarization rotator (IPSPR), cholesteric liquid crystals (CLC) and 1 / 4 wave plate combination, a TNLC with thin film transistor (TFT) circuit, and the like.

[0203] Taking the TNLC with TFT as an example, the TNLC with TFT is composed of a liquid crystal layer sandwiched between two conductive substrates. When a voltage is applied to the TNLC with TFT between 0 and Vc, the polarization direction of the incident polarized light beam will rotate by 0-90 degrees after passing through the TNLC, and the specific rotation angle is related to the applied voltage and the specific material of the TNLC.

[0204] The display component 2301 can be a common liquid crystal display screen (LCD), an OLED, or a more advanced micro-LED display screen. The OLED display has higher luminous efficiency and higher contrast; the mini-LED display has higher luminous brightness and can be applied to scenes requiring higher luminous brightness.

[0205] In a possible implementation, the control component 2304, for example, can be a processor, a microprocessor, a controller, and the like, for example, can be a general central processing unit (CPU), a general processor, a digital signal processing (DSP), an application specific integrated circuits (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof.

[0206] The birefringent device can adopt a crystal, such as a quartz crystal, a barium borate crystal, a quartz crystal, a lithium niobate crystal, or a titanium dioxide crystal. Generally, the birefringence of the crystal is small, resulting in a large size of the VR device or the AR device. The embodiments of the present application can use liquid crystal as the material of the birefringent device, and use the large birefringence of the liquid crystal material to make the thickness of the birefringent device small, which can be better placed in the VR device or the AR device with limited space. Exemplarily, the liquid crystal material can adopt a liquid liquid crystal material or a liquid crystal polymer material that is ultraviolet-cured or heat-cured. Exemplarily, the birefringent device 2303 adopts a liquid crystal polymer RM 257, after surface orientation or electric field orientation, the included angle between the liquid crystal molecule director and the surface is about 45 degrees, and then the liquid crystal polymer is formed by ultraviolet curing.

[0207] For the convenience of description, the devices in the display module are no longer numbered in the subsequent description. Referring to Figure 22 As shown, taking the vertical linearly polarized light emitted by the display assembly as an example, after the vertical linearly polarized light passes through the polarization rotator, the polarization rotator can rotate the vertical linearly polarized light into linearly polarized light of any angle by controlling the voltage signal applied to the polarization rotator by the control assembly. Since the polarization rotator can achieve sub-pixel level control, the polarization direction of each pixel, or even each sub-pixel in the display assembly after passing through the polarization rotator is not completely consistent. After the light beam passes through the polarization rotator and reaches the birefringent device, it is divided into two beams of light, o light and e light. The intensity ratio of the two beams of light is determined by the polarization direction or polarization angle of the incident light, as shown. Figure 22 .

[0208] As can be seen from the above, in fact, one light beam will be divided into two light beams after passing through the birefringent device, and the two light beams correspond to two images, which are a first sub-image and a second sub-image. According to the birefringent device arranged in the display module, the position of the first sub-image and the position of the second sub-image are spaced by Py / 2 in the vertical direction and / or Px / 2 in the horizontal direction, wherein Py represents the pitch of the pixels in the vertical direction, and Px represents the pitch of the pixels in the horizontal direction. After entering the human eye through the two sub-images, the high-resolution image is synthesized in the brain by using the visual persistence and visual integration functions of the human eye, so that the frame rate of the synthesized high-resolution image is reduced, but the resolution is improved.

[0209] In the embodiments of the present application, the control component can estimate and adjust the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image, so that the similarity between the superimposed projected image and the to-be-displayed image is greater than a set threshold, or in other words, the superimposed projected image is substantially the same as the to-be-displayed image. The set threshold is determined according to the perception ability of the human eye to image differences. Then, the control component can control the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image according to the luminous intensity of each pixel of the adjusted first sub-image and the luminous intensity of each pixel of the second sub-image. For the polarization rotator, different polarization directions correspond to a corresponding relationship between the luminous intensity distribution ratio of the output o light and e light. Therefore, after the luminous intensity of each pixel of the first sub-image and the second sub-image is adjusted, the corresponding relationship can be used to determine the required polarization direction of the input light beam of each pixel. For the polarization rotator, different polarization directions correspond to different voltage application voltages, so that the control component can apply a corresponding voltage application voltage to each pixel or sub-pixel according to the corresponding voltage application voltage.

[0210] Exemplarily, the voltage signal intensity of each pixel (or sub-pixel) on the polarization rotator and the content of the display component can be obtained according to the following optimization formula (1):

[0211]

[0212] wherein S is a column vector composed of all pixel values of the target image; R is a high-resolution image composed of a low-resolution first sub-image V1 composed of o light and a low-resolution second sub-image V2 composed of e light, which can be understood as an actually displayed image. The arrangement of the column vector of each pixel or sub-pixel in R is similar to the arrangement of the column vector of each pixel or sub-pixel in S.

[0213] M is a mapping matrix for mapping the first sub-image V1 and the second sub-image V2 to R.

[0214] Exemplarily, taking diagonal superposition as an example, refer to FIG. 6. Figure 23 As shown in FIG. 6, the to-be-processed image is decomposed into a first sub-image (o light sub-frame V1) and a second sub-image (e light sub-frame V2) after passing through the birefringent device. The image composed of the first sub-image and the second sub-image is shown in FIG. 7. Figure 23 Taking pixel 9 in the high-resolution image as an example, the pixel 9 is composed of pixel 2 in the o light sub-frame V1 and pixel 6 in the e light sub-frame V2, so refer to the ninth row in the mapping matrix M, except that the second element and the P+6th element are 1, all other elements are 0 (wherein P is the total number of sub-frames).

[0215] Exemplarily, the mapping matrix M is as follows:

[0216]

[0217] Based on the above content and the same technical concept, the embodiment of the present application further provides an imaging control method applied to a wearable device. The wearable device comprises a display component and a pixel position adjustment component, and the pixel position adjustment component comprises a polarization converter and a birefringent device.

[0218] Referring to Figure 24 Fig. 1 shows a possible imaging control method flowchart. The method is applied to a display device, and the display device comprises a display component and a pixel position adjustment component. The display component comprises a plurality of pixels, and each pixel comprises a plurality of sub-pixels.

[0219] 2301, receiving an image to be displayed, and performing sub-pixel level decomposition on the image to be displayed to obtain a plurality of images. The resolution of each image in the plurality of images is the same as the resolution of the display component, and the resolution of the plurality of images is smaller than the resolution of the image to be displayed.

[0220] 2302, controlling the pixel position adjustment component to adjust the position of each image displayed by the display component in time.

[0221] The time when the display component displays a first image is synchronized with the time when the pixel position adjustment component adjusts the first image, and the first image is any image in the plurality of images.

[0222] In some embodiments, the display device supports two modes, a super-resolution mode or a normal mode.

[0223] When the super-resolution mode of the display device is enabled, the image to be displayed is decomposed at a sub-pixel level to obtain a plurality of images.

[0224] When the super-resolution mode of the display device is not enabled, i.e., the normal mode is enabled, the image to be displayed is down-sampled to obtain a processed image; the processed image is input to the display component, so that the display component displays the processed image; and the pixel position adjustment component outputs the processed image at a set position. It can be understood that the polarization converter no longer adjusts the switching state, i.e., the polarization direction of the target polarized light to be output is no longer controlled.

[0225] In some embodiments, a first pixel point in a first image in the plurality of images comprises sub-pixels sampled from sub-pixels comprised in at least h adjacent pixel points in the image to be displayed.

[0226] wherein h is the number of images of the multi-frame image, the first image is any image in the multi-frame image, and the first pixel point is any pixel point in the first image.

[0227] In some embodiments, the pixel value of the first sub-pixel included in the first pixel point is determined according to pixel values of sub-pixels of the same color as the first sub-pixel included in a set region of the to-be-displayed image.

[0228] The geometric center of the set region is the sampling position of the first sub-pixel in the to-be-displayed image.

[0229] In some embodiments, the pixel value of the first sub-pixel included in the first pixel point is obtained by weighted summation of pixel values of sub-pixels of the same color as the first sub-pixel included in a set region.

[0230] wherein the weight of the sub-pixel of the same color as the first sub-pixel included in the set region is inversely proportional to the distance between the sub-pixels; and the distance between the sub-pixels is the distance between the sampling positions of the sub-pixels of the same color as the first sub-pixel and the first sub-pixel in the to-be-displayed image.

[0231] In some embodiments, the display device is a wearable device, and the size of the set region is related to the distance between the display component and the imaging plane of the wearable device.

[0232] In some embodiments, the size of the set region is related to the pixel size of the display component.

[0233] In some embodiments, the size of the set region is related to the display content of the display component.

[0234] In some embodiments, the pixel value of the first sub-pixel satisfies the condition shown in the following formula:

[0235] q(i,j)=α1*Q(i-1,j)+α2*Q(i,j-1)+α3*Q(i+1,j)+α4*Q(i,j+1)+α5*Q(i,j);

[0236] wherein q(i,j) represents the pixel value of the first sub-pixel; i represents the horizontal coordinate of the first sub-pixel in the pixel point of the to-be-displayed image; j represents the vertical coordinate of the first sub-pixel in the pixel point of the to-be-displayed image; Q(i,j) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the to-be-displayed image; and α1, α2, α3, α4 and α5 represent weights, respectively.

[0237] In some embodiments, the pixel value of the first sub-pixel satisfies the condition shown in the following formula:

[0238] q(i, j+1) = a1*Q(i-1, j) + a2*Q(i, j-1) + a3*Q(i+1, j) + a4*Q(i, j+1)

[0239] + b1*Q(i-1, j+1) + b2*Q(i, j) + b3*Q(i+1, j+1) + b4*Q(i, j+2).

[0240] wherein q(i, j+1) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed, j+1 represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed, Q(i, j+1) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, a1, a2, a3, a4, b1, b2, b3 and b4 represent weights respectively.

[0241] In some embodiments, the pixel position adjustment component comprises a polarization converter and a polarization displacement device;

[0242] The pixel position adjustment component is controlled to adjust the position of each frame of image displayed by the display component in time, comprising: inputting multiple frames of image to the display component in time, so that the display component emits target polarized light in time, wherein the target polarized light is used to carry each frame of image in the multiple frames of image; controlling the polarization converter to adjust the polarization direction of the output target polarized light in time, so that when the polarization direction of the target polarized light output by the polarization converter is the first polarization direction, the polarization displacement device outputs the target polarized light at the first position, and when the polarization direction of the target polarized light output by the polarization converter is the second polarization direction, the polarization displacement device outputs the target polarized light at the second position.

[0243] In some embodiments, the multiple frames of image comprise a first image and a second image;

[0244] The polarization converter is controlled to adjust the polarization direction of the output target polarized light in time, comprising:

[0245] In the first time unit, the polarization converter is controlled to adjust the polarization direction of the target polarized light carrying the first image output to the first polarization direction, and in the second time unit, the polarization converter is controlled to adjust the polarization direction of the target polarized light carrying the second image output to the second polarization direction, so that the first position of the target polarized light carrying the first image output by the polarization displacement device and the second position of the target polarized light carrying the second image output by the polarization displacement device are spaced apart by Px / 2 in the horizontal direction; Px represents the interval of adjacent pixels of the first image or the second image in the horizontal direction.

[0246] In some embodiments, the first pixel point in the first image comprises sub-pixels sampled from sub-pixels comprised in two horizontally adjacent pixel points in the image to be displayed;

[0247] The sub-pixels included in the second pixel in the second image are sampled from the sub-pixels included in two horizontally adjacent pixels.

[0248] The position coordinates of the first pixel in the first image are the same as the position coordinates of the second pixel in the second image.

[0249] In some embodiments, the multiple frames of images include a first image and a second image.

[0250] The polarization direction of the target polarized light output by the polarization converter is controlled to be adjusted in time, including:

[0251] The polarization direction of the target polarized light carrying the first image output by the polarization converter is controlled to be adjusted to be the first polarization direction in the first time unit, and the polarization direction of the target polarized light carrying the second image output by the polarization converter is controlled to be adjusted to be the second polarization direction in the second time unit, so that the first position of the target polarized light carrying the first image output by the polarization shifting device and the second position of the target polarized light carrying the second image output by the polarization shifting device are spaced apart by Py / 2 in the vertical direction; Py represents the spacing of adjacent pixels in the vertical direction of the first image or the second image.

[0252] In some embodiments, the sub-pixels included in the first pixel in the first image are sampled from the sub-pixels included in two vertically adjacent pixels in the image to be displayed.

[0253] The sub-pixels included in the second pixel in the second image are sampled from the sub-pixels included in two vertically adjacent pixels.

[0254] The position coordinates of the first pixel in the first image are the same as the position coordinates of the second pixel in the second image.

[0255] In some embodiments, the multiple frames of images include a first image and a second image.

[0256] The polarization direction of the target polarized light output by the polarization converter is controlled to be adjusted in time, including:

[0257] The polarization direction of the target polarized light carrying the first image input by the polarization converter is controlled to be adjusted to be the first polarization direction in the first time unit, and the polarization direction of the target polarized light carrying the second image input by the polarization converter is controlled to be adjusted to be the second polarization direction in the second time unit, so that the first position of the target polarized light carrying the first image output by the polarization shifting device and the second position of the target polarized light carrying the second image output by the polarization shifting device are spaced apart by Py / 2 in the vertical direction and offset by Px / 2 in the horizontal direction, Py represents the spacing of adjacent pixels in the vertical direction of the first image or the second image, and Px represents the spacing of adjacent pixels in the vertical direction of the first image or the second image.

[0258] In some embodiments, the sub-pixel included in the first pixel in the first image is sampled from sub-pixels included in two adjacent pixels in a diagonal direction in the image to be displayed.

[0259] The sub-pixel included in the second pixel in the second image is sampled from sub-pixels included in two adjacent pixels in a diagonal direction.

[0260] The position coordinates of the first pixel in the first image are the same as the position coordinates of the second pixel in the second image.

[0261] Embodiments of the present application also provide another imaging control method, which is applied to a wearable device. The wearable device includes a display component and a pixel position adjustment component, and the pixel position adjustment component includes a polarization rotator and a birefringent device.

[0262] Referring to Figure 25 , a possible imaging control method flow diagram is shown.

[0263] 2401, receiving an image to be displayed, performing down-sampling processing on the image to be displayed to obtain a to-be-processed image, and inputting the to-be-processed image to a display component, so that the display component emits target polarized light carrying the image to be displayed, wherein the target frame image is one of a plurality of frame images, and the resolution of the to-be-processed image is the same as the resolution of the display component;

[0264] 2402, controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image output by the polarization rotator, so that the birefringent device decomposes the light beam of each pixel included in the to-be-processed image, and outputs first target polarized light used for projecting a first sub-image at a first position and second target polarized light used for projecting a second sub-image at a second position;

[0265] Wherein, the decomposition ratio of the first pixel is different from the decomposition ratio of the second pixel, the first pixel and the second pixel are two pixels with different polarization directions in the to-be-processed image, the decomposition ratio of the first pixel is the ratio of the light intensity of the light beam of the first pixel projected on the pixel of the first sub-image to the light intensity of the light beam of the first pixel projected on the pixel of the second sub-image after decomposition, and the decomposition ratio of the second pixel is the ratio of the light intensity of the light beam of the second pixel projected on the pixel of the first sub-image to the light intensity of the light beam of the second pixel projected on the pixel of the second sub-image after decomposition.

[0266] In some embodiments, the position of the first sub-image and the position of the second sub-image are spaced by Py / 2 in the vertical direction and / or spaced by Px / 2 in the horizontal direction, Py represents the vertical spacing of the pixels, and Px represents the vertical spacing of the pixels.

[0267] In some embodiments, the control polarization rotator adjusts the polarization direction of the light beam of each pixel of the outputted to-be-processed image, including:

[0268] The control polarization rotator adjusts the polarization direction of the light beam of each pixel of the to-be-processed image including sub-pixels.

[0269] In some embodiments, the control polarization rotator adjusts the polarization direction of the light beam of each pixel of the outputted to-be-processed image, including:

[0270] According to the luminous intensity of each pixel of the to-be-displayed image, the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image are estimated; wherein the resolution of the first sub-image and the second sub-image is the same and smaller than the resolution of the to-be-displayed image;

[0271] According to the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image, the control polarization rotator adjusts the polarization direction of the light beam of each pixel of the to-be-processed image.

[0272] In some embodiments, the control polarization rotator adjusts the polarization direction of the light beam of each pixel of the outputted to-be-processed image, including:

[0273] The luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image are estimated and adjusted, so that the similarity between the superimposed projected image of the adjusted first sub-image and the second sub-image and the to-be-displayed image is greater than a set threshold; the set threshold is determined according to the perception ability of the human eye to the difference of the image;

[0274] According to the luminous intensity of each pixel of the adjusted first sub-image and the luminous intensity of each pixel of the second sub-image, the control polarization rotator adjusts the polarization direction of the light beam of each pixel of the to-be-processed image.

[0275] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, so that the processor can read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a head-mounted display device or a terminal device. Of course, the processor and the storage medium can also exist as discrete components in the head-mounted display device or the terminal device.

[0276] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are performed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable apparatus. The computer programs or instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium, for example, the computer programs or instructions can be transferred from one website, computer, server, or data center to another website, computer, server, or data center through a wired or wireless manner. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that integrates one or more available media. The available media can be a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape; an optical medium, such as a digital video disc (DVD); or a semiconductor medium, such as a solid state drive (SSD).

[0277] In the various embodiments of the present application, the terms and / or descriptions among different embodiments are consistent and can be referred to each other if there is no special description and logical conflict, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0278] In the present application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B can represent the following cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can represent a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple. In the textual description of the present application, the character " / " generally represents that the associated objects before and after are in an "or" relationship. In the formula of the present application, the character " / " represents that the associated objects before and after are in a "division" relationship. In the present application, the symbol "(a, b)" represents an open interval, which is greater than a and less than b; "[a, b]" represents a closed interval, which is greater than or equal to a and less than or equal to b; "(a, b]" represents a half-open half-closed interval, which is greater than a and less than or equal to b; "(a, b]" represents a half-open half-closed interval, which is greater than a and less than or equal to b. In addition, in the present application, the word "example" is used to mean as an example, illustration or description. Any embodiment or design scheme described as "example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Alternatively, it can be understood that the use of the word "example" is intended to present the concept in a specific way and does not limit the present application.

[0279] It can be understood that various numerical numbers involved in the present application are only for convenient differentiation and do not limit the scope of the embodiments of the present application. The size of the serial number of the above processes does not mean the order of execution, and the execution order of the processes should be determined according to their functions and inherent logic. The terms "first", "second", and the like similar expressions are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, including a series of steps or units. The method, system, product or device does not have to be limited to those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0280] Although the application has been described in conjunction with specific embodiments thereof, it will be evident that many alternatives, modifications and variations will be apparent to those of ordinary skill in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations as can come within the scope of the application. All publications, patents and patent applications cited herein are hereby incorporated by reference in their entirety for all purposes.

[0281] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A display module, characterized by The display module comprises a display component, a pixel position adjustment component and a control component, the display component comprises a plurality of pixels, each pixel of the plurality of pixels comprises a plurality of sub-pixels; The display component is configured to display a plurality of frames of images in time under the control of the control component, the plurality of frames of images are obtained by sub-pixel level decomposition of a to-be-displayed image, the resolution of the plurality of frames of images is the same as the resolution of the display component, and the resolution of the plurality of frames of images is smaller than the resolution of the to-be-displayed image; The pixel position adjustment component is configured to adjust the position of each frame of image displayed by the display component in time under the control of the control component; The display component displays a first image, and the time for adjusting the first image by the pixel position adjustment component is synchronized with the time for displaying the first image by the display component, the first image is any image in the plurality of frames of images; The pixel position adjustment component comprises a polarization converter and a polarization displacement device; The polarization converter is configured to adjust the polarization direction of a target polarized light output by the polarization converter in time under the control of the control component, the target polarized light carries a frame of image in the plurality of frames of images; The polarization displacement device is configured to output the target polarized light at a first position when the polarization direction of the target polarized light output by the polarization converter is a first polarization direction, and output the target polarized light at a second position when the polarization direction of the target polarized light output by the polarization converter is a second polarization direction.

2. The display module of claim 1, wherein, The polarization displacement device is a birefringent device or a polarization grating.

3. The display module of claim 1 or 2, wherein, The polarization converter comprises a twisted nematic liquid crystal or an in-plane switching liquid crystal; or the polarization converter comprises a cholesteric liquid crystal and a 1 / 4 wave plate.

4. The display module of claim 2, wherein the display module is configured to be mounted on a display device. The birefringent device is a birefringent liquid crystal, and the birefringent liquid crystal adopts a quartz crystal, a barium borate crystal, a lithium niobate crystal or a titanium dioxide crystal or a liquid crystal polymer.

5. The display module of claim 1 or 2, wherein, The control component is specifically configured to receive the to-be-displayed image, decompose the to-be-displayed image at a sub-pixel level to obtain the plurality of frames of images, and send the plurality of frames of images to the display component in time.

6. The display module of claim 1 or 2, wherein, The display module further comprises a folded light path between the display component and the pixel position adjustment component, and the folded light path is configured to transmit a target polarized light carrying any image of the plurality of frames of images to the pixel position adjustment component.

7. An imaging control method characterized by, The method is applied to a display device, the display device comprises a display component and a pixel position adjustment component, the pixel position adjustment component comprises a polarization converter and a polarization displacement device, the display component comprises a plurality of pixels, each pixel of the plurality of pixels comprises a plurality of sub-pixels, and the method comprises the following steps: Receiving a to-be-displayed image, decomposing the to-be-displayed image at a sub-pixel level to obtain a plurality of frames of images, the resolution of each frame of image in the plurality of frames of images is the same as the resolution of the display component, and the resolution of the plurality of frames of images is smaller than the resolution of the to-be-displayed image; Controlling the polarization converter to adjust the polarization direction of a target polarized light output in time, the target polarized light carries a frame of image in the plurality of frames of images; The polarization direction of the target polarized light output by the polarization conversion device is a first polarization direction, and the target polarized light is output at a first position; and the polarization direction of the target polarized light output by the polarization conversion device is a second polarization direction, and the target polarized light is output at a second position. The time at which the display component displays the first image is synchronized with the time at which the pixel position adjustment component adjusts the first image, and the first image is any image in the plurality of images.

8. The method of claim 7, wherein, The sub-pixel level decomposition of the image to be displayed to obtain the plurality of images comprises: When the super-resolution mode of the display device is enabled, the image to be displayed is decomposed at a sub-pixel level to obtain a plurality of images.

9. The method of claim 8, wherein, The method further comprises: When the super-resolution mode of the display device is not enabled, the image to be displayed is down-sampled to obtain an image to be processed; The image to be processed is input to the display component, so that the display component displays the image to be processed; The image to be processed is output at a set position by the pixel position adjustment component.

10. The method according to any one of claims 7 to 9, characterized in that, The first pixel point in the first image comprises a sub-pixel sampled from at least h adjacent pixel points in the image to be displayed; The h is the number of images in the plurality of images, the first image is any image in the plurality of images, and the first pixel point is any pixel point in the first image.

11. The method of claim 10, wherein, The pixel value of the first sub-pixel in the first pixel point is determined according to the pixel values of sub-pixels of the same color as the first sub-pixel in a set region of the image to be displayed; The geometric center of the set region is the sampling position of the first sub-pixel in the image to be displayed.

12. The method of claim 11, wherein, The pixel value of the first sub-pixel in the first pixel point is obtained by weighted summation of the pixel values of sub-pixels of the same color as the first sub-pixel in the set region; The weight of the sub-pixel of the same color as the first sub-pixel in the set region is inversely proportional to the distance between the sub-pixels; and the distance between the sub-pixels is the distance between the sampling positions of the sub-pixels of the same color as the first sub-pixel in the image to be displayed.

13. The method of claim 11 or 12, wherein, The display device is a wearable device, and the size of the set region is related to the distance between the display component and the imaging plane of the wearable device.

14. The method of claim 11 or 12, wherein, The size of the set region is related to the pixel size of the display component.

15. The method of claim 11 or 12, wherein, The size of the set region is related to the display content of the display component.

16. The method of claim 11 or 12, wherein, The pixel value of the first sub-pixel satisfies the following formula: q(i,j)=α1*Q(i-1,j)+α2*Q(i,j-1)+α3*Q(i+1,j)+α4*Q(i,j+1)+α5*Q(i,j); Wherein, q(i,j) represents the pixel value of the first sub-pixel; i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed; j represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed; Q(i,j) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed; and α1, α2, α3, α4 and α5 represent weights respectively.

17. The method of claim 11 or 12, wherein, The pixel value of the first sub-pixel satisfies the condition shown in the following formula: q(i,j+1) = α1*Q(i-1,j) + α2*Q(i,j-1) + α3*Q(i+1,j) + α4*Q(i,j+1) + β1*Q(i-1,j+1) + β2*Q(i,j) + β3*Q(i+1,j+1) + β4*Q(i,j+2); Wherein, q(i,j+1) represents the pixel value of the first sub-pixel, i represents the horizontal coordinate of the first sub-pixel in the pixel point of the image to be displayed, j+1 represents the vertical coordinate of the first sub-pixel in the pixel point of the image to be displayed, Q(i,j+1) represents the pixel value of the sub-pixel at the sampling position of the first sub-pixel in the image to be displayed, and α1, α2, α3, α4, β1, β2, β3 and β4 represent weights respectively. The multiple frames of images include the first image and the second image, and the control of the pixel position adjustment component to adjust the position of each frame of image displayed by the display component includes:

18. The method of any one of claims 7-9, wherein, inputting the multiple frames of images to the display component in time division, so that the display component displays the multiple frames of images in time division; controlling the pixel position adjustment component to output the first image at a first position in a first time unit, and controlling the pixel position adjustment component to output the second image at a second position in a second time unit; the interval of the first position and the second position in the horizontal direction is Px / 2; or the interval of the first position and the second position in the vertical direction is Py / 2; or the interval of the first position and the second position in the horizontal direction is Px / 2 and the interval of the first position and the second position in the vertical direction is Py / 2; the first time unit and the second time unit are adjacent in time. The display component, at least one adjustment component and a control component are included; the adjustment component includes a polarization rotator and a birefringent device.

19. A display module, characterized by The display component is used for receiving an image to be processed and displaying the image to be processed, and the resolution of the image to be processed is the same as the resolution of the display component. The polarization rotator is used for adjusting the polarization direction of the light beam of each pixel of the image to be processed under the control of the control component. The birefringent device is used for decomposing the light beam of each pixel included in the image to be processed, outputting a first target polarized light for projecting a first sub-image at a first position and outputting a second target polarized light for projecting a second sub-image at a second position. ​ The resolution ratio of the first pixel is different from the resolution ratio of the second pixel, the first pixel and the second pixel are two pixels with different polarization directions in the image to be processed, the resolution ratio of the first pixel is a ratio of luminous intensity of a light beam of the first pixel projected on a pixel of the first sub-image to luminous intensity of the light beam projected on a pixel of the second sub-image after the light beam is decomposed, and the resolution ratio of the second pixel is a ratio of luminous intensity of a light beam of the second pixel projected on a pixel of the first sub-image to luminous intensity of the light beam projected on a pixel of the second sub-image after the light beam is decomposed.

20. The display module of claim 19, wherein, The position of the first sub-image and the position of the second sub-image are spaced by Py / 2 in a vertical direction and / or spaced by Px / 2 in a horizontal direction, Py represents a vertical distance between the pixels, and Px represents a vertical distance between the pixels.

21. The display module of claim 19 or 20, wherein, The control component is specifically configured to control the polarization rotator to adjust the polarization direction of the light beam of each pixel.

22. The display module of claim 19 or 20, wherein, The image to be processed is obtained by performing down-sampling processing on the image to be displayed. The control component is specifically configured to: estimate luminous intensity of each pixel to be projected as the first sub-image and luminous intensity of each pixel to be projected as the second sub-image according to the luminous intensity of each pixel of the image to be displayed, wherein the first sub-image and the second sub-image have the same resolution and the resolution is smaller than that of the image to be displayed; control the polarization rotator to adjust the polarization direction of the light beam of each pixel of the image to be processed according to the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image.

23. The display module of claim 19 or 20, wherein, The image to be processed is obtained by performing down-sampling processing on the image to be displayed. The control component is specifically configured to: estimate and adjust the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image, so that the similarity between the image obtained by superimposed projection of the adjusted first sub-image and second sub-image and the image to be displayed is greater than a set threshold value; The set threshold value is determined according to the perception ability of the human eye to image difference; control the polarization rotator to adjust the polarization direction of the light beam of each pixel of the image to be processed according to the luminous intensity of each pixel of the adjusted first sub-image and the luminous intensity of each pixel of the second sub-image.

24. An imaging control method characterized by, The method is applied to a wearable device including a display component and a pixel position adjustment component, the pixel position adjustment component including a polarization rotator and a birefringent device; the method includes: receiving an image to be displayed, obtaining an image to be processed by performing down-sampling processing on the image to be displayed, and inputting the image to be processed to the display component, so that the display component emits target polarized light carrying the image to be displayed, wherein the resolution of the image to be processed is the same as the resolution of the display component; controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image so that the birefringent device decomposes the light beam of each pixel included in the to-be-processed image, outputs first target polarized light for projecting a first sub-image at a first position, and outputs second target polarized light for projecting a second sub-image at a second position; wherein a decomposition ratio of a first pixel is different from a decomposition ratio of a second pixel, the first pixel and the second pixel are two pixels in the to-be-processed image with different polarization directions, the decomposition ratio of the first pixel is a ratio of the luminous intensity of the light beam of the first pixel projected on a pixel of the first sub-image to the luminous intensity of the light beam of the first pixel projected on a pixel of the second sub-image, and the decomposition ratio of the second pixel is a ratio of the luminous intensity of the light beam of the second pixel projected on a pixel of the first sub-image to the luminous intensity of the light beam of the second pixel projected on a pixel of the second sub-image.

25. The method of claim 24, wherein, The first sub-image and the second sub-image are arranged in a vertical direction and / or a horizontal direction, and the first sub-image and the second sub-image are spaced apart by Py / 2 and / or Px / 2 in the vertical direction and / or the horizontal direction, Py representing a vertical distance between the pixels, and Px representing a horizontal distance between the pixels.

26. The method of claim 24 or 25, wherein, The control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises: controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises:

27. The method of claim 24 or 25, wherein, controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises: estimating the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image according to the luminous intensity of each pixel of the to-be-displayed image; wherein the first sub-image and the second sub-image have the same resolution and a resolution smaller than that of the to-be-displayed image; controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image according to the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image.

28. The method of claim 24 or 25, wherein, The control of the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image comprises: estimating and adjusting the luminous intensity of each pixel to be projected as the first sub-image and the luminous intensity of each pixel to be projected as the second sub-image so that the similarity between the superimposed projection of the adjusted first sub-image and second sub-image and the to-be-displayed image is greater than a set threshold; the set threshold is determined according to the perception ability of the human eye to image differences; controlling the polarization rotator to adjust the polarization direction of the light beam of each pixel of the to-be-processed image according to the luminous intensity of each pixel of the adjusted first sub-image and the luminous intensity of each pixel of the second sub-image.

Images