Display device

Abstract

The invention provides a display device. The device comprises at least one first display for displaying a first image and at least one second display for displaying a second image, projection of at least one first image formed in the extension direction of the user vision based on multiple reflections of light emitted by at least one first display and projection of at least one second image formed in the extension direction of the user vision based on multiple reflections of light emitted by at least one second display and an optical combiner that combines to create a target image in vision of the user. The projection of the first image and the projection of the second image can be combined to create the target image, and the display effect is improved. Moreover, the projection of the first image and the projection of the second image are formed through multiple reflections, so that the user can have a larger field angle when watching the target image, the immersion of the user in using the display device is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of display, and in particular to a display device. Background Art

[0002] In recent years, with the development of technologies for simulating environments such as virtual reality and augmented reality, more and more users use this technology for entertainment activities such as playing games and watching movies. The technology for simulating environments uses display devices as carriers.

[0003] Some related display devices use a display such as a focus plus background display to display three-dimensional images. When manufacturing this display, the focus display needs to be embedded in the background display so that the two displays are spliced ​​into one display. Therefore, the image presented on the focus plus background display often appears discontinuous at the splicing point of the focus display and the background display, and the display effect is not ideal.

[0004] From the above, it can be seen that the relevant display device displays a three-dimensional picture by combining the image displayed by the focus display and the image displayed by the background display. This display method may result in an unsatisfactory display effect due to the discontinuity of the displayed picture, thereby affecting the user experience. Summary of the invention

[0005] The present application provides a display device that can improve display effects and enhance user experience.

[0006] In a first aspect, a display device is provided, the display device comprising two optical display modules (eg, Figure 5 The optical display module 20 included in 412 and 413 is used to display the target image visually of the user, and the optical display module includes: at least one first display for displaying a first image (for example, Figure 6 ), at least one second display for displaying a second image (e.g., Figure 6 OLED display in the image), and performing multiple reflections on the light emitted by the at least one first display to form a projection of at least one first image in the extension direction of the user's vision (for example, Figure 8 or Fig.12 The image plane 1 in the image plane 1) and the projection of at least one second image formed in the extension direction of the user's vision based on multiple reflections of the light emitted by at least one second display (for example, Figure 8 or Fig.12 An optical combiner that combines the image planes 2) in the image plane to create a target image (three-dimensional picture) visually viewed by the user.

[0007] It should be understood that the display used by some related display devices is a display of a smaller size (for example, a focus display) embedded in a display of a larger size (for example, a background display), and a three-dimensional picture is displayed by combining the image displayed by the focus display and the image displayed by the background display. Since the focus display needs to be embedded in the background display when the display is manufactured, so that the two displays are spliced ​​into one display, the three-dimensional picture presented by the display often has discontinuities at the splicing of the focus display and the background display, and the display effect is not ideal.

[0008] In the embodiment of the present application, the projection of the first image formed by the light emitted by the first display in the extension direction of the user's vision and the projection of the second image formed by the light emitted by the second display in the extension direction of the user's vision are combined to create a three-dimensional picture. Compared with the method of combining two images themselves to display a three-dimensional picture in related display devices, the embodiment of the present application does not need to create a three-dimensional picture by combining multiple images displayed by multiple display screens themselves, but instead creates a three-dimensional picture by combining the projections of multiple images, thereby avoiding the discontinuity of the displayed three-dimensional picture at the joints of multiple display screens, improving the display effect and improving the user experience.

[0009] Furthermore, the projection of the first image in the embodiment of the present application is formed by multiple reflections of light emitted by the first display, and the projection of the second image is formed by multiple reflections of light emitted by the second display. After multiple reflections, the incident direction of the light entering the user's pupil can be changed, thereby enlarging the size of the projection of the first image and the projection of the second image, allowing the user to have a larger field of view when looking at the target image, thereby enhancing the user's sense of immersion in using the display device and improving the user experience.

[0010] In combination with the first aspect, in some implementations of the first aspect, a structure of an optical combiner is provided, the optical combiner comprising a first partial reflective film (eg, Figure 6 The semi-transparent and semi-reflective mirror A) and the first reflective polarizing film (for example, Figure 6 Reflective polarizing film A);

[0011] The light propagation path of the light emitted by the first display incident on the user's pupil may be (for ease of description, the light propagation path may be referred to as the first light path): the light emitted from the first display is transmitted for the first time after reaching the first partial reflective film, the light transmitted for the first time is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partial reflective film, and the light reflected for the second time is transmitted for the second time after reaching the first reflective polarizing film, so as to form a projection of the first image in the extension direction of the user's vision;

[0012] The propagation path of the light emitted by the second display that enters the user's pupil can be (for the sake of ease of description, this light propagation path can be called the second light path): the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partial reflective film, and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film, so as to form a projection of the second image in the extension direction of the user's vision.

[0013] In the embodiment of the present application, since the first partial reflective film and the first reflective polarizing film can transmit and reflect light, the light emitted from the first display and the second display can be effectively reflected multiple times by the first partial reflective film and the first reflective polarizing film;

[0014] Furthermore, the display device provided in the embodiment of the present application can simultaneously make the light emitted by the first display and the second display undergo multiple reflections through the first partial reflective film and the first reflective polarizing film. The light emitted by the first display and the second display can be reflected multiple times without setting up more optical elements, which can reduce the number of optical elements in the display device, thereby reducing the weight of the display device and improving the user experience.

[0015] In combination with the first aspect, in some implementations of the first aspect, the optical combiner further includes a first quarter phase glass (e.g., Figure 6 The 1 / 4 phase plate B) in the figure changes the polarization state of light.

[0016] Wherein, in the case where the optical combiner includes a first quarter phase glass, the first optical path may be: the light from the first display that is transmitted for the first time after passing through the first partial reflective film is changed in polarization state for the first time after arriving at the first quarter phase glass, the light whose polarization state is changed for the first time is reflected for the first time after arriving at the first reflective polarizing film, the light whose polarization state is reflected for the first time is changed in polarization state for the second time after arriving at the first quarter phase glass, the light whose polarization state is changed for the second time is reflected for the second time after arriving at the first partial reflective film, the light whose polarization state is changed for the second time is changed in polarization state for the third time after arriving at the first reflective polarizing film, and the light whose polarization state is changed for the third time is transmitted for the second time;

[0017] The second optical path can be: the polarization state of the light emitted from the second display is changed for the first time after reaching the first quarter phase glass plate, the light whose polarization state is changed for the first time is reflected for the first time after reaching the first quarter phase glass plate, the polarization state of the light whose polarization state is changed for the second time is changed after reaching the first partial reflective film and is reflected for the second time, the polarization state of the light whose polarization state is changed for the second time is changed for the third time after reaching the first quarter phase glass plate, and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film.

[0018] In the embodiment of the present application, the function of the first quarter-phase glass is to change the polarization state of light (for example, to change linear polarized light into circular polarized light, and to change circular polarized light into linear polarized light), and the function of the first reflective polarizing film is to reflect polarized light in one direction and transmit polarized light in another direction (for example, Figure 6 The reflective polarizing film A in the film can transmit vertical linear polarized light, i.e., P linear polarized light, and reflect horizontal linear polarized light, i.e., S linear polarized light). The function of the first part of the reflective film is to transmit part of the light and reflect part of the light (for example, Figure 6 The semi-transparent and semi-reflective mirror A in the optical device can transmit half of the light and reflect half of the light). Based on the function of the above-mentioned optical elements, the embodiment of the present application can change the polarization state of the light through the first quarter-phase glass. By continuously changing the polarization state of the light, the light is transmitted or reflected when passing through the first reflective polarizing film and the first partial reflective film, so that the light emitted by the first display and the second display can be better reflected multiple times.

[0019] In combination with the first aspect, in some implementations of the first aspect, another optical combiner structure is provided, the optical combiner includes a first optical component and a second optical component, the first optical component includes a second partial reflective film (for example, Fig. 9 The semi-transparent and semi-reflective mirror B in the middle) and the second reflective polarizing film (for example, Fig. 9 The second optical component includes a first partially reflective film (e.g., Fig. 9 The semi-transparent and semi-reflective mirror A) and the first reflective polarizing film (for example, Fig. 9 Reflective polarizing film A);

[0020] Wherein, in the case where the optical combiner includes the first optical component and the second optical component, the first optical path may be: the light emitted from the first display is transmitted for the first time after reaching the second partial reflective film, the light transmitted for the first time is reflected for the first time after reaching the second reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the second partial reflective film, and the light reflected for the second time is transmitted after passing through the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film in sequence, so as to form a projection of the first image in the extension direction of the user's vision;

[0021] In the case where the optical combiner includes a second optical component, the second optical path can be: the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partially reflective film, and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film, so as to form a projection of the second image in the extension direction of the user's vision.

[0022] In the embodiment of the present application, since the second partial reflective film, the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film can all transmit and reflect light, the light emitted by the second display can be effectively reflected multiple times by the second partial reflective film and the second reflective polarizing film, and the light reflected multiple times can be effectively transmitted and incident on the user's pupil by the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film, so as to form a projection of the first image in the extension direction of the user's vision;

[0023] Since the first partial reflective film and the first reflective polarizing film can transmit and reflect light, the light emitted by the second display can be effectively reflected multiple times by the first partial reflective film and the first reflective polarizing film, and the light reflected multiple times can be effectively transmitted by the first reflective polarizing film and then incident on the user's pupil, so as to form a projection of the second image in the extension direction of the user's vision;

[0024] Furthermore, in the embodiment of the present application, when the light emitted by the first display forms a projection of the first image through the first optical component, it is necessary to use the first partial reflective film and the first reflective polarizing film in the second optical component to transmit the light after multiple reflections by the first optical component. In this way, the optical combiner can more conveniently combine the projection of the first image and the projection of the second image to create a target image visually viewed by the user.

[0025] In combination with the first aspect, in some implementations of the first aspect, the first optical component further includes a second quarter phase glass ( Figure 8 1 / 4 phase glass D) and the third quarter phase glass ( Figure 8The second optical component also includes a first quarter phase glass ( Figure 8 1 / 4 phase glass B), where

[0026] In the case where the first optical component includes the second quarter phase glass and the third quarter phase glass, the first optical path may be: the light from the first display that is transmitted for the first time after passing through the second partial reflective film changes its polarization state for the first time after reaching the second quarter phase glass, the light whose polarization state is changed for the first time reaches the second reflective polarizing film and is reflected for the first time, the light whose polarization state is reflected for the first time changes its polarization state for the second time after reaching the second quarter phase glass, the light whose polarization state is changed for the second time reaches the second partial reflective film and is reflected for the second time, the light whose polarization state is reflected for the second time changes its polarization state for the third time after reaching the second quarter phase glass, and the light whose polarization state is changed for the third time passes through the second reflective polarizing film, the third quarter phase glass, the first partial reflective film, the first quarter phase glass and the first reflective polarizing film in sequence and is transmitted;

[0027] In the case where the second optical component includes a first quarter wave plate, the second optical path can be: the polarization state of the light emitted from the second display is changed for the first time after reaching the first quarter phase glass plate, the light whose polarization state is changed for the first time is reflected for the first time after reaching the first quarter phase glass plate, the polarization state of the light whose polarization state is changed for the second time is changed for the second time after reaching the first partial reflective film, the polarization state of the light whose polarization state is changed for the second time is changed for the third time after reaching the first quarter phase glass plate, and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film.

[0028] In the embodiment of the present application, the first quarter phase plate, the second quarter phase wave plate and the third quarter phase wave plate are used to change the polarization state of light (for example, to change linear polarized light into circular polarized light, and to change circular polarized light into linear polarized light), and the first reflective polarizing film and the second reflective polarizing film are used to reflect polarized light in one direction and transmit polarized light in another direction (for example, Figure 8 The reflective polarizing film A and the reflective polarizing film B in the embodiment can transmit vertical linear polarized light, i.e., P linear polarized light, and reflect horizontal linear polarized light, i.e., S linear polarized light). The first partial reflective film and the second partial reflective film can transmit a part of the light and reflect a part of the light (for example, Figure 8 The semi-transparent and semi-reflective mirrors A and B in the figure can transmit half of the light and reflect half of the light);

[0029] Based on the function of the above optical elements, the embodiment of the present application can change the polarization state of the light emitted by the first display through the second quarter-wave plate, and by continuously changing the polarization state of the light, the light is transmitted or reflected when passing through the second reflective polarizing film and the second partial reflective film, so that the light emitted by the first display can be better reflected multiple times;

[0030] In addition, the embodiment of the present application can change the polarization state of the light emitted by the first display through the third quarter phase wave plate and the first quarter phase wave plate, and by continuously changing the polarization state of the light, the light that has been reflected multiple times can be better transmitted when passing through the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film;

[0031] Based on the function of the above optical elements, the embodiment of the present application can change the polarization state of the light emitted by the second display through the first quarter-wave plate, and by continuously changing the polarization state of the light, the light is transmitted or reflected when passing through the first reflective polarizing film and the first partial reflective film, so that the light emitted by the second display can be better reflected multiple times;

[0032] Furthermore, the embodiment of the present application can change the polarization state of the light emitted by the second display through the first quarter-wave plate, so that the light that has been reflected multiple times can be better transmitted when passing through the first reflective polarizing film.

[0033] In combination with the first aspect, in some implementations of the first aspect, the first optical component further includes a first lens (e.g., Figure 8 The convex lens D in the lens is configured such that the first lens can refract the light emitted by the first display. Specifically, the light from the first display that is transmitted for the first time after passing through the second partial reflective film is refracted for the first time after reaching the first lens, the light that is refracted for the first time is reflected for the first time after reaching the second reflective polarizing film, the light that is reflected for the first time is refracted for the second time after reaching the first lens, the light that is refracted for the second time is reflected for the second time after reaching the second partial reflective film, the light that is reflected for the second time is refracted for the third time after reaching the first lens, and the light that is refracted for the third time passes through the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film in sequence and is transmitted.

[0034] In the embodiment of the present application, the first lens can refract the light emitted from the first display multiple times. The first refraction of the first lens is to refract the light from the first display that is transmitted for the first time after passing through the second partial reflective film. The second refraction of the first lens is to refract the light that is reflected for the first time. The third refraction of the first lens is to refract the light that is reflected for the second time. By refracting the light emitted from the first display multiple times, the size of the projection of the first image can be further enlarged, so that the user can have a larger field of view when looking at the projection of the first image, thereby enhancing the user's sense of immersion in looking at the projection of the first image.

[0035] In combination with the first aspect, in certain implementations of the first aspect, another propagation path for light emitted by the second display to enter the user's pupil is provided, and the path may be: the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is changed in polarization state for the first time after reaching the first quarter-phase glass, the light with the polarization state changed for the first time is reflected for the second time after reaching the first partial reflective film, the light reflected for the second time is changed in polarization state for the second time after reaching the first quarter-phase glass, and the light with the polarization state changed for the second time is transmitted for the first time after reaching the first reflective polarizing film.

[0036] In combination with the first aspect, in some implementations of the first aspect, the second display is disposed on one side of the first reflective polarizing film (for example, Figure 6 The OLED display is disposed on the left side of the reflective polarizing film A), and the included angle between the length direction of the first reflective polarizing film and the length direction of the second display is an acute angle (for example, Figure 6 The angle between the OLED display and the reflective polarizing film A is an acute angle).

[0037] In the embodiment of the present application, since the angle between the length direction of the first reflective polarizing film and the length direction of the second display is an acute angle, the light emitted by the second display can be better projected onto the first reflective polarizing film when the angle between the length direction of the first reflective polarizing film and the length direction of the second display is other angles (such as an obtuse angle or a right angle).

[0038] In combination with the first aspect, in some implementations of the first aspect, the length direction of the first display and the length direction of the first reflective polarizing film have a preset angle, and the first reflective polarizing film is disposed toward the first display (for example, Fig.10 The length direction of the LCD display is not parallel to the length direction of the reflective polarizing film A, and has a preset angle, and the reflective polarizing film A faces the LCD display).

[0039] In the embodiment of the present application, since the length direction of the first display and the length direction of the first reflective polarizing film have a preset angle, the movement range of the second display in the length direction of the second display can be increased relative to the length direction of the first display being parallel to the length direction of the first reflective polarizing film.

[0040] In combination with the first aspect, in certain implementations of the first aspect, the size of the first display is equal to the size of the second display, the resolution of the first display is equal to the resolution of the second display, and the center position of the projection of the first image, the center position of the projection of the second image, and the center position of the user's pupil are on a connecting line.

[0041] In the embodiment of the present application, since the size of the first display is equal to the size of the second display, the larger the size of the display, the larger the field of view, and the smaller the size of the display, the smaller the field of view, the resolution of the first display is equal to the resolution of the second display, and thus, the ratio of the resolution of the first display to the field of view is equal to the ratio of the resolution of the second display to the field of view, and since the ratio of the display resolution to the field of view can determine the clarity of the picture in the display device that the user is looking at, the clarity of the projection of the first image and the projection of the second image in the display device that the user is looking at is the same;

[0042] Since the ratio of the resolution of the first display to the field of view angle is equal to the ratio of the resolution of the second display to the field of view angle, and the center position of the projection of the first image, the center position of the projection of the second image, and the center position of the user's pupil are on a connecting line, each pixel on the projection of the first image that the user is gazing at and each pixel on the projection of the second image coincide with each other, and thus the projection of the first image that the user is gazing at and the projection of the second image overlap;

[0043] Furthermore, since the projection of the first image and the projection of the second image that the user is gazing at overlap, the probability of ghosting when the user is gazing at a target image created by combining the projection of the first image and the projection of the second image is reduced, thereby improving the display effect of the target image.

[0044] In combination with the first aspect, in some implementations of the first aspect, the display device further includes a processor, which can adjust the brightness value of each pixel in the first image and the second image so that the user can feel the depth information of each pixel when looking at the target image; specifically, the processor is used to:

[0045] Obtain a depth value of each pixel of any image in at least one first image and at least one second image; determine a pixel value of each pixel in each first image in the at least one first image and a pixel value of each pixel in each second image in the at least one second image according to the depth value of each pixel (for ease of description, the pixel value of each pixel in each first image in the at least one first image is referred to as a first-category pixel value, and the pixel value of each pixel in each second image in the at least one second image is referred to as a second-category pixel), so that each first image displays a brightness corresponding to a first-category pixel value based on the first-category pixel value and each second image displays a brightness corresponding to a second-category pixel value based on the second-category pixel value.

[0046] It should be understood that the smaller the depth value of a pixel on an image, the closer the pixel is to the user's pupil. The closer the pixel is to the user's pupil, the brighter the brightness of the pixel perceived by the user. The larger the depth value of a pixel on an image, the farther the pixel is from the user's pupil. The farther the pixel is from the user's pupil, the darker the brightness of the pixel perceived by the user. The brightness of the pixel is related to the size of the pixel value. The larger the pixel value, the brighter the pixel, and the smaller the pixel value, the darker the pixel.

[0047] In an embodiment of the present application, since the depth value of each pixel in the first image displayed by at least one first display and the depth value of each pixel in the second image displayed by at least one second display are the same, when obtaining the depth value of each pixel, the depth value of each pixel can be obtained from any one of the at least one first image and the at least one second image. After obtaining the depth value of each pixel, the first category pixel value and the second category pixel value can be determined according to the depth value of each pixel, so that each first image can display the brightness corresponding to the first category pixel value, and each second image can display the brightness corresponding to the second category pixel value. The brightness of the target image that the user is looking at is the brightness displayed after the brightness corresponding to the first category pixel value and the brightness corresponding to the second category pixel value are combined. Since the brightness of the pixel is related to the depth of the pixel, the user can feel the depth information of each pixel in the target image, thereby enhancing the user's sense of depth when looking at the target image.

[0048] In the related art, the distance between the user and the display in the display device is constant, which causes the focusing function of the user's eyeball to be unable to follow the convergence function to focus, resulting in a convergence-accommodation conflict. The convergence-accommodation conflict may cause the user to experience adverse reactions such as visual fatigue, dizziness, and headache when using the display device;

[0049] In the embodiment of the present application, since the user can feel the depth information of each pixel in the target image, when the user's eyes feel the depth of each pixel, the convergence function will converge the sights of both eyes to each pixel, and at the same time the focusing function will focus on the pixels at the same distance. In this way, the convergence and focusing functions of the user's eyes can be coordinated with each other, so that the sights of both eyes converge on the same pixel, effectively solving the convergence adjustment conflict.

[0050] In combination with the first aspect, in certain implementations of the first aspect, the processor is specifically used to: determine the ratio of the first category pixel value to the second category pixel value based on the depth value of each pixel; determine the first category pixel value and the second category pixel value based on the ratio of the first category pixel value and the second category pixel value.

[0051] In the embodiment of the present application, the processor can determine the first category pixel value and the second category pixel value based on the ratio of the first category pixel value and the second category pixel value, thereby improving the accuracy of the determined first category pixel value and the second category pixel value.

[0052] In combination with the first aspect, in certain implementations of the first aspect, the size of the first display is larger than the size of the second display, the ratio of the resolution of the first display to the first field of view angle is smaller than the ratio of the resolution of the second display to the second field of view angle, the first field of view angle is obtained by the projection of the user's pupil and the first image formed by the first display, and the second field of view angle is obtained by the projection of the user's pupil and the second image formed by the second display.

[0053] In the embodiment of the present application, since the size of the first display is larger than that of the second display, the larger the size of the display, the larger the field of view, and the smaller the size of the display, the smaller the field of view. Therefore, the first field of view angle obtained by the projection of the user's pupil and the first image formed through the first display is greater than the second field of view angle obtained by the projection of the user's pupil and the second image formed through the second display. Since the ratio of the resolution of the first display to the first field of view angle is smaller than the ratio of the resolution of the second display to the second field of view angle, the ratio of the display resolution to the field of view angle can determine the clarity of the picture in the display device that the user is looking at. Therefore, the clarity of the projection of the first image in the display device that the user is looking at is less than the clarity of the projection of the second image.

[0054] Since the first field of view angle obtained by the projection of the user's pupil and the first image formed through the first display is greater than the second field of view angle obtained by the projection of the user's pupil and the second image formed through the second display, and the clarity of the projection of the first image in the display device that the user is looking at is less than the clarity of the projection of the second image, when the user is looking at the target image in the display device, a picture with a larger field of view angle can be obtained through the projection of the first image, and the picture with a larger field of view angle can enhance the user's sense of immersion, and a clearer picture can be obtained through the projection of the second image. Therefore, when the user is looking at the target image of the display device, he can obtain a picture with a larger field of view angle and a clearer picture, thereby improving the user experience.

[0055] In combination with the first aspect, in some implementations of the first aspect, the display device further includes a detection module, a processor, and an adjustment module;

[0056] The detection module is used to detect the gaze direction of the user gazing at the target image and generate gaze direction information;

[0057] The processor is used to determine first position information of a gaze area where the user gazes at the target image according to the gaze direction information, and send an adjustment instruction to the adjustment module according to the first position information;

[0058] The adjustment module is used to adjust the position of the second display according to the adjustment instruction, so that the projection of the second image moves to the gaze area of ​​the target image gazed by the user.

[0059] In the embodiment of the present application, the projection of the second image can be moved to the gaze area of ​​the target image that the user is gazing at through the detection module, the processor and the adjustment module. Since the projection of the second image displays a clearer image, the position of the clearer image can change on the target image as the user's gaze direction changes, thereby improving the user experience.

[0060] In combination with the first aspect, in some implementations of the first aspect, the display device is a head-mounted near-eye display device.

[0061] In a second aspect, a display method is provided, which is applied to the display device provided in the first aspect, the display device comprising two optical display modules, the optical display modules being used to display a target image visually displayed by a user, the optical display modules comprising at least one first display for displaying a first image, at least one second display for displaying a second image, and an optical combiner for combining a projection of at least one first image formed based on light emitted by at least one first display in an extension direction of the user's vision and a projection of at least one second image formed based on light emitted by at least one second display in an extension direction of the user's vision to create the target image visually displayed by the user, the size of the first display being equal to the size of the second display, the resolution of the first display being equal to the resolution of the second display, and the center position of the projection of the first image, the center position of the projection of the second image, and the center position of the user's pupil being on a connecting line; the display method comprising:

[0062] Obtain a depth value for each pixel of any one of at least one first image and at least one second image; determine a pixel value for each pixel in each of the at least one first image and a pixel value for each pixel in each of the at least one second image based on the depth value of each pixel, so that each first image displays a brightness corresponding to a first type of pixel value based on the first type of pixel value and each second image displays a brightness corresponding to a second type of pixel value based on the second type of pixel value.

[0063] In combination with the second aspect, in some implementations of the second aspect, determining, according to the depth value of each pixel, a pixel value of each pixel in each first image in at least one first image and a pixel value of each pixel in each second image in at least one second image includes:

[0064] According to the depth value of each pixel, the ratio of the first type of pixel value to the second type of pixel value is determined; according to the ratio of the first type of pixel value to the second type of pixel value, the first type of pixel value and the second type of pixel value are determined.

[0065] In a third aspect, a display method is provided, which is applied to the display device provided in the first aspect, the display device comprising two optical display modules, the optical display modules being used to display a target image visually displayed by a user, the optical display modules comprising at least one first display for displaying a first image, at least one second display for displaying a second image, and an optical combiner for combining a projection of at least one first image formed in an extension direction of the user's vision based on light emitted by at least one first display and a projection of at least one second image formed in an extension direction of the user's vision based on light emitted by at least one second display to create a target image visually displayed by the user, the size of the first display being larger than the size of the second display, the ratio of the resolution of the first display to the first field of view angle being smaller than the ratio of the resolution of the second display to the second field of view angle, the first field of view angle being obtained by the projection of the user's pupil and the first image formed by the first display, and the second field of view angle being obtained by the projection of the user's pupil and the second image formed by the second display; the display method further comprises:

[0066] Detecting the gaze direction of a user gazing at a target image and generating gaze direction information; determining first position information of a gaze area of ​​the target image where the user is gazing according to the gaze direction information; and adjusting the position of a second display according to the first position information so that the projection of the second image moves to the gaze area of ​​the target image where the user is gazing. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 This is an example diagram of a field of view angle provided.

[0068] Figure 2 The following is an example of a screen displayed by a focus plus background display.

[0069] Figure 3 is an example diagram of one display provided.

[0070] Figure 4 It is a structural schematic diagram of a display device provided in an embodiment of the present application.

[0071] Figure 5 It is a structural schematic diagram of a VR glasses provided in an embodiment of the present application.

[0072] Figure 6 It is a structural schematic diagram of an optical display module provided in an embodiment of the present application.

[0073] Figure 7 This is a light path cross-sectional diagram provided in an embodiment of the present application.

[0074] Figure 8 This is an example diagram of a virtual image displayed by a display device provided in an embodiment of the present application.

[0075] Fig. 9 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0076] Fig.10 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0077] Fig.11 It is a simplified structural diagram of an optical display module provided in an embodiment of the present application.

[0078] Fig.12 This is an example diagram of a virtual image displayed by another display device provided in an embodiment of the present application.

[0079] Fig.13 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0080] Fig.14 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0081] Fig.15 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0082] Fig.16 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0083] Fig.17 It is a schematic diagram of the structure of another optical display module provided in an embodiment of the present application.

[0084] Fig.18 An example diagram of a convergence regulation conflict is provided.

[0085] Fig.19 This is an example diagram for resolving convergence regulation conflicts provided by an embodiment of the present application.

[0086] Fig. 20 It is a schematic diagram of the structure of another display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0087] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0088] Some of the terms used in the embodiments of the present application are explained below to facilitate understanding by those skilled in the art.

[0089] Field of View (FOV) refers to the angle between the edge of the virtual image observable by the human eye and the line connecting the center of the pupil of the human eye in the virtual image formed by the display device. The field of view angle includes horizontal field of view angle, vertical field of view angle and diagonal field of view angle. In the embodiments of the present application, the field of view angle refers to the horizontal field of view angle unless otherwise specified. In layman's terms, the field of view angle is the maximum visible range of the virtual image displayed by the display device in the horizontal, vertical or diagonal direction. The field of view angle is an important parameter for judging the sense of immersion. The larger the field of view angle, the stronger the sense of immersion. Immersion, also known as presence, refers to the immersive experience that the virtual environment brings to the participants. It is considered to be an important indicator for characterizing the performance of a virtual reality environment. For example, please refer to Figure 1 , Figure 1 This is an example diagram of a field of view angle provided. Figure 1 The "O" shown represents the center of the pupil of the human eye, "A, B, C and D" represent the four vertices of the display, the horizontal field of view angle may be angle AOB, the vertical field of view angle may be angle AOC, and the diagonal field of view angle may be angle AOD.

[0090] Convergence refers to the adjustment of the positions of two objects by the eyeballs turning inward (esotropia, commonly known as cross-eyed) or outward (exotropia), so that the brain can integrate the two images into one. The angle between the eyeballs and the object is called the convergence angle.

[0091] Focusing refers to the eyes automatically adjusting the focal length according to the distance of the object, so that the image of the object falls clearly on the retina, allowing both eyes to see the world clearly. The distance between the eyeball and the object is called the focal length.

[0092] Convex lens is made according to the principle of light refraction. It is thicker in the center and thinner at the edge. It has the function of converging light, so it is also called converging lens. Convex lens can be spherical lens or aspherical lens. Spherical lens means that the curvature is constant from the center to the edge of the lens, while aspherical lens means that the curvature changes continuously from the center to the edge. Convex lens can also be Fresnel lens. Fresnel lens is actually the continuous curved surface of ordinary convex lens cut into sections of discontinuous curved surfaces with constant curvature. Because the curved surface is divided very finely, it looks like circles of lines. Fresnel lens can be regarded as a series of prisms arranged in a ring, with sharper edges and a smoother convex surface in the center.

[0093] A semi-transparent and semi-reflective mirror, also known as a beam splitter, can easily separate incident light into two parts: reflected light and transmitted light. A semi-transparent and semi-reflective mirror can be considered a neutral beam splitter, which can split a beam of light into two beams of light with the same spectral components. In a certain wavelength region, it has the same transmittance and reflectance ratio for each wavelength, so the reflected light and the transmitted light are neutral. Neutral beam splitters with a transmission and reflectance ratio of 50 / 50 are the most commonly used. Beam splitters can also be replaced by partial reflective films (partial reflectors). The function of partial reflective films is to both transmit part of the light and reflect part of the light. The most typical one is semi-reflective and semi-transparent, half reflecting and half transmitting. The partial reflective film can be a metal film, a dielectric film, or a mixed film layer of the two. The semi-transparent and semi-reflective film does not change the polarization characteristics of the light. The beam splitter can also be replaced by a semi-transparent and semi-reflective film. The semi-transparent and semi-reflective film is a film material with special reflection and transmission properties. One side of the semi-transparent and semi-reflective film is semi-transparent, and the other side is reflective. When light is irradiated on the semi-transparent side, the light can be completely transmitted. When light is irradiated on the reflective side, the light can be completely reflected.

[0094] Polarizer, also known as polarizing film, is a compound film that can turn natural light into polarized light. Light is an electromagnetic wave, which is a transverse wave. The asymmetry of the vibration direction with respect to the propagation direction is called polarization. The phenomenon that the spatial distribution of the vibration of the electric vector of the light wave loses symmetry with respect to the propagation direction of light is called the polarization of light. Polarized light refers to a light wave whose vibration direction of the light vector remains unchanged or changes in a certain regular manner. Natural light is a complex mixed light wave composed of countless transverse vibrations. Natural light can be converted into polarized light through reflection, refraction, birefringence and selective absorption. The function of a polarizer is to convert natural light into polarized light. According to the properties of polarized light, polarized light can be divided into linear polarized light (Line Polarizer, LP), circular polarized light (Circular Polarizer, CP), elliptically polarized light, and partially polarized light.

[0095] Linearly polarized light refers to light that vibrates only in a fixed direction. The film that converts natural light into linearly polarized light is called a linear polarizer. Circularly polarized light refers to light whose polarization plane rotates with a circular frequency w relative to the propagation direction over time. Circularly polarized light is generally obtained through a 1 / 4 phase delay plate on the basis of linear polarized light. Circularly polarized light can be divided into left-handed circularly polarized light (Left Line Polarizer, LCP) and right-handed circularly polarized light (Right Line Polarizer, RCP) according to the direction of the light vector. If circularly polarized light encounters reflection, it will change its rotation direction. For example, left-handed circularly polarized light will become right-handed circularly polarized light after reflection, and right-handed circularly polarized light will become left-handed circularly polarized light after reflection.

[0096] Linear polarized light is divided into horizontal polarized light (S polarized light for short) and vertical polarized light (P polarized light for short). When light penetrates an optical element at a non-vertical angle, the reflection and transmission characteristics depend on the polarization phenomenon. The incident light and reflected light determine a plane. In this case, its coordinate system can be established based on this plane. Generally, the Z axis is the propagation direction of light, and the plane perpendicular to the Z axis is the XY plane. If the polarization direction is parallel to this plane, it is P polarized light, and if the polarization direction is perpendicular to this plane, it is S polarized light. P polarized light and S polarized light are relative to a specific coordinate system, and the XYZ polarization coordinate system is optional according to needs.

[0097] A reflective polarizing film is a type of polarizing film, which is a type of polarizing film that can selectively reflect polarized light. The reflective polarizing film can be configured to reflect S-polarized light and transmit P-polarized light, or to reflect P-polarized light and transmit S-polarized light.

[0098] 1 / 4 phase delay plate, also known as 1 / 4 phase glass plate, is usually made of plastic film with high light transmittance. When in the correct direction, linearly polarized light will become circularly polarized light when passing through the 1 / 4 phase glass plate at a certain angle, which can make the polarization components of the two vibration directions of the linear polarized light perpendicular to each other produce a phase delay of 1 / 4 wavelength (both to the left and right). Similarly, when circularly polarized light passes through the 1 / 4 phase delay plate, it will also become linearly polarized light.

[0099] An embodiment of the present application relates to a display device, which is mainly used to display three-dimensional (3D) pictures, such as three-dimensional images, three-dimensional videos, etc.

[0100] A display device usually includes a display and an optical device. The display is used to display the image source. The optical device uses the principle of light refraction to change the propagation direction of the light emitted by the display, so that the screen image displayed by the display close to the human eye can be focused, and the screen image can be focused on the retina of the human eye. At the same time, the screen image size is enlarged to allow users to obtain a picture with a larger viewing angle.

[0101] Some related display devices use a focus plus context screen, such as a display that displays images. This display embeds a smaller-sized, higher-resolution display into a larger-sized, lower-resolution display. The smaller-sized, higher-resolution display can be called a focus display, and the larger-sized, lower-resolution display can be called a context display. When making a focus plus context display, the focus display needs to be embedded into the context display, so that the two physical screens are spliced ​​into one physical screen. Therefore, the image displayed on the focus plus context display often appears discontinuous at the splicing point of the focus display and the context display, and the display effect is not ideal, resulting in a poor user experience when viewing the image. Please refer to Figure 2 , Figure 2 This is an example of a focus plus background display screen. Figure 2 In the figure, E1 is the picture displayed by the background display, and E2 is the picture displayed by the focus display. The pictures presented by E1 and E2 are discontinuous at the joint of the focus display and the background display.

[0102] Some other related display devices use displays that include several sub-screens that can display two-dimensional images. Each sub-screen can be moved to different depths, and the centers of each sub-screen are aligned, so that a three-dimensional image can be integrated. However, in this solution of displaying three-dimensional images through multiple physical screens, some physical screens will block the light propagation paths of other physical screens, resulting in unsatisfactory display effects. Please refer to Figure 3 , Figure 3 is an example diagram of a display provided. Figure 3 In the figure, screen 1, screen 2 and screen 3 are sub-screens of the display, and each sub-screen can be moved to a different depth. For example, screen 1 is moved to a position D3 away from the human eye, screen 2 is moved to a position D2 away from the human eye, and screen 3 is moved to a position D1 away from the human eye. At the same time, the center of each sub-screen is aligned, and finally a three-dimensional image can be integrated. Figure 3 It can be seen that the light propagation path of screen 3 will be blocked by screen 2, and the light propagation path of screen 2 will be blocked by screen 1, resulting in that the display effect of the final integrated three-dimensional picture is not ideal.

[0103] From the above, it can be seen that the relevant display devices display three-dimensional images by combining multiple physical screens, but these relevant display devices may not display continuous images or the light propagation path of the screen may be blocked, resulting in unsatisfactory display effects and affecting user experience.

[0104] An embodiment of the present application provides a display device that does not need to combine multiple physical screens. Instead, a three-dimensional picture is displayed by combining virtual images formed by multiple physical screens. Since virtual images are combined, there is no need to embed one physical screen into another physical screen, thereby avoiding discontinuity of the displayed three-dimensional picture at the joints of the physical screens, thereby improving the display effect.

[0105] Moreover, in the display device provided by the embodiment of the present application, the light propagation path of each physical screen will not be blocked by another physical screen, thereby improving the display effect.

[0106] The following embodiments introduce the specific structure of the display device provided in the embodiments of the present application.

[0107] Please refer to Figure 4 , Figure 4 1 is a schematic diagram of a display device 100 provided in an embodiment of the present application. The display device 100 may include: a control module 10, an optical display module 20 and an adjustment module 30, wherein the control module 10 includes a processor 11 and a memory 12, and the optical display module 20 includes a display 21 and an optical combiner 22, etc.

[0108] The control module 10 may be the nerve center and command center of the display device 100. The control module 10 may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0109] The processor 11 may include one or more processing units, for example, the processor 11 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0110] The memory 12 is used to store instructions and data. In some embodiments, the memory 12 is a cache memory. The memory 12 can store instructions or data that have just been used or are cyclically used by the processor 11. If the processor 11 needs to use the instruction or data again, it can be directly called from the memory 12, avoiding repeated access, reducing the waiting time of the processor 11, and thus improving the efficiency of the system.

[0111] The optical display module 20 can be used to display three-dimensional images, three-dimensional videos, etc. through the display 21. The optical combiner 22 uses the principles of light refraction and reflection to change the direction of light, so that the image displayed by the display 21 can be magnified to form a virtual image that is several times larger than the image displayed by the display, so that the user can obtain a picture with a larger field of view.

[0112] The display 21 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the display device 100 may include 1 or N displays 21, where N is a positive integer greater than 1.

[0113] The optical combiner 22 may include one or more of the following optical elements: a convex lens, a beam splitter, a polarizer, a reflective polarizer (RP), a quarter wave plate (QWP), etc.

[0114] The adjustment module 30 is used to adjust the position of the display 21 to adjust the distance between the human eye and the virtual image.

[0115] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the display device 100. In other embodiments of the present application, the display device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0116] The above-mentioned display device 100 can be an augmented reality (AR) head-mounted near-eye display device, a virtual reality (VR) head-mounted near-eye display device, a mixed reality (MR) head-mounted near-eye display device, etc. The embodiment of the present application does not specifically limit the specific form of the above-mentioned head-mounted near-eye display device. Among them, when the head-mounted near-eye display device is an AR head-mounted near-eye display device, it can be an AR helmet, AR glasses, or an AR portable theater. When the head-mounted near-eye display device is a VR head-mounted near-eye display device, it can be a VR helmet, VR glasses, or a VR portable theater. When the head-mounted near-eye display device 100 is an MR head-mounted near-eye display device, it can be a MR helmet, MR glasses, or an MR portable theater.

[0117] For the convenience of explanation, the display device 100 is taken as VR glasses as an example to explain its specific structure and the function of each structure.

[0118] Figure 5 It is a structural schematic diagram of a VR glasses provided by an embodiment of the present application. The VR glasses include: a main body 41, a first wearing seat 42 and a second wearing seat 43, the main body 41 includes a bearing structure 411, a first supporting structure 412 and a second supporting structure 413, the bearing structure 411 is used to support the first supporting structure 412 and the second supporting structure 413, the first supporting structure 412 and the second supporting structure 413 are both provided with a control module 10, an optical display module 20 and an adjustment module 30, when the VR glasses are worn on the user's head through the first wearing seat 42 and the second wearing seat 43, the user can see the virtual picture presented by the VR glasses through the optical display module 20 through the eyes (left eye 44, right eye 45).

[0119] It is understandable that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on VR glasses. In other embodiments of the present application, the optical display module 20 is arranged in the first support structure 412 and the second support structure 413, the control module 10 can be arranged in the first wearing seat 42 or the second wearing seat 43 or on the bearing structure 411, and the adjustment module 30 can also be arranged in the first wearing seat 42 or the second wearing seat 43 or on the bearing structure 411, and the embodiment of the present application does not limit this.

[0120] The following embodiments illustrate the specific structure of the optical display module 20 and the function of each structure.

[0121] Figure 64 is a schematic diagram of the structure of an optical display module 20 provided in an embodiment of the present application. Since the structures of the optical display modules 20 provided in the first supporting structure 412 and the second supporting structure 413 in the embodiment of the present application are the same, for the convenience of description, only the optical display module 20 in the first supporting structure 412 is introduced.

[0122] The optical display module 20 includes an LCD display 201 , and a central axis Z1 of the LCD display 201 is parallel to a line connecting pupil centers of the left eye 44 and the right eye 45 .

[0123] LCD display, also known as liquid crystal display, is an active matrix liquid crystal display driven by thin film transistors. It mainly uses electric current to stimulate liquid crystal molecules to generate points, lines, and surfaces to form a picture with the back light tube. The imaging of liquid crystal display consists of three main components: backlight, liquid crystal, and polarizer. The definition of polarizer can refer to the above embodiment. Liquid crystal is a material that can control the polarization direction by electricity (each pixel can be controlled individually). After the display is started, the backlight is turned on. When the liquid crystal is not powered, the polarization direction is perpendicular to the polarizer and light cannot pass through. When the liquid crystal is powered, the polarization direction is the same as the polarizer, and linear polarized light is transmitted.

[0124] A 1 / 4 phase glass A202 is attached to the surface of the LCD display 201, and the 1 / 4 phase glass A202 is used to convert the linear polarized light emitted by the LCD display 201 into circular polarized light. Optionally, the LCD display can also be an OLED display, an AMOLED display, a Miniled display, a MicroLed display, a Micro-oLed display, a FLED display, a QLED display, etc., which is not limited in the embodiments of the present application.

[0125] Optionally, the optical display module 20 further includes a convex lens A203, and the convex lens A is used to converge the circularly polarized light emitted by the LCD display through the 1 / 4 phase glass A. Figure 6 It can be seen that one side of the convex lens A is a flat surface, and the other side is an irregular curved surface.

[0126] Optionally, a semi-transparent and semi-reflective mirror A204 is attached to the irregular curved surface of the convex lens A203, and the semi-transparent and semi-reflective mirror A204 can transmit a semi-circular polarized light and reflect a semi-circular polarized light. The semi-transparent and semi-reflective mirror A204 can be replaced by a partial reflective film, and the partial reflective film can transmit a part of the circular polarized light and reflect a part of the circular polarized light. For example, the partial reflective film can transmit 3 / 4 of the circular polarized light and reflect 1 / 4 of the circular polarized light. The semi-transparent and semi-reflective mirror A204 can also be replaced by a semi-transparent and semi-reflective film, one side of the semi-transparent and semi-reflective film is in a semi-transparent state, and the other side is in a reflective state. When the circularly polarized light is irradiated on the side in the semi-transparent state, the circularly polarized light can be fully transmitted. The semi-transparent and semi-reflective mirror A204 can also be attached to the lower surface of the 1 / 4 phase glass A202.

[0127] A 1 / 4 phase glass plate B205 is attached to the plane of the convex lens A203, and the 1 / 4 phase glass plate B205 is used to convert the circularly polarized light transmitted by the semi-transparent and semi-reflective mirror A204 into linearly polarized light. The 1 / 4 phase glass plate B205 can also be attached to the lower surface of the semi-transparent and semi-reflective mirror A204.

[0128] Optionally, the optical display module 20 further includes a convex lens B206. Figure 6 It can be seen that one side of the convex lens B206 is a plane and the other side is a curved surface. A reflective polarizing film A207 is attached to the plane of the convex lens B206, and the reflective polarizing film A207 can selectively reflect or transmit linear polarized light. The convex lens B is used to converge the linear polarized light transmitted by the reflective polarizing film A207. The reflective polarizing film A207 can also be attached to the lower surface of the 1 / 4 phase glass plate B205.

[0129] The optical display module 20 further includes an OLED display 208 , a central axis Z2 of the OLED display 208 is not parallel to a central axis Z1 of the LED display 201 , that is, the OLED display 208 is not arranged in parallel to the LED display 201 .

[0130] OLED displays, also known as organic light-emitting diodes, are mainly driven by electric fields. Organic semiconductor materials and luminescent materials emit light through overcarrier injection and recombination. In essence, it is through the use of an indium tin oxide glass transparent electrode as the device anode and a metal electrode as the cathode. Driven by a power supply, electrons are transferred from the cathode to the electron transport layer, and holes are injected from the anode to the hole transport layer, and then migrated to the light-emitting layer. When the two meet, excitons are generated, which excite the luminescent molecules and generate light sources after radiation. In layman's terms, OLED displays do not require backlights to emit light like LCD displays. OLED displays can emit light by themselves. Optionally, the OLED display can also be an LCD display, an AMOLED display, a Miniled display, a MicroLed display, a Micro-oLed display, a FLED display, a QLED display, etc., which is not limited in the embodiments of the present application.

[0131] A circular polarizer 209 is attached to the OLED display 208. Since the light emitted by the OLED display 208 is non-polarized light, the non-polarized light can be converted into circularly polarized light through the circular polarizer 209. The circular polarizer 209 is essentially a 1 / 4 phase glass attached to a linear polarizer. The OLED display 208 converts non-polarized light into linearly polarized light through the linear polarizer, and the linearly polarized light becomes circularly polarized light through the 1 / 4 phase glass.

[0132] Optionally, the optical display module 20 further includes a convex lens C210. Figure 6 It can be seen that one side of the convex lens C210 is a flat surface and the other side is a curved surface. The convex lens C210 is used to converge the circularly polarized light emitted by the circular polarizer 209 .

[0133] Optionally, the optical display module 20 further includes a direct shielding layer 211, which can be attached to the curved surface of the convex lens B206. When the light emitted by the OLED display 208 and the LCD display 201 is reflected or transmitted in an optical element (e.g., a 1 / 4 phase glass, a reflective polarized film lamp), parasitic reflection is likely to be generated. Parasitic reflection refers to unnecessary reflection generated by the bottom surface of a transparent object. The unnecessary reflected light is repeatedly reflected in the lens, which may generate ghost images or glare, thereby reducing the image quality. The direct shielding layer 211 can block ghost images or glare, and can improve the image quality.

[0134] It should be understood that the OLED display 208 is parallel to the plane of the convex lens C210, and the purpose of such arrangement is that the light emitted by the OLED display 208 can be received by the convex lens C210. ​​The OLED display 208 and the plane of the convex lens B206 have a certain angle, and the angle needs to be of a suitable size to ensure that the OLED display 208 does not block the light emitted by the LCD display 201, and to ensure that the light emitted by the OLED display 208 can be irradiated onto the reflective polarizing film A207.

[0135] It should also be understood that the above-mentioned optical elements except the LCD display 201 and the OLED display 208 all belong to the optical combiner 22 in the optical display module 20 .

[0136] The above embodiments describe the specific structure of the optical display module 20 and the functions of each structure, and the following embodiments describe the light path propagation mode of the optical display module 20. For ease of description, the light path of the light emitted by the LCD display 201 passing through the optical display module 20 is referred to as light path 1, and the light path of the light emitted by the OLED display 208 passing through the optical display module 20 is referred to as light path 2.

[0137] Assuming that the reflective polarizing film A207 is configured to reflect vertical linear polarized light and transmit horizontal linear polarized light, the optical path 1 can be:

[0138] Please refer to Figure 6 For example, the S linear polarized light (horizontally polarized light) emitted by the LCD display 201 passes through the 1 / 4 phase glass A202 and becomes the right-handed circularly polarized light RCP. After the RCP passes through the semi-transparent and semi-reflective mirror A204, half of the RCP is transmitted, and the polarization state does not change. After the RCP passes through the 1 / 4 phase glass B205, it becomes the P linear polarized light (vertically polarized light). The P linear polarized light reaches the reflective polarizing film A207 and is reflected. Since the reflective polarizing film A207 is set to reflect the P linear polarized light, the reflected The S linear polarized light is emitted, and the reflective polarizing film A207 reflects the P linear polarized light. The P linear polarized light passes through the 1 / 4 phase glass plate B205 for the second time and turns back into right-handed circularly polarized light RCP. The RCP is reflected by the semi-transparent and semi-reflective mirror A204. Since the circularly polarized light encounters reflection, it will change its rotation direction. Therefore, RCP turns into left-handed circularly polarized light LCP. The LCP passes through the 1 / 4 phase glass plate B205 for the third time and turns into S linear polarized light. The S linear polarized light reaches the reflective polarizing film A207 and is transmitted and enters the human eye.

[0139] Light path 2 can be: Please refer to Figure 6For example, the OLED display 208 emits right-handed circularly polarized light RCP through the circular polarizer 209, and the RCP passes through the convex lens C210 to illuminate the 1 / 4 phase glass B205 and becomes P-linear polarized light. The P-linear polarized light reaches the reflective polarizing film A207 for reflection, and the P-linear polarized light passes through the 1 / 4 phase glass B205 for the second time and turns back into right-handed circularly polarized light RCP. The RCP is reflected by the semi-transparent and semi-reflective mirror A204 and becomes left-handed circularly polarized light LCP. The LCP passes through the 1 / 4 phase glass B205 for the third time and becomes S-linear polarized light. The S-linear polarized light reaches the reflective polarizing film A207 and is transmitted and enters the human eye.

[0140] From optical path 1 and combined Figure 6 It can be seen that after the image source displayed on the LCD display 201 passes through the semi-transparent and semi-reflective mirror, the light is reflected back and forth between the 1 / 4 phase glass and the reflective polarizing film for many times, and finally exits from the reflective polarizing film and enters the human eye. Figure 6 It can be seen that when the image source displayed by the OLED display 208 passes through the reflective polarizing film, the light is reflected, and the reflected light returns to the semi-transparent mirror and is reflected again, and finally exits from the reflective polarizing film and enters the human eye. Since the light that finally enters the human eye on the optical path 1 and the optical path 2 is folded back multiple times, the image seen by the human eye is a virtual image that is larger and farther than the image displayed on the display. For example, please refer to Figure 7 , Figure 7 This is a light path cross-sectional diagram provided in an embodiment of the present application.

[0141] Figure 7 The solid line optical path in the middle may represent optical path 1 or optical path 2. Assuming that the height of the image displayed on the display is X1, the light emitted by the display passes through the optical elements (e.g., semi-transparent mirror, 1 / 4 phase glass, and reflective polarizing film) in the optical display module 20 and is reflected multiple times. The light that finally enters the human eye gives the impression that the light enters the human eye from a higher position along the dotted line. The virtual image height and virtual image position finally seen by the human eye may be Figure 7 X2 in.

[0142] In the embodiment of the present application, the optical display module 20 can form two image planes in the extension direction of the user's vision through the optical path 1 and the optical path 2. The image planes are used to display virtual images. For example, Figure 8 This is an example diagram of a virtual image displayed by a display device provided in an embodiment of the present application. Figure 8In the figure, the direction of the arrow is the extension direction of the user's vision, plane a1b1c1d1 is the image plane 1 formed by the LCD display 201 through the optical path 1 in the extension direction of the user's vision, and plane a2b2c2d2 is the image plane 2 formed by the OLED display 208 through the optical path 2 in the extension direction of the user's vision. In the embodiment of the present application, the image plane 1 can be closer to the human eye than the image plane 2, the image plane 1 can also be farther from the human eye than the image plane 2, and the image plane 1 can also coincide with the position of the image plane 2, which is not limited in the embodiment of the present application.

[0143] It should be understood that the distance between the image plane and the human eye is related to the distance from the display to the optical combiner and the focal length of the optical combiner. The relationship between the three can be referred to the following formula:

[0144]

[0145] Wherein, v represents the distance between the image plane and the human eye, u represents the distance between the display and the optical combiner, and f represents the focal length of the optical combiner.

[0146] In the embodiment of the present application, since the focal lengths of the optical elements (e.g., convex lens A, convex lens B) in the optical combiner are fixed when constructing the optical combiner, the focal length f of the optical combiner is a fixed value. It can be seen from the above formula that u is inversely proportional to v, that is, the closer the distance between the display and the optical combiner, the farther the distance between the image plane and the human eye. Therefore, the adjustment module 30 in the embodiment of the present application can adjust the distance between the display and the optical combiner by adjusting the position of the display, so as to change the position and size of the image plane, thereby making the optical display module display Figure 8 The image plane is shown.

[0147] It can also be understood that when the OLED display moves within the moving range, it will not move onto the optical propagation path of the LCD display.

[0148] Combined with the above Figures 6 to 8 It can be seen that in the display device provided in the embodiment of the present application, the image source displayed by the LCD display forms image plane 1 through optical path 1, and a virtual image is displayed on image plane 1; the image source displayed by the OLED display forms image plane 2 through optical path 2, and a virtual image is displayed on image plane 2. A three-dimensional picture is displayed by superposition of virtual images, and the OLED display does not need to be embedded in the LCD display, thereby avoiding the discontinuity of the displayed three-dimensional picture at the splicing of the physical screen, thereby improving the display effect.

[0149] Moreover, in the display device provided in the embodiment of the present application, since the two displays are not arranged in parallel, the centers of the two displays are not aligned, and the OLED display will not move to the optical propagation path of the LCD display. Therefore, the light propagation path of the LCD display will not be blocked by the OLED display, thereby improving the display effect.

[0150] The above embodiments are combined Figures 6 to 8 A specific structure of an optical display module 20 is introduced, and the following embodiment introduces a specific structure of another optical display module 20.

[0151] Please refer to Fig. 9 , Fig. 9 is a schematic diagram of the structure of another optical display module 20 provided in an embodiment of the present application. Figure 5 The optical display module 20 disposed in the first supporting structure 412 and the second supporting structure 413 in the VR glasses shown have the same structure. Therefore, for the convenience of description, only the optical display module 20 in the first supporting structure 412 is introduced.

[0152] Fig. 9 The optical display module 20 includes an LCD display 201 , and a central axis Z1 of the LCD display 201 is parallel to a line connecting the pupil centers of the left eye 44 and the right eye 45 .

[0153] A 1 / 4 phase glass A202 is attached to the surface of the LCD display 201. The 1 / 4 phase glass A202 is used to convert the linearly polarized light emitted by the LCD display 201 into circularly polarized light.

[0154] Optionally, the optical display module 20 further includes a convex lens D212, and the convex lens D is used to converge the circularly polarized light emitted by the LCD display through the 1 / 4 phase glass A. Fig. 9 It can be seen that both sides of the convex lens D are curved surfaces.

[0155] A semi-transparent and semi-reflective mirror B213 is attached to the upper curved surface of the convex lens D212. The semi-transparent and semi-reflective mirror B213 can transmit a semi-circular polarized light and reflect a semi-circular polarized light. The semi-transparent and semi-reflective mirror B213 can be replaced by a partial reflective film, which can transmit a part of the circular polarized light and reflect a part of the circular polarized light. For example, the partial reflective film can transmit 3 / 4 of the circular polarized light and reflect 1 / 4 of the circular polarized light. The semi-transparent and semi-reflective mirror B213 can also be replaced by a semi-transparent and semi-reflective film. One side of the semi-transparent and semi-reflective film is in a semi-transparent state and the other side is in a reflective state. When the circularly polarized light is irradiated on the side in the semi-transparent state, the circularly polarized light can be fully transmitted. The semi-transparent and semi-reflective mirror B213 can also be attached to the lower surface of the 1 / 4 phase glass A202.

[0156] The optical display module 20 also includes a 1 / 4 phase glass plate D214, a reflective polarizing film B215 and a 1 / 4 phase glass plate E216. The above three optical elements can be attached to the lower curved surface of the semi-transparent and semi-reflective mirror B213, the upper curved surface of the semi-transparent and semi-reflective mirror A204, or the lower surface of the semi-transparent and semi-reflective mirror B213. The reflective polarizing film B215 is attached in the middle of the two 1 / 4 phase glass plates, wherein the 1 / 4 phase glass plate D214 is used to convert the circularly polarized light transmitted by the semi-transparent and semi-reflective mirror B213 into linearly polarized light, the reflective polarizing film B215 can selectively reflect or transmit linearly polarized light, and the 1 / 4 phase glass plate E216 is used to convert the linearly polarized light transmitted by the reflective polarizing film B215 into circularly polarized light.

[0157] Optionally, the optical display module further includes a convex lens A203, which is used to converge the circularly polarized light emitted by the 1 / 4 phase glass E216. Fig. 9 It can be seen that one side of the convex lens A is a flat surface, and the other side is an irregular curved surface.

[0158] A semi-transparent and semi-reflective mirror A204 is attached to the irregular curved surface of the convex lens A203, and the semi-transparent and semi-reflective mirror A204 can transmit semi-circular polarized light and reflect semi-circular polarized light. The semi-transparent and semi-reflective mirror A204 can also be attached to the lower surface of the 1 / 4 phase glass E216.

[0159] A 1 / 4 phase glass plate B205 is attached to the plane of the convex lens A203, and the 1 / 4 phase glass plate B205 is used to convert the circularly polarized light transmitted by the semi-transparent and semi-reflective mirror A204 into linearly polarized light. The 1 / 4 phase glass plate B205 can also be attached to the lower surface of the semi-transparent and semi-reflective mirror A204.

[0160] Optionally, the optical display module 20 further includes a convex lens B206. Fig. 9 It can be seen that one side of the convex lens B206 is a plane and the other side is a curved surface. A reflective polarizing film A207 is attached to the plane of the convex lens B206, and the reflective polarizing film A207 can selectively reflect or transmit linear polarized light. The convex lens B is used to converge the linear polarized light transmitted by the reflective polarizing film A207. The reflective polarizing film A207 can also be attached to the lower surface of the 1 / 4 phase glass plate B205.

[0161] Optionally, the optical display module 20 further includes a direct-light shielding layer 211 , and the direct-light shielding layer may be attached to the curved surface of the convex lens B206 .

[0162] The optical display module 20 further includes an OLED display 208 , and a central axis Z2 of the OLED display 208 is not parallel to a central axis Z1 of the LED display 201 .

[0163] A circular polarizer 209 is attached to the OLED display 208 . Since the light emitted by the OLED display 208 is non-polarized light, the non-polarized light can be converted into circularly polarized light by the circular polarizer 209 .

[0164] Optionally, the optical display module 20 further includes a convex lens C210. Fig. 9 It can be seen that one side of the convex lens C210 is a flat surface and the other side is a curved surface. The convex lens C210 is used to converge the circularly polarized light emitted by the circular polarizer 209 .

[0165] It should also be understood that the above-mentioned optical elements except the LCD display 201 and the OLED display 208 all belong to the optical combiner 22 in the optical display module 20 .

[0166] It should be understood that the OLED display 208 and the plane of the convex lens B206 have a certain angle, and the angle needs to be of appropriate size to ensure that the OLED display 208 does not block the light emitted by the LCD display 201, and to ensure that the light emitted by the OLED display 208 can irradiate the reflective polarizing film A207.

[0167] It should also be understood that Fig. 9 The structure shown is relative to Figure 6 The structure shown adds optical elements such as convex lens D212, semi-transparent mirror B213, 1 / 4 phase glass D214, reflective polarizing film B215 and 1 / 4 phase glass E216. Adding these optical elements can make the LCD display take advantage of Fig. 9 The virtual image formed by the structure shown is better than that formed by Figure 6 The virtual image formed by the structure shown is larger, allowing users to obtain a larger field of view. The reasons are as follows:

[0168] As we all know, the light emitted by the display can also form a virtual image through a convex lens that is several times larger than the image displayed on the display. Fig. 9 The light emitted by the LCD display passes through the convex lens D212, the semi-transparent and semi-reflective mirror B213, the 1 / 4 phase glass D214, the reflective polarizing film B215 and the 1 / 4 phase glass E216 to form a virtual image and Figure 6 The light emitted by the LCD display passes through the convex lens A203, the semi-transparent and semi-reflective mirror A204, the 1 / 4 phase glass B205, and the reflective polarizing film A to form a virtual image. Since the light is transmitted and reflected multiple times, the size of the virtual image formed is almost the same, but Fig. 9 The light in the middle also needs to pass through the convex lens A203, which will also magnify the virtual image. Fig. 9 The virtual image formed by the structure is relative to the use of Figure 6The virtual image formed by the structure is larger, allowing users to obtain a picture with a larger field of view.

[0169] It is understandable. Fig. 9 The 1 / 4 phase glass plate B205 and the reflective polarizing film A207 are arranged in parallel, and the OLED display 208 is placed in a position so that the light emitted by the display can be transmitted through the 1 / 4 phase glass plate B205 to the reflective polarizing film A. The purpose of this arrangement is to make Fig. 9 The structure shown is more compact, but the disadvantage of such a configuration is that the movable range of the OLED display 208 is too small. Therefore, in order to increase the movable range of the OLED display 208, the embodiment of the present application provides another structure of the optical display module 20.

[0170] Please refer to Fig.10 , Fig.10 It is a schematic diagram of the structure of another optical display module 20 provided in an embodiment of the present application. Fig.10 and Fig. 9 The difference is that Fig. 9 A circular polarizer 209 is attached to the OLED display 208. Fig.10 A linear polarizer 217 is attached to the OLED display 208. Fig. 9 The light emitted by the OLED display 208 becomes circularly polarized light after passing through the circular polarizer 209. The circularly polarized light needs to reach the 1 / 4 phase glass B205 after passing through the convex lens C210. ​​The 1 / 4 phase glass B205 converts the circularly polarized light into linearly polarized light before reaching the reflective polarizing film A207. Fig.10 The light emitted by the OLED display 208 in the image becomes linearly polarized light after passing through the linear polarizer 217, and the circularly polarized light does not need to pass through the 1 / 4 phase glass B205 after passing through the convex lens C210, and can directly reach the reflective polarizing film A207. In layman's terms, Fig. 9 The distance between the reflective polarizing film A207 and the 1 / 4 phase glass plate B205 is relatively close. Fig.10 The distance between the middle reflective polarizing film A207 and the 1 / 4 phase glass plate B205 is relatively far.

[0171] In other embodiments, in order to increase the movable range of the OLED display 208 without blocking the propagation path of the light emitted by the LCD display, when setting the reflective polarizing film A207, the convex lens B206 and the direct shielding layer 211, the reflective polarizing film A207, the convex lens B206 and the direct shielding layer 211 can be tilted relative to the 1 / 4 phase glass plate B205. The tilted reflective polarizing film A207, the convex lens B206 and the direct shielding layer 211 can refer to Fig.10 .

[0172] Fig.10The reason why the reflective polarizing film A207, the convex lens B206 and the direct shielding layer 211 arranged obliquely in the middle do not block the propagation path of the light emitted by the LCD display and increase the movable range of the OLED display 208 is: For example, please refer to Fig.11 , Fig.11 It is a simplified structural diagram of an optical display module 20 provided in an embodiment of the present application. Fig.11 Relative to Fig.10 Most of the optical components are omitted. Fig.11 In the structural diagram (a) shown in FIG. 1 , the OLED display 208 can move along the path of the dotted line DL. Assuming that the two edge light rays sent by the OLED display 208 are L1 and L2, and the two edge light rays sent by the OLED display 201 are L1 and L2, in order to prevent the position of the OLED display 208 after movement from blocking the propagation path of the light emitted by the LCD display, the movable range of the OLED display 208 can refer to Fig.11 (a) in FIG. 1 shows H1.

[0173] Please refer to Fig.11 In the structural diagram (b) shown in FIG. 1 , in order to increase the movable range of the OLED display 208 without blocking the propagation path of the light emitted by the LCD display, the reflective polarizing film A207, the convex lens B206 and the direct shielding layer 211 can be arranged tilted. After the tilting, the movable range of the OLED display 208 can refer to Fig.11 (b) shows H2, which is Fig.11 It can be seen that the moving range of H2 is larger than that of H1.

[0174] It should be understood that in order to increase the movable range of the OLED display 208 without blocking the propagation path of the light emitted by the LCD display, Figure 6 The reflective polarizing film A207, convex lens B206 and direct shielding layer 211 can also be arranged at an angle.

[0175] The above embodiments are combined Fig. 9 , Fig.10 and Fig.11 Another specific structure of the optical display module 20 and the functions of each structure are described. Fig. 9 For ease of description, the light path of the light emitted by the LCD display 201 passing through the optical display module 20 is called light path 3, and the light path of the light emitted by the OLED display 208 passing through the optical display module 20 is called light path 4.

[0176] Assuming that the reflective polarizing film A207 is configured to reflect vertical linear polarized light and transmit horizontal linear polarized light, the optical path 1 can be:

[0177] Please refer to Fig. 9 For example, the S linear polarized light (horizontally polarized light) emitted by the LCD display 201 passes through the 1 / 4 phase glass A202 and becomes the right circularly polarized light RCP. After passing through the semi-transparent and semi-reflective mirror B213, half of the RCP is transmitted, and the polarization state does not change. After passing through the 1 / 4 phase glass D214, the RCP becomes the P linear polarized light (vertically polarized light). The P linear polarized light reaches the reflective polarizing film B215 for reflection. Since the reflective polarizing film B215 is set to reflect the P linear polarized light and transmit the S linear polarized light, the reflective polarizing film B215 reflects the P linear polarized light. The P linear polarized light passes through the 1 / 4 phase glass D214 for the second time and becomes back Right circularly polarized light RCP is reflected by the semi-transparent and semi-reflective mirror B213. Since the circularly polarized light encounters reflection, it will change its rotation direction, so RCP becomes left circularly polarized light LCP. LCP passes through the 1 / 4 phase glass D214 for the third time and becomes S linear polarized light. The S linear polarized light reaches the reflective polarizing film B215 and is transmitted. The S linear polarized light passes through the 1 / 4 phase glass E216 and becomes LCP. After passing through the semi-transparent and semi-reflective mirror A204, half of the LCP is transmitted, and the polarization state does not change. After passing through the 1 / 4 phase glass B205, the LCP becomes S linear polarized light. The S linear polarized light reaches the reflective polarizing film A207 and is transmitted and enters the human eye.

[0178] The propagation path of light path 4 is the same as that of light path 2, and will not be described in detail here.

[0179] It can be seen from optical path 3 and optical path 4 that the light rays finally entering the human eye along optical path 3 and optical path 4 are folded back and forth for many times, resulting in the image seen by the human eye being a virtual image that is larger and farther away than the image displayed on the monitor.

[0180] The following examples are for Fig.10 For ease of description, the light path of the light emitted by the LCD display 201 passing through the optical display module 20 is called light path 5, and the light path of the light emitted by the OLED display 208 passing through the optical display module 20 is called light path 6.

[0181] Assume that the reflective polarizing film A207 is configured to reflect vertically polarized light and transmit horizontally polarized light.

[0182] It should be understood that the propagation path of the optical path 5 is the same as the propagation path of the optical path 3, which will not be described in detail here.

[0183] Optical path 6 can be: Please refer to Fig.10Exemplarily, the OLED display 208 emits P linear polarized light (vertical linear polarized light) through the linear polarizer 217, the P linear polarized light passes through the convex lens C210 and is irradiated onto the reflective polarizing film A207 and is reflected, the P linear polarized light passes through the 1 / 4 phase glass plate B205 and becomes right-handed circularly polarized light RCP, the RCP is reflected by the semi-transparent and semi-reflective mirror A204 and becomes left-handed circularly polarized light LCP, the LCP passes through the 1 / 4 phase glass plate B205 and becomes S linear polarized light, the S linear polarized light reaches the reflective polarizing film A207 and is transmitted and enters the human eye.

[0184] It can be seen from optical path 5 and optical path 6 that the light rays finally entering the human eye along optical path 5 and optical path 6 are folded back and forth for many times, resulting in the image seen by the human eye being a virtual image that is larger and farther away than the image displayed on the monitor.

[0185] In the embodiment of the present application, the optical display module 20 can form two image planes in the extension direction of the user's vision through the optical path 3 and the optical path 4, or the optical path 5 and the optical path 6. The image planes are used to display virtual images. For example, Fig.12 This is an example diagram of a virtual image displayed by another display device provided in an embodiment of the present application. Fig.12 In the figure, the direction of the arrow is the extension direction of the user's vision, plane a11b11c11d11 is the image plane 2 formed by the LCD display 201 through the optical path 3 or the optical path 5 in the extension direction of the user's vision, and plane a21b21c21d21 is the image plane 2 formed by the OLED display 208 through the optical path 4 or the optical path 6 in the extension direction of the user's vision, and the position of image plane 2 coincides with that of image plane 1.

[0186] As can be seen from the above embodiments, the distance between the image plane and the human eye is related to the distance from the display to the optical combiner and the focal length of the optical combiner. Therefore, the adjustment module 30 in the embodiment of the present application can adjust the distance from the display to the optical combiner by adjusting the position of the display, so as to change the position and size of the image plane, thereby making the optical display module display Fig.12 The image plane is shown.

[0187] Combined with the above Figures 9 to 12 It can be seen that in the display device provided in the embodiment of the present application, the image source displayed by the LCD display is an image plane 1 formed by the optical path 3 or the optical path 5, and a virtual image is displayed on the image plane 1. The image source displayed by the OLED display is an image plane 2 formed by the optical path 4 or the optical path 6, and a virtual image is displayed on the image plane 2. A three-dimensional picture is displayed by a combination of virtual images, and the OLED display does not need to be embedded in the LCD display, thereby avoiding the discontinuity of the displayed three-dimensional picture at the splicing of the physical screen, thereby improving the display effect.

[0188] Moreover, in the display device provided in the embodiment of the present application, since the two displays are not arranged in parallel, the centers of the two displays are not aligned, and the OLED display will not move to the optical propagation path of the LCD display. Therefore, the light propagation path of the LCD display will not be blocked by the OLED display, thereby improving the display effect.

[0189] The above embodiments are combined Figures 9 to 12 A specific structure of an optical display module 20 is introduced, and the following embodiment introduces a specific structure of another optical display module 20.

[0190] Please refer to Fig.13 , Fig.13 is a schematic diagram of the structure of another optical display module 20 provided in an embodiment of the present application. Figure 5 The optical display module 20 disposed in the first supporting structure 412 and the second supporting structure 413 in the VR glasses shown have the same structure. Therefore, for the convenience of description, only the optical display module 20 in the first supporting structure 412 is introduced.

[0191] The optical display module 20 includes an LCD display 201 , and a central axis Z1 of the LCD display 201 is parallel to a line connecting pupil centers of the left eye 44 and the right eye 45 .

[0192] A 1 / 4 phase glass A202 is attached to the surface of the LCD display 201. The 1 / 4 phase glass A202 is used to convert the linearly polarized light emitted by the LCD display 201 into circularly polarized light.

[0193] The optical display module 20 further includes an OLED display 208 , and a central axis Z2 of the OLED display 208 is parallel to a central axis Z1 of the LED display 201 , that is, the OLED display 208 is arranged in parallel to the LED display 201 .

[0194] The OLED display 208 of the embodiment of the present application is a transparent display screen, which uses a transparent material as a carrier, so that light can pass through from behind the screen, so the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208. In other embodiments, when the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208, the OLED display 208 and the LED display 201 can also be arranged non-parallel.

[0195] A circular polarizer 209 is attached to the OLED display 208 . Since the light emitted by the OLED display 208 is non-polarized light, the non-polarized light can be converted into circularly polarized light by the circular polarizer 209 .

[0196] Optionally, the optical display module 20 further includes a convex lens F219, which is used to converge the light emitted by the LCD display and the light emitted by the OLED display 208. Fig.13 It can be seen that one side of the convex lens F219 is a flat surface and the other side is a curved surface.

[0197] Optionally, a semi-transparent and semi-reflective mirror A204 is attached to the curved surface of the convex lens F219, and the semi-transparent and semi-reflective mirror A204 can transmit semicircular polarized light and reflect semicircular polarized light. The semi-transparent and semi-reflective mirror A204 can be replaced by a partial reflection film. The semi-transparent and semi-reflective mirror A204 can also be replaced by a semi-transparent and semi-reflective film. The semi-transparent and semi-reflective mirror A204 can also be attached to the lower surface of the 1 / 4 phase glass A202.

[0198] A 1 / 4 phase glass plate B205 is attached to the plane of the convex lens F219, and the 1 / 4 phase glass plate B205 is used to convert the circularly polarized light transmitted by the semi-transparent and semi-reflective mirror A204 into linearly polarized light. The 1 / 4 phase glass plate B205 can also be attached to the lower surface of the semi-transparent and semi-reflective mirror A204.

[0199] Optionally, the optical display module 20 further includes a convex lens B206. Fig.13 It can be seen that one side of the convex lens B206 is a plane and the other side is a curved surface. A reflective polarizing film A207 is attached to the plane of the convex lens B206, and the reflective polarizing film A207 can selectively reflect or transmit linear polarized light. The convex lens B is used to converge the linear polarized light transmitted by the reflective polarizing film A207. The reflective polarizing film A207 can also be attached to the lower surface of the 1 / 4 phase glass plate B205.

[0200] In the embodiment of the present application, the display device uses Fig.13 When the structure is used for light path propagation, the light path propagation modes of the LED display and the OLED display are the same as the light path 1 in the above embodiment, and will not be repeated here.

[0201] In the embodiment of the present application, the display device uses Fig.13 The virtual image formed by the structure can be referred to Figure 8 or Fig.12 , wherein image plane 1 may be an image plane formed by an LCD display, and image plane 2 may be an image plane formed by an OLED display.

[0202] Combined with the above Fig.13It can be seen that in the display device provided in the embodiment of the present application, the image source displayed by the LCD display can form image plane 1 through optical path 1, and a virtual image is displayed on image plane 1; the image source displayed by the OLED display can form image plane 2 through optical path 1, and a virtual image is displayed on image plane 2. A three-dimensional picture is displayed by superposition of virtual images, and the OLED display does not need to be embedded in the LCD display, thereby avoiding the discontinuity of the displayed three-dimensional picture at the splicing of the physical screen, thereby improving the display effect.

[0203] Moreover, in the display device provided by the embodiment of the present application, since the OLED display is a transparent display screen, the LCD display can be transmitted from behind the OLED display, so that the light propagation path of the LCD display will not be blocked by the OLED display, thereby improving the display effect.

[0204] The above embodiment 13 introduces a specific structure of an optical display module 20 , and the following embodiment introduces another specific structure of an optical display module 20 .

[0205] Please refer to Fig.14 , Fig.14 is a schematic diagram of the structure of another optical display module 20 provided in an embodiment of the present application. Figure 5 The optical display module 20 disposed in the first supporting structure 412 and the second supporting structure 413 in the VR glasses shown have the same structure. Therefore, for the convenience of description, only the optical display module 20 in the first supporting structure 412 is introduced.

[0206] The optical display module 20 includes an LCD display 201 , and a central axis Z1 of the LCD display 201 is non-parallel to a line connecting the centers of pupils of the left eye 44 and the right eye 45 .

[0207] A 1 / 4 phase glass A202 is attached to the surface of the LCD display 201. The 1 / 4 phase glass A202 is used to convert the linearly polarized light emitted by the LCD display 201 into circularly polarized light.

[0208] The optical display module 20 further includes an OLED display 208 , and a central axis Z2 of the OLED display 208 is parallel to a central axis Z1 of the LED display 201 , that is, the OLED display 208 is arranged in parallel to the LED display 201 .

[0209] The OLED display 208 of the embodiment of the present application is a transparent display screen, which uses a transparent material as a carrier, so that light can pass through from behind the screen, so the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208. In other embodiments, when the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208, the OLED display 208 and the LED display 201 can also be arranged non-parallel.

[0210] A circular polarizer 209 is attached to the OLED display 208 . Since the light emitted by the OLED display 208 is non-polarized light, the non-polarized light can be converted into circularly polarized light by the circular polarizer 209 .

[0211] Optionally, the optical display module 20 further includes a convex lens C210. Fig.14 It can be seen that one side of the convex lens C210 is a flat surface and the other side is a curved surface. The convex lens C210 is used to converge the light emitted by the OLED display 208 and the light emitted by the LCD display 201 .

[0212] Optionally, the optical display module 20 further includes a convex lens A203, and a convex lens C210 is used to converge the light emitted by the OLED display 208 and the light emitted by the LCD display 201. Fig.13 It can be seen that one side of the convex lens A is a flat surface, and the other side is an irregular curved surface.

[0213] Optionally, a semi-transparent and semi-reflective mirror A204 is attached to the irregular curved surface of the convex lens A203, and the semi-transparent and semi-reflective mirror A204 can transmit semi-circular polarized light and reflect semi-circular polarized light. The semi-transparent and semi-reflective mirror A204 can be replaced by a partial reflection film, and the semi-transparent and semi-reflective mirror A204 can also be replaced by a semi-transparent and semi-reflective film.

[0214] A 1 / 4 phase glass plate B205 is attached to the plane of the convex lens A203, and the 1 / 4 phase glass plate B205 is used to convert the circularly polarized light transmitted by the semi-transparent and semi-reflective mirror A204 into linearly polarized light. The 1 / 4 phase glass plate B205 can also be attached to the lower surface of the semi-transparent and semi-reflective mirror A204.

[0215] Optionally, the optical display module 20 further includes a convex lens B206. Figure 6 It can be seen that one side of the convex lens B206 is a plane and the other side is a curved surface. A reflective polarizing film A207 is attached to the plane of the convex lens B206, and the reflective polarizing film A207 can selectively reflect or transmit linear polarized light. The convex lens B is used to converge the linear polarized light transmitted by the reflective polarizing film A207. The reflective polarizing film A207 can also be attached to the lower surface of the 1 / 4 phase glass plate B205.

[0216] In the embodiment of the present application, the display device uses Fig.14 When the structure is used for light path propagation, the light path propagation modes of the LED display and the OLED display are the same as the light path 2 in the above embodiment, and will not be repeated here.

[0217] In the embodiment of the present application, the display device uses Fig.14 The virtual image formed by the structure can be referred to Figure 8 or Fig.12 , wherein image plane 1 may be an image plane formed by an LCD display, and image plane 2 may be an image plane formed by an OLED display.

[0218] Combined with the above Fig.14 It can be seen that in the display device provided in the embodiment of the present application, the image source displayed by the LCD display can form an image plane 1 through the optical path 2, and a virtual image is displayed on the image plane 1; the image source displayed by the OLED display can form an image plane 2 through the optical path 2, and a virtual image is displayed on the image plane 2. A three-dimensional picture is displayed by superposition or combination of virtual images, and the OLED display does not need to be embedded in the LCD display, thereby avoiding the discontinuity of the displayed three-dimensional picture at the splicing of the physical screen, thereby improving the display effect.

[0219] Moreover, in the display device provided by the embodiment of the present application, since the OLED display is a transparent display screen, the LCD display can be transmitted from behind the OLED display, so that the light propagation path of the LCD display will not be blocked by the OLED display, thereby improving the display effect.

[0220] The above embodiments are combined Fig.14 A specific structure of an optical display module 20 is introduced, and the following embodiment introduces a specific structure of another optical display module 20.

[0221] Please refer to Fig.15 , Fig.15 is a schematic diagram of the structure of another optical display module 20 provided in an embodiment of the present application. Figure 5 The optical display module 20 disposed in the first supporting structure 412 and the second supporting structure 413 in the VR glasses shown have the same structure. Therefore, for the convenience of description, only the optical display module 20 in the first supporting structure 412 is introduced.

[0222] Fig.15The optical display module 20 in the embodiment includes an LCD display 201 and an OLED display 208, wherein the LCD display 201 and the OLED display are arranged in parallel, and the central axis Z1 of the LCD display 201 and the central axis Z2 of the OLED display 208 are parallel to the line connecting the pupil centers of the left eye 44 and the right eye 45. The LCD display 201 is far from the human eye 44, and the OLED display is close to the human eye 44.

[0223] In the embodiment of the present application, the OLED display 208 is a transparent display screen, which uses a transparent material as a carrier, so that light can pass through from behind the screen, and thus the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208. In other embodiments, when the light emitted by the LCD display 201 can pass through the light emitted by the OLED display 208, the OLED display 208 and the LED display 201 can also be arranged non-parallel.

[0224] In the embodiment of the present application, the convex lens E218 can be an aspherical lens or a Fresnel lens. After the light emitted by the LCD display 201 and the OLED display 208 passes through the convex lens E218, the convex lens E218 uses the principle of light refraction to change the direction of the light, thereby amplifying the images displayed by the LCD display 201 and the OLED display 208, forming a virtual image that is larger than the image displayed by the display, allowing the user to obtain a picture with a larger field of view.

[0225] In the embodiment of the present application, the display device uses Fig.15 The virtual image formed by the structure can be referred to Figure 8 or Fig.12 , wherein image plane 1 may be an image plane formed by an LCD display, and image plane 2 may be an image plane formed by an OLED display.

[0226] Combined with the above Fig.15 It can be seen that in the display device provided in the embodiment of the present application, the image source displayed by the LCD display can form an image plane 1 through the convex lens E218, and a virtual image is displayed on the image plane 1. The image source displayed by the OLED display can form an image plane 2 through the convex lens E218, and a virtual image is displayed on the image plane 2. A three-dimensional picture is displayed by superposition or combination of virtual images, and the OLED display does not need to be embedded in the LCD display, thereby avoiding the discontinuity of the displayed three-dimensional picture at the joints of the physical screens, thereby improving the display effect.

[0227] Moreover, in the display device provided by the embodiment of the present application, since the OLED display is a transparent display screen, the LCD display can be transmitted from behind the OLED display, so that the light propagation path of the LCD display will not be blocked by the OLED display, thereby improving the display effect.

[0228] Above Figures 6 to 15 In the specific structure of the optical display module 20 introduced in the specification, the number of the LCD display and the number of the OLED display are both one. In other embodiments, the optical display module 20 may include multiple LCD displays and multiple OLED displays.

[0229] For example, see Fig.16 , Fig.16 is a schematic structural diagram of another optical display module 20 provided in an embodiment of the present application, Fig.16 In the embodiment, the optical display module 20 may include two OLED displays 208, and in order to smoothly transmit light, may also include two circular polarizers 209. Fig.17 , Fig.17 is a schematic structural diagram of another optical display module 20 provided in an embodiment of the present application, Fig.17 In the embodiment, the optical display module 20 may include two LCD displays 201, wherein the LCD display 201 closer to human eyes is a transparent display screen.

[0230] In summary Figures 4 to 15 It can be seen that the display device provided in the embodiment of the present application can display a three-dimensional picture by superimposing or combining multiple virtual images, thereby avoiding the discontinuity of the displayed three-dimensional picture at the joints of the physical screens, and the light propagation path of each physical screen in the embodiment of the present application will not be blocked by another physical screen, thereby improving the display effect.

[0231] In addition, the display device provided in the embodiment of the present application utilizes Figures 6 to 15 The structure of the optical display module shown can also solve the convergence adjustment conflict commonly seen in display devices.

[0232] The following is an introduction to the causes of convergence regulation conflicts.

[0233] As we all know, humans live in a three-dimensional world. By using both eyes, humans can observe the same object from different angles. Because there is a certain distance between the two eyes (interpupillary distance), there is a slight deviation in the position of the object seen by the two eyes, which is usually called parallax. Due to the parallax, the two images seen by the left eye and the right eye are transmitted to the human brain, and after analysis and synthesis by the human brain, a complete single image with three-dimensional stereoscopic vision is generated. This is the advanced visual function of humans - binocular single vision.

[0234] In order for humans to have binocular single vision, it is also necessary to achieve it through the convergence and focusing functions in conjunction with the brain. The relevant definitions of convergence and focusing can be referred to in the above embodiments, and will not be repeated here.

[0235] Normally, when humans look at objects in the real world, the convergence and focusing functions of the eyes are coordinated with each other. The convergence function will converge the sight of both eyes on the same object, and the focusing function will also focus on the object at the same distance. Over time, the brain has become accustomed to the rule that the sight and focus are always in the same position. For example, please refer to Fig.18 , Fig.18 This is an example diagram of a convergence accommodation conflict. When the human eye looks at a distant object C1 in the real world, the convergence angle between the eyeballs B1 and B2 and the object C1 is A1, and the focusing function of the eyeballs B1 and B2 will also adjust the focal length to D1. When the human eye looks at a close object C2 in the real world, the convergence angle between the eyeballs B1 and B2 and the object C2 is A2, and the focusing function of the eyeballs B1 and B2 will also adjust the focal length to D2. A1 corresponds to D1, and A2 corresponds to D2.

[0236] However, in the relevant display device, the distance between the user and the display in the display device is constant, so the focal length cannot be changed. This results in the inability of the eyeball's focusing function to follow the convergence function as usual, thus breaking the long-standing rule and separating the positions of convergence and focusing. This is the convergence adjustment conflict. For example, Fig.18 In the example, when the human eye views an object in a three-dimensional display screen, the convergence angle between the eyes and the object image C1 is A1. However, the focal length of the eyeball is D3 (the eyeball originally needs to focus to D1), and it is unable to focus following the convergence function. For example, Fig.18 The convergence angle between the two eyes and the object image C2 is A2, but the focal length of the eyeball is D3 (the eyeball originally needs to focus to D2), and it is unable to focus following the convergence function.

[0237] Due to the conflict of convergence and accommodation, the brain must be forced to synthesize information that the line of sight and the focus are not in the same position, which will cause confusion in the brain and may cause adverse reactions such as visual fatigue, dizziness, and headaches over a long period of time.

[0238] The present application embodiment utilizes Figures 6 to 17 When the optical display module shown solves the convergence adjustment conflict, the following conditions need to be met:

[0239] Condition 1: The centers of the two image planes formed by the optical display module are on a line with the center of the pupil of the human eye.

[0240] Condition 2: the screen resolution of the LCD display 201 for providing the image plane 1 is the same as the screen resolution of the OLED display 208 for providing the image plane 2, and the field angle of the image plane 1 observed by the human eye is the same as the field angle of the image plane 2 observed by the human eye. For example, Figure 8In the two image planes shown, the field angle a1ob1 is equal to the field angle a2ob2, the field angle a1oc1 is equal to the field angle a2oc2, and the field angle a1od1 is equal to the field angle a2od2.

[0241] According to the above two conditions, the effect diagram seen by human eyes through the display device can be referred to Figure 8 When the human eye views image plane 1 and image plane 2, each pixel on image plane 1 coincides with each pixel on image plane 2. For example, Figure 8 Pixel e1 on image plane 1 coincides with pixel f1 on image plane 2, and pixel e2 on image plane 1 coincides with pixel f2 on image plane 2. In layman's terms, according to the above two conditions, although the display device displays two image planes, the human eye only sees one image plane.

[0242] It is easy to understand that in the optical display module 20 , by using an LCD display and an OLED display with the same resolution, the resolutions of the two displays can be made the same.

[0243] It should also be understood that the size of the field of view depends on the screen size of the display on the one hand, and on the ability of the optical combiner to bend light on the other hand. Figures 6 to 17 When the optical combiner of the optical display module is used, the relevant parameters (such as focal length) of the optical elements (such as convex lens A and convex lens B) in the optical combiner are fixed. Therefore, in the embodiment of the present application, the size of the field of view angle depends on the screen size of the display. The larger the screen size of the display, the larger the field of view angle, and the smaller the screen size of the display, the smaller the field of view angle. In the embodiment of the present application, by using an LCD display and an OLED display of the same size in the optical display module, the field of view angles provided by the two displays can be the same. Thus, condition 2 can be satisfied.

[0244] Condition 1 can be met by calibrating the LCD display and the OLED display. The calibration process is as follows:

[0245] Exemplarily, the user marks the center of the image source displayed by the LCD display and the center of the image source displayed by the OLED display in advance. After the LCD display displays image plane 1 through the optical display module and the OLED display displays image plane 2 through the optical display module, the user looks directly at the image plane 1 displayed in the VR glasses through the human eye to observe whether the mark on the image plane 1 is in the normal viewing direction of the human eye. If the mark on the image plane 1 is not in the normal viewing direction of the human eye, the position of the LCD display is adjusted through the adjustment module to make the mark on the image plane 1 in the normal viewing direction of the human eye. If the mark on the image plane 1 is in the normal viewing direction of the human eye, then observe whether the virtual image on the image plane 1 has double images, or whether there are multiple identical virtual images, or whether there are two marks. Assuming that the virtual image has no double images or does not have multiple identical virtual images or has only one mark, then the calibration is completed. Assuming that the virtual image has double images or has multiple identical virtual images or has two marks, then the centers of the two image planes are not on a connecting line with the center of the pupil of the human eye. At this time, the position of the display is adjusted through the adjustment module so that the virtual image has no double images or does not have multiple identical virtual images or has only one mark.

[0246] It can also be understood that the above calibration method is only an exemplary description, and the embodiments of the present application do not limit the calibration method.

[0247] In the embodiment of the present application, after the optical display module 20 satisfies the above-mentioned conditions 1 and 2, the processor 11 can solve the convergence adjustment conflict through the following implementation method.

[0248] Step A: The processor obtains a depth value of each pixel in any one of a first depth image (image source) displayed by the LCD display and a second depth image (image source) displayed by the OLED display.

[0249] It should be understood that a depth image can be called a distance image, which refers to an image that uses the distance (depth) from the image collector to each point in the scene as a pixel value, and it directly reflects the geometry of the visible surface of the scene. In layman's terms, a depth image is equal to an ordinary red, green, and blue (RGB) three-channel color image plus a depth map. Each pixel value in the depth map is the actual distance from the sensor to the object. Therefore, the depth image includes not only RGB pixel values, but also depth values.

[0250] It should also be understood that the image content of the first depth image and the second depth image is the same. In layman's terms, the LCD display and the OLED display play the same image or video at the same time, and the screen resolution of the LCD display is the same as the screen resolution of the OLED display. Therefore, the resolution of the first depth image and the second depth image is also the same, so that each pixel in the first depth image corresponds to each pixel in the second depth image one by one, and one pixel in the first depth image corresponds to one pixel in the second depth image, and the depth values ​​of the one-to-one corresponding pixels in the first depth image and the second depth image are the same. For example, Figure 8 The image plane 1 shown is an image plane obtained by projection of the LCD display, and the image plane 2 is an image plane obtained by projection of the OLED display. Image plane 1 can be considered as a projection of the first depth image, and image plane 2 can be considered as a projection of the second depth image. Then, the one-to-one correspondence between each pixel in the first depth image and each pixel in the second depth image can mean that the e1 pixel corresponds to the f1 pixel, the e2 pixel corresponds to the f2 pixel, and the depth value of the e1 pixel is the same as the depth value of the f1 pixel, and the depth value of the e2 pixel is the same as the depth value of the f2 pixel.

[0251] It can be understood that the format of the first depth image and the second depth image obtained by the processor can be (RGB, D), RGB represents the RGB value of the pixel, D represents the depth value of the pixel, and the value range of RGB is usually 0 to 255, 256 is exactly 2 to the 8th power, and is represented by numbers from 0, 1, 2... to 255. The reason for reaching 255 is that the data in the chip is stored and calculated in binary form. Most chips are eight bits, that is, the maximum storage capacity of the chip is exactly 2 to the 8th power. Of course, when the chip is ten bits, the maximum storage capacity of the chip can also be 2 to the 10th power. The value range of RGB can also be 0 to 1024. The embodiment of the present application does not limit the value range of RGB.

[0252] 0 to 255 can also represent that each color of the three color channels of red, green and blue is divided into 256 levels of brightness, with the brightness being the weakest at 0 and the brightest at 255. In layman's terms, the larger the pixel value, the brighter the image at the pixel point, and the smaller the pixel value, the darker the image at the pixel point. Based on this feature, the embodiment of the present application adjusts the brightness of each pixel value in the first depth image and the second depth image by adjusting the pixel value of each pixel in the first depth image and the second depth image, thereby changing the brightness of image plane 1 and image plane 2. By changing the brightness of image plane 1 and image plane 2, the human eye can sense the depth change of each object in the image, so that the focusing function of the human eye can follow the convergence function to focus, thereby solving the problem of convergence adjustment conflict.

[0253] Step B: The processor determines, according to the depth value of each pixel, a ratio of a pixel value of each pixel in the first depth image to a pixel value of each pixel in the second depth image.

[0254] For ease of description, the pixel value of each pixel in the first depth image is referred to as a first-category pixel value, and the pixel value of each pixel in the second depth image is referred to as a second-category pixel value.

[0255] It should be understood that the smaller the depth value of a pixel on the first depth image or the second depth image, the closer the distance between the pixel and the human eye is. Figure 8 The pixel e1 shown shows a brighter brightness, and the pixel on the image plane 2 far away from the human eye (eg Figure 8 The pixel f1) shown shows a darker brightness, so that the human eye can feel that the pixel is closer to the human eye through the fused brightness displayed by the pixel e1 on the image plane 1 and the pixel f1 on the image plane 2.

[0256] Similarly, the larger the depth value of a pixel is, the farther the pixel is from the human eye. Therefore, the pixel on the image plane 1 close to the human eye (e.g. Figure 8 The pixel e1 shown shows a darker brightness, and the pixel on the image plane 2 far away from the human eye (eg Figure 8 The pixel f1) shown shows a brighter brightness, so that the fused brightness displayed by the pixel e1 on the image plane 1 and the pixel f1 on the image plane 2 can make the human eye feel that the pixel is farther away from the human eye.

[0257] From the above, it can be seen that the human eye's sense of depth of pixels is determined by the brightness of the pixels displayed on image plane 1 and image plane 2. The sense of depth means that the human eye can feel near and far on the screen, and the brightness of the pixel display is related to the pixel value. The larger the pixel value, the brighter the display brightness, and the smaller the pixel value, the weaker the display brightness. In addition, image plane 1 and image plane 2 are projections of the first depth image and the second depth image. Therefore, changing the pixel values ​​on the first depth image and the second depth image can change the brightness of the pixels displayed on image plane 1 and image plane 2.

[0258] From the above, it can also be known that the size of the pixel value on the first depth image and the second depth image is related to the depth value of the pixel of the first depth image or the second depth image. The smaller the depth value of a pixel, the larger the pixel value of the first depth image, and the smaller the pixel value of the second depth image. The larger the depth value of a pixel, the smaller the pixel value of the first depth image, and the larger the pixel value of the second depth image.

[0259] In an embodiment of the present application, a correspondence between the depth value of a pixel configured in the processor and the ratio of the pixel value of each pixel in the first depth image to the pixel value of each pixel in the second depth image is configured. Through this correspondence, the processor can determine the pixel value of the first depth image and the pixel value of the second depth image according to the depth value of the pixel.

[0260] In the embodiment of the present application, the above correspondence relationship can be constructed in the following way:

[0261] Exemplarily, the range of the depth value of the pixel on the preset first depth image or the second depth image is (d min , d max ), at a pixel depth value d min When the depth value is d min The ratio of the pixel value of the corresponding first depth image to the pixel value of the second depth image is 1:0; when the depth value of a pixel is d max When the depth value is d max The corresponding ratio of the pixel value of the first depth image to the pixel value of the second depth image is 0:1. x When the depth value is d x The ratio of the corresponding pixel values ​​can be calculated based on the depth value d min The corresponding pixel value ratio and depth value are d max The corresponding pixel value ratio is obtained, for example, for d min The corresponding pixel value ratio is 1:0 and d max The corresponding pixel value ratio is 0:1, and linear interpolation is performed to obtain d x The ratio of corresponding pixel values.

[0262] For example, if the depth value range of the pixels on the preset first depth image or the second depth image is (1, 6), and the unit of depth is meter, the corresponding relationship can be referred to in the following table:

[0263] Table 1

[0264] Depth Value First type pixel value: second type pixel value 1 1：0 2 4 / 5：1 / 5 3 3 / 5：2 / 5 4 2 / 5：3 / 5 5 1 / 5：4 / 5 6 0：1

[0265] Based on the above correspondence, the processor can determine the ratio of the first type of pixel value to the second type of pixel value according to the depth value of each pixel in the first depth image or the depth value of each pixel in the second depth image.

[0266] Step C: The processor adjusts the pixel value of each pixel in the first depth image and the second depth image based on the ratio of the first type of pixel value to the second type of pixel value, so that image plane 1 and image plane 2 display the brightness corresponding to the pixel value of each pixel.

[0267] For example, please refer to Figure 8 , the format of the first depth image and the second depth image can be (RGB, D), assuming that a pixel in the first depth image is e1, e1 can be expressed as (255, 150, 130, 2), and the pixel corresponding to e1 in the second depth image is f1, f1 can be expressed as (255, 150, 130, 2), then the depth value of the e1 pixel is 2. According to Table 1 above, when the depth value is 2, the ratio of the pixel value of the first depth image to the pixel value of the second depth image is 4 / 5:1 / 5. The processor can adjust the pixel value of e1 and the pixel value of f1 according to the ratio. The sectioned e1 can be expressed as (255×4 / 5=204, 150×4 / 5=120, 130×4 / 5=104, 2×4 / 5=1.6), and the adjusted f1 can be expressed as (255×1 / 5=51, 150×1 / 5=30, 130×1 / 5=26, 2×1 / 5=0.4). The pixel value of the adjusted e1 is greater than the pixel value of the adjusted f1. Therefore, the brightness of e1 displayed on the image plane is brighter than the brightness of f1 displayed on the image plane. By fusing the brightness of e1 and the brightness of f1, the human eye can feel that the depth of the pixel is 2 meters. The processor can refer to the above example to adjust the pixel values ​​of other pixels, which will not be repeated here.

[0268] The embodiment of the present application adjusts the brightness of each pixel on image plane 1 and image plane 2, and fuses the brightness of each pixel on image plane 1 and image plane 2 for display, so that the human eye can feel the depth of each pixel. When the human eye feels the depth of each pixel, the convergence function will converge the sights of both eyes to each pixel, and at the same time, the focusing function will focus on the pixels at the same distance. In this way, the convergence and focusing functions of the human eye can be coordinated with each other, so that the sights of both eyes can converge on the same pixel, effectively solving the convergence adjustment conflict.

[0269] For example, see Fig.19 , Fig.19 This is an example diagram for resolving convergence regulation conflicts provided by an embodiment of the present application. Fig.19 In the figure, binocular B1 and B2 observe that pixel e1 on image plane 1 and pixel f1 on image plane 2 are overlapped, and pixel e1 on image plane 1 is the projection of pixel e1 of the first depth image. Assuming that the depth of pixel e1 of the first depth image is D2, by adjusting the brightness of pixel e1 on image plane 1 and the brightness of pixel f1 on image plane 2 and merging and displaying them, the pixel observed by the human eye can be g1. At this time, the human eye feels that the depth of the projection of pixel e1 of the first depth image on the image plane is D2, and the convergence function of the human eye will converge the sight of both eyes on pixel g1, and the focusing function of the human eye will also focus and adjust the focal length to D2. In this way, the convergence and focusing functions of the human eye are coordinated with each other, so that the sight of both eyes can converge on pixel g1.

[0270] In order to solve the problem of convergence adjustment conflict, some related display devices use a display including several sub-screens that can display two-dimensional images. Please refer to Figure 3 , Figure 3 In the figure, screen 1, screen 2 and screen 3 are sub-screens of the display. Each sub-screen can be moved to a different depth, for example, screen 1 is moved to a position D3 away from the human eye, screen 2 is moved to a position D2 away from the human eye, and screen 3 is moved to a position D1 away from the human eye. At the same time, the center of each sub-screen is aligned, and finally a three-dimensional image can be integrated. In this way, when the human eye watches the three-dimensional image displayed on the display, when watching a distant object in the three-dimensional image, the convergence function will converge the sight of both eyes to the distant screen (for example, screen 3), and the focus function will also focus on the object at the same distance (for example, D1). When the human eye watches a nearby object in the three-dimensional image, the convergence function will converge the sight of both eyes to the nearby screen (for example, screen 1), and the focus function will also focus on the object at the same distance (for example, D3), which can effectively solve the problem of convergence conflict.

[0271] The problem with the display device using a display is that the display has multiple sub-screens, which may cause the size of the display to be too large due to the large size of the multiple sub-screens, making the display device too heavy. Wearing a display device that is too heavy may cause discomfort to the user and affect the user experience.

[0272] In addition, the three-dimensional picture displayed by the relevant display device has a lot of depth information. For example, the content displayed in the three-dimensional picture is "athletes playing football". When the athletes and the football are stationary, the athletes have multiple depth information and the football has multiple depth information. When the athletes and the football are both moving, the depth information of the athletes and the football will also change continuously, and multiple depth information will be generated. In order to be able to display a lot of depth information, the display device needs to configure the number of sub-screens according to the number of a lot of depth information. However, considering the cost and size of the display device, the display device will not configure a lot of sub-screens to meet the requirement of displaying a lot of depth information. In this way, the display device can only display the depth information within a limited range, and cannot fully display the depth information of the three-dimensional picture, which reduces the depth sense of the three-dimensional picture, thereby reducing the user experience. The depth sense is the sense of space, that is, the human eye can feel near and far on the three-dimensional picture, rather than feeling that it is all compressed in a plane. For example: the content displayed in the three-dimensional picture is "athletes playing football". Originally, the depth information in the picture ranges from 1 meter to 10 meters, but the display device can only display the depth information within 3 to 5 meters, and cannot display all the depth information in the three-dimensional picture, which reduces the depth sense of the three-dimensional picture.

[0273] In another case, the display device is configured with a limited number of sub-screens, and the position of the sub-screens is moved in real time to meet the requirement of displaying a large amount of depth information. However, it is difficult to move the sub-screens in real time. For example, please refer to Figure 3 , the display device needs to move screen 1 in real time according to the depth information D1 of the object. When the depth information of the object changes from D1 to D2, the display device needs to move screen 1 to the position of screen 2 in a short time. When the depth information of the object changes from D2 to D3, the display device needs to move screen 2 to the position of screen 3 in a short time. It is possible that when screen 1 has not yet moved to the position of screen 2, screen 2 needs to be moved to the position of screen 3. The real-time performance cannot be guaranteed. In addition, the display device may not be able to accurately move the sub-screen to the precise position. For example, refer to Figure 3 , the display device may not be able to accurately move screen 1 to the position of screen 2 in a short time. Since the display device may not be able to accurately move the sub-screen in real time, the depth information of the three-dimensional picture displayed by the display device may be inaccurate, reducing the display effect of the display device.

[0274] In the embodiment of the present application, each display has one screen, and the size of the display will not be too large due to the configuration of multiple sub-screens in the display, which can reduce the overall weight of the display device and improve the user experience.

[0275] Moreover, the embodiment of the present application adjusts the brightness displayed by each pixel on image plane 1 and image plane 2 by adjusting the pixel value of each pixel on the first depth image and the second depth image, and by fusing the brightness, the human eye can feel the depth of each pixel. Since the value range of the pixel value is large, for example, the value range is 0 to 255, the adjustment range of the pixel value of each pixel on the first depth image and the second depth image is large, so that the depth of the pixels on the first depth image or the second depth image varies within a larger range. Compared with the related display device that can only display depth information within a limited range, the embodiment of the present application displays a wider range of depth information, which can make the human eye feel a wider range of depth, and can enhance the sense of depth of the displayed picture.

[0276] Furthermore, the embodiments of the present application can make the human eye feel the depth of the pixel by adjusting the pixel value. Compared with the relevant display device that moves the position of the sub-screen in real time to meet the requirement of displaying depth information, the present application does not need to consider the position of the sub-screen that is moved in real time. This avoids the problem of inaccurate depth information of the three-dimensional picture displayed by the display device due to the difficulty of moving the sub-screen in real time and the inability to accurately move the sub-screen to the precise position. By adjusting the pixel value, the human eye can sense the depth information of the three-dimensional picture in a timely and accurate manner, thereby improving the user experience.

[0277] The above embodiments are combined with Figure 18 to Figure 19 Steps A to C introduce the implementation process of the display device to solve the convergence adjustment conflict. The display device provided by the embodiment of the present application can not only solve the problem of convergence adjustment conflict, but also make the image displayed by the display device have higher clarity and larger field of view.

[0278] It should be noted that the clarity of the image displayed by the display device seen by the human eye is related to the field of view angle and the resolution of the display. The larger the ratio of the display resolution to the field of view angle, the higher the clarity of the screen image seen by the human eye. The smaller the ratio of the display resolution to the field of view angle, the lower the clarity of the screen image seen by the human eye.

[0279] For ease of description, the embodiment of the present application refers to the ratio of the resolution of the display to the field of view as pixel density, and the unit of pixel density is pixel / degree.

[0280] In the embodiment of the present application, in order to make use of Figures 6 to 17 The image displayed by the optical display module shown has high clarity and a large field of view, which needs to meet the following conditions:

[0281] Condition 3: the screen resolution of the LCD display 201 used to provide image plane 1 is less than or equal to the screen resolution of the OLED display 208 used to provide image plane 2, and the field of view of image plane 2 is less than the field of view of image plane 1.

[0282] According to the above condition 3, the pixel density (screen resolution / field of view) provided by the LCD display 201 can be made smaller than the pixel density provided by the OLED display 208. Since image plane 1 can be formed by the LCD display 201 and image plane 1 can be formed by the OLED display 208, the clarity of the image displayed on image plane 2 is higher than the clarity of the image displayed on image plane 1, but the field of view of image plane 1 is larger than that of image plane 2, so that the user can have a larger field of view and see a clearer image through image plane 2.

[0283] For example, according to condition 3, the effect diagram seen by human eyes through the display device can refer to Fig.12 ,Depend on Fig.12It can be seen that the field of view angle a11ob11 of image plane 1 is greater than the field of view angle a21ob21 of image plane 2, and the resolution of image plane 2 is greater than the resolution of image plane 1. Therefore, the pixel density corresponding to image plane 2 is greater than the pixel density corresponding to image plane 1. When the human eye views the image on image plane 2, the image clarity is higher than that on image plane 1. In other embodiments, the resolution of image plane 2 may also be equal to the resolution of image plane 1, because the field of view angle a11ob11 of image plane 1 is greater than the field of view angle a21ob21 of image plane 2, so that the image clarity on image plane 2 can also be higher than that on image plane 1. In other embodiments, the position of image plane 2 may not coincide with the position of image plane 1, as long as the field of view angle of image plane 2 is smaller than that of image plane 1.

[0284] It is easy to understand that by using an LCD display and an OLED display with the same resolution in the optical display module 20, the requirement that the screen resolution of the LCD display 201 is equal to the screen resolution of the OLED display 208 in condition 3 can be met. By using an LCD display with a lower resolution and an OLED display with a higher resolution in the optical display module 20, the requirement that the screen resolution of the LCD display 201 is less than the screen resolution of the OLED display 208 in condition 3 can be met.

[0285] It can be seen from the above embodiments that the field of view of the embodiments of the present application mainly depends on the screen size of the display. Therefore, by making the size of the LCD display larger than the size of the OLED display in the optical display module 20, the field of view of the image plane 2 can be made smaller than the field of view of the image plane 1.

[0286] In the embodiment of the present application, after the optical display module 20 satisfies the above-mentioned condition 3, the following implementation method can be used to enable the human eye to see a clear image at any position on the image plane 1 by moving the position of the image plane 2 within the field of view angle range of the image plane 1 (larger field of view angle).

[0287] Step 1: The detection module detects the user's gaze direction and generates gaze direction information.

[0288] It should be understood that in order to detect the user's gaze direction, Figure 4 The display device 100 shown may further include a detection module 40. Fig. 20 is a schematic structural diagram of another display device 100 provided in an embodiment of the present application.

[0289] Fig. 20The detection module 40 is used to detect the user's gaze direction. The detection module 40 may include one of the following devices: an eye tracker, an infrared tracker, etc. These devices can track the gaze direction of the human eye. The embodiment of the present application does not limit the specific device used by the detection module.

[0290] In the embodiment of the present application, the display device uses the optical display module 20 to form a field of view angle of image plane 1 that is greater than the field of view angle of image plane 2. Therefore, the user can look at any position on the image plane (image plane 1) with a larger field of view angle.

[0291] Step 2: The processor receives the user's gaze direction information, determines the position information of the user's gaze area on the image plane 1 according to the user's gaze direction information, and sends an adjustment instruction to the adjustment module according to the position information of the user's gaze area on the image plane 1.

[0292] It should be understood that the position information of the gaze area can be represented by the coordinate information of the gaze area.

[0293] Step 3: The adjustment module adjusts the position of the OLED display according to the adjustment instruction so that the image plane 2 moves to the gaze area where the user gazes at the image plane 1.

[0294] Exemplarily, when the human eye looks at the center of image plane 1, the adjustment module can move image plane 2 to the center of image plane 1; when the human eye looks at the edge of image plane 1, the adjustment module can move image plane 2 to the edge of image plane 1.

[0295] It should be understood that the field of view angle is an important parameter for judging the sense of immersion. The larger the field of view angle, the stronger the sense of immersion. In the embodiment of the present application, image plane 1 can provide a larger field of view angle, thereby improving the user's sense of immersion and enhancing the user experience. Since image plane 2 can display clearer images, the user's gaze area on image plane 1 is determined by detecting the user's gaze direction. By moving the position of image plane 2 to the user's gaze area, the user can see a clear image.

[0296] In summary, the display device provided in the embodiments of the present application can enhance the user's sense of immersion while allowing the user to see clearer images, thereby improving the user experience.

[0297] Some related display devices can also provide a larger field of view and display a clearer image, but they use a focus plus background display to display the image. The focus display displays a clearer image, and the background display can provide a larger field of view. For example, please refer to Figure 2 , Figure 2 In the figure, E1 is the picture displayed by the background display, and E2 is the picture displayed by the focus display.

[0298] However, the position of the focus display within the focus plus background display is fixed (e.g. Figure 2 The middle focus display is at the center of the focus plus background display), but when the human eye views the image displayed on the display, the gaze direction of the eye can move. The eye can gaze at the center of the image or at the edge of the image. In this way, the position of the clear image displayed by the display cannot change with the change of the gaze direction of the human eye, affecting the user experience.

[0299] In the embodiment of the present application, the display device can detect the user's gaze direction, determine the user's gaze area on image plane 1, and move the position of image plane 2 to the gaze area, so that the human eye can view a clearer image through image plane 2. In other words, the position of the clear image displayed in the embodiment of the present application can change with the change of the gaze direction of the human eye, which can improve the user experience.

[0300] The following embodiments summarize the display device and display method involved in the above embodiments.

[0301] A display device includes two optical display modules, which are used to display a target image visually viewed by a user. The optical display modules include: at least one first display, which is used to display a first image; at least one second display, which is used to display a second image; an optical combiner, which is used to reflect light emitted from the at least one first display multiple times to form a projection of at least one first image in an extension direction of the user's vision, and to reflect light emitted from the at least one second display multiple times to form a projection of at least one second image in an extension direction of the user's vision, wherein the light emitted from the first display is reflected multiple times to form a projection of the first image, and the light emitted from the second display is reflected multiple times to form a projection of the second image; the optical combiner is also used to combine the projection of the at least one first image and the projection of the at least one second image to create a target image visually viewed by the user.

[0302] The display device of the embodiment of the present application may be a head-mounted near-eye display device. The head-mounted near-eye display device may be an AR head-mounted near-eye display device, a VR head-mounted near-eye display device, an MR head-mounted near-eye display device, etc. The embodiment of the present application does not specifically limit the specific form of the above-mentioned head-mounted near-eye display device. Among them, when the head-mounted near-eye display device is an AR head-mounted near-eye display device, it may be an AR helmet, AR glasses, or an AR portable theater, etc. When the head-mounted near-eye display device is a VR head-mounted near-eye display device, it may be a VR helmet, VR glasses, or a VR portable theater, etc. When the head-mounted near-eye display device is an MR head-mounted near-eye display device, it may be an MR helmet, MR glasses, or an MR portable theater, etc.

[0303] It should be understood that the head-mounted near-eye display device includes two optical display modules, for example, Figure 5 The optical display module 20 included in the first supporting structure 412 and the second supporting structure 413. When a user uses the head mounted display device, the user can see the virtual images presented by the device through the two optical display modules through both eyes.

[0304] It should also be understood that each optical display module includes a first display, a second display, and an optical combiner.

[0305] The first display may be Figure 6 , Fig. 9 , Fig.10 , Fig.13 , Fig.14 , Fig.15 , Fig.16 or Fig.17 The LCD display shown, the second display can be Figure 6 , Fig. 9 , Fig.10 , Fig.13 , Fig.14 , Fig.15 , Fig.16 or Fig.17 The OLED display shown, of course, the first display can also be an OLED display, an AMOLED display, a Miniled display, a MicroLed display, a Micro-oLed display, a FLED display, a QLED display, etc., which is not limited to the embodiments of the present application. The second display can also be an LCD display, an AMOLED display, a Miniled display, a MicroLed display, a Micro-oLed display, a FLED display, a QLED display, etc., which is not limited to the embodiments of the present application.

[0306] At least one first display means that the number of first displays can be one or more, and at least one second display means that the number of second displays can be one or more, for example, Figure 6 , Fig. 9 , Fig.10 , Fig.13 , Fig.14 and Fig.15 The number of the first display and the second display shown is one, Fig.16 The number of second displays shown is two, Fig.17 The number of first displays shown is two.

[0307] It can also be understood that the optical combiner may include optical elements other than the first display and the second display in the optical display module in the above embodiment. For example, the optical combiner may include Figure 6 , Fig. 9 , Fig.10 , Fig.13 , Fig.14 , Fig.15 , Fig.16 or Fig.17 Optical elements other than the LCD display and the OLED display in the optical display module are shown.

[0308] In the embodiment of the present application, the optical combiner can perform multiple reflections on the light emitted from the first display to form a projection of the first image in the extension direction of the user's vision, and can perform multiple reflections on the light emitted from the second display to form a projection of the second image in the extension direction of the user's vision. For example, the multiple reflections can refer to Figure 6 , Fig. 9 , Fig.10 , Fig.13 , Fig.14 and Fig.16 The light propagation path shown, the extension direction of the user's vision can be referred to Figure 8 and Fig.12 The direction of the arrow in the figure can be referred to as Figure 8 and Fig.12 The projection of the second image can be referred to as image plane 1 Figure 8 and Fig.12 Image plane 2 in.

[0309] In the embodiment of the present application, the light display may also combine the projection of at least one first image and the projection of at least one second image to create a target image visually perceived by the user. For example, Figure 8 and Fig.12 The combination of the image plane 1 and the image plane 2 can enable the optical combiner to create a target image for the user's vision, wherein the user is looking at Figure 8 When the target image is shown, image plane 1 and image plane 2 overlap, and the user looks at Fig.12 When the target image is shown, the size of image plane 2 is smaller than that of image plane 1.

[0310] It should be understood that some related display devices use a display that displays a three-dimensional image using a focus plus background display. The three-dimensional image presented by this display often has discontinuities at the joints of the focus display and the background display, and the display effect is not ideal.

[0311] In the embodiment of the present application, the projection of the first image formed by the light emitted by the first display in the extension direction of the user's vision and the projection of the second image formed by the light emitted by the second display in the extension direction of the user's vision are combined to create a three-dimensional picture. Compared with the method of combining two images themselves to display a three-dimensional picture in related display devices, the embodiment of the present application does not need to create a three-dimensional picture by combining multiple images displayed by multiple display screens themselves, but instead creates a three-dimensional picture by combining the projections of multiple images, thereby avoiding the discontinuity of the displayed three-dimensional picture at the joints of multiple display screens, improving the display effect and improving the user experience.

[0312] Furthermore, the projection of the first image in the embodiment of the present application is formed by multiple reflections of light emitted by the first display, and the projection of the second image is formed by multiple reflections of light emitted by the second display. After multiple reflections, the incident direction of the light entering the user's pupil can be changed, thereby enlarging the size of the projection of the first image and the projection of the second image, allowing the user to have a larger field of view when looking at the target image, thereby enhancing the user's sense of immersion in using the display device and improving the user experience.

[0313] In some embodiments, a structure of an optical combiner is provided, the optical combiner includes a first partially reflective film and a first reflective polarizing film; wherein the light propagation path of the light emitted by the first display incident on the user's pupil may be (for ease of description, the light propagation path may be referred to as the first light path): the light emitted from the first display is transmitted for the first time after reaching the first partially reflective film, the light transmitted for the first time is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partially reflective film, and the light reflected for the second time is transmitted for the second time after reaching the first reflective polarizing film, so as to form a projection of a first image in the extension direction of the user's vision; the propagation path of the light emitted by the second display incident on the user's pupil may be (for ease of description, the light propagation path may be referred to as the second light path): the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partially reflective film, and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film, so as to form a projection of a second image in the extension direction of the user's vision.

[0314] It should be understood that the first partial reflective film can transmit part of the light and reflect part of the light. For example, the partial reflective film can transmit 3 / 4 of the light and reflect 1 / 4 of the light. Figure 6The semi-transparent and semi-reflective mirror A shown can transmit 1 / 2 of the light and reflect 1 / 2 of the light. The first part of the reflective film can also be a semi-transparent and semi-reflective film. One side of the semi-transparent and semi-reflective film is in a semi-transparent state and the other side is in a reflective state. When light is irradiated on the side in the semi-transparent state, the light can be completely transmitted. When light is irradiated on the side in the reflective state, the light can be completely reflected.

[0315] The first reflective polarizing film can selectively reflect or transmit light. For example, the first reflective polarizing film can be Figure 6 Reflective polarizing film A in.

[0316] In the embodiment of the present application, the first optical path may be: Figure 6 The light emitted from the LCD display reaches the semi-transparent and semi-reflective mirror A and is transmitted for the first time. The light transmitted for the first time reaches the reflective polarizing film A and is reflected for the first time. The light reflected for the first time reaches the semi-transparent and semi-reflective mirror A and is reflected for the second time. The light reflected for the second time reaches the reflective polarizing film A and is transmitted for the second time. The light transmitted for the second time enters the human eye, allowing the human eye to see the projection of the first image.

[0317] The second optical path can be: Please refer to Figure 6 The light emitted from the OLED display reaches the reflective polarizing film A and is reflected for the first time. The light reflected for the first time reaches the semi-transparent and semi-reflective mirror A and is reflected for the second time. The light reflected for the second time reaches the reflective polarizing film A and is transmitted for the first time. The light transmitted for the first time enters the human eye, allowing the human eye to see the projection of the first image.

[0318] In the embodiment of the present application, since the first partial reflective film and the first reflective polarizing film can transmit and reflect light, the light emitted from the first display and the second display can be effectively reflected multiple times by the first partial reflective film and the first reflective polarizing film;

[0319] Furthermore, the display device provided in the embodiment of the present application can simultaneously make the light emitted by the first display and the second display undergo multiple reflections through the first partial reflective film and the first reflective polarizing film. The light emitted by the first display and the second display can be reflected multiple times without setting up more optical elements, which can reduce the number of optical elements in the display device, thereby reducing the weight of the display device and improving the user experience.

[0320] In some embodiments, the optical combiner further comprises a first quarter phase glass plate, the quarter phase glass plate functions to change the polarization state of the light;

[0321] Wherein, in the case where the optical combiner includes a first quarter phase glass, the first optical path may be: the light from the first display that is transmitted for the first time after passing through the first partial reflective film is changed in polarization state for the first time after arriving at the first quarter phase glass, the light whose polarization state is changed for the first time is reflected for the first time after arriving at the first reflective polarizing film, the light whose polarization state is reflected for the first time is changed in polarization state for the second time after arriving at the first quarter phase glass, the light whose polarization state is changed for the second time is reflected for the second time after arriving at the first partial reflective film, the light whose polarization state is changed for the second time is changed in polarization state for the third time after arriving at the first reflective polarizing film, and the light whose polarization state is changed for the third time is transmitted for the second time;

[0322] The second optical path can be: the polarization state of the light emitted from the second display is changed for the first time after reaching the first quarter phase glass plate, the light whose polarization state is changed for the first time is reflected for the first time after reaching the first quarter phase glass plate, the polarization state of the light whose polarization state is changed for the second time is changed after reaching the first partial reflective film and is reflected for the second time, the polarization state of the light whose polarization state is changed for the second time is changed for the third time after reaching the first quarter phase glass plate, and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film.

[0323] It should be understood that the first quarter wave phase plate can refer to Figure 6 The 1 / 4 phase wave plate B shown in the figure, the function of the first quarter phase plate is to change the polarization state of light. Specifically, the 1 / 4 phase wave plate B can change linear polarized light into circular polarized light, and change circular polarized light into linear polarized light.

[0324] The first reflective polarizing film can refer to Figure 6 The reflective polarizing film A shown in the figure can reflect polarized light in one direction and transmit polarized light in another direction. Specifically, Figure 6 The reflective polarizing film A in the embodiment can transmit vertical linear polarized light, namely P linear polarized light, and reflect horizontal linear polarized light, namely S linear polarized light.

[0325] The first part of the reflective film can be referred to Figure 6 The semi-transparent and semi-reflective mirror A shown in the figure can transmit part of the light and reflect part of the light. Specifically, Figure 6 The semi-transparent and semi-reflective mirror A in the image can transmit half of the circularly polarized light and reflect half of the circularly polarized light. When reflecting the circularly polarized light, it can change the direction of the circularly polarized light, for example, changing the left-handed circularly polarized light LCP into the right-handed circularly polarized light RCP, and changing the right-handed circularly polarized light RCP into the left-handed circularly polarized light.

[0326] The embodiment of the present application can make the light undergo multiple reflections based on the characteristics of the above optical elements. For example, please refer to Figure 6 , the first optical path can be: the LCD display emits RCP (the S linear polarized light of the LCD display is converted into right circular polarized light RCP after passing through the 1 / 4 phase glass A), the RCP is transmitted for the first time after passing through the semi-transparent and semi-reflective mirror A204, and half of the RCP is transmitted, the RCP is changed in polarization state for the first time after passing through the 1 / 4 phase glass B, and becomes P linear polarized light, the P linear polarized light is reflected for the first time after reaching the reflective polarizing film A (because the reflective polarizing film A can reflect P linear polarized light and transmit S linear polarized light, the reflective polarizing film A reflects P linear polarized light), the P linear polarized light is changed in polarization state for the second time after passing through the 1 / 4 phase glass B, and becomes right circular polarized light RCP, the RCP is reflected for the second time by the semi-transparent and semi-reflective mirror A (because the circular polarized light encounters reflection, it will change the rotation direction, so RCP becomes left circular polarized light LCP), the LCP is changed in polarization state for the third time after passing through the 1 / 4 phase glass B, and becomes S linear polarized light, the S linear polarized light is transmitted for the second time after reaching the reflective polarizing film A, and enters the human eye.

[0327] The second optical path can be: Figure 6 The OLED display emits right-handed circularly polarized light RCP. After RCP reaches the 1 / 4 phase glass B, its polarization state is changed for the first time and becomes P linear polarized light. After the P linear polarized light reaches the reflective polarizing film A, it is reflected for the first time. After the P linear polarized light reaches the 1 / 4 phase glass B, its polarization state is changed for the second time and becomes right-handed circularly polarized light RCP. After RCP reaches the semi-transparent and semi-reflective mirror A, it is reflected for the second time and becomes left-handed circularly polarized light LCP. After LCP passes through the 1 / 4 phase glass B, its polarization state is changed for the third time and becomes S linear polarized light. After the S linear polarized light reaches the reflective polarizing film A, it is transmitted for the first time and enters the human eye.

[0328] The embodiment of the present application can change the polarization state of the light through the first quarter phase glass. By continuously changing the polarization state of the light, the light is transmitted or reflected when passing through the first reflective polarizing film and the first partial reflective film, so that the light emitted by the first display and the second display can be better reflected multiple times.

[0329] In some embodiments, another structure of an optical combiner is provided, the optical combiner includes a first optical component and a second optical component, the first optical component includes a second partially reflective film and a second reflective polarizing film, the second optical component includes a first partially reflective film and a first reflective polarizing film;

[0330] Wherein, in the case where the optical combiner includes the first optical component and the second optical component, the first optical path may be: the light emitted from the first display is transmitted for the first time after reaching the second partial reflective film, the light transmitted for the first time is reflected for the first time after reaching the second reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the second partial reflective film, and the light reflected for the second time is transmitted after passing through the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film in sequence, so as to form a projection of the first image in the extension direction of the user's vision;

[0331] In the case where the optical combiner includes a second optical component, the second optical path can be: the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is reflected for the second time after reaching the first partially reflective film, and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film, so as to form a projection of the second image in the extension direction of the user's vision.

[0332] It should be understood that the second reflective polarizing film included in the first optical component may be Fig. 9 and Fig.10 The reflective polarizing film B in the second part of the reflective film can be Fig. 9 and Fig.10 As for the semi-transparent and semi-reflective mirror B in the reflective polarizing film, the definitions and functions of the semi-transparent and semi-reflective mirror can be referred to the above embodiments and will not be repeated here.

[0333] In the embodiment of the present application, the first optical path can be: Fig. 9 and Fig.10 The light emitted from the LCD display reaches the semi-transparent and semi-reflective mirror B and is transmitted for the first time. The light transmitted for the first time reaches the reflective polarizing film B and is reflected for the first time. The light reflected for the first time reaches the semi-transparent and semi-reflective mirror B and is reflected for the second time. The light reflected for the second time passes through the reflective polarizing film B, the semi-transparent and semi-reflective mirror A and the reflective polarizing film A in sequence and is transmitted. The transmitted light enters the human eye, allowing the human eye to see the projection of the first image.

[0334] The second optical path can be: Fig. 9 The light emitted from the OLED display reaches the reflective polarizing film A and is reflected for the first time. The light reflected for the first time reaches the semi-transparent and semi-reflective mirror A and is reflected for the second time. The light reflected for the second time reaches the reflective polarizing film A and is transmitted for the first time. The light transmitted for the first time enters the human eye, allowing the human eye to see the projection of the second image.

[0335] In the embodiment of the present application, since the second partial reflective film, the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film can all transmit and reflect light, the light emitted by the second display can be effectively reflected multiple times by the second partial reflective film and the second reflective polarizing film, and the light reflected multiple times can be effectively transmitted and incident on the user's pupil by the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film, so as to form a projection of the first image in the extension direction of the user's vision;

[0336] Since the first partial reflective film and the first reflective polarizing film can transmit and reflect light, the light emitted by the second display can be effectively reflected multiple times by the first partial reflective film and the first reflective polarizing film, and the light reflected multiple times can be effectively transmitted by the first reflective polarizing film and then incident on the user's pupil, so as to form a projection of the second image in the extension direction of the user's vision;

[0337] Furthermore, in the embodiment of the present application, when the light emitted by the first display forms a projection of the first image through the first optical component, it is necessary to use the first partial reflective film and the first reflective polarizing film in the second optical component to transmit the light after multiple reflections by the first optical component. In this way, the optical combiner can more conveniently combine the projection of the first image and the projection of the second image to create a target image visually viewed by the user.

[0338] In some embodiments, the first optical component further includes a second quarter phase glass and a third quarter phase glass, and the second optical component further includes a first quarter phase glass, wherein:

[0339] In the case where the first optical component includes the second quarter phase glass and the third quarter phase glass, the first optical path may be: the light from the first display that is transmitted for the first time after passing through the second partial reflective film changes its polarization state for the first time after reaching the second quarter phase glass, the light whose polarization state is changed for the first time reaches the second reflective polarizing film and is reflected for the first time, the light whose polarization state is reflected for the first time changes its polarization state for the second time after reaching the second quarter phase glass, the light whose polarization state is changed for the second time reaches the second partial reflective film and is reflected for the second time, the light whose polarization state is reflected for the second time changes its polarization state for the third time after reaching the second quarter phase glass, and the light whose polarization state is changed for the third time passes through the second reflective polarizing film, the third quarter phase glass, the first partial reflective film, the first quarter phase glass and the first reflective polarizing film in sequence and is transmitted;

[0340] In the case where the second optical component includes a first quarter wave plate, the second optical path can be: the polarization state of the light emitted from the second display is changed for the first time after reaching the first quarter phase glass plate, the light whose polarization state is changed for the first time is reflected for the first time after reaching the first quarter phase glass plate, the polarization state of the light whose polarization state is changed for the second time is changed for the second time after reaching the first partial reflective film, the polarization state of the light whose polarization state is changed for the second time is changed for the third time after reaching the first quarter phase glass plate, and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film.

[0341] It should be understood that the second quarter phase glass included in the first optical component may be Fig. 9 and Fig.10 The 1 / 4 phase glass D in the first optical component, the third quarter phase glass may be a 1 / 4 phase glass E, and the first quarter phase glass included in the second optical component may be Fig. 9 or Fig.10 The 1 / 4 phase glass B in the figure, the definition and function of the 1 / 4 phase glass can be referred to the above embodiment, which will not be repeated here.

[0342] In the embodiment of the present application, the first optical path can be: Fig. 9 and Fig.10 , the LCD display emits RCP (the S linear polarized light of the LCD display is converted into right-handed circularly polarized light RCP after passing through the 1 / 4 phase glass A), the RCP is transmitted for the first time after passing through the semi-transparent and semi-reflective mirror B, and half of the RCP is transmitted, the RCP is changed in polarization state for the first time after passing through the 1 / 4 phase glass D, and becomes P linear polarized light, the P linear polarized light reaches the reflective polarizing film B and is reflected for the first time (because the reflective polarizing film B can reflect P linear polarized light and transmit S linear polarized light, so the reflective polarizing film B reflects P linear polarized light), the P linear polarized light passes through the 1 / 4 phase glass D and its polarization state is changed for the second time, and becomes right-handed circularly polarized light RCP, RCP is reflected for the second time by the semi-transparent and semi-reflective mirror B (since circularly polarized light will change its rotation direction when encountering reflection, RCP becomes left-handed circularly polarized light LCP), LCP passes through the 1 / 4 phase glass D and its polarization state is changed for the third time, becoming S linear polarized light, the S linear polarized light reaches the reflective polarizing film B and is transmitted for the second time, the S linear polarized light passes through the 1 / 4 phase glass E and its polarization state is changed for the fourth time, becoming LCP, LCP passes through the semi-transparent and semi-reflective mirror A and is transmitted for the third time, the LCP passes through the 1 / 4 phase glass B and its polarization state is changed for the fifth time, becoming S linear polarized light, the S linear polarized light reaches the reflective polarizing film A and is transmitted for the fourth time, entering the human eye.

[0343] In the case where the second optical component further includes a first quarter phase glass, the second optical path in the embodiment of the present application can refer to the above embodiment. Figure 6 The second optical path shown will not be described in detail here.

[0344] In the embodiment of the present application, the first quarter phase glass plate, the second quarter phase wave plate and the third quarter phase wave plate function to change the polarization state of light, the first reflective polarizing film and the second reflective polarizing film function to reflect polarized light in one direction and transmit polarized light in another direction, and the first partial reflective film and the second partial reflective film function to transmit a part of light and reflect a part of light. Based on the functions of the above optical elements, the embodiment of the present application can change the polarization state of light emitted by the first display through the second quarter phase wave plate, and by continuously changing the polarization state of light, the light is transmitted or reflected when passing through the second reflective polarizing film and the second partial reflective film, so that the light emitted by the first display can be better reflected multiple times.

[0345] In addition, the embodiment of the present application can change the polarization state of the light emitted by the first display through the third quarter phase wave plate and the first quarter phase wave plate, and by continuously changing the polarization state of the light, the light that has been reflected multiple times can be better transmitted when passing through the second reflective polarizing film, the first partial reflective film and the first reflective polarizing film;

[0346] Based on the function of the above optical elements, the embodiment of the present application can change the polarization state of the light emitted by the second display through the first quarter-wave plate, and by continuously changing the polarization state of the light, the light is transmitted or reflected when passing through the first reflective polarizing film and the first partial reflective film, so that the light emitted by the second display can be better reflected multiple times;

[0347] Furthermore, the embodiment of the present application can change the polarization state of the light emitted by the second display through the first quarter-wave plate, so that the light that has been reflected multiple times can be better transmitted when passing through the first reflective polarizing film.

[0348] In some embodiments, the first optical component also includes a first lens, and the first lens can refract the light emitted by the first display. Specifically, the light from the first display that is transmitted for the first time after passing through the second partially reflective film is refracted for the first time after reaching the first lens, the light that is refracted for the first time is reflected for the first time after reaching the second reflective polarizing film, the light that is reflected for the first time is refracted for the second time after reaching the first lens, the light that is refracted for the second time is reflected for the second time after reaching the second partially reflective film, the light that is reflected for the second time is refracted for the third time after reaching the first lens, and the light that is refracted for the third time passes through the second reflective polarizing film, the first partially reflective film and the first reflective polarizing film in sequence and is transmitted.

[0349] It should be understood that the first lens may be Fig. 9 and Fig.10The convex lens D shown in the figure can refract the light emitted by the LCD display, for example, Fig. 9 and Fig.10 In the figure, the light RCP from the LCD display is transmitted for the first time after passing through the semi-transparent and semi-reflective mirror B and then refracted for the first time after reaching the convex lens D, the light RCP is reflected for the first time after passing through the reflective polarizing film B and then refracted for the second time after reaching the convex lens D, and the light LCP is reflected for the second time after passing through the semi-transparent and semi-reflective mirror B and then refracted for the third time after reaching the convex lens D.

[0350] In the embodiment of the present application, the first lens can refract the light emitted from the first display multiple times. The first refraction of the first lens is to refract the light from the first display that is transmitted for the first time after passing through the second partial reflective film. The second refraction of the first lens is to refract the light that is reflected for the first time. The third refraction of the first lens is to refract the light that is reflected for the second time. By refracting the light emitted from the first display multiple times, the size of the projection of the first image can be further enlarged, so that the user can have a larger field of view when looking at the projection of the first image, thereby enhancing the user's sense of immersion in looking at the projection of the first image.

[0351] In some embodiments, another propagation path for light emitted from the second display to enter the user's pupil is provided, and the path may be: the light emitted from the second display is reflected for the first time after reaching the first reflective polarizing film, the light reflected for the first time is changed in polarization state for the first time after reaching the first quarter-phase glass, the light with the polarization state changed for the first time is reflected for the second time after reaching the first partial reflective film, the light reflected for the second time is changed in polarization state for the second time after reaching the first quarter-phase glass, and the light with the polarization state changed for the second time is transmitted for the first time after reaching the first reflective polarizing film.

[0352] The light propagation path in the embodiment of the present application can be referred to Fig.10 The light emitted from the OLED display reaches the reflective polarizing film A and is reflected for the first time. The light reflected for the first time changes its polarization state for the first time after reaching the 1 / 4 phase glass B. The light whose polarization state is changed for the first time reaches the semi-transparent and semi-reflective mirror A and is reflected for the second time. The light reflected for the second time changes its polarization state for the second time after reaching the 1 / 4 phase glass B. The light whose polarization state is changed for the second time reaches the reflective polarizing film A and is transmitted for the first time.

[0353] In some embodiments, the second display is disposed on one side of the first reflective polarizing film, and an angle between a length direction of the first reflective polarizing film and a length direction of the second display is an acute angle.

[0354] For example, Figure 6 , Fig. 9 , Fig.10 and Fig.14The OLED displays shown in the figure are all arranged on the left side of the reflective polarizing film A, and the angle between the length direction of the OLED display and the length direction of the reflective polarizing film A is an acute angle. In the embodiment of the present application, the angle between the length direction of the OLED display and the length direction of the reflective polarizing film A is greater than 0 degree and less than 90 degrees. For example, the angle is 30 degrees, 45 degrees, 60 degrees, etc.

[0355] Of course, the OLED display may also be disposed on the right side of the reflective polarizing film A, which is not limited in the embodiment of the present application.

[0356] In the embodiment of the present application, since the angle between the length direction of the first reflective polarizing film and the length direction of the second display is an acute angle, the light emitted by the second display can be better projected onto the first reflective polarizing film when the angle between the length direction of the first reflective polarizing film and the length direction of the second display is other angles (such as an obtuse angle or a right angle).

[0357] In some embodiments, the length direction of the first display and the length direction of the first reflective polarizing film have a preset angle, and the first reflective polarizing film is disposed toward the first display (for example, Fig.10 The length direction of the LCD display is not parallel to the length direction of the reflective polarizing film A, and has a preset angle, and the reflective polarizing film A faces the LCD display).

[0358] For example, Fig.10 The length direction of the LCD display shown in the figure is non-parallel to the length direction of the reflective polarizing film A, and has a preset angle. The embodiment of the present application does not limit the size of the preset angle. In order for the light emitted by the LCD display to be projected onto the reflective polarizing film A, the reflective polarizing film A needs to face the LCD display.

[0359] It should be understood that the length direction of the first display and the length direction of the first reflective polarizing film have a preset angle, which can increase the movement range of the second display in the length direction of the second display. For example, please refer to Fig.11 , Fig.11 In (a), the length direction of the LCD display is parallel to the length direction of the reflective polarizing film A, and the movable range of the OLED display is H1. Fig.11 In (b), the length direction of the LCD display and the length direction of the reflective polarizing film A have a preset angle, and the movable range of the OLED display is H2, and the value of H2 is greater than the value of H1, so, Fig.11 (b) The movable range of the OLED display is greater than Fig.11 (a) The movable range of the OLED display.

[0360] In the embodiment of the present application, since the length direction of the first display and the length direction of the first reflective polarizing film have a preset angle, the movement range of the second display in the length direction of the second display can be increased relative to the length direction of the first display being parallel to the length direction of the first reflective polarizing film.

[0361] In some embodiments, in order to make the clarity of the projection of the first image and the projection of the second image in the display device that the user is looking at the same, and to make the projection of the first image and the projection of the second image that the user is looking at overlap, thereby reducing the possibility of ghosting when the user looks at the target image created by combining the projection of the first image and the projection of the second image, the size of the first display can be equal to the size of the second display, the resolution of the first display can be equal to the resolution of the second display, and the center position of the projection of the first image, the center position of the projection of the second image, and the center position of the user's pupil can be on a connecting line.

[0362] The projection of the first image in the embodiment of the present application can refer to Figure 8 Image plane 1 is shown, the projection of the second image may refer to image plane 2 .

[0363] It should be understood that the size of the field of view depends on the size of the display on the one hand, and on the ability of the optical combiner to bend light on the other hand. Since the relevant parameters (such as focal length) of the optical elements (such as convex lenses and partially reflective films) in the optical combiner are fixed when constructing the optical combiner, in the embodiment of the present application, the size of the field of view depends on the size of the display. The larger the size of the display, the larger the field of view, and the smaller the size of the display, the smaller the field of view. The clarity of the image depends on the ratio of the display resolution to the field of view. The larger the ratio, the clearer the image, and the smaller the ratio, the blurrier the image. Therefore, in order to make the clarity of the projection of the first image and the projection of the second image the same, in the embodiment of the present application, the size of the first display can be made equal to the size of the second display, so that the first field of view angle of the projection of the first image formed by the first display when the user is looking at it can be made the same as the second field of view angle of the projection of the second image formed by the user being looking at it through the second display, and by making the resolution of the first display equal to the resolution of the second display, the ratio of the resolution of the first image to the first field of view angle and the ratio of the resolution of the second image to the first field of view angle can be made the same, thereby achieving the effect that the clarity of the projection of the first image and the projection of the second image are the same.

[0364] In the embodiment of the present application, when the ratio of the resolution of the first image to the first field of view angle and the ratio of the resolution of the second image to the first field of view angle are the same, by making the center position of the projection of the first image, the center position of the projection of the second image and the center position of the user's pupil on a connecting line, it can be ensured that the projection of the first image and the projection of the second image that the user is gazing at overlap. For the implementation method of making the center position of the projection of the first image, the center position of the projection of the second image and the center position of the user's pupil on a connecting line, reference can be made to the above embodiment and will not be repeated here.

[0365] In the embodiment of the present application, since the size of the first display is equal to the size of the second display, and the resolution of the first display is equal to the resolution of the second display, the ratio of the resolution of the first display to the field of view is equal to the ratio of the resolution of the second display to the field of view, and since the ratio of the display resolution to the field of view can determine the clarity of the picture in the display device that the user is looking at, the clarity of the projection of the first image and the projection of the second image in the display device that the user is looking at is the same;

[0366] Since the ratio of the resolution of the first display to the field of view angle is equal to the ratio of the resolution of the second display to the field of view angle, and the center position of the projection of the first image, the center position of the projection of the second image, and the center position of the user's pupil are on a connecting line, each pixel on the projection of the first image that the user is gazing at and each pixel on the projection of the second image coincide with each other, and thus the projection of the first image that the user is gazing at and the projection of the second image overlap;

[0367] Furthermore, since the projection of the first image and the projection of the second image that the user is gazing at overlap, the probability of ghosting when the user is gazing at a target image created by combining the projection of the first image and the projection of the second image is reduced, thereby improving the display effect of the target image.

[0368] In some embodiments, the display device further includes a processor, which can adjust the brightness value of each pixel in the first image and the second image so that the user can feel the depth information of each pixel when looking at the target image; specifically, the processor is used to:

[0369] Obtain a depth value of each pixel of any image in at least one first image and at least one second image; determine a pixel value of each pixel in each first image in the at least one first image and a pixel value of each pixel in each second image in the at least one second image according to the depth value of each pixel (for ease of description, the pixel value of each pixel in each first image in the at least one first image is referred to as a first-category pixel value, and the pixel value of each pixel in each second image in the at least one second image is referred to as a second-category pixel), so that each first image displays a brightness corresponding to a first-category pixel value based on the first-category pixel value and each second image displays a brightness corresponding to a second-category pixel value based on the second-category pixel value.

[0370] It should be understood that the first image and the second image are depth images, and the format of the depth image may be (RGB, D), that is, the depth image contains the depth value of each pixel.

[0371] It should also be understood that the smaller the depth value of a pixel on an image, the closer the pixel is to the user's pupil. The closer the pixel is to the user's pupil, the brighter the brightness of the pixel perceived by the user. The larger the depth value of a pixel on an image, the farther the pixel is from the user's pupil. The farther the pixel is from the user's pupil, the darker the brightness of the pixel perceived by the user. The brightness of the pixel is related to the size of the pixel value. The larger the pixel value, the brighter the pixel, and the smaller the pixel value, the darker the pixel. Therefore, the embodiment of the present application can make the user feel the depth change of the pixel by adjusting the size of the pixel value.

[0372] In the embodiment of the present application, the pixel value of each pixel in each first image in at least one first image and the pixel value of each pixel in each second image in at least one second image can be determined according to the depth value of each pixel, so that the user can feel the depth change of the pixel. For example, the range of the depth value of each pixel is (d min , d max ), when the depth value is closer to d min When the depth value is closer to d, the first type of pixel value can be made much larger than the second type of pixel value. In this way, the brightness of the pixels on the first image is brighter than the brightness of the pixels on the second image. max When the pixel value of the second category is much larger than the pixel value of the first category, the brightness of the pixel on the second image is brighter than that of the pixel on the first image. By making the pixels on the first image and the pixels on the second image display different brightness, the user can feel the depth change of the pixel.

[0373] In an embodiment of the present application, since the depth value of each pixel in the first image displayed by at least one first display and the depth value of each pixel in the second image displayed by at least one second display are the same, when obtaining the depth value of each pixel, the depth value of each pixel can be obtained from any one of the at least one first image and the at least one second image. After obtaining the depth value of each pixel, the first category pixel value and the second category pixel value can be determined according to the depth value of each pixel, so that each first image can display the brightness corresponding to the first category pixel value, and each second image can display the brightness corresponding to the second category pixel value. The brightness of the target image that the user is looking at is the brightness displayed after the brightness corresponding to the first category pixel value and the brightness corresponding to the second category pixel value are combined. Since the brightness of the pixel is related to the depth of the pixel, the user can feel the depth information of each pixel in the target image, thereby enhancing the user's sense of depth when looking at the target image.

[0374] In the related art, the distance between the user and the display in the display device is constant, which causes the focusing function of the user's eyeball to be unable to follow the convergence function to focus, resulting in a convergence-accommodation conflict. The convergence-accommodation conflict may cause the user to experience adverse reactions such as visual fatigue, dizziness, and headache when using the display device;

[0375] In the embodiment of the present application, since the user can feel the depth information of each pixel in the target image, when the user's eyes feel the depth of each pixel, the convergence function will converge the sights of both eyes to each pixel, and at the same time the focusing function will focus on the pixels at the same distance. In this way, the convergence and focusing functions of the user's eyes can be coordinated with each other, so that the sights of both eyes converge on the same pixel, effectively solving the convergence adjustment conflict.

[0376] In some embodiments, the processor is specifically used to: determine the ratio of the first category pixel value to the second category pixel value according to the depth value of each pixel; determine the first category pixel value and the second category pixel value according to the ratio of the first category pixel value and the second category pixel value.

[0377] In implementation, the processor can configure a correspondence between the depth value of the pixel and the ratio of the pixel value of each pixel in the first image to the pixel value of each pixel in the second image. Through this correspondence, the processor can determine the pixel value of the first image and the pixel value of the second image based on the depth value of the pixel.

[0378] It should be understood that the number of the first display and the second display can be one or more.

[0379] When the number of the first display and the second display is one, the above correspondence relationship can refer to Table 1 in the above embodiment. Through this correspondence relationship, the processor can determine the pixel value of the first image and the pixel value of the second image according to the depth value of the pixel. The implementation method can refer to the above embodiment and will not be repeated here.

[0380] In the case where there are multiple first displays or multiple second displays, for example, there are two first displays and one second display, the corresponding relationship can be referred to the following table:

[0381] Table 2

[0382]

[0383] In the implementation, exemplarily, the format of the first first image, the second first image, and the second image may be (RGB, D). Assuming that a pixel of the first first image, the second first image, and the second image is represented as (255, 150, 130, 2), the depth value of the pixel is 2. According to Table 2 above, when the depth value is 2, the ratio of the pixel value of the first first image, the pixel value of the second first image, and the pixel value of the second image is 4 / 5:1 / 10:1 / 10. The processor may determine the pixel values ​​of the first image and the second image according to the ratio. The pixel on the first first image may be represented as (255×4 / 5=204, 150×4 / 5=120, 130×4 / 5=104, 2×4 / 5=1.6), and the pixel on the second first image may be represented as (25 5×1 / 10=25.5, 150×1 / 10=15, 130×1 / 10=13, 2×1 / 10=0.2), the pixel on the determined second image can be expressed as (255×1 / 10=25.5, 150×1 / 10=15, 130×1 / 10=13, 2×1 / 10=0.2), the pixel value of the determined first first image is greater than the pixel value of the second first image, and the pixel value of the second first image is equal to the pixel value of the second image. Therefore, the brightness of the pixel on the projection of the first first image is greater than the brightness of the pixel on the second first image, and the brightness of the pixel on the projection of the second first image is equal to the brightness of the pixel on the projection of the second image, which can make the human eye feel that the depth of the pixel is 2 meters. The processor can refer to the above example to determine the pixel values ​​of other pixels, which will not be repeated here.

[0384] In the embodiment of the present application, the processor can determine the first category pixel value and the second category pixel value based on the ratio of the first category pixel value and the second category pixel value, thereby improving the accuracy of the determined first category pixel value and the second category pixel value.

[0385] In some embodiments, in the embodiments of the present application, in order to enable the user to obtain a picture with a larger field of view angle and a clearer picture when looking at the target image of the display device, the size of the first display can be larger than the size of the second display, and the ratio of the resolution of the first display to the first field of view angle is smaller than the ratio of the resolution of the second display to the second field of view angle. The first field of view angle is obtained by the projection of the user's pupil and the first image formed by the first display, and the second field of view angle is obtained by the projection of the user's pupil and the second image formed by the second display.

[0386] It should be understood that the size of the field of view angle is related to the size of the display, and the clarity of the image depends on the ratio of the display resolution to the field of view angle.

[0387] The projection of the first image in the embodiment of the present application can refer to Fig.12 Image plane 1 is shown, the projection of the second image may refer to image plane 2 .

[0388] In the embodiment of the present application, since the size of the first display is larger than that of the second display, the first field of view angle obtained by the projection of the user's pupil and the first image formed through the first display is larger than the second field of view angle obtained by the projection of the user's pupil and the second image formed through the second display, and since the ratio of the resolution of the first display to the first field of view angle is smaller than the ratio of the resolution of the second display to the second field of view angle, the ratio of the display resolution to the field of view angle can determine the clarity of the picture in the display device that the user is looking at, and therefore, the clarity of the projection of the first image in the display device that the user is looking at is smaller than the clarity of the projection of the second image;

[0389] Since the first field of view angle obtained by the projection of the user's pupil and the first image formed through the first display is greater than the second field of view angle obtained by the projection of the user's pupil and the second image formed through the second display, and the clarity of the projection of the first image in the display device that the user is looking at is less than the clarity of the projection of the second image, when the user is looking at the target image in the display device, a picture with a larger field of view angle can be obtained through the projection of the first image, and the picture with a larger field of view angle can enhance the user's sense of immersion, and a clearer picture can be obtained through the projection of the second image. Therefore, when the user is looking at the target image of the display device, he can obtain a picture with a larger field of view angle and a clearer picture, thereby improving the user experience.

[0390] In some embodiments, the display device further includes a detection module, a processor, and an adjustment module;

[0391] The detection module is used to detect the gaze direction of the user's gaze at the target image and generate gaze direction information; the processor is used to determine the first position information of the gaze area of ​​the target image where the user is looking at according to the gaze direction information, and send an adjustment instruction to the adjustment module according to the first position information; the adjustment module is used to adjust the position of the second display according to the adjustment instruction so that the projection of the second image moves to the gaze area of ​​the target image where the user is looking at.

[0392] It should be understood that the target image that the user is looking at can refer to Fig.12 Image plane 1 and image plane 2 are shown.

[0393] It should also be understood that the detection module may include one of the following devices: an eye tracker, an infrared tracker, etc., all of which can track the gaze direction of the human eye. The present application embodiment does not limit the specific device used by the detection module. The first position information of the gaze area can be characterized by the coordinate information of the gaze area.

[0394] In the embodiment of the present application, the projection of the second image can be moved to the gaze area of ​​the target image that the user is gazing at through the detection module, the processor and the adjustment module. Since the projection of the second image displays a clearer image, the position of the clearer image can change on the target image as the user's gaze direction changes, thereby improving the user experience.

[0395] It should be understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0396] A person skilled in the art may understand that the various numerical numbers such as first and second involved in the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application, and also indicate the order of precedence.

[0397] In this application, elements expressed in the singular are intended to mean "one or more" rather than "one and only one", unless otherwise specified. In this application, "at least one" is intended to mean "one or more", and "more than one" is intended to mean "two or more", unless otherwise specified.

[0398] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A can be singular or plural, and B can be singular or plural.

[0399] The term "at least one" as used herein means all or any combination of the listed items. For example, "at least one of A, B, and C" may mean: A alone, B alone, C alone, A and B at the same time, B and C at the same time, and A, B, and C at the same time. A may be singular or plural, B may be singular or plural, and C may be singular or plural.

[0400] Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0401] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0402] The same or similar parts between the various embodiments in this application can refer to each other. In the various embodiments in this application, and the various implementation methods / implementation methods / implementation methods in each embodiment, if there is no special explanation and logical conflict, the terms and / or descriptions between different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment are consistent and can be referenced to each other. The technical features in different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment can be combined to form new embodiments, implementation methods, implementation methods, or implementation methods according to their inherent logical relationships. The above-described implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0403] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims. In short, the above is only a preferred embodiment of the technical solution of the present application, and is not used to limit the protection scope of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A display device, It is characterized in that include: The display device includes two optical display modules, and the optical display modules are used to display a target image visually displayed by a user, and the optical display modules include: At least one first display (201), the first display (201) being used to display a first image; at least one second display (208), the second display (208) being used to display a second image; An optical combiner, used for performing multiple reflections on light emitted from at least one of the first displays (201) to form a projection of at least one of the first images in an extension direction of a user's vision, and for performing multiple reflections on light emitted from at least one of the second displays (208) to form a projection of at least one of the second images in an extension direction of a user's vision, wherein the light emitted from the first display (201) is reflected multiple times to form a projection of the first image, and the light emitted from the second display (208) is reflected multiple times to form a projection of the second image; The optical combiner is further used to combine the projection of at least one of the first images and the projection of at least one of the second images to create the target image visually viewed by the user.

2. The display device according to claim 1, It is characterized in that The optical combiner comprises a first partially reflective film (204) and a first reflective polarizing film (207); wherein, The light emitted from the first display (201) reaches the first partial reflective film (204) and is transmitted for the first time, the light transmitted for the first time reaches the first reflective polarizing film (207) and is reflected for the first time, the light reflected for the first time reaches the first partial reflective film (204) and is reflected for the second time, and the light reflected for the second time reaches the first reflective polarizing film (207) and is transmitted for the second time, so as to form a projection of the first image in the extension direction of the user's vision; The light emitted from the second display (208) is reflected for the first time after reaching the first reflective polarizing film (207), the light reflected for the first time is reflected for the second time after reaching the first partial reflective film (204), and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film (207), so as to form a projection of the second image in the extension direction of the user's vision.

3. The display device according to claim 2, It is characterized in that The optical combiner also includes a first quarter phase glass (205); wherein, The light from the first display (201) that is transmitted for the first time after passing through the first partial reflection film (204) changes its polarization state for the first time after reaching the first quarter phase glass (205), the light whose polarization state is changed for the first time is reflected for the first time after reaching the first reflective polarizing film (207), the light whose polarization state is changed for the first time changes its polarization state for the second time after reaching the first quarter phase glass (205), the light whose polarization state is changed for the second time changes its polarization state for the second time after reaching the first partial reflection film (204) is reflected for the second time, the light whose polarization state is reflected for the second time changes its polarization state for the third time after reaching the first quarter phase glass (205), and the light whose polarization state is changed for the third time changes its polarization state for the second time after reaching the first reflective polarizing film (207) is transmitted for the second time; The light emitted from the second display (208) changes its polarization state for the first time after reaching the first quarter-phase glass (205), the light whose polarization state is changed for the first time is reflected for the first time after reaching the first reflective polarizing film (207), the light whose polarization state is reflected for the first time changes its polarization state for the second time after reaching the first quarter-phase glass (205), the light whose polarization state is changed for the second time is reflected for the second time after reaching the first partial reflective film (204), the light whose polarization state is reflected for the second time changes its polarization state for the third time after reaching the first quarter-phase glass (205), and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film (207).

4. The display device according to claim 1, It is characterized in that The optical combiner comprises a first optical component and a second optical component, wherein the first optical component comprises a second partially reflective film (213) and a second reflective polarizing film (215), and the second optical component comprises a first partially reflective film (204) and a first reflective polarizing film (207), wherein: The light emitted from the first display (201) reaches the second partial reflective film (213) and is transmitted for the first time, the light transmitted for the first time reaches the second reflective polarizing film (215) and is reflected for the first time, the light reflected for the first time reaches the second partial reflective film (213) and is reflected for the second time, and the light reflected for the second time passes through the second reflective polarizing film (215), the first partial reflective film (204) and the first reflective polarizing film (207) in sequence and is transmitted, so as to form a projection of the first image in the extension direction of the user's vision; The light emitted from the second display (208) is reflected for the first time after reaching the first reflective polarizing film (207), the light reflected for the first time is reflected for the second time after reaching the first partial reflective film (204), and the light reflected for the second time is transmitted for the first time after reaching the first reflective polarizing film (207), so as to form a projection of the second image in the extension direction of the user's vision.

5. The display device according to claim 4, It is characterized in that The first optical component further comprises a second quarter phase glass (214) and a third quarter phase glass (216), and the second optical component further comprises a first quarter phase glass (205), wherein: The light from the first display (201) that is transmitted for the first time after passing through the second partial reflective film (213) changes its polarization state for the first time after arriving at the second quarter phase glass plate (214); the light whose polarization state is changed for the first time reaches the second reflective polarizing film (215) and is reflected for the first time; the light whose polarization state is reflected for the first time changes its polarization state for the second time after arriving at the second quarter phase glass plate (214); the light whose polarization state is changed for the second time reaches the second partial reflective film (213) and is reflected for the second time; the light whose polarization state is reflected for the second time changes its polarization state for the third time after arriving at the second quarter phase glass plate (214); the light whose polarization state is changed for the third time passes through the second reflective polarizing film (215), the third quarter phase glass plate (216), the first partial reflective film (204), the first quarter phase glass plate (205) and the first reflective polarizing film (207) in sequence and is then transmitted; The light emitted from the second display (208) changes its polarization state for the first time after reaching the first quarter-phase glass (205), the light whose polarization state is changed for the first time is reflected for the first time after reaching the first reflective polarizing film (207), the light whose polarization state is reflected for the first time changes its polarization state for the second time after reaching the first quarter-phase glass (205), the light whose polarization state is changed for the second time is reflected for the second time after reaching the first partial reflective film (204), the light whose polarization state is reflected for the second time changes its polarization state for the third time after reaching the first quarter-phase glass (205), and the light whose polarization state is changed for the third time is transmitted for the first time after reaching the first reflective polarizing film (207).

6. The display device according to claim 4 or 5, It is characterized in that The first optical component further comprises a first lens (212), wherein: The light from the first display (201) that is transmitted for the first time after passing through the second partial reflective film (213) is refracted for the first time after reaching the first lens (212), the light that is refracted for the first time is reflected for the first time after reaching the second reflective polarizing film (215), the light that is reflected for the first time is refracted for the second time after reaching the first lens (212), the light that is refracted for the second time is reflected for the second time after reaching the second partial reflective film (213), the light that is reflected for the second time is refracted for the third time after reaching the first lens (212), and the light that is refracted for the third time passes through the second reflective polarizing film (215), the first partial reflective film (204) and the first reflective polarizing film (207) in sequence and is transmitted.

7. The display device according to any one of claims 2, 4 and 6, It is characterized in that The optical combiner also includes a first quarter phase glass (205); wherein, The light emitted from the second display (208) is reflected for the first time after reaching the first reflective polarizing film (207), the light reflected for the first time is changed in polarization state for the first time after reaching the first quarter-phase glass (205), the light whose polarization state is changed for the first time is reflected for the second time after reaching the first partial reflective film (204), the light reflected for the second time is changed in polarization state for the second time after reaching the first quarter-phase glass (205), and the light whose polarization state is changed for the second time is transmitted for the first time after reaching the first reflective polarizing film (207).

8. The display device according to any one of claims 2 to 7, It is characterized in that The second display (208) is arranged on one side of the first reflective polarizing film (207), and the angle between the length direction of the first reflective polarizing film (207) and the length direction of the second display (208) is an acute angle.

9. The display device according to claim 8, It is characterized in that The length direction of the first display (201) and the length direction of the first reflective polarizing film (207) have a preset angle, and the first reflective polarizing film (207) is arranged toward the first display (201).

10. The display device according to any one of claims 1 to 9, It is characterized in that The size of the first display (201) is equal to the size of the second display (208), the resolution of the first display (201) is equal to the resolution of the second display (208), and the center position of the projection of the first image, the center position of the projection of the second image and the center position of the user's pupil are on a connecting line.

11. The display device according to claim 10, It is characterized in that The display device further includes a processor, wherein the processor is configured to: Obtaining a depth value of each pixel of any one of at least one of the first images and at least one of the second images; According to the depth value of each pixel, a first-category pixel value of each pixel in at least one of the first images and a second-category pixel value of each pixel in at least one of the second images are determined, so that each of the first images displays the brightness corresponding to the first-category pixel value based on the first-category pixel value and each of the second images displays the brightness corresponding to the second-category pixel value based on the second-category pixel value.

12. The display device according to claim 11, It is characterized in that The processor is specifically used for: Determine, according to the depth value of each pixel, a ratio of the first-category pixel value to the second-category pixel value; The first-category pixel values ​​and the second-category pixel values ​​are determined according to a ratio of the first-category pixel values ​​to the second-category pixel values.

13. The display device according to any one of claims 1 to 9, It is characterized in that The size of the first display (201) is larger than the size of the second display (208), the ratio of the resolution of the first display (201) to the first field of view angle is smaller than the ratio of the resolution of the second display (208) to the second field of view angle, the first field of view angle is obtained by the projection of the user's pupil and the first image formed through the first display (201), and the second field of view angle is obtained by the projection of the user's pupil and the second image formed through the second display (208).

14. The display device according to claim 13, It is characterized in that The display device also includes a detection module, a processor and an adjustment module; The detection module is used to detect the gaze direction of the user gazing at the target image and generate gaze direction information; The processor is used to determine first position information of a gaze area where the user gazes at the target image according to the gaze direction information, and send an adjustment instruction to the adjustment module according to the first position information; The adjustment module is used to adjust the position of the second display (208) according to the adjustment instruction so that the projection of the second image moves to the gaze area of ​​the target image gazed by the user.

15. The display device according to any one of claims 1 to 14, It is characterized in that The display device is a head-mounted near-eye display device.

Images