Near-eye display system and head-mounted display device

Abstract

The embodiment of the present application provides a near-eye display system and a head-mounted display device; wherein the near-eye display system comprises: a lens barrel, a first screen, a second screen, a lens, an eyeball tracking camera, and a first total reflection mirror and a second total reflection mirror; the first screen and the second screen are both obliquely arranged on the side wall of the lens barrel, and the first screen and the second screen are mirror-symmetrically distributed about the central axis of the lens barrel; the lens is arranged at the first end of the lens barrel; the eyeball tracking camera is arranged at the second end of the lens barrel; the first total reflection mirror and the second total reflection mirror are both obliquely arranged in the lens barrel and are mirror-symmetrically arranged about the central axis of the lens barrel, the first total reflection mirror is located at a first position and can be used for totally reflecting first image light emitted by the first screen to the lens, and the second total reflection mirror is located at a second position and can be used for totally reflecting second image light emitted by the second screen to the lens. The near-eye display system provided by the embodiment of the present application can realize super-high resolution imaging of a VR device.

Description

Technical Field

[0001] This application relates to the field of optical imaging technology, and more specifically, to a near-eye display system and a head-mounted display device. Background Technology

[0002] In recent years, virtual reality headsets have experienced rapid development, with various new optical solutions and devices emerging one after another. However, due to limitations in VR device screen manufacturing processes and the cost of using high-resolution screens, the highest screen resolution currently used in VR devices can only reach 4K. This results in relatively low imaging resolution for existing VR devices, affecting the user's viewing experience. Summary of the Invention

[0003] The purpose of this application is to provide a new technical solution for a near-eye display system and a head-mounted display device.

[0004] In a first aspect, this application provides a near-eye display system. The near-eye display system includes:

[0005] Lens tube;

[0006] The first screen and the second screen are both inclinedly disposed on the side wall of the lens barrel, and the first screen and the second screen are distributed in a mirror symmetrical manner about the central axis of the lens barrel;

[0007] A lens is disposed at the first end of the lens barrel;

[0008] An eye-tracking camera is located at the second end of the lens barrel;

[0009] The first total reflection mirror and the second total reflection mirror are both inclinedly disposed inside the mirror tube and are mirror-symmetrical about the central axis of the mirror tube. The first total reflection mirror is located in a first position and is used to completely reflect the first image light emitted from the first screen to the mirror. The second total reflection mirror is located in a second position and is used to completely reflect the second image light emitted from the second screen to the mirror.

[0010] Optionally, the near-eye display system further includes a flat glass plate connected between the first total reflection mirror and the second total reflection mirror.

[0011] Optionally, the flat glass is rectangular, and the longer side of the flat glass is larger than the diameter of the imaging circle of the eye-tracking camera.

[0012] Optionally, an anti-reflective film or a filter film may be provided on any surface of the flat glass.

[0013] Optionally, the eye-tracking camera is located at the middle of the second end of the lens barrel, and is used to collect the position information of the eyeball facing the human eye.

[0014] Optionally, the first screen and the second screen are respectively embedded in the side wall of the lens barrel;

[0015] The first screen and the second screen respectively form a target angle with the side wall of the lens barrel, and the target angle is ≤30°.

[0016] Optionally, the target angle is 5° to 30°.

[0017] Optionally, the first total reflection mirror and the second total reflection mirror are fixedly connected to the side wall of the mirror tube, and the first total reflection mirror and the second total reflection mirror are inclined relative to the side wall of the mirror tube, with an inclination angle of 50° to 70°.

[0018] Optionally, the first image light is reflected by the first total reflection mirror and then passes through the lens to form a first image, and the second image light is reflected by the second total reflection mirror and then passes through the lens to form a second image. The first image and the second image are stitched together to form a target image, and the first image and the second image have an overlapping area A.

[0019] Optionally, the sidewall of the lens barrel is formed by a first wall portion, a second wall portion, a third wall portion and a fourth wall portion, and the first wall portion and the second wall portion are arranged opposite to each other, and the third wall portion and the fourth wall portion are arranged opposite to each other;

[0020] The first screen is disposed on the first wall portion, and the second screen is disposed on the second wall portion. The first wall portion and the second wall portion are straight wall structures.

[0021] One of the third wall portion and the fourth wall portion is located near the nasal wing side, and the third wall portion and the fourth wall portion are arc-shaped.

[0022] Secondly, this application provides a head-mounted display device. The head-mounted display device includes:

[0023] Casing; and

[0024] The near-eye display system as described in the first aspect is disposed in the housing.

[0025] The beneficial effects of this application are as follows:

[0026] According to the near-eye display system of this application, a light path design combining dual-screen image splicing and fusion with an eye-tracking camera is provided, which can improve the single-eye resolution and binocular resolution of virtual reality head-mounted displays, thereby improving the final imaging display effect and clarity; moreover, by arranging the two screens at a specific angle and using total internal reflection of light, the size of the system will not be increased, and virtual reality products can be made thinner and lighter.

[0027] Other features and advantages of this specification will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0028] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of this specification and, together with their description, serve to explain the principles of this specification.

[0029] Figure 1 The structure and optical path diagram of the near-eye display system provided in the embodiments of this application;

[0030] Figure 2 This is an image stitching display effect diagram of the near-eye display system provided in the embodiments of this application;

[0031] Figure 3 This is a diagram showing the external shape of the lens barrel of the near-eye display system provided in an embodiment of this application.

[0032] Explanation of reference numerals in the attached figures:

[0033] 01. Human eye; 1. First screen; 2. Second screen; 3. Lens tube; 31. First end; 32. Second end; 301. First wall; 302. Second wall; 303. Third wall; 304. Fourth wall; 4. Lens; 5. First total reflection mirror; 6. Second total reflection mirror; 7. Eye-tracking camera; 8. Flat glass;

[0034] 11. First image; 21. Second image; A. Overlapping region. Detailed Implementation

[0035] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0036] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0037] Technologies and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such technologies and equipment should be considered part of the specification.

[0038] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0039] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0040] The near-eye display system and head-mounted display device provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0041] According to one aspect of the embodiments of this application, a near-eye display system is provided, which is suitable for virtual reality display devices, such as VR head-mounted display devices. Specifically, the VR head-mounted display device may take the form of VR smart glasses or VR smart helmets, etc., and the embodiments of this application do not limit the specific form of the head-mounted display device.

[0042] The near-eye display system proposed in this application embodiment is described in [reference]. Figure 1 The near-eye display system includes: a lens barrel 3, a first screen 1, a second screen 2, a lens 4, an eye-tracking camera 7, and a first total reflection mirror 5 and a second total reflection mirror 6. The first screen 1 and the second screen 2 are both inclinedly disposed on the side wall of the lens barrel 3, and the first screen 1 and the second screen 2 are mirror-symmetrically distributed about the central axis of the lens barrel 3. The lens 4 is disposed at the first end 31 of the lens barrel 3. The eye-tracking camera 7 is disposed at the second end 32 of the lens barrel 3. The first total reflection mirror 5 and the second total reflection mirror 6 are both inclinedly disposed inside the lens barrel 3 and mirror-symmetrically distributed about the central axis of the lens barrel 3. The first total reflection mirror 5 is located in a first position and can be used to completely reflect the first image light emitted from the first screen 1 to the lens 4. The second total reflection mirror 6 is located in a second position and can be used to completely reflect the second image light emitted from the second screen 2 to the lens 4.

[0043] According to the near-eye display system provided in the above embodiments, in application, it corresponds to a user's single eye, that is, it is an optical imaging scheme that combines a single eye with dual screens. The optical scheme provided in this application embodiment achieves a significant increase in single-eye resolution by using image synthesis from two screens. See [link to relevant documentation]. Figure 2 Based on this, the resolution of binocular imaging can be improved.

[0044] For example, currently, the highest resolution a single screen in VR devices can reach is 4K. The optical solution provided in this application embodiment achieves a resolution of 8K or higher per eye. The resolution per eye is increased exponentially.

[0045] In the solution provided in this application embodiment, by arranging the two screens at a specific angle and combining them with a reflective structure to reflect light, the volume of the near-eye display system will not be increased.

[0046] In other words, the near-eye display system provided in this application embodiment can achieve a resolution that is several times higher per eye, such as 8K or higher, without increasing the system size.

[0047] According to the near-eye display system of this application embodiment, a light path design of dual-screen image splicing and fusion combined with eye-tracking camera 7 is provided, which can improve the single-eye resolution and binocular resolution of virtual reality head-mounted displays, thereby improving the final imaging display effect and clarity; moreover, by arranging the two screens at a specific angle and cooperating with total internal reflection of light, the size of the system will not be increased, and virtual reality products can be made thinner and lighter.

[0048] The near-eye display system provided in this application embodiment can improve the resolution of the final image while ensuring the VR device is thinner and lighter, which further enhances the wearing experience and viewing experience of the VR device.

[0049] According to the above embodiments, the lens barrel 3 is used to house the various optical elements described above.

[0050] Specifically, see Figure 1 The sidewall of the lens barrel 3 has a certain wall thickness, and the inside of the lens barrel 3 has a receiving space. The lens barrel 3 has a first end 31 and a second end 32 that are opposite each other along the axial direction. For example, at least one lens 4 is installed in the first end 31 and inside the lens barrel 3, while an eye-tracking camera 7 is installed in the second end 32.

[0051] The number of lenses 4 can be adjusted as needed, and this application does not impose any restrictions on this.

[0052] According to the near-eye display system provided in the above embodiments of this application, see [link to relevant documentation]. Figure 1 The optical path propagation path is as follows: the first image light emitted from the first screen 1 is projected onto the first total reflection mirror 5, the second image light emitted from the second screen 2 is projected onto the second total reflection mirror 6, the first image light is reflected by the first total reflection mirror 5, the second image light is reflected by the second total reflection mirror 6, and the first image light and the second image light enter the human eye 01 through the lens 4 to form an image.

[0053] See some examples in this application. Figure 1 The near-eye display system also includes a flat glass plate 8, which is connected between the first total reflection mirror 5 and the second total reflection mirror 6.

[0054] According to the above example, a flat glass plate 8 is also used in the near-eye display system. The flat glass plate 8 is disposed inside the lens barrel 3, specifically between the first total reflection mirror 5 and the second total reflection mirror 6. The flat glass plate 8 is used to support the two total reflection mirrors and can also play a role in enhancing the light transmission.

[0055] See Figure 1 The flat glass 8 is vertically positioned between the first total reflection mirror 5 and the second total reflection mirror 6. The central axis of the mirror tube 3 passes through the center of the flat glass 8.

[0056] In some examples of this application, the flat glass 8 is rectangular, and the long side of the flat glass 8 is larger than the imaging circle diameter of the eye-tracking camera 7.

[0057] The shape of the flat glass 8 is related to the shapes of the first screen 1 and the second screen 2. For example, if both the first screen 1 and the second screen 2 are rectangular, then the shape of the flat glass 8 is also rectangular. Furthermore, the long side dimension of the flat glass 8 is related to the long side dimension of the two screens.

[0058] Based on the optical constraint conditions provided in the example above, see [link / reference]. Figure 1 The eye-tracking camera 7 has a field of view (i.e., its shooting range) that can cover an entire screen. This improves the accuracy of the eye-tracking camera 7 in tracking the human eye.

[0059] It should be noted that if the entire long side of a screen can be captured by the eye-tracking camera 7, then the entire short side of the screen can naturally be captured as well.

[0060] In some examples of this application, an antireflective film or a light filter film is provided on any surface of the flat glass 8.

[0061] An antireflective coating is provided on one surface of the flat glass 8, which can be used to enhance light transmittance and reduce reflectance.

[0062] A filter film is provided on one surface of the flat glass 8 to filter the incident light so that the desired light can pass through.

[0063] Optionally, the antireflective film and the filter film can be bonded to the flat glass 8 by coating or bonding.

[0064] See some examples in this application. Figure 1 The eye-tracking camera 7 is located in the middle of the second end of the lens tube 3 away from the human eye 01, and can be used to collect the position information of the eyeball facing the human eye 01.

[0065] See Figure 1 The end of the lens tube 3 furthest from the human eye 01 (i.e. Figure 1 The second end 32) is defined as the end of the lens barrel, and the eye-tracking camera 7 is located at the center of this end of the lens barrel. The position of the eye-tracking camera 7 is such that it can directly face the human eye 01 to capture images, so as to achieve better eye-tracking effect and higher accuracy.

[0066] See some examples in this application. Figure 1 The first screen 1 and the second screen 2 are respectively embedded in the side wall of the lens barrel 3; the first screen 1 and the second screen 2 respectively form a target angle with the side wall of the lens barrel 3, and the target angle is ≤30°.

[0067] The optical solution provided in this application mainly relies on the design and optimization of the placement angle and position of the image display source, namely the first screen 1 and the second screen 2. By combining it with the special reflection and transmission structure inside the lens barrel 3, the stitching and fusion of the dual-screen images are realized, while improving the accuracy of the eye-tracking camera 7 in tracking the human eye.

[0068] Furthermore, in this application, the two screens are embedded in the side wall of the lens barrel 3, rather than being arranged along the axial direction of the lens barrel, which can reduce the axial dimension of the lens barrel.

[0069] The target angle can be 5° to 30° (including the two endpoint values).

[0070] For example, the target angle can be 5°, 10°, 15°, 20°, 25°, 30°, etc. In some examples of this application, the first total reflection mirror 5 and the second total reflection mirror 6 are respectively fixedly connected to the side wall of the mirror tube 3. The first total reflection mirror 5 and the second total reflection mirror 6 are inclined relative to the side wall of the mirror tube 3, and the inclination angle is 50° to 70° (including the two endpoint values).

[0071] See some examples in this application. Figure 1 The first image light, after being reflected by the first total internal reflection mirror 5, passes through the lens 4 to form the first image 11; the second image light, after being reflected by the second total internal reflection mirror 6, passes through the lens 4 to form the second image 21. (See also...) Figure 2 The first image 11 and the second image 21 are stitched together to form a target image, and the first image 11 and the second image 21 have an overlapping area A.

[0072] See Figure 1 In the near-eye display system provided in this application embodiment, both screens are tilted at a specific angle. Thus, the image light emitted by the first screen 1 and the second screen 2 will have a partial overlap area A after reflection by the total internal reflection mirror, see [link to relevant documentation]. Figure 2 .

[0073] It should be noted that the size of the overlapping area A depends on the tilt angle of the two screens relative to the sidewall plane of the mirror barrel 3 (i.e., the aforementioned target angle) and the angle at which the total reflection mirror reflects the image. The larger the overlapping area A of the two images is, the greater the tilt angle of both the screens and the total reflection mirror. In other words, the size of the overlapping area A is affected by the placement angles of the screens and the total reflection mirror, and these two factors can be adjusted to achieve the pre-designed requirements for the overlapping area A.

[0074] In a preferred embodiment of this application, the angle between the first screen 1 and the second screen 2 and the sidewall plane of the mirror barrel 3 is between 5° and 30°, and the tilt angle between the first total reflection mirror 5 and the second total reflection mirror 6 and the sidewall plane of the mirror barrel 3 is between 50° and 70°. Furthermore, the specific tilt angle range may be affected by the optical parameters of the optical lenses in the system, such as lens 4, but there must be at least one angle that allows the image light emitted by the first screen 1 and the second screen 2 to be clearly and completely imaged at the human eye O1.

[0075] See some examples in this application. Figure 3 The sidewall of the lens barrel 3 is formed by a first wall portion 301, a second wall portion 302, a third wall portion 303, and a fourth wall portion 304, with the first wall portion 301 and the second wall portion 302 facing each other, and the third wall portion 303 and the fourth wall portion 304 facing each other. The first screen 1 is disposed on the first wall portion 301, and the second screen 2 is disposed on the second wall portion 302. The first wall portion 301 and the second wall portion 302 are straight wall structures. One of the third wall portion 303 and the fourth wall portion 304 is located near the nasal wing side, and both the third wall portion 303 and the fourth wall portion 304 are arc-shaped.

[0076] Combination Figure 1 and Figure 3A first screen 1 and a second screen 2 are embedded in two opposite wall sections of the lens barrel 3, respectively. These two wall sections are designed as straight walls to facilitate positioning (and easy control of the tilt angle) and installation of the screens. Furthermore, the wall section of the lens barrel 3 near the nasal wing is designed as an arc shape, which helps to avoid obstruction on the nasal bridge side. Based on this, the other wall section opposite the nasal wing can also be designed as an arc shape to achieve a symmetrical effect.

[0077] See Figure 3 The longitudinal section of the lens tube 3 is similar to the shape of a runway.

[0078] The near-eye display system provided in this application proposes a dual-screen image splicing and fusion combined with an eye-tracking camera to directly capture the human eye, which can significantly improve the monocular and binocular resolution of virtual reality head-mounted displays, further enhancing the display effect and clarity.

[0079] According to another embodiment of this application, a head-mounted display device is provided.

[0080] The head-mounted display device includes a housing and a near-eye display system as described above, the near-eye display system being disposed within the housing.

[0081] The near-eye display system can be configured to have two settings, corresponding to the user's left and right eyes respectively, which can significantly improve both monocular and binocular resolution, thereby further enhancing display quality and clarity.

[0082] The head-mounted display device may take the form of VR glasses or VR helmets, and this application embodiment does not limit this.

[0083] The specific implementation of the head-mounted display device in this application can refer to the various embodiments of the near-eye display system described above. Therefore, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, and will not be described in detail here.

[0084] The above embodiments mainly describe the differences between the various embodiments. As long as the different optimization features between the various embodiments are not contradictory, they can be combined to form a better embodiment. For the sake of brevity, they will not be elaborated here.

[0085] While specific embodiments of this application have been described in detail by way of examples, those skilled in the art should understand that the above examples are for illustrative purposes only and are not intended to limit the scope of this application. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this application. The scope of this application is defined by the appended claims.

Claims

1. A near-eye display system, characterized in that, include: Lens tube (3); The first screen (1) and the second screen (2) are both inclinedly disposed on the side wall of the lens barrel (3), and the first screen (1) and the second screen (2) are mirror-symmetrically distributed about the central axis of the lens barrel (3); Lens (4) is disposed at the first end (31) of the lens tube (3); An eye-tracking camera (7) is disposed at the second end (32) of the lens tube (3); The first total reflection mirror (5) and the second total reflection mirror (6) are both inclinedly arranged inside the mirror tube (3) and are mirror symmetrical about the central axis of the mirror tube (3). The first total reflection mirror (5) is located in the first position and is used to reflect the first image light emitted from the first screen (1) to the lens (4). The second total reflection mirror (6) is located in the second position and is used to reflect the second image light emitted from the second screen (2) to the lens (4). The first screen (1) and the second screen (2) are respectively embedded in the side wall of the lens barrel (3); the first screen (1) and the second screen (2) respectively form a target angle with the side wall of the lens barrel (3), and the target angle is 5°~30°; The first total reflection mirror (5) and the second total reflection mirror (6) are fixedly connected to the side wall of the mirror tube (3). The first total reflection mirror (5) and the second total reflection mirror (6) are inclined relative to the side wall of the mirror tube (3), and the inclination angle is 50°~70°. The near-eye display system also includes a flat glass (8), which is connected between the first total reflection mirror (5) and the second total reflection mirror (6); the long side dimension of the flat glass (8) is larger than the imaging circle diameter of the eye-tracking camera (7).

2. The near-eye display system according to claim 1, characterized in that, The flat glass (8) is rectangular.

3. The near-eye display system according to claim 1 or 2, characterized in that, An anti-reflective film or a filter film is provided on any surface of the flat glass (8).

4. The near-eye display system according to claim 1, characterized in that, The eye-tracking camera (7) is located in the middle of the second end (32) of the lens tube (3) and is used to collect eye position information directly facing the human eye (01).

5. The near-eye display system according to claim 1, characterized in that, The first image light is reflected by the first total reflection mirror (5) and then passes through the lens (4) to form a first image (11). The second image light is reflected by the second total reflection mirror (6) and then passes through the lens (4) to form a second image (21). The first image (11) and the second image (21) are stitched together to form a target image, and the first image (11) and the second image (21) have an overlapping area (A).

6. The near-eye display system according to claim 1, characterized in that, The sidewall of the lens tube (3) is formed by a first wall portion (301), a second wall portion (302), a third wall portion (303) and a fourth wall portion (304), and the first wall portion (301) and the second wall portion (302) are arranged opposite to each other, and the third wall portion (303) and the fourth wall portion (304) are arranged opposite to each other; The first screen (1) is disposed on the first wall portion (301), and the second screen (2) is disposed on the second wall portion (302). The first wall portion (301) and the second wall portion (302) are straight wall structures. One of the third wall portion (303) and the fourth wall portion (304) is close to the nasal wing side, and the third wall portion (303) and the fourth wall portion (304) are arc-shaped.

7. A head-mounted display device, characterized in that, include: case; as well as The near-eye display system as described in any one of claims 1-6, wherein the near-eye display system is disposed in the housing.

Images