Head-mounted devices
By monitoring the user's head status and adjusting the angle of the lens seat, the problem of the user's line of sight being out of view when wearing virtual imaging equipment is solved, and the virtual image and the eye's line of sight are automatically overlapped.
Patent Information
- Application Number
- CN202310090628.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-17
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2043-01-17
AI Technical Summary
When a user wears a virtual imaging device, the user's eyes move, causing their sight to fall into an area not covered by the virtual image, and they cannot see the virtual image.
By monitoring the user's head status, such as an eye tracker or an inertial measurement unit, the angle of the lens mount is adjusted in real time to ensure that the virtual image coincides with the eye's line of sight.
Automatic calibration of the virtual image and the eye's line of sight is achieved, ensuring that the user can always see the complete virtual image when turning their head or eyes.
Smart Images

Figure CN115963629B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of virtual imaging devices, and in particular to head-mounted devices. Background Art
[0002] Virtual imaging devices can provide virtual images, but users need to see them through their lenses. When observing the outside world, the eyes can rotate to expand their field of view. The virtual image is smaller than the field of view, allowing the eyes to see the entire virtual image. However, this also means that areas of the image may not be visible within the field of view. However, in certain head positions, the eyes may rotate, causing their line of sight to fall into areas not covered by the virtual image, preventing them from seeing the virtual image. Summary of the Invention
[0003] In view of this, the present application provides a head-mounted device that rotates the lenses so that the virtual image can remain aligned with the eye's line of sight.
[0004] One embodiment of the present application provides a head-mounted device. The head-mounted device includes a main frame, a lens holder, a lens, and a monitoring device. The main frame is used to be worn on the user's head. The lens holder is rotatably mounted on the main frame. The lens is mounted on the lens holder. The lens is used to display a virtual image. The virtual image is smaller than the observation range. The observation range is the range that the user's eyes can see by rotating. The monitoring device is mounted on the main frame or the lens holder. The monitoring device is used to monitor the state of the user's head. According to the state of the user's head monitored by the monitoring device, the lens holder can rotate and drive the lens to move to change the angle of the lens relative to the user's eyes, thereby adjusting the position of the virtual image within the observation range.
[0005] In the above embodiment, the user's eyes see a virtual image through the lenses, and the range of observation that can be seen by rotating the eyes is larger than the virtual image. The main frame is fixed relative to the head, and the lens holder can rotate relative to the head by rotating relative to the main frame, driving the movement of the lenses, causing the angle of the lenses relative to the eyes to change, thereby changing the position of the virtual image relative to the eyes. The lenses are positioned between the virtual image and the eyes, so a small adjustment of the lenses can cause a larger change in the position of the virtual image. Simultaneously, based on the status information of the head monitored by the monitoring device, the relative position of the eye's line of sight within the observation range is determined and compared with the relative position of the virtual image within the observation range. The angle of the lenses relative to the eyes is adjusted to quickly achieve overlap between the virtual image and the eye's line of sight.
[0006] In some embodiments of the present application, the state of the user's head includes the position of the user's eye's line of sight. The monitoring device includes an eye tracker. The eye tracker is disposed on a lens holder. The eye tracker is used to track the position of the user's eye's line of sight. When the eye tracker tracks the user's eye's line of sight falling into a position within the observation range that is not covered by the virtual image, the lens holder rotates to change the position of the virtual image within the observation range. When the eye tracker tracks the user's eye's line of sight falling into a position within the observation range that is covered by the virtual image, the lens holder is fixed relative to the main frame to fix the position of the virtual image within the observation range.
[0007] In the above embodiment, the eye's gaze position is one of the head states, and the eye tracker is positioned on the lens mount so as to be oriented toward the eye, thereby monitoring the eye's gaze position. By monitoring the eye's gaze position, it can be directly compared with the observation range to determine the relative position of the eye's gaze within the observation range. Thus, if the virtual image and the gaze position do not coincide, the lens angle can be adjusted to move the virtual image to the gaze position. Alternatively, if the virtual image and the gaze position coincide, the lens angle can be maintained fixed to ensure that the virtual image and the gaze position remain coincident.
[0008] In some embodiments of the present application, the head-mounted device further includes an analysis control module and a drive module. The analysis control module and the drive module are arranged on the main frame or the lens holder. The analysis control module is respectively connected to the eye tracker and the drive module in telecommunication. The analysis control module is capable of receiving and analyzing the line of sight position signal of the user's eyes monitored by the eye tracker. When the analysis control module determines that the line of sight of the user's eyes falls into a position not covered by the virtual image within the observation range, the analysis control module controls the drive module to drive the lens holder to rotate relative to the main frame. When the analysis control module determines that the line of sight of the user's eyes falls into a position covered by the virtual image within the observation range, the analysis control module controls the drive module to maintain the lens holder fixed relative to the main frame.
[0009] In the above embodiment, the eye tracker monitors the eye's line of sight and converts it into a signal that is transmitted to the analysis and control module. The analysis and control module can analyze the signal and determine the position of the line of sight within the observation range, thereby determining whether the eye's line of sight deviates from the virtual image and the position of the deviation. The analysis and control module then controls the drive module to determine what kind of driving action to perform on the lens holder, causing the lens holder to rotate or remain fixed, thereby automatically completing the alignment calibration between the virtual image and the eye's line of sight.
[0010] In some embodiments of the present application, the state of the user's head includes the rotation angle of the user's head. The monitoring component includes an inertial measurement unit. The inertial measurement unit is arranged on the main frame. The inertial measurement unit is used to monitor the rotation angle of the user's head. When the inertial measurement unit detects that the user's head has rotated more than a set angle compared to the initial position of the user's head, the lens holder rotates to change the position of the virtual image within the observation range. When the inertial measurement unit detects that the user's head has not rotated more than a set angle compared to the initial position of the user's head, the lens holder is fixed relative to the main frame to fix the position of the virtual image within the observation range.
[0011] In the above embodiment, the head rotation angle is one of the head states. The inertial measurement unit is mounted on the main frame, which is fixed relative to the head. Therefore, the inertial measurement unit can measure the head's three-axis attitude angle and acceleration, thereby deriving the head rotation angle. When the head rotates, the eyes also rotate accordingly. Therefore, by monitoring the head rotation angle, the eye's line of sight position can be determined. This can be indirectly compared with the observation range to determine the relative position of the eye's line of sight within the observation range. Therefore, when the virtual image and the line of sight do not coincide, the lens angle can be adjusted to move the virtual image to the line of sight. Alternatively, when the virtual image and the line of sight coincide, the lens angle can be maintained fixed to ensure that the virtual image remains aligned with the line of sight.
[0012] In some embodiments of the present application, the head-mounted device further includes an analysis control module and a drive module. The analysis control module and the drive module are arranged on the main frame or the lens holder. The analysis control module is respectively connected to the inertial measurement unit and the drive module in telecommunication. The analysis control module is capable of receiving and analyzing the rotation angle signal of the user's head monitored by the inertial measurement unit. When the analysis control module determines that the rotation angle of the user's head exceeds the set angle, the analysis control module controls the drive module to drive the lens holder to rotate relative to the main frame. When the analysis control module determines that the rotation angle of the user's head does not exceed the set angle, the analysis control module controls the drive module to maintain the lens holder fixed relative to the main frame.
[0013] In the above embodiment, the inertial measurement unit monitors the rotation angle of the head and converts it into a signal that is transmitted to the analysis and control module. The analysis and control module is capable of analyzing the signal and determining the rotation angle of the eyes based on the magnitude of the head rotation angle, thereby obtaining the eye's line of sight position. The module can also determine the position of the line of sight within the observation range to determine whether the eye's line of sight position deviates from the virtual image and the position of the deviation. The analysis and control module then controls the drive module to determine what kind of driving action to perform on the lens holder to rotate or maintain the lens holder fixed, thereby automatically completing the alignment calibration between the virtual image and the eye's line of sight.
[0014] In some embodiments of the present application, the head-mounted device further includes a rotating shaft, through which the lens seat is rotatably connected to the main frame, and the lens seat rotates relative to the main frame to change the angle of the lens relative to the user's eyes.
[0015] In the above embodiment, the lens holder can rotate around the rotation axis and thus rotate relative to the main frame. The lens is fixed relative to the lens holder, and the lens holder drives the lens to rotate relative to the main frame, while the main frame is fixed relative to the eye, thereby achieving the change of the angle of the lens relative to the eye, so as to adjust the position of the virtual image within the observation range so that the virtual image coincides with the line of sight of the eye.
[0016] In some embodiments of the present application, there is one lens holder, and the lens holder is provided with two lenses, which are used to display virtual images to the user's two eyes respectively. When the lens holder rotates, the angles changed by the two lenses and their corresponding eyes are equal.
[0017] In the above embodiment, the rotation direction and angle of the user's two eyes are the same. By using a lens holder to simultaneously drive the movement of the two lenses, the angles between the two lenses and their corresponding eyes change synchronously, and the angles between the two lenses and their corresponding eyes are kept equal. This allows the line of sight of both eyes to coincide with the virtual image at the same time, avoiding a situation where one eye can see the virtual image while the other eye cannot.
[0018] In some embodiments of the present application, the head-mounted device also includes a slide rail and a slider. One of the main frame and the lens seat is provided with a first curved surface, and the other is provided with a slider. The slide rail is arranged along the first curved surface, and the slider is slidably arranged on the slide rail, so that the lens seat slides relative to the main frame to change the angle of the lens relative to the user's eyes.
[0019] In the above embodiment, the lens holder can slide relative to the main frame through the cooperation of the slider and the slide rail. The sliding direction of the lens holder is the extension direction of the slide rail, and the slide rail extends along the first curved surface on the main frame, so that the lens holder can rotate relative to the main frame while sliding, and the position of the lens relative to the lens holder and the position of the main frame relative to the eye is fixed, thereby realizing the change of the angle of the lens relative to the eye, so as to adjust the position of the virtual image within the observation range, so that the virtual image coincides with the line of sight of the eye.
[0020] In some embodiments of the present application, the main frame includes a head ring, which is used to be arranged around the user's head, and the lens seat can rotate relative to the head ring.
[0021] In the above embodiment, the headband is arranged around the head and can be stopped by the head in multiple directions to prevent movement, thereby keeping the headband fixed in position relative to the head. The lens holder rotates relative to the headband, allowing the lens holder to rotate relative to the head, thereby driving the lens to change its angle relative to the eye, so that the virtual image coincides with the eye's line of sight.
[0022] In some embodiments of the present application, the main frame also includes a fixed pad, which is arranged on the head ring. The fixed pad is provided with a second curved surface, and the second curved surface is used to abut against the user's forehead to fix the head ring relative to the user's head. The lens seat is rotatably arranged on the fixed pad.
[0023] In the above-mentioned embodiment, the headband is equipped with a fixed pad. The combined effect of the headband surrounding the head and the second curved surface of the fixed pad resting against the user's forehead enhances the relative stability of the headband, fixed pad, and head. This ensures that when the lens holder rotates relative to the fixed pad, causing the lens to change its angle relative to the eye, the angle between the lens and the eye is not affected by the movement of the headband and fixed pad relative to the head. This ensures that the lens holder can stably change the angle of the lens relative to the eye, ensuring that the virtual image and the eye's line of sight are consistently aligned. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope.
[0025] Figure 1 This is a schematic structural diagram of a head-mounted device in which the monitoring device is an eye tracker and is worn on the head of a user according to an embodiment of the present application;
[0026] Figure 2 for Figure 1 A schematic diagram of the process of the head-mounted device controlling whether the lens rotates;
[0027] Figure 3 This is a schematic structural diagram of a head-mounted device in which the monitoring device is an inertial measurement unit according to an embodiment of the present application and is worn on the head of a user;
[0028] Figure 4 for Figure 3 Schematic diagram of the process of the head-mounted device controlling whether the lens rotates.
[0029] Description of main component symbols:
[0030] Head-mounted device 100
[0031] Main frame 1
[0032] Headband 11
[0033] Fixed pad 12
[0034] First arc surface 121
[0035] The second arc surface 122
[0036] Lens holder 2
[0037] Lens 3
[0038] Virtual Image 31
[0039] Monitoring Item 4
[0040] Eye Tracker41
[0041] Inertial Measurement Unit 42
[0042] Reel 5
[0043] User 200
[0044] Head 201
[0045] Eyes 202
[0046] Observation Range 2021
[0047] Sight 2022 DETAILED DESCRIPTION
[0048] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments.
[0049] In the description of this application, it should be noted that the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, they cannot be understood as limitations on this application.
[0050] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be an intermediate element. When an element is referred to as being "connected to" another element, it may be directly connected to the other element or there may be an intermediate element. When an element is referred to as being "disposed on" another element, it may be directly disposed on the other element or there may be an intermediate element.
[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" as used herein includes any and all combinations of one or more of the relevant listed items.
[0052] An embodiment of the present application provides a head-mounted device. The head-mounted device includes a main frame, a lens holder, a lens, and a monitoring device. The main frame is used to be worn on the user's head. The lens holder is rotatably mounted on the main frame. The lens is mounted on the lens holder. The lens is used to display a virtual image. The virtual image is smaller than the observation range. The observation range is the range that the user's eyes can see by rotating. The monitoring device is mounted on the lens holder. The monitoring device is used to monitor the state of the user's head. According to the state of the user's head monitored by the monitoring device, the lens holder can rotate and drive the lens to move to change the angle of the lens relative to the user's eyes, thereby adjusting the position of the virtual image within the observation range.
[0053] The user's eyes see the virtual image through the lenses, and the range of vision they can see by rotating the eyes is larger than the virtual image. The main frame is fixed relative to the head, and the lens holder can rotate relative to the head by rotating relative to the main frame, driving the movement of the lenses, causing the angle of the lenses relative to the eyes to change, thereby changing the position of the virtual image relative to the eyes. The lenses are positioned between the virtual image and the eyes, so small adjustments to the lenses can cause larger changes in the position of the virtual image. Simultaneously, the monitoring device uses the head status information to determine the relative position of the eyes' line of sight within the observation range and compare it with the relative position of the virtual image within the observation range. The angle of the lenses relative to the eyes is adjusted to quickly achieve overlap between the virtual image and the eyes' line of sight.
[0054] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features of the embodiments may be combined with each other.
[0055] See also Figure 1 and Figure 3One embodiment of the present application provides a head-mounted device 100. The head-mounted device 100 includes a main frame 1, a lens holder 2, a lens 3, and a monitoring component 4. The main frame 1 is used to be worn on the head 201 of the user 200. The lens holder 2 is rotatably mounted on the main frame 1. The lens 3 is mounted on the lens holder 2. The lens 3 is used to display a virtual image 31. The virtual image 31 is smaller than the observation range 2021. The observation range 2021 is the range that the eyes 202 of the user 200 can see by rotating. The monitoring component 4 is mounted on the main frame 1 or the lens holder 2. The monitoring component 4 is used to monitor the state of the head 201 of the user 200. According to the state of the head 201 of the user 200 monitored by the monitoring component 4. The lens holder 2 can rotate and drive the lens 3 to move to change the angle of the lens 3 relative to the eyes 202 of the user 200, thereby adjusting the position of the virtual image 31 within the observation range 2021.
[0056] User 200's eye 202 sees virtual image 31 through lens 3. Eye 202 can rotate to expand its observation range 2021 beyond virtual image 31. The main frame 1 is fixed relative to head 201. The lens holder 2 can rotate relative to the main frame 1, driving the movement of lens 3. This changes the angle of lens 3 relative to eye 202, thereby changing the position of virtual image 31 relative to eye 202. Lens 3 is positioned between virtual image 31 and eye 202, so a small adjustment of lens 3 can significantly change the position of virtual image 31. Simultaneously, based on the status information of head 201 monitored by monitoring element 4, the relative position of eye 202's line of sight 2022 within observation range 2021 is determined and compared with the relative position of virtual image 31 within observation range 2021. The angle of lens 3 relative to eye 202 is adjusted to quickly achieve overlap between virtual image 31 and eye 202's line of sight 2022.
[0057] In some embodiments, the virtual image 31 includes but is not limited to an AR virtual image 31, a VR virtual image 31, and an MR virtual image 31. In some embodiments, the virtual image 31 displayed by the lens 3 is at a fixed angle relative to the lens 3.
[0058] In some embodiments, the eye 202 is able to see an area outside the range of the lens 3 by rotating, and the observation range 2021 is larger than the portion that the eye 202 can see through the lens 3. At the same time, the range that the eye 202 can see through the lens 3 is larger than the virtual image 31. That is, when the eye 202 sees through the lens 3, there is still a portion of the area not covered by the virtual image 31. The lens holder 2 rotates to change the angle of the lens 3 relative to the eye 202, thereby adjusting the position of the virtual image 31 within the observation range 2021. It will be understood that in some embodiments, the eye 202 is able to see an area outside the range of the lens 3 by rotating, and the observation range 2021 is larger than the portion that the eye 202 can see through the lens 3. At the same time, the virtual image 31 can fully cover the portion that the eye 202 can see through the lens 3. Similarly, the lens holder 2 rotates to change the angle of the lens 3 relative to the eye 202, thereby adjusting the position of the virtual image 31 within the observation range 2021.
[0059] See also Figure 1 and Figure 3 In some embodiments, the head-mounted device 100 further includes a rotation axis 5, through which the lens holder 2 is rotatably connected to the main frame 1. The lens holder 2 rotates relative to the main frame 1 to change the angle of the lens 3 relative to the eye 202 of the user 200. The lens holder 2 can rotate about the rotation axis 5, thereby rotating relative to the main frame 1. The lens 3 is fixed relative to the lens holder 2. The lens holder 2 drives the lens 3 to rotate relative to the main frame 1, while the main frame 1 is fixed relative to the eye 202. This allows the angle of the lens 3 relative to the eye 202 to be changed, thereby adjusting the position of the virtual image 31 within the observation range 2021 so that the virtual image 31 coincides with the line of sight 2022 of the eye 202.
[0060] It can be understood that, in some embodiments, the lens holder 2 is fixedly connected to the rotating shaft 5 , the driving module drives the rotating shaft 5 to rotate so as to rotate the lens holder 2 , and the rotating shaft 5 is an electric rotating shaft 5 .
[0061] See also Figure 1 and Figure 2In some embodiments, the state of the head 201 of the user 200 includes the position of the line of sight 2022 of the eye 202 of the user 200. The monitoring component 4 includes an eye tracker 41. The eye tracker 41 is disposed on the lens holder 2. The eye tracker 41 is used to track the position of the line of sight 2022 of the eye 202 of the user 200. When the eye tracker 41 tracks that the line of sight 2022 of the eye 202 of the user 200 falls into a position within the observation range 2021 that is not covered by the virtual image 31, the lens holder 2 rotates to change the position of the virtual image 31 within the observation range 2021. When the eye tracker 41 tracks that the line of sight 2022 of the eye 202 of the user 200 falls into a position within the observation range 2021 that is covered by the virtual image 31, the lens holder 2 is fixed relative to the main frame 1, so that the position of the virtual image 31 within the observation range 2021 is fixed. The position of the line of sight 2022 of the eye 202 is one of the states of the head 201. The eye tracker 41 is disposed on the lens holder 2 and can be oriented toward the eye 202, thereby monitoring the position of the line of sight 2022 of the eye 202. By monitoring the position of the line of sight 2022 of the eye 202, it can be directly compared with the observation range 2021 to determine the relative position of the line of sight 2022 of the eye 202 within the observation range 2021. Therefore, when the positions of the virtual image 31 and the line of sight 2022 do not overlap, the angle of the lens 3 can be adjusted to move the virtual image 31 to the position of the line of sight 2022. Alternatively, when the positions of the virtual image 31 and the line of sight 2022 overlap, the angle of the lens 3 can be maintained fixed so that the virtual image 31 remains aligned with the position of the line of sight 2022. It is understandable that in some embodiments, the eye tracker 41 includes a camera arranged on the lens holder 2 and facing the eye 202. The camera can track the line of sight 2022 of the eye 202 according to changes in the characteristics of the eyeball and the periphery of the eyeball, or track the line of sight 2022 of the eye 202 according to changes in the angle of the iris. It can also actively project infrared light beams or other light beams to the iris to extract features to track the line of sight 2022 of the eye 202.
[0062] See also Figure 1 and Figure 2In some embodiments, the virtual image 31 has an uncovered position between the viewing range 2021 and the lower boundary of the viewing range 2021. After the eye tracker 41 tracks the line of sight 2022 of the user's 202 eye 202 as it deviates downward to a certain angle, it determines that the line of sight 2022 of the user's 202 eye 202 falls within the area below the virtual image 31 within the viewing range 2021. The lens holder 2 rotates so that the lower edge of the lens 3 is closer to the eye 202 than the upper edge, thereby changing the angle of the lens 3 relative to the eye 202 and causing the virtual image 31 to re-align with the line of sight 2022 of the eye 202. Typically, when the user 200 looks close up, especially toward a position slightly downward from the front, the user 200 is more likely to turn their eyes 202 to see the image than to lower their head. Furthermore, when the user 200 looks to the left, right, or up, they are more likely to turn their head to see the image.
[0063] See also Figure 1 and Figure 2 In some embodiments, the head-mounted device 100 further includes an analysis and control module (not shown) and a drive module (not shown). The analysis and control module and the drive module are disposed on the main frame 1 or the lens holder 2. The analysis and control module is electrically connected to the eye tracker 41 and the drive module, respectively. The analysis and control module is capable of receiving and analyzing the position signal of the line of sight 2022 of the user's 200 eye 202 monitored by the eye tracker 41. When the analysis and control module determines that the line of sight 2022 of the user's 200 eye 202 falls within a position not covered by the virtual image 31 within the observation range 2021, the analysis and control module controls the drive module to drive the lens holder 2 to rotate relative to the main frame 1. When the analysis and control module determines that the line of sight 2022 of the user's 200 eye 202 falls within a position covered by the virtual image 31 within the observation range 2021, the analysis and control module controls the drive module to maintain the lens holder 2 fixed relative to the main frame 1. The eye tracker 41 monitors the position of the line of sight 2022 of the eye 202 and converts it into a signal, which is transmitted to the analysis and control module. The analysis and control module analyzes the signal and determines the position of the line of sight 2022 within the observation range 2021. The module then determines whether the line of sight 2022 of the eye 202 deviates from the virtual image 31 and the position of the deviation. The analysis and control module then controls the drive module to determine the driving action to be performed on the lens holder 2, causing the lens holder 2 to rotate or remain stationary, thereby automatically completing the alignment calibration between the virtual image 31 and the line of sight 2022 of the eye 202. It will be appreciated that in some embodiments, the telecommunications connection can be an electrical connection or a signal connection, as long as it can achieve signal transmission.
[0064] In some embodiments, the analysis control module includes but is not limited to a SoC chip.
[0065] See also Figure 3 and Figure 4In some embodiments, the state of the head 201 of the user 200 includes the rotation angle of the head 201 of the user 200. The monitoring component 4 includes an inertial measurement unit 42. The inertial measurement unit 42 is provided on the main frame 1. The inertial measurement unit 42 is used to monitor the rotation angle of the head 201 of the user 200. When the inertial measurement unit 42 detects that the head 201 of the user 200 has rotated more than a set angle compared to the initial position of the head 201 of the user 200, the lens holder 2 rotates to change the position of the virtual image 31 within the observation range 2021. When the inertial measurement unit 42 detects that the head 201 of the user 200 has not rotated more than the set angle compared to the initial position of the head 201 of the user 200, the lens holder 2 is fixed relative to the main frame 1, so that the position of the virtual image 31 within the observation range 2021 is fixed. The rotation angle of the head 201 is one of the states of the head 201. The inertial measurement unit 42 is mounted on the main frame 1, which is fixed relative to the head 201. Therefore, the inertial measurement unit 42 can measure the three-axis attitude angle and acceleration of the head 201, thereby determining the rotation angle of the head 201. When the head 201 rotates, the eyes 202 also rotate accordingly. Therefore, by monitoring the rotation angle of the head 201, the position of the eye 202's line of sight 2022 can be determined. This can be indirectly compared with the observation range 2021 to determine the relative position of the eye 202's line of sight 2022 within the observation range 2021. Therefore, when the virtual image 31 and the line of sight 2022 do not coincide, the angle of the lens 3 can be adjusted to move the virtual image 31 to the position of the line of sight 2022. Alternatively, when the virtual image 31 and the line of sight 2022 coincide, the angle of the lens 3 can be maintained fixed to ensure that the virtual image 31 remains aligned with the line of sight 2022. It can be understood that in some embodiments, the inertial measurement unit 42 is an IMU, which includes three single-axis accelerometers and three single-axis gyroscopes, which measure the angular velocity and acceleration of the head 201 in three-dimensional space and calculate the rotation angle of the head 201 based on this.
[0066] See also Figure 3 and Figure 4In some embodiments, the virtual image 31 has an uncovered position between the observation range 2021 and the lower boundary of the observation range 2021. After the inertial measurement unit 42 detects that the head 201 has rotated downward to a certain angle, it determines that the line of sight 2022 of the user's 200 eye 202 falls within the area below the virtual image 31 within the observation range 2021. The lens holder 2 rotates so that the lower edge of the lens 3 is closer to the eye 202 than the upper edge, thereby changing the angle of the lens 3 relative to the eye 202 and causing the virtual image 31 to re-align with the line of sight 2022 of the eye 202. Typically, when the user 200 looks to the left, right, up, or down, the rotation of the head 201 and the rotation of the eye 202 are combined to allow the user to look at the target location. For example, when the user lowers his head and looks at the ground, his eyes 202 will tilt downward by about 15°. The lens holder 2 drives the lens 3 to move so that the virtual image 31 moves downward to eliminate the downward tilt deviation of the eyes 202 of about 15° when lowering the head; when the user 200 looks straight ahead, his eyes 202 will tilt downward by about 5°. The lens holder 2 drives the lens 3 to move so that the virtual image 31 moves downward to eliminate the downward tilt deviation of the eyes 202 of about 5° when looking straight ahead.
[0067] See also Figure 3 and Figure 4 In some embodiments, the analysis and control module is electrically connected to the inertial measurement unit 42 and the drive module, respectively. The analysis and control module is capable of receiving and analyzing the rotation angle signal of the user's 200 head 201 monitored by the inertial measurement unit 42. When the analysis and control module determines that the rotation angle of the user's 200 head 201 exceeds a set angle, the analysis and control module controls the drive module to rotate the lens holder 2 relative to the main frame 1. When the analysis and control module determines that the rotation angle of the user's 200 head 201 does not exceed the set angle, the analysis and control module controls the drive module to maintain the lens holder 2 fixed relative to the main frame 1. The inertial measurement unit 42 monitors the rotation angle of the head 201 and converts it into a signal to be transmitted to the analysis and control module. The analysis and control module can analyze the signal and analyze the rotation angle of the eye 202 based on the size of the rotation angle of the head 201, thereby obtaining the position of the line of sight 2022 of the eye 202, and can determine the position of the line of sight 2022 within the observation range 2021 to determine whether the position of the line of sight 2022 of the eye 202 deviates from the virtual image 31 and the position of the deviation. The analysis and control module then controls the drive module to perform what kind of driving action on the lens holder 2 to rotate the lens holder 2 or keep it fixed, thereby automatically completing the overlap calibration of the virtual image 31 and the line of sight 2022 of the eye 202.
[0068] It is understandable that, in other embodiments, the state of the head 201 also includes sounds heard by the ears, etc. After the ears hear the sound, the user 200 will look towards the location where the sound is generated, causing the eyes 202 to rotate, thereby rotating the lens holder 2 and driving the lens 3 to change the angle relative to the user's 200 eyes 202, thereby adjusting the position of the virtual image 31 within the observation range 2021.
[0069] See also Figure 1 and Figure 3 In some embodiments, there is one lens holder 2, which is equipped with two lenses 3. Each lens 3 is used to display a virtual image 31 to each eye 202 of the user 200. When the lens holder 2 rotates, the angles changed by the two lenses 3 relative to their respective eyes 202 are equal. The user's 202 eyes 202 rotate in the same direction and at the same angle. By simultaneously driving the movement of both lenses 3, the angles between the two lenses 3 and their respective eyes 202 change synchronously, maintaining the same angles between the two lenses 3 and their respective eyes 202. This allows the line of sight 2022 of both eyes 202 to coincide with the virtual image 31, preventing one eye 202 from seeing the virtual image 31 while the other eye 202 cannot. In some embodiments, when the user 200 is standing upright and wearing the head-mounted device 100, the rotation axis 5 is vertically higher than the eyes 202 and lenses 3.
[0070] In some embodiments, the head-mounted device 100 further includes a slide rail (not shown) and a slider (not shown). One of the main frame 1 and the lens holder 2 is provided with a first curved surface 121, and the other is provided with a slider. The slide rail is disposed along the first curved surface 121, and the slider is slidably disposed on the slide rail, allowing the lens holder 2 to slide relative to the main frame 1 to change the angle of the lens 3 relative to the eye 202 of the user 200. The cooperation between the slider and the slide rail enables the lens holder 2 to slide relative to the main frame 1. The sliding direction of the lens holder 2 is the extension direction of the slide rail, which extends along the first curved surface 121 on the main frame 1. This allows the lens holder 2 to rotate relative to the main frame 1 while sliding, while the lens 3 is fixed relative to the lens holder 2 and the main frame 1 is fixed relative to the eye 202. This allows the angle of the lens 3 relative to the eye 202 to be changed, thereby adjusting the position of the virtual image 31 within the observation range 2021 so that the virtual image 31 coincides with the line of sight 2022 of the eye 202.
[0071] See also Figure 1 and Figure 3In some embodiments, the main frame 1 includes a headband 11, which is configured to be mounted on the head 201 of the user 200, and the lens holder 2 is capable of rotating relative to the headband 11. The headband 11 is mounted on the head 201 and can be stopped by the head 201 in multiple directions to prevent movement, thereby maintaining a fixed position of the headband 11 relative to the head 201. The lens holder 2 rotates relative to the headband 11, thereby causing the lens holder 2 to rotate relative to the head 201, thereby driving the lens 3 to change its angle relative to the eye 202, so that the virtual image 31 coincides with the line of sight 2022 of the eye 202.
[0072] See also Figure 1 and Figure 3 In some embodiments, the main frame 1 further includes a fixing pad 12, which is mounted on the headband 11 and has a second curved surface 122. The second curved surface 122 is designed to contact the forehead of the user 200 to secure the headband 11 relative to the head 201 of the user 200. The lens holder 2 is rotatably mounted on the fixing pad 12. The headband 11 is provided with the fixing pad 12. The combined effect of the headband 11 being mounted on the head 201 and the second curved surface 122 of the fixing pad 12 contacting the forehead of the user 200 enhances the relative stability of the headband 11, the fixing pad 12, and the head 201. This ensures that when the lens holder 2 rotates relative to the fixing pad 12, causing the lens 3 to change its angle relative to the eye 202, the angle between the lens 3 and the eye 202 is not affected by the movement of the headband 11 and the fixing pad 12 relative to the head 201. This ensures that the lens holder 2 can stably change the angle of the lens 3 relative to the eye 202, thereby ensuring that the virtual image 31 and the line of sight 2022 of the eye 202 are stably aligned.
[0073] In the present application, user 200's eye 202 sees a virtual image 31 through lens 3. Eye 202 can rotate to expand its observation range 2021 beyond the virtual image 31. The main frame 1 is fixed relative to the head 201. The lens holder 2 can rotate relative to the main frame 1, driving the lens 3 to move. This changes the angle of the lens 3 relative to the eye 202, thereby changing the position of the virtual image 31 relative to the eye 202. The lens 3 is positioned between the virtual image 31 and the eye 202, so a small adjustment of the lens 3 can significantly change the position of the virtual image 31. Simultaneously, based on the status information of the head 201 monitored by the monitoring element 4, the relative position of the eye 202's line of sight 2022 within the observation range 2021 is determined and compared with the relative position of the virtual image 31 within the observation range 2021. The angle of the lens 3 relative to the eye 202 is adjusted to quickly achieve overlap between the virtual image 31 and the eye 202's line of sight 2022.
[0074] The above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit the present application. Although the present application has been described in detail with reference to the above preferred embodiments, those skilled in the art should understand that modifications or equivalent replacements of the technical solutions of the present application should not depart from the spirit and scope of the technical solutions of the present application.
[0075] The information disclosed in the background technology section of this application is only intended to increase the understanding of the overall background of this application, and should not be regarded as an admission or any form of suggestion that the information constitutes the prior art already known to a person skilled in the art.
Claims
1. A head-mounted device, characterized in that: include: A main frame, adapted to be worn on the user's head; A lens holder is rotatably mounted on the main frame; a lens disposed on the lens holder, the lens being used to display a virtual image, the virtual image being smaller than an observation range, the observation range being a range that can be seen by the user's eyes by rotating; A monitoring component, provided on the main frame or the lens holder, and configured to monitor the status of the user's head; According to the state of the user's head monitored by the monitoring component, the lens holder can rotate and drive the lens to move, so as to change the angle of the lens relative to the user's eyes, thereby adjusting the position of the virtual image within the observation range; The state of the user's head includes a rotation angle of the user's head, and the monitoring component includes an inertial measurement unit, which is provided on the main frame and is used to monitor the rotation angle of the user's head; When the inertial measurement unit detects that the user's head has rotated more than a set angle compared to an initial position of the user's head, the lens holder rotates to change the position of the virtual image within the observation range; When the inertial measurement unit detects that the rotation of the user's head relative to the initial position of the user's head does not exceed the set angle, the lens holder is fixed relative to the main frame, so that the position of the virtual image within the observation range is fixed.
2. The head-mounted device according to claim 1, wherein: The state of the user's head includes the sight line position of the user's eyes, and the monitoring component includes an eye tracker, which is arranged on the lens holder and is used to track the sight line position of the user's eyes; When the eye tracker tracks that the sight line of the user's eyes falls into a position within the observation range that is not covered by the virtual image, the lens holder rotates to change the position of the virtual image within the observation range; When the eye tracker tracks the sight of the user's eyes falling into the position covered by the virtual image within the observation range, the lens holder is fixed relative to the main frame to fix the position of the virtual image within the observation range.
3. The head-mounted device according to claim 2, wherein: The head-mounted device further includes an analysis and control module and a drive module, wherein the analysis and control module and the drive module are disposed on the main frame or the lens holder, and the analysis and control module are respectively connected to the eye tracker and the drive module in telecommunication mode, and the analysis and control module is capable of receiving and analyzing the gaze position signal of the user's eye monitored by the eye tracker. When the analysis and control module determines that the user's line of sight falls into a position within the observation range that is not covered by the virtual image, the analysis and control module controls the driving module to drive the lens holder to rotate relative to the main frame; When the analysis and control module determines that the sight line of the user's eyes falls into the position covered by the virtual image within the observation range, the analysis and control module controls the driving module to keep the lens holder fixed relative to the main frame.
4. The head-mounted device according to claim 1, wherein: The head-mounted device further includes an analysis and control module and a drive module, wherein the analysis and control module and the drive module are arranged on the main frame or the lens holder, and the analysis and control module is respectively connected to the inertial measurement unit and the drive module in telecommunication, and the analysis and control module is capable of receiving and analyzing the rotation angle signal of the user's head monitored by the inertial measurement unit. When the analysis and control module determines that the rotation angle of the user's head exceeds the set angle, the analysis and control module controls the driving module to drive the lens holder to rotate relative to the main frame; When the analysis and control module determines that the rotation angle of the user's head does not exceed the set angle, the analysis and control module controls the driving module to maintain the lens holder fixed relative to the main frame.
5. The head mounted device according to any one of claims 1 to 4, wherein: The head-mounted device also includes a rotating shaft, and the lens seat is rotatably connected to the main frame via the rotating shaft. The lens seat rotates relative to the main frame to change the angle of the lens relative to the user's eyes.
6. The head-mounted device according to claim 5, wherein: There is one lens seat, and the lens seat is provided with two lenses. The two lenses are used to display the virtual image to the two eyes of the user respectively. When the lens seat rotates, the angles changed by the two lenses and their corresponding eyes of the user are equal.
7. The head mounted device according to any one of claims 1 to 4, characterized in that: The head-mounted device also includes a slide rail and a slider. One of the main frame and the lens holder is provided with a first curved surface, and the other is provided with the slider. The slide rail is arranged along the first curved surface, and the slider is slidably arranged on the slide rail, so that the lens holder slides relative to the main frame to change the angle of the lens relative to the user's eyes.
8. The head mounted device according to any one of claims 1 to 4, wherein: The main frame includes a head ring, which is used to be arranged around the head of the user, and the lens seat can rotate relative to the head ring.
9. The head-mounted device according to claim 8, wherein: The main frame also includes a fixing pad, which is arranged on the head ring. The fixing pad is provided with a second curved surface, and the second curved surface is used to abut against the user's forehead to fix the head ring relative to the user's head. The lens seat is rotatably arranged on the fixing pad.
Citation Information
Patent Citations
Systems and methods for automatic adjustment for vertical and rotational imbalance in augmented and virtual reality head-mounted displays
US20190349576A1
Head mounted display device with automated positioning
US9094677B1