Head-mounted display device, control method thereof, and computer readable storage medium
By adjusting the position of the display screen and lens part in the virtual reality head-mounted display device, the focus of the line of sight is on the image surface of the virtual image, the dizziness caused by the collision is solved by using eye tracking technology, and the comfort of the user experience is improved.
Patent Information
- Application Number
- CN202310551540.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-22
AI Technical Summary
In virtual reality head-mounted display devices, the problem of convergence and user dizziness is difficult to effectively alleviate the existing technology.
By adjusting the relative positions of the display screen and the lens part, the focal point of the line of sight is located at the image surface position of the virtual image, the eye tracker is used to determine the line of sight direction and line of sight of the user's eyes, and the position of the display screen and the lens part is adjusted accordingly to improve the radiation conflict.
It effectively alleviates the dizziness of users when using head-mounted display devices and improves the comfort of the virtual reality experience.
Smart Images

Figure CN119002048A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a head mounted display device, a control method thereof, and a computer readable storage medium. Background Art
[0002] As Virtual Reality (VR) display technology displays two-dimensional images of the same object from different angles in front of the user's eyes and uses parallax to form a three-dimensional visual effect, VR technology is gradually being integrated into people's daily lives. Summary of the invention
[0003] The embodiment of the present disclosure provides a head-mounted display device and a control method thereof, and a computer-readable storage medium. The control method of the head-mounted display device provided by the present disclosure can improve the convergence conflict by adjusting the relative position of the display screen and the lens part so that the line of sight is located at the image plane position of the virtual image, which is conducive to alleviating the dizziness generated by the user when using the head-mounted display device.
[0004] An embodiment of the present disclosure provides a control method for a head-mounted display device, wherein the head-mounted display device includes a display screen and a lens portion. The control method for the head-mounted display device includes: determining a line of sight direction of both eyes of a user; determining a line of sight focus of both eyes according to the line of sight direction of the both eyes; and adjusting positions of the display screen and the lens portion according to the line of sight focus so that the line of sight focus is located at an image plane position of a virtual image formed by an image displayed on the display screen through the lens portion.
[0005] For example, according to an embodiment of the present disclosure, adjusting the position of the display screen and the lens portion according to the line of sight focus includes: adjusting the position of the display screen and the lens portion relative to the eyeballs of both eyes according to the line of sight focus, and / or adjusting the relative position of the display screen and the lens portion.
[0006] For example, according to an embodiment of the present disclosure, the head-mounted display device includes two display components, the two display components correspond to binocular eyeballs respectively, and each display component includes at least one display screen and at least one lens portion, the at least one lens portion is located on the light emitting side of the at least one display screen; adjusting the position of the display screen and the lens portion according to the line of sight focus includes adjusting the position of the display screen and the lens portion relative to the binocular eyeballs according to the line of sight focus, which includes: driving at least one display component to move in a plane to adjust the position of the at least one display component relative to the corresponding eyeball, the plane being a plane perpendicular to the optical axis of the lens portion.
[0007] For example, according to an embodiment of the present disclosure, adjusting the position of the display screen and the lens portion relative to the eyeballs of the binoculars includes: when a straight line passing through the line of sight and parallel to the direction of the optical axis passes through the area between the two display components, driving the two display components to move symmetrically within the plane relative to the midpoint of the line connecting the eyeballs of the binoculars.
[0008] For example, according to an embodiment of the present disclosure, adjusting the positions of the display screen and the lens portion relative to the eyeballs of the binoculars includes: when a straight line passing through the line of sight and parallel to the direction of the optical axis passes through a display component, driving the two display components to perform asymmetric movement in the plane relative to the midpoint of the line connecting the eyeballs of the binoculars.
[0009] For example, according to an embodiment of the present disclosure, the head-mounted display device includes two display components, the two display components correspond to eyeballs of both eyes respectively, and each display component includes at least one display screen and at least one lens portion, and the at least one lens portion is located on the light emitting side of the at least one display screen; adjusting the position of the display screen and the lens portion according to the line of sight focus includes adjusting the relative position of the display screen and the lens portion, which includes: driving at least one of the display screen and the lens portion in at least one display component to move in a direction parallel to the optical axis of the lens portion to adjust the distance between the display screen and the lens portion.
[0010] For example, according to an embodiment of the present disclosure, adjusting the relative position of the display screen and the lens portion includes: when a straight line passing through the line of sight and parallel to the direction of the optical axis passes through the area between the two display components, driving the same type of structure in the two display components to move the same distance in a direction parallel to the optical axis of the lens portion, the structure including at least one of the display screen and the lens portion.
[0011] For example, according to an embodiment of the present disclosure, adjusting the relative position of the display screen and the lens portion includes: when a straight line passing through the line of sight and parallel to the direction of the optical axis passes through a display component, driving the same type of structure in the two display components to move different distances along a direction parallel to the optical axis of the lens portion, and the structure includes at least one of the display screen and the lens portion; or only driving at least one of the display screen and the lens portion in one display component to move along a direction parallel to the optical axis of the lens portion.
[0012] For example, according to an embodiment of the present disclosure, the movement time for adjusting the position of the display screen and the lens portion is within 100 milliseconds after the user's eyes blink or saccade.
[0013] For example, according to an embodiment of the present disclosure, after adjusting the sight focus to be located at the image plane position of the virtual image, the control method further includes: adjusting the display content in the display screen to optimize the aberration of the virtual image.
[0014] The disclosed embodiment provides a head-mounted display device, comprising: a housing; two display components located in the housing, wherein the two display components correspond to the user's eyeballs, respectively, and each display component comprises at least one display screen and at least one lens portion, wherein the at least one lens portion is located on the light-emitting side of the at least one display screen; an eye tracker located in the housing, wherein the eye tracker is configured to determine the sight direction of the user's eyes, and determine the sight focus of the eyes according to the sight direction of the user's eyes; a controller located in the housing, wherein the controller is electrically connected to the two display components and the eye tracker. The two display components are configured to be movable relative to the housing, and the controller is configured to adjust the positions of the display screen and the lens portion according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens portion.
[0015] For example, according to an embodiment of the present disclosure, the controller is configured to adjust the positions of the display screen and the lens portion relative to the eyeballs of the binoculars according to the line of sight focus, and / or adjust the relative position of the display screen and the lens portion.
[0016] For example, according to an embodiment of the present disclosure, at least one display component is configured to move within a plane to adjust the position of the at least one display component relative to the corresponding eyeball, and the plane is a plane perpendicular to the optical axis of the lens portion.
[0017] For example, according to an embodiment of the present disclosure, the two display components are configured to perform symmetrical or asymmetrical movement relative to the midpoint of the line connecting the eyeballs of both eyes within the plane according to the position of the visual focus.
[0018] For example, according to an embodiment of the present disclosure, at least one of the display screen and the lens portion in at least one display assembly is configured to move in a direction parallel to the optical axis of the lens portion to adjust the distance between the display screen and the lens portion.
[0019] For example, according to an embodiment of the present disclosure, the same type of structure in the two display components is configured to move the same or different distances in a direction parallel to the optical axis of the lens portion according to the position of the line of sight focus, and the structure includes at least one of the display screen and the lens portion; or at least one of the display screen and the lens portion in only one of the two display components is configured to move in a direction parallel to the optical axis of the lens portion.
[0020] The embodiment of the present disclosure provides a head-mounted display device, comprising a display screen; a lens portion, located on the light-emitting side of the display screen; a processor; and a memory, comprising one or more computer program modules. The one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for executing any of the above control methods.
[0021] An embodiment of the present disclosure provides a computer-readable storage medium having executable codes stored thereon. When the executable codes are executed by a processor, the processor executes any of the above control methods. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, but are not intended to limit the present disclosure.
[0023] Figure 1 Schematic diagram of binocular eyeballs viewing a virtual image without convergence conflict.
[0024] Figure 2 Schematic diagram of the convergence conflict that occurs when the two eyes view a virtual image.
[0025] Figure 3 A control method for a head mounted display device is provided according to an embodiment of the present disclosure.
[0026] Figure 4 A schematic diagram of the partial structure of a head-mounted display device provided according to an embodiment of the present disclosure.
[0027] Figure 5 and Figure 6 Schematic diagram of adjusting the position of the virtual image using a single eye as an example.
[0028] Figure 7 and Figure 8 Schematic diagram of adjusting the positions of a display screen and a lens portion relative to an eyeball to adjust the image plane of a virtual image according to different examples of an embodiment of the present disclosure.
[0029] Fig. 9 and Fig.10 Schematic diagram of adjusting the positions of a display screen and a lens portion relative to an eyeball to adjust the image plane of a virtual image according to different examples of an embodiment of the present disclosure.
[0030] Fig.11 is a schematic block diagram of a head mounted display device according to at least one embodiment of the present disclosure.
[0031] Fig.12is a schematic block diagram of a computer-readable storage medium according to at least one embodiment of the present disclosure. DETAILED DESCRIPTION
[0032] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0033] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The words "first", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. The words "include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects.
[0034] During the study, the inventors of the present application found that virtual reality (VR) motion sickness is one of the factors that affect the popularity of VR devices in people's lives and work, and among the causes of VR sickness, convergence conflict (VAC) is one of the main reasons.
[0035] Figure 1 Schematic diagram of binocular eyeballs viewing a virtual image without convergence conflict. Figure 2 Schematic diagram of the convergence conflict that occurs when the two eyes view a virtual image.
[0036] like Figure 1 and Figure 2 As shown, the head mounted display device includes a lens 11 and a display screen 12. The eyes 10 observe the virtual image plane 13 formed by the display screen 12 through the lens 11. For example, the distance between the intersection of the eyes 10 and the virtual image plane 13 can be VID. Figure 1 As shown, when the sight focus of the two eyes 10 is located at the intersection of the two virtual image planes 13, there is no convergence conflict, and the image viewed by the user in the head-mounted display device is the same as the scene viewed in real life, which is not easy to cause dizziness. Figure 2 As shown, when the sight focus 14 of the two eyes 10 is not located at the intersection of the two virtual image planes 13, a convergence conflict will occur, which may easily cause the user to feel dizzy.
[0037] Embodiments of the present disclosure provide a head-mounted display device, a control method thereof, and a computer-readable storage medium.
[0038] The head-mounted display device provided by the embodiment of the present disclosure includes a display screen and a lens portion. The control method of the head-mounted display device includes: determining the line of sight direction of the user's eyes; determining the line of sight focus of the eyes according to the line of sight direction of the eyes; adjusting the position of the display screen and the lens portion according to the line of sight focus, so that the line of sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens portion.
[0039] The control method of the head-mounted display device provided by the present disclosure can improve the convergence conflict by adjusting the relative positions of the display screen and the lens part so that the line of sight is located at the image plane position of the virtual image, which is helpful to alleviate the dizziness caused by the user when using the head-mounted display device.
[0040] The head-mounted display device provided by the embodiment of the present disclosure includes: a shell, two display components located in the shell, an eye tracker and a controller, the two display components correspond to the user's eyeballs respectively, and each display component includes at least one display screen and at least one lens part, at least one lens part is located on the light-emitting side of at least one display screen; the eye tracker is configured to determine the sight direction of the user's eyes, and determine the sight focus of the eyes according to the sight direction of the eyes; the controller is electrically connected to the two display components and the eye tracker. The two display components are configured to be movable relative to the shell, and the controller is configured to adjust the position of the display screen and the lens part according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens part.
[0041] The head-mounted display device provided by the present disclosure, by setting a display component that is movable relative to the shell, can adjust the positions of the display screen and the lens portion relative to the eyeballs of both eyes according to the line of sight focus, and / or adjust the relative position of the display screen and the lens portion, so that the line of sight focus is located at the intersection of two virtual image surfaces formed by the two display components, which can improve convergence conflict and help alleviate the dizziness caused by the user when using the head-mounted display device.
[0042] The head mounted display device and its control method, and computer readable storage medium provided by the embodiments of the present disclosure are described below in conjunction with the accompanying drawings.
[0043] Figure 3 A control method for a head mounted display device according to an embodiment of the present disclosure is provided. Figure 3As shown, a head-mounted display device using the control method provided by the present invention includes a display screen and a lens portion, and the control method includes the following steps, S01: determining the sight direction of the user's eyes; S02: determining the sight focus of the eyes according to the sight direction of the eyes; and S03: adjusting the positions of the display screen and the lens portion according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens portion.
[0044] The control method of the head-mounted display device provided by the present disclosure can improve the convergence conflict by adjusting the positions of the display screen and the lens part relative to the eyeballs of both eyes, and / or adjusting the relative positions of the display screen and the lens part so that the line of sight is located at the image plane position of the virtual image, which is conducive to alleviating the dizziness caused by the user when using the head-mounted display device.
[0045] Figure 4 FIG. 1 is a schematic diagram of a partial structure of a head mounted display device provided according to an embodiment of the present disclosure. Figure 4 As shown, the head mounted display device includes a housing 100, two display components 200 located in the housing 100, an eye tracker 300 and a controller 400. The two display components 200 correspond to the user's eyeballs, respectively, and each display component 200 includes at least one display screen 210 and at least one lens portion 220, and at least one lens portion 220 is located on the light emitting side of at least one display screen 210; the eye tracker 300 is configured to determine the sight direction of the user's eyes, and determine the sight focus of the eyes according to the sight direction of the eyes; the controller 400 is electrically connected to the two display components 200 and the eye tracker 300. The two display components 200 are configured to be movable relative to the housing 100, and the controller 400 is configured to adjust the relative positions of the display screen 210 and the lens portion 220 according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen 210 through the lens portion 220.
[0046] For example, the head mounted display device provided in the embodiment of the present disclosure can be used for application Figure 3 A head mounted display device with a control method as shown.
[0047] For the optical design in the head mounted display device, moving the lens portion relative to the user's eyeball or changing the distance between the display screen and the lens portion will cause the image plane of the virtual image, i.e., the virtual image plane (VIP), to change.
[0048] The head-mounted display device provided by the present disclosure, by setting a display component that is movable relative to the shell, can adjust the positions of the display screen and the lens portion relative to the eyeballs of both eyes according to the line of sight focus, and / or adjust the relative position of the display screen and the lens portion, so that the line of sight focus is located at the intersection of two virtual image surfaces formed by the two display components, which can improve convergence conflict and help alleviate the dizziness caused by the user when using the head-mounted display device.
[0049] For example, Figure 3 and Figure 4 As shown, in step S01, the sight direction of the user's eyes may be determined using an eye tracker 300. For example, the eye tracker 300 may be used to track the positions of the user's eyes.
[0050] For example, Figure 3 and Figure 4 As shown, in step S02, the eye tracker 300 may be used to determine the sight focus of the two eyes according to the sight direction of the two eyes. For example, the eye tracker 300 may be used to calculate the sight focus of the two eyes according to the positions of the eyeballs of the two eyes.
[0051] The control method and head-mounted display device provided in the embodiments of the present disclosure apply eye tracking technology.
[0052] For example, Figure 4 As shown, the head-mounted display device includes a near-eye display device, which may be a wearable virtual reality (VR) helmet, VR glasses, etc., but the embodiments of the present disclosure are not limited thereto.
[0053] For example, Figure 4 As shown, the eye tracker 300 may include a portion located between the eye and the display assembly 200 to track the eye.
[0054] For example, the eye tracker 300 may use a gaze tracking technology, such as a 2D gaze tracking technology or a 3D gaze tracking technology. For example, the 2D tracking technology is represented by the pupil-corneal reflection method, which uses a vector composed of the pupil center and the corneal bright spot to represent the gaze direction; the 3D tracking technology uses dual cameras or multiple cameras to obtain the coordinates of each reference point in the 3D space for gaze tracking.
[0055] For example, the eye tracker 300 may include an image acquisition unit and an image processing unit. For example, in one example of the present disclosure, the image acquisition unit is configured to acquire binocular iris images, and the image processing unit is configured to process the acquired iris images to establish a 3D model of the binocular irises, and locate the sight focus of the binoculars according to the 3D model. For example, in another example of the present disclosure, the image acquisition unit is configured to acquire light spots formed by red light reflected by the user's eyes, and the image processing unit is configured to perform sight estimation on the light spots in the acquired infrared image to determine the sight focus. For example, in yet another example of the present disclosure, the image acquisition unit is configured to acquire infrared light reflected by binocular eyeballs to form an eye image, and the image processing unit acquires the eye image and preset eye parameter information to determine the sight focus information of the binoculars.
[0056] For example, the image acquisition unit may include a camera, and the camera may be a color camera or an infrared camera. For example, the eye tracker 300 may include multiple cameras to illuminate the eyeballs of both eyes from different angles. For example, the image processing unit may use a high-speed computing module such as a digital signal processing (DSP) or a field programmable gate array (FPGA) for image processing.
[0057] For example, Figure 3 and Figure 4 As shown, the eye tracker 300 transmits the above-mentioned sight focus information to the controller 400.
[0058] For example, Figure 3 and Figure 4 As shown, in step S03, when the sight focus of the user's eyes is as shown in Figure 2 When the display screen 210 is located outside the image plane 13 of the virtual image formed by the lens unit 220, the controller 400 is configured to adjust the positions of the display screen 210 and the lens unit 220 according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen 210 through the lens unit 220. For example, the controller 400 is configured to adjust the positions of the display screen 210 and the lens unit 220 relative to the eyeballs of both eyes, and / or adjust the relative positions of the display screen 210 and the lens unit 220 according to the sight focus, so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen 210 through the lens unit 220.
[0059] For example, the head-mounted display device may also include structures such as linear motors and piezoelectric ceramics. The controller drives at least one of the display screen and the light-transmitting portion to move relative to the eyeball by controlling the linear motors and piezoelectric ceramics.
[0060] For example, the controller may refer to a control function implemented by hardware, that is, without considering the cost, those skilled in the art can build a corresponding hardware circuit to implement the control function. For example, the hardware circuit includes a conventional very large scale integration (VLSI) circuit or gate array and existing semiconductors such as logic chips, transistors, or other discrete components. For example, the controller can also be implemented with a programmable hardware device, such as a field programmable gate array, a programmable array logic, a programmable logic device, etc., which is not limited in this embodiment.
[0061] For example, the controller may also refer to a control function implemented by a software algorithm so as to be executed by various types of processors. For example, considering the level of existing hardware technology, the controller may be a module implemented by a software algorithm.
[0062] In some examples, such as Figure 4 As shown, the head-mounted display device includes two display components 200, the two display components 200 correspond to the eyeballs of both eyes respectively, and each display component 200 includes at least one display screen 210 and at least one lens portion 220, and the at least one lens portion 220 is located on the light emitting side of at least one display screen 210. Figure 4 It is schematically shown that each display component includes a display screen and a lens portion corresponding to the display screen, but is not limited thereto. Each display component may also include two or more display screens, and one or more lens portions may be provided on the light emitting side of each display screen.
[0063] For example, Figure 4 As shown, the lens portion 220 may include one or more lenses. For example, when the lens portion 220 includes multiple lenses, the multiple lenses may include a combination of at least one convex lens and at least one concave lens.
[0064] For example, Figure 4 As shown, the display screen 210 may be a micro display screen (for example, the diagonal size of the micro display screen is usually 0.39 inches, 2.1 inches, or 2.54 inches), or a large-size display screen, which is not limited in this embodiment. For example, the display screen 210 may be any type of display screen, such as a liquid crystal display screen, an organic light emitting diode display screen, an inorganic light emitting diode display screen, a quantum dot display screen, a projector (for example, an LCOS micro projector), etc.
[0065] Figure 5 and Figure 6 Schematic diagram of adjusting the position of the virtual image using a single eye as an example.
[0066] For example, Figure 5As shown, one eyeball 010 corresponds to one display assembly 200, and the position of the image plane 030 of the virtual image can be adjusted by moving the display assembly 200 in a plane perpendicular to the Y direction. For example, the optical axis of the lens portion 220 can extend along the Y direction.
[0067] For example, Figure 4 and Figure 5 As shown, the display assembly 200 moves relative to the housing 100 in a plane perpendicular to the Y direction. For example, the housing 100 may include a head-mounted device housing such as a helmet or glasses. For example, the housing 100 does not move relative to the position of the eyeball 010, and the display assembly 200 moves relative to the position of the eyeball 010.
[0068] For example, Figure 6 As shown, one eyeball 010 corresponds to one display assembly 200, and the position of the image plane 030 of the virtual image can be adjusted by adjusting the relative position between the display screen 210 and the lens portion 220 in the display assembly 200. For example, at least one of the display screen 210 and the lens portion 220 can be moved along the Y direction to adjust the distance between the display screen 210 and the lens portion 220, thereby adjusting the position of the image plane 030 of the virtual image.
[0069] For example, Figure 4 and Figure 6 As shown, at least one of the display screen 210 and the lens portion 220 moves along the Y direction relative to the housing 100. For example, the lens portion 220 moves along the Y direction relative to the housing 100.
[0070] Figure 7 and Figure 8 Schematic diagram of adjusting the positions of a display screen and a lens portion relative to an eyeball to adjust the image plane of a virtual image according to different examples of an embodiment of the present disclosure.
[0071] In some examples, such as Figure 3-4 as well as Figure 7 As shown, the control method for adjusting the position of the display screen 210 and the lens part 220 relative to the binocular eyeballs 011 and 012 includes: driving at least one display component 200 to move in a plane to adjust the position of at least one display component 200 relative to the corresponding eyeball, and the plane is a plane perpendicular to the optical axis of the lens part 220, such as a plane perpendicular to the Y direction. In the head-mounted display device using the above control method, at least one display component 200 is configured to move in a plane to adjust the position of at least one display component 200 relative to the corresponding eyeball, and the plane is a plane perpendicular to the optical axis of the lens part.
[0072] like Figure 4 and Figure 7As shown, the controller 400 can drive at least one display component 200 to move in a plane perpendicular to the optical axis of the lens portion 220 according to the line of sight focus information of the eye tracker 300 to adjust the position of at least one display component 200 relative to the corresponding eyeball, and can adjust the intersection of the image planes 031 and 032 of the two virtual images displayed by the two display components 200 to the line of sight focus 040 position of the binocular eyeballs 011 and 012 to improve the convergence conflict, which is helpful to solve the dizziness problem.
[0073] For example, Figure 7 The display assembly 200 is schematically shown to move along the X direction, but is not limited thereto. The display assembly may also move along other directions within a plane perpendicular to the Y direction.
[0074] For example, Figure 7 As shown, the controller can adjust the two display components 200 to move simultaneously in the above plane to simultaneously adjust the image planes 031 and 032 of the two virtual images, and adjust the intersection of the two image planes to the position of the visual focus 040 of the eyeballs 011 and 012 of the binocular eyes.
[0075] For example, when the user's eyesight focus 14 is Figure 2 When the display screen 210 is located outside the image plane 13 of the virtual image formed by the lens portion 220, the controller 400 is configured to adjust the display assembly 200 to move in a plane perpendicular to the optical axis of the lens portion 220 according to the line of sight focus to adjust the image planes 031 and 032 of the virtual image, so as to achieve the following Figure 7 As shown, the sight focus 040 is located at the image plane position of the virtual image formed by the image displayed on the display screen 210 through the lens portion 220, such as the intersection position of the image planes 031 and 032 of the virtual image, so that the refractive power of each eyeball is adapted to the convergence point to improve the convergence conflict, which is beneficial to solve the dizziness problem and achieve the best display effect.
[0076] In some examples, such as Figure 7 As shown, the control method for adjusting the position of the display screen 210 and the lens unit 220 relative to the binocular eyeballs 011 and 012 includes: when a straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through the area between the two display components 200, the two display components 200 are driven to move symmetrically in the plane relative to the midpoint of the line connecting the binocular eyeballs 011 and 012. Figure 7 As shown, in the head-mounted display device applying the above control method, the two display components 200 are configured to move symmetrically in a plane relative to the midpoint of the line connecting the binocular eyeballs 011 and 012 according to the position of the visual focus 040, so as to achieve the best display effect when the binocular eyeballs are in a normal viewing state.
[0077] For example, Figure 7As shown, the two display assemblies 200 can both move toward the direction close to the straight line 041, or both move away from the straight line 041, or both move upward, or both move downward. Here, "upward" and "downward" refer to two opposite directions perpendicular to the paper surface.
[0078] For example, Figure 7 As shown, the two display assemblies 200 can move the same distance. For example, during the movement of the two display assemblies 200, the distance between the center of each display assembly 200 and the corresponding eyeball is approximately equal.
[0079] For example, Figure 7 As shown, the midpoint of the line connecting the centers of the two display components 200 is the first midpoint, and the midpoint of the line connecting the eyeballs 011 and 012 of the user is the second midpoint. During the movement of the two display components 200, the line connecting the first midpoint and the second midpoint is basically always perpendicular to the X direction.
[0080] The above “straight line 041 passing through the visual focus 040 and parallel to the direction of the optical axis passes through the area between the two display components 200 ” means that the eyeballs 011 and 012 of both eyes are in a straight-looking state, such as basically looking straight ahead, rather than squinting.
[0081] The above-mentioned "symmetrical movement" means that the two display components 200 move simultaneously in a plane perpendicular to the Y direction, and the center line perpendicular to the XY plane at the initial position of the two display components 200 in the plane is taken as the initial symmetry axis, and the two display components 200 are always symmetrically distributed relative to the above-mentioned initial symmetry axis during the movement in the plane. The above-mentioned initial position may refer to the position where the display components are set when the head-mounted display device is produced.
[0082] The straight line passing through the focus of the line of sight may be a straight line passing through the initial axis of symmetry, or the distance between the straight line passing through the focus of the line of sight and the initial axis of symmetry is less than 10% of the initial distance between the two display components. The initial distance may refer to the distance between the two display components when the head mounted display device is produced.
[0083] In some examples, such as Figure 8 As shown, the control method for adjusting the position of the display screen 210 and the lens part 220 relative to the binocular eyeballs 011 and 012 includes: when a straight line 041 passing through the visual focus 040 and parallel to the direction of the optical axis passes through a display component 200, the two display components 200 are driven to perform asymmetrical movement in a plane relative to the midpoint of the line connecting the binocular eyeballs 011 and 012. Figure 8As shown, in the head-mounted display device applying the above control method, the two display components 200 are configured to perform asymmetrical movement relative to the midpoint of the line connecting the binocular eyeballs 011 and 012 in the plane according to the position of the visual focus 040, so as to achieve the best display effect when the binocular eyeballs are in a strabismus state.
[0084] The above “straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through a display component 200 ” means that at least one of the eyeballs 011 and 012 of the binocular eyes is in a strabismus state, such as basically not looking straight ahead.
[0085] The above-mentioned "asymmetric movement" means that the two display components 200 or only one of them moves in a plane perpendicular to the Y direction, and the center line perpendicular to the XY plane at the initial position of the two display components 200 in the plane is taken as the initial symmetry axis, and the two display components 200 are not symmetrically distributed relative to the above-mentioned initial symmetry axis during the movement in the plane. The above-mentioned initial position may refer to the position where the display components are set when the head-mounted display device is produced.
[0086] For example, Figure 8 As shown, the two display assemblies 200 can move different distances. For example, during the movement of the display assemblies 200, the distances between the midpoints of the display assemblies 200 and the corresponding eyeballs are different.
[0087] For example, Figure 8 As shown, when two display components 200 move simultaneously in a plane perpendicular to the Y direction, the distance moved by the display component 200 that overlaps with the straight line 041 may be smaller than the distance moved by the display component 200 that does not overlap with the straight line 041 .
[0088] For example, Figure 8 As shown, the midpoint of the line connecting the centers of the two display components 200 is the first midpoint, and the midpoint of the line connecting the eyeballs 011 and 012 of the user is the second midpoint. During the movement of the two display components 200, the line connecting the first midpoint and the second midpoint is not perpendicular to the X direction.
[0089] Fig. 9 and Fig.10 Schematic diagram of adjusting the positions of a display screen and a lens portion relative to an eyeball to adjust the image plane of a virtual image according to different examples of an embodiment of the present disclosure.
[0090] In some examples, such as Figure 3-4 as well as Fig. 9As shown, the control method for adjusting the relative position of the display screen 210 and the lens portion 220 includes: driving at least one of the display screen 210 and the lens portion 220 in at least one display assembly 200 to move in a direction parallel to the optical axis of the lens portion 220 to adjust the distance between the display screen 210 and the lens portion 220. For example, the optical axis of the lens portion 220 is parallel to the Y direction. In the head mounted display device to which the above control method is applied, at least one of the display screen 210 and the lens portion 220 in at least one display assembly 200 is configured to move in a direction parallel to the optical axis of the lens portion 220 to adjust the distance between the display screen 210 and the lens portion 220.
[0091] like Figure 4 and Fig. 9 As shown, the controller 400 can drive at least one of the display screen 210 and the lens portion 220 in at least one display component 200 to move in a direction parallel to the optical axis of the lens portion 220 according to the line of sight focus information of the eye tracker 300 to adjust the distance between the display screen 210 and the lens portion 220. The intersection of the image planes 031 and 032 of the two virtual images displayed by the two display components 200 can be adjusted to the line of sight focus 040 position of the binocular eyeballs 011 and 012 to improve the convergence conflict, which is helpful to solve the dizziness problem.
[0092] For example, Fig. 9 As shown, in the same display assembly 200, the distance between at least one of the display screen 210 and the light-transmitting portion 220 and the corresponding eyeball increases or decreases.
[0093] For example, Fig. 9 As shown, the controller can adjust the same components in the two display assemblies 200 to move in the Y direction, so as to simultaneously adjust the image planes 031 and 032 of the two virtual images, and adjust the intersection of the two image planes to the position of the sight focus 040 of the binocular eyeballs 011 and 012. For example, the controller can adjust only the two display screens 210 in the two display assemblies 200 to move, or only the two lens parts 220 to move, or both the two display screens 210 and the two lens parts 220 to move.
[0094] For example, when the user's eyesight focus 14 is Figure 2 When the display screen 210 is located outside the image plane 13 of the virtual image formed by the lens portion 220, the controller 400 is configured to drive at least one of the display screen 210 and the lens portion 220 in at least one display assembly 200 to move in a direction parallel to the optical axis of the lens portion 220 according to the line of sight to adjust the positions of the image planes 031 and 032 of the virtual image, so as to achieve the following Fig. 9As shown, the sight focus 040 is located at the image plane position of the virtual image formed by the image displayed on the display screen 210 through the lens portion 220, such as the intersection position of the image planes 031 and 032 of the virtual image, so that the refractive power of each eyeball is adapted to the convergence point to improve the convergence conflict, which is beneficial to solve the dizziness problem and achieve the best display effect.
[0095] For example, Fig. 9 As shown in FIG. 1 , when at least one of the display screen 210 and the light-transmitting portion 220 moves in the Y direction and can move the image plane of the virtual image to the position where the sight focus 040 is located, the display component 200 does not move in a plane perpendicular to the Y direction. For example, when at least one of the display screen 210 and the light-transmitting portion 220 moves in the Y direction and still cannot adjust the image plane of the virtual image to the position where the sight focus 040 is located, the display component 200 moves in a plane perpendicular to the Y direction as follows: Figure 7 or Figure 8 Movement shown.
[0096] In some examples, such as Fig. 9 As shown, the control method for adjusting the relative position of the display screen 210 and the lens unit 220 includes: when a straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through the area between the two display components 200, the same type of structure in the two display components 200 is driven to move the same distance in the direction parallel to the optical axis of the lens unit 220, and the above structure includes at least one of the display screen 210 and the lens unit 220. Fig. 9 As shown, in the head-mounted display device applying the above-mentioned control method, the same type of structure in the two display components 200 is configured to move the same distance in a direction parallel to the optical axis of the lens portion 220 according to the position of the line of sight focus 040, such as the above-mentioned structure includes at least one of the display screen 210 and the lens portion 220, so as to achieve the best display effect when the eyeballs of both eyes are in the emphases state.
[0097] The “same type of structure” mentioned above and subsequently refers to the display screens in the two display assemblies, or the lens parts in the two display assemblies.
[0098] For example, Fig. 9As shown, the control unit can adjust the distance that the lens unit 220 in one display assembly 200 moves along the Y direction to be the same as the distance that the lens unit 220 in another display assembly 200 moves along the Y direction, so that the image planes 031 and 032 of the virtual image are adjusted to the position where the visual focus 040 is located. For example, the control unit can adjust the distance that the display screen 210 in one display assembly 200 moves along the Y direction to be the same as the distance that the display screen 210 in another display assembly 200 moves along the Y direction. For example, the control unit can adjust the distance difference between the display screen 210 and the light-transmitting unit 220 in one display assembly 200 and the distance difference between the display screen 210 and the light-transmitting unit 220 in another display assembly 200 along the Y direction to be the same.
[0099] For example, Fig. 9 As shown, during the movement of the same type of structures in the two display assemblies 200, the distance between the moving structure of each display assembly 200 and the corresponding eyeball is approximately equal.
[0100] For example, Fig. 9 As shown, the midpoint of the line connecting the centers of the two display components 200 is the first midpoint, and the midpoint of the line connecting the eyeballs 011 and 012 of the user is the second midpoint. During the movement of the same structure in the two display components 200, the line connecting the first midpoint and the second midpoint is basically always perpendicular to the X direction.
[0101] The above “straight line 041 passing through the visual focus 040 and parallel to the direction of the optical axis passes through the area between the two display components 200 ” means that the eyeballs 011 and 012 of both eyes are in a straight-looking state, such as basically looking straight ahead, rather than squinting.
[0102] The straight line passing through the focus of the line of sight may be a straight line passing through the initial symmetry axis of the two display components, or the distance between the straight line passing through the focus of the line of sight and the initial symmetry axis is less than 10% of the initial distance between the two display components. The initial distance may refer to the distance between the two display components when the head mounted display device is produced.
[0103] In some examples, such as Fig.10 As shown, the control method for adjusting the relative position of the display screen 210 and the lens unit 220 includes: when a straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through one display assembly 200, driving the same type of structure in the two display assemblies 200 to move different distances in a direction parallel to the optical axis of the lens unit 220, and the above structure includes at least one of the display screen 210 and the lens unit 220. Fig.10As shown, in the head-mounted display device applying the above-mentioned control method, the same type of structure in the two display components 200 is configured to move different distances in a direction parallel to the optical axis of the lens portion 220 according to the position of the line of sight focus 040, such as the above-mentioned structure includes at least one of the display screen 210 and the lens portion 220, so as to achieve the best display effect when the eyeballs of both eyes are in a strabismus state.
[0104] The above “straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through a display component 200 ” means that at least one of the eyeballs 011 and 012 of the binocular eyes is in a strabismus state, such as basically not looking straight ahead.
[0105] For example, Fig.10 As shown, the control unit can adjust the distance that the lens unit 220 in one display assembly 200 moves along the Y direction to be different from the distance that the lens unit 220 in another display assembly 200 moves along the Y direction, so that the image planes 031 and 032 of the virtual image are adjusted to the position where the visual focus 040 is located. For example, the control unit can adjust the distance that the display screen 210 in one display assembly 200 moves along the Y direction to be different from the distance that the display screen 210 in another display assembly 200 moves along the Y direction. For example, the control unit can adjust the distance difference between the display screen 210 and the light-transmitting unit 220 in one display assembly 200 and the distance difference between the display screen 210 and the light-transmitting unit 220 in another display assembly 200 moving along the Y direction to be different.
[0106] For example, Fig.10 As shown, during the movement of the display assembly 200, the distances between the midpoints of the moving structures in each display assembly 200 and the corresponding eyeballs are not equal.
[0107] For example, Fig.10 As shown, the same type of structures moving in the display assembly 200 may all be lens portions 220 .
[0108] For example, Fig.10 As shown, when the same structure in two display components 200 moves simultaneously along the Y direction, the distance moved by the structure in the display component 200 that overlaps with the straight line 041 may be smaller than the distance moved by the structure in the display component 200 that does not overlap with the straight line 041 .
[0109] In some examples, such as Fig.10 As shown, the control method for adjusting the relative position of the display screen 210 and the lens portion 220 includes: when a straight line 041 passing through the visual focus 040 and parallel to the optical axis passes through one display assembly 200, only one of the display screen 210 and the lens portion 220 in the display assembly 200 is driven to move in a direction parallel to the optical axis of the lens portion 220. Fig.10As shown, in a head-mounted display device applying the above-mentioned control method, at least one of the display screen 210 and the lens portion 220 in only one of the two display components 200 is configured to move in a direction parallel to the optical axis of the lens portion 220 to achieve an optimal squint state.
[0110] For example, Fig.10 As shown, when the user's eyeballs 011 and 012 are in a strabismus state, only the display screen 210 and at least one of the lens portion 220 in the display component 200 that do not overlap with the straight line 041 can move along the Y direction, or only the display screen 210 and at least one of the lens portion 220 in the display component 200 that overlap with the straight line 041 can move along the Y direction.
[0111] For example, Fig.10 As shown in FIG. 1 , when at least one of the display screen 210 and the light-transmitting portion 220 moves in the Y direction and can make the image plane of the virtual image be located at the position of the sight focus 040, the display component 200 does not move in a plane perpendicular to the Y direction. For example, when at least one of the display screen 210 and the light-transmitting portion 220 moves in the Y direction and still cannot adjust the image plane of the virtual image to the position of the sight focus 040, the display component 200 moves in a plane perpendicular to the Y direction as follows: Figure 7 or Figure 8 Movement shown.
[0112] In some examples, such as Figures 3 to 10 As shown, the control method also includes: adjusting the positions of the display screen 210 and the lens portion 220 relative to the eyeballs 011 and 012, and / or adjusting the movement time of the relative position of the display screen 210 and the lens portion 220 to be within 100 milliseconds after the user's blinking or eye saccade, so that the moving structure has a fast response time and stability to avoid the user's perception, thereby achieving the best experience effect.
[0113] For example, Figures 3 to 10 As shown, the positions of the display screen 210 and the lens unit 220 relative to the eyeballs 011 and 012 of the eyes, and / or the movement time of the relative positions of the display screen 210 and the lens unit 220 are adjusted to be within 50 milliseconds (non-sensitive time) after the user's eye blinks or eye saccades. For example, the movement time of the display screen 210 and the lens unit 220 is adjusted to be within 30 milliseconds after the user's eye blinks or eye saccades. For example, the movement time of the display screen 210 and the lens unit 220 is adjusted to be within 20 milliseconds after the user's eye blinks or eye saccades.
[0114] In some examples, such as Figures 3 to 10As shown, after adjusting the sight focus 040 to be located at the image plane position of the virtual image, the control method further includes: adjusting the display content in the display screen 210 to optimize the aberration of the virtual image. For example, the aberration includes distortion. For example, when driving the display screen 210 and the light-transmitting portion 220 to move, the distortion needs to be adjusted according to the positions of the light-transmitting portion 220, the display screen 210 and the eyeball to avoid additional dizziness caused by pupil drift caused by movement.
[0115] For example, when optically designing the display components in the head-mounted display device provided by the present invention, the virtual image plane can have high sensitivity to the movement of the display screen or the lens part. For example, when the display screen or the lens part moves a small distance, the virtual image plane can move a larger distance, thereby minimizing the distance that the lens part or the display screen moves, increasing the response speed, and reducing the response time and physical interference.
[0116] Fig.11 is a schematic block diagram of a head mounted display device according to at least one embodiment of the present disclosure.
[0117] like Fig.11 As shown, an embodiment of the present disclosure further provides a head mounted display device, comprising a display screen 210 and a lens portion 220 located on the light emitting side of the display screen 210. The display screen and the lens portion in this embodiment may have the same features as the display screen and the lens portion provided in any of the above embodiments, and will not be described in detail herein.
[0118] like Fig.11 As shown, the head mounted display device further includes a processor 230 and a memory 240, and the memory 240 includes one or more computer program modules 241. The one or more computer program modules are stored in the memory 240 and are configured to be executed by the processor 230, and the one or more computer program modules include instructions for executing the control method as described above. For example, the memory and the processor may include at least part of the eye tracker and the controller in the above-mentioned embodiment.
[0119] For example, the processor 230 may be a central processing unit (CPU), a digital signal processor (DSP), or other forms of processing units with data processing capabilities and / or program execution capabilities, such as a field programmable gate array (FPGA), etc.; for example, the central processing unit (CPU) may be an X86 or ARM architecture, etc. The processor 230 may be a general-purpose processor or a dedicated processor, and may be coupled with other components in the head mounted display device 1000 to perform desired functions.
[0120] For example, the memory 240 may include any combination of one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, erasable programmable read-only memory (EPROM), portable compact disk read-only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules 241 may be stored on the computer-readable storage medium, and the processor 230 may run one or more computer program modules 241 to implement various functions of the head-mounted display device 1000. Various applications and various data, as well as various data used and / or generated by the application, etc. may also be stored in the computer-readable storage medium. The specific functions and technical effects of the head-mounted display device 1000 can refer to the description of the control method above, which will not be repeated here.
[0121] Fig.12 is a schematic block diagram of a computer-readable storage medium according to at least one embodiment of the present disclosure.
[0122] An embodiment of the present disclosure also provides a computer-readable storage medium. Fig.12 is a schematic block diagram of a computer-readable storage medium according to at least one embodiment of the present disclosure. Fig.12 As shown, the computer-readable storage medium 2000 stores computer program instructions 500, and when the computer program instructions 500 are executed by a processor, one or more steps in the control method described above are performed.
[0123] For example, the computer-readable storage medium 2000 may be any combination of one or more computer-readable storage media, such as one computer-readable storage medium comprising a computer-readable program code for determining the line of sight direction of the user's eyes, another computer-readable storage medium comprising a computer-readable program code for calculating the line of sight focus of the eyes according to the position of the eyeballs of the eyes, and yet another computer-readable storage medium comprising a computer-readable program code for adjusting the position of the display screen and the lens part relative to the eyeballs of the eyes according to the line of sight focus, and / or adjusting the relative position of the display screen and the lens part.
[0124] Of course, the above-mentioned various program codes can also be stored in the same computer-readable medium, and the embodiments of the present disclosure are not limited to this. For example, when the program code is read by a computer, the computer can execute the program code stored in the computer storage medium to execute, for example, the control method provided by any embodiment of the present disclosure.
[0125] For example, the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), flash memory, or any combination of the above storage media, or other applicable storage media.
[0126] There are a few points to note:
[0127] (1) In the drawings of the embodiments of the present disclosure, only the structures related to the embodiments of the present disclosure are involved, and other structures can refer to the general design.
[0128] (2) In the absence of conflict, features in the same embodiment or in different embodiments of the present disclosure may be combined with each other.
[0129] The above description is merely an exemplary embodiment of the present disclosure and is not intended to limit the protection scope of the present disclosure. The protection scope of the present disclosure is determined by the appended claims.
Claims
1. A method for controlling a head mounted display device, wherein: The head mounted display device comprises a display screen and a lens portion, and the control method comprises: Determine the direction of the user's eyes' gaze; Determining the sight focus of the binocular eyes according to the sight direction of the binocular eyes; The positions of the display screen and the lens portion are adjusted according to the sight focus so that the sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens portion.
2. The control method according to claim 1, wherein: Adjusting the positions of the display screen and the lens portion according to the line of sight focus includes: adjusting the positions of the display screen and the lens portion relative to eyeballs of both eyes according to the line of sight focus, and / or adjusting the relative positions of the display screen and the lens portion.
3. The control method according to claim 1, wherein: The head mounted display device comprises two display components, the two display components correspond to eyeballs of both eyes respectively, and each display component comprises at least one display screen and at least one lens portion, the at least one lens portion is located on the light emitting side of the at least one display screen; Adjusting the positions of the display screen and the lens portion according to the sight focus includes adjusting the positions of the display screen and the lens portion relative to the eyeballs of both eyes according to the sight focus, which includes: At least one display component is driven to move within a plane to adjust the position of the at least one display component relative to the corresponding eyeball, and the plane is a plane perpendicular to the optical axis of the lens portion.
4. The control method according to claim 3, wherein: Adjusting the positions of the display screen and the lens portion relative to the eyeballs of the binoculars comprises: When a straight line passing through the sight focus and parallel to the optical axis passes through the area between the two display components, the two display components are driven to move symmetrically within the plane relative to the midpoint of the line connecting the eyeballs of the two eyes.
5. The control method according to claim 3, wherein: Adjusting the positions of the display screen and the lens portion relative to the eyeballs of the binoculars comprises: When a straight line passing through the sight focus and parallel to the optical axis passes through one display component, the two display components are driven to perform asymmetric movement within the plane relative to the midpoint of the line connecting the eyeballs of the two eyes.
6. The control method according to claim 1, wherein: The head mounted display device comprises two display components, the two display components correspond to eyeballs of both eyes respectively, and each display component comprises at least one display screen and at least one lens portion, the at least one lens portion is located on the light emitting side of the at least one display screen; Adjusting the positions of the display screen and the lens portion according to the line of sight focus includes adjusting the relative positions of the display screen and the lens portion, which includes: driving at least one of the display screen and the lens portion in at least one display component to move in a direction parallel to the optical axis of the lens portion to adjust the distance between the display screen and the lens portion.
7. The control method according to claim 6, wherein: Adjusting the relative position of the display screen and the lens portion includes: When a straight line passing through the line of sight and parallel to the direction of the optical axis passes through the area between the two display components, the same type of structure in the two display components is driven to move the same distance along a direction parallel to the optical axis of the lens portion, and the structure includes at least one of the display screen and the lens portion.
8. The control method according to claim 6, wherein: Adjusting the relative position of the display screen and the lens portion includes: When a straight line passing through the line of sight and parallel to the direction of the optical axis passes through a display component, the same type of structure in the two display components is driven to move different distances in a direction parallel to the optical axis of the lens portion, and the structure includes at least one of the display screen and the lens portion; or only the display screen and at least one of the lens portion in one display component are driven to move in a direction parallel to the optical axis of the lens portion.
9. The control method according to any one of claims 1 to 8, wherein: The movement time for adjusting the position of the display screen and the lens portion is within 100 milliseconds after a blink or eye saccade of both eyes of the user.
10. The control method according to any one of claims 1 to 8, wherein: After adjusting the sight focus to be located at the image plane position of the virtual image, the control method further includes: The display content in the display screen is adjusted to optimize the aberration of the virtual image.
11. A head mounted display device, comprising: case; Two display assemblies are located in the housing, wherein the two display assemblies correspond to the user's eyeballs respectively, and each display assembly includes at least one display screen and at least one lens portion, and the at least one lens portion is located on the light emitting side of the at least one display screen; An eye tracker, located in the housing, the eye tracker being configured to determine the sight direction of the user's eyes and determine the sight focus of the eyes according to the sight direction of the user's eyes; A controller is located in the housing, and the controller is electrically connected to the two display components and the eye tracker. In which, the two display components are configured to be movable relative to the shell, and the controller is configured to adjust the positions of the display screen and the lens portion according to the line of sight focus so that the line of sight focus is located at the image plane position of the virtual image formed by the image displayed on the display screen through the lens portion.
12. The head mounted display device according to claim 11, wherein: The controller is configured to adjust the positions of the display screen and the lens portion relative to the eyeballs of the binoculars according to the visual focus, and / or adjust the relative position of the display screen and the lens portion.
13. The head mounted display device according to claim 11, wherein: At least one display component is configured to move within a plane to adjust the position of the at least one display component relative to the corresponding eyeball, and the plane is a plane perpendicular to the optical axis of the lens portion.
14. The head mounted display device according to claim 13, wherein: The two display components are configured to perform symmetrical or asymmetrical movement relative to a midpoint of a line connecting the eyeballs of both eyes in the plane according to the position of the sight focus.
15. The head mounted display device according to claim 11, wherein: At least one of the display screen and the lens portion in at least one display assembly is configured to move in a direction parallel to an optical axis of the lens portion to adjust a distance between the display screen and the lens portion.
16. The head mounted display device according to claim 15, wherein: The same type of structure in the two display components is configured to move the same or different distances in a direction parallel to the optical axis of the lens portion according to the position of the line of sight focus, and the structure includes at least one of the display screen and the lens portion; or the display screen and at least one of the lens portion in only one of the two display components is configured to move in a direction parallel to the optical axis of the lens portion.
17. A head mounted display device, comprising: Display screen; A lens portion, located at the light-emitting side of the display screen; processor; a memory including one or more computer program modules; The one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for executing the control method according to any one of claims 1 to 10.
18. A computer-readable storage medium having executable codes stored thereon, wherein when the executable codes are executed by a processor, the processor executes the control method according to any one of claims 1 to 10.
Citation Information
Cited By
Intelligent glasses
CN119846848A
