A head-mounted display device

By replacing multiple fixed cameras with a single eye-tracking camera that can dynamically adjust its position and angle in AR glasses, the problems of increased cost, weight, and power consumption in existing technologies are solved, achieving lightweight devices and efficient eye tracking.

CN122151366APending Publication Date: 2026-06-05VIVO MOBILE COMM CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
VIVO MOBILE COMM CO LTD
Filing Date
2026-03-09
Publication Date
2026-06-05

AI Technical Summary

Technical Problem

Existing AR glasses with eye-tracking capabilities use multiple fixed cameras, which increases hardware cost, overall weight, and power consumption.

Method used

An eye-tracking camera is connected to a drive component, which drives the eye-tracking camera to move or rotate, dynamically adjusting its position and angle, in order to replace the solution of multiple fixed cameras.

Benefits of technology

It significantly reduces hardware costs, overall weight, and power consumption, achieving an optimized balance between precision, cost, and lightweight design, improving wearing comfort and aesthetics, and extending device battery life.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122151366A_ABST
    Figure CN122151366A_ABST
Patent Text Reader

Abstract

The application provides a head-mounted display device, comprising a frame body, a first display assembly, a second display assembly, a driving assembly and an eye movement camera; the frame body has a support part, the first display assembly and the second display assembly are arranged on two sides of the support part away from each other; the driving assembly is fixed to the support part; the eye movement camera is connected with the driving assembly, and the driving assembly drives the eye movement camera to move or rotate. In the scheme, the head-mounted display device realizes image acquisition of the eyes of a user by arranging only one rotatable eye movement camera, reduces the number of cameras, and reduces the hardware cost, overall weight and power consumption of the device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of smart wearable devices, specifically to a head-mounted display device. Background Technology

[0002] With the development of augmented reality (AR) technology, smart wearable devices such as AR glasses are gradually incorporating eye-tracking functions to achieve more intelligent human-computer interaction by capturing the user's gaze point.

[0003] Existing AR glasses with eye-tracking capabilities generally use fixed dual or even four cameras. However, this approach leads to a significant increase in the device's hardware cost, overall weight, and power consumption. Summary of the Invention

[0004] The present invention aims to provide a head-mounted display device to solve the problem that the use of multiple cameras in the prior art leads to increased device cost, overall weight and power consumption.

[0005] To solve the above-mentioned technical problems, the present invention is implemented as follows: This invention provides a head-mounted display device, comprising: The frame has a supporting section; A first display component is disposed within the frame; A second display component is disposed on the frame, and the first display component and the second display component are located on opposite sides of the support portion; A drive assembly, which is fixed to the support portion; An eye-tracking camera is connected to the drive assembly, which drives the eye-tracking camera to move or rotate.

[0006] In this embodiment, by connecting the eye-tracking camera to a driving component and using the driving component to move or rotate the eye-tracking camera, a single eye-tracking camera can dynamically adjust its position and angle, thereby acquiring clear, distortion-free images of the human eye even when the eye rotates to different angles. This design replaces the multiple fixed cameras in the prior art with a single eye-tracking camera, effectively solving the problem of imaging in degraded areas while significantly reducing the hardware cost, overall weight, and power consumption of the head-mounted display device, achieving an optimized balance between accuracy, cost, and lightweight design. Attached Figure Description

[0007] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which: Figure 1This is a schematic diagram showing the relationship between the shooting angle of a fixed camera and the location of the degraded area being captured. Figure 2 This is a schematic diagram showing the positional relationship between the eye-tracking camera and the imaged deterioration area provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a head-mounted display device provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of a head-mounted display device acquiring a user's first-glance image according to an embodiment of the present invention; Figure 5 This is a schematic diagram of a head-mounted display device acquiring a user's second-eye image according to an embodiment of the present invention; Figure 6 This is a schematic diagram of the field of view of a head-mounted display device in a second position according to an embodiment of the present invention; Figure 7 This is a schematic diagram of the field of view of a head-mounted display device in a first position according to an embodiment of the present invention; Figure 8 This is a schematic diagram of the connection relationship of an eye-tracking camera provided in an embodiment of the present invention; Figure 9 This is a schematic diagram of the structure of an eye-tracking camera in a second position according to an embodiment of the present invention; Figure 10 This is a schematic diagram of the structure of an eye-tracking camera in a first position according to an embodiment of the present invention; Figure 11 This is a schematic diagram of the connection relationship of a rotating bracket provided in an embodiment of the present invention; Figure 12 This is a schematic diagram of the structure of a rotating bracket provided in an embodiment of the present invention; Figure 13 This is a schematic diagram of a first electromagnetic structure and a first magnetic component provided in an embodiment of the present invention; Figure 14 This is a schematic diagram showing the connection relationship between a first supplementary lighting device and a second supplementary lighting device provided in an embodiment of the present invention; Figure 15 This is a schematic diagram of the connection relationship of a movable infrared fill light when it is facing the user's first eye, according to an embodiment of the present invention; Figure 16 This is a schematic diagram of the connection relationship when a movable infrared fill light is facing the user's second eye, as provided in an embodiment of the present invention.

[0008] Figure label: A - First glance, B - Second glance, C - Field of view of eye-tracking camera, D - First camera, E - Second camera; 1-Frame, 10-Support, 100-Limiting block, 101-Mounting groove, 11-Housing, 110-Light-transmitting part; 2-First display component; 3-Second display component; 4-Drive assembly, 40-Rotating bracket, 41-Rotating shaft, 42-Drive component, 420-Electromagnetic drive component, 4200-First electromagnetic structure, 42001-Electromagnetic component, 42002-Coil, 42003-First flexible circuit board, 42004-Housing shell, 42005-Reinforcing component, 4201-First magnetic component, 43-Fixing component, 44-Reset component, 440-Second electromagnetic structure; 5 - Eye-tracking camera, 50 - First side, 51 - Second side, 52 - Third side, 53 - Fourth side; 6-First supplementary lighting component, 60-First supplementary light, 61-Second supplementary light; 7-Second fill light assembly, 70-Third fill light, 71-Fourth fill light; 8-Movable infrared fill light; 9-Second flexible circuit board. Detailed Implementation

[0009] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0010] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments.

[0011] Existing AR glasses with eye-tracking capabilities suffer from several issues. When the user's eye moves to a specific angle relative to the camera, the pupil appears as a tilted ellipse instead of a perfect circle. This results in severe perspective distortion, eyelid and eyelash obstruction, or blurred features in the captured eye image. This specific angle range is known as the image degradation zone. Within this area, the pupil shape is distorted, and crucial details are lost, preventing the algorithm from accurately detecting the pupil center and iris features, ultimately leading to a significant decrease in eye-tracking accuracy.

[0012] To address the issue of poor image quality in degraded areas, related technologies typically employ at least two fixed cameras to capture images from two separate human eyes. For example... Figure 1 As shown in the diagram, the shaded area represents the image degradation zone. The first camera D is fixedly positioned below one of the user's eyes (let's call it the left eye, and the other eye the right eye) to capture the left eye. The second camera E is fixedly positioned between the user's eyes, facing the other eye (right eye), to capture the right eye. Because the relative positions of the first camera D and the second camera E to their respective eyes are different, the image degradation zones corresponding to the first camera D and the second camera E are also different. That is, the user's two eyes will not simultaneously enter the image degradation zones of the first camera D and the second camera E. Specifically, when the user looks upwards, both eyes rotate upwards simultaneously. If the rotation angle is too large, the left eye may enter the image degradation zone of the first camera D, resulting in poor image quality. Meanwhile, the right eye is outside the image degradation zone of the second camera E, allowing the second camera E to capture the image. However, this approach leads to a significant increase in the device's hardware cost, overall weight, and power consumption.

[0013] To address the aforementioned problems, in a first aspect, the present invention provides a method such as... Figures 2 to 7 The head-mounted display device shown includes: a frame 1 having a support 10; a first display component 2 disposed on the frame 1; a second display component 3 disposed on the frame 1, the first display component 2 and the second display component 3 being located on opposite sides of the support 10; a drive component 4 fixed to the support 10; and an eye-tracking camera 5 connected to the drive component 4, the drive component 4 driving the eye-tracking camera 5 to move or rotate.

[0014] Typically, the eye-tracking camera 5 in this embodiment of the invention is used to capture images of the user's two eyes, which are respectively named First Eye A and Second Eye B in this specification. First Eye A refers to one of the user's left and right eyes, and Second Eye B refers to the other. The following description uses First Eye A as the left eye and Second Eye B as the right eye as an example. This descriptive method is only used to clearly illustrate the technical solution of the invention, and its scope of protection should not be limited by specific references.

[0015] This invention connects an eye-tracking camera 5 to a driving component 4, and uses the driving component 4 to drive the eye-tracking camera 5 to move or rotate. This allows the single eye-tracking camera 5 to dynamically adjust its position and angle, thereby acquiring clear, distortion-free images of the human eye even when the eye rotates to different angles. This design replaces the multiple fixed cameras in the prior art with a single eye-tracking camera 5, effectively solving the problem of imaging in degraded areas while significantly reducing the hardware cost, overall weight, and power consumption of the head-mounted display device, achieving an optimized balance between accuracy, cost, and lightweight design.

[0016] Specifically, the driving component 4 can drive the eye-tracking camera 5 to rotate or move to a position suitable for acquiring the left eye image, or drive the eye-tracking camera 5 to rotate or move with the rotation of the left eye; when it is necessary to acquire the right eye image or track the rotation of the right eye, the driving component 4 can also drive the eye-tracking camera 5 to rotate or move to a position suitable for acquiring the right eye image, or drive the eye-tracking camera 5 to rotate or move with the rotation of the right eyeball. Through the flexible adjustment of the position of the eye-tracking camera 5, a single eye-tracking camera 5 can achieve the observation range coverage that originally required multiple fixed cameras. This directly reduces the number of cameras, lowers procurement and assembly costs, reduces the hardware weight carried by the frame 1, and reduces the power consumption burden caused by multiple cameras working simultaneously.

[0017] Reference Figure 2 The eye-tracking camera 5 is rotatably positioned in the center of the entire head-mounted display device. The area of ​​image degradation for the eye-tracking camera 5 is shown as the shaded region in the figure. When the user looks to the left, both eyes move to the left simultaneously, with the left pupil moving away from the eye-tracking camera 5 and the right pupil moving closer. If the range of rotation is too large, the left eye will enter the image degradation zone of the eye-tracking camera 5, resulting in pupillary distortion and increased eyelid occlusion. However, at this time, the right pupil remains outside the image degradation zone, with a good, nearly circular, and clear image. Similarly, when the user looks to the right, the right eye enters the image degradation zone of the eye-tracking camera 5, while the left eye remains outside. In other words, the user's two eyes will not simultaneously be within the image degradation zone of the eye-tracking camera 5; at least one eye's pupil image is good. Based on this characteristic, when the pupil image quality of one of the eyes acquired by the eye-tracking camera 5 in this embodiment of the invention is poor, the driving component 4 drives the eye-tracking camera 5 to rotate towards the other eye pupil with a clear image to obtain a pupil image with clear features. The essence of this mechanism is to ensure that the eye-tracking camera 5 always "selects the best view," actively choosing the eye at the current best observation angle as the direct tracking target, thereby avoiding low-quality imaging of the eye in the area of ​​image degradation and ensuring that the acquired eye images are always reliable.

[0018] This invention employs a single eye-tracking camera 5, reducing the number of corresponding camera modules, image sensors, lenses, filters, near-infrared illumination units, and their independent circuits from two or more sets to a single set. This reduction in hardware directly leads to a significant decrease in material costs. Simultaneously, the weight and space occupied by a single movable camera and its driving component 4 are significantly less than those of two fixed camera modules. This is crucial for head-mounted displays worn on the face, directly improving wearing comfort and aesthetics, and freeing up more space within the frame 1 for batteries or other functional modules. Furthermore, with only one camera sensor and its associated structure operating, compared to the continuous high-power operation of a dual-camera system, the average power consumption of this solution can be reduced by nearly 50%, significantly extending the device's battery life.

[0019] Optionally, the driving component 4 drives the eye-tracking camera 5 to move or rotate between a first position and a second position: when the eye-tracking camera 5 is in the first position, the eye-tracking camera 5 rotates to face the user's first eye A or moves closer to the first display component 2 to obtain an image of the user's first eye A; when the eye-tracking camera 5 is in the second position, the eye-tracking camera 5 rotates to face the user's second eye B or moves closer to the second display component 3 to obtain an image of the user's second eye B.

[0020] For reference Figures 6 to 10 In this embodiment of the invention, the eye-tracking camera 5 is driven by the driving component 4 to move or rotate between a specifically defined first position and a second position, so that the eye-tracking camera 5 can actively and quickly switch to the optimized observation point for the user's first eye A or second eye B as needed, thereby ensuring that high-quality eye images can be acquired.

[0021] Specifically, the first position is the location where the image of the user's second eye (B) captured by eye-tracking camera 5 is in the image degradation zone, and the second position is the location where the image of the user's first eye (A) captured by eye-tracking camera 5 is in the image degradation zone. Since the first and second positions are fixed and known, the motion planning of the control drive component 4 (whether electromagnetic or motor driven) can be simplified to point-to-point movement from the current position to the first or second position. This significantly reduces the complexity of real-time path calculation. Simultaneously, during system calibration, precise calibration of these two key positions is sufficient to establish the spatial mapping relationship of the entire tracking system, improving calibration efficiency and system consistency. Eye-tracking camera 5 captures data for the first eye (A) at the first position, and then quickly switches to the second position to capture data for the second eye (B) as needed, or remains in the first position. This achieves the functional coverage equivalent to two fixed camera systems with a single hardware device, while avoiding the inherent spatial competition and synchronization problems of dual systems.

[0022] Optionally, the driving assembly 4 drives the eye-tracking camera 5 to rotate. The driving assembly 4 includes: a rotating bracket 40 for fixing the eye-tracking camera 5; a rotating shaft 41 fixedly connected to the rotating bracket 40 and rotatably connected to the support portion 10; and a driving member 42 for driving the rotating shaft 41 to rotate the rotating bracket 40 relative to the support portion 10, thereby driving the eye-tracking camera 5 to rotate. Alternatively, the driving assembly 4 drives the eye-tracking camera 5 to rotate. The driving assembly 4 includes: a rotating bracket 40 for fixing the eye-tracking camera 5; a rotating shaft 41 rotatably connected to the rotating bracket 40 and fixedly connected to the support portion 10; and a driving member 42 for driving the rotating bracket 40 to rotate around the rotating shaft 41, thereby driving the eye-tracking camera 5 to rotate.

[0023] In an alternative embodiment, reference may be made to Figures 8 to 13 The rotating shaft 41 is driven by the driving component 42, which in turn drives the rotating bracket 40, on which the eye-tracking camera 5 is fixed, to rotate relative to the support part 10, thus realizing the efficient switching of the eye-tracking camera 5 between the user's eyes. This solution is not only compact in structure, reliable in control, and low in power consumption, but also further optimizes the internal space layout, overall weight, and long-term operational reliability of the head-mounted display device.

[0024] Specifically, the rotation shaft 41 is connected to the support part 10. This connection can be via a bearing or a hinge, and this embodiment of the invention is not limited to either. The configuration of the rotation shaft 41 provides a single, defined physical axis of rotation for the eye-tracking camera 5, ensuring that the rotation trajectory of the eye-tracking camera 5 is a rotational motion around the rotation shaft 41, rather than an unrestrained wobbling. For every unit displacement or rotation applied by the drive member 42, the line of sight of the eye-tracking camera 5 will correspondingly change by a defined angle, making the motion trajectory of the eye-tracking camera 5 determined and repeatable.

[0025] The rotating shaft 41 is directly mounted on the support 10, giving the entire structure high torsional stiffness. When the eye-tracking camera 5 suddenly stops or changes direction during rotation, this structure effectively suppresses residual vibration, preventing image blurring caused by camera 5 shaking and ensuring instantaneous stability of image acquisition. The rotating bracket 40 fixes the eye-tracking camera 5 to the rotating shaft at the optimal center of gravity and observation angle, avoiding rotational imbalance caused by improper installation. The rotating bracket 40 itself can be made of lightweight materials (such as magnesium alloy or high-performance engineering plastics), minimizing the rotational inertia of rotating components while ensuring strength.

[0026] In a specific application scenario, taking the eye-tracking camera 5 rotating from facing the user's left eye to facing the user's right eye as an example, the specific working process is as follows: the drive component 42 outputs a specific angle or displacement, driving the rotating shaft 41 to precisely rotate through a predetermined angle. Since the rotating shaft 41 is fixedly connected to the rotating bracket 40, the rotating bracket 40 then drives the eye-tracking camera 5 on it to rotate synchronously by the same angle, thereby enabling the observation center of the eye-tracking camera 5 to align with the user's right eye from facing the user's left eye, achieving seamless relay tracking of eye movements.

[0027] In another alternative embodiment, the rotation shaft 41 is fixedly connected to the support portion 10, while the rotation bracket 40 is rotatably connected to the rotation shaft 41 and driven by the drive component 42 to rotate around the rotation shaft 41, thereby providing a rotational motion scheme with better rigidity and a more stable structure. This embodiment directly integrates the pivot of the rotational motion (rotation shaft 41) into a part or extension of the support portion 10, making the foundation of the entire drive assembly 4 more robust. By driving the rotation bracket 40 to rotate around the fixed rotation shaft 41 to drive the eye-tracking camera 5, the motion stiffness and positioning stability are improved, enabling the switching of observed targets with less vibration and higher repeatability. This further enhances the ability of a single eye-tracking camera 5 to dynamically track observed targets and acquire clear images; at the same time, this structural design facilitates reliable integration within the limited space of the head-mounted display device, reducing overall weight, complexity, and long-term accuracy maintenance.

[0028] Specifically, since the rotating shaft 41 is fixed to the support 10, it will not wobble or deform relative to the frame 1, providing a static and stable axis of rotation for the entire rotational motion. This provides a structural reference for ensuring the accuracy of the rotational trajectory of the eye-tracking camera 5. When the eye-tracking camera 5 and its rotating bracket 40 move or are subjected to external disturbances, the generated forces and torques are directly transmitted to the robust support 10 through the rotating shaft 41 and absorbed, avoiding the slight deformation that might occur when transmitted through bearings or other moving parts. This greatly improves the anti-interference capability and static / dynamic stiffness of the entire motion module. Secondly, the fixed rotating shaft 41 itself can serve as a load-bearing frame, simplifying the support requirements at both ends. Typically, only the base needs to be secure, which is beneficial for layout in narrow spaces such as eyeglass temples or beams.

[0029] The rotating bracket 40 is rotatably connected to the fixed rotating shaft 41 via bearings or bushings, while the driving component 42 directly or indirectly drives the rotating bracket 40 to rotate around the fixed rotating shaft 41. As a moving component, the rotating bracket 40 carries the eye-tracking camera 5 and rotates around an absolutely stationary axis (rotating shaft 41). This structure makes the moment of inertia of the moving component easy to calculate and control, facilitating rapid and smooth start-stop and precise pose control. Since the rotating shaft 41 is fixed, the driving component 42 (such as a micro motor) can be more flexibly arranged around or to the side of the rotating bracket 40, coupling with it via gears, friction wheels, or direct drive to drive its rotation. This layout fully utilizes the annular space around the rotating shaft 41, making the entire driving assembly 4 very compact in a plane perpendicular to the axis, particularly suitable for installation in directions where the thickness of the frame 1 is limited.

[0030] In specific application scenarios, the drive component 42 outputs a specific angle or displacement, generating torque that acts on the rotating bracket 40. Since the rotating shaft 41 is fixed, this torque is directly converted into pure rotational motion of the rotating bracket 40 around it, thereby driving the rotating bracket 40 to rotate through a preset angle. At the same time, the rotating bracket 40 drives the eye-tracking camera 5, which is fixedly connected to it, to rotate by the same angle, so as to change the orientation of the eye-tracking camera 5.

[0031] For reference Figure 8 , Figure 11 as well as Figures 14 to 16 In an optional embodiment, the drive assembly 4 further includes a fixing member 43, which is fixedly connected to the support portion 10. The rotating shaft 41 is rotatably connected to the fixing member 43, and the rotating shaft 41 is rotatably connected to the support portion 10 through the fixing member 43. By introducing the fixing member 43 between the support portion 10 and the rotating shaft 41, the installation reference, centering, and load-bearing functions of the drive assembly 4 are integrated. This not only significantly improves the positional accuracy and concentricity of the rotating shaft 41 installation, ensuring the smoothness and precision of the rotational movement of the eye-tracking camera 5, but also realizes the modularity and independent assembly of the drive assembly 4, greatly simplifying the overall assembly process of the equipment, improving the production yield, and providing convenience for subsequent maintenance and replacement. Ultimately, this consolidates and improves the overall performance of the monocular dynamic eye-tracking system from the perspectives of manufacturing and reliability.

[0032] Specifically, in the head-mounted display device, the support part 10, as part of the frame 1, primarily functions as structural support and load-bearing. It may experience minor deformation or dimensional tolerances due to injection molding, bending, or assembly. Directly assembling the high-precision rotating shaft 41 onto the support part 10 makes it difficult to guarantee the absolute straightness and precise positioning of the axis. The fastener 43, as an independent structure, is initially fixed to the support part 10 using screws, clips, or adhesives. Its design and manufacturing ensure that its bearing mounting holes have high dimensional and geometrical tolerances. In this way, the manufacturing tolerances of the support part 10 are absorbed and isolated by the fastener 43, preventing them from being directly transmitted to the mounting reference of the rotating shaft 41.

[0033] The rotating shaft 41 is rotatably connected to the fixing member 43, rather than directly to the support part 10. The fixing member 43 can be designed with the most suitable mounting cavity and stop structure according to the specifications of the selected bearing (such as miniature ball bearing or oil-impregnated bearing), ensuring that the bearing is precisely press-fitted or fixed in the optimal working position. This provides the rotating shaft 41 with a near-ideal low-friction, high-concentricity rotational environment. Through the connection of the fixing member 43, the rotation axis of the rotating shaft 41 can be precisely defined and maintained. This makes the optical axis deflection trajectory of the eye-tracking camera 5 fixed on the rotating bracket 40 highly predictable and without wobbling when rotating, thus ensuring that the pointing angle of the eye-tracking camera 5 has extremely high repeatability when switching between the first and second positions.

[0034] Secondly, the drive assembly 4 can undergo independent precision assembly, lubrication, and functional testing outside the production line. After ensuring the module itself is qualified, it is then installed as a single unit onto the support portion 10 of the frame 1. This "split-to-assemble" model greatly simplifies the complex assembly within the narrow frame 1, improving the efficiency of the assembly line and product yield. Furthermore, if the drive assembly 4 or the eye-tracking camera 5 malfunctions, there is no need to disassemble or replace the entire frame 1 or support portion 10. Simply removing the fastener 43 from the support portion 10 allows replacement of the entire faulty module or its sub-components. This significantly reduces the cost, complexity, and time of after-sales maintenance, enhancing product maintainability.

[0035] Optionally, the drive assembly 4 includes a drive member 42 for driving the eye-tracking camera 5 to rotate or move from a first position to a second position. The drive member 42 includes a drive motor or an electromagnetic drive member 420. When the drive member 42 includes an electromagnetic drive member 420, the electromagnetic drive member 420 includes a first electromagnetic structure 4200 and a first magnetic member 4201. The eye-tracking camera 5 is connected to the first magnetic member 4201. The first electromagnetic structure 4200 is fixed to the support portion 10 and is disposed on one side of the eye-tracking camera 5 so that the eye-tracking camera 5 can be driven to move by the first magnetic member 4201 when the first electromagnetic structure 4200 is energized. The first magnetic member 4201 includes a magnet, metal, or electromagnetic coil that can attract or repel the energized first electromagnetic structure 4200.

[0036] For reference Figure 9 and Figure 10 This invention specifically defines the driving component 42 as an electromagnetic driving component 420, and further defines it as including a first electromagnetic structure 4200 fixed to the support part 10 and a first magnetic component 4201 connected to the eye-tracking camera 5, thereby providing a driving solution with extremely fast response speed, ultra-thin structure and no mechanical contact wear. This solution utilizes electromagnetic principles to achieve non-contact driving, enabling the eye-tracking camera 5 to start and stop almost instantaneously between the first position and the second position, and to achieve extremely precise micro-displacement control. This not only significantly improves the efficiency and accuracy of switching observation targets during dynamic tracking and improves the quality of acquired images, but also greatly simplifies the structure, reduces the number of components and frictional losses by eliminating traditional mechanical transmission components such as gears and lead screws, which is conducive to achieving the ultimate thinness, low power consumption, high reliability and long service life of head-mounted display devices.

[0037] Specifically, this embodiment uses electromagnetic force as the driving force source. The first electromagnetic structure 4200 (such as an energized coil) is fixed to the support part 10, forming the stator; the first magnetic component 4201 (such as a permanent magnet) is connected to the eye-tracking camera 5, forming the mover. There is a gap between the two, and they do not directly contact each other. Instead, they are driven by the attraction or repulsion of the magnetic field, eliminating the unavoidable sliding friction, gear meshing gaps, and wear in mechanical transmission. Electromagnetic force drive not only has high driving efficiency and low energy loss, but also, since there is no wear between the first electromagnetic structure 4200 and the first magnetic component 4201, the motion accuracy will not degrade over time, and the device can maintain its original positioning accuracy even after long-term use. Furthermore, electromagnetic force drive is quiet and noiseless during operation, improving the user experience.

[0038] The generation and disappearance of electromagnetic force depend solely on the switching on and off of current, with an extremely short response time, typically on the order of milliseconds or even microseconds. When the first electromagnetic structure 4200 is energized, a magnetic field is established almost instantaneously, exerting a force on the first magnetic component 4201 and driving the eye-tracking camera 5 to begin moving immediately, eliminating the mechanical inertia delay inherent in traditional motor startup. This allows the system to quickly follow the rapid scanning movements of the user's eyes, ensuring real-time tracking.

[0039] Secondly, electromagnetic force can be directly applied to the supporting structure of the eye-tracking camera 5 (such as the rotating bracket 40) to achieve direct drive. By precisely controlling the magnitude and direction of the current in the first electromagnetic structure 4200, the magnitude and direction of the driving force can be linearly and accurately controlled, thereby achieving smooth and high-precision positioning of the eye-tracking camera 5 from the first position to the second position, and even achieving complex motion curve control.

[0040] Meanwhile, the first electromagnetic structure 4200 is fixed to the support portion 10. Its form is typically a planar coil or a miniature solenoid, and it can be made very flat. The first magnetic component 4201 (such as a thin-film permanent magnet) is also small in size and can be directly integrated onto the back of the eye-tracking camera 5 or the rotating bracket 40. The entire electromagnetic drive component 420 has no protruding motor or complex gearbox; it mainly consists of a flat coil and small magnets. It can be completely embedded inside the support portion 10 of the frame 1 or installed close to its inner wall, with an overall thickness controllable within 1-2 millimeters. This provides crucial technical feasibility for achieving the ultra-thin design of the frame 1.

[0041] In specific application scenarios, the first electromagnetic structure 4200 is located on one side of the eye-tracking camera 5. Depending on the overall layout, the first electromagnetic structure 4200 can be arranged in any position in front of, behind, to the left or right of the camera where a push / pull force needs to be generated. This embodiment does not limit this. The layout flexibility of this solution is much higher than that of a rotary motor with a fixed axis.

[0042] The first magnetic component 4201 includes a magnet, metal, or an electromagnetic coil, providing optional implementation paths for different product positioning. Specifically, using a permanent magnet as the first magnetic component 4201: the first electromagnetic structure 4200 (coil) generates a magnetic field when energized, interacting with the permanent magnet. Its advantages are simple structure, low cost, and the permanent magnet itself does not consume power. By changing the direction of the coil current, attraction or repulsion can be achieved, driving the camera to reciprocate. Using a magnetically conductive metal (such as soft iron) as the first magnetic component 4201: In this case, the first electromagnetic structure 4200 generates a magnetic field when energized, attracting the magnetically conductive metal. Its advantage is potentially lower cost, but it typically only produces unidirectional attraction (requiring a spring or other reset mechanism), and the control logic is relatively simple. Using an electromagnetic coil as the first magnetic component 4201: In this case, both driving forces are electromagnetic coils, and driving is achieved through the interaction of the magnetic fields between the two coils. Its advantage is the most flexible and precise control; complex force control can be achieved by adjusting the current of each coil separately, but the circuitry and control are slightly more complex. This solution provides the possibility of achieving nanometer-level precision micro-adjustment. Different first magnetic components 4201 can be selected according to different application scenarios, but this embodiment does not limit this.

[0043] Optionally, the driving assembly 4 further includes a reset member 44 for driving the eye-tracking camera 5 to rotate or move from the second position toward the first position. The reset member 44 includes at least one of an elastic member, a second magnetic member, and a second electromagnetic structure 440. The reset member 44 is located on the other side of the eye-tracking camera 5 away from the first electromagnetic structure 4200, so as to drive the eye-tracking camera 5 to rotate or move toward the first position to reset when the first electromagnetic structure 4200 is de-energized or the electromagnetic force is reduced.

[0044] For reference Figure 9 and Figure 10 This invention, through the addition of a reset component 44, provides an active, controllable, and reliable restoring force for the eye-tracking camera 5 to return from the second position to the first position, thereby constructing a complete, stable, and energy-efficient bidirectional motion system. This design ensures that position-switching-based eye tracking can be executed continuously, cyclically, and accurately, which is key to achieving long-term system reliability. By providing multiple optional reset methods such as elastic components, second magnetic components, and second electromagnetic structures 440, this solution can optimize configuration for the differentiated needs of different products in terms of power consumption, cost, response speed, and control accuracy, further improving the energy efficiency, lifespan, and overall performance of the entire eye-tracking module while ensuring core functionality.

[0045] Specifically, the reset element 44 provides a restoring force that always points to the first position. When the first electromagnetic structure 4200 is de-energized or its electromagnetic force decreases below the reset force, the reset element 44 immediately drives the eye-tracking camera 5 back from the second position to the first position. This allows the camera to form an infinitely repeatable reciprocating motion between the first and second positions, which is the physical basis for the continuous operation of human eye tracking. Through the mechanical design of the reset element 44 (such as the preload of an elastic element or the balance position of a permanent magnet), the first position is defined as a stable mechanical equilibrium point. This provides the system with a deterministic "zero" position that does not require power maintenance, greatly simplifying the logic of power-on initialization, position calibration, and fault recovery, and enhancing the system's self-recovery capability. When the head-mounted display device is subjected to vibration or accidental contact, the restoring force of the reset element 44 can automatically correct the accidental offset of the eye-tracking camera 5, causing it to quickly return to the first position, preventing tracking interruption due to pose inaccuracies, and improving the robustness of the system in dynamic usage environments.

[0046] Meanwhile, the driving component 42 provides driving thrust, and the resetting component 44 provides resetting force. These two components act on the eye-tracking camera 5 and the connected mounting bracket and rotating shaft 41 on both sides, forming a symmetrical force couple or push-pull structure. This makes the moving parts more evenly stressed, effectively reducing the risk of lateral sway and jamming during movement, ensuring that the camera's rotation or movement trajectory is straight and stable, which is beneficial for high-precision positioning.

[0047] When the first electromagnetic structure 4200 is energized to drive the eye-tracking camera 5 to the second position, or to drive the eye-tracking camera 5 to move to the second position against the force of the reset member 44, part of the electrical energy is converted into the kinetic energy of the camera, and part is converted into potential energy (such as elastic potential energy) stored in the reset member 44. When a reset is required, it is only necessary to cut off or reduce the current of the first electromagnetic structure 4200, and the stored potential energy is released by the reset member 44, efficiently driving the camera back to the first position. This significantly reduces the energy required for active reset, making the power consumption of the system extremely low during standby and reset phases.

[0048] In specific application scenarios, the reset component 44 can be selected from at least one of an elastic component, a second magnetic component, and a second electromagnetic structure 440; this embodiment does not limit this selection. Specifically, an elastic component (such as a miniature torsion spring, tension spring, or leaf spring) is used, which is the simplest, lowest-cost, and most reliable passive reset solution. The elastic component provides a linear restoring force proportional to the displacement, making the reset process smooth, predictable, and requiring no control circuitry. Its "fail-safe" characteristic ensures that even if the circuit of the drive component 4 completely fails, the camera can return to the first position under the action of the elastic force, maximizing the basic availability of the system. A second magnetic component (such as a permanent magnet) is used: this solution utilizes the attractive or repulsive forces between magnets to achieve non-contact reset. For example, a second magnetic component is set on the moving part of the camera, interacting with another magnet or magnetic conductor fixed on the support 10. This method is completely frictionless, wear-free, has an extremely long lifespan, and provides a rapid reset response. Through the ingenious design of the magnetic poles, precise "magnetic lock" positioning can be achieved in the first position, maintaining a strong and stable holding force. A second electromagnetic structure 440 is employed: This provides active, programmable reset control capability. The second electromagnetic structure 440 can be energized independently and works in conjunction with the first electromagnetic structure 4200 to achieve precise dynamic control of the camera's motion speed, acceleration, stopping position, and holding force. This solution can achieve the most complex motion curves and dynamic hovering at any position, making it suitable for scenarios with extreme requirements for tracking performance and adaptability, but the control is relatively complex.

[0049] In specific application scenarios, the position of the eye-tracking camera 5 can be adjusted by changing the magnetic attraction force of the first electromagnetic structure 4200 and / or the magnetic attraction force of the second electromagnetic structure 440. (See reference...) Figure 7 and Figure 8 The position of the eye-tracking camera 5 can be continuously and flexibly adjusted and controlled via electrical signals. This not only compensates for positional errors caused by manufacturing tolerances, temperature drift, or mechanical wear in real time, ensuring long-term tracking accuracy, but also allows for dynamic optimization of the observation point based on individual user differences (such as interpupillary distance) or specific application scenarios, thereby improving the adaptability, accuracy, and intelligence of eye tracking in head-mounted displays.

[0050] Specifically, when the eye-tracking camera 5 is stationary, it is in force balance. The magnetic attraction force F1 provided by the first electromagnetic structure 4200 is equal in magnitude and opposite in direction to the magnetic attraction force F2 provided by the second electromagnetic structure 440. When the eye-tracking camera 5 needs to rotate, for example, when it needs to turn towards the first electromagnetic structure 4200, F1 can be increased only, F2 can be decreased only, or both can be increased and decreased, thus causing the eye-tracking camera 5 to rotate through a specified angle. By coordinating and controlling the magnetic attraction forces of the two electromagnetic structures, the camera can overcome the reset force and stably remain at any intermediate point between the first and second positions. This makes it possible to track minute eye movements or achieve smoother scanning observations.

[0051] Secondly, for users with larger or smaller interpupillary distances, their eyes will shift relative to the geometric center of the device support 10. In this case, the system can automatically calculate and adjust the electromagnetic force balance points corresponding to the first and second positions based on the interpupillary distance data input by the user or through preliminary image analysis. This ensures that the optimal observation point of the camera accurately matches the physiological position of the user's eyeballs, solving the adaptation problem and enabling all users to obtain the same high-quality tracking experience.

[0052] In an alternative embodiment, reference may be made to Figure 13 The first electromagnetic structure 4200 includes an electromagnetic component 42001, a coil 42002, a first flexible circuit board 42003, a housing 42004, and a reinforcing component 42005. The coil 42002 is wound around the electromagnetic component 42001, with one end of the electromagnetic component 42001 exposed above the coil 42002. Both the coil 42002 and the electromagnetic component 42001 are mounted on the housing 42004. The first flexible circuit board 42003 is connected to the ends of the coil 42002 and the electromagnetic component 42001 that are away from the first magnetic component 4201, so that when the first flexible circuit board 42003 is energized, the electromagnetic component 42001 drives the eye-tracking camera 5 to move. The reinforcing component 42005 is connected to the first flexible circuit board 42003 and is respectively disposed opposite to the ends of the coil 42002 and the electromagnetic component 42001 that are away from the first magnetic component 4201 on both sides of the first flexible circuit board 42003.

[0053] Specifically, coil 42002 is wound around electromagnetic component 42001, with one end of electromagnetic component 42001 exposed above coil 42002. This is a typical "electromagnet" or "sowary" configuration, where electromagnetic component 42001 (usually a soft magnetic material with high permeability, such as permalloy or electrical pure iron) acts as the magnetic core, providing a low-resistivity path for the magnetic field generated by energizing coil 42002, significantly converging and enhancing magnetic lines of force, making the magnetic field more concentrated. Compared to hollow coil 42002, under the same current and number of turns, the first electromagnetic structure 4200 with a magnetic core can generate several to ten times the magnetic attraction force. This means that the eye-tracking camera 5 can be driven with a smaller current, directly reducing system power consumption and allowing the use of thinner coil 42002 wires, further reducing size. The design of one end of the electromagnetic component 42001 being exposed above the coil 42002 allows the magnetic lines of force to be highly concentrated and directionally emitted at the exposed end (i.e., the working end face interacting with the first magnetic component 4201), forming an effective "magnetic pole". This optimizes the magnetic coupling efficiency with the first magnetic component 4201 (such as a permanent magnet on a mover), reduces magnetic field leakage, makes the direction of the driving force clear and controllable, and improves energy conversion efficiency and the certainty of the action.

[0054] Inside the support portion 10 of the frame 1, the space is irregular and extremely limited in height. Traditional rigid printed circuit boards are difficult to bend and fit into the space. The first flexible circuit board 42003 has the advantages of being flexible, foldable, and extremely thin (typically less than 0.2 mm), which can be perfectly meandered into narrow spaces to lead the power and control signals of the main control board to the first electromagnetic structure 4200. This greatly simplifies the internal wiring complexity, saves valuable space, and significantly reduces the weight of the connection parts.

[0055] At the solder joint between the coil 42002 and the electromagnetic component 42001, the first flexible circuit board 42003 needs to withstand electrical current (which may generate heat) and potential mechanical stress (such as the reaction force transmitted when the camera moves or assembly stress). The design of the reinforcement 42005 not only prevents the solder joint from cracking due to frequent bending or vibration of the first flexible circuit board 42003, but also provides a stable base for the soldering operation, improving the production yield.

[0056] The outer casing 42004 is typically a precision injection-molded plastic or metal part that encapsulates the coil 42002 and the electromagnetic component 42001, preventing contaminants such as dust and sweat from entering and causing short circuits or corrosion, thus improving the module's environmental adaptability and lifespan. Furthermore, in specific application scenarios, the outer casing 42004 itself has snap-fit, stud, or adhesive surfaces for connection with the support part 10 or the fixing part 43, allowing the entire first electromagnetic structure 4200 to be installed quickly and accurately into equipment as a standardized, easily assembled module, achieving modular production.

[0057] Optionally, the driving assembly 4 includes a rotating bracket 40, to which the eye-tracking camera 5 is fixed. The rotating bracket 40 is rotatably connected to the support portion 10, such that the eye-tracking camera 5 is rotatably connected to the support portion 10 via the rotating bracket 40. The driving assembly 4 includes a first electromagnetic structure 4200, a second electromagnetic structure 440, and a first magnetic element 4201. The first electromagnetic structure 4200 and the second electromagnetic structure 440 are respectively fixed on opposite sides of the eye-tracking camera 5, and the first magnetic element 4201 is fixed to the rotating bracket 40. When the first electromagnetic structure 4200 is energized, the first electromagnetic structure 4200 and the first magnetic element 4201 repel or attract each other to drive the eye-tracking camera 5 to rotate from a first position to a second position. When the second electromagnetic structure 440 is energized, the second electromagnetic structure 440 and the first magnetic element 4201 repel or attract each other to drive the eye-tracking camera 5 to rotate from a second position to a first position.

[0058] For reference Figures 8 to 13 This invention utilizes a non-contact coupling between an independent first electromagnetic structure 4200 and a second electromagnetic structure 440, and a shared first magnetic element 4201, to achieve bidirectional active control of the eye-tracking camera 5's rotation between a first position and a second position. This not only simplifies and compacts the drive system structure to the greatest extent, achieving millisecond-level response speed and silent operation, but also enables the eye-tracking camera 5 to precisely hover and dynamically adjust at any intermediate angle through bidirectional independent electromagnetic force control. This solution improves the dynamic tracking performance and reliability of the eye-tracking camera 5 while reducing the size, weight, and power consumption of the drive component 4.

[0059] Specifically, by simultaneously adjusting the currents of the two electromagnetic structures to balance the torques they generate on the first magnetic component 4201, the eye-tracking camera 5 can be stably maintained at any angle between the first and second positions. When it is necessary to drive the camera from the first position to the second position, only the first electromagnetic structure 4200 is energized, causing it to generate a repulsive or attractive magnetic force with the first magnetic component 4201. This magnetic force acts on the lever arm of the rotating bracket 40, forming a driving torque. Conversely, when driving back, only the second electromagnetic structure 440 is energized. Movement in both directions is actively and precisely controlled by electromagnetic force. This not only eliminates the fatigue and wear problems that may be caused by the reset component 44, but also enables optimized acceleration curve control in both directions during the movement process.

[0060] The driving force is transmitted through a magnetic field, and there is no physical contact between the first electromagnetic structure 4200, the second electromagnetic structure 440, and the first magnetic component 4201. The establishment and disappearance of the magnetic field depends on the movement of electrons, with an extremely short response time (microseconds to milliseconds), allowing the eye-tracking camera 5 to start and stop almost instantaneously. Furthermore, no contact means no friction and no wear, resulting in a near-infinite mechanical lifespan for the driving component 4 itself, and extremely high reliability.

[0061] Secondly, this embodiment eliminates a series of complex mechanical components such as motors, gearboxes, lead screws, and return springs. This allows the drive assembly 4 to be extremely thin in the axial direction of the rotation shaft 41, resulting in an exceptionally simple overall structure and extremely light weight, which is highly advantageous for achieving concealed integration within the narrow space of the frame 1.

[0062] Optionally, the support part 10 is further provided with a limiting block 100, which is fixedly connected to the support part 10 and is used to limit the eye-tracking camera 5 from rotating between the first position and the second position.

[0063] For reference Figure 11 This embodiment of the invention, by setting a limit stop 100, avoids the risk of excessive rotation of the eye-tracking camera 5 due to control abnormalities, external interference, or deviations in force balance calculations, ensuring that the range of motion is strictly constrained within the designed safe and effective range. This not only directly protects the eye-tracking camera 5 and its drive component 4 from damage caused by mechanical impact or jamming, improving the overall reliability and durability of the system, but also provides a physical reference benchmark for high-precision electromagnetic control, simplifies the control logic, and optimizes the assembly process.

[0064] Specifically, regardless of the control system's state, the limit stop 100 can rigidly prevent the eye-tracking camera 5 from moving further when its rotation angle reaches its design limit, greatly reducing the probability of hardware damage due to accidental overshoot. With reliable mechanical limiting, the control algorithm can be designed to be more aggressive and efficient. For example, when a rapid switch to the first position is needed, the drive component 4 can be instructed to drive with a larger current; even with the risk of overshoot, the limit stop 100 provides a final safeguard. This allows the system to pursue faster switching speeds without being overly conservative. Simultaneously, when implementing the aforementioned precise control of "adjusting position by adjusting electromagnetic force," the presence of the limit stop 100 clearly defines the adjustment range boundaries, preventing the target position of the eye-tracking camera 5 from being set in a physically inaccessible area due to algorithm errors.

[0065] In specific application scenarios, when the eye-tracking camera 5 rotates to the first position, the limiting block 100 abuts against the side of the rotating bracket 40 closest to the first position to limit its movement; when the eye-tracking camera 5 rotates to the second position, the limiting block 100 abuts against the other side of the rotating bracket 40 closest to the second position to limit its movement. This embodiment eliminates positional uncertainties that may arise from flexible or indirect limiting, and by applying the limiting force directly to the robust rotating bracket 40 rather than the delicate camera module, it achieves optimized force distribution, effectively protecting the core optical sensing element and simplifying the structural design of related components.

[0066] Specifically, setting the limiting contact point on the rotating bracket 40 means that when a limiting collision occurs, the impact force will be directly absorbed by the rotating bracket 40 and transmitted and dissipated through its rotating connection point with the support part 10. This force flow path is the shortest and most direct, avoiding the transmission of impact force to the mounting interface or internal precision optical / electronic components of the eye-tracking camera 5 itself, thereby minimizing the risk of optical alignment misalignment, loose connection, or sensor damage to the eye-tracking camera 5 caused by frequent limiting impacts.

[0067] As a mechanical component, the rotating bracket 40 can be easily machined with flat, vertical contact surfaces on its sides, or specially designed with bosses or ribs for limiting movement. This allows the limiting stop 100 to provide an equally flat abutting surface, forming a large-area surface contact or stable line contact. This contact method offers higher stability, lower contact stress, and longer wear life compared to point contact or irregular curved surface contact, ensuring the stability and consistency of the limiting action.

[0068] In an optional embodiment, the support portion 10 includes a mounting groove 101 recessed in the frame 1, the drive assembly 4 and the limiting block 100 are both located within the mounting groove 101, and the eye-tracking camera 5 is rotatably connected to the support portion 10 via the drive assembly 4.

[0069] For reference Figure 11 In this embodiment of the invention, a physical space specifically designed to accommodate the eye-tracking drive system is actively created within the frame 1 structure, housing all motion, transmission, and limiting components within a controlled recessed environment. This not only achieves an extremely simple and flat appearance for the device, effectively protecting the precision mechanism from external bumps and contamination, but also significantly optimizes the relative positioning accuracy and assembly process of each component through predefined three-dimensional spatial constraints, thereby significantly improving the overall rigidity, reliability, and production consistency of the module.

[0070] Specifically, the drive component 4, limit stop 100, and other structures are embedded in the mounting slot 101, so that these components do not protrude from the outer surface of the frame 1. This ensures that the appearance of the head-mounted display device is highly consistent with ordinary glasses or existing AR devices, with no obtrusive exposed mechanical structures, meeting the aesthetic requirements of consumer electronics products. At the same time, the flat surface avoids snagging on clothing or hair, and also eliminates the risk of users touching or accidentally hitting moving parts, improving wearing safety and user experience. The side walls and bottom of the mounting slot 101 naturally form a protective structure surrounding the drive mechanism. It can effectively block dust, sweat, moisture, and direct contact with fingers during daily use, providing a relatively clean and dry working environment for the internal precision rotating shaft 41, electromagnetic structure, rotating bracket 40, and other moving parts, greatly reducing the probability of jamming, wear, or short circuits caused by contamination, and significantly improving the module's environmental tolerance and long-term reliability.

[0071] Optionally, the head-mounted display device further includes a first supplementary light component 6 and a second supplementary light component 7 disposed on the support portion 10. The first supplementary light component 6 and the second supplementary light component 7 are respectively disposed on the first side 50 and the second side 51 of the eye-tracking camera 5, and the first side 50 and the second side 51 are opposite sides of the eye-tracking camera 5. When the driving component 4 drives the eye-tracking camera 5 to rotate or move to face the user's first eye A, the first supplementary light component 6 emits light, and the second supplementary light component 7 does not emit light. When the driving component 4 drives the eye-tracking camera 5 to rotate or move to face the user's second eye B, the first supplementary light component 6 does not emit light, and the second supplementary light component 7 emits light.

[0072] For reference Figure 14 This invention provides independent, directional supplementary lighting for the first eye (A) and the second eye (B), activating only when needed. This ensures that the eye-tracking camera 5 provides optimal illumination for the target eye in any working position, significantly improving the feature contrast and signal-to-noise ratio of the eye image. This not only completely solves the problems of pupil feature crosstalk, image overexposure, or uneven illumination that may arise from simultaneous binocular illumination, making the detection of key features such as the pupil center and corneal reflection point more accurate and reliable, but also reduces the power consumption of the supplementary lighting system through a time-division and zone-division illumination strategy. Furthermore, it effectively reduces the potential interference of ineffective light on the user's visual experience, ultimately providing support for high-precision, robust, and low-power eye tracking from the optical imaging source level.

[0073] Specifically, when the camera is confirmed to be in position and aimed at the first eye A, the first supplementary lighting component 6 emits light to illuminate the first eye A; at this time, the second supplementary lighting component 7 does not emit light. Conversely, when the camera is aimed at the second eye B, the second supplementary lighting component 7 is activated, and the first supplementary lighting component 6 is deactivated. When a single light source illuminates both eyes simultaneously, the cornea of ​​each eye reflects not only the illumination from its own side but may also reflect weak light from the illumination from the opposite side, forming interfering "ghost" reflection points in the image of the opposite eye, which can be confused with the real corneal reflection points, leading to feature misjudgment. The time-division and zone-division illumination of this invention fundamentally eliminates this cross-illumination, ensuring that in the image captured by the eye-tracking camera 5, the image of the first eye A contains only the optical features generated by the first supplementary lighting component 6, and the image of the second eye B contains only the optical features generated by the second supplementary lighting component 7, resulting in unique, clear, and crosstalk-free features.

[0074] Compared to traditional supplemental lighting that operates continuously at full power for both eyes, this solution uses a first supplemental lighting component 6 and a second supplemental lighting component 7 that operate alternately with a duty cycle of approximately 50%. Assuming each component has the same power, the average power consumption of the system's supplemental lighting module can be reduced by about 50%. This is crucial for head-mounted devices with limited battery capacity, effectively extending battery life.

[0075] In specific application scenarios, infrared light, invisible to the human eye, is typically used for supplemental lighting. However, excessively strong or scattered infrared light may still be perceived as a faint halo by the user's surrounding vision, or it may cause glare on some imaging sensors. By strictly limiting the illumination to the target eye area and turning off the light source on the other side, the leakage of ineffective infrared light is minimized, reducing potential interference with the user's visual experience and improving user comfort and privacy.

[0076] Optionally, the first supplementary lighting component 6 includes a first supplementary light 60 and a second supplementary light 61, and the second supplementary lighting component 7 includes a third supplementary light 70 and a fourth supplementary light 71; the first supplementary light 60 and the second supplementary light 61 are respectively disposed on the third side 52 and the fourth side 53 of the eye-tracking camera 5, and the third supplementary light 70 and the fourth supplementary light 71 are respectively disposed on the third side 52 and the fourth side 53 of the eye-tracking camera 5; the third side 52 and the fourth side 53 are another pair of opposite sides of the eye-tracking camera 5.

[0077] For reference Figure 14This invention further defines the first supplementary lighting component 6 and the second supplementary lighting component 7 as each containing two supplementary lights, and groups these four supplementary lights in pairs, respectively positioned on the third side 52 and the fourth side 53 of the eye-tracking camera 5. This upgrades monocular supplementary lighting from a single-source, fixed-angle illumination mode to a multi-source, multi-angle composite illumination mode. This not only significantly improves the uniformity and three-dimensionality of eye illumination, effectively eliminates the heavy shadows produced by a single source, and enhances the contrast and detectability of key optical features (such as the pupil edge and corneal reflection point), but also greatly improves the adaptability and robustness of the lighting system to different user physiological structures (such as deep eye sockets and long eyelashes) and wearing conditions (such as eyeglass reflections) through the redundant design and flexible combination of multiple light sources.

[0078] Specifically, the pupil is a three-dimensional opening, and light from a single angle may only illuminate part of its edge. Two supplementary lights are configured for each eye (e.g., a first supplementary light 60 and a second supplementary light 61 for the left eye), and they are positioned on different sides of the camera (a third side 52 and a fourth side 53). When these two supplementary lights are illuminated simultaneously or in a specific ratio, light enters the eyeball from two different spatial directions, complementing each other and filling in the shadow areas caused by a single light source, resulting in more uniform illumination of the entire visible eyeball area (including the iris and sclera). This helps the image sensor capture more detail and reduces feature loss due to localized areas of excessive darkness or brightness.

[0079] In specific application scenarios, the system can intelligently select which supplementary lights to illuminate. For example, when tracking the left eye, the first supplementary light 60 and the second supplementary light 61, located above and below the left eye area, are simultaneously illuminated to achieve uniform stereoscopic illumination. When the system detects that the user's upper eyelid is drooping or long eyelashes are severely obstructing the light path from the upper (third side 52) light source, the system can automatically turn off the first supplementary light 60 (assuming it is located on the upper side) and only retain the second supplementary light 61 from the lower (fourth side 53) light source. Although this sacrifices some uniformity, it ensures the clear visibility of the core features (lower half of the pupil) and maintains the continuity of tracking. For users who wear glasses, the system can try to illuminate the supplementary lights in different positions in turn. Through image analysis, it can identify which light source (or light sources) produces the least interference with the image due to lens reflection, and then fix this lighting combination to achieve personalized anti-reflection optimization. Furthermore, the system can not only control the on / off state of the supplementary lights but also independently adjust the current (brightness) of each light. For example, considering the difference in reflectivity of infrared light between the user's left and right eyes (which may be due to differences in pigment depth), the total brightness of the two lamps in the first supplementary lighting component 6 and the two lamps in the second supplementary lighting component 7 can be set independently to make the images of both eyes reach similar ideal brightness levels, simplifying subsequent image processing.

[0080] Optionally, a movable infrared fill light 8 is also included. The eye-tracking camera 5 is connected to the movable infrared fill light 8. As the eye-tracking camera 5 rotates or moves, the movable infrared fill light 8 follows the movement of the eye-tracking camera 5.

[0081] For reference Figure 15 and Figure 16 This invention, through the inclusion of a movable infrared supplementary light 8 that moves with the eye-tracking camera 5, ensures that the relative spatial position between the supplementary light source and the imaging visual axis is maintained or controlled to adjust during camera movement. This guarantees that, regardless of whether the target eye region is in the first or second position, and regardless of eye movement, it always receives the optimal illumination angle and intensity for the current camera's field of view. This solves the problems of illumination angle failure, deteriorated shadow distribution, or decreased feature contrast that may occur with fixed supplementary lights after large-scale camera movement, providing all-weather, all-view stable, high-quality optical imaging conditions for dynamic monocular tracking systems.

[0082] Specifically, the eyeball is a sphere, and when a camera changes from a frontal view to a side view, the direction of the normal to the surface of the eyeball changes accordingly. A fixed light source cannot adapt to this change. A movable light source can follow the adjustment of the camera's viewing angle, dynamically "navigating" to the optimal illumination side of the currently visible area of ​​the eyeball, ensuring that light enters the cornea and iris at the most effective angle, maximizing feature visibility, and reducing uneven illumination or overexposure caused by the curvature of the eyeball.

[0083] The movable infrared fill light 8 is connected to the eye-tracking camera 5 and follows its movement during rotation or movement. This means that the movable infrared fill light 8 and the camera form a moving unit, or that their poses change synchronously through control linkage. When the eye-tracking camera 5 is driven by the drive component 4 and rotates from a first position to a second position, its spatial orientation changes drastically. If the fill light remains stationary, its angle relative to the optical axis of the eye-tracking camera 5 in the new position will completely change, potentially causing the illumination angle to deviate from the optimal value, severely affecting the quality of pupil contrast and corneal reflection points. However, the movable infrared fill light 8, by following the movement, ensures that regardless of which eye the eye-tracking camera 5 is pointing at, the infrared fill light always maintains a preset optimal off-axis angle (e.g., always located 30 degrees above and to the right of the camera), thus providing the algorithm with consistent and highly predictable optical feature input.

[0084] In an optional embodiment, a second flexible circuit board 9 is also included. The eye-tracking camera 5 is connected to the second flexible circuit board 9, and a movable infrared fill light 8 is fixed to the second flexible circuit board 9. During the rotation or movement of the eye-tracking camera 5, the movable infrared fill light 8 follows the movement of the eye-tracking camera 5.

[0085] For reference Figure 15 and Figure 16 In this embodiment of the invention, a second flexible circuit board 9 is provided, which simultaneously transmits signals to the eye-tracking camera 5 and supplies power to the fill light. When the eye-tracking camera 5 and the movable infrared fill light 8 are rotated or moved frequently as a whole motion unit, the internal electrical connection has extremely high fatigue resistance and signal integrity, thereby stably maintaining the coordinated performance of lighting and imaging during long-term dynamic use.

[0086] Specifically, traditional connection methods might require separate cables and mounting brackets for the eye-tracking camera 5 and the movable infrared fill light 8, resulting in significant space consumption, weight, and messy wiring. The second flexible circuit board 9 integrates power lines, data lines, control lines, and mechanical support functions onto an ultra-thin (typically less than 0.2 mm) flexible substrate, achieving "zero volume increase" in electrical connection and mechanical support, minimizing the size and weight of the movable module. Furthermore, the trace impedance on the flexible circuit board is controllable and the layout is fixed, reducing signal noise and electromagnetic interference that may be caused by wiring harness movement. Transmitting high-speed image signals to the eye-tracking camera 5 and providing pulsed drive current to the movable infrared fill light 8 can both be completed within a stable, well-shielded channel, ensuring signal quality and contributing to improved image clarity and the precision of lighting control.

[0087] In specific application scenarios, the second flexible circuit board 9 can use flexible substrates such as polyimide, and its copper foil traces can be specially designed (such as serpentine traces and reinforcing ribs) to withstand repeated bending. When the entire module rotates with the rotating bracket 40, the second flexible circuit board 9 undergoes compliant elastic deformation in the preset bending area (such as the root near the axis of rotation), rather than being rigidly stretched, thereby evenly distributing stress and avoiding wire breakage caused by localized stress concentration. This makes its bending life far exceed that of ordinary cables, ensuring the connection reliability of the product throughout its life cycle.

[0088] In an optional embodiment, the frame 1 further includes a housing 11, which covers one side of the drive assembly 4 and / or the eye-tracking camera 5; the housing 11 includes a light-transmitting portion 110, which is opposite to the eye-tracking camera 5, so that the eye-tracking camera 5 can capture images of the user's first eye A or second eye B during rotation or movement.

[0089] For reference Figure 9 and Figure 10This invention, through the housing 11, integrates the exposed drive assembly 4 and eye-tracking camera 5 into a controlled, sealed or semi-sealed space. This not only provides comprehensive physical protection for the internal precision components (such as the rotating bracket 40, electromagnetic structure, and eye-tracking camera 5), ​​preventing dust, sweat intrusion, and accidental contact damage, but also provides a viewing port for the eye-tracking camera 5 by providing a light-transmitting part 110, ensuring that the eye-tracking camera 5 can capture images of the user's first eye (A) or second eye (B) without obstruction. Simultaneously, it achieves a complete, smooth, and aesthetically pleasing device appearance, significantly improving the product's environmental adaptability, durability, safety, and market acceptance.

[0090] Specifically, head-mounted display devices inevitably experience minor bumps, friction, or accidental touches from users' fingers during daily use. Exposed rotating brackets 40 or camera lenses are highly susceptible to damage or misalignment as a result. The housing 11, acting as a robust outer shell, withstands and disperses external impacts and pressures, providing direct cushioning and protection for internal core components. This prevents mechanical damage or accuracy loss due to accidental physical contact, enhancing the product's durability and resistance to rough handling. Simultaneously, the housing 11 ensures that the user's skin (such as temples or eyebrows) or hair does not come into contact with the high-speed moving rotating brackets 40 or other components, eliminating the risk of pinching or pulling and improving product safety.

[0091] A light-transmitting portion 110 is provided on the housing 11, and the light-transmitting portion 110 is opposite to the eye-tracking camera 5. In specific application scenarios, the position and size of the light-transmitting portion 110 can be precisely calculated to ensure that when the eye-tracking camera 5 rotates or moves between the first position and the second position under the drive of the drive component 4, the light path in front of its lens can always reach the user's eye unobstructed through the light-transmitting portion 110. The light-transmitting portion 110 can be made of optical-grade resin or glass with high light transmittance and low birefringence, and can be coated with an anti-reflection film to reduce surface reflection and improve the transmittance of infrared light (which is crucial for systems using infrared supplementary lighting). Its inner and outer surfaces can be designed as specific curved surfaces to correct or match the field of view of the camera lens and reduce edge aberrations. This embodiment does not specifically limit this.

[0092] Optionally, when the eye-tracking camera 5 rotates to face the user's first eye A or moves closer to the first display component 2, the eye-tracking camera 5 acquires a first image of the user's first eye A; it confirms whether the pupil of the first eye A in the first image is located in the shooting degradation area of ​​the eye-tracking camera 5 based on the pupil position information and / or pupil outline information of the first eye A in the first image; if the pupil in the first image is located in the shooting degradation area of ​​the eye-tracking camera 5, the eye-tracking camera 5 is driven to rotate to face the user's second eye B, or driven to move closer to the second display component 3, and the eye-tracking camera 5 is controlled to acquire a second image of the second eye B; if the pupil in the first image is located outside the shooting degradation area of ​​the eye-tracking camera 5, the eye-tracking camera 5 remains facing the user's first eye A.

[0093] This invention, through real-time analysis of the pupil's position and shape in the image captured by the eye-tracking camera 5, proactively determines whether the current imaging has entered or is about to enter a degradation zone, and decides whether to maintain the current tracking state or immediately drive the eye-tracking camera 5 to switch to tracking the opposite eye. This method fully utilizes the dynamic capabilities provided by the hardware, achieving a leap from "fixed position switching" to "on-demand switching based on image quality feedback," thereby dynamically and accurately avoiding degradation zones at the system level. This ensures optimal image quality tracking under any user condition, ultimately maximizing the overall tracking accuracy, robustness, and system energy efficiency.

[0094] Specifically, eye-tracking camera 5 first tracks the first eye A, acquires the first image, and immediately performs image processing to extract key pupil position information (such as image plane coordinates) and pupil contour information (such as ellipse fitting parameters, ellipticity, and contour sharpness). When the pupil information shows that the pupil in the first image is in the degraded imaging zone of eye-tracking camera 5, the driving component 4 drives eye-tracking camera 5 to rotate to the second eye B. According to the conjugate principle of binocular motion, when the first eye A enters the degraded imaging zone due to rotation to its limit, the second eye B is usually in a position relatively facing the camera, in the "high-quality imaging zone." The second image acquired after switching to the second eye B is of higher quality, and the gaze direction calculated based on this image is more accurate. Combined with the binocular motion model, the gaze of the first eye A can be inferred. When the pupil information shows that the first image is well-imaged and its pupil is not in the degraded imaging zone of eye-tracking camera 5, the current state is maintained.

[0095] Optionally, determining whether the pupil of the first eye A in the first image is located within the image degradation zone of the eye-tracking camera 5 based on the pupil position information and / or pupil contour information in the first image includes: obtaining the major and minor axis dimensions of the ellipse fitting curve of the pupil contour based on the pupil contour information; if the ratio of the major axis dimension to the minor axis dimension is less than or equal to 0.3, determining that the pupil in the first image is located within the image degradation zone of the eye-tracking camera 5; if the ratio of the major axis dimension to the minor axis dimension is greater than 0.3, determining that the pupil in the first image is located within the image degradation zone of the eye-tracking camera 5. Outside the image degradation zone; and / or, based on pupil position information, determine whether the pupil center position in the first image is within a preset pupil center imaging area. If the pupil center position is within the preset pupil center imaging area, determine that the pupil in the first image is within the image degradation zone of the eye-tracking camera 5; if the pupil center position is outside the preset pupil center imaging area, determine that the pupil in the first image is outside the image degradation zone of the eye-tracking camera 5. The preset pupil center imaging area is obtained based on the pupil center imaging positions of the pupils in multiple pre-captured images of the first eye A.

[0096] This invention provides a clear, calculable, and robust binary criterion for the crucial decision-making step of "determining whether the pupil is located in a degraded imaging zone" by specifically quantifying the ratio of the major axis to the minor axis of the pupil contour ellipse fitting curve and comparing the pupil center position with a preset pupil center imaging area. This method transforms the abstract assessment of image quality into measurable geometric and positional parameters, achieving objectivity, standardization, and efficiency in the judgment process. This not only makes the decision logic of the control system clear and reliable, greatly reducing the probability of misjudgment and missed judgment, but also, through the introduction of a preset statistical region, makes the judgment standard inclusive of different users' physiological characteristics. This method ensures that the system can trigger the switching action of the eye-tracking camera 5 at the most appropriate time, thereby accurately avoiding degraded imaging zones while minimizing unnecessary hardware actions and optimizing the overall tracking accuracy, response speed, and energy efficiency of the system.

[0097] Specifically, when the pupil is facing the camera directly, it appears as a near-circle, with a major-to-minor axis ratio close to 1. As the eye moves and the camera's viewing angle tilts, the pupil's projection in the image gradually becomes an ellipse. The more the viewing angle deviates, the flatter the ellipse becomes, and the smaller the major-to-minor axis ratio becomes. Therefore, the major-to-minor axis ratio is a direct and sensitive geometric measure representing the angle between the line of sight of the current eye-tracking camera and the optical axis of the eye. Based on extensive experimental data calibration, when the major-to-minor axis ratio is below 0.3, the elliptical distortion of the pupil is quite severe, leading to two consequences: first, the algorithm errors for pupil edge detection and ellipse fitting will increase significantly, affecting the accuracy of center positioning; second, the excessively flattened ellipse will lose the number of effective pixels that can be used for fitting, reducing the robustness of the algorithm.

[0098] Alternatively, at least 10,000 different images of the image degradation zone can be pre-collected, and the imaging position of the pupil center in the images can be statistically analyzed. Based on the imaging position, a preset pupil center imaging area can be determined. It is determined whether the pupil center imaging position in the first image captured by the eye-tracking camera 5 is within the preset pupil center imaging area. If it is within the preset pupil center imaging area, the pupil in the first image is located in the image degradation zone of the eye-tracking camera 5, and the driving component 4 drives the eye-tracking camera 5 to rotate to the second eye B; if it is not within the preset pupil center imaging area, the pupil in the first image is not located in the image degradation zone of the eye-tracking camera 5, the first image is well-imaged, and the eye-tracking camera 5 remains in its current state.

[0099] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0100] Although alternative embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make further changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the alternative embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.

[0101] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used merely to distinguish one entity from another, and do not necessarily require or imply any such actual relationship or order between these entities. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or terminal device that includes that element.

[0102] The technical solution provided by the present invention has been described in detail above. Specific examples have been used to illustrate the principle and implementation of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the principle and implementation of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A head-mounted display device, characterized in that, include: The frame (1) has a support (10). The first display component (2) is disposed in the frame (1); The second display component (3) is disposed on the frame (1), and the first display component (2) and the second display component (3) are located on opposite sides of the support (10); Drive component (4), which is fixed to the support part (10); An eye-tracking camera (5) is connected to the drive assembly (4), which drives the eye-tracking camera (5) to move or rotate.

2. The head-mounted display device according to claim 1, characterized in that, The drive component (4) drives the eye-tracking camera (5) to move or rotate between the first position and the second position: When the eye-tracking camera (5) is in the first position, the eye-tracking camera (5) rotates to face the user's first eye (A) or the eye-tracking camera (5) moves closer to the first display component (2) to obtain an image of the user's first eye (A); When the eye-tracking camera (5) is in the second position, the eye-tracking camera (5) rotates toward the user's second eye (B) or the eye-tracking camera (5) moves toward the second display component (3) to obtain an image of the user's second eye (B).

3. The head-mounted display device according to claim 1, characterized in that, The driving component (4) drives the eye-tracking camera (5) to rotate, and the driving component (4) includes: Rotating bracket (40) is used to fix the eye-tracking camera (5); A rotating shaft (41) is fixedly connected to the rotating bracket (40), and the rotating shaft (41) is rotatably connected to the support part (10); The driving component (42) is used to drive the rotating shaft (41) to drive the rotating bracket (40) to rotate relative to the support part (10), thereby driving the eye-tracking camera (5) to rotate; or The driving component (4) drives the eye-tracking camera (5) to rotate, and the driving component (4) includes: Rotating bracket (40) is used to fix the eye-tracking camera (5); A rotating shaft (41) is rotatably connected to the rotating bracket (40), and the rotating shaft (41) is fixedly connected to the support part (10); The driving component (42) is used to drive the rotating bracket (40) to rotate around the rotating shaft (41), thereby driving the eye-tracking camera (5) to rotate.

4. The head-mounted display device according to any one of claims 1 to 3, characterized in that, The drive assembly (4) includes a drive member (42) for driving the eye-tracking camera (5) to rotate or move from a first position toward a second position, the drive member (42) including a drive motor or an electromagnetic drive member (420). When the driving member (42) includes an electromagnetic driving member (420), the electromagnetic driving member (420) includes a first electromagnetic structure (4200) and a first magnetic member (4201). The eye-tracking camera (5) is connected to the first magnetic component (4201), and the first electromagnetic structure (4200) is fixed to the support (10). The first electromagnetic structure (4200) is located on one side of the eye-tracking camera (5) so that the eye-tracking camera (5) can be driven to move by the first magnetic component (4201) when the first electromagnetic structure (4200) is energized. The first magnetic element (4201) includes a magnet, metal or electromagnetic coil that can attract or repel the energized first electromagnetic structure (4200).

5. The head-mounted display device according to claim 4, characterized in that, The driving assembly (4) further includes a reset member (44) for driving the eye-tracking camera (5) to rotate or move from the second position toward the first position. The reset member (44) includes at least one of an elastic member, a second magnetic member, and a second electromagnetic structure (440). The reset member (44) is located on the other side of the eye-tracking camera (5) away from the first electromagnetic structure (4200) to drive the eye-tracking camera (5) to rotate or move toward the first position to reset when the first electromagnetic structure (4200) is de-energized or the electromagnetic force is reduced.

6. The head-mounted display device according to claim 4, characterized in that, The drive assembly (4) includes a rotating bracket (40), the eye-tracking camera (5) is fixed to the rotating bracket (40), and the rotating bracket (40) is rotatably connected to the support part (10), so that the eye-tracking camera (5) is rotatably connected to the support part (10) through the rotating bracket (40); The driving component (4) includes a first electromagnetic structure (4200), a second electromagnetic structure (440), and a first magnetic component (4201); the first electromagnetic structure (4200) and the second electromagnetic structure (440) are respectively fixed on opposite sides of the eye-tracking camera (5), and the first magnetic component (4201) is fixed to the rotating bracket (40). When the first electromagnetic structure (4200) is energized, the first electromagnetic structure (4200) and the first magnetic element (4201) repel or attract each other, thereby driving the eye-tracking camera (5) to rotate from the first position toward the second position; When the second electromagnetic structure (440) is energized, the second electromagnetic structure (440) and the first magnetic element (4201) repel or attract each other to drive the eye-tracking camera (5) to rotate from the second position toward the first position.

7. The head-mounted display device according to claim 3, characterized in that, The support part (10) is also provided with a limiting block (100), which is fixedly connected to the support part (10) and is used to limit the eye-tracking camera (5) from rotating between the first position and the second position.

8. The head-mounted display device according to claim 1, characterized in that, The head-mounted display device further includes a first supplementary light component (6) and a second supplementary light component (7) disposed on the support portion (10). The first supplementary light component (6) and the second supplementary light component (7) are respectively disposed on the first side (50) and the second side (51) of the eye-tracking camera (5). The first side (50) and the second side (51) are opposite sides of the eye-tracking camera (5). When the driving component (4) drives the eye-tracking camera (5) to rotate or move toward the user's first eye (A), the first supplementary light component (6) emits light, and the second supplementary light component (7) does not emit light; When the driving component (4) drives the eye-tracking camera (5) to rotate or move toward the user's second eye (B), the first supplementary lighting component (6) does not emit light, and the second supplementary lighting component (7) emits light.

9. The head-mounted display device according to claim 8, characterized in that, The first supplementary lighting component (6) includes a first supplementary light (60) and a second supplementary light (61), and the second supplementary lighting component (7) includes a third supplementary light (70) and a fourth supplementary light (71); the first supplementary light (60) and the second supplementary light (61) are respectively disposed on the third side (52) and the fourth side (53) of the eye-tracking camera (5), and the third supplementary light (70) and the fourth supplementary light (71) are respectively disposed on the third side (52) and the fourth side (53) of the eye-tracking camera (5); the third side (52) and the fourth side (53) are another pair of opposite sides of the eye-tracking camera (5).

10. The head-mounted display device according to claim 1, characterized in that, It also includes a movable infrared fill light (8), the eye-tracking camera (5) is connected to the movable infrared fill light (8), and the movable infrared fill light (8) follows the eye-tracking camera (5) as the eye-tracking camera (5) rotates or moves.

11. The head-mounted display device according to claim 1, characterized in that, When the eye-tracking camera rotates to face the user's first eye or moves close to the first display component, the eye-tracking camera acquires a first image of the user's first eye; Based on the pupil position information and / or pupil outline information of the first eye in the first image, confirm whether the pupil of the first eye in the first image is located in the shooting degradation area of ​​the eye-tracking camera. If the pupil in the first image is located in the image degradation area of ​​the eye-tracking camera, drive the eye-tracking camera to rotate toward the user's second eye, or drive the eye-tracking camera to move closer to the second display component, and control the eye-tracking camera to acquire a second image of the second eye; When the pupil in the first image is outside the image degradation zone of the eye-tracking camera, the eye-tracking camera remains facing the user's first eye.

12. The head-mounted display device according to claim 11, characterized in that, The step of determining whether the pupil of the first eye in the first image is located in the degraded area of ​​the eye-tracking camera based on the pupil position information and / or pupil outline information of the first eye in the first image includes: Based on the pupil contour information, the major and minor axis dimensions of the elliptical fitting curve of the pupil contour are obtained. If the ratio of the major axis dimension to the minor axis dimension is less than or equal to 0.3, the pupil in the first image is determined to be located within the degradation zone of the eye-tracking camera; if the ratio of the major axis dimension to the minor axis dimension is greater than 0.3, the pupil in the first image is determined to be located outside the degradation zone of the eye-tracking camera; and / or, Based on the pupil position information, it is determined whether the center position of the pupil in the first image is within a preset pupil center imaging area. If the center position of the pupil is within the preset pupil center imaging area, it is determined that the pupil in the first image is located in the image degradation zone of the eye-tracking camera. If the center position of the pupil is outside the preset pupil center imaging area, it is determined that the pupil in the first image is outside the image degradation zone of the eye-tracking camera. The preset pupil center imaging area is obtained based on the pupil center imaging positions of multiple pre-captured images of the pupil in the first eye.