Modular eye dynamic capture assembly, head-mounted device accessory, and systems thereof

Abstract

The application relates to the technical field of eye motion capture, and discloses a modular eye dynamic capture assembly which comprises a master control expansion module and an eye collection module, the master control expansion module is connected with the eye collection module through a connecting line, and the master control expansion module is internally provided with a control mainboard; the number of the eye collection modules is two, the two eye collection modules are arranged side by side in a transverse direction at the bottom of the master control expansion module, and at least one camera is arranged on each eye collection module; a first connecting port is arranged on the control mainboard, and the first connecting port is used for electrically connecting with a head-mounted device through a data line; the eye collection module and the master control expansion module are connected through a flexible cable in the application, the first connecting port is arranged to realize power supply connection and data transmission with the head-mounted device, the design of an internal battery is omitted, and the detachable modular structure enables a user to quickly adapt the same high-performance collection module to different models or brands of VR devices, so that the universality of the device is improved.

Description

Technical Field

[0001] This application relates to the technical field of eye motion capture, and more particularly to modular eye motion capture components, head-mounted display accessories, and systems thereof. Background Technology

[0002] Chinese patent publication number CN107491165A, titled: A VR glasses eye 3D image, planar image capture and gesture capture system, specifically discloses that camera a and camera b are set in the internal area of ​​the VR glasses corresponding to the left eye position, and camera a and camera b are set on the upper and lower sides of lens a, and camera a and camera b capture the eye and nose bridge area image inside the VR glasses; However, in the prior art, the camera and VR headset use a fixed, integrated connection structure, which is a non-detachable whole. This design lacks flexibility in practical use, making it difficult for users to quickly disassemble or replace the image capture module according to specific needs. For example, users cannot easily share the same high-performance image capture module between different models or brands of VR devices, nor can they quickly replace it when the module fails. This limits the universality and maintainability of the device and makes it difficult to meet users' growing demand for modularity and configurability.

[0003] Therefore, modular eye motion capture components, head-mounted display accessories, and related systems are urgently needed to solve the above problems.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Utility Model Content

[0005] The main purpose of this application is to provide modular eye motion capture components, head-mounted display accessories and systems, to solve the problem that existing eye capture modules adopt a fixed integrated structure, which results in the inflexible disassembly of camera modules and the inability to share modules between devices.

[0006] To achieve the above objectives, the modular eye motion capture component provided in this application includes a main control expansion module and an eye acquisition module. The main control expansion module is connected to the eye acquisition module via a connecting cable, and the main control expansion module has a built-in control motherboard. The number of eye acquisition modules is two, and the two eye acquisition modules are arranged side by side in the horizontal direction at the bottom of the main control expansion module. Each eye acquisition module is equipped with at least one camera. The control motherboard is provided with a first connection port, which is used to electrically connect to the head-mounted display device via a data cable.

[0007] As a preferred embodiment of this application, the main control expansion module further includes a bottom shell and a top cover. The bottom shell is connected to the top cover. The bottom shell has a receiving cavity, and the control motherboard is disposed in the receiving cavity. The shape of the receiving cavity is adapted to the control motherboard.

[0008] As a preferred embodiment of this application, each of the eye acquisition modules further includes an annular bottom cover and an arc-shaped plate. The two annular bottom covers are arranged side by side in a horizontal direction. An arc-shaped plate is arranged on the left side of the annular bottom cover on the left, and another arc-shaped plate is arranged on the right side of the annular bottom cover on the right. The camera is located on the arc-shaped plate.

[0009] As a preferred embodiment of this application, it also includes a ring circuit board and infrared LED fill lights. The ring circuit board is disposed in the ring bottom cover. The ring circuit board is electrically connected to the control main board through wires. Multiple infrared LED fill lights are arranged circumferentially on the ring circuit board, and the multiple infrared LED fill lights are directed towards the eye area of ​​the wearer.

[0010] As a preferred embodiment of this application, the bottom shell is provided with a mounting groove, a rubber pad is provided in the mounting groove, the top cover is provided with another rubber pad at the corresponding position of the mounting groove, and the connecting line is provided between the two rubber pads.

[0011] As a preferred embodiment of this application, it further includes a cover plate, wherein an annular bottom cover has an annular groove, the annular circuit board is housed in the annular groove, and the infrared LED fill light faces the annular groove, the cover plate covers the annular groove to limit the annular circuit board in the annular groove; the annular bottom cover has a plurality of lamp holes penetrating the annular groove, the plurality of lamp holes have rounded corners, and the infrared LED fill light is housed in the lamp holes.

[0012] As a preferred embodiment of this application, the number of the first connection ports is three, and the three first connection ports are arranged along the outer edge of the control motherboard, wherein one is used for electrical connection with the head-mounted display device, and the other two serve as device expansion interfaces.

[0013] As a preferred embodiment of this application, the camera is an infrared camera, and the optical axis of the infrared camera points to the pupil area of ​​the corresponding eyeball.

[0014] A head-mounted display accessory includes a data cable, a stand, and the aforementioned modular eye motion capture component; wherein, The data cable has one end connected to the first connection port of the modular eye motion capture component and the other end connected to the second interface on the head-mounted display device. The first connection port is used for power supply and data transmission. The bracket is provided with a first mounting part and a second mounting part. The first mounting part is detachably connected to the modular eye motion capture component, and the second mounting part is used to connect to the head-mounted display device.

[0015] A head-mounted display system includes the aforementioned head-mounted display accessories and the head-mounted display itself; wherein... The second mounting part is detachably connected to the head-mounted display device; The head-mounted display device internally includes a power module, a data processing module, and a wireless transmission module. The second interface of the head-mounted display device is internally connected to the power module and the data processing module, and externally connected to the first connection port via the data cable.

[0016] The modular eye motion capture component provided in this application uses a flexible cable to connect the eye acquisition module and the main control expansion module, and sets a first connection port to connect with the head-mounted display device for power supply and data transmission. This eliminates the need for a built-in battery, which helps to reduce the weight of the entire module. At the same time, the detachable modular structure allows users to quickly adapt the same high-performance acquisition module to different models or brands of VR devices, improving the device's versatility and effectively solving the problems of insufficient flexibility and limited compatibility caused by the fixed integration of VR devices and image capture modules in the prior art. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of a first three-dimensional structure of a modular eye motion capture component in one embodiment of this application; Figure 2 This is a schematic diagram of a second three-dimensional structure of a modular eye motion capture component in one embodiment of this application; Figure 3 This is a cross-sectional view of the main control expansion module in a modular eye motion capture component according to an embodiment of this application; Figure 4 This is an exploded view of the main control expansion module in a modular eye motion capture component according to an embodiment of this application; Figure 5 This is an enlarged view of the main control expansion module A in a modular eye motion capture component according to an embodiment of this application; Figure 6 This is a first exploded view of the eye acquisition module in a modular eye motion capture component according to an embodiment of this application; Figure 7 This is a second exploded view of the eye acquisition module in a modular eye motion capture component according to an embodiment of this application.

[0018] Explanation of reference numerals in the attached figures: 1. Main control expansion module; 2. Eye acquisition module; 3. Connecting cable; 4. Ring circuit board; 5. Infrared LED fill light; 11. Control motherboard; 12. Bottom shell; 13. Top cover; 14. First connection port; 15. Rubber pad; 16. Mounting slot; 21. Camera; 22. Annular bottom cover; 23. Arc plate; 24. Annular groove; 25. Lamp hole. Detailed Implementation

[0019] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0020] Furthermore, descriptions using terms such as "first" and "second" in this application are for descriptive purposes only (e.g., to distinguish identical or similar elements) and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, technical solutions from different embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If a combination of technical solutions is contradictory or impossible to implement, such a combination should be considered nonexistent and not within the scope of protection claimed in this application.

[0021] Please refer to Figure 1 , Figure 2 , Figure 4 In one embodiment, the modular eye motion capture component includes a main control expansion module 1 and an eye acquisition module 2. The main control expansion module 1 is connected to the eye acquisition module 2 via a connecting cable 3. The main control expansion module 1 has a built-in control motherboard 11. There are two eye acquisition modules 2, and the two eye acquisition modules 2 are arranged side by side in the horizontal direction at the bottom of the main control expansion module 1. Each eye acquisition module 2 is equipped with at least one camera 21. The control motherboard 11 is provided with a first connection port 14, which is used to electrically connect to the head-mounted display device via a data cable.

[0022] Preferably, the control motherboard 11 is an ESP32-S3 controller, and the image is transmitted after being compressed in JPEG format; Specifically, the connection cable 3 adopts a USB Type-C connection cable 3 that conforms to USB 2.0. It achieves power supply and data transmission through a split cable connection, eliminating the need for a built-in battery design and helping to reduce the overall weight. Specifically, each eye acquisition module 2 also includes an annular bottom cover 22 and an arc plate 23. The two annular bottom covers 22 are arranged side by side in the horizontal direction. During installation, the axes of the two annular bottom covers 22 are respectively coaxial with the left and right lenses in the VR device, ensuring that each camera 21 can be directly aimed at the user's pupil area at the preset optimal angle and distance, thus ensuring the accuracy and consistency of image capture. Furthermore, an arc-shaped plate 23 is provided on the left side of the annular bottom cover 22 on the left side, and another arc-shaped plate 23 is provided on the right side of the annular bottom cover 22 on the right side. The camera 21 is located on the arc-shaped plate 23. More specifically, the camera 21 is an infrared camera, and the optical axis of the infrared camera points to the pupil area corresponding to the eyeball, which is used to capture subtle movements such as eyeball movement, pupil changes, and eyelid opening and closing. The installation position of the infrared camera is precisely calculated by optical simulation software to ensure that the camera 21 can completely monitor all key feature points of the user's eyes at the optimal incident angle.

[0023] In this embodiment, the head-mounted display device is an Android-based all-in-one VR head-mounted display (Meta Quest series, Pico series, etc.). The first connection port 14 is specifically a USB Type-C interface, which operates in USB 2.0 mode. Power supply and data transmission are achieved with the VR head-mounted display through this first connection port 14. This module uses two infrared cameras 21, precisely oriented towards the eyes, to capture real-time image data of both eyes at the optimal angle. The data is transmitted to the main control expansion module 1 via the connection cable 3, where it undergoes preprocessing such as synchronization and noise reduction by the ESP32-S3 controller to form a synchronized data stream for both eyes. Finally, this data is stably sent to the Android VR headset via the USB 2.0 interface, and then forwarded by the headset to the backend for intelligent recognition. This modular eye motion capture component utilizes a detachable modular structure, allowing users to quickly adapt the same high-performance capture module to different models or brands of VR devices. This improves the versatility of the devices and effectively solves the problems of insufficient flexibility and limited compatibility caused by the fixed integration of VR devices and image capture modules in existing technologies.

[0024] Further, please refer to Figure 3 , Figure 4 The main control expansion module 1 also includes a bottom shell 12 and a top cover 13. The bottom shell 12 is connected to the top cover 13. The bottom shell 12 has a receiving cavity, and the receiving cavity has a control motherboard 11. The shape of the receiving cavity is adapted to the control motherboard 11.

[0025] It is understandable that the direct connection between the top cover 13 and the bottom shell 12 is relatively simple and convenient for disassembling and assembling the control motherboard 11 during maintenance. Furthermore, the connection between the bottom shell 12 and the top cover 13 forms a complete protective shell, isolating the control motherboard 11 from the external environment. This effectively resists collisions, scratches, and dust intrusion during daily use, improving the module's durability. At the same time, the tightly fitted cavity ensures the precise positioning and fixation of the motherboard, preventing it from shaking inside and ensuring the stability of the internal electrical connections.

[0026] Specifically, please refer to Figure 2 , Figure 7 Based on the above embodiments, it also includes a ring circuit board 4 and infrared LED fill lights 5. The ring circuit board 4 is provided in the ring bottom cover 22. The ring circuit board 4 is electrically connected to the control main board 11 through wires. Multiple infrared LED fill lights 5 are arranged around the ring circuit board 4, and the multiple infrared LED fill lights 5 are arranged facing the camera 21.

[0027] It is understandable that by adding the ring circuit board 4 and the circumferentially arranged infrared LED fill lights 5, infrared light can be evenly projected onto the entire eye area, effectively eliminating shadows and local overexposure, and ensuring that the camera 21 can capture high-quality eye images with clear details and consistent contrast under any ambient light conditions.

[0028] Specifically, please refer to Figure 3 , Figure 4 , Figure 5 The bottom shell 12 is provided with a mounting groove 16, and a rubber pad 15 is provided in the mounting groove 16. The top cover 13 is provided with another rubber pad 15 at the corresponding position in the mounting groove 16. The connecting wire 3 is located between the two rubber pads 15. It is understandable that when the top cover 13 and the bottom shell 12 are closed, the two rubber pads 15 can tightly press and hold the connecting line 13 from the top and bottom sides, effectively preventing it from shifting or loosening due to vibration or pulling.

[0029] Specifically, please refer to Figure 2 , Figure 6 Based on the above embodiments, a cover plate is also included. An annular groove 24 is provided on the annular bottom cover 22. The annular circuit board 4 is housed in the annular groove 24, and the infrared LED supplementary light 5 faces the annular groove 24. The cover plate is closed on the annular groove 24 to limit the annular circuit board 4 in the annular groove 24.

[0030] It is understandable that by adding a cover plate and annular groove 24 structure, the cover plate securely limits and seals the annular circuit board 4 and the infrared LED supplementary light 5 in the annular groove 24, effectively preventing them from shifting or being damaged due to vibration or external impact. Specifically, please refer to Figure 2 , Figure 6 , Figure 7 Based on the above embodiment, the annular bottom cover 22 has multiple lamp holes 25 that penetrate the annular groove 24, and the multiple lamp holes 25 have rounded corners, and the infrared LED supplementary light 5 is housed in the lamp hole 25.

[0031] It is understandable that the structure of the lamp hole 25 provides an independent mounting slot for each supplementary light, ensuring that its position on the annular circuit board 4 is precisely fixed. At the same time, the rounded corner structure of the edge of the lamp hole 25 can guide the infrared light to be emitted at a more ideal angle, effectively reducing unnecessary reflection and obstruction of light on the hole wall, playing a role in converging and optimizing the light path, making the emitted light spot more uniform and concentrated, further improving the uniformity and efficiency of supplementary lighting to the eye area, and optimizing the final imaging effect.

[0032] Specifically, please refer to Figure 1 , Figure 4 , Figure 5 Based on the above embodiment, the number of first connection ports 14 is three. The three first connection ports 14 are arranged along the outer edge of the control motherboard 11, one of which is used for electrical connection with the head-mounted display device, and the other two are used as device expansion interfaces.

[0033] It is understandable that by increasing the number of first connection ports 14 to three and setting them along the outer edge of the control motherboard 11, this design greatly enhances the system integration and functional scalability of the main control expansion module 1; one of the interfaces is dedicated to connecting the VR headset to ensure the stable operation of the core functions, while the other two expansion interfaces build an open hardware platform that allows users to flexibly connect various third-party peripherals such as face capture modules, enabling a single VR headset to easily integrate multiple motion capture functions.

[0034] A head-mounted display accessory includes a data cable, a stand, and the aforementioned modular eye motion capture component; wherein, The data cable has one end connected to the first connection port 14 of the modular eye motion capture component and the other end connected to the second interface on the head-mounted display device. The first connection port 14 is used for power supply and data transmission. The bracket has a first mounting part and a second mounting part. The first mounting part is detachably connected to the modular eye motion capture component, and the second mounting part is used to connect to the head-mounted display device.

[0035] It is understandable that the data cable specifically adopts a USB Type-C data cable that conforms to USB 2.0. By using the first connection port 14, the data cable and the second interface, a power supply connection and data processing are established between the eye motion capture module and the head-mounted display device, which can realize quick disassembly and assembly and adapt to other head-mounted display devices. Furthermore, the shape of the bracket can be designed as an arc structure according to the shape of the head-mounted display device. This arc structure is adapted to the mounting surface of the head-mounted display device. Preferably, a through hole can be opened in the middle of the arc-shaped bracket, and a protrusion can be set on the head-mounted display device. After connecting the through hole and the protrusion, the bracket and the head-mounted display device can be connected. The direct end is the first mounting part. The structure of the first mounting part can be that a groove is opened at one end of the bracket. A hand-tightened bolt is passed through the hole on the bracket and the opening of the above-mentioned connecting part in sequence, and the threaded part of the hand-tightened bolt is connected to the nut on the bracket to realize the connection between the eye-catching module and the bracket. After installation, the mounting angle of the eye-catching module can be adjusted by tightening or loosening the bolt.

[0036] This connection method allows for quick assembly and disassembly of the eye motion capture module, facilitating maintenance. Furthermore, due to the universality of its interface protocol, it can flexibly adapt to various head-mounted display devices, improving accessory compatibility.

[0037] A head-mounted display system includes the aforementioned head-mounted display accessories and a head-mounted display device; wherein, The second mounting section is detachably connected to the head-mounted display device; The head-mounted display device has a power module, a data processing module and a wireless transmission module inside. The second interface of the head-mounted display device is internally connected to the power module and the data processing module, and externally connected to the first connection port 14 via a data cable.

[0038] In summary, it can be understood that when the modular eye motion capture component provided in this application is used, it connects to the second interface on the VR headset via a USB Type-C interface on the main control expansion module 1. The built-in power module of the headset also provides 5V DC power of no more than 500mA through this interface to power the entire eye motion capture component. When acquiring eye images, infrared LED fill lights 5 are used for illumination. Two independent eye acquisition modules 2 are precisely aimed at the user's left and right eye areas respectively. The camera 21 on each module, driven by the control motherboard 11, synchronously acquires infrared images of both eyes in JPEG compression format, with a typical frame rate of 30 Hz (up to 60 fps), focusing on capturing the fine dynamics of the eyeball, eyelids and periocular area. After the two eye image data streams are transmitted to the main control expansion module 1, its built-in control motherboard 11 (such as ESP32-S3) first performs timestamp synchronization to ensure that the left and right eye images are completely aligned in time. Then, the control motherboard 11 runs a stereo matching preprocessing algorithm to perform stereo correction, alignment and other operations on the two images. After performing local image preprocessing and data synchronization, the data is transmitted to the headset via a proprietary streaming media protocol through a USB Type-C interface. A dedicated application running within the headset performs protocol parsing and data preprocessing, and then uses 5GHz Wi-Fi (802.11ac) to stably wirelessly forward the data to an external PC for processing.

[0039] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, apparatus, article, or method. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, apparatus, article, or method that includes that element.

[0040] The above description is only a preferred embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural changes made based on the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A modular eye motion capture component, characterized in that, It includes a main control expansion module and an eye acquisition module. The main control expansion module is connected to the eye acquisition module via a connecting cable, and the main control expansion module has a built-in control motherboard. The number of eye acquisition modules is two, and the two eye acquisition modules are arranged side by side in the horizontal direction at the bottom of the main control expansion module. Each eye acquisition module is equipped with at least one camera. The control motherboard is provided with a first connection port, which is used to electrically connect to the head-mounted display device via a data cable.

2. The modular eye motion capture component according to claim 1, characterized in that, The main control expansion module also includes a bottom shell and a top cover. The bottom shell is connected to the top cover. The bottom shell has a receiving cavity, and the control motherboard is disposed in the receiving cavity. The shape of the receiving cavity is adapted to the control motherboard.

3. The modular eye motion capture component according to claim 1, characterized in that, Each of the eye acquisition modules includes an annular bottom cover and an arc-shaped plate. The two annular bottom covers are arranged side by side in the horizontal direction. An arc-shaped plate is arranged on the left side of the annular bottom cover on the left, and another arc-shaped plate is arranged on the right side of the annular bottom cover on the right. The camera is arranged on the arc-shaped plate.

4. The modular eye motion capture component according to claim 3, characterized in that, It also includes a ring circuit board and infrared LED fill lights. The ring circuit board is disposed in the ring bottom cover. The ring circuit board is electrically connected to the control main board through wires. Multiple infrared LED fill lights are arranged circumferentially on the ring circuit board, and the multiple infrared LED fill lights are directed towards the wearer's eye area.

5. The modular eye motion capture component according to claim 2, characterized in that, The bottom shell is provided with a mounting groove, and a rubber pad is provided in the mounting groove. The top cover is provided with another rubber pad at the corresponding position of the mounting groove, and the connecting line is provided between the two rubber pads.

6. The modular eye motion capture component according to claim 4, characterized in that, It also includes a cover plate, on which an annular bottom cover is provided an annular groove, the annular circuit board is housed in the annular groove, and the infrared LED fill light faces the annular groove. The cover plate covers the annular groove to limit the annular circuit board in the annular groove. The annular bottom cover is provided with a plurality of lamp holes penetrating the annular groove, and the plurality of lamp holes are provided with rounded corners. The infrared LED fill light is housed in the lamp holes.

7. The modular eye motion capture component according to claim 1, characterized in that, The number of the first connection ports is three, and the three first connection ports are arranged along the outer edge of the control motherboard. One of them is used for electrical connection with the head-mounted display device, and the other two serve as device expansion interfaces.

8. The modular eye motion capture component according to claim 1 or 3, characterized in that, The camera is an infrared camera, and the optical axis of the infrared camera points to the pupil area of ​​the corresponding eyeball.

9. A head-mounted display accessory, characterized in that, Includes a data cable, a bracket, and a modular eye motion capture component as described in any one of claims 1-8; in, The data cable has one end connected to the first connection port of the modular eye motion capture component and the other end connected to the second interface on the head-mounted display device. The first connection port is used for power supply and data transmission. The bracket is provided with a first mounting part and a second mounting part. The first mounting part is detachably connected to the modular eye motion capture component, and the second mounting part is used to connect to the head-mounted display device.

10. A head-mounted display system, characterized in that, Includes the head-mounted display device accessory as described in claim 9 and the head-mounted display device; wherein, The second mounting part is detachably connected to the head-mounted display device; The head-mounted display device internally includes a power module, a data processing module, and a wireless transmission module. The second interface of the head-mounted display device is internally connected to the power module and the data processing module, and externally connected to the first connection port via the data cable.

Images