General purpose detachable face and eye capture system

Abstract

The application relates to the technical field of image capturing, and discloses a general detachable face and eye capturing system, which comprises a face capturing module, a first interface of which is arranged on the face capturing module; an eye capturing module, at least two second interfaces of which are arranged on the eye capturing module; a support used for connecting with a head-mounted device; one end of the support is detachably connected with the face capturing module through a first connecting part, and the other end of the support is detachably connected with the eye capturing module; the first interface of the face capturing module is electrically connected with one of the second interfaces of the eye capturing module in a pluggable mode, and the other second interface of the eye capturing module is used for being electrically connected with the head-mounted device through a data line; the detachable design of the face capturing module, the eye capturing module and the support is adopted, and the pluggable electrical connection between the modules is matched, so that users can quickly detach, replace or flexibly deploy the image capturing modules among different VR devices according to actual demands, and the system hardware expansibility and configuration flexibility are improved.

Description

Technical Field

[0001] This application relates to the technical field of image capture, and more particularly to a universal detachable face and eye capture system. Background Technology

[0002] Chinese patent publication number CN107491165A, entitled "A VR Glasses Eye 3D Image, Planar Image Capture and Gesture Capture System," provides an integrated eye and face image capture solution. Its cameras a, b, c, and d are all fixed in specific positions on the VR glasses through a fixed integrated structure (the lower side frame corresponds to the face area, and the upper and lower sides of the lens correspond to the eye and nose bridge areas). Cameras c and d capture images of the face area below the VR glasses when the person is wearing VR glasses, while cameras a and b capture images of the eye and nose bridge areas inside the VR glasses. However, the aforementioned camera and VR device are fixedly connected. This fixed structure limits the hardware's scalability and personalized configuration. Users find it difficult to quickly disassemble or replace the image capture module according to specific needs. It also prevents the dedicated capture module from being shared between different VR devices, resulting in a lack of necessary flexibility and configurability for the image capture module.

[0003] Therefore, there is an urgent need for a universal, detachable face and eye capture system to solve the above problems.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Utility Model Content

[0005] The main purpose of this application is to provide a universal detachable face and eye capture system to solve the problem that the existing eye capture module adopts a fixed integrated structure, which makes the camera module unable to be flexibly disassembled and the module cannot be shared between devices.

[0006] To achieve the above objectives, the universal detachable face and eye capture system provided in this application includes: a face capture module having a first interface thereon; An eye-capture module, which has at least two second interfaces; A stand for connecting to the head-mounted display device; One end of the bracket is detachably connected to the face capture module via a first connecting part, and the other end of the bracket is detachably connected to the eye capture module; The first interface of the face capture module is electrically connected to one of the second interfaces of the eye capture module in a pluggable manner, and the other second interface of the eye capture module is used to electrically connect to the head-mounted display device via a data cable.

[0007] As a preferred embodiment of this application, the bracket is an arc-shaped bracket, and both ends of the arc-shaped bracket are provided with a fastening structure adapted to the head-mounted display device.

[0008] As a preferred embodiment of this application, two nuts are arranged side by side on the first connecting part, and grooves are provided at both ends of the first connecting part. The groove at one end engages with the protrusion at one end of the bracket and is fastened to the nut by a first hand-tightening bolt; the groove at the other end is connected to the face capture module.

[0009] As a preferred embodiment of this application, the face capture module includes a housing, a first control motherboard, a first camera, and a first infrared fill light; The first control motherboard is disposed inside the housing. The first camera is integrated on the first control motherboard. Multiple first infrared fill lights are arranged around the first camera in a circumferential manner on the first control motherboard.

[0010] As a preferred embodiment of this application, the eye capture module includes a main control expansion module and two eye acquisition modules. The two eye acquisition modules are arranged side by side on the same horizontal line, and the main control expansion module and the eye acquisition modules are connected by a connecting cable. The main control expansion module has a built-in second control motherboard, and the second control motherboard integrates the second interface. Each of the aforementioned eye acquisition modules is equipped with a second camera and a second infrared fill light.

[0011] As a preferred embodiment of this application, the arc-shaped bracket has at least one mounting hole for connecting to the head-mounted display device.

[0012] As a preferred embodiment of this application, it further includes a guide block disposed at the edge of the arc-shaped bracket, the guide block having an arc-shaped groove for guiding the cable.

[0013] As a preferred embodiment of this application, the other end of the bracket is provided with a mounting groove, and the mounting groove is provided with a screw hole, which is connected to the eye-catching module by a screw.

[0014] As a preferred embodiment of this application, the face capture module is provided with a second connecting part, the second connecting part is provided with an opening, the second connecting part is located in the groove at the other end of the first connecting part, and is fastened to the nut by a second hand-tightening bolt.

[0015] As a preferred embodiment of this application, a buffer pad is also included, wherein the buffer pad is disposed between the first camera and the housing.

[0016] The universal detachable face and eye capture system provided in this application adopts a detachable design for the face capture module, eye capture module, and bracket, and is equipped with pluggable electrical connections between modules. This allows users to quickly disassemble, replace, or flexibly allocate image capture modules between different VR devices according to actual needs, thereby improving the system's hardware scalability, configuration flexibility, and module universality. It enables the capture module to be shared between different devices, reducing user operating costs and maintenance complexity. Attached Figure Description

[0017] Figure 1 This is a three-dimensional structural diagram of a first embodiment of a general detachable face and eye capture system according to this application; Figure 2 This is a schematic diagram of a second three-dimensional structure of a general detachable face and eye capture system according to an embodiment of this application; Figure 3 This is a schematic diagram of the structure of a general detachable face and eye capture system bracket in one embodiment of this application; Figure 4 This is an exploded view of the face acquisition module in a general detachable face and eye capture system according to an embodiment of this application; Figure 5 This is a first exploded view of the main control expansion module in a general detachable face and eye capture system according to an embodiment of this application; Figure 6 This is a second exploded view of the main control expansion module in a general detachable face and eye capture system according to an embodiment of this application; Figure 7 This is a first exploded view of the eye acquisition module in a general detachable face and eye capture system according to an embodiment of this application; Figure 8 This is a second exploded view of the eye acquisition module in a general detachable face and eye capture system according to an embodiment of this application.

[0018] Explanation of reference numerals in the attached figures: 1. Facial capture module; 2. Eye capture module; 3. Support; 4. First connecting part; 5. First interface; 11. Main control expansion module; 12. Eye acquisition module; 13. Connecting cable; 14. Rubber pad; 21. Housing; 22. First control motherboard; 23. First camera; 24. First infrared fill light; 25. Buffer pad; 31. Fastening structure; 32. Guide block; 41. Groove; 42. Nut; 43. First hand-tightening bolt; 44. Second hand-tightening bolt; 111. Second control motherboard; 112. Second interface; 121. Second camera; 122. Second infrared fill light. Detailed Implementation

[0019] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0020] Furthermore, descriptions using terms such as "first" and "second" in this application are for descriptive purposes only (e.g., to distinguish identical or similar elements) and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, technical solutions from different embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If a combination of technical solutions is contradictory or impossible to implement, such a combination should be considered nonexistent and not within the scope of protection claimed in this application.

[0021] Please refer to Figure 1 , Figure 2 , Figure 3 , Figure 5 , Figure 6 In one embodiment, a universal detachable face and eye capture system includes: a face capture module 1 having a first interface 5 thereon; The eye-capture module 2 is provided with at least two second interfaces 112; Stand 3 is used to connect to the head-mounted display device; One end of the bracket 3 is detachably connected to the face capture module 1 via the first connecting part 4, and the other end of the bracket 3 is detachably connected to the eye capture module 2. The first interface 5 of the face capture module 1 is electrically connected to one of the second interfaces 112 of the eye capture module 2 in a pluggable manner, and the other second interface 112 of the eye capture module 2 is used to electrically connect to the head-mounted display device via a data cable.

[0022] In this embodiment, the head-mounted display device is an Android-based all-in-one VR head-mounted display (Meta Quest series, Pico series, etc.). The first interface 5 and the second interface 112 are specifically USB Type-C interfaces. This interface supports the USB 3.2 Gen 1 (5Gbps) data transmission protocol. Power supply and data transmission with the VR head-mounted display are achieved through this second interface 112. Specifically, the plug-in connection between the face capture module 1 and the eye capture module 2 can be achieved by using a data cable connected to the head-mounted display device. The data cable specifically uses a USB Type-C data cable that supports the USB 3.2 Gen 1 data transmission protocol. By using the first interface 5, the data cable, and the second interface 112, a power supply connection and data processing can be established between the face capture module 1, the eye capture module 2, and the head-mounted display device, enabling quick disassembly and assembly as well as compatibility with other head-mounted display devices. Specifically, the bracket 3 is an arc-shaped bracket 3, and both ends of the arc-shaped bracket 3 are provided with a fastening structure 31 adapted to the head-mounted display device; It can be understood that the bracket 3 is an arc-shaped bracket 3 that is adapted to the contour of the front shell of the head-mounted display device. Each end of the arc-shaped bracket 3 is provided with a set of fastening structure 31 for quick installation and fixation with the head-mounted display device. Each set of fastening structure 31 consists of two fastening plates that are parallel or nearly parallel to each other, and the curvature of the fastening plates faces the concave surface of the arc-shaped bracket 3 (i.e. the side facing the head-mounted display device during installation). During installation, by inserting the mounting part (such as a specific slot or flange) on the head-mounted display device into the clamping space formed by the two fastening plates, a stable and reliable detachable connection between the bracket 3 and the head-mounted display device can be achieved. Furthermore, in order to achieve rapid positioning and further secure connection, a protrusion can be provided on the front cover of the head-mounted display device. To accommodate the protrusion, at least one mounting hole can be provided on the arc-shaped bracket 3. The mounting hole is used to connect with the protrusion on the head-mounted display device, which enables rapid installation and positioning. At the same time, by setting the protrusion, the bracket 3 can be effectively limited to avoid shaking during use and avoid image distortion or data inaccuracy caused by module displacement.

[0023] It is understandable that when using the device, the user first fixes the fastening structure 31 on the bracket 3, which is connected to the face capture module 1 and the eye capture module 2, to the VR headset. Then, the user uses the connecting cable 13 to connect the interfaces of the face capture module 1 and the eye capture module 2. Finally, the user uses a data cable to connect the eye module to the headset host to realize system power-on and data transmission. During image acquisition, the face capture module 1 captures the lower half of the user's face, and the generated face image data is transmitted to the eye capture module 2 through the first interface 5 and the connecting line 13. At the same time, the eye-capture module 2 simultaneously collects image data of the user's eyes; In this system, the eye capture module 2 acts as the data processing center, receiving eye data collected by itself and facial data from the face capture module 1. Then, it integrates these two data streams and uploads the integrated data to the VR headset device through the second interface 112 and the data cable. After receiving the fused facial and eye data, the VR headset device is further processed by its internal processor and corresponding programs (such as image recognition and feature extraction) to finally generate eye and facial animation data that can be used to drive the virtual avatar's expressions, thus achieving immersive interaction. By adopting a detachable design for the face capture module 1, eye capture module 2, and bracket 3, and with pluggable electrical connections between modules, users can quickly disassemble, replace, or flexibly allocate image capture modules between different VR devices according to actual needs. This improves the system's hardware scalability, configuration flexibility, and module universality, enabling the capture module to be shared between different devices and reducing user operating costs and maintenance complexity.

[0024] Specifically, please refer to Figure 3 Based on the above embodiment, two nuts 42 are arranged side by side on the first connecting part 4, and grooves 41 are provided at both ends of the first connecting part 4. The groove 41 at one end cooperates with the protrusion provided at one end of the bracket 3 and is fastened to the nut 42 by the first hand-tightening bolt 43; the groove 41 at the other end is connected to the face capture module 1. More specifically, the face capture module 1 is provided with a second connecting part, which has an opening. The second connecting part is located in the groove 41 at the other end of the first connecting part 4 and is fastened to the nut 42 by a second hand-tightening bolt 44.

[0025] It is understandable that the tightening force applied by hand-tightening the bolts can tightly fix the first connecting part 4, the bracket 3, and the face capture module 1 together. This rigid connection can effectively resist the vibration and impact caused by head shaking during use, fundamentally preventing the module from loosening, ensuring the stability of image acquisition, and avoiding image blurring or data distortion caused by slight camera movements. At the same time, users can complete the installation and disassembly of the module by hand without any tools, which greatly improves the convenience of use. The angle of the face capture module 1 can also be adjusted according to the needs of use, making it more convenient to use overall.

[0026] Specifically, please refer to Figure 4 Based on the above embodiments, the face capture module 1 includes a housing 21, a first control motherboard 22, a first camera 23, and a first infrared fill light 24; The housing 21 contains a first control motherboard 22, which integrates a first camera 23. Multiple first infrared fill lights 24 are arranged around the first camera 23.

[0027] It is understood that the housing 21 includes a bottom cover and a front cover, which are connected. The front cover is made of high light transmittance plastic. Multiple first infrared fill lights 24 are arranged around the edge of the first control motherboard 22, and the light can be evenly projected onto the user's face through the high light transmittance front cover, providing sufficient and uniform illumination for the first camera 23. This ensures that facial image features can be clearly and stably captured in any lighting environment. At the same time, the first motherboard integrates a first interface 5, making the entire face capture module 1 relatively independent, easy to disassemble and freely combine according to user needs. Specifically, please refer to Figure 5 , Figure 6 , Figure 7 , Figure 8 Based on the above embodiments, the eye capture module 2 includes a main control expansion module 11 and two eye acquisition modules 12. The two eye acquisition modules 12 are arranged side by side on the same horizontal line, and the main control expansion module 11 and the eye acquisition modules 12 are connected by a connecting line 13. The main control expansion module 11 has a built-in second control motherboard 111, and the second control motherboard 111 has a second interface 112 integrated on it; Each eye acquisition module 12 is equipped with a second camera 121 and a second infrared fill light 122.

[0028] Preferably, in this example, there are three second interfaces 112, and three first interfaces 5 are arranged along the outer edge of the second control motherboard 111, one of which is used for electrical connection with the head-mounted display device, and the other two are used as device expansion interfaces; More specifically, the main control expansion module 11 includes a bottom shell and an upper shell, the bottom shell and the upper shell are connected, a second control motherboard 111 is provided in the bottom shell, and a placement groove for placing the connecting wire 13 is provided on the bottom shell. The connecting wire 13 is located on the upper and lower surfaces of the placement groove, and rubber pads 14 are provided on each surface. When the upper cover and the bottom shell are closed, the two rubber pads 15 can tightly press and hold the connecting wire 13 from the upper and lower sides, effectively preventing it from shifting or loosening due to vibration or pulling. Furthermore, the connection cable 13 specifically adopts a USB Type-C connection cable 13 that supports the USB 3.2 Gen 1 data transmission protocol. By adopting a split cable connection design between the eye acquisition module 12 and the main control expansion module 11, it is possible to achieve power supply and support data transmission rates of up to 5Gbps, eliminating the need for a built-in battery design and helping to reduce the weight of the entire module. It is understood that in this embodiment, when acquiring eye images, by adding a ring circuit board and circumferentially arranged infrared LED fill lights, infrared light can be evenly projected onto the entire eye area, effectively eliminating shadows and local overexposure, and ensuring that the second camera 121 can capture high-quality eye images with clear details and consistent contrast under any ambient light conditions. Specifically, please refer to Figure 3 Based on the above embodiments, a guide block 32 is also included. The guide block 32 is disposed on the edge of the arc-shaped bracket 3, and the guide block 32 is provided with an arc-shaped groove for guiding the cable.

[0029] Understandably, the arc-shaped groove can precisely guide the cable along the edge of the bracket 3 for fixed routing, effectively avoiding the problems that may be caused by the cable hanging or swaying randomly, such as accidental scratching to the user's face, being caught on the arm and falling off, or even being damaged due to excessive bending. This not only ensures the stability of data transmission between modules and reduces the risk of data loss due to connection interruption, but also makes the overall installation neater and more beautiful, and improves the user's sense of security and comfort when using it.

[0030] Specifically, based on the above embodiments, the other end of the bracket 3 is provided with a mounting groove, and the mounting groove is provided with a screw hole, which is connected to the eye-catching module 2 by a screw.

[0031] It is understandable that the screw connection method has a simple structure, high reliability, and convenient maintenance. By opening the mounting slot and screw hole, a stable, precise and reusable connection between the eye-catching module 2 and the bracket 3 is achieved.

[0032] Specifically, please refer to Figure 4 Based on the above embodiments, a buffer pad 25 is also included, and a buffer pad 25 is provided between the first camera 23 and the housing 21.

[0033] It is understandable that the buffer pad 25 is made of high-damping EVA material. High-damping EVA material can actively absorb and attenuate the subtle vibrations and impacts generated by the user's head movements (such as turning the head quickly, walking, etc.), preventing these vibrations from being directly transmitted to the precision camera imaging components, effectively avoiding image blurring or jelly effect caused by vibration, and ensuring that every frame of facial image captured is clear and stable.

[0034] In summary, it can be understood that when using the universal detachable face and eye capture system provided in this application, the system first connects to the VR headset and obtains power through the USB Type-C interface on the main control expansion module 11; At the data acquisition end, the eye and face capture modules 1 work synchronously. With the assistance of the second infrared fill light 122, the eye acquisition module 12 accurately captures the infrared images of the eyes at a frame rate of 60fps; the face acquisition module simultaneously acquires the lower half of the face image. The main control expansion module 11 serves as a system-level data processing center. Its built-in control motherboard (such as ESP32-S3) uniformly schedules and manages multiple data streams from the face and eye modules, and performs advanced processing functions such as data fusion, timestamp synchronization, and dynamic bandwidth allocation.

[0035] The data stream, integrated by the main control expansion module 11, is uploaded to the VR headset via a USB Type-C interface. A dedicated Android relay application running within the headset acts as the second-level processing core, simultaneously receiving and processing both facial expression and eye movement data streams. An intelligent load balancing algorithm dynamically adjusts the transmission strategy based on network conditions and data priority. The processed integrated expression data is then forwarded to the PC via 5GHz Wi-Fi. The PC client's deep learning model fuses and analyzes the received multimodal data, generating high-precision facial expression and eye movement parameters for use by applications such as VRChat and virtual live streaming.

[0036] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, apparatus, article, or method. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, apparatus, article, or method that includes that element.

[0037] The above description is only a preferred embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural changes made based on the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A universal detachable face and eye capture system, characterized in that, include: A facial capture module, which has a first interface; An eye-capture module, which has at least two second interfaces; A stand for connecting to the head-mounted display device; One end of the bracket is detachably connected to the face capture module via a first connecting part, and the other end of the bracket is detachably connected to the eye capture module; The first interface of the face capture module is electrically connected to one of the second interfaces of the eye capture module in a pluggable manner, and the other second interface of the eye capture module is used to electrically connect to the head-mounted display device via a data cable.

2. The universal detachable face and eye capture system according to claim 1, characterized in that, The bracket is an arc-shaped bracket, and both ends of the arc-shaped bracket are provided with a fastening structure adapted to the head-mounted display device.

3. The universal detachable face and eye capture system according to claim 1, characterized in that, Two nuts are arranged side by side on the first connecting part, and grooves are provided at both ends of the first connecting part. The groove at one end engages with the protrusion at one end of the bracket and is fastened to the nut by a first hand-tightening bolt; the groove at the other end is connected to the face capture module.

4. The universal detachable face and eye capture system according to claim 1, characterized in that, The facial capture module includes a housing, a first control motherboard, a first camera, and a first infrared fill light; The first control motherboard is disposed inside the housing. The first camera is integrated on the first control motherboard. Multiple first infrared fill lights are arranged around the first camera in a circumferential manner on the first control motherboard.

5. The universal detachable face and eye capture system according to claim 1, characterized in that, The eye-capturing module includes a main control expansion module and two eye-acquisition modules. The two eye-acquisition modules are arranged side by side on the same horizontal line, and the main control expansion module and the eye-acquisition modules are connected by a connecting cable. The main control expansion module has a built-in second control motherboard, and the second control motherboard integrates the second interface. Each of the aforementioned eye acquisition modules is equipped with a second camera and a second infrared fill light.

6. The universal detachable face and eye capture system according to claim 2, characterized in that, The arc-shaped bracket has at least one mounting hole for connecting to the head-mounted display device.

7. The universal detachable face and eye capture system according to claim 2, characterized in that, It also includes a guide block, which is disposed on the edge of the arc-shaped bracket and has an arc-shaped groove for guiding the cable.

8. The universal detachable face and eye capture system according to claim 2, characterized in that, The other end of the bracket is provided with a mounting groove, and the mounting groove is provided with a screw hole, which is connected to the eye-catching module by a screw.

9. The universal detachable face and eye capture system according to claim 3, characterized in that, The face capture module is provided with a second connecting part, which has an opening. The second connecting part is located in the groove at the other end of the first connecting part and is fastened to the nut by a second hand-tightening bolt.

10. The universal detachable face and eye capture system according to claim 4, characterized in that, It also includes a buffer pad, which is disposed between the first camera and the housing.

Images