AR wearable device

Abstract

The utility model discloses AR (Augmented Reality) wearable equipment. The AR wearable equipment comprises a mirror frame main body, a detachable foreground camera module, a pupil detection module and a communication module, a pupil detection module is arranged in the glasses frame main body, a camera assembly clamping groove is formed in the front of the glasses frame main body, the camera assembly clamping groove is used for configuring the detachable foreground camera module, and a pluggable nose pad structure is arranged below the front of the glasses frame main body; the pupil detection module comprises at least one pupil camera, and the pupil camera is used for detecting pupil information of a user; the detachable foreground camera module is used for expanding and capturing scene information; the communication module is arranged in the glasses legs of the glasses frame main body and is electrically connected with the detachable foreground camera module and the pupil detection module, and the communication module is provided with a main processor board and a WiFi module, so that high integration of multiple purposes, high adaptability and comfort is realized, and the integration level and the high adaptability of the AR wearable equipment are improved.

Description

Technical Field

[0001] The utility model relates to the technical field of wearable devices, and in particular to an AR wearable device. Background Art

[0002] Intelligent human-computer interaction is one of the core technologies for the development of modern society. It plays a vital role in promoting communication and task execution between humans and computer systems. Eye contact interaction plays a key role in completing complex human-computer collaborative tasks. As an intelligent interaction method, eye contact interaction, with its non-contact, implicit and active characteristics, can realize input control through the user's gaze position, bringing users an unprecedented interactive experience.

[0003] With the rapid development of augmented reality (AR) technology and its wide application in education, entertainment, industrial maintenance and other fields, the market demand for high-performance AR devices is increasing day by day. However, current AR wearable devices generally have problems such as narrow field of view, discomfort to wear, and single function, which limits their application potential in certain professional scenarios. In addition, most existing AR wearable devices adopt a fixed structure design, lacking flexibility and personalized configuration, and it is difficult to meet the diverse needs of different user groups.

[0004] These problems limit the widespread application of eye-gaze interaction technology in human-computer interaction tasks. How to optimize hardware design, reduce the sensitivity of eye-gaze interaction to viewing angle and distance, expand the range of suitable people and improve wearing comfort has become an important issue that needs to be solved urgently. Summary of the invention

[0005] The embodiment of the utility model provides an AR wearable device to improve the field of view and compatibility of the AR wearable device.

[0006] In order to solve the above technical problems, an embodiment of the present application provides an AR wearable device, including a frame body, a detachable foreground camera module, a pupil detection module and a communication module;

[0007] The frame body has a built-in pupil detection module, a camera assembly slot is arranged in the front of the frame body, the camera assembly slot is used to arrange the detachable foreground camera module, and a pluggable nose pad structure is arranged at the lower front of the frame body;

[0008] The pupil detection module includes at least one pupil camera, and the pupil camera is used to detect user pupil information;

[0009] The detachable foreground camera module is used to expand the captured scene information, and includes a foreground camera fixing component and a foreground camera module;

[0010] The communication module is built into the temple of the frame body and is electrically connected to the detachable foreground camera module and the pupil detection module. The communication module is equipped with a main processor board and a WiFi module to support real-time capture of images and videos and transmission to other devices.

[0011] Optionally, the frame body is made of polylactic acid material and has a built-in drawer wire groove, and the drawer wire groove is used to hide the data lines of the detachable foreground camera module and the pupil detection module.

[0012] Optionally, the pupil detection module adopts a three-stage adjustable structure, including a uniform limit slot, a side frame connecting plate arranged parallel to the frame body, a side frame connecting rod placed in the uniform limit slot and adjustable for longitudinal extension, and a camera limit plate, the tail end of the side frame connecting rod is connected to the camera limit plate through a universal ball, and the uniform limit slot is a uniformly distributed limit slot.

[0013] Optionally, the AR wearable device further includes a coprocessor chip, and the coprocessor chip is disposed at the tail of the frame body.

[0014] Optionally, the AR wearable device also includes at least one micro RGB camera, which is located in front of the frame body and embedded in the frame body to assist in capturing user eye image information and target scene image information.

[0015] Optionally, the foreground camera fixing component is a support frame, and the foreground camera module is connected to the frame body through the support frame. A movable slide rail and a tail stock are provided on both sides of the inner wall of the frame body. The movable slide rail and the tail stock are movably arranged on the frame body along the horizontal direction of the frame body, and have a sliding damping in the vertical direction of the frame body, so that the support frame can move horizontally relative to the frame body under the traction of an external force.

[0016] Optionally, the camera assembly slot is built with a groove guide rail, the groove guide rail is distributed with a plurality of equally spaced grooves, and the groove guide rail is connected to the support frame via the equally spaced grooves.

[0017] Optionally, the number of the equally spaced card slots is 16.

[0018] Optionally, two rows of infrared light array modules are provided on both sides of the pupil camera, and the infrared light array modules are used to assist in locating the pupil.

[0019] Optionally, the foreground camera module includes at least one of a binocular camera module or a depth camera module.

[0020] The AR wearable device provided by the embodiment of the utility model includes a frame body, a detachable foreground camera module, a pupil detection module and a communication module; the frame body has a built-in pupil detection module, a camera assembly slot is arranged in the front of the frame body, the camera assembly slot is used to configure the detachable foreground camera module, and a pluggable nose pad structure is arranged in the front and lower part of the frame body; the pupil detection module includes at least one pupil camera, and the pupil camera is used to detect the user's pupil information; the detachable foreground camera module is used to expand the captured scene information, and includes a foreground camera fixing component and a foreground camera module; the communication module is built into the temple of the frame body, electrically connected to the detachable foreground camera module and the pupil detection module, and is equipped with a main processor board and a WiFi module, so as to achieve a high degree of integration of multi-purpose, high adaptability and comfort, and improve the integration and high adaptability of the AR wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the utility model, the drawings required for use in the description of the embodiments of the utility model will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the utility model. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 It is a schematic diagram of the overall structure of the AR wearable device of the present application;

[0023] Figure 2 is a top view of the AR wearable device of the present application;

[0024] Figure 3 is a rear view of the AR wearable device of the present application;

[0025] Figure 4 is a right view of the AR wearable device of the present application;

[0026] Figure 5 This is another structural schematic diagram of the AR wearable device of the present application.

[0027] The reference numerals are respectively: frame body 1, detachable foreground camera module 2, pupil detection module 3, communication module 4, pluggable nose pad structure 5, camera assembly slot 6, pupil camera 7, infrared light array module 8, pupil camera limiting hole 9, camera limiting plate 10, side frame connecting rod 11. DETAILED DESCRIPTION

[0028] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of the present application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present application; the terms "including" and "having" and any variations thereof in the specification and claims of the present application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0029] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0030] The following will be combined with the drawings in the embodiments of the utility model to clearly and completely describe the technical solutions in the embodiments of the utility model. Obviously, the described embodiments are part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.

[0031] See also Figures 1 to 5 , Figure 1 The figure shows an overall structural diagram of an AR wearable device provided by an embodiment of the utility model. Figure 2 is a top view of the AR wearable device of the present application, Figure 3 is a rear view of the AR wearable device of the present application, Figure 4 is a right view of the AR wearable device of the present application, Figure 5 This is another structural schematic diagram of an AR wearable device of the present application, and the AR wearable device is described in detail as follows:

[0032] An AR wearable device comprises a frame body 1, a detachable foreground camera module 2, a pupil detection module 3 and a communication module 4;

[0033] The frame body 1 has a built-in pupil detection module 3, a camera assembly slot 6 is disposed in the front of the frame body 1, and the camera assembly slot is used to configure the detachable foreground camera module 2, and a pluggable nose pad structure 5 is disposed at the lower front of the frame body 1;

[0034] The pupil detection module 3 includes at least one pupil camera 7, and the pupil camera 7 is used for detecting user pupil information;

[0035] The detachable foreground camera module 2 is used to expand the captured scene information, and includes a foreground camera fixing component and a foreground camera module;

[0036] The communication module 4 is built into the temple of the frame body 1 and is electrically connected to the detachable foreground camera module 2 and the pupil detection module 3. The communication module 4 is equipped with a main processor board and a WiFi module to support real-time capture of images and videos and transmission to other devices.

[0037] The frame body 1 may be a head-mounted frame body.

[0038] Specifically, unlike the traditional integrated design of frame and camera, the AR wearable device in the embodiment of the present application adopts a detachable camera fixing device with a foreground camera module installation method, which is convenient for users to choose suitable models of binocular camera modules and depth camera modules according to different application scenarios, thereby realizing a flexible configuration of one machine for multiple uses.

[0039] It should be understood that the camera assembly slot 6 is specially designed for the high-performance depth camera module in this embodiment, and the corresponding module can also be installed according to actual needs. The depth camera module can capture three-dimensional information in the environment in real time, providing users with a richer and more realistic AR experience. With the support of depth data, the device can realize a variety of interactive modes such as object recognition, text segmentation, gesture control, etc., which greatly expands the functionality and interactivity of AR wearable devices. This design not only improves the versatility and flexibility of the device, but also provides users with a comprehensive and immersive augmented reality experience.

[0040] Furthermore, in this embodiment, the traditional connection structure of the frame and the temples being separated is abandoned, and an integrated frame body design is adopted, and a draw-out wire groove is built in to hide the data cables of the detachable foreground camera module 2 and the pupil detection module 3. Compared with the traditional connection structure, this integrated wire groove design significantly reduces the exposure of the data cables, and improves the aesthetics and durability of the device.

[0041] Specifically, a shell-drawing wire duct refers to an integrated wire duct that is designed using a shell-drawing command and then obtained using 3D printing. In this embodiment, the shell-drawing command of 3D printing is used to create the cavity part of the wire duct, and multiple open faces are selected to adapt to different clamping distributions and wiring requirements. For example, a rectangular parallelepiped is created through the stretch command, and then the shell-drawing command is used to set the thickness and select the faces to be opened, thereby creating a box without a lid. Such a structure can be used for the design of wire ducts. The use of the shell-drawing command makes the wire duct design more flexible and efficient, and which faces to retain as closed and open parts can be selected according to actual needs.

[0042] Furthermore, shielding covers are installed on both sides of the main processor board and the WiFi module of the communication module 4 respectively.

[0043] Optionally, the frame body 1 is an integrated structure made of polylactic acid material and has a built-in drawer wire groove, and the drawer wire groove is used to hide the data lines of the detachable foreground camera module 2 and the pupil detection module 3.

[0044] Among them, in this embodiment, the depth perception function is integrated into the design of the AR wearable device through a depth camera. The depth camera can provide accurate spatial information, which is essential for achieving a more natural interactive experience. However, how to effectively combine the depth camera with the AR wearable device and achieve high performance without sacrificing lightness and comfort is one of the main challenges currently faced. To this end, the traditional design of the frame connected to the temples is abandoned in the embodiment, and an integrated frame body is adopted, and 3D printing is performed using highly ductile polylactic acid material (PLA). This method not only improves the wearing comfort of the AR wearable device, but also enhances the wrapping of the frame to the head, effectively reduces the loosening or falling off of the device due to movement, and improves the wearing stability, thereby avoiding the problem of pupil recalibration caused by device shaking.

[0045] Optionally, the pupil detection module adopts a three-stage adjustable structure, including a uniform limit slot, a side frame connecting plate arranged in parallel with the frame body, a side frame connecting rod 11 placed in the uniform limit slot and adjustable for longitudinal extension, and a camera limit plate 10, the tail end of the side frame connecting rod 11 is connected to the camera limit plate 10 through a universal ball, and the uniform limit slot is a uniformly distributed limit slot. Among them, the pupil camera limit hole 9 fixes the pupil camera 7 and the infrared light array module 8 on the camera limit plate 10.

[0046] Specifically, this embodiment changes the side frame structure of pupil detection into a three-stage design, including: a side frame connecting plate with a uniform limit slot and parallel arrangement with the frame body 1, a side frame connecting rod 11 placed in the slot and adjustable for longitudinal telescopic movement, and a camera limit plate 10. The tail end of the side frame connecting rod 11 is connected to the camera limit plate 10 through a universal ball, so that the position relationship of the pupil detection module relative to the user's pupil can be flexibly adjusted, thereby facilitating more accurate pupil calibration. This modular design not only improves the adaptability of the device, but also brings a better user experience to the user.

[0047] In this embodiment, a three-stage adjustable design is introduced on the pupil detection module 3, including a retractable connecting rod and a universal ball joint, so that the pupil camera can be flexibly adjusted to the optimal position. This innovative structure improves the accuracy and flexibility of pupil detection, ensuring that the device can efficiently locate and track pupils in different wearers and scenarios.

[0048] Optionally, the AR wearable device further includes a coprocessor chip, and the coprocessor chip is configured at the rear of the frame body 1.

[0049] In the design of this communication processing module, the coprocessor chip is set at the tail of the frame and connected to the support frame; each temple is equipped with a main processor board and a WiFi module to undertake core computing and data processing functions. The communication processing module 4 supports real-time capture of images and videos and transmission to other devices. The technical solution of this application disperses the high-power consumption components in the AR wearable device through reasonable layout, avoids the concentration of high-energy consumption components, and improves the heat dissipation effect.

[0050] Optionally, the AR wearable device further includes at least one micro RGB camera, which is located in front of the frame body 1 and embedded in the frame body 1, and is used to assist in capturing user eye image information and target scene image information.

[0051] Specifically, the present embodiment further installs a miniature RGB camera in front of the frame body 1. As a preferred embodiment, the number of RGB cameras in the present embodiment is two, and the RGB camera is embedded in the frame body 1, so that the control system can more widely capture the user's eye image information and the image information of the target scene.

[0052] Furthermore, the micro RGB camera is electrically connected to the coprocessor board, and the USB data cable is hidden in the grooves on both sides of the frame body.

[0053] Optionally, the foreground camera fixing component is a support frame, and the foreground camera module is connected to the frame body 1 through the support frame. A movable slide rail and a tail stock are provided on both sides of the inner wall of the frame body 1. The movable slide rail and the tail stock are movably arranged on the frame body along the horizontal direction of the frame body 1, and have a sliding damping in the vertical direction of the frame body 1, so that the support frame can move horizontally relative to the frame body under the traction of an external force.

[0054] Furthermore, the camera assembly slot 6 is built with a groove guide rail, the groove guide rail is distributed with a plurality of equally spaced grooves, and the groove guide rail is connected to the support frame through the equally spaced grooves. A movable guide rail is built into the depth camera support frame, and the extension direction of the guide column is consistent with the height of the frame; the sliding arm can slide along the extension direction of the depth camera support frame.

[0055] Optionally, the number of the equally spaced card slots is 16.

[0056] Optionally, two rows of infrared light array modules 8 are provided on both sides of the pupil camera, and the infrared light array modules 8 are used to assist in locating the pupil.

[0057] Specifically, two rows of infrared light array modules 8 are provided on both sides of the pupil camera 7. The infrared camera is used to emit infrared light and receive infrared light reflected from the eye. Since the reflection characteristics of the pupil under infrared light are different from those of other parts such as the iris and cornea, the pupil camera 7 can locate the pupil by analyzing these reflected images and perform further processing, such as tracking pupil movement or measuring pupil diameter.

[0058] It should be understood that by installing a pupil detection camera with an infrared light array, etc., when the device is actually operated, the device reasonably designs the optical system so that two infrared lights illuminate the eyes to obtain a clear pupil image and double corneal bright spots, and obtains a qualified eye image through an optical filtering system for subsequent extraction of eye movement information. The first foreground camera and the second infrared array pupil detection camera, which are symmetrically distributed front and back, can respectively realize image acquisition of the computer screen and the user's eye movement image. When processing data, the image preprocessing module mainly completes image smoothing and noise filtering and the region of interest (Region of Interest) of the eye image. The eye tracking module is used to set the center of interest (ROI), and then obtain the position of the pupil center and the corneal bright spot through the eye feature acquisition module. The matching module of the eye feature and the screen coordinate system includes the calibration state calculation and the working state calculation. The calibration process must be performed before eye tracking. After that, the previous calibration parameters are used in the working state to complete the matching of the eye movement data and the screen coordinates, and the coordinates of the line of sight on the screen are calculated. The line of sight tracking result display module is mainly used for the back-end display work, which renders and synthesizes the line of sight coordinates and eye movement data in the real-time collected eye image and screen image respectively, displays the gaze point position in the form of an icon, and realizes the control of the mouse by line of sight.

[0059] Optionally, the foreground camera module includes at least one of a binocular camera module or a depth camera module.

[0060] In this embodiment, there are a frame body, a detachable foreground camera module, a pupil detection module and a communication module; the frame body has a built-in pupil detection module, a camera assembly slot is arranged in the front of the frame body, the camera assembly slot is used to configure the detachable foreground camera module, and a pluggable nose pad structure is arranged in the front and lower part of the frame body; the pupil detection module includes at least one pupil camera, and the pupil camera is used to detect the user's pupil information; the detachable foreground camera module is used to expand the captured scene information; the communication module is built into the temple of the frame body, electrically connected to the detachable foreground camera module and the pupil detection module, and is equipped with a main processor board and a WiFi module, so as to achieve a high degree of integration of multi-purpose, high adaptability and comfort, and improve the integration and high adaptability of AR wearable devices.

[0061] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method.

[0062] Obviously, the embodiments described above are only some embodiments of the present application, rather than all embodiments. The preferred embodiments of the present application are given in the accompanying drawings, but they do not limit the patent scope of the present application. The present application can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present application more thorough and comprehensive. Although the present application is described in detail with reference to the aforementioned embodiments, for those skilled in the art, it is still possible to modify the technical solutions recorded in the aforementioned specific implementation methods, or to perform equivalent replacement of some of the technical features therein. Any equivalent structure made using the contents of the specification and drawings of this application, directly or indirectly used in other related technical fields, is similarly within the scope of patent protection of this application.

Claims

1. An AR wearable device, characterized in that: It includes a frame body, a detachable foreground camera module, a pupil detection module and a communication module; The frame body has a built-in pupil detection module, a camera assembly slot is arranged in the front of the frame body, the camera assembly slot is used to arrange the detachable foreground camera module, and a pluggable nose pad structure is arranged at the lower front of the frame body; The pupil detection module includes at least one pupil camera, and the pupil camera is used to detect user pupil information; The detachable foreground camera module is used to expand the captured scene information, and includes a foreground camera fixing component and a foreground camera module; The communication module is built into the temple of the frame body and is electrically connected to the detachable foreground camera module and the pupil detection module. The communication module is equipped with a main processor board and a WiFi module to support real-time capture of images and videos and transmission to other devices.

2. The AR wearable device according to claim 1, wherein: The frame body is made of polylactic acid material and has a built-in drawer wire groove, which is used to hide the data lines of the detachable foreground camera module and the pupil detection module.

3. The AR wearable device according to claim 1, wherein: The pupil detection module adopts a three-stage adjustable structure, including a uniform limit slot, a side frame connecting plate arranged parallel to the frame body, a side frame connecting rod placed in the uniform limit slot and adjustable for longitudinal extension, and a camera limit plate. The tail end of the side frame connecting rod is connected to the camera limit plate through a universal ball. The uniform limit slot is a uniformly distributed limit slot.

4. The AR wearable device according to claim 1, wherein: The AR wearable device also includes a coprocessor chip, and the coprocessor chip is configured at the tail of the frame body.

5. The AR wearable device according to claim 1, wherein: The AR wearable device also includes at least one micro RGB camera, which is located in front of the frame body and embedded in the frame body to assist in capturing user eye image information and target scene image information.

6. The AR wearable device according to claim 1, wherein: The foreground camera fixing component is a support frame, and the foreground camera module is connected to the frame body through the support frame. Movable slide rails and tail stocks are provided on both sides of the inner wall of the frame body. The movable slide rails and the tail stock are movably arranged on the frame body along the horizontal direction of the frame body, and have sliding damping in the vertical direction of the frame body, so that the support frame can move horizontally relative to the frame body under the traction of external force.

7. The AR wearable device according to claim 6, wherein: The camera assembly slot is built with a groove guide rail, and the groove guide rail is distributed with a plurality of equally spaced grooves, and the groove guide rail is connected to the support frame through the equally spaced grooves.

8. The AR wearable device according to claim 7, characterized in that: The number of the equally spaced card slots is 16.

9. The AR wearable device according to claim 1, wherein: Two rows of infrared light array modules are provided on both sides of the pupil camera, and the infrared light array modules are used to assist in locating the pupil.

10. The AR wearable device according to claim 1, wherein: The foreground camera module includes at least one of a binocular camera module or a depth camera module.

Images