A detachable smart glasses with multi-modal sensors

Abstract

The utility model belongs to intelligent glasses technical field discloses a detachable intelligent glasses with multimode sensor, including glasses frame and glasses leg subassembly, the glasses frame front part integration camera, ambient light sensor and LED pilot lamp are used for shooting, ambient light detection and state indication, the glasses leg subassembly includes first casing and second casing, first casing with glasses frame articulates, first casing and second casing are detachable connection through buckle structure and lock catch spare, one of the glasses leg subassembly built-in main control board, the main control board on integration multimode sensor and speech processing module are used for heart rate real -time monitoring and environmental sound enhancement. The application through integration multimode sensor has realized the fusion of health monitoring, environmental sound enhancement, shooting, speech interaction and so on multiple functions, provides more comprehensive and convenient use experience for the user.

Description

Technical Field

[0001] This utility model belongs to the field of smart glasses technology, specifically relating to a detachable smart glasses with multimodal sensors. Background Technology

[0002] With the rapid development of smart wearable device technology, smart glasses, as portable devices integrating multiple functions, have gradually attracted market attention. However, existing smart glasses technologies mostly focus on basic functions such as photography and navigation, lacking support for users' health status, such as real-time heart rate monitoring and hearing assistance, making it difficult to meet users' growing health management needs. Meanwhile, while traditional hearing aids can provide hearing assistance, they are bulky, have limited functionality, and have low integration with smart devices, failing to provide users with a convenient and intelligent wearable experience. Furthermore, existing health monitoring devices such as wristbands and watches are limited by their wearing methods and cannot coordinate with the wearing scenarios of glasses, leading to numerous inconveniences for users in terms of health management. Therefore, a detachable smart glasses with multimodal sensors was designed. Utility Model Content

[0003] To address the aforementioned technical issues, this invention provides a detachable smart glasses device with multimodal sensors. By integrating multimodal sensors, it achieves the fusion of multiple functions such as health monitoring, ambient sound enhancement, photography, and voice interaction, providing users with a more comprehensive and convenient user experience.

[0004] The technical solution of this utility model is: a detachable smart glasses with a multimodal sensor, including a frame and temple assembly, wherein the front of the frame integrates a camera, an ambient light sensor and an LED indicator for shooting, ambient light detection and status indication; The temple assembly includes a first housing and a second housing, the first housing being hinged to the frame, and the first housing and the second housing being detachably connected by a snap-fit ​​structure and a locking fastener; One of the temple components has a built-in main control board, which integrates a multimodal sensor and a voice processing module for real-time heart rate monitoring and ambient sound enhancement. The temple assembly has a built-in hearing aid module, which is electrically connected to the main control board. A sound outlet is provided on the temple assembly at the position corresponding to the hearing aid module.

[0005] Preferably, the multimodal sensor includes a PPG sensor, which is electrically connected to the main control board and is used to acquire heart rate signals in real time.

[0006] Preferably, the snap-fit ​​structure includes a snap block disposed on the first housing and a snap groove disposed on the second housing, wherein the snap block snaps into the snap groove for detachable connection of the first housing and the second housing.

[0007] Preferably, the locking element is fixed to the first housing, and the second housing is provided with a slot corresponding to the locking tongue of the locking element, and the locking tongue of the locking element is engaged in the slot.

[0008] Preferably, one of the temple assemblies also contains a microphone array, which is electrically connected to the main control board.

[0009] Preferably, another temple assembly has a built-in microphone array and battery, the microphone array, dynamic speaker, and battery being electrically connected to the main control board.

[0010] Preferably, the microphone array includes four MEMS microphones distributed at the front and rear of the two temple assemblies.

[0011] Preferably, the main control board integrates a gyroscope and an accelerometer to detect head movement trajectories, identify nodding and / or head shaking movements, and manage cervical spine health.

[0012] Preferably, the frame and the area corresponding to the bridge of the nose are provided with a wearing detection module for detecting whether the smart glasses are being worn, and the wearing detection module is electrically connected to the main control board.

[0013] Preferably, the temple assembly has a touch button on its surface, and the touch button is electrically connected to the main control board.

[0014] One or more technical solutions provided in the embodiments of this application have at least the following technical effects or advantages: 1. This application integrates multimodal sensors to achieve the fusion of multiple functions such as health monitoring, environmental sound enhancement, shooting, and voice interaction, providing users with a more comprehensive and convenient user experience.

[0015] 2. The design of the detachable temple assembly allows users to replace or upgrade some components as needed, improving the scalability of the device and reducing the upgrade cost for users. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram of the structure of this utility model; Figure 2 This is a bottom-view perspective view of the structure of this utility model; Figure 3 This is a schematic diagram of the internal structure of one of the temple components of this utility model; Figure 4 This is a schematic diagram of the internal structure of another temple component of this utility model.

[0018] In the attached image:

[0019] 10. Frame; 11. Camera; 12. Ambient light sensor; 13. LED indicator; 20. Temple assembly; 21. First housing; 22. Second housing; 23. Main control board; 24. Microphone array; 25. Hearing aid module; 26. Sound outlet; 27. Slot; 28. Battery; 30. Locking fastener; 40. Wear detection module; 50. Nose pad. Detailed Implementation

[0020] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0021] It should be noted that all directional indications in the embodiments of this application are only used to explain the relative positional relationship and movement of each component in a specific posture. If the specific posture changes, the directional indications will also change accordingly.

[0022] Please see Figure 1-4 A detachable smart glasses with multimodal sensors includes a frame 10 and detachable temple assembly 20. The front of the frame 10 integrates a camera 11, an ambient light sensor 12 and an LED indicator 13 for shooting, ambient light detection and status indication.

[0023] The temple assembly 20 includes a first housing 21 and a second housing 22. The first housing 21 is hinged to the frame 10. The first housing 21 and the second housing 22 are detachably connected by a snap-fit ​​structure and a locking fastener 30. The design of the detachable temple assembly 20 allows users to replace or upgrade some components as needed, improving the scalability of the device and reducing the upgrade cost for users.

[0024] One of the temple components 20 has a built-in main control board 23, which integrates a multimodal sensor, a voice processing module, and a Bluetooth module. The voice processing module is a Zhongke Lanxun BT8922F, used for ambient sound enhancement.

[0025] The temple assembly 20 incorporates a hearing aid module 25, which is a dynamic speaker. A sound outlet 26 is located on the temple assembly 20 corresponding to the position of the hearing aid module 25. The dynamic speaker, combined with the directional sound transmission of the sound outlet, effectively reduces sound loss and interference during propagation, ensuring the user can accurately receive ambient sounds. Furthermore, the integration of the hearing aid module 25 with the smart glasses allows the user to activate the hearing assistance function whenever needed, eliminating the need for additional hearing aids and greatly improving convenience and comfort.

[0026] In this embodiment, the multimodal sensor includes a PPG sensor, which is electrically connected to the main control board 23. The PPG sensor is used to collect heart rate signals in real time.

[0027] In this embodiment, the snap-fit ​​structure includes a snap block disposed on the first housing 21 and a snap groove disposed on the second housing 22. The snap block snaps into the snap groove for detachable connection of the first housing 21 and the second housing 22, which facilitates the maintenance and replacement of internal components.

[0028] In this embodiment, the locking fastener 30 is fixed to the first housing 21, and the second housing 22 is provided with a slot 27 corresponding to the locking tongue of the locking fastener 30. The locking tongue on the locking fastener 30 is engaged in the slot 27, which enhances the stability of the temple assembly 20.

[0029] In this embodiment, one of the temple components 20 is also equipped with a microphone array 24 and a dynamic speaker, which are electrically connected to the main control board 23. The other temple component 20 is equipped with a microphone array 24, a dynamic speaker and a battery 28, which are electrically connected to the main control board 23.

[0030] In this embodiment, the microphone array 24 includes four MEMS microphones, model MS2200AB from Huaxinbang, distributed at the front and rear of the two temple assemblies 20. The four MEMS microphones can capture the user's voice from all directions, ensuring clear voice interaction even in noisy environments.

[0031] In this embodiment, the main control board 23 integrates a gyroscope and an accelerometer to detect head movement trajectory, identify nodding and / or head shaking movements, and manage cervical spine health.

[0032] In one feasible embodiment, using a gyroscope and accelerometer, the smart glasses can monitor the user's head tilt angle and duration in real time. When it detects that the user's head is tilted down for more than a preset angle and for a preset time, it will trigger an alert, prompting the user to adjust their posture and avoid putting pressure on the cervical spine by maintaining a poor posture for a long time. The preset angle and preset time can be adjusted through a mobile app or the smart glasses' settings interface.

[0033] In this embodiment, a wearing detection module 40 is provided in the area corresponding to the bridge of the nose of the frame 10 for detecting whether the smart glasses are being worn. The wearing detection module 40 is electrically connected to the main control board 23.

[0034] In this embodiment, a touch button is provided on the surface of the temple assembly 20, and the touch button is electrically connected to the main control board 23. The touch button enables taking photos and recording videos, and also supports functions such as volume adjustment, answering phone calls, and switching scene modes.

[0035] In some embodiments, the PPG sensor is a TI AFE4404. The PPG sensor integrates red and infrared light emitting units and a photodetector, and is placed inside the temple assembly 20 in contact with the skin area for heart rate monitoring.

[0036] In this embodiment, two nose pads are symmetrically arranged on the frame 10. The nose pads are adjustable and can be adapted to different nose shapes.

[0037] When in use, wear the glasses. When the wearing detection module 40 detects that the glasses are being worn, the smart glasses will automatically turn on. After being removed, they will go into standby mode. After being worn and turned on, the camera 11 can be woken up by voice and taken to take photos, record videos and record audio according to the instructions. Alternatively, photos, videos and audio can be taken by the touch buttons on the temple assembly 20. Or, the gyroscope sensor can be used to detect the wearer's nodding / shaking movements to achieve functions such as quickly answering phone calls. The main control board 23 integrates a multimodal sensor. The PPG sensor emits red / infrared light, receives the light intensity change signal caused by vascular pulsation, and transmits it to the main control board 23, which calculates the heart rate through fast Fourier transform.

[0038] The smart glasses feature a dynamic speaker combined with a directional sound transmission design. They connect to a mobile phone via Bluetooth, support headphone functionality, enabling users to answer calls, play music, and make voice calls. They can also activate hearing assistance functions, eliminating the need for additional hearing aids.

[0039] It should be noted that the heart rate monitoring in this application is intended to provide users with auxiliary reference data for health management and should not be used as a basis for medical diagnosis.

[0040] It should be noted that the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0041] Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the present invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A detachable smart glasses with a multimodal sensor, characterized in that, include: The frame (10) integrates a camera (11), an ambient light sensor (12) and an LED indicator (13) at its front for shooting, ambient light detection and status indication; The temple assembly (20) includes a first housing (21) and a second housing (22), the first housing (21) being hinged to the frame (10), and the first housing (21) and the second housing (22) being detachably connected by a snap-fit ​​structure and a locking fastener (30); One of the temple components (20) has a built-in main control board (23), which integrates a multimodal sensor and a voice processing module for real-time heart rate monitoring and ambient sound enhancement. The temple assembly (20) has a built-in hearing aid module (25), which is electrically connected to the main control board (23). The temple assembly (20) has a sound outlet (26) at the position corresponding to the hearing aid module (25).

2. The detachable smart glasses with multimodal sensors as described in claim 1, characterized in that, The multimodal sensor includes a PPG sensor, which is electrically connected to the main control board (23).

3. The detachable smart glasses with multimodal sensors as described in claim 1, characterized in that, The snap-fit ​​structure includes a snap block disposed on the first housing (21) and a snap groove disposed on the second housing (22). The snap block snaps into the snap groove for detachable connection of the first housing (21) and the second housing (22).

4. The detachable smart glasses with a multimodal sensor as described in claim 1, characterized in that, The locking element (30) is fixed on the first housing (21), and the second housing (22) is provided with a slot (27) corresponding to the locking tongue of the locking element (30), and the locking tongue on the locking element (30) is engaged in the slot (27).

5. The detachable smart glasses with a multimodal sensor as described in claim 1, characterized in that, One of the temple components (20) also contains a microphone array (24), which is electrically connected to the main control board (23).

6. The detachable smart glasses with a multimodal sensor as described in claim 5, characterized in that, Another temple assembly (20) has a built-in microphone array (24) and battery (28), which are electrically connected to the main control board (23).

7. The detachable smart glasses with a multimodal sensor as described in claim 6, characterized in that, The microphone array (24) includes four MEMS microphones distributed at the front and rear of the two temple assemblies (20).

8. The detachable smart glasses with a multimodal sensor as described in claim 1, characterized in that, The main control board (23) integrates a gyroscope and an accelerometer to detect head movement trajectory, identify nodding and / or head shaking movements, and manage cervical spine health.

9. The detachable smart glasses with a multimodal sensor as described in claim 1, characterized in that, The temple assembly (20) is provided with a touch button on its surface, and the touch button is electrically connected to the main control board.

10. The detachable smart glasses with a multimodal sensor as described in claim 1, characterized in that, The frame (10) and the area corresponding to the bridge of the nose are provided with a wearing detection module (40) for detecting whether the smart glasses are being worn. The wearing detection module (40) is electrically connected to the main control board (23).

Images