Cognitive accessory combining brain-computer interface and intelligent glasses

Abstract

The utility model relates to the crossing field of wearable intelligent equipment and neural engineering, and discloses a brain-computer interface and intelligent glasses combined cognitive accessory which comprises an in-ear electrode module, a plurality of EEG electrodes and an intelligent glasses frame are arranged on the in-ear electrode module, glasses legs are arranged on the left side and the right side of the intelligent glasses frame, and the glasses legs are connected with the brain-computer interface and the intelligent glasses. A glasses nose pad is arranged at the bottom of the intelligent glasses frame, two lenses are mounted on the intelligent glasses frame, a non-intrusive brain signal acquisition module, an environment sensing module, an embedded processor and an AR display module are integrated in the intelligent glasses frame, the brain signal acquisition module adopts a flexible electrode, and the environment sensing module adopts a non-intrusive brain signal acquisition module. And the glasses lenses are distributed on the inner sides of the glasses nose pads and the glasses legs. The flexible EEG electrode and the miniature fNIRS probe are integrated in the intelligent glasses frame, a user can achieve efficient and non-invasive electroencephalogram and cerebral blood oxygen monitoring without wearing traditional complex head-mounted equipment, and the equipment is lighter, more comfortable and convenient to wear for a long time due to the design.

Description

Technical Field

[0001] This utility model relates to the interdisciplinary field of wearable smart devices and neural engineering, specifically to a cognitive accessory that combines a brain-computer interface with smart glasses. Background Technology

[0002] With the continuous development of brain-computer interface (BCI) technology and the popularization of smart wearable devices, how to effectively combine the two to improve users' cognitive experience and interaction efficiency has become a current research hotspot. BCI technology provides users with real-time brainwave monitoring and feedback by collecting neural signals such as electroencephalograms (EEGs) and functional near-infrared spectroscopy (FIR). Meanwhile, smart glasses, as a highly convenient wearable device, have been widely used in augmented reality (AR) displays, environmental perception, and intelligent assistance due to their lightweight, portability, and all-weather wearability.

[0003] Existing brain-computer interface devices typically require head-mounted devices or attached electrodes to acquire brain signals, which are often inconvenient to wear for extended periods. Summary of the Invention

[0004] To address the shortcomings of existing technologies, this invention provides a cognitive accessory that combines a brain-computer interface with smart glasses, solving the problem that the device is bulky and inconvenient for long-term wear.

[0005] To achieve the above objectives, this utility model provides the following technical solution: a cognitive accessory combining a brain-computer interface and smart glasses, comprising:

[0006] An in-ear electrode module, wherein the in-ear electrode module is provided with multiple EEG electrodes;

[0007] The smart glasses frame has temples on both the left and right sides, a nose pad at the bottom, two lenses mounted on it, and integrates a non-invasive brain signal acquisition module, an environmental perception module, an embedded processor, and an AR display module.

[0008] The brain signal acquisition module uses flexible electrodes, which are distributed on the nose pads and inner sides of the temples of the glasses, and a miniature fNI RS probe is provided on the edge of the lens.

[0009] The environmental perception module includes a binocular RGB camera integrated on the upper edge of the smart glasses frame, a motion sensor embedded in the temple, and audio sensors located on both sides of the smart glasses frame.

[0010] The binocular RGB camera supports SLAM environment modeling and eye tracking;

[0011] The motion sensor includes an accelerometer, a gyroscope, and a magnetometer, and is used for head posture compensation and motion artifact elimination.

[0012] The audio sensor employs a directional microphone array and is used to collect ambient sound and separate user voice commands.

[0013] The embedded processor includes a front-end processing unit, a multimodal fusion algorithm main control unit, and a communication interface.

[0014] Preferably, the smart glasses frame is made of lightweight magnesium alloy, and the temples have built-in flexible circuits that connect EEG electrodes to a miniature fNI RS probe at the edge of the lens.

[0015] Preferably, a power module is integrated at the ends of both temples, and the power module adopts a split design, with the ends of the temples being detachable from the main body of the temples.

[0016] Preferably, two sets of flexible dry electrodes are embedded above the nose pads of the glasses, and the surfaces are coated with Ag / AgCl. Both sets of flexible dry electrodes are used to collect EEG signals from the prefrontal cortex.

[0017] Preferably, the temples are connected to the smart glasses frame by an elastic hinge bracket, the ends of the temples are elastic telescopic structures, and the temples have built-in impedance detection chips to adjust the pressure according to the user's head circumference, ensuring that the contact impedance between the electrodes and the skin is <10kΩ.

[0018] Preferably, three miniature fN I RS probes are distributed on the inner sides of each of the left and right temples. All three miniature fN I RS probes are used to monitor changes in temporal lobe blood oxygenation and to identify memory load and fatigue state.

[0019] Preferably, the environmental perception module further includes an ambient light sensor integrated under the smart glasses frame, used to detect the ambient light intensity and automatically adjust the brightness of the AR display module.

[0020] Preferably, the in-ear electrode module is ergonomically designed to fit the contours of the ear, thereby improving wearing comfort and stability.

[0021] Preferably, the AR display module uses a high-resolution, low-power display screen and has eye protection function.

[0022] Preferably, the embedded processor also integrates a local storage unit for temporarily storing the collected brain signal data, environmental perception data, and processed analysis results.

[0023] This invention provides a cognitive accessory that combines a brain-computer interface with smart glasses. It offers the following advantages:

[0024] 1. This utility model integrates flexible EEG electrodes and a miniature fNI RS probe within the frame of smart glasses, enabling users to achieve efficient and non-invasive EEG and cerebral oxygenation monitoring without wearing traditional complex head-mounted devices. This design makes the device lighter, more comfortable, and convenient for long-term wear.

[0025] 2. By integrating a dual-lens RGB camera, a motion sensor, and an audio sensor, this utility model enables the device to perceive the user's environment and movement status in real time, supporting eye tracking, head posture compensation, and motion artifact elimination. At the same time, the audio sensor can accurately separate the user's voice commands, providing a more precise voice interaction experience.

[0026] 3. By fusing EEG, fN IRS, eye tracking, and IMU data, this invention enables the device to deeply analyze the user's cognitive state, attention distribution, emotional changes, and fatigue level, thereby providing personalized feedback to help users improve cognitive efficiency and avoid cognitive overload.

[0027] 4. The smart glasses of this utility model adopt a lightweight magnesium alloy frame, combined with flexible circuit and split power supply design, to ensure that the device provides powerful functions while maintaining a comfortable wearing experience, avoiding pressure on the head and eyes, and is suitable for long-term use.

[0028] 5. Based on real-time collected brain signal data and environmental information, this utility model enables the device to intelligently analyze and provide personalized cognitive state feedback, such as reminding users to rest, adjust their posture, or enhance their attention, thereby effectively improving users' work efficiency and quality of life. Attached Figure Description

[0029] Figure 1 This is a schematic diagram of the overall structure of the cognitive accessory that combines a brain-computer interface with smart glasses according to this utility model.

[0030] Among them, 1. In-ear electrode module; 2. Smart glasses frame. Detailed Implementation

[0031] The technical solution of this utility model will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this utility model, and not all embodiments. Based on the embodiments of this utility model, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this utility model.

[0032] Please see the appendix Figure 1 This utility model embodiment provides a cognitive accessory combining a brain-computer interface and smart glasses, including:

[0033] In-ear electrode module 1, which is equipped with multiple EEG electrodes;

[0034] The smart glasses frame 2 has temples on both the left and right sides, a nose pad at the bottom, and two lenses. The smart glasses frame 2 integrates a non-invasive brain signal acquisition module, an environmental perception module, an embedded processor, and an AR display module.

[0035] The brain signal acquisition module uses flexible electrodes, which are distributed on the nose pads and inner sides of the temples of the glasses, and miniature fN I RS probes are located on the edges of the lenses;

[0036] The environmental perception module includes a binocular RGB camera integrated on the upper edge of the smart glasses frame 2, a motion sensor embedded in the right temple, and audio sensors located on both sides of the smart glasses frame 2.

[0037] The dual-lens RGB camera supports SLAM environment modeling and eye tracking;

[0038] Motion sensors include accelerometers, gyroscopes, and magnetometers. They are used for head posture compensation and motion artifact elimination.

[0039] The audio sensor uses a directional microphone array to collect ambient sound and separate user voice commands.

[0040] The embedded processor includes a front-end processing unit responsible for signal filtering and noise reduction, a main control unit responsible for running the EEG+fNIR+eye-tracking+IMU multimodal fusion algorithm, and a communication interface that supports Bluetooth 5.2 and Wi-Fi 6 for connecting to cloud AI model updates or local devices.

[0041] The in-ear electrode module 1 is a brain-computer interface. Multiple EEG electrodes are set on the in-ear electrode module 1, which can effectively collect weak electrical signals emitted by the brain. The in-ear design brings the electrodes closer to the temporal lobe region of the brain, improving the accuracy and stability of signal acquisition. This provides a data foundation for the analysis of brain neural activity and helps to accurately capture neural signals related to the user's thoughts and emotions. The EEG electrodes work based on the principle of bioelectrical conduction. The tiny currents generated by the activity of brain neurons are conducted to the surface of the scalp. The EEG electrodes collect these electrical signals by contacting the ear canal. The design of the in-ear electrode module is based on the physiological structure of the human ear, so that the electrodes fit tightly to the ear canal, reducing signal interference and optimizing the signal acquisition effect.

[0042] The smart glasses frame 2 is made of lightweight magnesium alloy, with flexible circuitry built into the temples to connect EEG electrodes to a miniature fNIRS probe on the edge of the lens.

[0043] The smart glasses frame 2 is made of lightweight magnesium alloy, which significantly reduces the overall weight of the glasses and improves wearing comfort, allowing users to wear them for a long time without feeling fatigued. At the same time, magnesium alloy has good strength and toughness, ensuring that the glasses frame can withstand a certain amount of external force in daily use without being easily damaged, thus ensuring the stability and durability of the device.

[0044] Magnesium alloys are alloys composed of magnesium as the base and other elements. They have a relatively low density, achieving lightweight while ensuring structural strength. The crystal structure and alloy composition of this material endow it with good mechanical properties, enabling it to meet the usage requirements of the smart glasses frame 2.

[0045] The temple has a built-in flexible circuit that connects the EEG electrode to the miniature fNIRS probe on the edge of the lens, achieving a stable and reliable electrical connection between the various functional modules. The flexible circuit can adapt to the bending and deformation of the temple and will not be damaged by bending during daily use, ensuring the stability of signal transmission and ensuring that brain nerve signals and other physiological signals can be smoothly transmitted to the subsequent processing modules.

[0046] Flexible circuits typically consist of a flexible substrate, conductive lines, and a cover layer. The flexible substrate is made of flexible polyimide, which can be bent to a certain extent without affecting the performance of the conductive lines. The conductive lines are fabricated on the flexible substrate through special printing or etching processes and are responsible for transmitting electrical signals.

[0047] The power module is integrated into the ends of both temples. The power module adopts a split design, and the ends of the temples are detachable from the main body of the temples.

[0048] This design allows users to quickly replace the power module when it runs out of power, ensuring continuous operation of the device. At the same time, the split design helps to balance the overall weight distribution of the glasses, further improving wearing comfort.

[0049] The separate power module connects to the temple body via an electrical interface to transmit electrical energy. The detachable structure typically uses a magnetic connection for easy user operation, ensuring stable electrical connection while meeting the need for quick power supply replacement.

[0050] Two sets of flexible dry electrodes are embedded above the nose pads of the glasses. The surface is coated with Ag / AgCl. Both sets of flexible dry electrodes are used to collect EEG signals from the prefrontal cortex.

[0051] Two sets of flexible dry electrodes with Ag / AgCl coatings are embedded above the nose pads of the glasses. They are specifically designed to collect EEG signals from the prefrontal cortex, which is closely related to higher cognitive functions such as attention, emotion regulation, and decision-making. Collecting EEG signals from this area helps to analyze the user's cognitive state and emotional changes in depth, providing data support for providing more targeted feedback and intervention measures.

[0052] The Ag / AgCl coating exhibits excellent conductivity and biocompatibility, reducing contact resistance between the electrode and skin and improving signal acquisition quality. The flexible dry electrode conforms to the skin surface above the nose pad, adapting to different users' facial contours and ensuring stable signal acquisition. Electrical signals generated by neuronal activity in the prefrontal cortex of the brain are conducted through the skin to the electrode and then acquired.

[0053] The temples are connected to the smart glasses frame 2 by an elastic hinge bracket. The ends of the temples are elastic telescopic structures. The temples have built-in impedance detection chips to adjust the pressure according to the user's head circumference, ensuring that the contact impedance between the electrodes and the skin is <10kΩ.

[0054] It can automatically adjust the pressure of the temples on the head according to the user's head circumference, ensuring that the contact impedance between the electrodes and the skin is always less than 10kΩ, thus ensuring good contact between the electrodes and the skin, improving the quality and stability of signal acquisition. Regardless of the user's head circumference or slight head movement during wear, it can ensure that the device works normally and accurately acquires nerve signals.

[0055] The flexible hinged frame allows the temples to rotate flexibly within a certain angle range to adapt to different head shapes and wearing habits. The elastic telescopic temples, through an internal elastic structure, can automatically adjust their length according to external pressure. An impedance detection chip monitors the contact impedance between the electrodes and the skin in real time. When the impedance exceeds a set threshold, a feedback mechanism adjusts the temple pressure to maintain the impedance within a suitable range, based on the principles of impedance measurement and feedback control in electrical engineering.

[0056] Three miniature fNIRS probes are distributed on the inner side of each temple. All three miniature fNIRS probes are used to monitor changes in temporal lobe blood oxygenation and to identify memory load and fatigue status.

[0057] The temporal lobe of the brain is related to memory and auditory processing functions. By monitoring changes in blood oxygen content in the temporal lobe, the metabolic status of brain neural activity in this area can be indirectly reflected, providing an important basis for assessing the user's cognitive state, helping the user to understand their own state in a timely manner, take corresponding measures to adjust, and avoid excessive fatigue or excessive cognitive load.

[0058] The miniature fNI RS probe operates based on near-infrared spectroscopy technology. Near-infrared light can penetrate the scalp and skull to enter brain tissue. Different brain tissue components have different absorption and scattering characteristics for near-infrared light. When brain neural activity increases, the blood oxygen content of local brain tissue changes. By detecting the changes in the absorption and scattering of near-infrared light in brain tissue, the changes in the blood oxygen content of the temporal lobe can be calculated, thereby enabling the monitoring of cognitive status.

[0059] The environmental perception module also includes an ambient light sensor integrated under the smart glasses frame 2, which is used to detect the ambient light intensity and automatically adjust the brightness of the AR display module.

[0060] The system detects ambient light intensity in real time and automatically adjusts the brightness of the AR display module, ensuring that users can clearly see the AR display content in different lighting conditions. At the same time, it avoids excessively bright or dark displays that may cause discomfort to the user's eyes, thereby improving the user experience.

[0061] Ambient light sensors typically use photoresistors. When the intensity of ambient light changes, the resistance of the photosensitive element changes accordingly. This change is converted into an electrical signal by a circuit and transmitted to the control unit. The control unit adjusts the brightness of the AR display module according to a preset algorithm to achieve automatic adjustment.

[0062] The in-ear electrode module 1 is ergonomically designed to fit the contours of the ear, improving wearing comfort and stability.

[0063] The AR display module uses a high-resolution, low-power display and has eye-protection features.

[0064] The high-resolution display uses an AR display with a single-eye resolution of 1080×1200 or higher. This high resolution clearly presents various visual feedback information, allowing users to accurately understand their own cognitive state. Low power consumption helps extend the device's battery life, reducing charging frequency and improving portability and ease of use. Eye protection features adjust screen brightness, color temperature, and blue light ratio to reduce eye strain, making it suitable for extended use.

[0065] The embedded processor also integrates a local storage unit for temporarily storing the acquired brain signal data, environmental perception data, and processed analysis results.

[0066] The local storage unit integrated into the embedded processor is used to temporarily store the acquired brain signal data, environmental perception data, and processed analysis results. In the event of poor or no network connection, it ensures that the data will not be lost and can continue to perform local data analysis and processing. At the same time, local storage also helps to improve the efficiency of data processing, reduce the latency caused by data transmission, and support real-time feedback and rapid decision-making.

[0067] Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the present invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A cognitive accessory combining a brain-computer interface and smart glasses, characterized in that, include: An in-ear electrode module (1) is provided with multiple EEG electrodes; The smart glasses frame (2) has temples on both the left and right sides, a nose pad at the bottom, two lenses on the frame, and integrates a non-invasive brain signal acquisition module, an environmental perception module, an embedded processor, and an AR display module. The brain signal acquisition module uses flexible electrodes distributed on the nose pads and inner sides of the temples of the glasses, and a miniature fNIRS probe is provided on the edge of the lens. The environmental perception module includes a binocular RGB camera integrated on the upper edge of the smart glasses frame (2), a motion sensor embedded in the temple, and an audio sensor located on both sides of the smart glasses frame (2). The binocular RGB camera supports SLAM environment modeling and eye tracking; The motion sensor includes an accelerometer, a gyroscope, and a magnetometer, and is used for head posture compensation and motion artifact elimination. The audio sensor employs a directional microphone array and is used to collect ambient sound and separate user voice commands. The embedded processor includes a front-end processing unit, a multimodal fusion algorithm main control unit, and a communication interface.

2. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The smart glasses frame (2) is made of lightweight magnesium alloy, with flexible circuitry built into the temples to connect the EEG electrodes to the miniature fNIRS probes on the edge of the lenses.

3. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: A power module is integrated at the ends of both temples. The power module adopts a split design, and the ends of the temples are detachable from the main body of the temples.

4. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: Two sets of flexible dry electrodes are embedded above the nose pads of the glasses, and the surface is coated with Ag / AgCl. Both sets of flexible dry electrodes are used to collect EEG signals from the prefrontal cortex.

5. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The temples are connected to the smart glasses frame (2) by an elastic hinge bracket. The ends of the temples are elastic telescopic structures. The temples have built-in impedance detection chips to adjust the pressure according to the user's head circumference, ensuring that the contact impedance between the electrodes and the skin is <10kΩ.

6. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: Three miniature fNIRS probes are distributed on the inner side of each of the left and right temples. All three miniature fNIRS probes are used to monitor changes in blood oxygenation in the temporal lobe and to identify memory load and fatigue status.

7. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The environmental perception module also includes an ambient light sensor integrated under the smart glasses frame (2) for detecting ambient light intensity and automatically adjusting the brightness of the AR display module.

8. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The in-ear electrode module (1) is ergonomically designed to fit the contours of the ear, thereby improving wearing comfort and stability.

9. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The AR display module uses a high-resolution, low-power display screen and has eye protection features.

10. The cognitive accessory combining a brain-computer interface and smart glasses according to claim 1, characterized in that: The embedded processor also integrates a local storage unit for temporarily storing the collected brain signal data, environmental perception data, and processed analysis results.

Images