Smart glasses

By integrating a prompt output module, bioelectric signal detection electrodes, and motion detection module into smart glasses, a refined, tiered assessment of responsiveness is achieved, solving the problem that traditional smart glasses cannot provide such a refined assessment and improving the scientific rigor and portability of the assessment.

CN120686477BActive Publication Date: 2026-01-30GOERTEK INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202511164719.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-08-20
Publication Date
2026-01-30
Estimated Expiration
2045-08-20

AI Technical Summary

Technical Problem

Traditional smart glasses cannot perform detailed, tiered assessments of a user's reaction ability; they can only obtain overall reaction time.

Method used

The smart glasses integrate a prompt output module, bioelectric signal detection electrodes, and a motion detection module. By detecting changes in bioelectric signals and the completion time of reaction test actions, they generate assessment results of cognitive and executive reaction abilities.

Benefits of technology

It enables multi-level, fine-grained analysis of responsiveness, improves the scientific rigor and accuracy of the assessment, simplifies the testing process, and provides a good sense of immersion and interactivity, making it easy to promote and apply in various scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120686477B_ABST
    Figure CN120686477B_ABST
Patent Text Reader

Abstract

This application discloses a smart glasses, relating to the field of wearable device technology. The smart glasses include: a prompt output module, including a display module and / or a speaker, configured to output guiding prompt information; bioelectrical signal detection electrodes, including ENG electrodes and / or EMG electrodes, disposed on the inner side of the temples of the smart glasses and, when worn, in contact with the target body surface area corresponding to the reaction test action, configured to detect changes in bioelectrical signals; an action detection module, including a camera and / or a microphone, configured to detect the reaction test action; and a processor, connected to the prompt output module, the bioelectrical signal detection electrodes, and the action detection module, configured to generate cognitive reaction ability assessment results and executive reaction ability assessment results based on a first time the guiding prompt information is output, a second time the bioelectrical signal change is detected, and a third time the reaction test action is detected and completed. This application enables refined, hierarchical assessment of reaction ability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of wearable device technology, and more particularly to a smart pair of glasses. Background Technology

[0002] With the development of technology and the popularization of intelligent devices, the objective and quantitative assessment of reaction ability is playing an increasingly important role in many fields. For example, in the field of sports, reaction ability is one of the important indicators for measuring the comprehensive quality of athletes; in the field of clinical medicine, reaction ability can serve as an important monitoring parameter for neurological function and rehabilitation progress; and in special professions such as pilots and drivers, reaction ability is a key factor in ensuring operational safety and mission completion efficiency.

[0003] Currently, traditional smart glasses typically rely on manual observation or the use of simple external devices to record the total time from when a user receives a stimulus (such as a visual or auditory cue) to when they complete a specified action. For example, after outputting visual cues on a screen or playing sound cues through a speaker, the time interval between the user's response to the cues and the completion of the corresponding action is recorded as an evaluation of their reaction ability.

[0004] However, these traditional smart glasses can only obtain the overall reaction time and cannot perform a detailed, tiered assessment of the user's reaction ability. Summary of the Invention

[0005] The main objective of this application is to provide a smart glasses designed to enable a refined, tiered assessment of responsiveness.

[0006] To achieve the above objectives, this application proposes a smart glasses system comprising:

[0007] The prompt output module includes a display module and / or a speaker, and the prompt output module is configured to output guiding prompt information corresponding to the reaction test action;

[0008] A bioelectric signal detection electrode, including an ENG electrode and / or an EMG electrode, is disposed on the inner side of the temple of the smart glasses, and when the smart glasses are worn, the bioelectric signal detection electrode is in contact with the target body surface area corresponding to the reaction test action; the bioelectric signal detection electrode is configured to detect the changes in bioelectric signals caused by the reaction test action.

[0009] An action detection module, including a camera and / or a microphone, is configured to detect the reaction test action;

[0010] The processor is connected to the prompt output module, the bioelectric signal detection electrode, and the action detection module. The processor is configured to generate the wearer's cognitive reaction ability assessment result and executive reaction ability assessment result based on the first time when the prompt output module outputs the guidance prompt information, the second time when the bioelectric signal detection electrode detects the change in the bioelectric signal, and the third time when the action detection module detects the completion of the reaction test action.

[0011] In one embodiment, the microphone is disposed on the nose bridge of the smart glasses, and the microphone is disposed on the inner side and / or the lower side of the nose bridge.

[0012] In one embodiment, the microphone includes a bone conduction microphone, and when the smart glasses are worn, the bone conduction microphone is fitted against the bridge of the wearer's nose;

[0013] The reaction test includes a teeth-tapping action, and the target surface area corresponding to the teeth-tapping action is the temporalis muscle surface projection area.

[0014] In one embodiment, the microphone includes an air conduction microphone, and when the smart glasses are worn, the air conduction microphone is directed towards the wearer's mouth;

[0015] The reaction test includes vocalization, and the target body surface area corresponding to the vocalization is the temporalis muscle projection area.

[0016] In one embodiment, the camera is mounted on the frame of the smart glasses.

[0017] In one embodiment, the camera includes a first camera, which is disposed on the upper edge of the frame of the smart glasses, and when the smart glasses are worn, the shooting direction of the first camera is directed towards the wearer's eyebrows;

[0018] The reaction test includes eyebrow movements, and the target surface area corresponding to the eyebrow movements is the temporal branch surface projection area.

[0019] In one embodiment, the camera includes a second camera, which is disposed at the lower edge of the frame of the smart glasses, and when the smart glasses are worn, the shooting direction of the second camera is directed towards the mouth of the wearer;

[0020] The reaction test includes mouth opening and closing movements, and the target body surface area corresponding to the mouth opening and closing movements is the temporalis muscle surface projection area.

[0021] In one embodiment, the camera includes a third camera, and when the smart glasses are worn, the shooting direction of the third camera is pointed towards the wearer's eyes;

[0022] The reaction test includes eyelid opening and closing movements, and the target surface area corresponding to the eyelid opening and closing movements is the temporal branch surface projection area.

[0023] In one embodiment, the bioelectric signal detection electrode includes an electrode body and an electrode convex structure. The electrode body includes a first side and a second side disposed opposite to each other. The first side is attached to the inner side of the temple of the smart glasses. The electrode convex structure is disposed on the second side. When the smart glasses are worn, the electrode convex structure is attached to the target body surface projection area of ​​the wearer.

[0024] In one embodiment, the temples of the smart glasses include arc-shaped ear loops, the speaker is disposed in the arc-shaped ear loops, and when the smart glasses are worn, the speaker's sound direction is directed towards the wearer's ear canal.

[0025] In one embodiment, the smart glasses further include a first inertial measurement unit, a second inertial measurement unit, and a third inertial measurement unit;

[0026] The first inertial measurement unit is located on the nose bridge of the smart glasses, the second inertial measurement unit is located at the end of the left temple of the smart glasses away from the frame, and the third inertial measurement unit is located at the end of the right temple of the smart glasses away from the frame.

[0027] This application provides a smart glasses, relating to the field of wearable device technology. The smart glasses include: a prompt output module, including a display module and / or a speaker, configured to output guiding prompt information corresponding to a reaction test action; bioelectrical signal detection electrodes, including ENG electrodes and / or EMG electrodes, disposed on the inner side of the temples of the smart glasses, and when the smart glasses are worn, the bioelectrical signal detection electrodes are in contact with the target body surface area corresponding to the reaction test action; the bioelectrical signal detection electrodes are configured to detect changes in bioelectrical signals caused by the reaction test action; an action detection module, including a camera and / or a microphone, configured to detect the reaction test action; and a processor connected to the prompt output module, the bioelectrical signal detection electrodes, and the action detection module, configured to generate a cognitive reaction ability assessment result and an executive reaction ability assessment result for the wearer based on the first time the prompt output module outputs guiding prompt information, the second time the bioelectrical signal detection electrodes detect changes in bioelectrical signals, and the third time the action detection module detects the completion of the reaction test action.

[0028] The smart glasses proposed in this application achieve a refined, tiered assessment of the wearer's reaction ability by integrating a prompt output module, bioelectrical signal detection electrodes, a motion detection module, and a processor. Specifically, during the test, the system first presents visual or auditory guidance prompts related to the reaction test action to the wearer through the display module and / or speaker in the prompt output module, and determines the prompt output time of the guidance prompts, i.e., the first moment; then, through the ENG (Electroneurography) electrodes and / or EMG (Electromyography) electrodes in the bioelectrical signal detection electrodes, when the wearer receives the prompt and prepares to perform the action, the system detects in real time the changes in bioelectrical signals caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporal muscle surface projection area, etc.), thereby determining the neuromuscular activation signal. The change time is the second time; simultaneously, the completion time of the wearer's actual action in the reaction test is captured by the camera and / or microphone in the action detection module, which is the third time; finally, based on the above three time segments, the processor can evaluate the wearer's reaction ability from two dimensions: the cognitive stage and the execution stage, and generate corresponding cognitive reaction ability evaluation results and execution reaction ability results. Among them, the time interval from the prompt output to the change of bioelectrical signal reflects the wearer's cognitive processing speed and decision-making ability, which belongs to the cognitive reaction ability evaluation index, while the time interval from the change of bioelectrical signal to the completion of the action reflects the wearer's motor execution efficiency and motor coordination, which belongs to the execution reaction ability evaluation index. This application's method of decomposing the overall reaction time into two sub-processes, cognition and execution, breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes multi-level, fine-grained analysis of reaction ability.

[0029] The beneficial technical effects of this application are as follows: On the one hand, by introducing bioelectric signal detection technology, it is possible to accurately capture the neuromuscular activation signals of the wearer before obvious limb movements are generated after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and executive stages and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire testing process relies on smart glasses, it has a good sense of immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, vocational ability assessment, and rehabilitation monitoring, and has strong practicality and scalability; in addition, this application can complete multimodal data acquisition and synchronous analysis without relying on external independent devices, which simplifies the testing process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability. Attached Figure Description

[0030] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0031] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 This is a schematic diagram of the module structure of the smart glasses in the embodiments of this application;

[0033] Figure 2 This is a schematic diagram of the hardware structure of the smart glasses in the embodiments of this application;

[0034] Figure 3 This is a schematic diagram of the wearing state of the smart glasses in the embodiments of this application;

[0035] Figure 4 This is a schematic diagram of the surface projection position of the temporal branch in the embodiments of this application;

[0036] Figure 5 This is a schematic diagram of the surface projection position of the temporalis muscle in the embodiments of this application;

[0037] Figure 6 This is a schematic diagram of the structure of the bioelectric signal detection electrode in the embodiments of this application.

[0038] Explanation of the attached figure numbers:

[0039] 100. Smart Glasses; 1. Prompt Output Module; 11. Display Module; 12. Speaker; 2. Bioelectric Signal Detection Electrode; 21. ENG Electrode; 22. EMG Electrode; 23. Electrode Body; 24. Electrode Convex Hull Structure; 3. Motion Detection Module; 31. Camera; 32. Microphone; 4. Processor; 5. First Inertial Measurement Unit; 6. Second Inertial Measurement Unit; 7. Third Inertial Measurement Unit.

[0040] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0041] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0042] Currently, traditional smart glasses typically rely on manual observation or the use of simple external devices to record the total time from when a user receives a stimulus (such as a visual or auditory cue) to when they complete a specified action. For example, after outputting visual cues on a screen or playing sound cues through a speaker, the time interval between the user's response to the cues and the completion of the corresponding action is recorded as an evaluation of their reaction ability.

[0043] However, these traditional smart glasses can only obtain overall reaction time and cannot assess the user's cognitive and executive reaction abilities in a finer granular way.

[0044] In contrast, the solution of this application embodiment is to provide a smart glasses, which includes: a prompt output module, including a display module and / or a speaker, the prompt output module being configured to output guidance prompt information corresponding to the reaction test action; a bioelectrical signal detection electrode, including an ENG electrode and / or an EMG electrode, the bioelectrical signal detection electrode being disposed on the inner side of the temple of the smart glasses, and when the smart glasses are worn, the bioelectrical signal detection electrode being in contact with the target body surface area corresponding to the reaction test action; the bioelectrical signal detection electrode being configured to detect changes in bioelectrical signals caused by the reaction test action; an action detection module, including a camera and / or a microphone, the action detection module being configured to detect the reaction test action; and a processor connected to the prompt output module, the bioelectrical signal detection electrode, and the action detection module, the processor being configured to generate a cognitive reaction ability assessment result and an executive reaction ability assessment result of the wearer based on a first time when the prompt output module outputs the guidance prompt information, a second time when the bioelectrical signal detection electrode detects the change in bioelectrical signals, and a third time when the action detection module detects the completion of the reaction test action.

[0045] The smart glasses proposed in this application achieve a refined, tiered assessment of the wearer's reaction ability by integrating a prompt output module, bioelectrical signal detection electrodes, a motion detection module, and a processor. Specifically, during the test, the system first presents visual or auditory guidance prompts related to the reaction test action to the wearer through the display module and / or speaker in the prompt output module, and determines the prompt output time of the guidance prompts, i.e., the first time. Subsequently, through the ENG electrodes and / or EMG electrodes in the bioelectrical signal detection electrodes, when the wearer receives the prompt and prepares to perform the action, the system detects in real time the changes in bioelectrical signals caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporal muscle surface projection area, etc.), thereby determining the signal change time of neuromuscular activation, i.e., the second time. Simultaneously, through the motion detection module... The camera and / or microphone in the block capture the time it takes for the wearer to actually complete the reaction test action, i.e., the third time. Finally, based on the above three time segments, the processor can evaluate the wearer's reaction ability from two dimensions: the cognitive stage and the execution stage, and generate corresponding cognitive reaction ability evaluation results and execution reaction ability results. Among them, the time interval from the prompt output to the change of bioelectrical signal reflects the wearer's cognitive processing speed and decision-making ability, which belongs to the cognitive reaction ability evaluation index, while the time interval from the change of bioelectrical signal to the completion of the action reflects the wearer's motor execution efficiency and motor coordination, which belongs to the execution reaction ability evaluation index. This application's method of decomposing the overall reaction time into two sub-processes, cognition and execution, breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes multi-level, fine-grained analysis of reaction ability.

[0046] The beneficial technical effects of this application are as follows: On the one hand, by introducing bioelectric signal detection technology, it is possible to accurately capture the neuromuscular activation signals of the wearer before obvious limb movements are generated after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and executive stages and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire testing process relies on smart glasses, it has a good sense of immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, vocational ability assessment, and rehabilitation monitoring, and has strong practicality and scalability; in addition, this application can complete multimodal data acquisition and synchronous analysis without relying on external independent devices, which simplifies the testing process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability.

[0047] The smart glasses in this application embodiment may include, but are not limited to, Mixed Reality (MR) glasses, Augmented Reality (AR) glasses, Virtual Reality (VR) glasses, Extended Reality (XR) glasses, or some combination thereof. In this embodiment, for ease of description, the following description uses smart glasses as the implementing entity.

[0048] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0049] This application presents a first embodiment of smart glasses.

[0050] Please refer to Figure 1 , Figure 1 This is a schematic diagram of the module structure provided for the first embodiment of the smart glasses of this application.

[0051] In this embodiment, the smart glasses 100 includes:

[0052] The prompt output module 1 includes a display module 11 and / or a speaker 12. The prompt output module 1 is configured to output guiding prompt information corresponding to the reaction test action.

[0053] The bioelectric signal detection electrode 2 includes an ENG electrode 21 and / or an EMG electrode 22. The bioelectric signal detection electrode 2 is located on the inner side of the temple of the smart glasses 100. When the smart glasses 100 is in the wearing state, the bioelectric signal detection electrode 2 is in contact with the target body surface area corresponding to the reaction test action. The bioelectric signal detection electrode 2 is configured to detect the changes in bioelectric signals caused by the reaction test action.

[0054] The motion detection module 3 includes a camera 31 and / or a microphone 32. The motion detection module 3 is configured to detect reaction test actions.

[0055] The processor 4 is connected to the prompt output module 1, the bioelectric signal detection electrode 2, and the action detection module 3. The processor 4 is configured to generate the wearer's cognitive reaction ability assessment result and executive reaction ability assessment result based on the first time when the prompt output module 1 outputs guiding prompt information, the second time when the bioelectric signal detection electrode 2 detects a change in bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action.

[0056] In this embodiment, the prompt output module 1 includes a display module 11 and / or a speaker 12, used to output guiding prompt information to the wearer corresponding to the reaction test action.

[0057] Specifically, the wearer refers to the wearer of the smart glasses 100.

[0058] Guidance prompts refer to prompts used to guide the wearer to perform reaction test actions. These prompts can be visual prompts (such as text, images, and animations), auditory prompts (such as sound), or a combination thereof. Visual prompts can be output through the display module 11 in the prompt output module 1, and auditory prompts can be output through the speaker 12 in the prompt output module 1.

[0059] The display module 11 can be a micro-display integrated into the lens of the smart glasses 100, a projection optical engine component set on the frame of the smart glasses 100, or a diffraction waveguide device or holographic waveguide device constructed using optical elements such as waveguides and gratings (which can expand and guide light from small side light sources, thereby presenting a virtual image that seems to float above the real world in the wearer's field of vision).

[0060] In one feasible implementation, such as Figure 2 and Figure 3 As shown, the temples of the smart glasses 100 include arc-shaped ear loops, and the speaker 12 is disposed in the arc-shaped ear loops. When the smart glasses 100 is in the wearing state, the sound direction of the speaker 12 is directed towards the wearer's ear canal opening.

[0061] In this embodiment, the speaker 12 is cleverly embedded in the curved ear loop of the temple, and its position is carefully designed so that when worn, the sound outlet of the speaker 12 is directly facing the wearer's ear canal. This layout not only makes full use of the space in the temple, but also effectively avoids interference from external environmental noise, ensuring that the wearer can clearly receive auditory guidance prompts.

[0062] Furthermore, placing the speaker 12 within the curved ear hook groove further enhances wearing comfort and stability. The ergonomic design of the curved ear hook groove better conforms to the shape of the ear, reducing discomfort from prolonged wear. Simultaneously, the direct alignment of the speaker 12 with the ear canal opening reduces energy loss during sound propagation, improving audio quality.

[0063] This embodiment achieves effective transmission of auditory guidance information by placing the speaker 12 in the arc-shaped ear-hook groove of the temple and directing its sound towards the wearer's ear canal opening, thereby improving the user experience and the accuracy of test results.

[0064] This embodiment provides clear and identifiable action trigger signals through the prompt output module 1, ensuring that the wearer can receive test instructions under a unified time reference, thereby improving the consistency and comparability of test results. Simultaneously, this embodiment also records the prompt output time of the guidance prompt information output by the prompt output module 1, i.e., the first moment, as the starting point of the entire reaction test process. This is used to subsequently calculate the time interval between the cognitive and execution phases, enabling the processor 4 to perform a refined, tiered evaluation of the wearer's reaction ability.

[0065] In this embodiment, the bioelectric signal detection electrode 2 includes an ENG electrode 21 and / or an EMG electrode 22, which are disposed on the inner side of the temple of the smart glasses 100. When the smart glasses 100 is worn, these electrodes can fit against the specific target body surface area of ​​the wearer (i.e. the target body surface area corresponding to the reaction test action), thereby realizing non-invasive acquisition of bioelectric signal changes generated by performing the reaction test action.

[0066] Those skilled in the art will understand that the ENG electrode 21 can be used to detect the electrical signal activity of peripheral nerves (i.e., changes in nerve electrical signals), such as the nerve impulses transmitted by the temporal branch of the facial nerve during blinking, while the EMG electrode 22 can be used to detect changes in muscle electrical signals, such as the muscle contraction signal generated by the temporalis muscle during mouth closure. Furthermore, by combining specific algorithms, the ENG electrode 21 can also indirectly detect changes in muscle electrical signals; conversely, the EMG electrode 22 can also be used to capture changes in nerve electrical signals. Related technologies have been explored to some extent in existing research, and this embodiment will not elaborate further.

[0067] In this embodiment, the reaction test actions are mainly divided into two categories: temporal branch-related reaction test actions and temporalis muscle-related reaction test actions. Temporal branch-related reaction test actions refer to reaction test actions involving the temporal branch of the facial nerve, which induce changes in nerve electrical signals detectable by the bioelectrical signal detection module in the temporal branch's surface projection area (the projection area of ​​the temporal branch on the body surface). These mainly include eyebrow movements (raising eyebrows, frowning, brow-raising, etc.) and eyelid opening and closing movements (opening eyes, closing eyes, blinking, etc.), with the corresponding target surface projection area being the temporal branch's surface projection area. Temporalis muscle-related reaction test actions refer to reaction test actions involving the temporalis muscle, which induce changes in muscle electrical signals detectable by the bioelectrical signal detection module in the temporalis muscle's surface projection area (the projection area of ​​the temporalis muscle on the body surface). These mainly include teeth-tapping movements (tapping once, continuously, tapping on the left side, etc.), vocalization movements (pronouncing specific syllables, reciting specific words, reading specific sentences, etc.), and mouth-opening and closing movements (opening the mouth, closing the mouth, etc.), with the corresponding target surface projection area being the temporalis muscle's surface projection area.

[0068] It is easy to understand that when the wearer performs a reaction test action related to the temporal branch, the camera 31 in the motion detection module 3, which is responsible for detecting eyebrow movements and / or eyelid opening and closing movements, is called to detect the temporal branch-related reaction test action, thereby determining the completion time of the action. When the wearer performs a reaction test action related to the temporalis muscle, the camera 31 in the motion detection module 3, which is responsible for detecting teeth-tapping movements, air-conduction microphones for detecting vocalization movements, or cameras for detecting mouth opening and closing movements, is called to detect the temporalis muscle-related reaction test action, thereby determining the completion time of the action.

[0069] For example, such as Figure 4 As shown, when the reaction test action is a temporal branch-related reaction test action, taking blinking as an example, the nerve impulse sent by the brain is transmitted to the orbicularis oculi muscle through the temporal branch of the facial nerve, causing the orbicularis oculi muscle to contract and relax, thereby completing the blinking action. Therefore, when the wearer blinks, there is a transmission of neural electrical signals in the temporal branch of the facial nerve, that is, there is a change in neural electrical signals. Thus, the projection area of ​​the temporal branch nerve on the body surface—the temporal branch surface projection area—can be used as the target body surface area. The neural electrical signal detection unit (implemented through ENG electrode 21 and / or EMG electrode 22) in the bioelectrical signal detection electrode 2, which is specifically used to detect changes in peripheral nerve electrical signals in the inner layer from the body surface, is set to fit against the wearer's temporal branch surface projection area when the smart glasses 100 is in the wearing state. Thus, through this neural electrical signal detection unit, the changes in neural electrical signals caused by the wearer blinking are detected in the temporal branch surface projection area, and the signal change time of the neural electrical signal is determined. This is to facilitate the division of the cognitive stage and execution stage when the wearer blinks, and thus to conduct a refined stratified assessment of the wearer's eyelid opening and closing reaction ability.

[0070] Similarly, such as Figure 5As shown, when the reaction test action is a temporalis muscle-related reaction test action, taking mouth closure as an example, the nerve impulses sent by the brain will be transmitted to the temporalis muscle, which is one of the main muscles for closing the mouth, causing the temporalis muscle to contract and generate force to move the mandible upward and backward, thereby achieving the mouth closure action. Therefore, when the wearer performs the mouth-closing action, the electromyographic signal of the temporalis muscle changes. Thus, the projection area of ​​the temporalis muscle on the body surface—the temporalis muscle surface projection area—can be used as the target body surface area. The electromyographic signal detection unit (implemented through ENG electrode 21 and / or EMG electrode 22), which is specifically used to detect changes in the electromyographic signal of the inner layer from the body surface, is set to fit against the wearer's temporalis muscle surface projection area when the smart glasses 100 is in the wearing state. In this way, the electromyographic signal detection unit can detect the changes in the electromyographic signal caused by the wearer performing the mouth-closing action in the temporalis muscle surface projection area, and determine the signal change time of the electromyographic signal change. This is to facilitate the division of the cognitive stage and the execution stage when the wearer performs the mouth-closing action, and thus to conduct a refined stratified assessment of the wearer's mouth opening and closing reaction ability.

[0071] In one feasible implementation, such as Figure 6 As shown, the bioelectric signal detection electrode 2 includes an electrode body 23 and an electrode convex structure 24. The electrode body 23 includes a first side and a second side arranged opposite to each other. The first side is attached to the inner side of the temple of the smart glasses 100. The electrode convex structure 24 is located on the second side. When the smart glasses 100 is in the wearing state, the electrode convex structure 24 is attached to the target body surface projection area of ​​the wearer.

[0072] It should be noted that the electrode convex hull structure 24 refers to a special structure designed to enhance the contact effect between the bioelectric signal detection electrode 2 and the wearer's skin. This electrode convex hull structure 24 integrates a series of protrusions with a certain height and elasticity on the electrode body 23, allowing the bioelectric signal detection electrode 2 to penetrate physical barriers such as body hair and actively press against specific target areas of the wearer's skin when worn. This effectively improves the contact quality between the electrode and the skin, enhances the stability and sensitivity of signal acquisition, and achieves more stable and accurate signal acquisition.

[0073] Compared to traditional planar electrode designs without an electrode convex hull structure 24, this embodiment can effectively penetrate the wearer's skin hairs or other physical barriers that may affect electrode contact by applying local pressure during wear. This significantly reduces signal interference or distortion caused by hair obstruction, skin undulations, or unstable wear. Furthermore, the elastic design of the electrode convex hull structure 24 can adapt to differences in facial contours among different users, avoiding poor contact or signal drift due to individual differences, thereby improving the device's universality and reliability. Therefore, this electrode convex hull structure 24 design not only effectively solves the problem of traditional electrodes being susceptible to physical interference in non-invasive wearing scenarios, but also significantly improves the accuracy and consistency of the smart glasses 100 in acquiring electrical nerve signals (ENG) and electrical muscle signals (EMG) in dynamic testing environments. This is a key technological innovation in achieving high-quality biosignal detection in this embodiment.

[0074] This embodiment utilizes the bioelectric signal detection electrode 2 to provide stable and accurate physiological signal acquisition, ensuring the capture of neural excitation and muscle pre-activation processes occurring before the wearer produces any obvious limb movements. This effectively distinguishes between the "cognitive stage" and the "executive stage" of reaction ability, significantly improving the scientific rigor and accuracy of the refined stratified assessment of reaction ability. Simultaneously, this embodiment records the signal change time at which the bioelectric signal detection electrode 2 detects changes in bioelectric signals, i.e., the second time point. This serves as the time node for dividing the reaction test process into the "cognitive stage" and the "executive stage," used for subsequent calculation of the time interval between the cognitive and executive stages. This facilitates the processor 4's refined stratified assessment of the wearer's reaction ability.

[0075] In this embodiment, the motion detection module 3 includes a camera 31 and / or a microphone 32, used to detect whether the wearer has completed the reaction test action corresponding to the guidance prompt information, and accurately record the completion time of the reaction test action, i.e., the third time.

[0076] Depending on the type of reaction test action, this embodiment can select the corresponding sensor for detection. For example, when detecting eyelid opening and closing actions (such as opening eyes, closing eyes, blinking, etc.), the camera 31 can be called, and when detecting vocalization actions, the microphone 32 can be called.

[0077] This embodiment provides accurate and real-time motion recognition capabilities through the motion detection module 3, ensuring a clear definition of the process boundary from neuromuscular activation to actual motion completion, thus providing crucial data support for the quantitative analysis of the "execution phase." Simultaneously, this embodiment also records the completion time of the reaction test motion detected by the motion detection module 3, i.e., the third time, as the time endpoint of the entire reaction test process. Combined with the first time (prompt output time) and the second time (bioelectrical signal change time), these time benchmarks constitute the time references for the cognitive and execution phases, enabling the processor 4 to perform refined, stratified evaluation of the wearer's cognitive and execution reaction abilities.

[0078] In this embodiment, the processor 4 is connected to the prompt output module 1, the bioelectric signal detection electrode 2, and the action detection module 3, respectively, and is configured to generate the wearer's cognitive reaction ability assessment result and executive reaction ability assessment result based on the first time when the prompt output module 1 outputs guiding prompt information, the second time when the bioelectric signal detection electrode 2 detects a change in bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action.

[0079] Specifically, the steps described above, which generate the wearer's cognitive reaction ability assessment result and executive reaction ability assessment result based on the first time when the prompt output module 1 outputs the guidance prompt information, the second time when the bioelectric signal detection electrode 2 detects the change in bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action, may include: assessing the wearer's cognitive reaction ability based on the first and second times to generate the wearer's cognitive reaction ability assessment result; and assessing the wearer's executive reaction ability based on the second and third times to generate the wearer's executive reaction ability assessment result.

[0080] Cognitive responsiveness refers to the efficiency of information processing from receiving external stimuli to the activation of the neuromuscular system, encompassing multiple psychological processes such as perception, judgment, and decision-making. This cognitive responsiveness can serve as an indicator of an individual's cognitive processing speed, decision-making efficiency, and level of attention in response to external stimuli, directly reflecting their level of attention, information processing speed, and response readiness. The cognitive responsiveness assessment result is obtained by evaluating an individual's cognitive responsiveness based on the time difference between receiving a cue and the onset of detectable bioelectrical signal changes in their neuromuscular system.

[0081] Executive response capability refers to the efficiency of motor execution from the activation of the neuromuscular system to the actual completion of a specified action, encompassing multiple aspects such as muscle contraction, motor coordination, and force control. This executive response capability can serve as an indicator of an individual's cognitive processing speed, decision-making efficiency, and attentional concentration in response to external stimuli, directly reflecting their motor control precision and body coordination. The executive response capability assessment result is obtained by evaluating an individual's executive response capability based on the time difference between the generation of detectable bioelectrical signal changes in their neuromuscular system and the actual completion of the specified response test action.

[0082] In one feasible implementation, the step of assessing the wearer's cognitive reaction ability based on a first time and a second time, and generating an assessment result of the wearer's cognitive reaction ability, may include: calculating the cognitive reaction time of the wearer performing the reaction test action based on the first time and the second time; assessing the wearer's cognitive reaction ability based on the cognitive reaction time, and generating an assessment result of the wearer's cognitive reaction ability.

[0083] By comparing the "first time" and the "second time," this implementation method can obtain the time difference between the wearer's perception of the cue and neuromuscular activation, i.e., the cognitive reaction time. The shorter this cognitive reaction time, the higher the wearer's cognitive processing efficiency and the stronger their cognitive response ability.

[0084] It is easy to understand that in this embodiment, the prompt output module 1 outputs guidance prompts corresponding to at least one reaction test action. Correspondingly, based on the first and second times corresponding to each reaction test action, the cognitive reaction time of the wearer performing each reaction test action is calculated. Therefore, when performing the step of calculating the cognitive reaction time of the wearer performing the reaction test action based on the first and second times, a cognitive reaction ability assessment is performed on each reaction test action according to actual settings to obtain the wearer's cognitive reaction ability assessment result for each reaction test action. Alternatively, the average cognitive reaction time for each type of reaction test action is statistically obtained, and then a cognitive reaction ability assessment is performed on each type of reaction test action to obtain the wearer's cognitive reaction ability assessment result for each type of reaction test action. Or, after performing a cognitive reaction ability assessment on each reaction test action to obtain the wearer's cognitive reaction ability assessment result for each reaction test action, the cognitive reaction ability assessment results corresponding to each reaction test action are combined or weighted to obtain the wearer's overall cognitive reaction ability assessment result. This embodiment does not impose specific limitations on this; the cognitive reaction ability assessment method can be flexibly set according to actual needs.

[0085] It is worth mentioning that, in this embodiment, when a user performs a reaction ability assessment through the head-mounted display device, they can actively select one of the multiple types of reaction test actions, or even a specific reaction test action, or they can choose to perform a reaction ability assessment that randomly covers all reaction test actions.

[0086] In one feasible implementation, the step of evaluating the wearer's executive reaction ability based on the second and third times and generating an evaluation result of the wearer's executive reaction ability may include: calculating the executive reaction time of the wearer's executive reaction test action based on the second and third times; evaluating the wearer's executive reaction ability based on the executive reaction time and generating an evaluation result of the wearer's executive reaction ability.

[0087] By comparing the "second time" and the "third time," this implementation method can obtain the time difference between the wearer's neuromuscular activation and the completion of the action, i.e., the execution reaction time. The shorter and more stable this execution reaction time, the higher the wearer's motor execution efficiency and the stronger their execution reaction ability.

[0088] Similar to the aforementioned implementation, when evaluating the performance response capability in this implementation, if the prompt output module 1 outputs guidance prompts corresponding to multiple response test actions, it is also necessary to calculate the performance response time of the wearer for each response test action. In the step of evaluating the wearer's performance response capability based on the performance response time and generating the performance response capability evaluation result of the wearer, the performance response capability of the wearer is evaluated according to the actual settings, which will not be elaborated here. For details, please refer to the aforementioned implementation.

[0089] In one feasible implementation, the step of assessing the wearer's cognitive reaction ability based on cognitive reaction time and generating an assessment result of the wearer's cognitive reaction ability may include: obtaining the cognitive reaction time distribution corresponding to the reaction test action; assessing the wearer's cognitive reaction ability based on the cognitive reaction time distribution and cognitive reaction time, and generating an assessment result of the wearer's cognitive reaction ability.

[0090] It should be noted that, in this embodiment, the cognitive reaction time distribution refers to the statistical distribution of cognitive reaction times of all individuals within a certain sample range for a specific reaction test action. This cognitive reaction time distribution is typically obtained through large-scale data collection and analysis, covering the time difference between receiving the cue information and the onset of detectable bioelectrical signal changes in the neuromuscular system. This data can come from populations of different ages, genders, health conditions, ethnicities, occupations, etc., to ensure that the distribution is broadly representative and reflects the characteristics of different population groups.

[0091] It is worth noting that the cognitive reaction time distribution is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles, which are used to describe the variability of the cognitive reaction speed of the entire group when performing a specific reaction test action.

[0092] This implementation method can pre-calculate the cognitive reaction time distribution of different groups of people for different reaction test actions. In practical applications, the target group can be determined based on the wearer's group settings or personal information (including at least one of age information, gender information, ethnicity information, occupation information, health status information, etc.). Then, when performing the step of obtaining the cognitive reaction time distribution corresponding to the reaction test action, the cognitive reaction time distribution of the target group for the specific reaction test action can be obtained.

[0093] This implementation method, by comparing the cognitive reaction time of an individual wearer with the cognitive reaction time distribution of the target population, can more accurately locate the wearer's position within the target population, thereby enabling a scientific assessment of their cognitive reaction ability. Specifically, firstly, the cognitive reaction time distribution is used as a reference benchmark, and then the current wearer's cognitive reaction time is compared and analyzed within this distribution framework. This step considers not only the wearer's absolute reaction speed (i.e., cognitive reaction time) during the cognitive phase, but also their relative performance compared to similar groups of people.

[0094] This implementation takes into account the differences in cognitive reaction ability among different groups of people. By introducing the concept of cognitive reaction time distribution, the cognitive reaction ability assessment of each wearer is no longer isolated, but based on a broad data background. This supports a more personalized reaction ability assessment service, making the cognitive reaction ability assessment results more practical and more accurate and reliable.

[0095] In one feasible implementation, the step of evaluating the wearer's execution reaction ability based on the execution reaction time and generating an evaluation result of the wearer's execution reaction ability may include: obtaining the execution reaction time distribution corresponding to the reaction test action; evaluating the wearer's execution reaction ability based on the execution reaction time distribution and the execution reaction time, and generating an evaluation result of the wearer's execution reaction ability.

[0096] It should be noted that, in this embodiment, the execution reaction time distribution refers to the statistical distribution of the execution reaction times of all individuals within a certain sample range for a specific reaction test action. This execution reaction time distribution is typically obtained through large-scale data collection and analysis, covering the time difference between the generation of detectable bioelectrical signals by the neuromuscular system and the actual completion of the specified reaction test action. These data can be derived from populations of different ages, genders, health conditions, ethnicities, occupations, etc., to ensure that the distribution is broadly representative and reflects the characteristics of different population groups.

[0097] It is worth noting that the execution reaction time distribution is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles, which are used to describe the variability of the execution reaction speed of the entire group when performing a specific reaction test action.

[0098] This implementation method can pre-calculate the execution reaction time distribution of different groups of people for different reaction test actions. In practical applications, the target group can be determined based on the wearer's group settings or personal information (including at least one of age information, gender information, ethnicity information, occupation information, health status information, etc.). Then, when performing the step of obtaining the execution reaction time distribution corresponding to the reaction test action, the execution reaction time distribution of the target group for the specific reaction test action can be obtained.

[0099] This implementation method, by comparing the execution reaction time of an individual wearer with the execution reaction time distribution of the target population, can more accurately locate the wearer's position within the target population, thereby enabling a scientific assessment of their execution reaction ability. Specifically, the execution reaction time distribution is first used as a reference benchmark, and then the current wearer's execution reaction time is compared and analyzed within this distribution framework. This step considers not only the wearer's absolute reaction speed (i.e., execution reaction time) during the execution phase, but also their relative performance compared to similar groups of people during the execution phase.

[0100] This implementation takes into account the differences in executive reaction ability among different groups of people. By introducing the concept of executive reaction time distribution, the executive reaction ability assessment of each wearer is no longer isolated, but based on a broad data background. This supports a more personalized reaction ability assessment service, making the executive reaction ability assessment results more practical and more accurate and reliable.

[0101] In one feasible implementation, the processor 4 is further configured to: perform weighted fusion of the cognitive reaction ability assessment results and the executive reaction ability assessment results to obtain the wearer's comprehensive reaction ability assessment results.

[0102] When assessing the wearer's reaction ability, processor 4 has already provided detailed assessment results from two dimensions: cognitive reaction ability and executive reaction ability. However, in practical applications, a comprehensive indicator is often needed to fully reflect an individual's overall reaction ability. Therefore, in this embodiment, processor 4 is also configured to: perform weighted fusion of the cognitive reaction ability assessment results and the executive reaction ability assessment results to obtain the wearer's comprehensive reaction ability assessment result.

[0103] As those skilled in the art will know, weighted fusion refers to combining evaluation results from different sources or types according to a preset weight allocation scheme to form a more comprehensive and balanced final evaluation result.

[0104] In this embodiment, the weighted fusion targets the cognitive reaction ability assessment results and the execution reaction ability assessment results previously generated by the processor 4.

[0105] Specifically, weighted fusion can be achieved using the following formula:

[0106] The overall response capability assessment result = w1 × cognitive response capability assessment result + w2 × executive response capability assessment result.

[0107] Where w1 is the weight of cognitive response ability in the comprehensive evaluation, w2 is the weight of executive response ability in the comprehensive evaluation, and w1+w2=1.

[0108] The weights can be adjusted according to the specific needs of the application scenario. For example, for application scenarios that emphasize rapid decision-making, the value of w1 can be increased appropriately; while for applications that focus more on the efficiency of action execution, the weight of w2 can be increased.

[0109] It is worth noting that, considering that cognitive and executive response abilities have different proportions in the overall response ability when people of different genders are at different ages, the values ​​of w1 and w2 need to be adjusted according to the wearer's age and / or gender information.

[0110] This implementation method, through a weighted fusion approach, considers not only the wearer's performance in the cognitive stage but also their efficiency in the execution stage, thus providing a more comprehensive evaluation system for responsiveness.

[0111] The smart glasses 100 proposed in this embodiment achieves a refined, tiered assessment of the wearer's reaction ability through the integrated prompt output module 1, bioelectrical signal detection electrodes 2, action detection module 3, and processor 4. Specifically, during the test, the system first presents visual or auditory guidance prompts related to the reaction test action to the wearer through the display module 11 and / or speaker 12 in the prompt output module 1, and determines the prompt output time of the guidance prompts, i.e., the first moment; then, through the ENG (Electroneurography) electrodes and / or EMG (Electromyography) electrodes in the bioelectrical signal detection electrodes 2, when the wearer receives the prompt and prepares to perform the action, the system detects in real time the changes in bioelectrical signals caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporal muscle surface projection area, etc.), thereby determining the neuromuscular activation signal. The change time is the second time; simultaneously, the camera 31 and / or microphone 32 in the action detection module 3 capture the actual completion time of the wearer's reaction test action, which is the third time; finally, based on the above three time segments, the processor 4 can evaluate the wearer's reaction ability from two dimensions: the cognitive stage and the execution stage, and generate corresponding cognitive reaction ability evaluation results and execution reaction ability results. Among them, the time interval from the prompt output to the change of bioelectrical signal reflects the wearer's cognitive processing speed and decision-making ability, which belongs to the cognitive reaction ability evaluation index, while the time interval from the change of bioelectrical signal to the completion of the action reflects the wearer's motor execution efficiency and motor coordination, which belongs to the execution reaction ability evaluation index. This embodiment breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes multi-level, fine-grained analysis of reaction ability by decomposing the overall reaction time into two sub-processes of cognition and execution.

[0112] The beneficial technical effects of this embodiment are as follows: On the one hand, by introducing bioelectric signal detection technology, it is possible to accurately capture the neuromuscular activation signals of the wearer before obvious limb movements are generated after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and executive stages and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire testing process relies on smart glasses 100, it has a good sense of immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, vocational ability assessment, and rehabilitation monitoring, and has strong practicality and scalability; in addition, this embodiment can complete multimodal data acquisition and synchronous analysis without relying on external independent devices, which simplifies the testing process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability.

[0113] In one feasible implementation, such as Figure 2As shown, the smart glasses 100 also includes a first inertial measurement unit 5, a second inertial measurement unit 6, and a third inertial measurement unit 7;

[0114] The first inertial measurement unit 5 is located on the nose bridge of the smart glasses 100, the second inertial measurement unit 6 is located at the end of the left temple of the smart glasses 100 away from the frame, and the third inertial measurement unit 7 is located at the end of the right temple of the smart glasses 100 away from the frame.

[0115] In this embodiment, the first inertial measurement unit 5 is disposed on the nose bridge of the smart glasses 100 and is used to detect the changes in angular velocity and acceleration of the wearer's head in three-dimensional space. It is particularly suitable for capturing head posture changes related to cognitive response tasks such as nodding and raising the head. The second inertial measurement unit 6 is disposed at the end of the left temple of the smart glasses 100 away from the frame, and the third inertial measurement unit 7 is disposed at the end of the right temple of the smart glasses 100 away from the frame. The second inertial measurement unit 6 and the third inertial measurement unit 7 are symmetrically distributed at the ends of the left and right temples, and can work together to sense the overall motion state of the smart glasses 100 when worn, including tilting, rotation, and slight shaking caused by body movement or unstable wearing.

[0116] By incorporating inertial measurement units (IMUs) at over 100 key structural components of the smart glasses, this implementation achieves simultaneous acquisition of multi-point motion information of the wearer's head and the glasses themselves. This design not only enhances the robustness of the system's action recognition in dynamic environments but also effectively distinguishes motion signals caused by real reaction test actions from noise signals caused by head shaking or other interference factors, thereby further improving the accuracy and reliability of the action detection module 3 in recognizing reaction test actions. Furthermore, data fusion from multiple IMUs can be used to assist other sensors such as camera 31 and microphone 32 in action determination, enhancing the comprehensiveness and scientific rigor of the system's assessment of the wearer's reaction ability.

[0117] Based on the first embodiment described above, this application proposes a second embodiment of smart glasses.

[0118] In the second embodiment of this application, the same or similar content as in the above embodiments can be referred to the above description, and will not be repeated hereafter.

[0119] In this embodiment, the microphone 32 is disposed on the nose bridge of the smart glasses 100, and the microphone 32 is disposed on the inner side and / or the lower side of the nose bridge.

[0120] In this embodiment, the microphone 32 in the motion detection module 3 is located on the nose bridge of the smart glasses 100. Specifically, the microphone 32 is located on the inner side (i.e. the side facing the wearer) and / or the lower side of the nose bridge, so that when the smart glasses 100 is worn, the microphone 32 can be closer to the wearer's facial structure, thereby achieving effective acquisition of acoustic signals related to specific reaction test actions.

[0121] For example, such as Figure 2 As shown, the microphone 32 can be located on the underside of the nose bridge of the smart glasses 100.

[0122] By integrating the microphone 32 into the bridge of the nose, this embodiment not only optimizes the spatial layout of the smart glasses 100, but also improves the balance between wearing comfort and functional practicality.

[0123] In a first feasible implementation, the microphone 32 includes a bone conduction microphone (not shown), and when the smart glasses 100 are worn, the bone conduction microphone is in contact with the wearer's nose bridge;

[0124] The reaction test includes a teeth-tapping action, and the target surface area corresponding to the teeth-tapping action is the temporalis muscle surface projection area.

[0125] As those skilled in the art will know, a bone conduction microphone is a device that transmits sound by capturing bone vibrations. Specifically, a bone conduction microphone does not pick up sound by transmitting sound waves through the air, but is directly installed in contact with bone (such as the skull, nasal bone, etc.), and can sense the mechanical vibrations transmitted from the vocal cords through the bone and convert them into electrical signals.

[0126] In this embodiment, the microphone 32 in the motion detection module 3 includes a bone conduction microphone, and when the smart glasses 100 are worn, the bone conduction microphone is in contact with the wearer's nose bridge. This design allows the bone conduction microphone to directly sense the weak mechanical vibration signal transmitted from the teeth through the jawbone to the nose bridge area during the wearer's teeth-tapping action. Thus, when the guidance prompts the wearer to perform the teeth-tapping action, it can efficiently and accurately determine whether the wearer has completed the specified teeth-tapping action and determine the completion time of the teeth-tapping action.

[0127] In a second feasible implementation, the microphone 32 includes an air conduction microphone (not shown), and when the smart glasses 100 are worn, the air conduction microphone is directed towards the wearer's mouth.

[0128] The reaction test includes vocalization, and the target body surface area corresponding to the vocalization is the temporalis muscle projection area.

[0129] As those skilled in the art will know, an air conduction microphone refers to a type 32 microphone that transmits sound using air as a medium. It works by receiving sound waveforms propagating in the air and converting them into electrical signals. An air conduction microphone typically contains a diaphragm. When a sound wave strikes the diaphragm, it causes vibration, which in turn changes the capacitance or other parameters in the internal circuitry, ultimately generating an electrical signal output corresponding to the sound wave.

[0130] It should be noted that the pickup direction refers to the directional characteristic of the microphone 32 relative to the location of the sound source when receiving sound signals. It describes the sensitivity of the microphone 32 to sound signals from different directions, that is, which direction the microphone 32 is more inclined to capture.

[0131] In this embodiment, the microphone 32 in the motion detection module 3 includes an air conduction microphone, and when the smart glasses 100 are worn, the air conduction microphone's pickup direction is pointed towards the wearer's mouth. This design allows the air conduction microphone to more accurately capture the sound signal emitted from the wearer's mouth during the vocalization process, thereby efficiently and accurately determining whether the wearer has completed the specified vocalization action and determining the completion time of the vocalization action when the guidance prompts the wearer to perform the vocalization action.

[0132] This embodiment integrates microphone 32 into the inner and / or lower side of the nose bridge and employs both bone conduction and air conduction technologies to achieve high-precision recognition of different types of reaction test actions (such as teeth tapping and vocalization). The bone conduction microphone is suitable for teeth tapping actions that do not involve significant sound wave radiation but are accompanied by craniofacial bone vibration; while the air conduction microphone is better suited for capturing vocalization actions where sound is the primary output. This complementary combination gives the smart glasses 100 a more comprehensive action detection capability, helping to expand application scenarios and improve the accuracy of evaluation results.

[0133] Based on the first embodiment described above, this application proposes a third embodiment of smart glasses.

[0134] In the third embodiment of this application, the same or similar content as the above embodiments can be referred to the above description, and will not be repeated hereafter.

[0135] In this embodiment, the camera 31 is mounted on the frame of the smart glasses 100.

[0136] In this embodiment, the camera 31 is mounted on the frame of the smart glasses 100. Specifically, the camera 31 can be configured as multiple sub-cameras 31 according to different reaction test action types, arranged in different positions on the frame and having specific shooting directions, so as to achieve accurate visual acquisition of key areas of the wearer's face.

[0137] For example, such as Figure 2 and Figure 3 As shown, the camera 31 can be installed on the lower edge of the frame of the smart glasses 100.

[0138] By integrating the camera 31 into the frame structure, this embodiment not only makes effective use of the device space, but also ensures the stability of the relative position between the camera 31 and the wearer's face, improving the accuracy of motion recognition and the overall aesthetics of the system.

[0139] In a first feasible implementation, the camera 31 includes a first camera (not shown), which is located on the upper edge of the frame of the smart glasses 100, and when the smart glasses 100 is worn, the shooting direction of the first camera is pointed towards the wearer's eyebrows.

[0140] The reaction test includes eyebrow movements, and the target surface area corresponding to the eyebrow movements is the temporal branch projection area.

[0141] In this embodiment, the first camera refers to camera 31, which is mainly used to detect eyebrow movements.

[0142] It should be noted that the shooting direction refers to the directional characteristics of the camera 31 relative to the subject when capturing images or videos. It describes the specific direction in which the lens of the camera 31 is pointed, and determines the content and quality of the image that the camera 31 can effectively capture.

[0143] In this embodiment, the camera 31 in the motion detection module 3 includes a first camera located on the upper edge of the frame, and when the smart glasses 100 are worn, the first camera's shooting direction is pointed towards the wearer's eyebrows. This design allows the first camera to more accurately capture the dynamic changes in the eyebrow area during the wearer's eyebrow movements, thereby efficiently and accurately determining whether the wearer has completed the specified eyebrow movement and determining the completion time of the eyebrow movement when the guidance prompts the wearer to perform the eyebrow movement.

[0144] In a second feasible implementation, the camera 31 includes a second camera (not shown), which is located at the lower edge of the frame of the smart glasses 100, and when the smart glasses 100 is worn, the shooting direction of the second camera is directed towards the wearer's mouth.

[0145] The reaction test includes mouth opening and closing movements, and the target body surface area corresponding to the mouth opening and closing movements is the temporalis muscle surface projection area.

[0146] In this embodiment, the second camera refers to camera 31, which is mainly used to detect the opening and closing of the mouth.

[0147] In this embodiment, the camera 31 in the motion detection module 3 includes a second camera located at the lower edge of the frame, and when the smart glasses 100 are worn, the second camera's shooting direction is pointed towards the wearer's mouth. This design allows the first camera to more accurately capture the dynamic changes in the mouth area during the wearer's mouth opening and closing actions, thereby efficiently and accurately determining whether the wearer has completed the specified mouth opening and closing action when guided by prompts, and determining the completion time of the mouth opening and closing action.

[0148] In a third feasible implementation, camera 31 includes a third camera (not shown), and when the smart glasses 100 are worn, the shooting direction of the third camera is pointed towards the wearer's eyes.

[0149] The reaction test includes eyelid opening and closing movements, and the target surface area corresponding to the eyelid opening and closing movements is the temporal branch surface projection area.

[0150] In this embodiment, the third camera refers to camera 31, which is mainly used to detect the opening and closing of the eyelids.

[0151] In this embodiment, the camera 31 in the motion detection module 3 includes a third camera, and when the smart glasses 100 are worn, the shooting direction of the third camera is pointed towards the wearer's eyes. This design enables the third camera to more accurately capture the dynamic changes in the eye area during the wearer's eyelid opening and closing movements, thereby efficiently and accurately determining whether the wearer has completed the specified eyelid opening and closing movement and determining the completion time of the eyelid opening and closing movement when the guidance prompts the wearer to perform the eyelid opening and closing movement.

[0152] This embodiment integrates cameras 31 at different positions on the frame and adjusts their shooting direction accordingly, achieving high-precision recognition of different types of reaction test actions (such as eyebrow movements, mouth opening and closing movements, and eyelid opening and closing movements). Specifically, the first camera, shooting towards the eyebrows when worn, is suitable for placement on the upper edge of the frame; the second camera, shooting towards the mouth when worn, is suitable for placement on the lower edge of the frame; and the third camera, shooting towards the eyes when worn, has less stringent placement requirements. This complementary combination of the three cameras gives the smart glasses 100 a more comprehensive action detection capability, helping to expand application scenarios and improve the accuracy of evaluation results.

[0153] It should be noted that the above embodiments are only used to assist in understanding this application and do not constitute a limitation on the smart glasses of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0154] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A smart glass, characterized by, The intelligent glasses comprise: a prompt output module comprising a display module and / or a speaker, the prompt output module being configured to output guiding prompt information corresponding to a reaction test action; bioelectric signal detection electrodes comprising ENG electrodes and / or EMG electrodes, the bioelectric signal detection electrodes being arranged on the inner side of the temple of the intelligent glasses, and when the intelligent glasses are in a wearing state, the bioelectric signal detection electrodes are in contact with a target body surface area corresponding to the reaction test action, the target body surface area comprising at least one of a temporal branch nerve body surface projection area and a temporal muscle body surface projection area; the bioelectric signal detection electrodes are configured to detect bioelectric signal changes caused by the reaction test action; an action detection module comprising a camera and / or a microphone, the action detection module being configured to detect the reaction test action; a processor connected to the prompt output module, the bioelectric signal detection electrodes and the action detection module, the processor being configured to generate a cognitive reaction ability evaluation result and an execution reaction ability evaluation result of a wearer according to a first time at which the prompt output module outputs the guiding prompt information, a second time at which the bioelectric signal detection electrodes detect the bioelectric signal changes, and a third time at which the action detection module detects completion of the reaction test action.

2. The smart glasses of claim 1, wherein, The microphone is arranged on the nose bridge of the intelligent glasses, and the microphone is arranged on the inner side and / or the lower side of the nose bridge.

3. The smart glasses of claim 2, wherein, The microphone comprises a bone conduction microphone, and when the intelligent glasses are in a wearing state, the bone conduction microphone is in contact with the nose bridge of the wearer; The reaction test action comprises a tooth tapping action, and the target body surface area corresponding to the tooth tapping action is the temporal muscle body surface projection area.

4. The smart glasses of claim 2, wherein, The microphone comprises an air conduction microphone, and when the intelligent glasses are in a wearing state, the sound pickup direction of the air conduction microphone points to the mouth of the wearer; The reaction test action comprises a vocalization action, and the target body surface area corresponding to the vocalization action is the temporal muscle body surface projection area.

5. The smart glasses of claim 1, wherein, The camera is arranged on the frame of the intelligent glasses.

6. The smart glasses of claim 5, wherein, The camera comprises a first camera, the first camera is arranged on the upper edge of the frame of the intelligent glasses, and when the intelligent glasses are in a wearing state, the shooting direction of the first camera points to the eyebrows of the wearer; The reaction test action comprises an eyebrow action, and the target body surface area corresponding to the eyebrow action is the temporal branch body surface projection area.

7. The smart glasses of claim 5, wherein, The camera comprises a second camera, the second camera is arranged on the lower edge of the frame of the intelligent glasses, and when the intelligent glasses are in a wearing state, the shooting direction of the second camera points to the mouth of the wearer; The reaction test action comprises a mouth opening and closing action, and the target body surface area corresponding to the mouth opening and closing action is the temporal muscle body surface projection area.

8. The smart glasses of claim 5, wherein, The camera comprises a third camera, and when the intelligent glasses are in a wearing state, the shooting direction of the third camera points to the eyes of the wearer; The reaction test action comprises an eyelid opening and closing action, and the target body surface area corresponding to the eyelid opening and closing action is the temporal branch body surface projection area.

9. The smart glasses of any one of claims 1 to 8, wherein, The bioelectric signal detection electrode comprises an electrode body and an electrode convex structure, the electrode body comprises a first side and a second side arranged oppositely, the first side is attached to the inner side of the temple of the smart glasses, the electrode convex structure is arranged on the second side, and when the smart glasses are in a wearing state, the electrode convex structure is attached to the target body surface projection area of the wearer.

10. The smart glasses of any one of claims 1 to 8, wherein, The temple of the smart glasses comprises an arc-shaped ear-hanging groove, the speaker is arranged in the arc-shaped ear-hanging groove, and when the smart glasses are in a wearing state, the sound emitting direction of the speaker points to the ear canal opening of the wearer.

11. The smart glasses of any one of claims 1 to 8, wherein, The smart glasses further comprise a first inertial measurement unit, a second inertial measurement unit and a third inertial measurement unit. The first inertial measurement unit is arranged on the bridge of the smart glasses, the second inertial measurement unit is arranged on one end of the left temple of the smart glasses away from the frame, and the third inertial measurement unit is arranged on one end of the right temple of the smart glasses away from the frame.

Citation Information

Patent Citations

  • Cognitive platform including computerized evocative elements

    CN110024014A

  • Electroencephalogram eye tracker based on brain-computer interface, calibration method and device thereof, computer equipment and storage medium

    CN120371132A

  • Response capability assessment method, head-mounted display device and computer readable storage medium

    CN120643230A

  • Systems and Methods for Determining Physiological State Based on Surface Biopotentials

    US20250127444A1