Intelligent glasses

Abstract

The invention discloses a pair of intelligent glasses, and relates to the technical field of wearable equipment, and the intelligent glasses comprise a prompt output module which comprises a display module and / or a loudspeaker and is set to output guiding prompt information; the bio-electricity signal detection electrode comprises an ENG electrode and / or an EMG electrode, is arranged on the inner side of a glasses leg of the intelligent glasses, is attached to a target body surface area corresponding to a reaction test action in a wearing state, and is set to detect the change of a bio-electricity signal; the action detection module comprises a camera and / or a microphone and is set to detect and respond to the test action; the processor is connected with the prompt output module, the bio-electricity signal detection electrode and the action detection module, and is used for outputting the guidance prompt information according to the first time for outputting the guidance prompt information, the second time for detecting the change of the bio-electricity signal and the third time for detecting the completion of the reaction test action; and generating a cognitive response capability evaluation result and an execution response capability evaluation result. According to the invention, refined layered evaluation of the reaction capability can be realized.

Description

Technical Field

[0001] The present application relates to the technical field of wearable devices, and in particular to smart glasses. Background Art

[0002] With the advancement of technology and the widespread use of intelligent devices, the objective and quantitative assessment of reaction ability is playing an increasingly important role in various fields. For example, in sports, reaction ability is one of the key indicators for measuring an athlete's overall quality; in clinical medicine, reaction ability can be used as a key monitoring parameter for neurological function and rehabilitation progress; and in specialized professions such as pilots and drivers, reaction ability is a key factor in ensuring operational safety and mission efficiency.

[0003] Currently, traditional smart glasses typically rely on manual observation or the use of simple external devices to record the total time from when a user receives a stimulus (such as a visual or auditory cue) to when they complete a designated action. For example, after a visual cue is output on the screen or an audio cue is played through a speaker, the time interval between the user responding to the cue and completing the corresponding action is recorded to evaluate their responsiveness.

[0004] However, this traditional smart glasses can only obtain the overall reaction time and cannot perform a detailed hierarchical assessment of the user's reaction ability. Summary of the Invention

[0005] The main purpose of this application is to provide a smart glasses that aims to achieve refined hierarchical evaluation of reaction ability.

[0006] To achieve the above objectives, the present application proposes a pair of smart glasses, comprising: A prompt output module, including a display module and / or a speaker, wherein the prompt output module is configured to output guidance prompt information corresponding to the reaction test action; Bioelectric signal detection electrodes, including ENG electrodes and / or EMG electrodes, are disposed on the inner sides of the temples of the smart glasses, and when the smart glasses are worn, the bioelectric signal detection electrodes are in contact with the target body surface area corresponding to the reaction test action; the bioelectric signal detection electrodes are configured to detect changes in bioelectric signals caused by the reaction test action; an action detection module, comprising a camera and / or a microphone, wherein the action detection module is configured to detect the reaction test action; A processor is connected to the prompt output module, the bioelectric signal detection electrode and the action detection module. The processor is configured to generate a cognitive reaction ability assessment result and an execution reaction ability assessment result of the wearer based on a first time when the prompt output module outputs the guidance prompt information, a second time when the bioelectric signal detection electrode detects a change in the bioelectric signal, and a third time when the action detection module detects that the reaction test action is completed.

[0007] In one embodiment, the microphone is disposed on the nose bridge of the smart glasses, and the microphone is disposed on the inner side and / or lower side of the nose bridge.

[0008] In one embodiment, the microphone includes a bone conduction microphone, and when the smart glasses are in a worn state, the bone conduction microphone is in contact with the nose bridge of the wearer; The reaction test action includes a teeth-clicking action, and the target body surface area corresponding to the teeth-clicking action is the temporalis muscle surface projection area.

[0009] In one embodiment, the microphone includes an air conduction microphone, and when the smart glasses are in a worn state, the sound pickup direction of the air conduction microphone is directed toward the wearer's mouth; The reaction test action includes a vocalization action, and the target body surface area corresponding to the vocalization action is the temporalis muscle body surface projection area.

[0010] In one embodiment, the camera is disposed on the frame of the smart glasses.

[0011] In one embodiment, the camera includes a first camera, which is disposed on an upper edge of a frame of the smart glasses, and when the smart glasses are worn, a shooting direction of the first camera is directed toward an eyebrow of the wearer; The reaction test action includes an eyebrow action, and the target body surface area corresponding to the eyebrow action is the temporal branch body surface projection area.

[0012] In one embodiment, the camera includes a second camera, which is disposed at the lower edge of the frame of the smart glasses, and when the smart glasses are in a worn state, the shooting direction of the second camera is directed toward the wearer's mouth; The reaction test action includes a mouth opening and closing action, and the target body surface area corresponding to the mouth opening and closing action is the temporalis muscle body surface projection area.

[0013] In one embodiment, the camera includes a third camera, and when the smart glasses are in a wearing state, the shooting direction of the third camera is directed toward the eyes of the wearer; The reaction test action includes an eyelid opening and closing action, and the target body surface area corresponding to the eyelid opening and closing action is the temporal branch body surface projection area.

[0014] In one embodiment, the bioelectric signal detection electrode includes an electrode body and an electrode convex structure, the electrode body includes a first side and a second side arranged opposite to each other, the first side is in contact with the inner side of the temple of the smart glasses, and the electrode convex structure is arranged on the second side. When the smart glasses are in a worn state, the electrode convex structure is in contact with the target body surface projection area of ​​the wearer.

[0015] In one embodiment, the temples of the smart glasses include arc-shaped ear-hanging grooves, the speakers are arranged in the arc-shaped ear-hanging grooves, and when the smart glasses are in a worn state, the broadcasting direction of the speakers points to the ear canal opening of the wearer.

[0016] In one embodiment, the smart glasses further include a first inertial measurement unit, a second inertial measurement unit, and a third inertial measurement unit; Among them, the first inertial measurement unit is arranged on the bridge of the smart glasses, the second inertial measurement unit is arranged at the end of the left temple of the smart glasses away from the frame, and the third inertial measurement unit is arranged at the end of the right temple of the smart glasses away from the frame.

[0017] The present application provides a pair of smart glasses, relating to the technical field of wearable devices, the smart glasses comprising: a prompt output module, comprising a display module and / or a speaker, the prompt output module being configured to output guidance prompt information corresponding to a reaction test action; a bioelectric signal detection electrode, comprising an ENG electrode and / or an EMG electrode, the bioelectric signal detection electrode being arranged on the inner side of the temple of the smart glasses, and when the smart glasses are in a worn state, the bioelectric signal detection electrode being in contact with a target body surface area corresponding to the reaction test action; the bioelectric signal detection electrode being configured to detect changes in bioelectric signals caused by the reaction test action; an action detection module, comprising a camera and / or a microphone, the action detection module being configured to detect the reaction test action; a processor, connected to the prompt output module, the bioelectric signal detection electrode and the action detection module, the processor being configured to generate a cognitive reaction ability assessment result and an execution reaction ability assessment result of the wearer according to a first time when the prompt output module outputs the guidance prompt information, a second time when the bioelectric signal detection electrode detects a change in the bioelectric signal, and a third time when the action detection module detects that the reaction test action is completed.

[0018] The smart glasses proposed in this application realize a refined hierarchical evaluation of the wearer's reaction ability through the prompt output module, bioelectric signal detection electrodes, action detection module and processor integrated in the smart glasses. Specifically, during the test process, the system first presents visual or auditory guidance prompt information related to the reaction test action to the wearer through the display module and / or speaker in the prompt output module, and determines the prompt output time of the guidance prompt information, that is, the first time; then, through the ENG (Electroneurography) electrodes and / or EMG (Electromyography) electrodes in the bioelectric signal detection electrodes, when the wearer receives the prompt and is ready to perform the action, the bioelectric signal changes caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporalis muscle surface projection area, etc.) are detected in real time, thereby determining the signal of neuromuscular activation. The change time is the second time; at the same time, the camera and / or microphone in the action detection module is used to capture the time it takes for the wearer to actually complete the reaction test action, which is the third time; finally, based on the above three time nodes, the processor can evaluate the wearer's reaction ability from the two dimensions of the cognitive stage and the execution stage, and generate cognitive reaction ability evaluation results and execution reaction ability results accordingly. Among them, the time interval from the prompt output to the change of the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, which is an evaluation indicator of cognitive reaction ability, while the time interval from the change of the bioelectric signal to the completion of the action reflects the wearer's movement execution efficiency and movement coordination, which is an evaluation indicator of execution reaction ability. This application decomposes the overall reaction time into two sub-processes, cognition and execution, breaking through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizing a multi-level and fine-grained analysis of reaction ability.

[0019] The beneficial technical effects of the present application are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire test process relies on smart glasses, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, the present application does not rely on external independent equipment to complete multimodal data acquisition and synchronous analysis, simplifies the test process, improves assessment efficiency, and helps promote the development of reaction ability assessment technology towards intelligence and portability. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 Schematic diagram of the module structure of the smart glasses in the embodiment of the present application; Figure 2 Schematic diagram of the hardware structure of the smart glasses in the embodiment of this application; Figure 3 This is a schematic diagram of the wearing state of the smart glasses in an embodiment of the present application; Figure 4 This is a schematic diagram of the surface projection position of the temporal branch in the embodiment of the present application; Figure 5 This is a schematic diagram of the surface projection position of the temporalis muscle in an embodiment of the present application; Figure 6 Schematic diagram of the structure of the bioelectric signal detection electrode in the embodiment of the present application.

[0023] Description of the accompanying figures: 100. Smart glasses; 1. Prompt output module, 11. Display module, 12. Speaker; 2. Bioelectric signal detection electrode, 21. ENG electrode, 22. EMG electrode, 23. Electrode body, 24. Electrode convex structure; 3. Motion detection module, 31. Camera, 32. Microphone; 4. Processor; 5. First inertial measurement unit; 6. Second inertial measurement unit; 7. Third inertial measurement unit.

[0024] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0025] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0026] Currently, traditional smart glasses typically rely on manual observation or the use of simple external devices to record the total time from when a user receives a stimulus (such as a visual or auditory cue) to when they complete a designated action. For example, after a visual cue is output on the screen or an audio cue is played through a speaker, the time interval between the user responding to the cue and completing the corresponding action is recorded to evaluate their responsiveness.

[0027] However, such traditional smart glasses can only obtain the overall reaction time and cannot evaluate the user's cognitive reaction ability and executive reaction ability in a fine-grained manner.

[0028] In contrast, the solution of an embodiment of the present application is to provide smart glasses, which include: a prompt output module, including a display module and / or a speaker, and the prompt output module is configured to output guidance prompt information corresponding to a reaction test action; a bioelectric signal detection electrode, including an ENG electrode and / or an EMG electrode, and the bioelectric signal detection electrode is arranged on the inner side of the temple of the smart glasses, and when the smart glasses are in a worn state, the bioelectric signal detection electrode is in contact with the target body surface area corresponding to the reaction test action; the bioelectric signal detection electrode is configured to detect changes in bioelectric signals caused by the reaction test action; an action detection module, including a camera and / or a microphone, and the action detection module is configured to detect the reaction test action; a processor, connected to the prompt output module, the bioelectric signal detection electrode and the action detection module, and the processor is configured to generate a wearer's cognitive reaction ability evaluation result and an execution reaction ability evaluation result based on a first time when the prompt output module outputs the guidance prompt information, a second time when the bioelectric signal detection electrode detects the bioelectric signal change, and a third time when the action detection module detects that the reaction test action is completed.

[0029] The smart glasses proposed in this application realize a refined hierarchical evaluation of the wearer's reaction ability through the prompt output module, bioelectric signal detection electrodes, action detection module and processor integrated in the smart glasses. Specifically, during the test process, the system first presents visual or auditory guidance prompt information related to the reaction test action to the wearer through the display module and / or speaker in the prompt output module, and determines the prompt output time of the guidance prompt information, that is, the first time; then, through the ENG electrode and / or EMG electrode in the bioelectric signal detection electrode, when the wearer receives the prompt and is ready to perform the action, the bioelectric signal changes caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporalis muscle surface projection area, etc.) are detected in real time, thereby determining the signal change time of neuromuscular activation, that is, the second time; at the same time, through the action detection module The camera and / or microphone in the block captures the time it takes for the wearer to actually complete the reaction test action, which is the third time. Finally, based on the above three time nodes, the processor can evaluate the wearer's reaction ability from two dimensions, namely the cognitive stage and the execution stage, and generate cognitive reaction ability evaluation results and execution reaction ability results accordingly. Among them, the time interval from the prompt output to the change of the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, which is an evaluation indicator of cognitive reaction ability, while the time interval from the change of the bioelectric signal to the completion of the action reflects the wearer's movement execution efficiency and movement coordination, which is an evaluation indicator of execution reaction ability. This application decomposes the overall reaction time into two sub-processes, namely cognition and execution, which breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes a multi-level and fine-grained analysis of reaction ability.

[0030] The beneficial technical effects of the present application are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire test process relies on smart glasses, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, the present application does not rely on external independent equipment to complete multimodal data acquisition and synchronous analysis, simplifies the test process, improves assessment efficiency, and helps promote the development of reaction ability assessment technology towards intelligence and portability.

[0031] The smart glasses in the embodiments of this application may include, but are not limited to, mixed reality (MR) glasses, augmented reality (AR) glasses, virtual reality (VR) glasses, extended reality (XR) glasses, or some combination thereof. In this embodiment, for ease of description, the following description uses smart glasses as the execution subject.

[0032] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0033] This application proposes a first embodiment of smart glasses.

[0034] Please refer to Figure 1 , Figure 1 A schematic diagram of the module structure provided for the first embodiment of the smart glasses of this application.

[0035] In this embodiment, the smart glasses 100 include: The prompt output module 1 includes a display module 11 and / or a speaker 12, and the prompt output module 1 is configured to output guidance prompt information corresponding to the reaction test action; The bioelectric signal detection electrode 2 includes an ENG electrode 21 and / or an EMG electrode 22. The bioelectric signal detection electrode 2 is disposed on the inner side of the temple of the smart glasses 100. When the smart glasses 100 are worn, the bioelectric signal detection electrode 2 is in contact with the target body surface area corresponding to the reaction test action. The bioelectric signal detection electrode 2 is configured to detect changes in the bioelectric signal caused by the reaction test action. The action detection module 3 includes a camera 31 and / or a microphone 32, and the action detection module 3 is configured to detect a reaction test action; The processor 4 is connected to the prompt output module 1, the bioelectric signal detection electrode 2 and the action detection module 3. The processor 4 is configured to generate the wearer's cognitive reaction ability evaluation results and the execution reaction ability evaluation results according to the first time when the prompt output module 1 outputs the guidance prompt information, the second time when the bioelectric signal detection electrode 2 detects the change of the bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action.

[0036] In this embodiment, the prompt output module 1 includes a display module 11 and / or a speaker 12, which is used to output guidance prompt information corresponding to the reaction test action to the wearer.

[0037] The wearer specifically refers to a wearer wearing the smart glasses 100 .

[0038] Guidance prompt information refers to prompt information used to guide the wearer to perform reaction test actions. The guidance prompt information can be visual guidance prompt information (such as text, image, animation), auditory guidance prompt information (such as sound) or a combination thereof, wherein the visual guidance prompt information can be output through the display module 11 in the prompt output module 1, and the auditory guidance prompt information can be output through the speaker 12 in the prompt output module 1.

[0039] The display module 11 can be a microdisplay integrated into the lens of the smart glasses 100, a projection optical component set on the frame of the smart glasses 100, or a diffraction waveguide device or a holographic waveguide device constructed using optical elements such as waveguides and gratings (which can expand and guide light from a small side light source, thereby presenting a virtual image in the wearer's field of view that seems to be floating above the real world).

[0040] In one possible implementation, Figure 2 and Figure 3 As shown, the temples of the smart glasses 100 include arc-shaped ear-hanging grooves, and the speakers 12 are arranged in the arc-shaped ear-hanging grooves. When the smart glasses 100 are in the wearing state, the broadcast direction of the speakers 12 points to the wearer's ear canal opening.

[0041] In this embodiment, the speaker 12 is cleverly embedded in the curved ear-hanging groove of the temple. Its position is carefully designed so that when worn, the sound outlet of the speaker 12 is directly opposite the wearer's ear canal opening. This layout not only fully utilizes the space in the temple, but also effectively avoids interference from external environmental noise, ensuring that the wearer can clearly receive the auditory guidance prompts.

[0042] Furthermore, by placing the speaker 12 within the curved ear-hanging slot, wearing comfort and stability are further enhanced. The curved ear-hanging slot is ergonomically designed to better conform to the shape of the auricle, reducing discomfort from prolonged wear. Furthermore, the direct alignment of the speaker 12 with the ear canal opening reduces energy loss during sound transmission, improving audio quality.

[0043] This embodiment achieves effective transmission of auditory guidance prompt information by arranging the speaker 12 in the arc-shaped ear-hanging groove of the temple and pointing its broadcast direction toward the wearer's ear canal opening, thereby improving user experience and the accuracy of test results.

[0044] This embodiment uses the prompt output module 1 to provide a clear and recognizable action trigger signal, ensuring that the wearer can receive the test instructions under a unified time reference, thereby improving the consistency and comparability of the test results. At the same time, this embodiment also records the prompt output time of the prompt output module 1 outputting the guidance prompt information, that is, the first time, as the time starting point of the entire reaction test process. This is used to subsequently calculate the time interval between the cognitive stage and the execution stage, so that the processor 4 can perform a refined and hierarchical assessment of the wearer's reaction ability.

[0045] In this embodiment, the bioelectric signal detection electrode 2 includes an ENG electrode 21 and / or an EMG electrode 22, which is arranged on the inner side of the temple of the smart glasses 100. When the smart glasses 100 are in a worn state, these electrodes can fit with the wearer's specific target body surface area (i.e., the target body surface area corresponding to the reaction test action), thereby realizing non-invasive collection of bioelectric signal changes caused by performing the reaction test action.

[0046] Those skilled in the art will appreciate that the ENG electrodes 21 can be used to detect peripheral nerve electrical signal activity (i.e., changes in neural electrical signals), such as the nerve impulses transmitted by the temporal branch of the facial nerve during blinking. The EMG electrodes 22 can be used to detect changes in muscle electrical signals, such as the muscle contraction signals generated by the temporalis muscle during mouth closure. Furthermore, by combining specific algorithms, the ENG electrodes 21 can also indirectly detect changes in muscle electrical signals, and conversely, the EMG electrodes 22 can also be used to capture changes in neural electrical signals. Related technologies have been explored in existing research and will not be elaborated upon in this embodiment.

[0047] In this embodiment, the reaction test actions are primarily divided into two categories: temporal branch-related reaction test actions and temporal muscle-related reaction test actions. Temporal branch-related reaction test actions involve the temporal branch of the facial nerve and induce changes in neural electrical signals detectable by the bioelectrical signal detection module in the temporal branch surface projection area (the area where the temporal branch nerve is projected on the body surface). These actions primarily include eyebrow movements (raising, frowning, and furrowing eyebrows) and eyelid opening and closing movements (opening, closing, and blinking eyes). Their corresponding target surface projection area is the temporal branch surface projection area. Temporal muscle-related reaction test actions involve the temporal muscle and induce changes in muscle electrical signals detectable by the bioelectrical signal detection module in the temporal muscle surface projection area (the area where the temporal muscle is projected on the body surface). These actions primarily include tooth tapping (single, continuous, or left-side tapping), vocalization (pronouncing specific syllables, reciting specific words, or reciting specific sentences), and mouth opening and closing movements (opening and closing the mouth). Their corresponding target surface projection area is the temporal muscle surface projection area.

[0048] It is easy to understand that when the wearer's reaction test action is a temporal branch-related reaction test action, the camera 31 in the action detection module 3 responsible for detecting eyebrow movements and / or eyelid opening and closing movements is correspondingly called to detect the temporal branch-related reaction test action, thereby determining the action completion time of the temporal branch-related reaction test action. When the wearer's reaction test action is a temporalis muscle-related reaction test action, the bone conduction microphone responsible for detecting tooth clicking, the air conduction microphone responsible for detecting vocalization, or the camera 31 responsible for detecting mouth opening and closing movements in the action detection module 3 is correspondingly called to detect the temporalis muscle-related reaction test action, thereby determining the action completion time of the temporalis muscle-related reaction test action.

[0049] For example, Figure 4 As shown, when the reaction test action is a temporal branch-related reaction test action, taking blinking as an example, the nerve impulses sent by the brain are transmitted to the orbicularis oculi muscle through the temporal branch of the facial nerve, causing the orbicularis oculi muscle to contract and relax, thereby completing the blinking action. Therefore, when the wearer performs a blinking action, there will be transmission of neural electrical signals in the temporal branch of the facial nerve, that is, there will be changes in neural electrical signals. Therefore, the projection area of ​​the temporal branch nerve on the body surface - the temporal branch body surface projection area, can be used as the target body surface area, and the neural electrical signal detection unit in the bioelectrical signal detection electrode 2, which is specifically used to detect changes in peripheral nerve electrical signals in the inner layer from the body surface (implemented by the ENG electrode 21 and / or the EMG electrode 22), is set to be in contact with the wearer's temporal branch body surface projection area when the smart glasses 100 are in a worn state, so that the neural electrical signal changes caused by the wearer performing the blinking action are detected in the temporal branch body surface projection area by the neural electrical signal detection unit, and the signal change time of the neural electrical signal change is determined, so as to divide the cognitive stage and the execution stage when the wearer performs the blinking action, and then perform a refined and hierarchical evaluation of the wearer's eyelid opening and closing reaction ability.

[0050] Similarly, if Figure 5As shown, when the reaction test action is a temporalis muscle-related reaction test action, taking mouth closing as an example, the nerve impulses sent by the brain will be transmitted to the temporalis muscle, one of the main mouth closing muscles, prompting the temporalis muscle to contract, generating force to move the mandible upward and backward, thereby achieving the mouth closing action. Therefore, when the wearer performs the mouth-closing action, the muscle electrical signal of the temporalis muscle will change. Therefore, the projection area of ​​the temporalis muscle on the body surface - the temporalis muscle surface projection area, can be used as the target body surface area, and the muscle electrical signal detection unit in the bioelectric signal detection module, which is specifically used to detect the changes in the muscle electrical signals of the inner layer from the body surface (implemented by the ENG electrode 21 and / or the EMG electrode 22), is set to fit with the wearer's temporalis muscle surface projection area when the smart glasses 100 are in the wearing state, so that the muscle electrical signal changes caused by the wearer performing the mouth-closing action are detected in the temporalis muscle surface projection area by the muscle electrical signal detection unit, and the signal change time of the muscle electrical signal change is determined, so as to divide the cognitive stage and the execution stage when the wearer performs the mouth-closing action, and then conduct a refined and hierarchical evaluation of the wearer's mouth opening and closing reaction ability.

[0051] In one possible implementation, Figure 6 As shown, the bioelectric signal detection electrode 2 includes an electrode body 23 and an electrode convex structure 24. The electrode body 23 includes a first side and a second side that are relatively arranged. The first side is in contact with the inner side of the temple of the smart glasses 100, and the electrode convex structure 24 is arranged on the second side. When the smart glasses 100 are in a worn state, the electrode convex structure 24 is in contact with the target body surface projection area of ​​the wearer.

[0052] It should be noted that the electrode convex structure 24 is a special structure designed to enhance the contact between the bioelectrical signal detection electrode 2 and the wearer's body surface. By integrating a series of raised portions of a certain height and elasticity on the electrode body 23, the electrode convex structure 24 enables the bioelectrical signal detection electrode 2 to penetrate physical obstacles such as hair when worn and actively press into the wearer's specific target area of ​​the body surface. This effectively improves the contact quality between the electrode and the skin, enhances the stability and sensitivity of signal acquisition, and achieves more stable and accurate signal acquisition.

[0053] Compared to traditional planar electrode designs without an electrode convex structure 24, this embodiment can effectively penetrate the wearer's skin hair or other physical obstacles that may affect electrode contact by applying local pressure during wearing, significantly reducing signal interference or distortion caused by hair obstruction, skin undulations, or unstable wearing. In addition, the elastic design of the electrode convex structure 24 can also adapt to the differences in facial contours of different users, avoiding poor contact or signal drift due to individual differences, thereby improving the universality and reliability of the device. Therefore, the design of the electrode convex structure 24 not only effectively solves the problem that traditional electrodes are susceptible to physical interference factors in non-invasive wearing scenarios, but also significantly improves the accuracy and consistency of the smart glasses 100 in collecting neural electrical signals (ENG) and muscle electrical signals (EMG) in a dynamic testing environment. It is a key technological innovation for achieving high-quality biosignal detection in this embodiment.

[0054] This embodiment provides a stable and accurate physiological signal acquisition function through the bioelectric signal detection electrode 2, ensuring that it can capture the neural excitation and muscle pre-activation process that occurs before the wearer makes obvious limb movements, thereby effectively dividing the "cognitive stage" and "execution stage" in reaction ability, significantly improving the scientific nature and accuracy of the refined hierarchical evaluation of reaction ability. At the same time, this embodiment also records the signal change time when the bioelectric signal detection electrode 2 detects the bioelectric signal change, that is, the second time, as the time node for dividing the reaction test process into the "cognitive stage" and the "execution stage", and is used for the subsequent calculation of the time interval between the cognitive stage and the execution stage, so that the processor 4 can perform a refined hierarchical evaluation of the wearer's reaction ability.

[0055] In this embodiment, the action detection module 3 includes a camera 31 and / or a microphone 32, which is used to detect whether the wearer has completed the reaction test action corresponding to the guidance prompt information, and accurately record the completion time of the reaction test action, that is, the third time.

[0056] According to different reaction test action types, this embodiment can select corresponding sensors for detection. For example, when detecting eyelid opening and closing actions (such as opening eyes, closing eyes, blinking, etc.), the camera 31 is called, and when detecting sound actions, the microphone 32 is called. This embodiment provides accurate and real-time motion recognition capabilities through the motion detection module 3, ensuring that the boundaries of the wearer's process from neuromuscular activation to actual action completion can be clearly defined, thereby providing key data support for the quantitative analysis of the "execution phase." At the same time, this embodiment also records the time when the motion detection module 3 detects the completion of the reaction test action, i.e., the third time, as the time endpoint of the entire reaction test process. This time, combined with the first time (prompt output time) and the second time (bioelectric signal change time), constitutes the time benchmark for the cognitive and execution phases, allowing the processor 4 to perform a refined and hierarchical assessment of the wearer's cognitive and executive reaction abilities.

[0057] In this embodiment, the processor 4 is respectively connected to the prompt output module 1, the bioelectric signal detection electrode 2 and the action detection module 3, and is configured to generate the wearer's cognitive reaction ability evaluation results and execution reaction ability evaluation results according to the first time when the prompt output module 1 outputs the guidance prompt information, the second time when the bioelectric signal detection electrode 2 detects the change of the bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action.

[0058] Specifically, the above-mentioned steps of generating the wearer's cognitive reaction ability evaluation results and executive reaction ability evaluation results based on the first time when the prompt output module 1 outputs the guidance prompt information, the second time when the bioelectric signal detection electrode 2 detects the change of the bioelectric signal, and the third time when the action detection module 3 detects the completion of the reaction test action may include: evaluating the wearer's cognitive reaction ability based on the first time and the second time, and generating the wearer's cognitive reaction ability evaluation results; evaluating the wearer's executive reaction ability based on the second time and the third time, and generating the wearer's executive reaction ability evaluation results.

[0059] Cognitive responsiveness refers to the efficiency of information processing from the receipt of external stimuli to the activation of the neuromuscular system, encompassing multiple psychological processes such as perception, judgment, and decision-making. This cognitive responsiveness can be used as an indicator to measure an individual's cognitive processing speed, decision-making efficiency, and attentional focus in response to external stimuli. It directly reflects an individual's attentional focus, information processing speed, and response readiness. The cognitive responsiveness assessment result is based on the time difference between the receipt of a prompt and the onset of detectable bioelectrical signal changes in the neuromuscular system.

[0060] Executive reaction ability refers to the efficiency of movement execution from the activation of the neuromuscular system to the actual completion of the designated action, covering multiple aspects such as muscle contraction, movement coordination, and force control. This executive reaction ability can be used as an indicator to measure an individual's cognitive processing speed, decision-making efficiency, and attentional focus in response to external stimuli, and directly reflects the individual's movement control accuracy and body coordination. The result of the executive reaction ability assessment is based on the time difference between the individual's neuromuscular system starting to generate detectable bioelectric signal changes and the actual completion of the designated reaction test action.

[0061] In a feasible embodiment, the above-mentioned step of evaluating the wearer's cognitive reaction ability based on the first time and the second time and generating the wearer's cognitive reaction ability evaluation result may include: calculating the cognitive reaction time of the wearer performing the reaction test action based on the first time and the second time; evaluating the wearer's cognitive reaction ability based on the cognitive reaction time, and generating the wearer's cognitive reaction ability evaluation result.

[0062] By comparing the "first time" with the "second time," this embodiment can determine the time difference between the wearer's perception of the cue and neuromuscular activation, i.e., the cognitive response time. The shorter this cognitive response time, the higher the wearer's cognitive processing efficiency and the stronger their cognitive response ability.

[0063] It is not difficult to understand that in this embodiment, the prompt output module 1 will output the guidance prompt information corresponding to at least one reaction test action. Accordingly, the cognitive reaction time of the wearer performing each reaction test action is calculated based on the first time and the second time corresponding to each reaction test action. When performing the above step of calculating the cognitive reaction time of the wearer performing the reaction test action based on the first time and the second time, according to the actual setting, a cognitive reaction ability assessment is performed on each reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each reaction test action, or according to multiple types of reaction test actions, the average cognitive reaction time of each type of reaction test action is statistically obtained, and then a cognitive reaction ability assessment is performed on each type of reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each type of reaction test action, or after a cognitive reaction ability assessment is performed on each reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each type of reaction test action, the cognitive reaction ability assessment results corresponding to each reaction test action are integrated or weighted to obtain the overall cognitive reaction ability assessment result of the wearer. This embodiment does not specifically limit this, and the cognitive reaction ability assessment method can be flexibly set according to actual needs.

[0064] It is worth mentioning that in this embodiment, when the user conducts a reaction ability evaluation through the head-mounted display device, he or she can actively choose to conduct a certain type of reaction test action, or even conduct a reaction ability evaluation of a specific reaction test action, or choose to conduct a reaction ability evaluation that randomly covers all reaction test actions.

[0065] In a feasible embodiment, the above-mentioned step of evaluating the wearer's execution reaction ability based on the second time and the third time and generating the wearer's execution reaction ability evaluation result may include: calculating the execution reaction time of the wearer's execution reaction test action based on the second time and the third time; evaluating the wearer's execution reaction ability based on the execution reaction time, and generating the wearer's execution reaction ability evaluation result.

[0066] By comparing the "second time" with the "third time," this embodiment can determine the time difference between the wearer's neuromuscular activation and the completion of the movement, i.e., the execution reaction time. The shorter and more stable this execution reaction time is, the higher the wearer's exercise execution efficiency and the stronger their execution reaction ability.

[0067] Similar to the aforementioned embodiment, when evaluating the execution reaction ability, this embodiment also needs to calculate the execution reaction time of the wearer to perform each reaction test action if the prompt output module 1 outputs guidance prompt information corresponding to multiple reaction test actions. Thus, in the step of evaluating the wearer's execution reaction ability based on the execution reaction time and generating the wearer's execution reaction ability evaluation result, the wearer's execution reaction ability is evaluated according to the actual setting. It will not be elaborated here, and please refer to the aforementioned embodiment for details.

[0068] In a feasible embodiment, the above-mentioned step of evaluating the wearer's cognitive reaction ability based on the cognitive reaction time and generating the wearer's cognitive reaction ability evaluation result may include: obtaining the cognitive reaction time distribution corresponding to the reaction test action; evaluating the wearer's cognitive reaction ability based on the cognitive reaction time distribution and the cognitive reaction time, and generating the wearer's cognitive reaction ability evaluation result.

[0069] It should be noted that, in this embodiment, the cognitive reaction time distribution refers to the statistical distribution of cognitive reaction times for all individuals within a certain sample range for a specific reaction test action. This cognitive reaction time distribution is typically obtained through large-scale data collection and analysis, covering the time difference between receiving the prompt information and the beginning of the neuromuscular system generating detectable bioelectric signal changes. This data can be derived from people of different age groups, genders, health conditions, races, occupations, etc., to ensure that the distribution is broadly representative and reflects the characteristics of different populations.

[0070] It is worth noting that the distribution of cognitive reaction time is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles to describe the variability of the cognitive reaction speed of the entire group when performing specific reaction test actions.

[0071] This embodiment can pre-statistically obtain the cognitive reaction time distribution of different groups of people for different reaction test actions, so that in actual applications, the target population can be determined based on the wearer's population settings or personal information (including at least one of age information, gender information, race information, occupation information, health status information, etc.), and then when executing the step of obtaining the cognitive reaction time distribution corresponding to the reaction test action, the cognitive reaction time distribution of the target population to the specific reaction test action can be obtained.

[0072] By comparing a single wearer's cognitive reaction time with the target population's cognitive reaction time distribution, this implementation more accurately positions the wearer within the target population and provides a scientific assessment of their cognitive reaction ability. Specifically, the cognitive reaction time distribution is used as a reference benchmark, and then the wearer's cognitive reaction time is placed within this distribution framework for comparative analysis. This step not only considers the wearer's absolute reaction speed (i.e., cognitive reaction time) during the cognitive phase, but also their relative performance relative to similar populations during this phase.

[0073] This embodiment takes into account the differences in cognitive reaction abilities among different groups of people. By introducing the concept of cognitive reaction time distribution, the cognitive reaction ability assessment of each wearer is no longer isolated, but is based on a broad data background, thereby supporting a more personalized reaction ability assessment service and making the cognitive reaction ability assessment results more practical, accurate and reliable.

[0074] In a feasible embodiment, the above-mentioned step of evaluating the wearer's execution reaction ability based on the execution reaction time and generating the wearer's execution reaction ability evaluation result may include: obtaining the execution reaction time distribution corresponding to the reaction test action; evaluating the wearer's execution reaction ability based on the execution reaction time distribution and the execution reaction time, and generating the wearer's execution reaction ability evaluation result.

[0075] It should be noted that, in this embodiment, the execution reaction time distribution refers to the statistical distribution of the execution reaction time of all individuals obtained within a certain sample range for a specific reaction test action. The execution reaction time distribution is usually obtained through large-scale data collection and analysis, covering the time difference between the beginning of the generation of detectable bioelectric signal changes in the neuromuscular system and the actual completion of the specified reaction test action. These data can be derived from people of different age groups, genders, health conditions, races, occupations, etc., to ensure that the distribution is broadly representative and can reflect the characteristics of different populations.

[0076] It is worth noting that the distribution of executive reaction time is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles to describe the variability of the executive reaction speed of the entire group when performing a specific reaction test action.

[0077] This embodiment can pre-statistically obtain the execution reaction time distribution of different groups of people for different reaction test actions, so that in actual applications, the target population can be determined based on the wearer's population settings or personal information (including at least one of age information, gender information, race information, occupation information, health status information, etc.), and then when executing the step of obtaining the execution reaction time distribution corresponding to the reaction test action, the execution reaction time distribution of the target population for the specific reaction test action can be obtained.

[0078] By comparing an individual wearer's execution reaction time with the target population's execution reaction time distribution, this implementation more accurately positions the wearer within the target population and provides a scientific assessment of their execution reaction ability. Specifically, the execution reaction time distribution is used as a reference benchmark, and then the current wearer's execution reaction time is placed within this distribution framework for comparative analysis. This step not only considers the wearer's absolute reaction speed (i.e., execution reaction time) during the execution phase, but also their relative performance relative to similar populations during the execution phase.

[0079] This embodiment takes into account the differences in execution reaction ability among different groups of people. By introducing the concept of execution reaction time distribution, the execution reaction ability assessment of each wearer is no longer isolated, but is based on a broad data background, thereby supporting a more personalized reaction ability assessment service, making the execution reaction ability assessment results more practical, accurate and reliable.

[0080] In a feasible implementation manner, the processor 4 is further configured to perform weighted fusion on the cognitive reaction ability evaluation results and the executive reaction ability evaluation results to obtain the wearer's comprehensive reaction ability evaluation result.

[0081] When evaluating the wearer's reaction ability, processor 4 already provides detailed evaluation results from the two dimensions of cognitive reaction ability and executive reaction ability. However, in practical applications, a comprehensive indicator is often required to fully reflect an individual's overall reaction ability. Therefore, in this embodiment, processor 4 is further configured to perform a weighted fusion of the cognitive reaction ability evaluation results and the executive reaction ability evaluation results to obtain a comprehensive reaction ability evaluation result for the wearer.

[0082] Those skilled in the art will appreciate that weighted fusion refers to combining evaluation results from different sources or types according to a preset weight distribution scheme to form a more comprehensive and balanced final evaluation result.

[0083] In this embodiment, the objects of weighted fusion are the cognitive reaction ability evaluation results and the executive reaction ability evaluation results previously generated by the processor 4 .

[0084] Specifically, weighted fusion can be achieved through the following formula: Comprehensive reaction ability assessment result = w1 × cognitive reaction ability assessment result + w2 × executive reaction ability assessment result.

[0085] Among them, w1 is the weight of cognitive response ability in the comprehensive evaluation, w2 is the weight of executive response ability in the comprehensive evaluation, and w1+w2=1.

[0086] The choice of weight can be adjusted according to the specific needs of the application scenario. For example, for application scenarios that emphasize quick decision-making, the value of w1 can be appropriately increased; while for applications that focus more on action execution efficiency, the proportion of w2 can be increased.

[0087] It is worth mentioning that, considering people of different genders at different ages, cognitive reaction ability and executive reaction ability have different proportions in the composition of comprehensive reaction ability. Therefore, when setting the values ​​of w1 and w2, they need to be adjusted according to the wearer's age information and / or gender information.

[0088] This embodiment uses a weighted fusion method to consider not only the wearer's performance in the cognitive stage, but also the wearer's efficiency in the execution stage, thereby providing a more comprehensive reaction ability evaluation system.

[0089] The smart glasses 100 proposed in this embodiment realizes a refined hierarchical evaluation of the wearer's reaction ability through the prompt output module 1, bioelectric signal detection electrodes 2, action detection module 3 and processor 4 integrated in the smart glasses 100. Specifically, during the test process, the system first presents visual or auditory guidance prompt information related to the reaction test action to the wearer through the display module 11 and / or speaker 12 in the prompt output module 1, and determines the prompt output time of the guidance prompt information, that is, the first time; then, through the ENG (Electroneurography) electrode and / or EMG (Electromyography) electrode in the bioelectric signal detection electrode 2, when the wearer receives the prompt and prepares to perform the action, the bioelectric signal changes caused by the reaction test action in the target body surface area (such as the temporal branch surface projection area, the temporalis muscle surface projection area, etc.) are detected in real time, thereby determining the signal of neuromuscular activation. At the same time, the camera 31 and / or microphone 32 in the action detection module 3 captures the time it takes the wearer to actually complete the reaction test action, which is the third time. Finally, based on the above three time nodes, the processor 4 can evaluate the wearer's reaction ability from two dimensions, namely the cognitive stage and the execution stage, and generate corresponding cognitive reaction ability evaluation results and execution reaction ability results. Among them, the time interval from the prompt output to the change of the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, which is an evaluation indicator of cognitive reaction ability, while the time interval from the change of the bioelectric signal to the completion of the action reflects the wearer's movement execution efficiency and movement coordination, which is an evaluation indicator of execution reaction ability. This embodiment decomposes the overall reaction time into two sub-processes, namely, cognitive and execution. This method breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes a multi-level and fine-grained analysis of reaction ability.

[0090] The beneficial technical effects of this embodiment are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of the reaction ability assessment; on the other hand, since the entire test process relies on the smart glasses 100, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, this embodiment can complete multimodal data collection and synchronous analysis without relying on external independent equipment, which simplifies the test process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability.

[0091] In one possible implementation, Figure 2As shown, the smart glasses 100 further include a first inertial measurement unit 5, a second inertial measurement unit 6 and a third inertial measurement unit 7; Among them, the first inertial measurement unit 5 is arranged on the bridge of the smart glasses 100, the second inertial measurement unit 6 is arranged at the end of the left temple of the smart glasses 100 away from the frame, and the third inertial measurement unit 7 is arranged at the end of the right temple of the smart glasses 100 away from the frame.

[0092] In this embodiment, the first inertial measurement unit 5 is arranged on the bridge of the smart glasses 100, and is used to detect the angular velocity and acceleration changes of the wearer's head in three-dimensional space, and is particularly suitable for capturing head posture changes related to cognitive response tasks such as nodding and raising the head; the second inertial measurement unit 6 is arranged at the end of the left temple of the smart glasses 100 away from the frame, and the third inertial measurement unit 7 is arranged at the end of the right temple of the smart glasses 100 away from the frame, and the second inertial measurement unit 6 and the third inertial measurement unit 7 are symmetrically distributed at the ends of the left and right temples, and can collaboratively sense the overall movement state of the smart glasses 100 when worn, including tilt, rotation, and slight shaking caused by body movement or unstable wearing.

[0093] By installing inertial measurement units (IMUs) in over 100 key structural locations within the smart glasses, this embodiment enables the simultaneous acquisition of motion information from multiple locations on the wearer's head and the glasses themselves. This design not only helps improve the robustness of the system's motion recognition in dynamic environments, but also effectively distinguishes motion signals caused by actual reaction test movements from noise signals caused by head shaking or other interfering factors, thereby further improving the accuracy and reliability of the motion detection module 3 in identifying reaction test movements. Furthermore, data fusion from multiple IMUs can also be used to assist other sensors, such as the camera 31 and microphone 32, in motion determination, enhancing the comprehensiveness and scientific nature of the system's assessment of the wearer's reaction ability.

[0094] Based on the above first embodiment, the present application proposes smart glasses according to a second embodiment.

[0095] In the second embodiment of the present application, for the same or similar contents as those in the above embodiments, please refer to the above introduction and will not be repeated hereafter.

[0096] In this embodiment, the microphone 32 is disposed on the nose bridge of the smart glasses 100 , and the microphone 32 is disposed on the inner side and / or the lower side of the nose bridge.

[0097] In this embodiment, the microphone 32 in the action detection module 3 is arranged on the nose bridge of the smart glasses 100. Specifically, the microphone 32 is arranged on the inner side (i.e., the side facing the wearer) and / or the lower side of the nose bridge, so that when the smart glasses 100 are in the worn state, the microphone 32 can be closer to the wearer's facial structure, thereby achieving effective collection of acoustic signals related to specific reaction test actions.

[0098] For example, Figure 2 As shown, the microphone 32 can be located on the lower side of the nose bridge of the smart glasses 100.

[0099] By integrating the microphone 32 into the nose bridge, this embodiment not only optimizes the spatial layout of the smart glasses 100, but also improves the balance between wearing comfort and functional practicality.

[0100] In a first feasible embodiment, the microphone 32 includes a bone conduction microphone (not shown), and when the smart glasses 100 are in a worn state, the bone conduction microphone is in contact with the wearer's nose bridge; The reaction test action includes teeth-clicking action, and the target surface area corresponding to the teeth-clicking action is the surface projection area of ​​the temporalis muscle.

[0101] Those skilled in the art will recognize that a bone conduction microphone is a device that transmits sound by capturing bone vibrations. Specifically, rather than picking up sound waves through the air, a bone conduction microphone is mounted directly on bone (such as the skull or the bridge of the nose). It senses the mechanical vibrations transmitted through the bones by the vocal cords and converts them into electrical signals.

[0102] In this embodiment, the microphone 32 in the action detection module 3 comprises a bone conduction microphone, and when the smart glasses 100 are worn, the bone conduction microphone is in contact with the wearer's nose bridge. This design enables the bone conduction microphone to directly sense the weak mechanical vibration signals transmitted from the wearer's teeth to the nose bridge area through the jawbone during the wearer's teeth-clicking action. This allows the bone conduction microphone to efficiently and accurately determine whether the wearer has completed the designated teeth-clicking action when the guidance prompt information guides the wearer to perform the teeth-clicking action, and to determine the completion time of the teeth-clicking action.

[0103] In a second feasible embodiment, the microphone 32 includes an air conduction microphone (not shown), and when the smart glasses 100 are in a worn state, the sound pickup direction of the air conduction microphone is directed toward the wearer's mouth; The reaction test action includes a vocalization action, and the target body surface area corresponding to the vocalization action is the temporalis muscle surface projection area.

[0104] As those skilled in the art will appreciate, an air conduction microphone is a type of microphone 32 that uses air as a medium for sound transmission. It operates by receiving sound waveforms propagating through the air and converting them into electrical signals. An air conduction microphone typically includes a diaphragm. When sound waves strike the diaphragm, it vibrates, which in turn changes the capacitance or other parameters in the internal circuit, ultimately generating an electrical signal output corresponding to the sound waves.

[0105] It should be noted that the sound pickup direction refers to the directional characteristics of the microphone 32 relative to the sound source when receiving sound signals. It describes the sensitivity of the microphone 32 to sound signals from different directions, that is, from which direction the microphone 32 is more inclined to capture sound.

[0106] In this embodiment, the microphone 32 in the action detection module 3 comprises an air conduction microphone. When the smart glasses 100 are worn, the air conduction microphone's sound pickup direction is directed toward the wearer's mouth. This design enables the air conduction microphone to more accurately capture the sound signals emitted from the wearer's mouth during vocalization. This allows the microphone to efficiently and accurately determine whether the wearer has completed the designated vocalization action, and to determine the completion time of the action, when the guidance prompt information instructs the wearer to perform the vocalization action.

[0107] This embodiment integrates microphone 32 on the inner and / or underside of the nose bridge and utilizes both bone conduction and air conduction technology to achieve high-precision recognition of various types of reaction test actions (such as tooth-clicking and vocalization). Bone conduction microphones are suitable for tooth-clicking actions, which lack significant sound radiation but are accompanied by craniofacial bone vibrations; while air conduction microphones are more suitable for capturing vocalization actions, which primarily output sound. This complementary combination of these two technologies provides smart glasses 100 with more comprehensive action detection capabilities, helping to expand application scenarios and improve the accuracy of evaluation results.

[0108] Based on the above first embodiment, the present application proposes smart glasses according to a third embodiment.

[0109] In the third embodiment of the present application, for the same or similar contents as those in the above embodiments, please refer to the above introduction and will not be repeated hereafter.

[0110] In this embodiment, the camera 31 is disposed on the frame of the smart glasses 100 .

[0111] In this embodiment, the camera 31 is provided on the frame of the smart glasses 100. Specifically, the camera 31 can be configured as multiple sub-cameras 31 according to different reaction test action types, and each sub-camera 31 is arranged at different positions of the frame and has a specific shooting direction to achieve accurate visual capture of key areas of the wearer's face.

[0112] For example, Figure 2 and Figure 3 As shown, the camera 31 can be located at the bottom edge of the frame of the smart glasses 100 .

[0113] By integrating the camera 31 into the frame structure, this embodiment not only effectively utilizes the equipment space, but also ensures the stability of the relative position between the camera 31 and the wearer's face, thereby improving the accuracy of motion recognition and the overall aesthetics of the system.

[0114] In a first feasible embodiment, the camera 31 includes a first camera (not shown), which is disposed on the upper edge of the frame of the smart glasses 100, and when the smart glasses 100 are worn, the shooting direction of the first camera is directed toward the wearer's eyebrows; The reaction test movements include eyebrow movements, and the target body surface area corresponding to the eyebrow movements is the temporal branch body surface projection area.

[0115] In this embodiment, the first camera refers to the camera 31 mainly used to detect eyebrow movements.

[0116] It should be noted that the shooting direction refers to the directional characteristics of the camera 31 relative to the object when capturing images or videos. It describes the specific direction at which the camera 31 lens is pointed, and determines the image content and quality that the camera 31 can effectively capture.

[0117] In this embodiment, the camera 31 in the motion detection module 3 includes a first camera located on the upper edge of the frame. When the smart glasses 100 are worn, the first camera's shooting direction is directed toward the wearer's eyebrows. This design enables the first camera to more accurately capture dynamic changes in the wearer's brow area during the wearer's eyebrow movements. This allows the first camera to efficiently and accurately determine whether the wearer has completed the designated eyebrow movement when prompted by the guidance prompt, and to determine the completion time of the eyebrow movement.

[0118] In a second feasible embodiment, the camera 31 includes a second camera (not shown), which is disposed at the lower edge of the frame of the smart glasses 100, and when the smart glasses 100 are worn, the shooting direction of the second camera is directed toward the wearer's mouth; The reaction test movements include mouth opening and closing movements, and the target body surface area corresponding to the mouth opening and closing movements is the temporalis muscle surface projection area.

[0119] In this embodiment, the second camera refers to the camera 31 mainly used to detect the opening and closing movement of the mouth.

[0120] In this embodiment, the camera 31 in the motion detection module 3 includes a second camera located at the bottom edge of the frame. When the smart glasses 100 are worn, the second camera's shooting direction is directed toward the wearer's mouth. This design enables the first camera to more accurately capture dynamic changes in the wearer's mouth area during the wearer's mouth opening and closing movements. This allows the camera to efficiently and accurately determine whether the wearer has completed the designated mouth opening and closing movement when the guidance prompts the wearer to perform the movement, and to determine the completion time of the movement.

[0121] In a third feasible embodiment, the camera 31 includes a third camera (not shown), and when the smart glasses 100 are in a worn state, the shooting direction of the third camera is directed toward the wearer's eyes; The reaction test action includes eyelid opening and closing action, and the target body surface area corresponding to the eyelid opening and closing action is the temporal branch body surface projection area.

[0122] In this embodiment, the third camera refers to the camera 31 mainly used to detect the opening and closing of the eyelids.

[0123] In this embodiment, the camera 31 in the motion detection module 3 includes a third camera, and when the smart glasses 100 are worn, the third camera's shooting direction is directed toward the wearer's eyes. This design enables the third camera to more accurately capture dynamic changes in the wearer's eye area during the eyelid opening and closing action. This allows the third camera to efficiently and accurately determine whether the wearer has completed the designated eyelid opening and closing action when the guidance prompt information instructs the wearer to perform the eyelid opening and closing action, and to determine the completion time of the eyelid opening and closing action.

[0124] This embodiment achieves high-precision recognition of different types of reaction test actions (such as eyebrow movements, mouth opening and closing movements, and eyelid opening and closing movements) by integrating cameras 31 at different locations on the frame and adjusting their shooting directions accordingly. Specifically, the first camera, which points toward the eyebrows when worn, is ideally located at the top edge of the frame; the second camera, which points toward the mouth when worn, is ideally located at the bottom edge of the frame; and the third camera, which points toward the eyes when worn, has lower placement requirements. The complementary combination of these three elements provides smart glasses 100 with more comprehensive motion detection capabilities, helping to expand application scenarios and improve the accuracy of evaluation results.

[0125] It should be noted that the above embodiments are only used to assist in understanding the present application and do not constitute a limitation on the smart glasses of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0126] The above description is only part of the embodiments of the present application and does not limit the patent scope of the present application. All equivalent structural transformations made by using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A pair of smart glasses, characterized in that: The smart glasses include: A prompt output module, including a display module and / or a speaker, wherein the prompt output module is configured to output guidance prompt information corresponding to the reaction test action; Bioelectric signal detection electrodes, including ENG electrodes and / or EMG electrodes, are disposed on the inner sides of the temples of the smart glasses, and when the smart glasses are worn, the bioelectric signal detection electrodes are in contact with the target body surface area corresponding to the reaction test action; the bioelectric signal detection electrodes are configured to detect changes in bioelectric signals caused by the reaction test action; an action detection module, comprising a camera and / or a microphone, wherein the action detection module is configured to detect the reaction test action; A processor is connected to the prompt output module, the bioelectric signal detection electrode and the action detection module. The processor is configured to generate a cognitive reaction ability assessment result and an execution reaction ability assessment result of the wearer based on a first time when the prompt output module outputs the guidance prompt information, a second time when the bioelectric signal detection electrode detects a change in the bioelectric signal, and a third time when the action detection module detects that the reaction test action is completed.

2. The smart glasses according to claim 1, wherein: The microphone is arranged on the nose bridge of the smart glasses, and the microphone is arranged on the inner side and / or lower side of the nose bridge.

3. The smart glasses according to claim 2, wherein: The microphone includes a bone conduction microphone, and when the smart glasses are in a wearing state, the bone conduction microphone is in contact with the nose bridge of the wearer; The reaction test action includes a teeth-clicking action, and the target body surface area corresponding to the teeth-clicking action is the temporalis muscle surface projection area.

4. The smart glasses according to claim 2, wherein: The microphone includes an air conduction microphone, and when the smart glasses are in a wearing state, the sound pickup direction of the air conduction microphone is directed toward the wearer's mouth; The reaction test action includes a vocalization action, and the target body surface area corresponding to the vocalization action is the temporalis muscle body surface projection area.

5. The smart glasses according to claim 1, wherein: The camera is arranged on the frame of the smart glasses.

6. The smart glasses according to claim 5, wherein: The camera includes a first camera, which is arranged at the upper edge of the frame of the smart glasses, and when the smart glasses are in a wearing state, the shooting direction of the first camera is directed toward the wearer's eyebrows; The reaction test action includes an eyebrow action, and the target body surface area corresponding to the eyebrow action is the temporal branch body surface projection area.

7. The smart glasses according to claim 5, wherein: The camera includes a second camera, which is arranged at the lower edge of the frame of the smart glasses, and when the smart glasses are in a wearing state, the shooting direction of the second camera is directed toward the wearer's mouth; The reaction test action includes a mouth opening and closing action, and the target body surface area corresponding to the mouth opening and closing action is the temporalis muscle body surface projection area.

8. The smart glasses according to claim 5, wherein: The camera includes a third camera, and when the smart glasses are in a wearing state, the shooting direction of the third camera is directed toward the eyes of the wearer; The reaction test action includes an eyelid opening and closing action, and the target body surface area corresponding to the eyelid opening and closing action is the temporal branch body surface projection area.

9. The smart glasses according to any one of claims 1 to 8, wherein: The bioelectric signal detection electrode includes an electrode body and an electrode convex structure. The electrode body includes a first side and a second side arranged opposite to each other. The first side is in contact with the inner side of the temple of the smart glasses. The electrode convex structure is arranged on the second side. When the smart glasses are in a worn state, the electrode convex structure is in contact with the target body surface projection area of ​​the wearer.

10. The smart glasses according to any one of claims 1 to 8, wherein: The temples of the smart glasses include arc-shaped ear-hanging grooves, the speakers are arranged in the arc-shaped ear-hanging grooves, and when the smart glasses are in a wearing state, the broadcasting direction of the speakers points to the ear canal opening of the wearer.

11. The smart glasses according to any one of claims 1 to 8, wherein: The smart glasses further include a first inertial measurement unit, a second inertial measurement unit, and a third inertial measurement unit; Among them, the first inertial measurement unit is arranged on the bridge of the smart glasses, the second inertial measurement unit is arranged at the end of the left temple of the smart glasses away from the frame, and the third inertial measurement unit is arranged at the end of the right temple of the smart glasses away from the frame.

Images