Reaction capability evaluation method, head-mounted device, and computer-readable storage medium

By integrating bioelectric signal detection technology into the head-mounted display device, a refined, stratified assessment of responsiveness is achieved, solving the problem that traditional assessment methods cannot distinguish between the cognitive and executive stages, thus improving the scientific rigor and accuracy of the assessment.

CN120643230BActive Publication Date: 2025-11-07GOERTEK INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202511164718.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-08-20
Publication Date
2025-11-07
Estimated Expiration
2045-08-20

Smart Images

  • Figure CN120643230B_ABST
    Figure CN120643230B_ABST
Patent Text Reader

Abstract

The application discloses a reaction ability evaluation method, a head-mounted device and a computer readable storage medium, relates to the technical field of head-mounted devices, and the method is applied to the head-mounted device, and comprises the following steps: outputting prompt information corresponding to at least one reaction test action through a prompt output module, and determining a prompt output time; detecting a bioelectric signal change caused by a wearer performing the reaction test action in a target body surface area through a bioelectric signal detection module, and determining a signal change time; determining an action completion time through a reaction test action detection module; evaluating the cognitive reaction ability of the wearer based on the prompt output time and the signal change time, and obtaining a cognitive reaction ability evaluation result of the wearer; and evaluating the execution reaction ability of the wearer based on the signal change time and the action completion time, and obtaining an execution reaction ability evaluation result of the wearer. The application can realize fine and layered evaluation of the reaction ability.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of head-mounted device, and particularly relates to a reaction ability evaluation method, a head-mounted device and a computer readable storage medium. BACKGROUND

[0002] With the development of technology and the popularization of intelligent devices, objective quantitative evaluation of reaction ability plays an increasingly important role in many fields. For example, in the field of sports competition, reaction ability is one of the important indicators for measuring the comprehensive quality of athletes; in the field of clinical medicine, reaction ability can be used as an important monitoring parameter for neurological function and rehabilitation progress; and in special professions such as pilots and drivers, reaction ability is a key factor to ensure operation safety and task completion efficiency.

[0003] At present, the traditional reaction ability evaluation method usually relies on manual observation or uses simple external devices to record the total time from receiving a stimulus (such as a visual or auditory prompt) to completing a specified action. For example, after a visual prompt is output on the screen or a sound prompt is played through a loudspeaker, the time interval for the user to respond to the prompt and complete the corresponding action is recorded, which is used as the basis for evaluating the reaction ability.

[0004] However, this traditional reaction ability evaluation method can only obtain the overall reaction time and cannot perform fine-grained hierarchical evaluation of the user's reaction ability. SUMMARY

[0005] The main purpose of the present application is to provide a reaction ability evaluation method, a head-mounted device and a computer readable storage medium, which aims to realize fine-grained hierarchical evaluation of reaction ability.

[0006] To achieve the above purpose, the present application provides a reaction ability evaluation method, which is applied to a head-mounted device, the head-mounted device comprising a prompt output module, a bioelectric signal detection module and a reaction test action detection module, wherein the bioelectric signal detection module is in contact with a target body surface area of a wearer when the head-mounted device is in a wearing state, and the method comprises the following steps:

[0007] The prompt output module outputs prompt information corresponding to at least one reaction test action, and determines a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action;

[0008] The bioelectric signal detection module detects a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area, and determines a signal change time of the bioelectric signal change;

[0009] The reaction test action detection module determines an action completion time of the wearer performing the reaction test action;

[0010] Based on the prompt output time and the signal change time, the cognitive reaction ability of the wearer is evaluated to obtain a cognitive reaction ability evaluation result of the wearer;

[0011] Based on the signal change time and the action completion time, the execution reaction ability of the wearer is evaluated to obtain an execution reaction ability evaluation result of the wearer.

[0012] In an embodiment, the step of evaluating the cognitive reaction ability of the wearer based on the prompt output time and the signal change time to obtain a cognitive reaction ability evaluation result of the wearer comprises:

[0013] According to the prompt output time and the signal change time, a cognitive reaction time of the wearer performing the reaction test action is calculated;

[0014] According to the cognitive reaction time, the cognitive reaction ability of the wearer is evaluated to obtain a cognitive reaction ability evaluation result of the wearer.

[0015] In an embodiment, the step of evaluating the cognitive reaction ability of the wearer according to the cognitive reaction time to obtain a cognitive reaction ability evaluation result of the wearer comprises:

[0016] A cognitive reaction time distribution corresponding to the reaction test action is obtained;

[0017] According to the cognitive reaction time distribution and the cognitive reaction time, the cognitive reaction ability of the wearer is evaluated to obtain a cognitive reaction ability evaluation result of the wearer.

[0018] In an embodiment, the step of evaluating the execution reaction ability of the wearer based on the signal change time and the action completion time to obtain an execution reaction ability evaluation result of the wearer comprises:

[0019] According to the signal change time and the action completion time, an execution reaction time of the wearer performing the reaction test action is calculated;

[0020] According to the execution reaction time, the execution reaction ability of the wearer is evaluated to obtain an execution reaction ability evaluation result of the wearer.

[0021] In an embodiment, the step of evaluating the executive reaction ability of the wearer according to the executive reaction time to obtain an executive reaction ability evaluation result of the wearer comprises:

[0022] obtaining an executive reaction time distribution corresponding to the reaction test action;

[0023] evaluating the executive reaction ability of the wearer according to the executive reaction time distribution and the executive reaction time to obtain an executive reaction ability evaluation result of the wearer.

[0024] In an embodiment, the method further comprises:

[0025] weighting and fusing the cognitive reaction ability evaluation result and the executive reaction ability evaluation result to obtain a comprehensive reaction ability evaluation result of the wearer.

[0026] In an embodiment, the target body surface area includes a temporal branch nerve surface projection area, the bioelectric signal detection module includes a neural electric signal detection unit, and the reaction test action detection module includes an eye movement detection camera, wherein the neural electric signal detection unit is in contact with the temporal branch nerve surface projection area when the head-mounted device is in a wearing state;

[0027] In the case where the reaction test action is a blinking action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area and determining a signal change time of the bioelectric signal change comprises:

[0028] detecting, by the neural electric signal detection unit, a neural electric signal change caused by the wearer performing the blinking action at the temporal branch nerve surface projection area and determining a signal change time of the neural electric signal change;

[0029] In the case where the reaction test action is a blinking action, the step of determining, by the reaction test action detection module, an action completion time of the wearer performing the reaction test action comprises:

[0030] determining, by the eye movement detection camera, an action completion time of the wearer performing the blinking action.

[0031] In an embodiment, the target body surface area includes a temporal muscle surface projection area, the bioelectric signal detection module includes a muscle electric signal detection unit, and the reaction test action detection module includes a mouth movement detection camera, wherein the muscle electric signal detection unit is in contact with the temporal muscle surface projection area when the head-mounted device is in a wearing state;

[0032] In the case where the reaction test action is a closed action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area, and determining a signal change time of the bioelectric signal change, comprises:

[0033] detecting, by the muscle electric signal detection unit, a muscle electric signal change caused by the wearer performing the closed action at the temporal muscle body surface projection area, and determining a signal change time of the muscle electric signal change;

[0034] The step of determining, by the reaction test action detection module, an action completion time of the wearer performing the reaction test action, comprises:

[0035] determining, by the mouth action detection camera, an action completion time of the wearer performing the closed action.

[0036] In addition, to achieve the above object, the present application also provides a head-mounted device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the reaction ability evaluation method as described above.

[0037] In addition, to achieve the above object, the present application also provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the reaction ability evaluation method as described above.

[0038] In addition, to achieve the above object, the present application also provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to implement the steps of the reaction ability evaluation method as described above.

[0039] The application provides a reaction ability evaluation method, a head-mounted device and a computer readable storage medium, relates to the technical field of head-mounted devices, and the reaction ability evaluation method is applied to the head-mounted device. The head-mounted device comprises a prompt output module, a bioelectric signal detection module and a reaction test action detection module. When the head-mounted device is in a wearing state, the bioelectric signal detection module is connected to a target body surface area of a wearer. The method comprises the following steps: the prompt output module outputs prompt information corresponding to at least one reaction test action, and the prompt output time of the prompt information is determined. The prompt information is used to prompt the wearer to perform the reaction test action. The bioelectric signal detection module detects a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area, and the signal change time of the bioelectric signal change is determined. The reaction test action detection module determines the action completion time of the wearer performing the reaction test action. The cognitive reaction ability of the wearer is evaluated based on the prompt output time and the signal change time, and the cognitive reaction ability evaluation result of the wearer is obtained. The execution reaction ability of the wearer is evaluated based on the signal change time and the action completion time, and the execution reaction ability evaluation result of the wearer is obtained.

[0040] The reaction ability evaluation method provided by the application realizes fine and layered evaluation of the reaction ability of a wearer through the prompt output module, the bioelectric signal detection module and the reaction test action detection module integrated in the head-mounted device. Specifically, in the test process, the system first presents visual or aural prompt information related to the reaction test action to the wearer through the prompt output module, and records the prompt output time. Then, the bioelectric signal detection module detects the bioelectric signal change of the target body surface area (such as the body surface projection area of the temporal branch nerve and the body surface projection area of the temporal muscle) of the wearer in real time when the wearer receives the prompt and prepares to perform the action, so as to determine the signal change time of the neuromuscular activation. At the same time, the reaction test action detection module is used to capture the time point at which the wearer actually completes the specified action, that is, the action completion time. Based on the above three time nodes: the prompt output time, the signal change time and the action completion time, the method can evaluate the reaction ability from two dimensions of the cognitive stage and the execution stage. The time interval from the prompt output to the bioelectric signal change reflects the cognitive processing speed and decision-making ability of the wearer, which belongs to the cognitive reaction ability evaluation index. The time interval from the bioelectric signal change to the action completion reflects the movement execution efficiency and action coordination of the wearer, which belongs to the execution reaction ability evaluation index. This method of decomposing the overall reaction time into two sub-processes of cognition and execution breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes multi-level and fine-grained analysis of the reaction ability.

[0041] The beneficial technical effects of the present application are: on the one hand, by introducing bioelectric signal detection technology, the neuromuscular activation signal of the wearer before obvious limb movement is generated after receiving the stimulus can be accurately captured, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of the reaction ability evaluation; on the other hand, since the entire test process relies on the head-mounted device to realize, it has good immersion and interactivity, and is convenient for popularization and application in virtual reality training, professional ability evaluation, rehabilitation monitoring and other scenes, and has strong practicality and scalability; in addition, the method can complete multi-modal data acquisition and synchronous analysis without relying on external independent devices, simplifies the test process, improves the evaluation efficiency, and helps to promote the reaction ability evaluation technology to be intelligent and portable. BRIEF DESCRIPTION OF DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and serve to explain the principles of the present application together with the specification.

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those skilled in the art, other drawings can also be obtained based on these drawings without creative labor.

[0044] Figure 1 The flowchart provided for the first embodiment of the reaction ability evaluation method of the present application;

[0045] Figure 2 The structural diagram of the intelligent glasses in a specific embodiment of the present application;

[0046] Figure 3 The wearing state diagram of the intelligent glasses in a specific embodiment of the present application;

[0047] Figure 4 The device structure diagram of the hardware running environment involved in the reaction ability evaluation method in the embodiment of the present application.

[0048] The purpose of the present application, functional characteristics and advantages will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application, and are not used to limit the present application.

[0050] Currently, the traditional reaction ability evaluation method usually relies on manual observation or uses simple external devices to record the total time of a user from receiving a stimulus (such as a visual or auditory prompt) to completing a specified action. For example, after a visual prompt is output through a screen or a sound prompt is played through a loudspeaker, the time interval of the user responding to the prompt and completing the corresponding action is recorded as the basis for evaluating the reaction ability of the user.

[0051] However, this traditional reaction ability evaluation method can only obtain the overall reaction time and cannot evaluate the cognitive reaction ability and the execution reaction ability of the user in a fine-grained manner.

[0052] By contrast, the solution of the embodiments of the present application is a reaction ability evaluation method applied to a head-mounted device, the head-mounted device comprising a prompt output module, a bioelectric signal detection module, and a reaction test action detection module, wherein the bioelectric signal detection module is in contact with a target body surface area of a wearer when the head-mounted device is in a wearing state, and the method comprises: outputting, through the prompt output module, prompt information corresponding to at least one reaction test action and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, through the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area and determining a signal change time of the bioelectric signal change; determining, through the reaction test action detection module, an action completion time of the wearer performing the reaction test action; evaluating the cognitive reaction ability of the wearer based on the prompt output time and the signal change time to obtain a cognitive reaction ability evaluation result of the wearer; and evaluating the execution reaction ability of the wearer based on the signal change time and the action completion time to obtain an execution reaction ability evaluation result of the wearer.

[0053] The reaction ability evaluation method provided in the application realizes fine and layered evaluation of the reaction ability of the wearer by integrating the prompt output module, the bioelectric signal detection module and the reaction test action detection module in the head-mounted device. Specifically, in the test process, the system first presents visual or aural prompt information related to the reaction test action to the wearer through the prompt output module, and records the prompt output time; then, the bioelectric signal detection module detects the bioelectric signal change generated by the target body surface area (such as the temporal branch nerve body surface projection area, the temporal muscle body surface projection area, etc.) of the wearer when the wearer receives the prompt and prepares to perform the action, so as to determine the signal change time of the neuromuscular activation; at the same time, the reaction test action detection module is used to capture the time point at which the wearer actually completes the specified action, i.e. the action completion time. Based on the above three time nodes: the prompt output time, the signal change time and the action completion time, the method can evaluate the reaction ability from two dimensions of the cognitive stage and the execution stage. Among them, the time interval from the prompt output to the bioelectric signal change reflects the cognitive processing speed and decision-making ability of the wearer, which belongs to the cognitive reaction ability evaluation index; and the time interval from the bioelectric signal change to the action completion reflects the movement execution efficiency and action coordination of the wearer, which belongs to the execution reaction ability evaluation index. This method of decomposing the overall reaction time into two sub-processes of cognition and execution breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes multi-level and fine-grained analysis of the reaction ability.

[0054] The beneficial technical effects of the application are as follows: on the one hand, by introducing bioelectric signal detection technology, the neuromuscular activation signal of the wearer before obvious limb action is generated after receiving the stimulus can be accurately captured, so that the time contribution of the cognitive and execution stages is effectively distinguished, and the scientificity and accuracy of the reaction ability evaluation are significantly improved; on the other hand, since the whole test process is realized by relying on the head-mounted device, it has good immersion and interactivity, is convenient for popularization and application in various scenes such as virtual reality training, professional ability evaluation and rehabilitation monitoring, has strong practicality and expandability; in addition, the method can complete multi-modal data acquisition and synchronous analysis without relying on external independent devices, simplifies the test process, improves the evaluation efficiency, and helps to promote the development of reaction ability evaluation technology in the direction of intelligence and portability.

[0055] The head-mounted device in the embodiments of the present application can include, but is not limited to, a head-mounted display device such as a Mixed Reality (MR) device (for example, MR glasses or an MR helmet), an Augmented Reality (AR) device (for example, AR glasses or an AR helmet), a Virtual Reality (VR) device (for example, VR glasses or a VR helmet), an Extended Reality (XR) device, or some combination thereof. In the embodiments, for ease of description, the following is described with the head-mounted device as the execution subject.

[0056] In order to better understand the technical solutions of the present application, the following will be described in detail in combination with the drawings of the specification and specific embodiments.

[0057] The present application proposes a reaction ability evaluation method of the first embodiment.

[0058] Please refer to Figure 1 , Figure 1 The flowchart provided for the reaction ability evaluation method of the first embodiment of the present application.

[0059] In the embodiments, the reaction ability evaluation method is applied to a head-mounted device, the head-mounted device includes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module, wherein the bioelectric signal detection module is in contact with a target body surface area of the wearer when the head-mounted device is in a wearing state, and the method can include steps S100-S500:

[0060] Step S100, output prompt information corresponding to at least one reaction test action through the prompt output module, and determine the prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action;

[0061] As known by those skilled in the art, bioelectric signals refer to the total of electrical activity signals generated by living tissues (such as nerves, muscles, skin, etc.), mainly including neural electrical signals, muscle electrical signals, and skin electrical signals, etc. Among them, neural electrical signals specifically refer to the potential changes generated when information is transmitted between neurons or within neurons, mainly including EEG (Electroencephalogram, electroencephalogram) for recording brain neural activity, and ENG (Electroneurography, Electroneurography) for recording peripheral nerve activity. Muscle electrical signals, also known as electromyography, are electrical activity recorded from muscle cells, which can be recorded by invasive or non-invasive electrodes, for example, surface electromyography (sEMG, Surface Electromyography) recorded by electrodes placed on the skin surface, and needle electromyography recorded by electrodes inserted into the muscle.

[0062] In the embodiment, the bioelectric signal detection module is used to detect the change of bioelectric signal, mainly including detecting the change of neural electric signal in the form of ENG and detecting the change of muscle electric signal in the form of sEMG.

[0063] It should be noted that, in the embodiment, the reaction test action refers to an action designed for evaluating the reaction ability of the wearer in the use scenario of the head-mounted device. When the head-mounted device is in the wearing state, the change of bioelectric signal caused by the wearer performing the reaction test action can be detected from a certain body surface area of the wearer in contact with the head-mounted device. The body surface area in contact with the head-mounted device and capable of detecting the change of bioelectric signal caused by the wearer performing the reaction test action through the bioelectric signal detection module is the target body surface area.

[0064] For example, when the reaction test action is an eye reaction test action, taking blinking as an example, the neural impulse sent by the brain is transmitted to the orbicularis oculi muscle through the temporal branch of the facial nerve, causing the contraction and relaxation of the orbicularis oculi muscle, thereby completing the blinking action. Thus, when the wearer performs the blinking action, the temporal branch of the facial nerve will have neural electric signal transmission, i.e., there will be a change in neural electric signal. Therefore, the projection area of the temporal branch of the facial nerve on the body surface (hereinafter referred to as the temporal branch of the facial nerve body surface projection area) can be used as the target body surface area, and the neural electric signal detection unit in the bioelectric signal detection module, which is specially used to detect the change of peripheral neural electric signal from the body surface, is arranged to be in contact with the temporal branch of the facial nerve body surface projection area of the wearer when the head-mounted device is in the wearing state. Thus, through the neural electric signal detection unit, the change of neural electric signal caused by the wearer performing the blinking action can be detected in the temporal branch of the facial nerve body surface projection area, and the signal change time of the change of neural electric signal can be determined, so as to divide the cognitive stage and the execution stage when the wearer performs the blinking action, and further to finely stratify the evaluation of the reaction ability of the wearer's eyes.

[0065] It should be further noted that, in the embodiment, the prompt output module refers to a component for outputting visual or auditory stimulation signals (i.e., prompt information corresponding to the reaction test action) to the wearer, which is usually integrated in the head-mounted device, such as a display screen or a speaker. Its function is to provide clear and identifiable action trigger signals (i.e., prompt information corresponding to the reaction test action) to the wearer to guide him / her to perform the preset reaction test action. The prompt information can be in the form of text, image, sound or combination thereof, and its content corresponds to the reaction test action to be performed. The prompt output time refers to the time point when the prompt information is output to the wearer, which is used as the time starting point of the entire reaction test process for subsequent calculation of the time interval between the cognitive stage and the execution stage.

[0066] It needs to be particularly pointed out that in the present embodiment, the prompt output module outputs the prompt information corresponding to at least one reaction test action and records the prompt output time corresponding to each prompt information, and accordingly, in the subsequent step S200, the bioelectric signal detection module determines the signal change time of the bioelectric signal change caused by each reaction test action, and in step S300, the reaction test action detection module also determines the action completion time of each reaction test action, so that in steps S400 and S500, the cognitive reaction ability and the execution reaction ability of the wearer are comprehensively and deeply evaluated according to the prompt output time, the signal change time and the action completion time corresponding to each reaction test action.

[0067] In step S200, the bioelectric signal detection module detects the bioelectric signal change caused by the wearer performing the reaction test action on the target body surface area and determines the signal change time of the bioelectric signal change.

[0068] In the present embodiment, the bioelectric signal detection module is arranged inside the head-mounted device, and when the user wears the head-mounted device, the bioelectric signal detection module is in contact with the target body surface area of the wearer, so that the bioelectric signal change caused by the wearer performing the reaction test action can be non-invasively detected, and the signal change time of the bioelectric signal change is determined, so as to divide the cognitive stage and the execution stage of the wearer performing the reaction test action according to the signal change time, and further to finely stratify the evaluation of the reaction ability of the wearer.

[0069] In the present embodiment, the bioelectric signal change caused by the wearer performing the reaction test action refers to the bioelectric signal fluctuation caused by neural excitation and muscle pre-activation before obvious body movement is generated after the wearer receives the prompt information. This signal change occurs earlier than the actual action, reflecting the response speed and decision-making process of the central nervous system to external stimuli.

[0070] The present embodiment introduces a bioelectric signal change detection mechanism at the physiological level, so that the reaction ability evaluation is no longer dependent on external behavior, but can be deeply activated at the neuromuscular level, thereby realizing the fine capture of the whole process of "perceiving stimulus → cognitive decision → executing action".

[0071] In step S300, the reaction test action detection module determines the action completion time of the wearer performing the reaction test action.

[0072] It should be noted that in the present embodiment, the reaction test action detection module refers to a sensor component integrated in the head-mounted device, which is used to accurately detect whether the wearer has completed the specified reaction test action, and determine the specific time of action completion (i.e. action completion time). These sensors can include but are not limited to cameras, infrared sensors, microphones, etc.

[0073] In the present embodiment, the reaction test action is mainly divided into three categories: eye reaction test action, mouth reaction test action and vocalization reaction test action. Among them, the eye reaction test action refers to the reaction test action made by eye movement, blinking, gaze direction change or eyelid opening change, etc. The mouth reaction test action refers to the reaction test action completed by the coordinated movement of the lips, jaw, tongue, teeth, etc. The vocalization reaction test action refers to the reaction test action of emitting voice signals through vocal cord vibration and oral cavity resonance system.

[0074] It is not difficult to understand that when the reaction test action performed by the wearer is the eye reaction test action, the camera or infrared sensor responsible for detecting eye action in the reaction test action detection module is called to determine the action completion time corresponding to the eye reaction test action. When the reaction test action performed by the wearer is the mouth reaction test action, the camera or infrared sensor responsible for detecting mouth action in the reaction test action detection module is called to determine the action completion time corresponding to the mouth reaction test action. Correspondingly, when the reaction test action performed by the wearer is the vocalization reaction test action, the microphone responsible for detecting sound in the reaction test action detection module is called to determine the action completion time corresponding to the vocalization reaction test action.

[0075] It should be noted that similar to the eye reaction test action, when the reaction test action is the mouth reaction test action, for example, the brain's nerve impulse will be transmitted to the temporal muscle, which is one of the main closing muscles, to promote the contraction of the temporal muscle and generate force to move the mandible upward and backward, thereby realizing the closing action. Therefore, when the wearer performs the closing action, the muscle electrical signal of the temporal muscle will change, so the projection area of the temporal muscle on the body surface (hereinafter referred to as the temporal muscle body surface projection area) can be used as the target body surface area, and the muscle electrical signal detection unit in the bioelectric signal detection module, which is specially used to detect the muscle electrical signal changes from the body surface, is set to be in contact with the temporal muscle body surface projection area of the wearer when the head-mounted device is in the wearing state. Thus, through the muscle electrical signal detection unit, the muscle electrical signal changes caused by the wearer performing the closing action are detected in the temporal muscle body surface projection area, and the signal change time of the muscle electrical signal changes is determined, so as to divide the cognitive stage and the execution stage of the wearer performing the closing action, and further to finely stratify the evaluation of the reaction ability of the wearer's mouth.

[0076] It can be understood that each specific reaction test action in the above three categories of reaction test actions corresponds to a part of the muscles and / or nerves related to the head or face, so the projection area of these muscles and / or nerves on the body surface can be taken as the target body surface area, and the neural electrical signal detection unit and / or muscle electrical signal detection unit can be correspondingly arranged in the head-mounted device, so that when the wearer performs a certain reaction test action, the bioelectrical signal detection module detects the bioelectrical signal change in the target body surface area corresponding to the reaction test action, thereby dividing the cognitive stage and execution stage of the wearer when performing the reaction test action, and further performing fine hierarchical evaluation on the cognitive reaction ability and execution reaction ability of the wearer.

[0077] In step S400, the cognitive reaction ability of the wearer is evaluated based on the prompt output time and the signal change time, and a cognitive reaction ability evaluation result of the wearer is obtained.

[0078] In this embodiment, the cognitive reaction ability refers to the information processing efficiency between receiving external stimulation and the activation of the neuromuscular system, covering multiple psychological processes such as perception, judgment, and decision-making. The cognitive reaction ability can be used as an ability index to measure the individual's cognitive processing speed, decision-making efficiency, and attention concentration degree, and directly reflects the individual's attention concentration degree, information processing speed, and reaction preparation level. The cognitive reaction ability evaluation result refers to the result obtained by evaluating the cognitive reaction ability of the individual based on the time difference between the individual receiving the prompt information and the neuromuscular system of the individual starting to produce detectable bioelectrical signal changes.

[0079] For example, in a feasible implementation, step S400 can include steps S410-S420:

[0080] In step S410, the cognitive reaction time of the wearer performing the reaction test action is calculated according to the prompt output time and the signal change time.

[0081] In step S420, the cognitive reaction ability of the wearer is evaluated according to the cognitive reaction time, and a cognitive reaction ability evaluation result of the wearer is obtained.

[0082] By comparing the "prompt output time" with the "signal change time", the embodiment can obtain the time difference between the wearer's perception of the prompt information and the activation of the neuromuscular system, i.e. the cognitive reaction time. The shorter the cognitive reaction time, the higher the cognitive processing efficiency and the stronger the cognitive reaction ability of the wearer.

[0083] It is understandable that in the embodiment, the prompt output module outputs the prompt information corresponding to the at least one reaction test action, and accordingly, the cognitive reaction time of the wearer performing each reaction test action is calculated according to the prompt output time and the signal change time corresponding to each reaction test action, so that when step S420 is performed, according to the actual setting, the cognitive reaction ability of each reaction test action can be evaluated once to obtain the cognitive reaction ability evaluation result of the wearer performing each reaction test action, or according to the three types of reaction test actions, the average cognitive reaction time of each type of reaction test action is counted, and then the cognitive reaction ability of each type of reaction test action is evaluated once to obtain the cognitive reaction ability evaluation result of the wearer performing each type of reaction test action, or after each reaction test action is evaluated once to obtain the cognitive reaction ability evaluation result of the wearer performing each reaction test action, the cognitive reaction ability evaluation results corresponding to each reaction test action are integrated or weighted, so as to obtain the overall cognitive reaction ability evaluation result of the wearer. The embodiment does not make specific limitation on this, and the evaluation method of cognitive reaction ability can be flexibly set according to actual needs.

[0084] It is worth mentioning that in the embodiment, when the user performs the reaction ability evaluation through the head-mounted device, the user can actively select a type of the three types of reaction test actions, or even a specific reaction test action for reaction ability evaluation, or randomly cover all reaction test actions for reaction ability evaluation.

[0085] Step S500, based on the signal change time and the action completion time, the execution reaction ability of the wearer is evaluated to obtain the execution reaction ability evaluation result of the wearer.

[0086] In the embodiment, the execution reaction ability refers to the movement execution efficiency between the activation of the neuromuscular system and the actual completion of the specified action, which covers muscle contraction, action coordination, force control and other aspects. The execution reaction ability can be used as an ability index for measuring the cognitive processing speed, decision efficiency and attention concentration of individuals to external stimuli, and directly reflects the movement control accuracy and body coordination of individuals. The execution reaction ability evaluation result refers to the result obtained by evaluating the execution reaction ability of an individual based on the time difference between the generation of a detectable bioelectric signal change from the neuromuscular system of the individual and the actual completion of the specified reaction test action.

[0087] Exemplarily, in a feasible embodiment, step S500 can include steps S510-S520:

[0088] Step S510, according to the signal change time and the action completion time, the execution reaction time of the wearer performing the reaction test action is calculated;

[0089] Step S520, according to the execution reaction time, the execution reaction ability of the wearer is evaluated, and the execution reaction ability evaluation result of the wearer is obtained.

[0090] By comparing the "signal change time" with the "action completion time", the embodiment can obtain the time difference between the neuromuscular activation and the action completion of the wearer, that is, the execution reaction time. The shorter and more stable the execution reaction time is, the higher the motion execution efficiency of the wearer is, and the stronger the execution reaction ability is.

[0091] Similar to the embodiment mentioned in the above step S400, when the execution reaction ability is evaluated, if the prompt output module outputs the prompt information corresponding to the plurality of reaction test actions, the execution reaction time of the wearer performing each reaction test action needs to be calculated, so that when step S520 is performed, the execution reaction ability of the wearer is evaluated according to the actual setting, which is not described herein, and can be referred to the foregoing embodiment.

[0092] The reaction ability evaluation method proposed in this embodiment realizes the fine and layered evaluation of the reaction ability of the wearer through the prompt output module, the bioelectric signal detection module and the reaction test action detection module integrated in the head-mounted device. Specifically, in the test process, the system first presents the visual or auditory prompt information related to the reaction test action to the wearer through the prompt output module, and records the prompt output time; then, the bioelectric signal detection module detects the bioelectric signal change generated by the target body surface area (such as the body surface projection area of the temporal branch nerve, the body surface projection area of the temporal muscle, etc.) of the wearer when the wearer receives the prompt and prepares to perform the action, so as to determine the signal change time of the neuromuscular activation; at the same time, the reaction test action detection module is used to capture the time point when the wearer actually completes the specified action, that is, the action completion time. Based on the above three time nodes: prompt output time, signal change time and action completion time, the method can evaluate the reaction ability from two dimensions of cognitive stage and execution stage. Among them, the time interval from the prompt output to the bioelectric signal change reflects the cognitive processing speed and decision-making ability of the wearer, which belongs to the cognitive reaction ability evaluation index; and the time interval from the bioelectric signal change to the action completion reflects the motion execution efficiency and action coordination of the wearer, which belongs to the execution reaction ability evaluation index. This method of decomposing the whole reaction time into two sub-processes of cognition and execution breaks through the limitation of traditional evaluation methods that can only obtain the total reaction time, and realizes the multi-level and fine-grained analysis of the reaction ability.

[0093] The beneficial technical effects of the embodiment are: on the one hand, by introducing bioelectric signal detection technology, the neuromuscular activation signal of the wearer before obvious body movement is generated after receiving the stimulus can be accurately captured, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of the reaction ability evaluation; on the other hand, since the entire test process relies on the head-mounted device to realize, it has good immersion and interactivity, and is convenient for popularization and application in virtual reality training, professional ability evaluation, rehabilitation monitoring and other scenes, and has strong practicality and scalability; in addition, the method can complete multi-modal data acquisition and synchronous analysis without relying on external independent devices, simplifying the test process, improving the evaluation efficiency, and helping to promote the development of reaction ability evaluation technology towards intelligence and portability.

[0094] In a feasible implementation, step S420 evaluates the cognitive reaction ability of the wearer according to the cognitive reaction time, and obtains the cognitive reaction ability evaluation result of the wearer, which can include steps S421-S422:

[0095] Step S421 obtains the cognitive reaction time distribution corresponding to the reaction test action;

[0096] It should be noted that in the present embodiment, the cognitive reaction time distribution refers to the statistical distribution of the cognitive reaction time of all individuals within a certain sample range for a specific reaction test action. The cognitive reaction time distribution is usually obtained through large-scale data collection and analysis, and covers the time difference between receiving the prompt information and the neuromuscular system starting to produce detectable bioelectric signal changes. These data can come from people of different ages, genders, health conditions, races, occupations, etc., to ensure that the distribution is representative and can reflect the characteristics of different groups of people.

[0097] It is worth noting that the cognitive reaction time distribution is not only a simple calculation of the average value, but also includes statistical quantities such as standard deviation and percentile, to describe the variability of the cognitive reaction speed of the entire group when performing a specific reaction test action.

[0098] The present embodiment can statistically obtain the cognitive reaction time distribution of different groups of people for different reaction test actions in advance, so that in actual application, according to the group setting or personal information (including at least one of age information, gender information, race information, occupation information, health condition information, etc.) of the wearer, the target group is determined, and then in step S421, the cognitive reaction time distribution of the target group for a specific reaction test action is obtained.

[0099] Step S422 evaluates the cognitive reaction ability of the wearer according to the cognitive reaction time distribution and the cognitive reaction time, and obtains the cognitive reaction ability evaluation result of the wearer.

[0100] The embodiment can more accurately locate the wearer in the target population by comparing the cognitive reaction time of the individual wearer with the cognitive reaction time distribution of the target population, and further make a scientific evaluation on the cognitive reaction ability. Specifically, first, the cognitive reaction time distribution obtained in step S421 is used as a reference benchmark, and then the cognitive reaction time of the current wearer is compared and analyzed in this distribution framework. This step not only considers the absolute reaction speed of the wearer in the cognitive stage (i.e., cognitive reaction time), but also considers the relative performance of the wearer in the cognitive stage relative to the same type of population.

[0101] The embodiment takes into account the differences in cognitive reaction ability among different populations, by introducing the concept of cognitive reaction time distribution, so that the evaluation of the cognitive reaction ability of each wearer is no longer isolated, but based on a wide range of data background, thereby supporting more personalized reaction ability evaluation services, making the cognitive reaction ability evaluation results more practical, and more accurate and reliable.

[0102] In a feasible embodiment, the step S520 of evaluating the execution reaction ability of the wearer according to the execution reaction time to obtain the execution reaction ability evaluation result of the wearer can include steps S521-S522:

[0103] Step S521, obtaining an execution reaction time distribution corresponding to the reaction test action;

[0104] It should be noted that in the embodiment, the execution reaction time distribution refers to the statistical distribution of the execution reaction time of all individuals within a certain sample range for a specific reaction test action. This execution reaction time distribution is usually obtained through large-scale data collection and analysis, covering the time difference between the start of the neuromuscular system to produce detectable bioelectric signal changes and the actual completion of the specified reaction test action. These data can come from people of different ages, genders, health conditions, races, occupations, etc. to ensure that the distribution is representative and can reflect the characteristics of different populations.

[0105] It is worth noting that the execution reaction time distribution is not only a simple calculation of the average value, but also includes statistical quantities such as standard deviation and percentile to describe the variability of the execution reaction speed of the entire population when performing a specific reaction test action.

[0106] The embodiment can statistically obtain the execution reaction time distribution of different populations for different reaction test actions in advance, so that in actual application, the target population is determined according to the population setting or personal information (including at least one of age information, gender information, race information, occupation information, health status information, etc.) of the wearer, and then the execution reaction time distribution of the target population for a specific reaction test action is obtained when the step S421 is executed.

[0107] In step S522, the execution reaction ability of the wearer is evaluated according to the execution reaction time distribution and the execution reaction time, and the execution reaction ability evaluation result of the wearer is obtained.

[0108] The embodiment can more accurately locate the position of the wearer in the target population by comparing the execution reaction time of the single wearer with the execution reaction time distribution of the target population, and then scientifically evaluate the execution reaction ability of the wearer. Specifically, the execution reaction time distribution obtained in step S521 is used as a reference benchmark, and then the execution reaction time of the current wearer is compared and analyzed in this distribution framework. This step not only considers the absolute reaction speed of the wearer in the execution phase (i.e., the execution reaction time), but also considers the relative performance of the wearer in the execution phase relative to the same type of population.

[0109] The embodiment considers the differences in execution reaction ability of different populations, introduces the concept of execution reaction time distribution, so that the execution reaction ability evaluation of each wearer is no longer isolated, but is based on extensive data background, thereby supporting more personalized reaction ability evaluation service, so that the execution reaction ability evaluation result is more practical and more accurate and reliable.

[0110] In a feasible embodiment, the reaction ability evaluation method can further include step S600:

[0111] In step S600, the cognitive reaction ability evaluation result and the execution reaction ability evaluation result are weighted and fused to obtain the comprehensive reaction ability evaluation result of the wearer.

[0112] When the reaction ability of the wearer is comprehensively evaluated, steps S400 and S500 respectively provide detailed evaluation results from the dimensions of cognitive reaction ability and execution reaction ability. However, in actual application, a comprehensive index is often needed to comprehensively reflect the overall reaction ability of the individual.

[0113] Therefore, the embodiment proposes step S600, that is, the cognitive reaction ability evaluation result and the execution reaction ability evaluation result are weighted and fused to obtain the comprehensive reaction ability evaluation result of the wearer.

[0114] Those skilled in the art can know that the weighted fusion refers to combining the evaluation results of different sources or types according to a preset weight distribution scheme to form a more comprehensive and balanced final evaluation result.

[0115] In this embodiment, the objects of the weighted fusion are the cognitive reaction ability evaluation result from step S400 and the executive reaction ability evaluation result from step S500.

[0116] Specifically, the weighted fusion can be realized by the following formula:

[0117] The comprehensive reaction ability evaluation result = w1 x cognitive reaction ability evaluation result + w2 x executive reaction ability evaluation result.

[0118] Wherein, w1 is the weight of cognitive reaction ability in comprehensive evaluation, w2 is the weight of executive reaction ability in comprehensive evaluation, and w1 + w2 = 1.

[0119] The selection of the weight can be adjusted according to the specific needs of the application scene, for example, for the application scene that emphasizes rapid decision-making, the value of w1 can be appropriately increased; and for the application that pays more attention to the action execution efficiency, the proportion of w2 can be increased.

[0120] It is worth mentioning that considering that the proportion of cognitive reaction ability and executive reaction ability in the composition of comprehensive reaction ability is different for people of different genders at different ages, when setting the values of w1 and w2, the age information and / or gender information of the wearer need to be adjusted.

[0121] The present embodiment provides a more comprehensive reaction ability evaluation system by the method of weighted fusion, which not only considers the performance of the wearer in the cognitive stage, but also considers the efficiency of the wearer in the execution stage.

[0122] Based on the above first embodiment, the present application proposes a reaction ability evaluation method of the second embodiment.

[0123] In the second embodiment of the present application, the same or similar contents as the above embodiments can be referred to the above introduction, and will not be described in detail hereinafter.

[0124] In this embodiment, the target body surface area includes the temporal branch nerve body surface projection area, the bioelectric signal detection module includes a neural electric signal detection unit, and the reaction test action detection module includes an eye action detection camera, wherein when the head-mounted device is in a wearing state, the neural electric signal detection unit is connected with the temporal branch nerve body surface projection area.

[0125] In the case where the reaction test action is the blinking action, the step S200 of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action on the target body surface area and determining a signal change time of the bioelectric signal change can include a step S210 of:

[0126] The step S210 includes detecting, by the neural electric signal detection unit, a neural electric signal change caused by the wearer performing the blinking action on the temporal branch nerve surface projection area and determining a signal change time of the neural electric signal change.

[0127] In the case where the reaction test action is the blinking action, the step S300 of determining, by the reaction test action detection module, an action completion time of the wearer performing the reaction test action can include a step S310 of:

[0128] The step S310 includes determining, by the eye movement detection camera, an action completion time of the wearer performing the blinking action.

[0129] In the embodiment, when the reaction test action is the blinking action, the neural impulse emitted by the brain is transmitted to the orbicularis oculi muscle through the temporal branch of the facial nerve, causing the contraction and relaxation of the orbicularis oculi muscle, thereby completing the blinking action. Thus, when the wearer performs the blinking action, the temporal branch of the facial nerve will have a neural electric signal transmission, i.e., a neural electric signal change. Therefore, the projection area of the temporal branch nerve on the body surface (i.e., the temporal branch nerve surface projection area) can be used as the target body surface area, and the neural electric signal detection unit (which can be implemented by an ENG electrode) in the bioelectric signal detection module that is specifically used to detect the peripheral neural electric signal change from the body surface can be arranged to be in contact with the temporal branch nerve surface projection area of the wearer when the head-mounted device is in the wearing state. Thus, the neural electric signal detection unit can be used to detect the neural electric signal change caused by the wearer performing the blinking action on the temporal branch nerve surface projection area and determine a signal change time of the neural electric signal change, so as to divide the cognitive stage and the execution stage of the wearer performing the blinking action, and further perform a fine layered evaluation on the reaction ability of the wearer's eye.

[0130] Based on the first embodiment, the present application proposes a reaction ability evaluation method of a third embodiment.

[0131] In the third embodiment of the present application, the same or similar contents as the above embodiments can be referred to the above introduction, and will not be described in detail hereinafter.

[0132] In the embodiment, the target body surface area includes the temporal muscle surface projection area, the bioelectric signal detection module includes the muscle electric signal detection unit, and the reaction test action detection module includes the mouth movement detection camera. When the head-mounted device is in the wearing state, the muscle electric signal detection unit is in contact with the temporal muscle surface projection area.

[0133] In the case where the reaction test action is the closing action, step S200 detects, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action on the target body surface area, and determines a signal change time of the bioelectric signal change, and can further include step S220:

[0134] Step S220 detects, by the muscle electric signal detection unit, a muscle electric signal change caused by the wearer performing the closing action on the temporalis muscle body surface projection area, and determines a signal change time of the muscle electric signal change;

[0135] In the case where the reaction test action is the closing action, step S300 determines, by the reaction test action detection module, an action completion time of the wearer performing the reaction test action, and can further include step S320:

[0136] Step S320 determines, by the mouth action detection camera, an action completion time of the wearer performing the closing action.

[0137] In the embodiment, when the reaction test action is the closing action, the nerve impulse sent by the brain is transmitted to the temporalis muscle which is one of the main closing muscles, prompting the temporalis muscle to contract and generate power to move the mandible upward and backward, thereby realizing the closing action. Therefore, when the wearer performs the closing action, the muscle electric signal of the temporalis muscle changes, so the projection area of the temporalis muscle on the body surface (i.e. the temporalis muscle body surface projection area) can be taken as the target body surface area, and the muscle electric signal detection unit (which can be realized by an EMG electrode or an ENG electrode) in the bioelectric signal detection module which is specially used to detect the muscle electric signal change from the body surface can be set to be in contact with the temporalis muscle body surface projection area of the wearer when the head-mounted device is in the wearing state, so that the muscle electric signal detection unit detects the muscle electric signal change caused by the wearer performing the closing action on the temporalis muscle body surface projection area, and determines the signal change time of the muscle electric signal change, so as to divide the cognitive stage and the execution stage of the wearer performing the closing action, and further to perform fine layered evaluation on the reaction ability of the wearer's mouth.

[0138] In order to facilitate understanding of the reaction ability evaluation method in the above embodiments of the present application, a specific embodiment is listed:

[0139] As shown in Figure 2 In the specific embodiment, the head-mounted device can be smart glasses, which include a reaction test action detection module composed of two cameras arranged on the lower sides of the left and right frames and a MIC (Microphone) arranged on the lower side of the nose pad, a prompt output module composed of a display area arranged on the lens and a loudspeaker arranged on the two side legs, and a bioelectric signal detection module composed of electrodes arranged on the inner side of the legs.

[0140] As shown in Figure 3 the embodiment, when the smart glasses are in the wearing state, the electrode is in contact with the surface projection area of the temporal branch nerve and the surface projection area of the temporal muscle of the wearer, so that when the reaction test action is a blinking action or a mouth closing action, the electrode can detect the change of the nerve electrical signal or the muscle electrical signal caused by the wearer performing the reaction test action in the target surface area, and determine the corresponding signal change time. At the same time, when the reaction test action is an eye reaction test action such as a blinking action, the camera arranged on the lower side of the frame can determine the corresponding action completion time.

[0141] It should be noted that the above embodiments are only used to assist in understanding the present application and do not constitute a limitation on the reaction ability evaluation method of the present application. Based on this technical concept, more forms of simple transformation are within the protection scope of the present application.

[0142] In addition, please refer to Figure 4 , Figure 4 the device structure diagram of the hardware running environment involved in the reaction ability evaluation method in the embodiment of the present application.

[0143] The present application also provides a head-mounted device, which comprises: at least one processor; and a memory in communication connection with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the reaction ability evaluation method in the above embodiment.

[0144] The head-mounted device in the embodiment of the present application can include but is not limited to a head-mounted display device such as a Mixed Reality (MR) glasses, an Augmented Reality (AR) glasses, a Virtual Reality (VR) glasses, an Extended Reality (XR) glasses or some combination thereof.

[0145] Reference is made to Figure 4 , which shows a structure diagram of a head-mounted device suitable for implementing the embodiment of the present application. Figure 4 The head-mounted device shown is only an example and should not impose any limitation on the function and use range of the embodiment of the present application.

[0146] As shown in Figure 4As shown, the head-mounted device can include a processing device 1001 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to programs stored in a read-only memory 1002 or loaded from a storage device 1003 into a random access memory 1004. Various programs and data required for the operation of the head-mounted device are also stored in the random access memory 1004. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other by a bus 1005. An input / output interface 1006 is also connected to the bus. Generally, the following systems can be connected to the input / output interface 1006: input devices 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; the storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the head-mounted device to communicate wirelessly or by wire with other devices to exchange data. Although the head-mounted device is shown with various systems, it should be understood that all of the illustrated systems are not required to be implemented or possessed. More or fewer systems can alternatively be implemented or possessed.

[0147] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program comprising program code for performing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication device, or installed from the storage device 1003, or installed from the read-only memory 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the methods of embodiments of the present disclosure are performed.

[0148] The head-mounted device provided by the present application adopts the reaction ability evaluation method in the above-mentioned embodiments, and can realize fine and hierarchical evaluation of reaction ability. Compared with the prior art, the head-mounted device provided by the present application has the same beneficial effects as the reaction ability evaluation method provided by the above-mentioned embodiments, and other technical features in the head-mounted device are the same as the features disclosed in the above-mentioned embodiments, which will not be described here.

[0149] It should be understood that parts of the present disclosure can be realized by hardware, software, firmware or a combination thereof. In the description of the above-mentioned embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0150] The above merely describes specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the above claims.

[0151] In addition, the present application also provides a computer readable storage medium having stored thereon computer readable program instructions (i.e., computer programs) for performing the steps of the reaction ability evaluation method in the above embodiments.

[0152] The computer readable storage medium provided by the present application may, for example, be a U disk, but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination of the above. More specific examples of computer readable storage media include, but are not limited to, an electrical connection having one or more conductive wires, a portable computer diskette, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical fiber, a portable compact disk read-only memory, an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to electrical wires, optical cables, RF (Radio Frequency, radio frequency), etc., or any suitable combination of the above.

[0153] The above computer readable storage medium can be included in a head-mounted device; or can exist separately and not be assembled into a head-mounted device.

[0154] The above computer readable storage medium carries one or more programs, which, when executed by the head-mounted device, cause the head-mounted device to: output, through the prompt output module, prompt information corresponding to at least one reaction test action, and determine a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detect, through the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at a target body surface area, and determine a signal change time of the bioelectric signal change; determine, through the reaction test action detection module, an action completion time of the wearer performing the reaction test action; evaluate the cognitive reaction ability of the wearer based on the prompt output time and the signal change time, and obtain a cognitive reaction ability evaluation result of the wearer; evaluate the execution reaction ability of the wearer based on the signal change time and the action completion time, and obtain an execution reaction ability evaluation result of the wearer.

[0155] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0156] The flow diagrams and the block diagrams in the drawings are meant as methodological and functional description of implementations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0157] The modules involved in the embodiments of the present application can be implemented in software or hardware. In some cases, the names of the modules do not limit the modules themselves.

[0158] The computer readable storage medium provided by the present application stores computer readable program instructions (i.e. computer program) for executing the steps of the reaction capacity evaluation method described above, and can realize fine and hierarchical evaluation of reaction capacity. Compared with the prior art, the computer readable storage medium provided by the present application has the same beneficial effects as the reaction capacity evaluation method provided by the above embodiments, and will not be described here.

[0159] In addition, the embodiment of the present application further provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the reaction capacity evaluation method in the above embodiment.

[0160] The computer program product provided by the present application can realize fine and hierarchical evaluation of reaction capacity. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present application are the same as those of the reaction capacity evaluation method provided by the above embodiment, and are not described herein.

[0161] The above only describes some embodiments of the present application, and does not limit the patent scope of the present application. Any equivalent structural transformation, direct / indirect application in other related technical fields, or the like made by using the content of the present application specification and drawings within the technical concept of the present application is included in the patent protection scope of the present application.

Claims

1. A method for assessing reactivity, characterized by, The reaction ability evaluation method is applied to a head-mounted device, the head-mounted device comprising a prompt output module, a bioelectric signal detection module, and a reaction test action detection module, wherein the bioelectric signal detection module is in contact with a target body surface area of a wearer when the head-mounted device is in a wearing state, the target body surface area comprising at least one of a temporal branch nerve body surface projection area and a temporal muscle body surface projection area, and the method comprises: outputting, by the prompt output module, prompt information corresponding to at least one reaction test action, and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area, and determining a signal change time of the bioelectric signal change; determining, by the reaction test action detection module, an action completion time of the wearer performing the reaction test action; evaluating, based on the prompt output time and the signal change time, a cognitive reaction ability of the wearer to obtain a cognitive reaction ability evaluation result of the wearer; evaluating, based on the signal change time and the action completion time, an execution reaction ability of the wearer to obtain an execution reaction ability evaluation result of the wearer.

2. The reaction ability evaluation method according to claim 1, wherein The step of evaluating, based on the prompt output time and the signal change time, the cognitive reaction ability of the wearer to obtain the cognitive reaction ability evaluation result of the wearer comprises: calculating a cognitive reaction time of the wearer performing the reaction test action according to the prompt output time and the signal change time; evaluating, according to the cognitive reaction time, the cognitive reaction ability of the wearer to obtain the cognitive reaction ability evaluation result of the wearer.

3. The reaction ability assessment method according to claim 2, wherein The step of evaluating, according to the cognitive reaction time, the cognitive reaction ability of the wearer to obtain the cognitive reaction ability evaluation result of the wearer comprises: obtaining a cognitive reaction time distribution corresponding to the reaction test action; evaluating, according to the cognitive reaction time distribution and the cognitive reaction time, the cognitive reaction ability of the wearer to obtain the cognitive reaction ability evaluation result of the wearer.

4. The reaction ability assessment method according to claim 1, wherein The step of evaluating, based on the signal change time and the action completion time, the execution reaction ability of the wearer to obtain the execution reaction ability evaluation result of the wearer comprises: calculating an execution reaction time of the wearer performing the reaction test action according to the signal change time and the action completion time; evaluating, according to the execution reaction time, the execution reaction ability of the wearer to obtain the execution reaction ability evaluation result of the wearer.

5. The reaction ability assessment method according to claim 4, wherein The step of evaluating, according to the execution reaction time, the execution reaction ability of the wearer to obtain the execution reaction ability evaluation result of the wearer comprises: obtaining an execution reaction time distribution corresponding to the reaction test action; According to the execution reaction time distribution and the execution reaction time, an execution reaction ability of the wearer is evaluated to obtain an execution reaction ability evaluation result of the wearer.

6. The reaction ability evaluation method according to any one of claims 1 to 5, wherein The method further comprises: The cognitive reaction ability evaluation result and the execution reaction ability evaluation result are weighted and fused to obtain a comprehensive reaction ability evaluation result of the wearer.

7. The reaction ability evaluation method according to any one of claims 1 to 5, wherein The target body surface area includes a superficial projection area of the temporal branch nerve, the bioelectric signal detection module includes a neural electric signal detection unit, and the reaction test action detection module includes an eye movement detection camera, wherein the neural electric signal detection unit is in contact with the superficial projection area of the temporal branch nerve when the head-mounted device is in a wearing state; In the case where the reaction test action is a blinking action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area and determining a signal change time of the bioelectric signal change comprises: detecting, by the neural electric signal detection unit, a neural electric signal change caused by the wearer performing the blinking action at the superficial projection area of the temporal branch nerve and determining a signal change time of the neural electric signal change; In the case where the reaction test action is a blinking action, the step of determining, by the reaction test action detection module, a movement completion time of the wearer performing the reaction test action comprises: determining, by the eye movement detection camera, a movement completion time of the wearer performing the blinking action.

8. The reaction ability evaluation method according to any one of claims 1 to 5, wherein The target body surface area includes a superficial projection area of the temporal muscle, the bioelectric signal detection module includes a muscle electric signal detection unit, and the reaction test action detection module includes a mouth movement detection camera, wherein the muscle electric signal detection unit is in contact with the superficial projection area of the temporal muscle when the head-mounted device is in a wearing state; In the case where the reaction test action is a mouth closing action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action at the target body surface area and determining a signal change time of the bioelectric signal change comprises: detecting, by the muscle electric signal detection unit, a muscle electric signal change caused by the wearer performing the mouth closing action at the superficial projection area of the temporal muscle and determining a signal change time of the muscle electric signal change; The step of determining, by the reaction test action detection module, a movement completion time of the wearer performing the reaction test action comprises: determining, by the mouth movement detection camera, a movement completion time of the wearer performing the mouth closing action.

9. A head-mounted device, comprising: The device comprises a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the reaction ability evaluation method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the steps of the reaction capacity evaluation method in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Cognitive platform including computerized evocative elements

    CN110024014A

  • Electroencephalogram eye tracker based on brain-computer interface, calibration method and device thereof, computer equipment and storage medium

    CN120371132A

  • Systems and Methods for Determining Physiological State Based on Surface Biopotentials

    US20250127444A1