Response capability assessment method, head-mounted display device and computer readable storage medium

Abstract

The invention discloses a reaction capability evaluation method, head-mounted display equipment and a computer readable storage medium, and relates to the technical field of head-mounted display equipment, the method is applied to the head-mounted display equipment, and the method comprises the following steps: through a prompt output module, outputting prompt information corresponding to at least one reaction test action, and determining prompt output time; through a bio-electricity signal detection module, bio-electricity signal change caused by the fact that the wearer executes the reaction test action is detected in the target body surface area, and signal change time is determined; action completion time is determined through a reaction test action detection module; based on the prompt output time and the signal change time, the cognitive response ability of the wearer is evaluated, and a cognitive response ability evaluation result of the wearer is obtained; and based on the signal change time and the action completion time, evaluating the execution response capability of the wearer to obtain an execution response capability evaluation result of the wearer. According to the invention, refined layered evaluation of the reaction capability can be realized.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted display devices, and in particular to a reaction capability evaluation method, a head-mounted display device, and a computer-readable storage medium. Background Art

[0002] With the advancement of technology and the widespread use of intelligent devices, the objective and quantitative assessment of reaction ability is playing an increasingly important role in various fields. For example, in sports, reaction ability is one of the key indicators for measuring an athlete's overall quality; in clinical medicine, reaction ability can be used as a key monitoring parameter for neurological function and rehabilitation progress; and in specialized professions such as pilots and drivers, reaction ability is a key factor in ensuring operational safety and mission efficiency.

[0003] Currently, traditional methods for assessing responsiveness often rely on manual observation or the use of simple external devices to record the total time it takes for a user to receive a stimulus (such as a visual or auditory cue) and complete a designated action. For example, after a visual cue is displayed on a screen or an audio cue is played through a speaker, the time interval between the user responding to the cue and completing the corresponding action is recorded to assess their responsiveness.

[0004] However, this traditional reaction ability evaluation method can only obtain the overall reaction time and cannot perform a refined hierarchical evaluation of the user's reaction ability. Summary of the Invention

[0005] The main purpose of this application is to provide a reaction ability evaluation method, a head-mounted display device and a computer-readable storage medium, aiming to achieve a refined hierarchical evaluation of reaction ability.

[0006] To achieve the above objectives, the present application proposes a reaction ability assessment method, which is applied to a head-mounted display device. The head-mounted display device includes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module. When the head-mounted display device is in a worn state, the bioelectric signal detection module is in contact with a target body surface area of ​​the wearer. The method includes: Outputting prompt information corresponding to at least one reaction test action through the prompt output module and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, by the bioelectric signal detection module, changes in bioelectric signals caused by the wearer performing the reaction test action in the target body surface area, and determining a signal change time of the bioelectric signal change; Determining the time it takes for the wearer to complete the reaction test action by using the reaction test action detection module; evaluating the wearer's cognitive response ability based on the prompt output time and the signal change time, and obtaining an evaluation result of the wearer's cognitive response ability; The wearer's execution reaction ability is evaluated based on the signal change time and the action completion time to obtain an evaluation result of the wearer's execution reaction ability.

[0007] In one embodiment, the step of evaluating the wearer's cognitive response ability based on the prompt output time and the signal change time to obtain the wearer's cognitive response ability evaluation result includes: Calculating the cognitive reaction time of the wearer performing the reaction test action according to the prompt output time and the signal change time; The cognitive reaction ability of the wearer is evaluated according to the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

[0008] In one embodiment, the step of evaluating the wearer's cognitive reaction ability based on the cognitive reaction time to obtain the wearer's cognitive reaction ability evaluation result includes: Obtaining a cognitive reaction time distribution corresponding to the reaction test action; The cognitive reaction ability of the wearer is evaluated according to the cognitive reaction time distribution and the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

[0009] In one embodiment, the step of evaluating the wearer's execution reaction ability based on the signal change time and the action completion time to obtain the wearer's execution reaction ability evaluation result includes: Calculating the execution reaction time of the wearer performing the reaction test action according to the signal change time and the action completion time; The execution reaction ability of the wearer is evaluated according to the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

[0010] In one embodiment, the step of evaluating the wearer's execution reaction ability based on the execution reaction time to obtain the evaluation result of the wearer's execution reaction ability includes: Obtaining the execution reaction time distribution corresponding to the reaction test action; The execution reaction ability of the wearer is evaluated according to the execution reaction time distribution and the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

[0011] In one embodiment, the method further comprises: The cognitive reaction ability evaluation result and the executive reaction ability evaluation result are weightedly fused to obtain the wearer's comprehensive reaction ability evaluation result.

[0012] In one embodiment, the target body surface area includes a temporal nerve surface projection area, the bioelectric signal detection module includes a neural signal detection unit, and the reaction test action detection module includes an eye action detection camera, wherein when the head-mounted display device is in a worn state, the neural signal detection unit is in contact with the temporal nerve surface projection area; In a case where the reaction test action is a blinking action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area and determining a signal change time of the bioelectric signal change includes: detecting, by the neural electrical signal detection unit, a neural electrical signal change caused by the wearer performing the blinking action in the temporal branch nerve surface projection area, and determining a signal change time of the neural electrical signal change; In the case where the reaction test action is a blinking action, the step of determining, by the reaction test action detection module, the time at which the wearer completes the reaction test action includes: The eye movement detection camera is used to determine the time when the wearer completes the blinking action.

[0013] In one embodiment, the target body surface area includes a temporalis muscle surface projection area, the bioelectrical signal detection module includes a muscle electrical signal detection unit, and the reaction test movement detection module includes a mouth movement detection camera, wherein when the head-mounted display device is in a worn state, the muscle electrical signal detection unit is in contact with the temporalis muscle surface projection area; In a case where the reaction test action is a mouth-closing action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area and determining a signal change time of the bioelectric signal change includes: detecting, by the muscle electrical signal detection unit, changes in the muscle electrical signal caused by the wearer performing the mouth closing action in the temporalis muscle surface projection area, and determining a signal change time of the muscle electrical signal change; The step of determining the completion time of the wearer performing the reaction test action by the reaction test action detection module includes: The mouth action detection camera is used to determine the time when the wearer completes the mouth closing action.

[0014] In addition, to achieve the above-mentioned purpose, the present application also proposes a head-mounted display device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the reaction ability evaluation method described above.

[0015] In addition, to achieve the above-mentioned purpose, the present application also proposes a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the reaction capability evaluation method described above are implemented.

[0016] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the reaction ability evaluation method described above.

[0017] The present application provides a reaction ability assessment method, a head-mounted display device, and a computer-readable storage medium, relating to the technical field of head-mounted display devices. The reaction ability assessment method is applied to a head-mounted display device, wherein the head-mounted display device includes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module. When the head-mounted display device is in a worn state, the bioelectric signal detection module is connected to a target body surface area of ​​the wearer. The method includes: outputting, via the prompt output module, prompt information corresponding to at least one reaction test action, and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, via the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area, and determining a signal change time of the bioelectric signal change; determining, via the reaction test action detection module, an action completion time of the wearer performing the reaction test action; evaluating the wearer's cognitive reaction ability based on the prompt output time and the signal change time, to obtain a cognitive reaction ability assessment result of the wearer; and evaluating the wearer's executive reaction ability based on the signal change time and the action completion time, to obtain a wearer's executive reaction ability assessment result.

[0018] The reaction ability assessment method proposed in this application utilizes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module integrated into the head-mounted display device to achieve a refined, hierarchical assessment of the wearer's reaction ability. Specifically, during the test, the system first presents visual or auditory prompts related to the reaction test action to the wearer through the prompt output module and records the prompt output time. Subsequently, when the wearer receives the prompt and prepares to perform the action, the bioelectric signal detection module detects changes in bioelectric signals generated by the target body surface area (such as the temporal nerve surface projection area, the temporalis muscle surface projection area, etc.) in real time, thereby determining the signal change time of neuromuscular activation. Simultaneously, the reaction test action detection module is used to capture the time point when the wearer actually completes the specified action, namely the action completion time. Based on these three time nodes: prompt output time, signal change time, and action completion time, this method can evaluate reaction ability from two dimensions: the cognitive stage and the execution stage. The time interval from the prompt output to the change in the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, and is an indicator of cognitive response ability. The time interval from the bioelectric signal change to the completion of the action reflects the wearer's movement execution efficiency and coordination, and is an indicator of executive response ability. This method of breaking down the overall reaction time into two sub-processes, cognitive and executive, overcomes the limitation of traditional assessment methods that only captures the total reaction time, and enables a multi-level, fine-grained analysis of reaction ability.

[0019] The beneficial technical effects of the present application are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire test process relies on the head-mounted display device, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, this method can complete multimodal data acquisition and synchronous analysis without relying on external independent equipment, which simplifies the test process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 A schematic diagram of a process flow provided for the first embodiment of the reaction capability evaluation method of the present application; Figure 2 This is a schematic structural diagram of smart glasses in a specific embodiment of the present application; Figure 3 This is a schematic diagram of the wearing state of smart glasses in a specific embodiment of the present application; Figure 4 Schematic diagram of the device structure of the hardware operating environment involved in the reaction capability evaluation method in the embodiment of the present application.

[0023] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0024] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0025] Currently, traditional methods for assessing responsiveness often rely on manual observation or the use of simple external devices to record the total time it takes for a user to receive a stimulus (such as a visual or auditory cue) and complete a designated action. For example, after a visual cue is displayed on a screen or an audio cue is played through a speaker, the time interval between the user responding to the cue and completing the corresponding action is recorded to assess their responsiveness.

[0026] However, this traditional responsiveness evaluation method can only obtain the overall response time and cannot evaluate the user's cognitive responsiveness and executive responsiveness in a fine-grained manner.

[0027] In contrast, the solution of an embodiment of the present application is a reaction ability assessment method, which is applied to a head-mounted display device, the head-mounted display device including a prompt output module, a bioelectric signal detection module, and a reaction test action detection module. When the head-mounted display device is in a worn state, the bioelectric signal detection module is in contact with a target body surface area of ​​the wearer. The method includes: outputting, via the prompt output module, prompt information corresponding to at least one reaction test action, and determining a prompt output time for the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, via the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area, and determining a signal change time of the bioelectric signal change; determining, via the reaction test action detection module, an action completion time of the wearer performing the reaction test action; evaluating the wearer's cognitive reaction ability based on the prompt output time and the signal change time, to obtain a cognitive reaction ability assessment result of the wearer; and evaluating the wearer's executive reaction ability based on the signal change time and the action completion time, to obtain a executive reaction ability assessment result of the wearer.

[0028] The reaction ability assessment method proposed in this application utilizes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module integrated into the head-mounted display device to achieve a refined, hierarchical assessment of the wearer's reaction ability. Specifically, during the test, the system first presents visual or auditory prompts related to the reaction test action to the wearer through the prompt output module and records the prompt output time. Subsequently, when the wearer receives the prompt and prepares to perform the action, the bioelectric signal detection module detects changes in bioelectric signals generated by the target body surface area (such as the temporal nerve surface projection area, the temporalis muscle surface projection area, etc.) in real time, thereby determining the signal change time of neuromuscular activation. Simultaneously, the reaction test action detection module is used to capture the time point when the wearer actually completes the specified action, namely the action completion time. Based on these three time nodes: prompt output time, signal change time, and action completion time, this method can evaluate reaction ability from two dimensions: the cognitive stage and the execution stage. The time interval from the prompt output to the change in the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, and is an indicator of cognitive response ability. The time interval from the bioelectric signal change to the completion of the action reflects the wearer's movement execution efficiency and coordination, and is an indicator of executive response ability. This method of breaking down the overall reaction time into two sub-processes, cognitive and executive, overcomes the limitation of traditional assessment methods that only captures the total reaction time, and enables a multi-level, fine-grained analysis of reaction ability.

[0029] The beneficial technical effects of the present application are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contribution of the cognitive and execution stages, and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire test process relies on the head-mounted display device, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, this method can complete multimodal data acquisition and synchronous analysis without relying on external independent equipment, which simplifies the test process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability.

[0030] The head-mounted display device in the embodiments of this application may include, but is not limited to, mixed reality (MR) devices (e.g., MR glasses or MR helmets), augmented reality (AR) devices (e.g., AR glasses or AR helmets), virtual reality (VR) devices (e.g., VR glasses or VR helmets), extended reality (XR) devices, or some combination thereof, and the like. In this embodiment, for ease of description, the following description uses the head-mounted display device as the execution subject.

[0031] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0032] This application proposes a reaction capability evaluation method according to a first embodiment.

[0033] Please refer to Figure 1 , Figure 1 A flowchart of the first embodiment of the reaction capability evaluation method of the present application is provided.

[0034] In this embodiment, the reaction ability assessment method is applied to a head-mounted display device, which includes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module. When the head-mounted display device is worn, the bioelectric signal detection module is in contact with the wearer's target body surface area. The method may include steps S100 to S500: Step S100: Outputting prompt information corresponding to at least one reaction test action through a prompt output module, and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; Those skilled in the art will know that bioelectric signals refer to the general term for electrical activity signals generated by living tissues (such as nerves, muscles, skin, etc.), mainly including neural electrical signals, muscle electrical signals, skin electrical signals, etc. Among them, neural electrical signals specifically refer to the changes in potential generated when information is transmitted between neurons or within neurons, mainly including EEG (Electroencephalogram) for recording brain neural activity, and ENG (Electroneurography) for recording peripheral nerve activity. Muscle electrical signals, also known as electromyographic signals, are electrical activities recorded from muscle cells and can be obtained by invasive or non-invasive electrode recording, for example, surface electromyography (sEMG) recorded by electrodes placed on the surface of the skin, and needle electromyography recorded by inserting electrodes into the muscle.

[0035] In this embodiment, the bioelectric signal detection module is used to detect changes in bioelectric signals, mainly including detecting changes in nerve electrical signals in the form of ENG, and detecting changes in muscle electrical signals in the form of sEMG.

[0036] It should be noted that in this embodiment, the reaction test action refers to an action specifically designed to assess the wearer's reaction ability in a head-mounted display (HMD) usage scenario. When the HMD is worn, changes in bioelectrical signals caused by the wearer performing the reaction test action can be detected from a certain body surface area connected to the HMD. The body surface area connected to the HMD, where the bioelectrical signal changes caused by the wearer performing the reaction test action can be detected by the bioelectrical signal detection module, is the target body surface area.

[0037] For example, when the reaction test action is an eye reaction test action, such as blinking, nerve impulses emitted by the brain are transmitted to the orbicularis oculi muscle via the temporal branch of the facial nerve, causing the muscle to contract and relax, thereby completing the blink. Therefore, when the wearer blinks, neural electrical signals are transmitted in the temporal branch of the facial nerve, i.e., neural electrical signal changes occur. Therefore, the projection area of ​​the temporal branch nerve on the body surface (hereinafter referred to as the temporal branch nerve surface projection area) can be used as the target body surface area. The neural electrical signal detection unit in the bioelectrical signal detection module, which is specifically designed to detect changes in peripheral neural electrical signals from the inner layer of the body surface, is positioned to connect to the wearer's temporal branch nerve surface projection area when the head-mounted display device is worn. The neural electrical signal detection unit then detects neural electrical signal changes caused by the wearer's blinking action in the temporal branch nerve surface projection area and determines the signal change time of the neural electrical signal change. This facilitates the classification of the wearer's cognitive and executive stages of the blinking action, thereby providing a refined and stratified assessment of the wearer's ocular reaction ability.

[0038] It should also be noted that in this embodiment, the prompt output module refers to the component used to output visual or auditory stimulation signals (i.e., prompt information corresponding to the reaction test action) to the wearer. It is typically integrated into the head-mounted display device, such as a display screen or speaker. Its function is to provide the wearer with a clear and recognizable action trigger signal (i.e., prompt information corresponding to the reaction test action) to guide them in performing the preset reaction test action. The prompt information can be in the form of text, images, sounds, or a combination thereof, and its content corresponds to the reaction test action to be performed. The prompt output time refers to the time when the prompt information is output to the wearer. This time point serves as the starting point of the entire reaction test process and is used to subsequently calculate the time interval between the cognitive and execution phases.

[0039] It should be noted that in this embodiment, the prompt output module will output prompt information corresponding to at least one reaction test action, and record the prompt output time corresponding to each prompt information. Accordingly, in the subsequent step S200, the bioelectric signal detection module will determine the signal change time of the bioelectric signal change caused by each reaction test action, and in step S300, the reaction test action detection module will also determine the action completion time of each reaction test action. Therefore, in steps S400 and S500, the wearer's cognitive reaction ability and executive reaction ability are comprehensively and in-depth evaluated according to the prompt output time, signal change time and action completion time corresponding to each reaction test action.

[0040] Step S200, detecting, by a bioelectric signal detection module, changes in bioelectric signals caused by the wearer performing a reaction test action in a target body surface area, and determining a signal change time of the bioelectric signal change; In this embodiment, the bioelectric signal detection module is arranged on the inside of the head-mounted display device, and when the user wears the head-mounted display device, the bioelectric signal detection module is connected to the target body surface area of ​​the wearer, so that it can non-invasively detect the bioelectric signal changes caused by the wearer performing the reaction test action, and determine the signal change time of the bioelectric signal change, so as to divide the wearer's cognitive stage and execution stage when performing the reaction test action according to the signal change time, and then perform a refined hierarchical assessment of the wearer's reaction ability.

[0041] In this embodiment, the bioelectric signal changes caused by the wearer's reaction test actions refer to fluctuations in bioelectric signals caused by nerve excitation and muscle pre-activation after the wearer receives the prompt information but before any obvious physical movement. This signal change occurs before the actual movement, reflecting the central nervous system's response speed to external stimuli and its decision-making process.

[0042] This embodiment introduces a physiological-level bioelectric signal change detection mechanism, so that the reaction ability assessment no longer relies solely on external behavioral performance, but can go deep into the neuromuscular activation level, thereby achieving detailed capture of the entire process of "perceiving stimulation → cognitive decision-making → executing action".

[0043] Step S300, determining the completion time of the wearer's reaction test action through the reaction test action detection module; It should be noted that in this embodiment, the reaction test action detection module refers to the sensor components integrated into the head-mounted display device, which are used to accurately detect whether the wearer has completed the specified reaction test action and determine the specific time when the action is completed (i.e., the action completion time). These sensors may include but are not limited to cameras, infrared sensors, microphones, etc.

[0044] In this embodiment, the reaction test actions are mainly divided into three categories: eye reaction test actions, mouth reaction test actions, and vocal reaction test actions. Among them, eye reaction test actions refer to reaction test actions performed through eye behaviors such as eye movements, blinking, changes in gaze direction, or changes in eyelid opening and closing. Mouth reaction test actions refer to reaction test actions completed through coordinated movements of the lips, mandible, tongue, teeth, and other parts of the mouth. Vocal reaction test actions refer to reaction test actions that emit voice signals through vocal cord vibration and the oral resonance system.

[0045] It is not difficult to understand that when the reaction test action performed by the wearer is an eye reaction test action, the camera or infrared sensor responsible for detecting eye movements in the reaction test action detection module is called to determine the action completion time corresponding to the eye reaction test action. When the reaction test action performed by the wearer is a mouth reaction test action, the camera or infrared sensor responsible for detecting mouth movements in the reaction test action detection module is called to determine the action completion time corresponding to the mouth reaction test action. Correspondingly, when the reaction test action performed by the wearer is a vocal reaction test action, the microphone responsible for detecting sound in the reaction test action detection module is called to determine the action completion time corresponding to the vocal reaction test action.

[0046] It should be noted that, similar to the eye reaction test, when the reaction test action is a mouth reaction test action, for example, mouth closing, nerve impulses generated by the brain are transmitted to the temporalis muscle, one of the main mouth-closing muscles, causing it to contract, generating force to move the mandible upward and backward, thereby achieving mouth closing. Therefore, when the wearer performs the mouth-closing action, the temporalis muscle's muscle electrical signal changes. Therefore, the projected area of ​​the temporalis muscle on the body surface (hereinafter referred to as the temporalis muscle surface projected area) can be used as the target body surface area. The muscle electrical signal detection unit in the bioelectrical signal detection module, which is specifically designed to detect changes in muscle electrical signals from the inner layer of the body surface, is positioned to contact the wearer's temporalis muscle surface projected area when the head-mounted display device is worn. The muscle electrical signal detection unit detects muscle electrical signal changes caused by the wearer's mouth-closing action in the temporalis muscle surface projected area and determines the signal change time of the muscle electrical signal change. This facilitates the classification of the wearer's cognitive and executive stages when performing the mouth-closing action, thereby providing a refined and stratified assessment of the wearer's mouth reaction ability.

[0047] It can be understood that each specific reaction test action in the above three categories of reaction test actions will correspond to some muscles and / or nerves involving the head or face, so that the projection area of ​​these muscles and / or nerves on the body surface can be used as the target body surface area, and a neural electrical signal detection unit and / or a muscle electrical signal detection unit can be correspondingly set in the head display device. When the wearer performs a certain reaction test action, the bioelectric signal detection module detects the bioelectric signal changes in the target body surface area corresponding to the reaction test action, thereby dividing the wearer's cognitive stage and execution stage when performing the reaction test action, and then conducting a refined and hierarchical evaluation of the wearer's cognitive reaction ability and execution reaction ability.

[0048] Step S400, evaluating the wearer's cognitive response ability based on the prompt output time and the signal change time, and obtaining the wearer's cognitive response ability evaluation result; In this embodiment, cognitive responsiveness refers to the information processing efficiency from the time an external stimulus is received to the activation of the neuromuscular system, encompassing multiple psychological processes such as perception, judgment, and decision-making. This cognitive responsiveness can be used as an indicator to measure an individual's cognitive processing speed, decision-making efficiency, and attentional focus in response to external stimuli, directly reflecting the individual's attentional focus, information processing speed, and response readiness. The cognitive responsiveness assessment result is the result obtained by evaluating an individual's cognitive responsiveness based on the time difference between the time an individual receives a prompt and the time their neuromuscular system begins to generate detectable bioelectrical signal changes.

[0049] For example, in a feasible implementation, step S400 may include steps S410 to S420: Step S410, calculating the cognitive reaction time of the wearer performing the reaction test action based on the prompt output time and the signal change time; Step S420: Evaluate the cognitive reaction ability of the wearer according to the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

[0050] By comparing the "prompt output time" with the "signal change time," this embodiment can determine the time difference between the wearer's perception of the prompt information and neuromuscular activation, i.e., the cognitive response time. A shorter cognitive response time indicates a higher cognitive processing efficiency and stronger cognitive response ability.

[0051] It is not difficult to understand that in this embodiment, the prompt output module will output prompt information corresponding to at least one reaction test action. Accordingly, the cognitive reaction time of the wearer performing each reaction test action is calculated based on the prompt output time and signal change time corresponding to each reaction test action. Therefore, when executing the above step S420, according to the actual setting, a cognitive reaction ability assessment can be performed for each reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each reaction test action, or according to the three major types of reaction test actions, the average cognitive reaction time of each type of reaction test action is statistically obtained, and then a cognitive reaction ability assessment is performed for each type of reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each type of reaction test action, or after a cognitive reaction ability assessment is performed for each reaction test action to obtain the cognitive reaction ability assessment result of the wearer when performing each type of reaction test action, the cognitive reaction ability assessment results corresponding to each reaction test action are integrated or weighted to obtain the overall cognitive reaction ability assessment result of the wearer. This embodiment does not specifically limit this, and the cognitive reaction ability assessment method can be flexibly set according to actual needs.

[0052] It is worth mentioning that in this embodiment, when the user conducts a reaction ability evaluation through the head-mounted display device, he or she can actively choose to conduct one of the three major types of reaction test actions, or even conduct a reaction ability evaluation of a specific reaction test action, or choose to conduct a reaction ability evaluation that randomly covers all reaction test actions.

[0053] Step S500 : evaluating the wearer's execution reaction ability based on the signal change time and the action completion time, and obtaining an evaluation result of the wearer's execution reaction ability.

[0054] In this embodiment, executive reaction ability refers to the efficiency of movement execution from the activation of the neuromuscular system to the actual completion of the specified action, covering multiple aspects such as muscle contraction, movement coordination, and strength control. This executive reaction ability can be used as an indicator to measure an individual's cognitive processing speed, decision-making efficiency, and degree of concentration of attention to external stimuli, and directly reflects the individual's movement control accuracy and body coordination. The evaluation result of executive reaction ability refers to the result obtained after evaluating the individual's executive reaction ability based on the time difference between the individual's neuromuscular system starting to produce detectable bioelectric signal changes and the actual completion of the specified reaction test action.

[0055] For example, in a feasible implementation, step S500 may include steps S510 to S520: Step S510, calculating the wearer's reaction time for performing the reaction test action based on the signal change time and the action completion time; Step S520: Evaluate the wearer's execution reaction ability based on the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

[0056] By comparing the "signal change time" with the "action completion time," this embodiment can determine the time difference between the wearer's neuromuscular activation and the completion of the action, i.e., the execution reaction time. The shorter and more stable this execution reaction time, the higher the wearer's exercise execution efficiency and the stronger their execution reaction ability.

[0057] Similar to the implementation mentioned in the above step S400, when evaluating the execution reaction ability, this implementation also needs to calculate the execution reaction time of the wearer to perform each reaction test action if the prompt output module outputs prompt information corresponding to multiple reaction test actions. Therefore, in step S520, the wearer's execution reaction ability is evaluated according to the actual settings. It will not be elaborated here, and please refer to the above implementation for details.

[0058] The reaction ability assessment method proposed in this embodiment utilizes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module integrated into the head-mounted display device to achieve a refined, hierarchical assessment of the wearer's reaction ability. Specifically, during the test, the system first presents visual or auditory prompts related to the reaction test action to the wearer through the prompt output module and records the prompt output time. Subsequently, when the wearer receives the prompt and prepares to perform the action, the bioelectric signal detection module detects changes in bioelectric signals generated by the target body surface area (such as the temporal nerve surface projection area and the temporalis muscle surface projection area) in real time, thereby determining the signal change time of neuromuscular activation. Simultaneously, the reaction test action detection module captures the time when the wearer actually completes the designated action, i.e., the action completion time. Based on these three time nodes: prompt output time, signal change time, and action completion time, this method can assess reaction ability from two dimensions: the cognitive stage and the execution stage. The time interval from the prompt output to the change in the bioelectric signal reflects the wearer's cognitive processing speed and decision-making ability, and is an indicator of cognitive response ability. The time interval from the bioelectric signal change to the completion of the action reflects the wearer's movement execution efficiency and coordination, and is an indicator of executive response ability. This method of breaking down the overall reaction time into two sub-processes, cognitive and executive, overcomes the limitation of traditional assessment methods that only captures the total reaction time, and enables a multi-level, fine-grained analysis of reaction ability.

[0059] The beneficial technical effects of this embodiment are: on the one hand, by introducing bioelectric signal detection technology, it can accurately capture the neuromuscular activation signals of the wearer before he or she produces obvious limb movements after receiving stimulation, thereby effectively distinguishing the time contributions of the cognitive and execution stages, and significantly improving the scientificity and accuracy of reaction ability assessment; on the other hand, since the entire test process relies on the head-mounted display device, it has good immersion and interactivity, which is convenient for promotion and application in various scenarios such as virtual reality training, professional ability assessment, rehabilitation monitoring, etc., and has strong practicality and scalability; in addition, this method can complete multimodal data acquisition and synchronous analysis without relying on external independent equipment, which simplifies the test process, improves assessment efficiency, and helps to promote the development of reaction ability assessment technology towards intelligence and portability.

[0060] In a feasible implementation, step S420 evaluates the wearer's cognitive reaction ability based on the cognitive reaction time to obtain the wearer's cognitive reaction ability evaluation result, which may include steps S421 to S422: Step S421, obtaining the cognitive reaction time distribution corresponding to the reaction test action; It should be noted that, in this embodiment, the cognitive reaction time distribution refers to the statistical distribution of cognitive reaction times for all individuals within a certain sample range for a specific reaction test action. This cognitive reaction time distribution is typically obtained through large-scale data collection and analysis, covering the time difference between receiving the prompt information and the beginning of the neuromuscular system generating detectable bioelectric signal changes. This data can be derived from people of different age groups, genders, health conditions, races, occupations, etc., to ensure that the distribution is broadly representative and reflects the characteristics of different populations.

[0061] It is worth noting that the distribution of cognitive reaction time is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles to describe the variability of the cognitive reaction speed of the entire group when performing specific reaction test actions.

[0062] This embodiment can pre-statistically obtain the cognitive reaction time distribution of different groups of people for different reaction test actions, so that in actual applications, the target population can be determined based on the wearer's population settings or personal information (including at least one of age information, gender information, ethnicity information, occupational information, health status information, etc.), and then when executing step S421, the cognitive reaction time distribution of the target population to the specific reaction test action can be obtained.

[0063] Step S422: Evaluate the cognitive reaction ability of the wearer according to the cognitive reaction time distribution and the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

[0064] By comparing a single wearer's cognitive reaction time with the target population's cognitive reaction time distribution, this embodiment can more accurately locate the wearer's position within the target population and provide a scientific assessment of their cognitive reaction ability. Specifically, the cognitive reaction time distribution obtained in step S421 is first used as a reference benchmark, and then the current wearer's cognitive reaction time is placed within this distribution framework for comparative analysis. This step not only considers the wearer's absolute reaction speed (i.e., cognitive reaction time) during the cognitive phase, but also their relative performance relative to similar populations during this phase.

[0065] This embodiment takes into account the differences in cognitive reaction abilities among different groups of people. By introducing the concept of cognitive reaction time distribution, the cognitive reaction ability assessment of each wearer is no longer isolated, but is based on a broad data background, thereby supporting a more personalized reaction ability assessment service and making the cognitive reaction ability assessment results more practical, accurate and reliable.

[0066] In a feasible implementation, step S520 evaluates the wearer's execution reaction ability based on the execution reaction time, and the step of obtaining the wearer's execution reaction ability evaluation result may include steps S521 to S522: Step S521, obtaining the execution reaction time distribution corresponding to the reaction test action; It should be noted that, in this embodiment, the execution reaction time distribution refers to the statistical distribution of the execution reaction time of all individuals obtained within a certain sample range for a specific reaction test action. The execution reaction time distribution is usually obtained through large-scale data collection and analysis, covering the time difference between the beginning of the generation of detectable bioelectric signal changes in the neuromuscular system and the actual completion of the specified reaction test action. These data can be derived from people of different age groups, genders, health conditions, races, occupations, etc., to ensure that the distribution is broadly representative and can reflect the characteristics of different populations.

[0067] It is worth noting that the distribution of executive reaction time is not just a simple calculation of the mean, but also includes statistics such as standard deviation and percentiles to describe the variability of the executive reaction speed of the entire group when performing a specific reaction test action.

[0068] This embodiment can pre-statistically obtain the execution reaction time distribution of different groups of people for different reaction test actions, so that in actual applications, the target population can be determined based on the wearer's population settings or personal information (including at least one of age information, gender information, race information, occupation information, health status information, etc.), and then when executing step S421, the execution reaction time distribution of the target population for a specific reaction test action can be obtained.

[0069] Step S522: Evaluate the wearer's execution reaction ability based on the execution reaction time distribution and the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

[0070] By comparing a single wearer's execution reaction time with the target population's execution reaction time distribution, this embodiment can more accurately locate the wearer's position within the target population and provide a scientific assessment of their execution reaction ability. Specifically, the execution reaction time distribution obtained in step S521 is first used as a reference benchmark, and then the current wearer's execution reaction time is placed within this distribution framework for comparative analysis. This step not only considers the wearer's absolute reaction speed (i.e., execution reaction time) during the execution phase, but also their relative performance relative to similar populations during the execution phase.

[0071] This embodiment takes into account the differences in execution reaction ability among different groups of people. By introducing the concept of execution reaction time distribution, the execution reaction ability assessment of each wearer is no longer isolated, but is based on a broad data background, thereby supporting a more personalized reaction ability assessment service, making the execution reaction ability assessment results more practical, accurate and reliable.

[0072] In a feasible implementation, the reaction capability evaluation method may further include step S600: Step S600: weighted fusion of the cognitive reaction ability assessment result and the executive reaction ability assessment result is performed to obtain the wearer's comprehensive reaction ability assessment result.

[0073] When comprehensively evaluating the wearer's reaction ability, steps S400 and S500 provide detailed evaluation results from the two dimensions of cognitive reaction ability and executive reaction ability, respectively. However, in practical applications, a comprehensive indicator is often needed to fully reflect the individual's overall reaction ability.

[0074] Therefore, this embodiment proposes step S600, which is to obtain the wearer's comprehensive reaction ability evaluation result by weighted fusion of the cognitive reaction ability evaluation result and the executive reaction ability evaluation result.

[0075] Those skilled in the art will appreciate that weighted fusion refers to combining evaluation results from different sources or types according to a preset weight distribution scheme to form a more comprehensive and balanced final evaluation result.

[0076] In this embodiment, the objects of weighted fusion are the cognitive reaction ability evaluation result from step S400 and the executive reaction ability evaluation result from step S500.

[0077] Specifically, weighted fusion can be achieved through the following formula: Comprehensive reaction ability assessment result = w1 × cognitive reaction ability assessment result + w2 × executive reaction ability assessment result.

[0078] Among them, w1 is the weight of cognitive response ability in the comprehensive evaluation, w2 is the weight of executive response ability in the comprehensive evaluation, and w1+w2=1.

[0079] The choice of weight can be adjusted according to the specific needs of the application scenario. For example, for application scenarios that emphasize quick decision-making, the value of w1 can be appropriately increased; while for applications that focus more on action execution efficiency, the proportion of w2 can be increased.

[0080] It is worth mentioning that, considering people of different genders at different ages, cognitive reaction ability and executive reaction ability have different proportions in the composition of comprehensive reaction ability. Therefore, when setting the values ​​of w1 and w2, they need to be adjusted according to the wearer's age information and / or gender information.

[0081] This embodiment uses a weighted fusion method to consider not only the wearer's performance in the cognitive stage, but also the wearer's efficiency in the execution stage, thereby providing a more comprehensive reaction ability evaluation system.

[0082] Based on the above-mentioned first embodiment, the present application proposes a reaction capability evaluation method of a second embodiment.

[0083] In the second embodiment of the present application, for the same or similar contents as those in the above embodiments, please refer to the above introduction and will not be repeated hereafter.

[0084] In this embodiment, the target body surface area includes a temporal nerve surface projection area, the bioelectrical signal detection module includes a neural signal detection unit, and the reaction test action detection module includes an eye action detection camera. When the head-mounted display device is in a worn state, the neural signal detection unit is connected to the temporal nerve surface projection area. In the case where the reaction test action is a blinking action, step S200 detects, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area, and determines a signal change time of the bioelectric signal change, which may include step S210: Step S210, detecting, by a neural signal detection unit, a change in a neural signal caused by the wearer's blinking action in the temporal nerve surface projection area, and determining a signal change time of the neural signal change; In the case where the reaction test action is a blink action, step S300 determines the completion time of the wearer's reaction test action through the reaction test action detection module, which may include step S310: Step S310: determining the completion time of the wearer's blinking action through the eye movement detection camera.

[0085] In this embodiment, when the reaction test action is a blink, nerve impulses generated by the brain are transmitted through the temporal branch of the facial nerve to the orbicularis oculi muscle, causing contraction and relaxation of the orbicularis oculi muscle, thereby completing the blink. Therefore, when the wearer blinks, neural electrical signals are transmitted through the temporal branch of the facial nerve, i.e., neural electrical signal changes occur. Therefore, the projection area of ​​the temporal branch nerve on the body surface (i.e., the temporal branch nerve surface projection area) can be used as the target body surface area. A neural electrical signal detection unit (which can be implemented as an ENG electrode) in the bioelectrical signal detection module, specifically designed to detect changes in peripheral neural electrical signals from the inner layer of the body surface, is positioned to be in contact with the wearer's temporal branch nerve surface projection area when the head-mounted display device is worn. This neural electrical signal detection unit detects neural electrical signal changes caused by the wearer's blink in the temporal branch nerve surface projection area and determines the signal change time of these neural electrical signal changes. This facilitates the classification of the wearer's cognitive and executive stages of the blink, thereby providing a refined, stratified assessment of the wearer's ocular reflexes.

[0086] Based on the above-mentioned first embodiment, the present application proposes a reaction capability evaluation method of a third embodiment.

[0087] In the third embodiment of the present application, for the same or similar contents as those in the above embodiments, please refer to the above introduction and will not be repeated hereafter.

[0088] In this embodiment, the target body surface area includes the temporalis muscle surface projection area, the bioelectrical signal detection module includes a muscle electrical signal detection unit, and the reaction test movement detection module includes a mouth movement detection camera. When the head-mounted display device is in a worn state, the muscle electrical signal detection unit is in contact with the temporalis muscle surface projection area. In the case where the reaction test action is a mouth-closing action, step S200 detects, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area, and determines a signal change time of the bioelectric signal change. The step S220 may also be included: Step S220, detecting, by the muscle electrical signal detection unit, changes in the muscle electrical signal caused by the wearer performing the mouth closing action in the temporalis muscle surface projection area, and determining a signal change time of the muscle electrical signal change; In the case where the reaction test action is a mouth-closing action, step S300 determines the time when the wearer completes the reaction test action by using the reaction test action detection module, and may further include step S320: Step S320: Determine the time when the wearer completes the mouth closing action through the mouth action detection camera.

[0089] In this embodiment, when the reaction test action is mouth closing, nerve impulses generated by the brain are transmitted to the temporalis muscle, one of the main muscles for mouth closing, causing it to contract, generating force to move the mandible upward and backward, thereby achieving mouth closing. Therefore, when the wearer performs the mouth closing action, the temporalis muscle's electromyographic signal changes. Therefore, the projected area of ​​the temporalis muscle on the body surface (i.e., the temporalis muscle surface projection area) can be used as the target body surface area. A muscle electromyographic signal detection unit (which can be implemented as an EMG electrode or an ENG electrode) in the bioelectrical signal detection module, specifically designed to detect changes in muscle electromyographic signals from the body surface, is positioned in contact with the wearer's temporalis muscle surface projection area when the head-mounted display device is worn. This muscle electromyographic signal detection unit detects changes in muscle electromyographic signals caused by the wearer's mouth closing action in the temporalis muscle surface projection area and determines the signal change time of these changes. This facilitates the classification of the wearer's cognitive and executive stages when performing the mouth closing action, thereby providing a refined, stratified assessment of the wearer's mouth reaction ability.

[0090] To facilitate understanding of the reaction ability evaluation method in the above embodiments of the present application, a specific embodiment is given below: like Figure 2 As shown, in this specific embodiment, the head display device can be smart glasses, which include a reaction test action detection module composed of two cameras arranged on the lower sides of the left and right frames and a MIC (Microphone) arranged on the lower side of the nose pad, a prompt output module composed of a display area arranged on the lens and speakers arranged on both sides of the temples, and a bioelectric signal detection module composed of electrodes arranged on the inner sides of the temples.

[0091] like Figure 3 As shown, in this specific embodiment, when the smart glasses are worn, the electrodes are in contact with the wearer's temporal nerve and temporalis muscle surface projections. Thus, when the reaction test action is a blink or mouth closure, the electrodes can detect changes in nerve or muscle electrical signals caused by the wearer performing the reaction test action in the target body surface area and determine the corresponding signal change time. Simultaneously, when the reaction test action is an eye reaction test action, such as a blink, the corresponding action completion time can be determined using a camera located on the underside of the frame.

[0092] It should be noted that the above embodiments are only used to assist in understanding the present application and do not constitute a limitation on the reaction capability evaluation method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0093] In addition, please refer to Figure 4 , Figure 4Schematic diagram of the device structure of the hardware operating environment involved in the reaction capability evaluation method in the embodiment of the present application.

[0094] The present application also provides a head-mounted display device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the reaction ability assessment method in the above embodiment.

[0095] The head-mounted display device in the embodiments of the present application may include, but is not limited to, head-mounted display devices such as mixed reality (MR) glasses, augmented reality (AR) glasses, virtual reality (VR) glasses, extended reality (XR) glasses, or some combination thereof.

[0096] Reference below Figure 4 , which shows a schematic structural diagram of a head-mounted display device suitable for implementing an embodiment of the present application. Figure 4 The head-mounted display device shown is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0097] like Figure 4 As shown, the head-mounted display device may include a processing device 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes based on programs stored in a read-only memory 1002 or programs loaded from a storage device 1003 into a random access memory 1004. The random access memory 1004 also stores various programs and data required for the operation of the head-mounted display device. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output interface 1006 is also connected to the bus. Typically, the following systems may be connected to the input / output interface 1006: an input device 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), speakers, and vibrator; a storage device 1003 including, for example, a magnetic tape or hard disk; and a communication device 1009. The communication device 1009 can allow the head-mounted display device to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a head-mounted display device with various systems, it should be understood that it is not required to implement or have all of the systems shown. More or fewer systems may be implemented or have alternatively.

[0098] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device 1003, or installed from a read-only memory 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are performed.

[0099] The head-mounted display device provided in this application utilizes the responsiveness evaluation method described in the aforementioned embodiment to achieve refined, hierarchical responsiveness evaluation. Compared to the prior art, the head-mounted display device provided in this application offers the same beneficial effects as the responsiveness evaluation method described in the aforementioned embodiment. Other technical features of the head-mounted display device are the same as those disclosed in the aforementioned embodiment and are not further elaborated here.

[0100] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0101] The above are merely specific embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the above claims.

[0102] In addition, the present application also provides a computer-readable storage medium having computer-readable program instructions (ie, a computer program) stored thereon, and the computer-readable program instructions are used to execute the steps of the reaction capability evaluation method in the above embodiment.

[0103] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical fiber, a portable compact disk read-only memory, an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0104] The computer-readable storage medium may be included in the head-mounted display device, or may exist independently without being incorporated into the head-mounted display device.

[0105] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: outputs prompt information corresponding to at least one reaction test action through a prompt output module, and determines the prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detects the bioelectric signal changes caused by the wearer performing the reaction test action in the target body surface area through the bioelectric signal detection module, and determines the signal change time of the bioelectric signal change; determines the action completion time of the wearer performing the reaction test action through the reaction test action detection module; evaluates the wearer's cognitive reaction ability based on the prompt output time and the signal change time, and obtains the wearer's cognitive reaction ability evaluation result; evaluates the wearer's execution reaction ability based on the signal change time and the action completion time, and obtains the wearer's execution reaction ability evaluation result.

[0106] Computer program code for performing the operations of the present application may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0107] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0108] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0109] The computer-readable storage medium provided in this application stores computer-readable program instructions (i.e., a computer program) for executing the steps of the aforementioned reaction capability assessment method, enabling a refined, hierarchical assessment of reaction capability. Compared to the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the reaction capability assessment method provided in the aforementioned embodiment, and are not further elaborated here.

[0110] In addition, an embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the reaction ability evaluation method in the above embodiment.

[0111] The computer program product provided in this application can realize the refined hierarchical evaluation of reaction ability. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiment of this application are the same as the beneficial effects of the reaction ability evaluation method provided in the above embodiment, which will not be repeated here.

[0112] The above description is only part of the embodiments of the present application and does not limit the patent scope of the present application. All equivalent structural transformations made by using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A reaction ability evaluation method, characterized in that: The reaction ability assessment method is applied to a head-mounted display device, which includes a prompt output module, a bioelectric signal detection module, and a reaction test action detection module. When the head-mounted display device is in a worn state, the bioelectric signal detection module is in contact with a target body surface area of ​​the wearer. The method includes: Outputting prompt information corresponding to at least one reaction test action through the prompt output module and determining a prompt output time of the prompt information, wherein the prompt information is used to prompt the wearer to perform the reaction test action; detecting, by the bioelectric signal detection module, changes in bioelectric signals caused by the wearer performing the reaction test action in the target body surface area, and determining a signal change time of the bioelectric signal change; Determining the time it takes for the wearer to complete the reaction test action by using the reaction test action detection module; evaluating the wearer's cognitive response ability based on the prompt output time and the signal change time, and obtaining an evaluation result of the wearer's cognitive response ability; The wearer's execution reaction ability is evaluated based on the signal change time and the action completion time to obtain an evaluation result of the wearer's execution reaction ability.

2. The reaction ability evaluation method according to claim 1, wherein: The step of evaluating the wearer's cognitive response ability based on the prompt output time and the signal change time to obtain the wearer's cognitive response ability evaluation result includes: Calculating the cognitive reaction time of the wearer performing the reaction test action according to the prompt output time and the signal change time; The cognitive reaction ability of the wearer is evaluated according to the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

3. The reaction ability evaluation method according to claim 2, wherein: The step of evaluating the wearer's cognitive reaction ability based on the cognitive reaction time to obtain the wearer's cognitive reaction ability evaluation result includes: Obtaining a cognitive reaction time distribution corresponding to the reaction test action; The cognitive reaction ability of the wearer is evaluated according to the cognitive reaction time distribution and the cognitive reaction time to obtain an evaluation result of the wearer's cognitive reaction ability.

4. The reaction ability evaluation method according to claim 1, wherein: The step of evaluating the wearer's execution reaction ability based on the signal change time and the action completion time to obtain the wearer's execution reaction ability evaluation result includes: Calculating the execution reaction time of the wearer performing the reaction test action according to the signal change time and the action completion time; The execution reaction ability of the wearer is evaluated according to the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

5. The reaction ability evaluation method according to claim 4, wherein: The step of evaluating the wearer's execution reaction ability based on the execution reaction time to obtain the wearer's execution reaction ability evaluation result includes: Obtaining the execution reaction time distribution corresponding to the reaction test action; The execution reaction ability of the wearer is evaluated according to the execution reaction time distribution and the execution reaction time to obtain an evaluation result of the wearer's execution reaction ability.

6. The reaction ability evaluation method according to any one of claims 1 to 5, characterized in that: The method further comprises: The cognitive reaction ability evaluation result and the executive reaction ability evaluation result are weightedly fused to obtain the wearer's comprehensive reaction ability evaluation result.

7. The reaction ability evaluation method according to any one of claims 1 to 5, characterized in that: The target body surface area includes a temporal nerve surface projection area, the bioelectric signal detection module includes a neural signal detection unit, and the reaction test action detection module includes an eye action detection camera, wherein when the head display device is in a worn state, the neural signal detection unit is connected to the temporal nerve surface projection area; In a case where the reaction test action is a blinking action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area and determining a signal change time of the bioelectric signal change includes: detecting, by the neural electrical signal detection unit, a neural electrical signal change caused by the wearer performing the blinking action in the temporal branch nerve surface projection area, and determining a signal change time of the neural electrical signal change; In the case where the reaction test action is a blinking action, the step of determining, by the reaction test action detection module, the time at which the wearer completes the reaction test action includes: The eye movement detection camera is used to determine the time when the wearer completes the blinking action.

8. The reaction ability evaluation method according to any one of claims 1 to 5, characterized in that: The target body surface area includes a temporalis muscle surface projection area, the bioelectric signal detection module includes a muscle electrical signal detection unit, and the reaction test action detection module includes a mouth action detection camera, wherein when the head-mounted display device is in a worn state, the muscle electrical signal detection unit is in contact with the temporalis muscle surface projection area; In a case where the reaction test action is a mouth-closing action, the step of detecting, by the bioelectric signal detection module, a bioelectric signal change caused by the wearer performing the reaction test action in the target body surface area and determining a signal change time of the bioelectric signal change includes: detecting, by the muscle electrical signal detection unit, changes in the muscle electrical signal caused by the wearer performing the mouth closing action in the temporalis muscle surface projection area, and determining a signal change time of the muscle electrical signal change; The step of determining the completion time of the wearer performing the reaction test action by the reaction test action detection module includes: The mouth action detection camera is used to determine the time when the wearer completes the mouth closing action.

9. A head-mounted display device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the reaction capability evaluation method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the reaction ability evaluation method according to any one of claims 1 to 8.

Images