A state detection and assessment system based on head-mounted multimodal biosignals and its application method

Abstract

This invention discloses a state detection and assessment system based on head-mounted multimodal biosignals and its usage method. The system includes core modules such as an EEG signal acquisition module, a physiological signal acquisition module, a signal processing module, a state assessment module, and a report generation module. It can simultaneously acquire the user's EEG and physiological signals throughout a complete detection cycle. After the cycle ends, it performs unified signal preprocessing and feature extraction to generate multiple independent state assessment indicators and corresponding level results. Combined with historical assessment data recorded by the user identification and individual correction module, subsequent assessment parameters are personalized and corrected. Finally, the assessment report is pushed to the user's terminal through the report output module. This invention belongs to the field of biosignal detection and state assessment technology, specifically a state detection and assessment system based on head-mounted multimodal biosignals and its usage method.

Description

Technical Field

[0001] This invention belongs to the field of biosignal detection and state assessment technology, specifically relating to a method, system, wearable device, and computer-readable storage medium for state detection and assessment based on head-mounted multimodal biosignals, which is suitable for detecting, assessing, and outputting results of a user's state within a preset detection period. Background Technology

[0002] With the development of wearable technology and biosignal acquisition technology, applications for detecting and assessing user status based on electroencephalogram (EEG) signals and physiological signals are gradually increasing. In existing technologies, some solutions use a single biosignal for status determination, or process the signal in real time during acquisition and output the assessment results immediately.

[0003] However, existing technologies still have the following shortcomings: On the one hand, real-time processing and instant output are easily affected by transient noise, short-term signal fluctuations, and individual differences, resulting in unstable evaluation results that are difficult to reflect the user's overall state over a period of time; on the other hand, although some multimodal solutions collect multiple biological signals simultaneously, they lack a mechanism for independently evaluating and classifying different signal characteristics, and usually output a single result through simple fusion, resulting in limited dimensions of state evaluation information and insufficient interpretability; in addition, existing technologies usually do not systematically record and utilize historical evaluation results generated by the same user in multiple testing processes, and fail to correct evaluation parameters in subsequent testing processes for individual differences, affecting the consistency and reliability of multiple testing results.

[0004] Therefore, it is necessary to provide a new technical solution to simultaneously acquire multimodal biological signals throughout the entire detection cycle and to uniformly process and evaluate the signals after the detection cycle ends, thereby obtaining stable, reliable and individually calibrable state assessment results. Summary of the Invention

[0005] In order to overcome the shortcomings of the prior art, this invention provides a state detection and assessment system based on head-mounted multimodal biosignals and its usage method. By synchronously acquiring EEG signals and physiological signals during the complete detection cycle and uniformly triggering state assessment calculations after the detection cycle ends, the stability and reliability of the state assessment results are improved.

[0006] Another objective of this invention is to achieve a multi-dimensional assessment of user status by generating multiple independent status assessment indicators and corresponding level results.

[0007] A further objective of this invention is to record the historical status evaluation results of the same user in multiple detection processes, and then individually correct the evaluation parameters in subsequent detection processes to reduce the impact of individual differences on the evaluation results.

[0008] The technical solution adopted by this invention is as follows: This invention proposes a state detection and assessment system based on head-mounted multimodal biosignals, comprising: The EEG signal acquisition module is used to acquire the user's EEG signals through a head-mounted EEG acquisition device; The physiological signal acquisition module is used to acquire the user's physiological signals and works synchronously with the electroencephalogram (EEG) signal acquisition module during the same detection process. The signal processing module is used to preprocess the collected EEG and physiological signals and extract feature parameters after the complete detection cycle is completed; The status assessment module is used to generate multiple status assessment indicators based on the feature parameters, and map the status assessment indicators to corresponding level intervals to output a status assessment result set; The report generation module is used to generate a status assessment report based on the status assessment result set; The report output module is used to send the status assessment report to the user terminal for display.

[0009] In some implementations, the system further includes a user identification module and an individual correction module for identifying the same user and individually correcting the state evaluation parameters.

[0010] In some implementations, the system further includes a user interaction module for outputting interactive feedback content related to the status evaluation result to the user after receiving a user-triggered instruction.

[0011] The various modules of the system work together to realize the state detection and assessment method based on head-mounted multimodal biosignals as described in any of the preceding claims.

[0012] On the other hand, the present invention provides a method for using a state detection and assessment system based on head-mounted multimodal biosignals, comprising the following steps: Step 1: Collect the user's brainwave signals through a head-mounted EEG acquisition device, and collect the user's physiological signals through a physiological signal acquisition module set in the same wearable device, wherein the brainwave signals and the physiological signals are collected synchronously in the same detection process; Step 2: Continuously record the collected EEG signals and physiological signals within a preset detection time period, where the detection time period is a complete detection cycle; Step 3: After the complete detection cycle is completed, the collected EEG signals and physiological signals are preprocessed and the corresponding feature parameters are extracted. Step 4: Generate multiple state evaluation indicators based on the feature parameters, wherein the state evaluation indicators are obtained by at least one of the following methods: normalization of the feature parameters, weighted calculation, or threshold comparison. Step 5: Map each status evaluation index to the corresponding level interval. The level interval is divided based on a preset threshold range or statistical distribution to obtain the user's status evaluation result set. Step 6: Generate a status assessment report based on the status assessment result set.

[0013] Step 7: Output the status assessment report to the user terminal for display, so as to provide the user with the status assessment results based on multimodal biosignal fusion after the completion of the full detection cycle.

[0014] In some embodiments, the physiological signal includes at least one of photoplethysmography (PPG) or heart rate-related signals.

[0015] In some implementations, the complete detection cycle is a preset fixed-duration detection cycle, and a state evaluation calculation is triggered uniformly after the detection cycle ends.

[0016] In some implementations, the state assessment indicators include indicators generated based on the frequency band characteristics of EEG signals and indicators generated based on the statistical characteristics of physiological signals, and the state assessment indicators each correspond to independent level intervals.

[0017] In some implementations, the status assessment result set includes multiple independent level determination results, and the level determination results together constitute the user's status assessment information within the detection period.

[0018] In some implementations, when a user is detected to have established a binding relationship with the wearable device through a login account, the user is identified as the same user, and the historical state evaluation results corresponding to the user in multiple detection processes are recorded. Based on the historical state evaluation results, at least one of the state evaluation threshold, feature parameter baseline, or feature weight used in subsequent detection processes is individually corrected. The individual correction is performed before the start of the detection cycle or during the state evaluation calculation stage to reduce state evaluation bias caused by individual differences and improve the stability of state evaluation results in multiple detection processes.

[0019] In some implementations, after the user terminal receives a user-triggered command, it provides the user with interactive feedback content related to the state assessment result based on the state assessment result. The interactive feedback content includes audio content, used to provide the user with state-related information prompts or experiential feedback.

[0020] The present invention also provides a wearable device, including a processor and a memory, wherein the memory stores a computer program, and the computer program, when executed on the processor, implements the above-described method.

[0021] In addition, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed on a processor, implements the above-described method.

[0022] The beneficial effects achieved by the present invention using the above structure are as follows: 1. By synchronously collecting multimodal biological signals throughout the entire detection cycle and uniformly performing state assessment calculations after the detection cycle ends, the impact of instantaneous noise and short-term fluctuations on the assessment results is reduced, and the stability of the state assessment results is improved. 2. By generating multiple independent status assessment indicators and level determination results, a multi-dimensional assessment of user status is achieved, improving the interpretability of the assessment results; 3. By recording users' historical status assessment results and performing individual corrections, the impact of individual differences on assessment results is effectively reduced, and the consistency between multiple test results is improved. Attached Figure Description

[0023] Figure 1 This is a schematic diagram of the state detection and assessment system based on head-mounted multimodal biosignals in an embodiment of the present invention.

[0024] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used together with the embodiments of the invention to explain the invention and do not constitute a limitation thereof. Detailed Implementation

[0025] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0026] like Figure 1 As shown, the present invention proposes a state detection and assessment system based on head-mounted multimodal biosignals. In a specific embodiment, the user wears a head-mounted wearable device, which includes an electroencephalogram (EEG) signal acquisition module and a physiological signal acquisition module. Within a preset complete detection cycle, the device simultaneously acquires the user's EEG signals and photoplethysmography (PPG) signals.

[0027] After the detection period ends, the collected EEG signals are preprocessed and the corresponding frequency band feature parameters are extracted. At the same time, heart rate-related statistical feature parameters are extracted from the photoplethysmography signal.

[0028] Based on the aforementioned feature parameters, multiple status assessment indicators are generated. These indicators may include at least one of the following: focus level related indicators, fatigue level related indicators, stress related indicators, or abnormal risk related indicators. Each status assessment indicator is then mapped to a corresponding level range to obtain multiple independent level determination results. These level determination results together constitute the user's status assessment result set for the detection period.

[0029] A status assessment report is generated based on the status assessment result set, and the status assessment report is output to the user terminal for display.

[0030] After a user logs in with their account and establishes a binding relationship with the wearable device, the system records the user's historical status evaluation results during multiple testing processes, and performs individual corrections on the evaluation parameters in subsequent testing processes based on the historical results.

[0031] The present invention and its embodiments have been described above. This description is not restrictive, and the accompanying drawings are only one embodiment of the present invention; the actual structure is not limited thereto. In conclusion, if those skilled in the art are inspired by this description and design similar structures and embodiments without departing from the spirit of the invention, such designs should fall within the protection scope of the present invention.

Claims

1. A state detection and assessment system based on head-mounted multimodal biosignals, characterized in that, include: The EEG signal acquisition module is used to acquire the user's EEG signals through a head-mounted EEG acquisition device; The physiological signal acquisition module is used to acquire the user's physiological signals and works synchronously with the electroencephalogram (EEG) signal acquisition module during the same detection process. The signal processing module is used to preprocess the collected EEG and physiological signals and extract feature parameters after the complete detection cycle is completed; The status assessment module is used to generate multiple status assessment indicators based on the feature parameters, and map the status assessment indicators to corresponding level intervals to output a status assessment result set; The report generation module is used to generate a status assessment report based on the status assessment result set; The report output module is used to send the status assessment report to the user terminal for display.

2. The state detection and assessment system based on head-mounted multimodal biosignals according to claim 1, characterized in that: It also includes a user identification module and an individual correction module. The user identification module is used to identify the same user, and the individual correction module is used to perform individual correction on the status assessment parameters based on the user's historical status assessment results. It also includes a user interaction module, which is used to output interactive feedback content related to the status evaluation result to the user after receiving a user-triggered command.

3. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 1, characterized in that, Includes the following steps: Step 1: Collect the user's brain signals through a head-mounted EEG acquisition device, and collect the user's physiological signals through a physiological signal acquisition module set in the same wearable device. The EEG signals and the physiological signals are collected synchronously in the same detection process. Step 2: Continuously record the collected EEG signals and physiological signals within a preset detection period, where the detection period is a complete detection cycle; Step 3: After the complete detection cycle is completed, the collected EEG signals and physiological signals are preprocessed and the corresponding feature parameters are extracted. Step 4: Generate multiple state evaluation indicators based on the feature parameters. The state evaluation indicators are obtained by at least one of the following methods: normalization of the feature parameters, weighted calculation, or threshold comparison. Step 5: Map each status evaluation index to the corresponding level interval. The level interval is divided based on a preset threshold range or statistical distribution to obtain the user's status evaluation result set. Step Six: Generate a status assessment report based on the aforementioned status assessment result set; Step 7: Output the status assessment report to the user terminal for display.

4. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 3, characterized in that: The physiological signal includes at least one of photoplethysmography (PPG) signal or heart rate-related signal.

5. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 4, characterized in that: The complete detection cycle is a preset fixed-duration detection cycle, and a state evaluation calculation is triggered uniformly after the detection cycle ends.

6. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 5, characterized in that: The state assessment indicators include indicators generated based on the frequency band characteristics of EEG signals and indicators generated based on the statistical characteristics of physiological signals, and each state assessment indicator corresponds to an independent level interval; the state assessment result set includes multiple independent level judgment results, and each level judgment result together constitutes the user's state assessment information within the detection period.

7. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 3, characterized in that, It also includes individual correction steps: When it is detected that a user has established a binding relationship with the wearable device through a login account, the user is identified as the same user, and the historical status evaluation results of the user are recorded in multiple detection processes; Based on the historical state assessment results, at least one of the state assessment threshold, feature parameter baseline, or feature weight used in subsequent detection processes is individually corrected. The individual correction is performed before the start of the detection cycle or during the state assessment calculation phase.

8. The method of using the state detection and assessment system based on head-mounted multimodal biosignals according to claim 7, characterized in that, It also includes an interactive feedback step: after the user terminal receives the user's trigger command, it provides the user with interactive feedback content related to the status assessment result based on the status assessment result, and the interactive feedback content includes audio content.

Images