Signal Processing Apparatus for Multimodal Biological State Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multimodal biological sensors face challenges in ensuring consistent data quality and accounting for individual differences in sensitivity to physiological reactions, leading to suboptimal user state estimation.
Innovation Solution
A signal processing apparatus that estimates signal qualities for each modal biological signal, detects variation heterogeneity, and adjusts sensitivity to biological reactions, integrating user state estimation based on signal qualities and sensitivities to improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multimodal biological sensor is used to improve resistance to body motion noise, then estimation reliability is improved, but individual difference in sensitivity causes measurement precision to deteriorate
Solution Approach 1:
The patent applies local quality by detecting variation heterogeneity specific to each modal (EEG, PPG, EDA) and estimating individual sensitivity characteristics for each sensor type. This allows the system to account for individual differences in how each modal responds to physiological changes, thereby maintaining measurement precision while using multiple modalities for reliability.
Solution Approach 2:
The system changes the parameter of sensitivity estimation by dynamically adjusting the weightings of different modal contributions based on detected variation heterogeneity. When a modal shows atypical variation patterns, the system modifies its sensitivity parameter to compensate, ensuring accurate user state estimation despite individual differences.
2Productivity
If feature amounts are calculated from multimodal biological signals, then estimation capability is improved, but individual characteristics are ignored causing measurement precision to deteriorate
Solution Approach 1:
The patent implements feedback by continuously monitoring the variation characteristics of each modal and using this information to adjust sensitivity estimates. The system feeds back the detected variation heterogeneity to modify future estimations, ensuring that individual characteristics are accounted for in real-time while maintaining strong estimation capability through multimodal integration.
3Measurement precision
If signal quality estimation is performed for each modal, then measurement precision is improved, but processing time increases causing loss of time
Solution Approach 1:
The system performs preliminary action by estimating sensitivity characteristics during baseline periods or using historical data, so that when actual user state estimation is needed, the sensitivity parameters are already available. This allows rapid processing without requiring time-consuming sensitivity estimation for each measurement, thus reducing processing time while maintaining precision.
Data Source
AI summary
The present technology relates to a signal processing apparatus and a method capable of improving the integration accuracy of estimation of a user state using a multimodal sensor. The signal processing apparatus estimates signal qualities for respective modals each representing a type of a biological signal of a user, detects at least one of the modals having variation heterogeneity representing that variation of the biological signal is different from a plurality of the modals, estimates a sensitivity to biological reaction of the modal based on a detection result of the modal having the variation heterogeneity, and integrally estimates a state of the user on the basis of the signal qualities and the sensitivities to the biological reaction. The present technology can be applied to a user state estimation processing system.


