Signal Processing Apparatus for Multimodal Biological State Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multimodal biological sensors face challenges in ensuring consistent data quality and accounting for individual differences in sensitivity to physiological reactions, leading to suboptimal user state estimation.

Innovation Solution

A signal processing apparatus that estimates signal qualities for each modal biological signal, detects variation heterogeneity, and adjusts sensitivity to biological reactions, integrating user state estimation based on signal qualities and sensitivities to improve accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multimodal biological sensor is used to improve resistance to body motion noise, then estimation reliability is improved, but individual difference in sensitivity causes measurement precision to deteriorate

Engineering Contradiction:
Improveestimation reliabilityVSAvoidmeasurement precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by detecting variation heterogeneity specific to each modal (EEG, PPG, EDA) and estimating individual sensitivity characteristics for each sensor type. This allows the system to account for individual differences in how each modal responds to physiological changes, thereby maintaining measurement precision while using multiple modalities for reliability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the parameter of sensitivity estimation by dynamically adjusting the weightings of different modal contributions based on detected variation heterogeneity. When a modal shows atypical variation patterns, the system modifies its sensitivity parameter to compensate, ensuring accurate user state estimation despite individual differences.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If feature amounts are calculated from multimodal biological signals, then estimation capability is improved, but individual characteristics are ignored causing measurement precision to deteriorate

Engineering Contradiction:
Improveestimation capabilityVSAvoidmeasurement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback by continuously monitoring the variation characteristics of each modal and using this information to adjust sensitivity estimates. The system feeds back the detected variation heterogeneity to modify future estimations, ensuring that individual characteristics are accounted for in real-time while maintaining strong estimation capability through multimodal integration.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If signal quality estimation is performed for each modal, then measurement precision is improved, but processing time increases causing loss of time

Engineering Contradiction:
Improvesignal qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by estimating sensitivity characteristics during baseline periods or using historical data, so that when actual user state estimation is needed, the sensitivity parameters are already available. This allows rapid processing without requiring time-consuming sensitivity estimation for each measurement, thus reducing processing time while maintaining precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250000383A1Signal processing apparatus and method
Publication Date: 2025.01.02 SONY GROUP CORP
  • US20250000383A1 patent drawing
  • US20250000383A1 patent drawing
  • US20250000383A1 patent drawing

AI summary

The present technology relates to a signal processing apparatus and a method capable of improving the integration accuracy of estimation of a user state using a multimodal sensor. The signal processing apparatus estimates signal qualities for respective modals each representing a type of a biological signal of a user, detects at least one of the modals having variation heterogeneity representing that variation of the biological signal is different from a plurality of the modals, estimates a sensitivity to biological reaction of the modal based on a detection result of the modal having the variation heterogeneity, and integrally estimates a state of the user on the basis of the signal qualities and the sensitivities to the biological reaction. The present technology can be applied to a user state estimation processing system.