Earbud Sensor Fusion for Accurate Use-State Feature Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices, particularly headphones and earbuds, require cumbersome manual user interactions for configuring features before, during, and after each use, and current automatic detection methods are prone to false positives and negatives, leading to disruptive errors.
Innovation Solution
A system and method utilizing multiple sensors, including force, IMU, and proximity sensors, along with sensor fusion and machine learning, to accurately detect the use state of electronic devices, enabling automatic and robust configuration of features based on wear state, orientation, and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual control methods are used to configure device features, then users can precisely control each feature, but the operation becomes cumbersome and time-consuming
Solution Approach 1:
The system automatically detects device state through multiple sensors and configures features without user intervention. The processor fuses data from force, IMU, proximity, and temperature sensors to autonomously determine wear state and adjust audio settings, eliminating manual configuration steps
Solution Approach 2:
The system performs preliminary detection of device state using multiple sensors before feature configuration is needed. By continuously monitoring sensor data and predicting wear state in advance, the system prepares appropriate audio settings before the user actually needs them
2Extent of automation
If automatic use state detection is implemented, then user interaction is reduced, but false positives and negatives occur leading to disruptive errors
Solution Approach 1:
The system merges data from multiple independent sensors (force, IMU, proximity, temperature) to detect device state. By combining these different sensor modalities, the system cross-validates detections and eliminates false positives that would occur with single-sensor approaches
Solution Approach 2:
The system continuously monitors sensor data and compares current state against previous states and thresholds. This feedback mechanism allows the processor to confirm detections and correct false positives by analyzing trends across multiple time points and sensor readings
3Reliability
If multiple sensors are used to improve detection accuracy, then use state detection becomes more reliable, but device complexity increases
Solution Approach 1:
The system uses a single processor to perform multiple functions: fusing sensor data, detecting wear state, predicting future states, and controlling audio features. This multi-functional approach consolidates complexity into one component rather than requiring separate processing units for each function
Solution Approach 2:
The system performs preliminary processing of sensor data to create normalized representations and thresholds before actual wear state detection is needed. By pre-processing and organizing sensor data in advance, the system reduces the computational complexity required during real-time decision-making
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Electronic device (100) comprises a plurality of sensors (220) and at least one processor (340) adapted to receive first type of data from at least one first sensor (320) and second type of data from at least one second sensor (344) and, from the first type of data and the second type of data, to: determine a current use state of the electronic device, and compare the current use state to a previous use state of the electronic device, if the current use state is different from the previous use state, change a status of at least one feature of the electronic device based on the current use state, and if the current use state is the same as the previous use state, maintain a status of at least one feature of the electronic device.