Depth and IMU Fusion for Off-Center Face Presence Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to reliably detect user presence using depth sensors, especially when the user's face is not centered in the sensor's field of view, leading to inaccurate detection and increased power consumption.
Innovation Solution
The integration of a depth sensor and an inertial measurement unit to analyze both depth sensor signals and inertial sensor signals, utilizing machine learning and inertial sensor data to determine the expected position of the user's face, enhancing detection reliability and reducing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a depth sensor alone is used to detect user presence, then the device complexity is reduced, but the detection reliability deteriorates
Solution Approach 1:
The patent combines a depth sensor and an inertial measurement unit (IMU) into an integrated sensor system. The depth sensor captures spatial information about the user's face position, while the IMU provides device orientation and motion data. By merging these two sensor types, the system achieves more reliable user presence detection than either sensor could provide alone, resolving the contradiction between simplified design and detection reliability.
Solution Approach 2:
The processor acts as an intermediary that fuses data from the depth sensor and IMU. It combines the spatial information from the depth sensor with orientation and motion data from the IMU to determine whether the user's face is within the field of view, even when the face is off-center. This intermediary processing layer enables reliable detection despite the limitations of individual sensors.
2Measurement precision
If the depth sensor continuously monitors the field of view to ensure accurate detection, then the detection precision is improved, but the energy consumption increases
Solution Approach 1:
Instead of continuous monitoring, the system uses periodic sampling combined with IMU data prediction. The processor utilizes orientation and motion data from the IMU to predict where the user's face should be located based on recent device movements. This allows the depth sensor to operate intermittently rather than continuously, reducing energy consumption while maintaining detection precision through intelligent sampling strategies.
Solution Approach 2:
The system performs preliminary analysis using IMU data before activating the depth sensor for full detection. The processor evaluates orientation and motion data to determine if user presence is likely, and only activates the power-intensive depth sensor when necessary. This preliminary filtering action reduces overall energy consumption while maintaining high detection precision when the sensor is active.
Data Source
AI summary
An electronic device includes a depth sensor and an inertial measurement unit. The electronic device detects a presence of the user of the electronic device by analyzing a combination of inertial sensor signals from the inertial measurement unit and depth sensor signals from the depth sensor.