Sensor Fusion for User Presence Detection in Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile computing devices face challenges in enabling user interaction when touch-based interaction is not feasible, such as in scenarios where the user is separated from the device by a distance, requiring innovative methods to detect user presence and transition device states accordingly.
Innovation Solution
The system employs a combination of sensors, including touch, vibration, acoustic, and image sensors, to generate sensor data signatures that determine user presence through sensor fusion techniques, using a decision engine and context engine to evaluate real-time data against historical patterns and adjust sensor weights for accurate detection and state transitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based interaction is used, then user interaction is enabled, but user interaction becomes infeasible when user is separated from device by distance
Solution Approach 1:
The patent replaces touch-based mechanical interaction with sensor-based detection systems. Multiple sensors (microphones, cameras, motion detectors) detect user presence and trigger appropriate device states, eliminating the need for physical contact while maintaining interaction capability across various distances.
Solution Approach 2:
The patent introduces sensor data and device states as intermediaries between the user and the device. Sensors detect user presence and convert it into actionable device states (locked, unlocked, power modes), enabling indirect interaction that works at various distances without requiring direct touch.
2Measurement precision
If multiple sensors are used for user presence detection, then detection accuracy is improved, but device complexity increases
Solution Approach 1:
The patent divides the detection system into multiple independent sensor modules, each responsible for specific detection tasks (audio, visual, motion). This segmentation allows each sensor to be optimized for its specific function while maintaining overall system manageability and accuracy through modular architecture.
Solution Approach 2:
The patent combines data from multiple different sensor types (audio, visual, motion sensors) to create a comprehensive user presence determination. By merging diverse sensor inputs, the system achieves high detection accuracy while using standard off-the-shelf components rather than a single complex sensor.
3Use of energy by moving object
If device transitions between power states based on user presence, then energy efficiency is improved, but response time may be affected
Solution Approach 1:
The patent keeps sensors active and monitoring even when the device is in low-power states, performing preliminary detection of user presence. When a user approaches, the system has already detected their presence and can transition states quickly, reducing perceived response time while maintaining energy efficiency through selective sensor activation.
Solution Approach 2:
The patent uses periodic sensor activation and state checking to balance energy consumption and response time. Sensors are activated at intervals to detect user presence, and the system periodically evaluates whether state transitions are needed, achieving energy efficiency without completely sacrificing responsiveness to user needs.
Data Source
AI summary
A decision engine executing on an electronic device may determine, using sensor data captured by multiple sensors of the device, whether a user is present in an environment that includes the device. If the user is determined to be present in the environment, the device may transition from a first state to a second state. The first state may be a first power state of the device in which the device is powered off or an idle or dormant state in which the device is powered on but a display of the device is powered off. Correspondingly, the second state may be a second power state of the device in which the device and the display are powered on and content is being rendered on the display. If the decision engine cannot make a determination based on the sensor data, a context engine may adjudicate the user presence determination.