Display Rotation via Sensor Fusion and Eye Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional auto-rotation techniques in computing devices, relying on accelerometers and upright orientation, are ineffective when devices are placed flat or when users interact while lying down, leading to incorrect positioning of on-screen elements and user interfaces, causing user frustration and confusion.
Innovation Solution
Enhanced display rotation techniques that utilize a combination of sensor data from cameras, compasses, accelerometers, and other sensors to determine the positional relationships between the device and user, allowing for more accurate control of on-screen element arrangement and rotation based on calculated positions and alignments, including eye tracking and gaze detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If accelerometer based auto-rotation techniques are used, then device rotation control is simple, but positioning accuracy deteriorates when device is placed flat or user is lying down
Solution Approach 1:
The patent combines multiple sensors (accelerometer, gyroscope, magnetometer, camera) to detect device orientation and user position. This sensor fusion approach overcomes the limitations of individual sensors, particularly the accelerometer's inability to accurately detect orientation when the device is placed flat or when the user is in non-upright positions.
Solution Approach 2:
The patent introduces camera-based eye tracking and gaze detection as an intermediary to determine user position and intent. This intermediary system provides additional context about user interaction, enabling more accurate determination of whether the user is lying down or the device is placed flat, thereby improving position detection accuracy.
2Measurement precision
If multiple sensors are used to improve position detection accuracy, then measurement precision improves, but device complexity and power consumption increase
Solution Approach 1:
The patent dynamically adjusts sensor activation based on detected conditions. For example, the camera and other sensors are selectively activated only when needed (such as when ambiguity about user position is detected), rather than continuously. This dynamic approach maintains high measurement precision while reducing overall system complexity and power consumption.
Solution Approach 2:
The system changes operational parameters of sensors based on context. Sensors are activated or deactivated based on detected device orientation, user position, and interaction patterns. This parameter changes approach allows the system to maintain accuracy when needed while minimizing complexity and power usage during normal operation.
3Measurement precision
If continuous sensor activation is used, then measurement precision is maintained, but power consumption increases
Solution Approach 1:
The patent implements periodic sensor activation rather than continuous operation. Sensors are activated at specific intervals or triggered by specific events (such as detected changes in device orientation or ambiguous positioning scenarios). This periodic action maintains measurement precision when needed while significantly reducing overall power consumption during steady-state operation.
4Ease of manufacture
If conventional rotation techniques are used, then implementation is simple, but adaptability to different user scenarios deteriorates
Solution Approach 1:
The patent creates a universal auto-rotation system that handles multiple user scenarios (upright holding, lying down, device placed flat, various viewing angles) through a single integrated sensor fusion approach. This multi-functional system replaces multiple scenario-specific implementations, maintaining ease of manufacture while dramatically improving adaptability to different user situations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides more accurate and user-friendly auto-rotation results, supporting additional scenarios such as devices on flat surfaces and wearable devices, while optimizing power and resource usage by selectively activating sensors.
Implementation Method 1
at least a camera to obtain eye tracking data
Implementation Method 2
a compass used to determine an alignment of the device
Implementation Method 3
data from an accelerometer
Data Source
AI summary
Enhanced display rotation techniques are described in which arrangement of on-screen elements and user interfaces may be controlled based upon a combination of inputs from a sensor system of a device indicative of positional relationships. Output positions for elements are controlled in dependence upon a calculated position of a user in relation to the device and alignment of the device with a magnetic direction. The position and alignment may be derived based on sensor data, including at least a camera to obtain eye tracking data and a compass used to determine an alignment of the device. Other factors may also be considered such as data from an accelerometer, facial tracking by the camera, gaze detection, a proximity sensor, and other sensor data. Responsive to manipulation of the device, rotation and/or location of the elements may be controlled in accordance with the positional relationships that are ascertained.