Dynamic Display Area Orientation via User Face Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices with multiple display areas struggle to intuitively adapt to user intentions, particularly in terms of display area expansion and rotation, leading to inconvenience in multi-display environments.
Innovation Solution
Incorporating a sensor unit to detect device rotation, a camera to determine user face or eye direction, and a controller to adjust display area orientation and expansion based on user intent, allowing for dynamic adjustment of display areas in response to device orientation and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple display areas are provided in one screen, then task execution capability is improved, but display area adaptability to user intention deteriorates
Solution Approach 1:
The display areas are made dynamic by allowing their size, shape, and position to change automatically based on sensor inputs (accelerometer, gyro sensor) and camera detection of user face direction. The controller continuously adjusts the display configuration to match device orientation and user gaze, transforming static display regions into adaptive, living spaces that respond to real-time user context.
Solution Approach 2:
The system implements feedback loops where the camera captures user face direction and the sensor unit detects device orientation, feeding this information back to the controller. The controller then adjusts the display areas accordingly, creating a closed-loop system that continuously adapts to user intention. This feedback mechanism enables the display to 'understand' and respond to user preferences automatically.
2Adaptability or versatility
If automatic rotation function is implemented, then display direction adaptation is improved, but complexity of determining display direction in multi-display environment deteriorates
Solution Approach 1:
The camera acts as an intermediary between the user and the display system. Instead of directly processing complex sensor data from multiple axes, the camera captures the user's face direction as a visual reference point. This intermediary element simplifies the determination of which display area should be expanded, as the controller only needs to compare camera-derived face direction with the current display layout rather than calculating optimal orientations from multiple sensor inputs.
Solution Approach 2:
The sensor unit serves multiple functions: it detects both device rotation for traditional automatic rotation and provides orientation data for determining display area expansion direction. The accelerometer and gyro sensor data are reused across different determination methods (face direction-based and holding position-based), reducing the need for separate sensing systems and simplifying the overall complexity.
3Ease of operation
If display area expansion is enabled, then user interaction intuitiveness is improved, but precision of display area control deteriorates
Solution Approach 1:
The system performs preliminary determination of user intention before executing display area expansion. The camera captures the user's face direction in advance, and the controller pre-calculates which display area should be expanded and by how much, based on the detected face direction and current layout. This preliminary action ensures that when expansion occurs, it precisely matches user expectation without requiring real-time adjustment during the expansion process.
Solution Approach 2:
The system changes display area parameters (size, position, shape) in a controlled sequence. First, the controller determines the target display area for expansion based on face direction. Then, it calculates the optimal expansion parameters to maintain proportional relationships with other display areas. Finally, it applies these parameter changes smoothly, ensuring both intuitiveness and precision in the expansion process.
Data Source
AI summary
An electronic device and a method of controlling a screen display of the electronic device are provided. The method includes displaying, in one screen, a first display area in which a main task is executed and a second display area in which a sub-task is executed; detecting a rotation of the electronic device; determining a direction of a user's face relative to the electronic device; and determining a direction of the display area based on an angle between a direction of the electronic device and the determined direction of the user's face.