Mobile Phone Interface Adaptation via Image-Based Orientation Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile phones with multiple functionalities require adaptive man/machine interface parameters based on user orientation, which existing technologies fail to automatically detect and adjust effectively.
Innovation Solution
A method using an image sensor to analyze the scene in front of the device, detecting the user's face and eye axis to determine the device's orientation and adjust parameters such as display mode, sound channels, and antenna usage based on the user's position, automatically adapting the interface to 'portrait' or 'landscape' modes and optimizing settings for energy consumption and radio frequency exposure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If manual control of display orientation is implemented, then user control over interface adaptation is improved, but ease of operation deteriorates due to additional user actions required
Solution Approach 1:
The system automatically detects user orientation and adjusts display orientation and interface parameters without user intervention. The detection unit captures images, the analysis unit determines user position, and the control unit automatically configures the interface, making the system self-adapting rather than requiring manual user control.
Solution Approach 2:
The patent replaces manual mechanical rotation of the device with an automatic image-based detection and control system. Instead of physically rotating the device to change orientation, the system uses image capture, analysis, and automated control to achieve the same interface adaptation effect.
2Adaptability or versatility
If multiple functionalities are added to mobile phones, then adaptability is improved, but device complexity increases
Solution Approach 1:
The image sensor serves multiple functions: it captures images for user orientation detection, analyzes scene blur and brightness to determine ear-based usage, detects user faces, and estimates distances. This single component performs what would otherwise require multiple separate sensors and systems, reducing overall device complexity while maintaining high adaptability.
Solution Approach 2:
The patent combines detection, analysis, and control functions into an integrated system. The detection unit, analysis unit, and control unit work together as a unified multi-functional module that handles various detection tasks (orientation, ear-based usage, face detection, distance estimation) and automatically adjusts multiple interface parameters simultaneously.
3Ease of operation
If automatic image analysis is implemented, then ease of operation is improved, but use of energy increases due to continuous image processing
Solution Approach 1:
The system performs image capture and analysis periodically or on-demand rather than continuously. Image processing is triggered by specific events or time intervals, allowing the system to balance automatic adaptation with energy conservation by processing images only when necessary for interface adjustment.
Solution Approach 2:
The system uses the image sensor to create a visual copy of the scene for analysis, rather than requiring direct physical interaction or continuous high-power sensing. This optical copying method is energy-efficient compared to continuous active sensing or mechanical detection methods.
4Measurement precision
If face detection and eye axis analysis are implemented, then measurement precision of user orientation is improved, but difficulty of detecting and measuring increases
Solution Approach 1:
The system performs preliminary face detection before proceeding to more complex eye axis analysis. The detection unit first identifies the presence of a face, then the analysis unit sequentially analyzes facial features and eye positions. This staged approach simplifies the overall detection process by breaking it into manageable steps that build upon each other.
Solution Approach 2:
The analysis unit acts as an intermediary between the image sensor and the control unit. It processes the raw image data, extracts relevant features (face position, eye axis), and translates them into meaningful orientation information for the control unit, simplifying the overall measurement chain.
Data Source
Figure 1~3
Figure 4~5
Figure 6
AI summary
The invention aims to provide a way to adapt the human-machine interface parameters of a mobile phone based on the phone's orientation relative to the user. This orientation is automatically detected by analyzing the image of the scene in front of the phone. In a particular embodiment of the invention, the phone attempts to identify the user's face, and specifically the eye axis, to determine its orientation relative to the user. In this way, a user can, for example, switch their phone's display to portrait mode simply by rotating the phone.