Display Content Stabilization via Face Fiducial Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users experience discomfort due to wobble-induced changes in display content orientation when using portable terminal devices, especially during non-stationary activities, leading to dizziness and poor viewing experiences.
Innovation Solution
A display control method and apparatus that captures face images to determine face location offset values, adjusting the display content accordingly to maintain a stable orientation relative to the user, using camera-based fiducials and processing circuitry to calculate and apply display location offset values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the terminal device is used during non-stationary activities (walking, riding), then the user can move freely and conduct entertainment activities, but the display content wobbles relative to the user's eyes causing dizziness and discomfort
Solution Approach 1:
The system continuously captures face images via the camera, extracts fiducial points, calculates face location offsets, and uses this feedback to dynamically adjust display content position. This closed-loop feedback mechanism compensates for terminal movement in real-time, maintaining display stability during mobility
Solution Approach 2:
Instead of using mechanical stabilization (gyroscopes, physical dampers), the patent substitutes a computational approach using camera-based face tracking and software-based display adjustment. This replaces complex mechanical stabilization systems with lightweight image processing and coordinate transformation algorithms
2Adaptability or versatility
If the terminal screen moves relative to the user during wobble, then the display adapts to terminal movement, but the viewing experience deteriorates due to content orientation changes and dizziness
Solution Approach 1:
The system uses real-time face image feedback to detect user orientation and terminal movement, then adjusts display content position accordingly. This continuous feedback loop compensates for harmful wobble effects, preventing user discomfort while maintaining adaptability to natural movement
Solution Approach 2:
The system performs preliminary compensation by calculating the expected display offset based on face position changes before the user experiences discomfort. By proactively adjusting display content in the opposite direction of anticipated movement, it prevents harmful effects rather than merely reacting to them
3Stability of the object's composition
If face image capture and processing is performed continuously to compensate for wobble, then display stability is improved, but device complexity and energy consumption increase
Solution Approach 1:
The system extracts only the essential fiducial points from face images rather than processing entire images. By isolating and tracking specific characteristic points (eyes, nose, mouth), it reduces computational complexity while maintaining accurate face position detection for display stabilization
Solution Approach 2:
The system creates a simplified computational model (fiducial point coordinates) that copies the essential spatial information from complex face images. This abstract representation enables efficient calculation of display offsets without requiring heavy image processing, reducing device complexity
Data Source
AI summary
Aspects of the disclosure provide a method for display control. The method includes capturing, by a camera in a terminal device that is in use by a user, a first face image and a second face image of the user, extracting a first face fiducial of a characteristic point on a face of the user from the first face image and a second face fiducial of the characteristic point on the face of the user from the second face image, determining a face location offset value based on the first face fiducial and the second face fiducial, determining, based on the face location offset value, a display location offset value of content to be displayed on a display screen of the terminal device, and performing a display control of the content on the display screen according to the display location offset value.