Facial Image Display Control for Hands-Free Terminal Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current display control techniques require manual operations, which can be inconvenient and prone to errors, especially when hands are occupied or during tasks like eating, and do not allow for hands-free operation.
Innovation Solution
A display control method and device that uses facial movements to control terminal displays by acquiring and processing facial images to determine the coordinates of reference points, such as the pupils, and performing operations based on changes in these coordinates or their motion vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual control operations (keyboard, mouse, touch screen) are used, then display control functionality is achieved, but user hands must be free to operate and operational errors occur
Solution Approach 1:
The patent replaces manual mechanical control operations (keyboard typing, mouse clicking, touch screen contact) with an optical detection system that tracks facial features and eye gaze. The control system detects the user's line of sight and facial orientation through image processing, converting these optical signals into control commands, thereby eliminating the need for manual contact operations and enabling hands-free control while maintaining operational accuracy.
2Ease of operation
If touch screen contact operation is used, then display control is achieved, but operations are readily misjudged and unexpected clicks occur
Solution Approach 1:
The patent introduces an intermediary detection system that captures the user's facial image and eye gaze direction as intermediate signals. Instead of directly interpreting touch screen contact or keyboard input, the system uses image processing to detect the user's line of sight and facial orientation, then translates these intermediate optical signals into accurate control commands, preventing misjudgment of operation intent.
3Extent of automation
If eye-gaze detection system is implemented, then hands-free control is achieved, but device complexity increases
Solution Approach 1:
The patent utilizes the terminal device's existing camera or image sensing component, which is already present for other functions such as video calls or photo capture. By repurposing this existing imaging hardware for eye-gaze detection and facial feature tracking, the system achieves automatic hands-free control without adding dedicated specialized hardware, thereby minimizing the increase in device complexity while maintaining high automation capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables hands-free control of terminal displays, reducing operational errors and enhancing user experience by allowing control through facial actions alone, with low hardware requirements and versatile user-defined reference points.
Implementation Method 1
a facial image of a user is periodically acquired
Data Source
Figure 1~3
Figure 4~5a
Figure 5b~6a
AI summary
In order to solve a problem that current terminal display control techniques are based on manual operations, the present disclosure provides a display control method, device and terminal. The device includes an acquisition module configured to acquire periodically a facial image of a user, a processing module configured to calculate coordinates of a reference object according to the facial image and compare the coordinates of the reference object with preset coordinates, and an execution module configured to execute an operation according to a processing result; the terminal includes a sensing device configured to sense a facial image of a user, a display device configured to display content and the display control device provided by the present present disclosure, wherein the display control device is configured to acquire periodically the facial image of the user through the sensing device, calculate the coordinates of the reference object according to the facial image; and control content display of the display device according to the coordinates of the reference object and the preset coordinates. With the implementation of the present disclosure, the user can implement control of content displayed by a terminal using only facial actions rather than a keyboard, a mouse or a touch screen, thus freeing both hands of the user and enhancing user experiences.