Vision Pixels for Mobile Terminal Gesture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile terminal control methods rely heavily on hardware interfaces like keypads and touchscreens, which are limited and consume excessive power when using vision recognition schemes that process large amounts of unnecessary pixel information, leading to increased operation time and battery consumption.
Innovation Solution
Designating a subset of pixels in an image sensor as 'vision pixels' for low-power vision recognition, allowing for efficient detection of user interactions without direct input, using a configuration that includes a Bayer pattern color filter and converting optical information into digital signals for fast processing and reduced power usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If vision recognition scheme processes all pixels from captured image, then vision recognition accuracy is improved, but power consumption increases and operation time increases
Solution Approach 1:
The patent divides the image sensor pixels into two distinct groups: vision pixels (first pixel group) dedicated to vision recognition tasks and imaging pixels (second pixel group) dedicated to full-image capture. This segmentation allows the system to process only necessary pixels for vision recognition, reducing computational load and power consumption while maintaining recognition accuracy.
Solution Approach 2:
The patent extracts and isolates only the necessary pixel information for vision recognition by designating specific pixels as vision pixels. This extraction principle enables the system to disregard unnecessary pixel data, thereby reducing processing time and energy consumption while preserving the essential information needed for accurate vision recognition.
2Measurement precision
If vision recognition scheme processes all pixels from captured image, then vision recognition accuracy is improved, but operation time increases
Solution Approach 1:
The patent divides the image sensor pixels into two distinct groups: vision pixels (first pixel group) dedicated to vision recognition tasks and imaging pixels (second pixel group) dedicated to full-image capture. This segmentation allows the system to process only necessary pixels for vision recognition, reducing computational load and operation time while maintaining recognition accuracy.
Solution Approach 2:
The patent applies partial action by processing only a subset of pixels (vision pixels) rather than all pixels in the captured image. This partial processing approach is sufficient for vision recognition tasks, significantly reducing operation time and computational resources while maintaining adequate recognition accuracy for the intended application.
3Ease of operation
If hardware UI (keypad, touchscreen) is used for control, then direct user input is achieved, but control flexibility and user experience are limited
Solution Approach 1:
The patent replaces traditional mechanical UI elements (keypad, touchscreen) with a vision-based control system. By using vision pixels to detect user interactions such as hand gestures or presence, the system eliminates the need for physical input devices, thereby enhancing control flexibility and user experience while maintaining ease of operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables intuitive control of mobile terminals with reduced power consumption and faster operation by selectively using vision pixels for vision recognition, improving user experience and convenience while minimizing battery usage.
Implementation Method 1
an image sensor... converts optical information including a large number of pixels into image data
Data Source
Figure 1~2
Figure 3
AI summary
A method and apparatus for controlling a mobile terminal through use of user interaction are provided. The method includes operating in a vision recognition mode that generates a vision recognition image through use of a signal output from a second plurality of pixels designated as vision pixels from among a plurality of pixels of an image sensor included in the mobile terminal; determining whether a predetermined object in the vision recognition image corresponds to a person; determining a gesture of the predetermined object when the predetermined object corresponds to the person; and performing a control function of the mobile terminal corresponding to the gesture of the predetermined object.