Image Sensor Gesture Recognition for Portable Device Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current man-machine interfaces (MMIs) in portable devices, such as miniaturized keyboards and touch screens, are limited by their size, price, and inability to efficiently convert complex movement patterns into control signals for textual input or function control, restricting user interaction and configurability.
Innovation Solution
A device and method utilizing an image sensor to detect predefined complex self-motions, converting digital images into control signals through a motion vector detection and matching module, allowing users to input characters or control functions via predefined movement patterns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If traditional MMIs (miniaturized keyboards or touch screens) are used, then device size is reduced, but user interaction efficiency and configurability deteriorate
Solution Approach 1:
The patent replaces traditional mechanical MMIs (keyboards, touch screens with conductive layers) with an image sensor-based system that captures movement patterns. The image sensor detects complex self-motions of the device, converting them into control signals through motion vector analysis and pattern matching, thereby eliminating the need for physical keyboards or transparent conductive touch screens.
Solution Approach 2:
The image sensor serves multiple functions: it acts as both the primary input device for capturing movement patterns and as a camera for capturing images. The system can recognize various predefined movement patterns (characters, symbols, gestures) and convert them into different control signals, making a single component perform multiple input functions.
2Volume of moving object
If traditional MMIs are miniaturized to fit portable devices, then device portability is improved, but the ability to input complex characters or signs deteriorates
Solution Approach 1:
The patent transitions from two-dimensional keyboard input to three-dimensional movement pattern recognition. The image sensor captures the device's movement through space, analyzing motion vectors in multiple dimensions (x, y, z coordinates over time). This allows complex characters and signs to be input through spatial trajectories rather than being constrained to a limited keyboard layout.
Solution Approach 2:
The system captures and analyzes motion vectors that represent the physical movement of the device, creating a digital copy of the movement pattern. These motion vectors are then processed and matched against predefined patterns to recognize intended characters or commands, effectively copying the physical gesture into a recognizable input form.
3Adaptability or versatility
If image sensors are integrated into portable devices, then additional input possibilities are opened, but the ability to convert complex movement patterns into control signals deteriorates
Solution Approach 1:
The patent divides the complex task of movement pattern recognition into distinct modular components: an image sensor for capturing images, a motion vector detection module for generating motion data, an amalgamating module for processing sequences of motion vectors, and a pattern matching module for recognizing predefined patterns. This segmentation makes the complex conversion process manageable and implementable.
Data Source
AI summary
A device for converting digital images taken along a predefined movement pattern into a control signal. The device comprises an image input device having a connection to a image sensor. The image input device is adapted to receive the digital images captured during the displacement of the image sensor and determine whether motion measured therein corresponds to any prestored movement pattern, that is to say to a predefined gesture. The device further comprises a movement pattern converter to convert the recognized pattern into the control signal.