Camera Gesture Control for Handheld Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for controlling hand-held devices using camera motion are inconvenient, require additional hardware, and lack accuracy and practicality, especially for complex user interfaces.

Innovation Solution

A method and apparatus that utilize an image pickup unit to trace motion parameters, detect gestures, and output control signals without additional hardware, using a motion tracing unit, gesture model storing unit, and motion analysis unit to classify and recognize gestures for controlling applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If input keys are made small to reduce device size, then device compactness is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvedevice sizeVSAvoidease of pressing input keys
Core Design Contradiction:
Volume of moving objectVSEase of operation

Solution Approach 1:

The patent replaces the mechanical input key system with an optical motion detection system. The camera captures hand movements, and image processing algorithms translate these motions into control signals, eliminating the need for physical keys and enabling contactless operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary system consisting of the camera and image processing unit. This intermediary captures user intentions through hand gestures and converts them into control commands, serving as a bridge between the user and the device without requiring direct physical contact with small keys.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a stylus is used for input, then input accuracy is improved, but device complexity and cost increase

Engineering Contradiction:
Improveinput accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the camera serve multiple functions: it captures images for display purposes and simultaneously detects hand gestures for control input. This multi-functionality eliminates the need for separate stylus hardware while maintaining input capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The camera system performs self-service by utilizing its existing image capture capability to also serve as the input detection mechanism. The same optical sensor that displays visual information also detects user gestures, making the system self-sufficient without requiring additional specialized hardware.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If camera motion is used for control, then ease of operation is improved, but measurement precision deteriorates

Engineering Contradiction:
Improveease of controlVSAvoidpointing accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements feedback by continuously tracking hand position and gesture orientation through image processing. The system adjusts and refines the control signal based on the detected hand movement trajectory and final position, ensuring accurate translation of gestures into control commands.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary detection of hand gestures and motion vectors before executing the control command. By analyzing the preliminary hand movement pattern and position, the system can accurately determine the intended control action and refine the final control signal for precise execution.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7952561B2Method and apparatus for controlling application using motion of image pickup unit
Publication Date: 2011.05.31 SAMSUNG ELECTRONICS CO LTD
  • US7952561B2 patent drawing
  • US7952561B2 patent drawing
  • US7952561B2 patent drawing

AI summary

A method of controlling an application using a motion of an image pickup unit, the method includes storing gestures corresponding to a command to control an application, tracing a motion parameter corresponding to an image that is continuously input, detecting a gesture corresponding to the traced motion parameter from the stored gestures, and outputting a control signal of a command corresponding to the detected gesture.