Virtual Plane UI Control via Marker Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for controlling electronic devices, such as TVs, are cumbersome due to the complexity of remote controls and require users to be within a restricted radius, with limited flexibility in operation and installation, and often fail to accurately detect user inputs under varying illumination conditions.

Innovation Solution

A method and apparatus that utilize a virtual plane initialized by spatial coordinates from multiple image capture devices, allowing users to control electronic devices from any location by detecting markers and moving a screen pointer to select menu options, enabling convenient operation without the need for physical controllers or fixed installations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple image capture devices are installed at fixed locations to detect user input, then the electronic device can be controlled according to three-dimensional position, but the installation becomes complex and the device can only be used at fixed locations

Engineering Contradiction:

Improvethree-dimensional position detection accuracyVSAvoidinstallation complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a marker (physical object) as a copy or representation of the user's hand position, which can be detected by the image capture device. This marker serves as a simplified intermediary that translates complex hand gestures into detectable visual signals, reducing the complexity of direct hand position detection while maintaining three-dimensional positioning accuracy.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent introduces a marker as an intermediary object between the user and the electronic device control system. The marker acts as a mediator that carries position information from the user's hand to the image capture device, simplifying the detection process and enabling flexible positioning without requiring complex direct hand gesture recognition.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If skin color detection is used to identify user hand, then the system can detect user input, but detection fails when illumination conditions change

Engineering Contradiction:

Improvecontactless control convenienceVSAvoiddetection reliability under varying illumination

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent uses a marker with specific color characteristics that can be reliably detected by the image capture device. The marker's color properties are designed to be distinguishable and stable under various illumination conditions, replacing the unreliable skin color detection method with a controlled, known color reference that maintains detection reliability across different lighting environments.

Inventive Principle:

Principle #32Color changes

3Measurement precision

If a fixed light beam region is used for image capture, then the system can detect user input within that region, but the user's radius of action is restricted

Engineering Contradiction:

Improveuser input detection accuracyVSAvoiduser movement flexibility

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements a virtual plane that can dynamically adapt to the user's position and movements. The detection region is not fixed but can be adjusted and repositioned based on the user's location, allowing the user to control the electronic device from various positions within the room while maintaining accurate input detection through the flexible, movable virtual plane.

Inventive Principle:

Principle #15Dynamics

4Measurement precision

If multiple image capture devices are installed on wall or ceiling, then fingertip position can be detected in three dimensions, but the installation location becomes fixed and inconvenient

Engineering Contradiction:

Improvefingertip three-dimensional position detectionVSAvoidinstallation convenience

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent uses a marker as a portable copy or representation of the user's hand position, which can be detected by a single or minimal number of image capture devices. This marker-based approach eliminates the need for multiple fixed installations on walls or ceilings, as the marker can be held and moved freely by the user, providing three-dimensional position detection with minimal installation requirements.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS9052744B2Method and apparatus for controlling user interface of electronic device using virtual plane

Publication Date: 2015.06.09 SAMSUNG ELECTRONICS CO LTD

AI summary

Provided is a method and apparatus for controlling a user interface (UI) of an electronic device by using a specific region of a virtual plane. In the method, the virtual plane is initialized according to spatial coordinates of two or more images detected by using locations of the images displayed in an image display unit of a first image capture device and an image display unit of a second image capture device. Furthermore, the location of a marker is determined and is indicated by a specific image on the virtual plane. Furthermore, a screen pointer corresponding to the marker is displayed at a position where the marker is located in an image display unit corresponding to the virtual plane. Furthermore, a menu of the electronic device is selected which is pointed to by the screen pointer while moving the marker. Accordingly, a user can conveniently control the UI of the electronic device by performing a simple operation.