Video-Based Control Interface for Electronic Appliances

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote control systems for electronic appliances, such as television sets, face difficulties in accurately detecting user operations when multiple control buttons are present, especially when the hand and other objects are superimposed, leading to user inconvenience.

Innovation Solution

A system that includes a video camera, mirror image converter, operational image generator, mixer, detector, and controller to create a mixed image on the display, allowing the system to detect user operations by overlaying detection zones corresponding to control buttons and prioritizing them for accurate control signal generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a video camera is used to detect hand motion for remote control operations, then the need for a physical remote controller is eliminated and user flexibility is improved, but the system fails to accurately detect the intended control button when the hand overlaps multiple buttons or when other objects are superimposed

Engineering Contradiction:
Improveremote control operationVSAvoidbutton detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The display screen is divided into multiple detection zones, each corresponding to a specific control button. The detector independently monitors hand motion within each zone, allowing precise identification of which button the user intends to operate even when the hand overlaps multiple buttons. This segmentation resolves the ambiguity in detecting the intended target.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different detection zones are assigned different priorities based on their position and function. When hand motion is detected in multiple zones simultaneously, the system applies local quality rules to determine which zone's detection should take precedence, enabling accurate button identification despite overlapping detections.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If multiple detection zones are used to cover all control buttons, then comprehensive button detection is achieved, but the system cannot determine which button should be activated when the hand overlaps multiple zones

Engineering Contradiction:
Improvedetection zone coverageVSAvoidintended button identification
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

Prior to actual operation, the system pre-establishes priority relationships among all detection zones. When hand motion triggers multiple zones simultaneously, the predetermined priority information is immediately applied to resolve the ambiguity and identify the intended button, preventing loss of information about user intent.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides feedback by highlighting or indicating which detection zone has been selected for activation. This feedback mechanism confirms to the user that the system has correctly identified the intended button, and allows the user to correct the selection if necessary, thereby preventing erroneous operations.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8144121B2Method and apparatus for controlling electronic appliance
Publication Date: 2012.03.27 JVC KENWOOD CORP
  • US8144121B2 patent drawing
  • US8144121B2 patent drawing
  • US8144121B2 patent drawing

AI summary

An apparatus for controlling an electronic appliance having a display is provided. A plurality of control buttons are displayed on the display. An operator in front of the display is photographed with a video camera and is displayed on the display. The operator holds his or her hand to specify one of the control buttons on the display. The control buttons are provided with numbers or marks according to the order of priority. A feature detector of the apparatus detects various features from the photographed image. According to the features, a controller of the apparatus selects one of the control buttons on which the hand of the operator is superimposed and carries out an operation corresponding to the selected control button with respect to the electronic appliance.