Multi-directional Remote Control Using Camera-Based Position Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional remote controls are inadequate for controlling complex entertainment systems that integrate PC and TV functions, as they lack multi-directional control capabilities, leading to cumbersome navigation of graphical user interfaces and requiring multiple devices, which increases cost and clutter.

Innovation Solution

A remote control system that uses a camera to capture image data from a display, determining position information to provide multi-directional control by detecting distinctive boundaries or markers, allowing for intuitive control of GUIs and menu navigation without the need for separate devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a conventional remote control is used to control complex entertainment systems, then the system is simple to operate, but the control capability is insufficient for GUI navigation and menu control

Engineering Contradiction:
Improvecontrol capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple control functions (conventional remote control, multi-directional mouse control, and camera-based position detection) into a single integrated remote control device. This merging eliminates the need for separate control devices while providing comprehensive control capability for both traditional TV functions and complex GUI interfaces.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The remote control device is designed to perform multiple functions: it can control traditional TV functions using conventional buttons, navigate GUI interfaces using a multi-directional control stick, and detect its position relative to the display using a camera. This multi-functionality allows a single device to replace multiple specialized controllers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If a mouse type controller is added to provide multi-directional control, then the control precision is improved, but the ease of operation deteriorates due to requiring a clean flat surface and two hands

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical mouse system (which requires a flat surface and physical movement on the surface) with an optical detection system using a camera. The camera detects the position of distinctive markers on the display to determine remote control orientation and position, eliminating the need for mechanical contact with a surface while maintaining precise control capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

Instead of having the controller detect position through physical contact with a surface (mouse on flat surface), the invention inverts the approach by having the controller actively capture images of the display itself. The display becomes the reference frame, and the controller's position is determined by what it sees rather than what it touches.

Inventive Principle:
Principle #13The other way round (Inversion)

3Adaptability or versatility

If multiple separate control devices are used to provide full control functionality, then the control versatility is improved, but the device complexity and clutter increase

Engineering Contradiction:
Improvecontrol versatilityVSAvoidnumber of devices
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent integrates three distinct control functionalities into one unified remote control device: conventional button controls for basic TV functions, a multi-directional control stick for GUI navigation, and a camera-based position detection system for intuitive pointing. This consolidation reduces the number of devices from three separate controllers to a single integrated unit.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The remote control is designed as a universal controller that can handle diverse control tasks through its multiple integrated functions. It can control traditional TV operations, navigate complex GUI interfaces, and provide precise pointing control, making it suitable for a wide range of entertainment systems without requiring device-specific controllers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Ease of operation

If gyroscopic motion detection is used to provide mouse type control, then the ease of operation is improved, but the cost and complexity increase

Engineering Contradiction:
Improveease of operationVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces complex gyroscopic sensors and motion detection hardware with a simpler camera-based optical detection system. The camera captures images of distinctive markers on the display, and software processes these images to determine controller position and orientation, achieving similar functionality with lower hardware complexity and cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention introduces distinctive markers on the display as an intermediary element that facilitates communication between the remote control and the display system. These markers serve as visual references that the camera can easily detect and track, enabling precise position detection without requiring complex sensors in the remote control.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables convenient, one-handed navigation of complex entertainment systems by converting remote control motion into precise control inputs, reducing the need for multiple devices and improving user experience with enhanced control flexibility.

Implementation Method 1

capturing image data of the displayed image and display screen using the camera on the remote control

Methodology Applied
Scientific EffectImage capture and processing: Photography

Data Source

PatentUS8456534B2Multi-directional remote control system and method
Publication Date: 2013.06.04 I INTERACTIVE LLC
  • US8456534B2 patent drawing
  • US8456534B2 patent drawing
  • US8456534B2 patent drawing

AI summary

A multi-directional remote control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions employing a mouse type control. The remote controller may be conveniently held in one hand of a user and still provides full mouse type functionality. The remote control system and method images the screen of the TV or other display to detect relative motion between the controller and screen. This position information is transmitted to the entertainment system for control of a cursor or other GUI interface.