Image-Based Remote Control for TV Application Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing entertainment systems lack efficient control capabilities for managing complex applications and menus on devices such as TVs, multimedia systems, and internet access systems, especially in living room settings.

Innovation Solution

A remote control system that captures image information from a video camera, processes it to isolate the display screen data, and uses this information to control applications, providing a multi-directional control function similar to a GUI interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If image information is captured from a video camera to control applications, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

A video camera is introduced as an intermediary device between the user and the entertainment system. The camera captures images of the display screen, and image processing software analyzes these images to determine user interactions, thereby controlling applications without requiring direct physical input devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Traditional mechanical control interfaces (remotes, keyboards, mice) are replaced with an optical-based system. Instead of direct mechanical input, the system uses image capture and analysis to infer user actions, substituting mechanical interaction with optical detection and computational processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If control capabilities are added to manage complex applications and menus, then productivity is improved, but device complexity increases

Engineering Contradiction:
ImproveproductivityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system enables self-service control by automatically analyzing the display screen content and determining appropriate control actions based on the captured images. The image processing software autonomously identifies menu items, buttons, and interface elements, eliminating the need for users to manually navigate complex controls.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops where captured images are continuously analyzed to track the state of the application interface. This feedback mechanism allows the system to adapt to different application states and provide appropriate control responses, improving productivity in managing complex software environments.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250117068A1Method for controlling an application employing identification of a displayed image
Publication Date: 2025.04.10 I INTERACTIVE LLC
  • US20250117068A1 patent drawing
  • US20250117068A1 patent drawing
  • US20250117068A1 patent drawing

AI summary

An application control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions. A control device may be conveniently held by a user and employs an imager. The control system and method images the screen of the TV or other display to detect distinctive markers displayed on the screen. This information is transmitted to the entertainment system for control of an application or is used by the control device to control an application.