Virtual Remote Controller Image Recognition Association

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for displaying a virtual remote controller on a screen require manual association of operation signals with virtual operation devices, which can lead to mismatches between the actual operation device on the remote controller and the associated virtual device, especially when data like the remote controller's model number is unavailable.

Innovation Solution

An information processing device that captures images of the remote controller and associates the operated operation device with the operation signal transmitted from the remote controller, using image recognition and communication with external devices to ensure accurate matching without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual association of operation signals with virtual operation devices is used, then the system can be operated, but the association accuracy deteriorates and mismatches occur between actual and virtual operation devices

Engineering Contradiction:
Improveassociation accuracyVSAvoidmanual data entry requirement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system automatically captures images of the remote controller, recognizes operation devices through image processing, and associates them with operation signals without requiring manual data entry. The remote controller itself provides the visual information needed for accurate association through its captured image.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of associating operation signals with virtual devices is replaced by an optical recognition system. The system uses image capture and processing to automatically identify and associate operation devices, substituting manual operations with automated visual recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If manual association is required, then the system structure remains simple, but the productivity deteriorates due to time-consuming manual data entry

Engineering Contradiction:
Improveassociation speedVSAvoidimage recognition system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The manual association process is replaced by an automated image recognition system that captures images of the remote controller, processes them to identify operation devices, and automatically associates them with operation signals, dramatically improving association speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a visual copy of the remote controller through image capture and uses this copy for automatic recognition and association. This optical copy enables the system to identify operation devices without physical manual intervention.

Inventive Principle:
Principle #26Copying

3Reliability

If manual association is used, then the system is easy to operate, but the reliability deteriorates when remote controller model number data is unavailable

Engineering Contradiction:
Improveoperation accuracyVSAvoidhandling unknown remote controllers
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system replaces reliance on model number data with optical recognition. By capturing and processing images of the remote controller, the system can identify operation devices based on visual characteristics rather than requiring pre-stored model information, enabling it to handle unknown or custom remote controllers.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the identification parameter from model number data to visual image data. This parameter change allows the system to recognize and associate operation devices based on the actual appearance of the remote controller rather than relying on database lookups by model number.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10200526B2Information processing device, information processing method, and program
Publication Date: 2019.02.05 SONY GROUP CORP
  • US10200526B2 patent drawing
  • US10200526B2 patent drawing
  • US10200526B2 patent drawing

AI summary

There is provided an information processing device, including a processing unit configured to associate, based on a captured image obtained by imaging a remote controller including an operation device and an operation signal transmitted from the remote controller in response to an operation on the operation device, the operated operation device with the operation signal.