HMD Virtual Remote Control for Device Selection and Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote controls are inconvenient due to the need to find the correct device and navigate complex button layouts, particularly for elderly users.

Innovation Solution

A head-mounted display (HMD) generates a virtual remote control interface based on handwritten instructions on a presentation surface, allowing users to control devices through gestures or line-of-sight interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a general-purpose remote control with multiple function buttons is used, then various remote control functions can be integrated, but the interface becomes complex and inconvenient for users to operate

Engineering Contradiction:
Improveremote control functionsVSAvoiduser interface
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a virtual remote control interface that is projected or displayed on a surface, copying the essential functionality of a physical remote control. This virtual interface can be customized to show only the buttons and functions the user needs, eliminating the complexity of general-purpose remotes while maintaining versatility through software-based function selection.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual remote control interface is dynamic and adaptable - it can change its layout, buttons, and functions based on user preferences, context, or selected devices. This allows the interface to simplify itself for ease of operation while maintaining the ability to provide various remote control functions when needed.

Inventive Principle:
Principle #15Dynamics

2Reliability

If existing remote controls with fixed button layouts are used, then device control functions are available, but users spend time finding the remote control and navigating complex button arrangements

Engineering Contradiction:
Improvedevice controlVSAvoidtime to find and operate remote
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical physical remote control with a virtual interface that can be projected or displayed on various surfaces. This eliminates the need to physically locate and pick up a remote control device, as the interface can be accessed from a distance or projected onto a convenient surface, significantly reducing the time to access and operate control functions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an image processing device and projection system as intermediaries between the user and the controlled device. Instead of directly manipulating physical buttons, users interact with a virtual interface that mediates the control signals, allowing for faster access and more flexible interaction methods.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If traditional remote controls are used, then basic control functions are provided, but the interface is not user-friendly for elderly users or those with difficulties in finding and operating buttons

Engineering Contradiction:
Improvecontrol functionVSAvoiduser-friendliness
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The virtual remote control interface can be segmented or customized to show only the specific buttons and functions that a user needs, rather than presenting all possible functions. This segmented approach simplifies the interface for elderly users or those with difficulties, while maintaining full control functionality through selective button display and larger, more accessible virtual button sizes.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12380698B2Information processing terminal and remote control method
Publication Date: 2025.08.05 MAXELL LTD
  • US12380698B2 patent drawing
  • US12380698B2 patent drawing
  • US12380698B2 patent drawing

AI summary

An information processing terminal including a communication device, which transmits a control command to a controlled device via the communication device to remotely control the controlled device, comprises: a virtual remote control generator configured to identify the controlled device and a desired control operation that is a control operation desired to be performed from a surrounding image which is an image around the information processing terminal, and generate an acceptance object for accepting an operation instruction to the desired control operation from a user; an operation acceptance section configured to accept the operation instruction from the user via the acceptance object; and a command transmitter configured to transmit the control command corresponding to the operation instruction accepted by the operation acceptance section to the controlled device.