Virtual Operating Interface Remote Control via Projection and Image Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional remote control methods using mechanical buttons are prone to damage, affecting the accuracy and flexibility of inputting remote commands, especially with the rise of wearable devices and diverse human-computer interaction technologies.

Innovation Solution

A remote control method and system that utilizes a control terminal to project a virtual operating interface based on voice commands, capturing graphic images at intervals to determine remote commands from fingertip interactions, thereby allowing precise and flexible input of commands without mechanical buttons.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mechanical buttons are used for remote control input, then the device structure is simple and easy to manufacture, but the buttons are easily broken and affect input accuracy

Engineering Contradiction:

Improveinput accuracyVSAvoiddevice structure

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces mechanical buttons with a projection display system that projects a virtual operating interface onto a projection surface. The system uses an image collector to capture finger operation images and determines operation types based on image analysis, thereby eliminating mechanical components and improving reliability while maintaining operational functionality.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If mechanical buttons are used for remote control, then the device is simple to operate, but the buttons are prone to damage affecting flexibility of command input

Engineering Contradiction:

Improveflexibility of command inputVSAvoidbutton durability

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The virtual operating interface can be dynamically adjusted and repositioned on the projection surface. The system can adapt to different operation scenarios by modifying the interface layout and characteristics, providing greater flexibility compared to fixed mechanical buttons.

Inventive Principle:

Principle #15Dynamics

3Reliability

If a virtual operating interface is projected for remote control, then mechanical button damage is prevented and input accuracy is improved, but the device complexity increases

Engineering Contradiction:

Improveinput accuracyVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an image collector as an intermediary component that captures finger operation images on the projection surface. This intermediary enables the system to detect operations without direct mechanical contact, achieving improved reliability while distributing system complexity across multiple functional modules rather than a single complex mechanism.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10429936B2Remote control method and system for virtual operating interface

Publication Date: 2019.10.01 SHENZHEN TCL NEW-TECH CO LTD

AI summary

The present disclosure provides a remote control method for virtual operating interface including following steps. A voice command is obtained by the to-be-controlled terminal according to a voice signal input by a user, and the voice command is sent to a control terminal. A corresponding virtual operating interface is projected by the control terminal according to the voice command. A graphic image formed by the virtual operating interface is collected by the control terminal at each preset time interval. A remote command corresponding to a location within the virtual operating interface at which a fingertip of the user keeps operating is determined by the control terminal according to the collected graphic image, and the remote command is sent to the to-be-controlled terminal, thereby controlling the to-be-controlled terminal to perform corresponding remote operations.