Wearable HMD Virtual Control Overlay for External Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wearable systems lack an efficient method to provide users with a seamless interface to control and interact with various devices in their environment, such as home appliances and office equipment, without the need for direct physical interaction or a dedicated user interface.

Innovation Solution

A wearable computing device equipped with a head-mounted display (HMD) that detects target devices using visual, beacon, or RFID methods, and overlays a virtual control interface onto the device's surface, allowing users to control and interact with the devices through gestures or user interface inputs, while maintaining a real-world view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a wearable computing device with HMD is used to provide virtual control interfaces, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a wearable computing device with HMD as an intermediary between the user and target devices. The HMD captures the user's field of view, identifies target devices, and overlays virtual control interfaces onto the real-world view. This mediator handles the complexity of device control, authentication, and interface management, while the user simply interacts with the virtual interface displayed in their视野, eliminating the need for physical interaction with complex target devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates virtual copies of control interfaces that are displayed through the HMD. Instead of requiring users to physically interact with the actual target device's interface, the system generates and displays a virtual replica of the control interface overlaid on the target device's location. This virtual copy contains all necessary controls and information, allowing users to interact with the target device remotely while maintaining the simplicity of a familiar interface paradigm.

Inventive Principle:
Principle #26Copying

2Loss of information

If visual display methods are used to present information, then loss of information is reduced, but ease of operation deteriorates

Engineering Contradiction:
Improveloss of informationVSAvoidease of operation
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent transitions from traditional two-dimensional display surfaces to a three-dimensional spatial display environment. The HMD projects virtual control interfaces and information overlays directly into the user's field of view at the appropriate spatial location corresponding to the target device. This dimensional change allows comprehensive information presentation without requiring the user to shift between multiple physical devices or screens, as all information is presented in the natural viewing direction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent applies different visual qualities and information densities to different regions of the user's field of view. The virtual control interface is localized to the specific spatial position of the target device, with controls, status information, and operational details presented only where relevant. This local quality approach ensures that users receive comprehensive information about each target device without being overwhelmed by global information overload, maintaining ease of operation through contextually relevant information presentation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9678654B2Wearable computer with superimposed controls and instructions for external device
Publication Date: 2017.06.13 GOOGLE LLC
  • US9678654B2 patent drawing
  • US9678654B2 patent drawing
  • US9678654B2 patent drawing

AI summary

A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.