Virtual Terminal Overlay for Intuitive VR Input Alignment

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing virtual reality display devices require continuous attention and concentration to avoid overlooking virtual input elements, leading to potential erroneous operations due to user fatigue.

Innovation Solution

A virtual input system that includes a virtual input device and method for analyzing captured image data to specify the position of virtual terminals on a display, generating display information based on user information, and outputting it to the virtual reality display device, allowing for continuous and intuitive operation of virtual terminals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user interface is implemented in virtual space requiring continuous visual recognition, then interaction capability is improved, but user fatigue increases and error rate rises

Engineering Contradiction:

Improveinteraction capabilityVSAvoiderror rate

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent merges the virtual terminal interface with the real-world physical terminal by superimposing virtual display elements onto the physical terminal's camera feed. This combination allows users to interact with virtual interfaces while maintaining awareness of the physical environment, reducing fatigue and errors associated with fully immersive virtual interfaces.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The camera display acts as an intermediary between the physical terminal and the user. Instead of requiring direct visual focus on virtual elements in VR space, the camera capture display provides a mediated view that combines physical terminal imagery with overlaid virtual interface elements, enabling interaction with reduced cognitive load.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If a camera capture display is superimposed on the physical terminal, then operational continuity is improved, but device complexity increases

Engineering Contradiction:

Improveoperational continuityVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The physical terminal serves multiple functions: it acts as both a traditional input device and a display device for the camera capture feed. This multi-functionality allows the system to provide continuous operational feedback without requiring separate dedicated display hardware, thereby managing complexity while maintaining productivity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The physical terminal's existing camera and display capabilities are utilized to provide operational continuity feedback. The system leverages the terminal's own hardware resources (camera, screen) to deliver continuous visual feedback about the virtual interface state, eliminating the need for additional external monitoring devices.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS12625521B2Virtual input device, virtual input system, virtual input method, and recording medium

Publication Date: 2026.05.12 NEC PLATFROMS LTD

AI summary

Provided is a virtual input device that includes an input/output unit that acquires image data captured by a camera of a virtual reality display device and output display information to be displayed on a display of the virtual reality display device to the virtual reality display device, a video analysis unit that analyzes the image data to specify a position at which a virtual terminal is to be displayed, and a display information generation unit that generates the display information including the virtual terminal based on user information of a user wearing the virtual reality display device.