Virtual Keyboard Input in 3D Immersive Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing virtual reality headset devices cannot see actual keyboard positions in a 3D immersive environment, making it difficult to input information effectively.

Innovation Solution

Displaying a virtual keyboard within the 3D immersive environment, allowing users to select key positions using various methods such as handle operation, gyroscope-controlled cursor movement, or touch panel interaction, and sending confirmation instructions to input information into an input box.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a user wears a virtual reality headset device to enter a 3D immersive environment, then the user experiences immersive visualization, but the user cannot see actual keyboard positions in reality and cannot input information

Engineering Contradiction:
Improveimmersive environment capabilityVSAvoidinformation input capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a virtual keyboard that replicates the functionality and visual appearance of a physical keyboard within the 3D immersive environment. The virtual keyboard includes key positions that correspond to actual keyboard layouts, allowing users to input information by selecting virtual keys rather than physical keys, thus solving the contradiction between immersive experience and input capability

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a cursor as an intermediary tool that mediates between the user's actions and the virtual keyboard. The cursor moves to indicate selected key positions and facilitates the selection process, enabling users to interact with the virtual keyboard through controlled movement and confirmation actions rather than direct physical key pressing

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a virtual keyboard is displayed in the 3D immersive environment, then the user can see keyboard positions, but the user interface becomes more complex

Engineering Contradiction:
Improvekeyboard visibilityVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent inverts the traditional input approach by placing the keyboard within the virtual environment rather than having the user look at a physical keyboard outside the environment. This inversion allows the keyboard to be part of the immersive experience while maintaining familiar layouts, reducing the cognitive load and perceived complexity

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent makes only the necessary parts of the interface visible and interactive - specifically the virtual keyboard and cursor - while keeping the rest of the 3D environment intact. This localized approach to UI elements maintains immersion without overwhelming the user with excessive interface complexity

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables convenient and quick information input by typewriting in the virtual environment, accommodating different user preferences and demands through multiple input control methods.

Implementation Method 1

a system where the 3D immersive environment lies comprises a handle having a gyroscope function; the selecting a key position on the virtual keyboard and determining the selected key position specifically comprises: displaying a virtual cursor in the immersive environment; collecting spatial movement information of the handle via the gyroscope of the handle, and controlling movement of the virtual cursor in the immersive environment

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentUS10417826B2Information input method in 3D immersive environment
Publication Date: 2019.09.17 BEIJING PICO TECH
  • US10417826B2 patent drawing
  • US10417826B2 patent drawing
  • US10417826B2 patent drawing

AI summary

The present disclosure discloses an information input method in a 3D immersive environment, comprising: displaying a virtual keyboard in the 3D immersive environment; selecting a key position on the virtual keyboard and determining the selected key position; and sending a confirmation instruction to the selected key position, and inputting information corresponding to the selected key position into an information input box to thereby complete information input for one time. Displaying the virtual keyboard to the user in the 3D immersive environment and receiving the user's selection and confirmation instruction of the key position on the virtual keyboard solves the problem that the user, wearing the virtual reality headset device, cannot see actual key positions of a keyboard in reality and cannot input information and enables the user to conveniently and quickly input information by typewriting in the virtual environment.