Keyboard Touch Sensor Visual Feedback for VR Typing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users face inefficiencies when interacting with traditional computer input devices like keyboards while wearing virtual reality headsets due to the obstruction of visual feedback, leading to slower typing speeds and increased errors.

Innovation Solution

The implementation of a key assembly with a touch sensor and switch that communicates with a control device to provide visual feedback in a virtual space, allowing the head-mounted display to present a visual representation of the key assembly and fingertip interactions, enabling users to see their finger movements relative to the keys.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a virtual reality headset is worn to enable immersive experience, then immersion and engagement are improved, but visual feedback from traditional input devices is obstructed

Engineering Contradiction:

Improveimmersive experienceVSAvoidvisual feedback

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces an intermediary system consisting of sensors on the input device and a display overlay that mediates between the physical input device and the user's vision. The sensors detect interaction states and transmit this information to the display system, which then presents visual feedback through the VR headset's display elements, allowing the user to see feedback without removing the headset.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent moves the visual feedback from the traditional two-dimensional plane of the input device surface into the three-dimensional virtual space of the VR environment. By projecting visual feedback as virtual elements in the immersive environment, the system provides feedback that is both visible through the VR headset and spatially integrated into the virtual world.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If traditional input devices are used while wearing virtual reality headset, then device compatibility is maintained, but interaction efficiency and accuracy deteriorate

Engineering Contradiction:

Improvedevice compatibilityVSAvoidinteraction efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent implements a closed-loop feedback system where sensors on the traditional input device detect user interactions and transmit this information to the VR system. The system then provides immediate visual feedback through the VR display, creating a feedback loop that allows users to see the result of their actions without removing the headset, thereby maintaining interaction efficiency.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces the need for direct visual observation of mechanical input device states with an electronic sensing and digital display system. Instead of relying on optical feedback from physical key presses or mouse movements, the system uses sensors to detect states and converts them into visual representations displayed through the VR headset.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If visual feedback is provided through virtual reality display, then user awareness of input actions is improved, but system complexity increases

Engineering Contradiction:

Improvevisual feedbackVSAvoidsystem complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent leverages the multi-functionality of the VR headset, using its existing display elements and processing capabilities to provide input feedback. Rather than adding a separate dedicated feedback device, the system utilizes the VR headset's display system for multiple purposes including rendering the virtual environment and providing input device feedback, thereby reducing overall system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the input device feedback system with the VR display system by integrating sensor data from the physical input device into the virtual reality rendering pipeline. This consolidation allows visual feedback to be delivered through the same display infrastructure used for the virtual environment, reducing the need for separate feedback hardware and simplifying the overall system architecture.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS10928923B2Apparatuses, systems, and methods for representing user interactions with real-world input devices in a virtual space

Publication Date: 2021.02.23 META PLATFORMS TECHNOLOGIES LLC

AI summary

A key assembly for a keyboard may include a key cap that includes a touch sensor that is communicatively coupled to a control device. When the touch sensor senses a touch event, the touch sensor may send a touch signal to the control device, and when the touch sensor senses an absence of touch, the touch sensor may send a control signal to the control device. The key assembly may further include a switch that is communicatively coupled to the control device and that is movable between a pressed position and an un-pressed position. When the switch is in the pressed position, the switch may send a closed signal to the control device, and when the switch is in the un-pressed position, the switch may send an open signal to the control device. Various other apparatuses, systems, and methods are also disclosed.