HMD Contact Sensor Input for Immersive Command Entry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing head-mounted displays (HMDs) face difficulties in entering commands due to the immersive nature of the technology, which restricts their ability to see outside and interact with the system using traditional input methods.

Innovation Solution

An information processing apparatus and method that utilizes correlations between vibration patterns detected on the HMD and image patterns from an image-taking apparatus to enable manipulation inputs, allowing users to interact with the system through contact actions or gestures without the need for direct external input devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a non-transmission type HMD is worn to cover both eyes for immersive experience, then the sense of immersion and game entertainment is enhanced, but the user's ability to see outside and enter commands through a controller is significantly reduced

Engineering Contradiction:
Improvesense of immersionVSAvoidability to enter commands
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical controller input with contact-based input methods. Users can input commands by touching the HMD case at specific locations or making contact actions on the HMD, eliminating the need to look at and manipulate external controllers while maintaining immersive experience.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The HMD case serves as an intermediary input device. Contact sensors on the HMD case detect user touches and translate them into commands, allowing users to interact with the system through the HMD itself rather than requiring separate external controllers.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If traditional external controllers are used for input, then command entry is straightforward, but the user cannot fully concentrate on the screen or enjoy the sense of immersion

Engineering Contradiction:
Improvecommand entryVSAvoidsense of immersion
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent merges the display function and input function into a single integrated system. The HMD both displays the virtual reality content and detects user input through contact sensors, eliminating the need for separate external controllers and allowing users to maintain immersion while entering commands.

Inventive Principle:
Principle #5Merging (Combining)

3Volume of moving object

If the HMD case is made compact for portability, then wearability is improved, but the space for placing input sensors and processing units is reduced

Engineering Contradiction:
ImproveHMD sizeVSAvoidsensor integration
Core Design Contradiction:
Volume of moving objectVSDevice complexity

Solution Approach 1:

The patent utilizes thin-film contact sensors that can be integrated into the HMD case structure. These flexible sensors require minimal space while providing comprehensive contact detection capability across the HMD surface, allowing compact design without sacrificing input functionality.

Inventive Principle:
Principle #30Flexible shells and thin films

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Provides an intuitive and effective method for users to input commands while wearing HMDs, enhancing user interaction and immersion in virtual reality environments by leveraging existing sensors and image processing techniques.

Implementation Method 1

a vibration detection unit that detects vibration caused by user contact actions

Methodology Applied
Scientific EffectVibration detection: Vibration

Implementation Method 2

an image taking apparatus that takes an image of the user wearing the HMD

Methodology Applied
Scientific EffectImage capture: Photography

Data Source

PatentUS10303244B2Information processing apparatus, information processing method, and computer program
Publication Date: 2019.05.28 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10303244B2 patent drawing
  • US10303244B2 patent drawing
  • US10303244B2 patent drawing

AI summary

An information processing apparatus includes: a storage block configured to store at least one of a correlation between a pattern of a vibration detected on a head-mounted display as a result of a predetermined contact action and a type of data processing and a correlation between a pattern of an image outputted from an image-taking apparatus, the outputting being caused by a predetermined gesture action, and a type of data processing; an acquisition block configured to acquire at least one of information related with the detected vibration and the outputted image; and a data processing block configured to, according to each of the correlations stored in the storage block, execute at least one of data processing of the type corresponding to the detected vibration and data processing of the type corresponding to the outputted image.