Headset Information Processing Apparatus for Intuitive Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video image display apparatuses worn on the head, such as head-mounted displays and smart glasses, lack intuitive interaction capabilities, as users struggle to interact with video images in a natural and immersive manner.

Innovation Solution

An information processing apparatus connected to a video image display apparatus that acquires the relative position of a user's body parts and displays video images indicating the position of objects in a virtual space, allowing for intuitive interactions by aligning virtual objects with real-time user movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If video image display apparatuses are worn on the head to provide immersive viewing, then the realism and immersion of video images are improved, but the intuitiveness of user interaction with video images deteriorates

Engineering Contradiction:
Improverealism of video imagesVSAvoidintuitiveness of interaction
Core Design Contradiction:
Illumination intensityVSEase of operation

Solution Approach 1:

The system captures images of the user's body parts using imaging devices, detects their positions, and feeds back this information by displaying virtual objects corresponding to these body parts in the video image. This closed-loop feedback mechanism enables intuitive interaction as the user's natural movements are immediately reflected in the virtual environment, resolving the contradiction between immersion and interaction intuitiveness

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces body parts as intermediaries between the user and the virtual environment. By detecting and visualizing body parts (hands, feet, etc.) as virtual objects in the video image, the system creates a natural mediation layer that translates physical movements into intuitive virtual interactions, maintaining both immersion and ease of operation

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10642349B2Information processing apparatus
Publication Date: 2020.05.05 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10642349B2 patent drawing
  • US10642349B2 patent drawing
  • US10642349B2 patent drawing

AI summary

An information processing apparatus is provided that allows a user to execute, when a video image is displayed on a video image display apparatus worn on the head of the user, interactions with video images more intuitively. An information processing apparatus 10, connected to a video image display apparatus 40 worn on the head of a user, acquires information of a relative position of at least a part of the body of the user with reference to a position of the video image display apparatus 40 and displays, on the video image display apparatus 40, a video image indicative of a situation in which an object corresponding to the part is arranged at a position in a virtual space, the position being determined in accordance with the acquired relative position.