Information Processing Device for 3D Spatial Interaction in Photographic VR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Photographic VR content lacks three-dimensional spatial interaction, as 2-dimensional captured images fail to provide tactile feedback, resulting in unnatural user interactions.

Innovation Solution

An information processing device that acquires captured images with three-dimensional subject position information and generates content configuration information for associating subjects in the images with virtual space interactions, enabling spatial interaction by displaying images in a virtual space and providing feedback based on user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If 2-dimensional captured images are used in photographic VR content, then the content can be displayed in a virtual space, but three-dimensional spatial interaction such as touching cannot be realized

Engineering Contradiction:
Improvespatial interaction capabilityVSAvoidtactile feedback information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent associates three-dimensional position information with subjects in captured images, enabling the system to interpret 2D image data within a 3D virtual space context. This dimensional enhancement allows users to interact with image subjects as if they were three-dimensional objects, supporting spatial interactions like touching while maintaining the use of standard 2D captured images.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If three-dimensional position information is associated with subjects in captured images, then spatial interaction can be realized, but the complexity of content configuration increases

Engineering Contradiction:
Improvespatial interaction capabilityVSAvoidcontent configuration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The information processing device automatically performs the association between captured images and three-dimensional position information. The system self-configures the virtual space by autonomously integrating image data with spatial coordinates, eliminating the need for manual content configuration and reducing operational complexity while enabling spatial interactions.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If tactile feedback is provided during user interaction with subjects in captured images, then the interaction becomes more natural, but the system complexity increases

Engineering Contradiction:
Improveinteraction naturalnessVSAvoidfeedback system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the information processing device provides tactile feedback to users during spatial interactions with subjects in captured images. This feedback loop enhances interaction naturalness by simulating real-world tactile sensations, while the automated nature of the feedback system minimizes the added complexity.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11250636B2Information processing device, information processing method, and program
Publication Date: 2022.02.15 SONY GROUP CORP
  • US11250636B2 patent drawing
  • US11250636B2 patent drawing
  • US11250636B2 patent drawing

AI summary

An information processing device includes: an acquisition unit (110, 140) configured to acquire a captured image including a subject and three-dimensional subject position information indicating a three-dimensional position of the subject; and a content configuration information generation unit (150) configured to generate content configuration information including the captured image, the three-dimensional subject position information, and virtual space association information which is information used for an interaction in which the subject in the captured image displayed in the virtual space is involved and is information for associating the subject in the captured image with the three-dimensional subject position information.