Virtual Space Construction Using Temporal Image Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for constructing virtual spaces based on reality spaces do not adequately account for changes over time, failing to effectively reproduce dynamic environments.

Innovation Solution

An information processing apparatus and method that acquires multiple images of a reality space at different times and constructs a virtual space by arranging unit volume elements, such as voxels, based on these images to represent subjects and their changes over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple images are acquired at different times to reproduce dynamic environments, then the realism and immersion of the virtual space is improved, but the loss of time and processing complexity increases

Engineering Contradiction:
Improverealism of virtual spaceVSAvoidtime consumption
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by acquiring multiple images at different time points in advance, and pre-processes them to extract subject information and determine voxel arrangements. This preparation work is done before the final virtual space construction, allowing the system to quickly assemble the virtual space when needed, thus reducing the actual time consumption while maintaining high realism.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the image processing task by dividing multiple images into individual frames, extracting subject information from each frame separately, and processing them independently to determine voxel arrangements. This segmentation allows parallel processing of different time-point images, reducing overall processing time while capturing temporal changes for realistic virtual space construction.

Inventive Principle:
Principle #1Segmentation

2Reliability

If multiple images are acquired at different times to reproduce dynamic environments, then the realism and immersion of the virtual space is improved, but the device complexity increases

Engineering Contradiction:
Improverealism of virtual spaceVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The information processing apparatus is designed with multi-functional units that can perform multiple tasks. The image acquiring unit captures images at different time points, the subject information extracting unit processes various types of image data to extract subject characteristics, and the virtual space constructing unit integrates all this information to build the virtual space. This universal design consolidates multiple functions into a single integrated system, managing complexity while enabling realistic dynamic environment reproduction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary subject information extracting unit that acts as a mediator between the image acquiring unit and the virtual space constructing unit. This intermediary unit processes multiple images, extracts relevant subject information, and prepares standardized data for virtual space construction. By introducing this intermediary layer, the system manages complexity through modular design while maintaining the capability to reproduce dynamic environments realistically.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Duration of action of moving object

If unit volume elements are arranged based on multiple time-point images, then the temporal dynamics of the virtual space is improved, but the manufacturing precision requirements increase

Engineering Contradiction:
Improvetemporal representationVSAvoidvoxel positioning precision
Core Design Contradiction:
Duration of action of moving objectVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by adjusting the arrangement parameters of unit volume elements (voxels) based on the temporal information extracted from multiple images. The system changes the position, orientation, and other parameters of voxels to reflect the dynamic state of subjects at different time points. This parameter-based approach enables temporal dynamics representation while managing positioning precision requirements through systematic parameter adjustment rather than requiring absolute precision in each individual voxel placement.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10762715B2Information processing apparatus
Publication Date: 2020.09.01 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10762715B2 patent drawing
  • US10762715B2 patent drawing
  • US10762715B2 patent drawing

AI summary

An information processing apparatus that constructs a virtual space by acquiring a plurality of images obtained by observing, at different times, a reality space in which one or more subjects are present, and arranging a plurality of unit volume elements at positions determined depending on a subject captured in each image of the plurality of images.