Virtual Space Object Decision for Free Viewpoint Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating free viewpoint videos from real spaces include all sensed objects, leading to undesirable objects being displayed, which can result in an unnatural user experience.

Innovation Solution

An information processing device and method that decides shared objects in a virtual space based on predetermined references from sensing results of multiple real spaces, using a priority calculation unit to determine which objects to display, preventing overlaid displays and enhancing user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If all sensed objects are displayed in the free viewpoint video, then the completeness of spatial information is improved, but the quality of displayed content deteriorates due to inclusion of undesirable objects

Engineering Contradiction:
Improvequantity of displayed objectsVSAvoidundesirable objects displayed
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and separates desirable objects from undesirable objects by classifying them into different groups based on their spatial relationships with users. The system identifies objects that should be displayed (first group) and objects that should not be displayed (second group), then selectively renders only the desirable objects in the free viewpoint video, thereby removing harmful elements while preserving useful information.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different display qualities to different objects based on their local characteristics and spatial relationships. Objects closer to users or with specific spatial relationships are marked for display, while objects farther away or with undesirable characteristics are excluded. This local differentiation allows the system to maintain high display quality while preserving spatial completeness.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If objects from multiple real spaces are synthesized into a shared virtual space, then the versatility of communication is improved, but the complexity of object arrangement increases

Engineering Contradiction:
Improveshared space communication capabilityVSAvoidobject arrangement complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments objects from multiple real spaces into distinct groups based on their spatial relationships with respective users. Each user's objects are processed independently, then integrated into the shared virtual space with appropriate spatial positioning. This segmentation approach maintains versatility while managing complexity through systematic organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a shared virtual space as an intermediary that mediates between multiple real spaces. This virtual space serves as a common platform where objects from different users' real spaces can be synthesized and displayed together, enabling versatile communication while simplifying the complexity of direct multi-space integration through a unified representation framework.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11043033B2Information processing device and information processing method capable of deciding objects arranged in virtual space generated based on real space
Publication Date: 2021.06.22 SONY GROUP CORP
  • US11043033B2 patent drawing
  • US11043033B2 patent drawing
  • US11043033B2 patent drawing

AI summary

An information processing device including a decision unit that determines, on the basis of a predetermined reference, a shared object arranged in a virtual space that is generated for communication between a first user and a second user on the basis of a sensing result of a first real space including at least one first actual object in relation to the first user and a sensing result of a second real space including at least one second actual object in relation to the second user.