Virtual Space Generation for Multi-Direction Communication Interruptions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In real-time bidirectional communication systems, it is challenging to maintain a continuous and comfortable user experience when video transmission is interrupted, as existing techniques struggle to seamlessly generate and display virtual video representations of interrupted communication partners.

Innovation Solution

A multi-direction communication apparatus that receives real space information, generates virtual space information based on this data, and controls the display of this virtual space information on a second user's apparatus instead of the real space information, using accumulated data and context information to create a continuous and comfortable user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If real-time bidirectional communication is implemented, then communication functionality is improved, but user comfort during interruption is deteriorated

Engineering Contradiction:
Improvecommunication functionalityVSAvoiduncomfortable feeling during interruption
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary actions by capturing and storing space information (images, audio, metadata) before communication interruption occurs. This pre-captured data is then used to generate virtual space representations during interruption, ensuring continuous user experience without uncomfortable gaps in the communication flow.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates virtual space information as a copy of the real space by processing captured images, audio, and metadata through generation sections. This virtual copy maintains the essence of the original space, allowing users to perceive continuous presence even when real-time transmission is interrupted.

Inventive Principle:
Principle #26Copying

2Object-affected harmful factors

If virtual space information is generated and displayed instead of real space information during interruption, then user comfort is improved, but system complexity is worsened

Engineering Contradiction:
Improveuncomfortable feelingVSAvoidsystem complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system divides the complex task of maintaining communication continuity into separate functional sections: reception sections for capturing space information, generation sections for creating virtual representations, and display control sections for managing output. This segmentation allows each component to handle specific tasks efficiently, reducing overall system complexity while maintaining user comfort.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces virtual space information as an intermediary element between the user and the interrupted real-time communication. This intermediary maintains the perception of continuous space linkage without requiring direct real-time data transmission, simplifying the handling of interruption scenarios.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Object-affected harmful factors

If continuous space linkage is maintained during interruption, then user comfort is improved, but data processing requirements are worsened

Engineering Contradiction:
Improveuncomfortable feelingVSAvoiddata processing requirements
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system applies local quality by processing and generating space information specifically at the locations where communication participants are present. Rather than processing all possible data globally, the system focuses on capturing and generating relevant space information locally at each user's environment, reducing overall data processing requirements while maintaining continuous space linkage perception.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11140357B2Multi-direction communication apparatus and multi-direction communication method
Publication Date: 2021.10.05 SONY GROUP CORP
  • US11140357B2 patent drawing
  • US11140357B2 patent drawing
  • US11140357B2 patent drawing

AI summary

The present technique relates to a multi-direction communication apparatus, a multi-direction communication method, and a program capable of reducing an uncomfortable feeling to be provided to a user feeling that spaces are continuous in a multi-direction communication system. A reception section receives real space information including information representing a situation of a real space for a user B. A virtual data generation section generates, on the basis of the received real space information, virtual space information including information representing a situation of a virtual space. A control section controls display, on an information processing apparatus of a user A, of the virtual space represented by the generated virtual space information instead of the real space represented by the real space information. The present technique can be applied to a multi-direction communication system.