Superimposition Processor for Mixed Reality Telepresence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge in telepresence technology arises when stereoscopic and non-stereoscopic displays are used together, leading to asymmetry in perceived sense of co-presence and reality, making it difficult for users to interact effectively.

Innovation Solution

An information processing apparatus that includes an image acquisition section, depth acquisition section, and a superimposition processor to superimpose the interaction of a user on a stereoscopic display with depth information from a non-stereoscopic display, ensuring consistent viewing experiences across different display types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If stereoscopic displays are used to enhance sense of reality, then sense of reality and spatial co-presence are improved, but device complexity and cost increase

Engineering Contradiction:
Improvesense of realityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system enables a single telepresence platform to support both stereoscopic and non-stereoscopic displays through the superimposition processing function. The superimposition processor adds depth information to non-stereoscopic displays, allowing the same system to adapt to different display capabilities without requiring separate dedicated systems for each display type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The superimposition processor acts as an intermediary that translates and adapts visual information between stereoscopic and non-stereoscopic formats. By processing and superimposing depth information onto standard displays, it bridges the gap between high-fidelity stereoscopic output and conventional display capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If stereoscopic and non-stereoscopic displays communicate together, then adaptability and user base expand, but interaction quality and sense of co-presence deteriorate due to asymmetry

Engineering Contradiction:
ImproveadaptabilityVSAvoidsense of co-presence
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system changes the depth parameter representation by superimposing depth information onto non-stereoscopic displays. This parameter transformation allows users on non-stereoscopic displays to perceive spatial relationships and interaction positions similarly to users on stereoscopic displays, maintaining consistent sense of co-presence across different display types.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system intentionally handles stereoscopic and non-stereoscopic displays asymmetrically through targeted superimposition processing. Rather than requiring both displays to be identical, the system applies depth enhancement selectively to non-stereoscopic displays, compensating for their limitations while preserving the natural advantages of stereoscopic displays.

Inventive Principle:
Principle #4Asymmetry

3Reliability

If depth information is superimposed on non-stereoscopic displays, then sense of spatial co-presence is improved, but image processing complexity increases

Engineering Contradiction:
Improvesense of spatial co-presenceVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The superimposition processor performs preliminary depth information preparation and integration before final display output. By pre-processing depth data and integrating it with visual information in advance, the system reduces real-time processing demands and simplifies the overall image processing pipeline.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250211720A1Information processing apparatus, information processing method, and recording medium
Publication Date: 2025.06.26 SONY GROUP CORP
  • US20250211720A1 patent drawing
  • US20250211720A1 patent drawing
  • US20250211720A1 patent drawing

AI summary

An information processing apparatus according to an embodiment of the present technology includes an image acquisition section, a depth acquisition section, and a superimposition processor. The image acquisition section acquires a captured image of a first user who uses a stereoscopic display. The depth acquisition section acquires depth information regarding a second user who uses a non-stereoscopic display that communicates with the stereoscopic display. The superimposition processor superimposes a result of interaction of the second user on the captured image of the first user on the basis of the depth information, the captured image of the first user being displayed on the non-stereoscopic display.