Adaptive Video Display Using 3D Sensing for AR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional technologies for displaying images in augmented reality do not effectively incorporate three-dimensional information sensed in real spaces, limiting the ability to provide a realistic experience by not accounting for the viewer's location and body positioning.

Innovation Solution

An information processing apparatus and method that determines video display settings based on sensed three-dimensional information in a real space, using a server to manage and display videos corresponding to depth maps and position information, allowing for adaptive video display in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional augmented reality display technology is used to show images in the real world, then basic display functionality is achieved, but the display cannot be adaptively optimized based on the viewer's three-dimensional position and orientation information

Engineering Contradiction:
Improveadaptive display capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The server performs preliminary actions by determining video display settings in advance based on three-dimensional information (position and orientation) before the actual display occurs. This allows the system to pre-process and optimize video presentation according to the viewer's spatial context, enabling adaptive display without adding complexity to the real-time display device

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The server acts as an intermediary between the video source and the display device. It receives three-dimensional information, determines appropriate display settings, and returns optimized video content to the display device. This intermediary approach enables adaptive display functionality while keeping the display device itself relatively simple

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If video is displayed without considering three-dimensional information, then display simplicity is maintained, but the realism and immersion of the viewing experience is limited

Engineering Contradiction:
Improverealism of viewing experienceVSAvoiddisplay processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary determination of display settings based on three-dimensional position and orientation information before video playback. This advance processing ensures that the video is optimized for the viewer's spatial context, enhancing realism without requiring complex real-time processing during display

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The server automatically determines appropriate display settings by utilizing three-dimensional information that is already available in the system. This self-service approach allows the system to autonomously optimize video presentation for realism without requiring manual intervention or complex user configuration

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10868977B2Information processing apparatus, information processing method, and program capable of adaptively displaying a video corresponding to sensed three-dimensional information
Publication Date: 2020.12.15 SONY GROUP CORP
  • US10868977B2 patent drawing
  • US10868977B2 patent drawing
  • US10868977B2 patent drawing

AI summary

An information processing apparatus, an information processing method, and a program that are capable of adaptively displaying a video corresponding to sensed three-dimensional information in a space in which the video is displayed. The information processing apparatus includes: a determination unit that determines a setting related to display of a video when the video corresponding to first three-dimensional information sensed in a first real space is displayed in a second real space, on the basis of a sensing result in the second real space.