Omni Window Free Viewpoint Video Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing free viewpoint video technologies cause health hazards due to sharp visual environment changes when switching between viewpoints, and fail to maintain the reality of the experience, as they often rely on instantaneous changes and thumbnail displays that do not consider the viewer's motion or desired viewpoint position and line-of-sight direction.

Innovation Solution

An information processing device and method that employs an 'omni window' to allow viewers to explore and switch between free viewpoint video content by moving within a virtual space, using an omni window display control unit to manage sub-content display within the main content's free viewpoint space, with a sub-content searching unit selecting suitable content based on filters and determining viewpoint positions, line-of-sight directions, and reproduction times, and an omni window display update unit adjusting the display in response to viewer movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If free viewpoint video content is instantly switched, then content switching speed is improved, but visual environment changes sharply causing health hazards to viewers

Engineering Contradiction:
Improvecontent switching speedVSAvoidhealth hazard to viewers
Core Design Contradiction:
SpeedVSObject-affected harmful factors

Solution Approach 1:

The system displays a thumbnail of the target content before actual content switching occurs. This preliminary display allows the viewer's visual system to gradually adapt to the upcoming content, preventing sudden visual shocks while maintaining efficient content navigation. The thumbnail acts as a visual buffer that prepares the viewer for the transition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The content switching process is made dynamic through the thumbnail display mechanism. Instead of instantaneous switching, the system transitions from displaying the current content to showing a thumbnail of the target content, and finally to the full target content. This dynamic transition process allows visual adaptation while maintaining switching efficiency.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If thumbnails of other content are displayed while viewing free viewpoint video, then content selection capability is improved, but the reality of the virtual experience is hindered

Engineering Contradiction:
Improvecontent selection capabilityVSAvoidreality of virtual experience
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The thumbnail is displayed in a localized, confined area rather than replacing the entire view. This local display approach provides content selection capability without disrupting the overall immersive experience. The thumbnail occupies a specific spatial region that does not interfere with the main virtual reality content.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The thumbnail is positioned in a spatial location that separates it from the main virtual reality content space. By placing the thumbnail in a distinct dimensional or spatial zone, the system provides content selection functionality while maintaining the integrity and realism of the primary virtual experience.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If conventional content switching methods are used, then content switching functionality is improved, but viewpoint position and line-of-sight direction information is lost

Engineering Contradiction:
Improvecontent switching functionalityVSAvoidviewpoint position and line-of-sight direction
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system incorporates feedback mechanisms that track and preserve viewpoint position and line-of-sight direction information during content switching. When a viewer selects new content, the system remembers the current viewing parameters and applies them to the new content, ensuring continuous and coherent viewing experience without information loss.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary processing to save and store viewpoint position and line-of-sight direction information before content switching occurs. This preliminary action ensures that when the new content is loaded, the viewer's viewing parameters are restored, maintaining the integrity of the viewing experience.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11132099B2Information processing device and information processing method
Publication Date: 2021.09.28 SONY GROUP CORP
  • US11132099B2 patent drawing
  • US11132099B2 patent drawing
  • US11132099B2 patent drawing

AI summary

Display of free viewpoint video content is switched so as to alleviate health hazard to viewers without impairing the reality.The omni window is a window integrating all windows, through each of which each sub-content is looked in from main content, and also serves as an entrance to a free viewpoint space of each sub-content. A viewer can go back and forth between different free viewpoint spaces by way of the omni window and the free viewpoint video is switched in accordance with such an exploring motion within the spaces. Furthermore, it is possible to impart a conversion function for a perceived size of the viewer to the omni window.