Virtual Viewpoint History Management for Immersive Experience

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating virtual viewpoint images struggle to maintain user engagement when the user stops interacting with the virtual viewpoint operation for an extended period, leading to a loss of immersive experience.

Innovation Solution

An information processing apparatus with a history management unit to track user-designated virtual viewpoints, a viewpoint determination unit to select a virtual viewpoint based on user viewing tendencies, and a viewpoint control unit to set and update the virtual viewpoint, ensuring continuous generation of virtual viewpoint images even when user interaction ceases.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the virtual viewpoint image is changed to a predetermined virtual viewpoint image when user operation is not detected for a predetermined period of time, then the system can maintain basic functionality, but the user engagement and immersive experience are lost

Engineering Contradiction:
Improvesystem functionalityVSAvoiduser engagement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by managing virtual viewpoint history and proactively determining appropriate virtual viewpoints before the user needs them. The history management unit stores past viewpoint selections, and the viewpoint determination unit uses this stored information to automatically select viewpoints, preparing the system state in advance for seamless user experience without requiring active user input.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system serves itself by automatically determining virtual viewpoints based on its own managed history data. The viewpoint determination unit independently selects appropriate viewpoints using the history information stored by the history management unit, without requiring external user commands, thus maintaining system functionality and user engagement simultaneously.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If the virtual viewpoint is frequently changed based on user operations, then user engagement is maintained, but the system complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary action by pre-managing virtual viewpoint history and having the viewpoint determination unit ready to automatically select viewpoints from this history. This preparation eliminates the need for complex real-time processing when user engagement is low, reducing overall system complexity while maintaining ease of operation through automated viewpoint selection based on stored preferences.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If the virtual viewpoint is determined based on user viewing tendencies from history, then ease of operation is improved, but information processing requirements increase

Engineering Contradiction:
Improveease of useVSAvoidprocessing load
Core Design Contradiction:
Ease of operationVSUse of energy by stationary object

Solution Approach 1:

The system applies partial action by using only the necessary portion of history information for viewpoint determination rather than processing all possible data. The viewpoint determination unit selectively determines viewpoints based on relevant history data from the history management unit, achieving ease of use through automated selection while avoiding excessive processing load by focusing only on essential historical viewing patterns.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240275931A1Information processing apparatus, information processing method, and storage medium
Publication Date: 2024.08.15 CANON KK
  • US20240275931A1 patent drawing
  • US20240275931A1 patent drawing
  • US20240275931A1 patent drawing

AI summary

An information processing apparatus manages a virtual viewpoint designated by a user operation as a virtual viewpoint history, and determines a virtual viewpoint based on the managed virtual viewpoint history. The information processing apparatus sets the virtual viewpoint determined based on the virtual viewpoint history as a virtual viewpoint used to generate a virtual viewpoint image.