Dynamic User Interface for Virtual Viewpoint Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual viewpoint image generation systems do not provide users with tailored user interfaces for different imaging target subjects, making it inefficient for users to generate desired virtual viewpoint images.

Innovation Solution

An information processing apparatus that determines and provides a user interface specific to the imaging target subject based on captured images, using a determination unit to select from multiple user interfaces and a provision unit to offer the appropriate interface for generating virtual viewpoint images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single general user interface is provided for generating virtual viewpoint images, then the device complexity is reduced, but the ease of operation deteriorates because users cannot efficiently generate desired virtual viewpoint images for different imaging target subjects

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The user interface dynamically changes based on the imaging target subject. The system automatically switches between different user interfaces (e.g., soccer UI, karate UI, concert UI) depending on what is being captured, providing context-appropriate controls and options without requiring manual selection by the user.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The user interface is segmented into multiple specialized interfaces, each optimized for specific imaging target subjects. Instead of one generic interface, the system divides the interface into subject-specific variants (sports events, concerts, ceremonies, etc.), each with customized controls and parameters relevant to that subject type.

Inventive Principle:
Principle #1Segmentation

2Productivity

If multiple customized user interfaces are provided for different imaging target subjects, then the ease of operation improves, but the device complexity increases

Engineering Contradiction:
ImproveproductivityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system automatically determines which user interface to provide based on the imaging target subject without requiring manual configuration by the user. The determination unit autonomously selects the appropriate interface (soccer, karate, concert, etc.) based on analysis of the captured images, making the system self-adapter to different scenarios.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

A single information processing apparatus provides multiple specialized user interfaces through one system. The determination unit and provision unit work together to make the system universally applicable to various imaging target subjects (sports, concerts, ceremonies, etc.) while maintaining subject-specific optimization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the user interface automatically adapts to different imaging target subjects, then the ease of operation improves, but the measurement precision required increases to accurately identify the imaging target subject

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system uses feedback from analyzing captured images to determine the imaging target subject. The determination unit continuously monitors the captured content and adjusts the provided user interface based on this feedback, creating a closed-loop system that adapts to the actual imaging scenario.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11526250B2Information processing apparatus, method for controlling the same, and storage medium
Publication Date: 2022.12.13 CANON KK
  • US11526250B2 patent drawing
  • US11526250B2 patent drawing
  • US11526250B2 patent drawing

AI summary

The present invention provides a user with a user interface for enabling the user to efficiently perform an operation for generating a virtual viewpoint image for each imaging target subject to be imaged by a plurality of imaging apparatuses. An event information acquisition unit acquires information about an event subjected to virtual viewpoint image generation, and transmits the acquired event information to a user interface (UI) determination unit. The UI determination unit determines a UI to be generated by a UI generation unit based on the event information transmitted from the event information acquisition unit. The UI generation unit generates the UI determined by the UI determination unit. The user performs an input operation for generating a virtual viewpoint image according to the UI generated by the UI generation unit.