Display Control for Virtual Viewpoint Image Abnormality Impact

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systems for generating virtual viewpoint images, simply indicating an abnormal state of an image capturing apparatus does not adequately inform users of the impact on image quality and the number of processes required for recovery.

Innovation Solution

A display control apparatus that obtains information on the states of multiple image capturing apparatuses, identifies apparatuses in abnormal states, and controls a display to show the relationship of these apparatuses with others, enabling users to understand the extent of the abnormality's impact.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If only the abnormal apparatus is indicated, then the information display is simple, but the user cannot understand the degree of influence on virtual viewpoint image quality

Engineering Contradiction:
Improveinformation completenessVSAvoiddisplay complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display is segmented into multiple hierarchical levels: (1) abnormal apparatus indication, (2) connected apparatus indication, and (3) apparatus group indication. This segmentation allows progressive disclosure of information, enabling users to first see the basic abnormal state and then optionally explore deeper levels of relationship information to understand the full impact on virtual viewpoint image generation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a relational dimension to the display by showing not only which apparatus is abnormal but also its connection relationships with other apparatuses. This transforms a one-dimensional abnormal state indicator into a multi-dimensional view that includes spatial and functional relationships, helping users understand the propagation of abnormalities through the system.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If relationship information of abnormal apparatus is displayed, then the user can understand the influence degree, but the information processing and display become more complex

Engineering Contradiction:
Improvesystem monitoring reliabilityVSAvoidinformation processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system pre-establishes and maintains connection relationship information between apparatuses before abnormalities occur. This preliminary structuring of data allows the system to quickly retrieve and display relevant relationship information when an abnormality is detected, rather than computing relationships in real-time during error handling, thus reducing processing complexity during critical moments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The display provides feedback about the abnormal state and its potential impact on virtual viewpoint image quality. This feedback mechanism helps users understand the consequences of the abnormality and take appropriate actions, improving system monitoring reliability while keeping the interface manageable through structured information presentation.

Inventive Principle:
Principle #23Feedback

3Productivity

If detailed abnormality information is provided, then appropriate measures can be taken quickly, but the user interface becomes more complex

Engineering Contradiction:
Improverecovery efficiencyVSAvoiduser interface simplicity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The information is segmented into essential and detailed components. The essential information (abnormal apparatus identification and basic impact) is displayed prominently for quick awareness, while detailed relationship information is organized in a structured manner that users can access as needed. This segmentation enables rapid initial response while providing comprehensive information for thorough problem resolution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different parts of the display provide different levels of information density appropriate to their function. The abnormal apparatus indicator provides immediate, high-visibility alert information, while the connected apparatus and relationship information provide contextual details in less prominent areas. This local quality differentiation optimizes both quick recognition and detailed understanding without overwhelming the entire interface.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12212735B2Display control apparatus, display control method, and non-transitory computer-readable storage medium
Publication Date: 2025.01.28 CANON KK
  • US12212735B2 patent drawing
  • US12212735B2 patent drawing
  • US12212735B2 patent drawing

AI summary

An information display apparatus 400 obtains information about a plurality of apparatuses for obtaining a plurality of images captured from a plurality of directions for use in generating a virtual viewpoint image corresponding to a specified viewpoint. Furthermore, the information display apparatus 400 identifies an apparatus in an abnormal state among the plurality of apparatuses based on the obtained information. The information display apparatus 400 then causes the display unit 404 to display information indicating one or a plurality of apparatuses, among the plurality of apparatuses, that are in a predetermined relationship with the apparatus in the abnormal state.