Display Control for Virtual Viewpoint Imaging Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in monitoring the states of constituent elements within a system that generates virtual viewpoint images, such as image capturing apparatuses, servers, and network devices, which can lead to reduced image quality due to equipment failures or misconfigured parameters.

Innovation Solution

A display control apparatus that acquires and displays information on the connection status, imaging parameters, and states of image capturing apparatuses, allowing users to easily identify and address issues within the system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple image capturing apparatuses are installed to generate virtual viewpoint images, then the quality and versatility of the virtual viewpoint image is improved, but the complexity of the system increases and makes it difficult to monitor the state of constituent elements

Engineering Contradiction:
Improvevirtual viewpoint image qualityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a display control apparatus as an intermediary between the multiple image capturing apparatuses and the user. This intermediary collects state information from all image capturing apparatuses, processes it, and presents it in a unified map-based display interface. This resolves the contradiction by managing the complexity through a dedicated control system while maintaining the versatility benefits of multiple apparatuses.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by continuously monitoring the state of each image capturing apparatus (power status, image capture status, communication status) and displaying this information on a map interface. This feedback mechanism allows users to understand the system state without increasing operational complexity, thus maintaining versatility while managing system complexity.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the system operates without real-time monitoring of image capturing apparatuses, then the ease of operation is improved, but the reliability of virtual viewpoint image generation deteriorates due to undetected equipment failures

Engineering Contradiction:
Improveoperation simplicityVSAvoidimage quality reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The image capturing apparatuses automatically report their state information (power status, image capture status, communication status) to the display control apparatus without requiring manual intervention. This self-service mechanism maintains ease of operation while ensuring reliability through automated monitoring and alerting of any issues.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The display control apparatus serves as an intermediary that automatically collects, processes, and displays state information from all image capturing apparatuses. This intermediary function provides reliable monitoring without requiring users to manually check each apparatus, thus maintaining operational simplicity while ensuring image quality reliability through continuous state tracking.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If detailed information on all image capturing apparatuses is displayed simultaneously, then the measurement precision of system state monitoring is improved, but the ease of operation deteriorates due to information overload

Engineering Contradiction:
Improvestate monitoring precisionVSAvoidinterface usability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent segments the display of state information by representing each image capturing apparatus as a separate icon on a map interface, with each icon showing specific state indicators (power status, image capture status, communication status). This segmentation allows precise monitoring of individual apparatus states while maintaining ease of operation through a visual, organized layout that avoids information overload.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies local quality by displaying different types of information (power status, image capture status, communication status) at appropriate locations on the map interface near each apparatus icon. This localized information presentation provides precise state monitoring for each apparatus while maintaining overall interface usability through spatial organization rather than overwhelming the user with centralized data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3618429B1Display control device, display control method, and program
Publication Date: 2023.09.20 CANON KK
  • EP3618429B1 patent drawingFigure 1
  • EP3618429B1 patent drawingFigure 2
  • EP3618429B1 patent drawingFigure 3

AI summary

A display control apparatus configured to perform display control so as to display information on a plurality of image capturing apparatuses configured to capture images for generating a virtual viewpoint image includes acquisition means configured to acquire information on the plurality of image capturing apparatuses, and display control means configured to perform display control to cause a display unit to display information on a communication connection of the plurality of image capturing apparatuses for transmitting an image captured by each of the plurality of image capturing apparatuses based on the information acquired by the acquisition means.