Virtual Viewpoint Image Control With Manual And Tagged Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for controlling virtual cameras in virtual viewpoint images are cumbersome, particularly when significant or complex movements are required, making it difficult for users to navigate and interact with the virtual environment.

Innovation Solution

An image display apparatus that combines automated and manual operations to control virtual cameras, using a system with a manual operation unit, automated operation unit, operation control unit, tag management unit, model generation unit, and image generation unit to generate virtual viewpoint images based on user input and predefined parameters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional touch operation methods are used to control virtual camera movement, then the system maintains simplicity in operation, but the ability to achieve significant or complex viewpoint changes is limited

Engineering Contradiction:
Improveoperation simplicityVSAvoidviewpoint change capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The operation unit is designed to accept multiple types of operations (manual operations and automated operations with tags) through a unified interface. The system can switch between different operation modes depending on user needs, allowing both simple touch operations and complex automated sequences to be performed through the same control mechanism, thereby resolving the contradiction between operational simplicity and viewpoint change capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Automated operations utilize pre-defined tags that contain predetermined sequences of virtual camera operations. These tags are created in advance and can be executed with a single user input, enabling complex viewpoint changes without requiring multiple manual operations. This preliminary preparation of operation sequences allows the system to achieve versatile viewpoint changes while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If automated operations with tags are used to achieve complex viewpoint changes, then the versatility of virtual camera control is improved, but the system complexity increases

Engineering Contradiction:
Improveviewpoint change capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of implementing complex automated control logic directly in the system, the patent uses tags that copy and store predetermined operation sequences. These tags act as reusable templates that can be executed without requiring the system to recalculate or reprocess the entire control logic each time. This copying approach enables versatile automated operations while keeping the core system relatively simple.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The tag management unit automatically handles the execution and management of operation sequences without requiring complex intervention. Once tags are created, they can be independently executed and managed, reducing the burden on the main control system and minimizing overall system complexity while maintaining high versatility in viewpoint control.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If manual operations are used for precise virtual camera control, then the precision of viewpoint positioning is improved, but the time required for operation increases

Engineering Contradiction:
Improveviewpoint positioning precisionVSAvoidoperation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system allows users to perform manual operations only for the specific portions of viewpoint adjustment that require precision, while using automated tag operations for routine or less critical positioning. This partial application of manual control reduces overall operation time while maintaining precision where needed, resolving the contradiction between positioning precision and operation speed.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Tags contain pre-calculated viewpoint positions and movement parameters that have been optimized for precision. When a tag is executed, these predetermined precise positions are applied immediately without requiring the user to manually adjust each parameter, thereby achieving precise viewpoint positioning quickly without the time cost of manual adjustment.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250284386A1Image display apparatus, control method and non-transitory computer-readable storage medium for generating a virtual viewpoint image
Publication Date: 2025.09.11 CANON KK
  • US20250284386A1 patent drawing
  • US20250284386A1 patent drawing
  • US20250284386A1 patent drawing

AI summary

There is provided an image display apparatus. The image display apparatus accepts a user operation for determining a first parameter which designates at least one of an orientation of view from virtual viewpoint and a position of a target point in a virtual viewpoint image; obtains a second parameter that is set in advance and that designates at least one of an orientation of view from virtual viewpoint and a position of a target point in a virtual viewpoint image; and displays, on a display unit, the virtual viewpoint image generated based on at least one of the first parameter and the second parameter.