Virtual Viewpoint Determination for 3D Region Observation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current information processing systems lack the ability to allow users to observe a three-dimensional region from various positions effectively, with existing solutions failing to accurately determine and display the intended viewpoint position within the region.

Innovation Solution

An information processing apparatus and method that acquires and processes images of a three-dimensional region, using coordinates and observation states to generate virtual viewpoint images, allowing users to observe the region from intended positions by determining the viewpoint position based on indicated positions within the region, and displaying these images on user devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a virtual viewpoint is moved to a predetermined movement area when the distance is within a threshold, then the user can observe the three-dimensional region from various positions, but the system complexity increases due to multiple threshold judgments and viewpoint management

Engineering Contradiction:
Improveviewpoint observation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent pre-divides the three-dimensional region into multiple movement areas and sets predetermined viewpoint positions in advance. When a user selects a movement area, the system directly switches to the pre-configured viewpoint without requiring real-time calculation or complex judgment, thus reducing system complexity while maintaining versatile observation capability.

Inventive Principle:
Principle #10Preliminary action

2Stability of the object's composition

If the virtual viewpoint is not moved when the distance exceeds a threshold, then the system maintains stability, but the user experience deteriorates due to limited viewpoint adjustment

Engineering Contradiction:
Improveviewpoint stabilityVSAvoidviewpoint adjustment flexibility
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

The patent implements dynamic viewpoint adjustment based on distance thresholds. When the distance between the virtual viewpoint and the selected movement area is within the threshold, the viewpoint automatically moves to provide flexible adjustment. When the distance exceeds the threshold, the viewpoint remains stable. This dynamic response balances stability and flexibility, improving user experience without causing excessive viewpoint hopping.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If multiple imaging apparatuses are used to capture the three-dimensional region, then the observation accuracy and coverage improve, but the device complexity and cost increase

Engineering Contradiction:
Improveobservation accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines images captured by multiple imaging apparatuses positioned at different locations within the three-dimensional region. By merging these multiple perspectives into a unified virtual viewpoint system, the patent achieves high observation accuracy and comprehensive coverage without requiring each individual imaging device to be overly complex. The coordination of multiple simple imaging apparatuses replaces the need for a single complex high-precision system.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20230224451A1Information processing apparatus, information processing method, and program
Publication Date: 2023.07.13 FUJIFILM CORP
  • US20230224451A1 patent drawing
  • US20230224451A1 patent drawing
  • US20230224451A1 patent drawing

AI summary

An information processing apparatus includes a processor, and a memory built in or connected to the processor, in which the processor acquires a subject image showing a subject present inside a three-dimensional region, which is an observation target, in a case in which an inside of the three-dimensional region is observed from a viewpoint position determined based on coordinates inside the three-dimensional region corresponding to an indication position that is indicated inside the three-dimensional region or that is indicated inside a reference image showing a state of the inside of the three-dimensional region in a case in which the inside of the three-dimensional region is observed from a reference position.