3D Position Shift Correction for Virtual View Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating virtual point-of-view images from multiple captured images struggle with maintaining accuracy due to changes in the state of image capturing apparatuses, such as shake or lens position changes, which affect the quality of the generated image content.

Innovation Solution

An information processing apparatus comprising a first acquisition unit for capturing images, a second acquisition unit for acquiring image capturing information, and a correction unit that corrects shifts between three-dimensional positions identified from feature points across multiple images and corresponding image capturing information, ensuring accurate image generation despite changes in the image capturing apparatuses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple image capturing apparatuses are used to generate virtual point-of-view images, then the quality and variety of image content is improved, but the accuracy of generated shape data decreases due to changes in apparatus state (shake, lens position changes)

Engineering Contradiction:
Improveimage content qualityVSAvoidshape data accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent implements feedback by detecting the state of image capturing apparatuses (shake, lens position changes) and using this information to correct shifts in three-dimensional positions. The correction unit adjusts the reconstructed shape data based on detected apparatus state changes, creating a closed-loop system that maintains accuracy despite environmental disturbances.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes parameters by dynamically adjusting the three-dimensional position calculations based on detected apparatus state. When shake or lens position changes are detected, the system modifies the position parameters of reconstructed objects to compensate for the apparatus movement, thereby maintaining measurement precision.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If image capturing apparatuses are fixed in position and orientation, then measurement precision is maintained, but adaptability to different capturing scenarios decreases

Engineering Contradiction:
Improveposition identification accuracyVSAvoidcapturing scenario flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by transitioning from static apparatus positioning to dynamic state detection and correction. The system continuously monitors apparatus state (shake, lens position) and dynamically adjusts three-dimensional position calculations, allowing the system to adapt to different capturing scenarios while maintaining precision through real-time compensation.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If correction processing is applied to maintain accuracy, then shape data accuracy is improved, but device complexity increases due to additional correction units and processing steps

Engineering Contradiction:
Improvethree-dimensional position accuracyVSAvoidcorrection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary correction unit that acts as a mediator between the image capturing apparatuses and the shape data generation process. This correction unit processes the raw data, applies necessary adjustments based on detected apparatus state, and outputs corrected three-dimensional positions, thereby maintaining accuracy without requiring fundamental changes to the entire system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11836879B2Information processing apparatus, information processing method, and storage medium for correcting a shift between three-dimensional positions
Publication Date: 2023.12.05 CANON KK
  • US11836879B2 patent drawing
  • US11836879B2 patent drawing
  • US11836879B2 patent drawing

AI summary

An information processing apparatus for correcting a shift between a first three-dimensional position in an image capturing region that is identified based on a position of a first feature point on a first image and a second three-dimensional position in an image capturing region that is identified based on a position of a second feature point corresponding to the first feature point on a second image.