Obstacle Removal in Multi-Viewpoint Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques lack a method to obtain obstacle-removed images using disparity information, where obstacles often appear in photographic images due to composition or situational factors, hindering the capture of desired subjects.

Innovation Solution

An image processing apparatus and method that generates obstacle-removed images by removing obstacles from multiple viewpoints using disparity information, where the apparatus includes a removal section to generate after-removal images and an image generation section to register these images at a predetermined viewpoint, eliminating obstacles from the photographic images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple photographic images at different viewpoints are used to remove obstacles, then the quality of the obstacle-removed image is improved, but the device complexity and processing time increase

Engineering Contradiction:
Improveimage qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the obstacle removal process into distinct functional modules: a removal section that processes each viewpoint's image separately to remove obstacles, and an image generation section that synthesizes the final result by registering multiple after-removal images. This segmentation allows complex multi-viewpoint processing to be broken down into manageable, independent operations that can be executed efficiently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces disparity information as an intermediary element that mediates between multiple photographic images at different viewpoints. The disparity information serves as a reference guide that enables the removal section to accurately identify and remove obstacles while preserving the desired subject, and allows the image generation section to correctly register and synthesize images from multiple viewpoints into a coherent final image.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If disparity information is used to remove obstacles from multiple viewpoints, then obstacle removal accuracy is improved, but the processing time and computational load increase

Engineering Contradiction:
Improveobstacle removal accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary processing by generating after-removal photographic images at multiple viewpoints before synthesizing the final obstacle-removed image. The removal section预先 removes obstacles from each viewpoint's image using disparity information, creating intermediate after-removal images that are then registered and combined by the image generation section. This preliminary action approach allows complex obstacle removal to be performed on individual images rather than attempting to process all images simultaneously, reducing overall computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the obstacle removal process into distinct functional modules: a removal section that processes each viewpoint's image separately to remove obstacles, and an image generation section that synthesizes the final result by registering multiple after-removal images. This segmentation allows complex multi-viewpoint processing to be broken down into manageable, independent operations that can be executed efficiently.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If obstacles are removed using disparity information from multiple viewpoints, then the clarity of the desired subject is improved, but the complexity of image registration increases

Engineering Contradiction:
Improvesubject clarityVSAvoidregistration complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces disparity information as an intermediary element that mediates between multiple photographic images at different viewpoints. The disparity information serves as a reference guide that enables the removal section to accurately identify and remove obstacles while preserving the desired subject, and allows the image generation section to correctly register and synthesize images from multiple viewpoints into a coherent final image.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10748264B2Image processing apparatus and image processing method
Publication Date: 2020.08.18 SONY GROUP CORP
  • US10748264B2 patent drawing
  • US10748264B2 patent drawing
  • US10748264B2 patent drawing

AI summary

The present technique relates to an image processing apparatus and an image processing method capable of obtaining an obstacle-removed image in which an obstacle does not appear using disparity information. A removal section generates after-removal photographic images at a plurality of viewpoints by removing part of subjects from respective photographic images at the plurality of viewpoints using disparity information associated with the photographic images at the plurality of viewpoints. An image generation section generates an obstacle-removed image at a predetermined viewpoint by registering the after-removal photographic images at the plurality of viewpoints using the disparity information. The present technique is applicable to a case, for example, of generating an obstacle-removed image in which an obstacle does not appear using photographic images at a plurality of viewpoints.