Circular Fisheye Image Processing with Missing Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques fail to effectively handle circular fisheye images with missing regions, where no pixel values are present, especially when these images are used to create three-dimensional virtual reality (VR) images with parallax.

Innovation Solution

An image processing apparatus and method that involves obtaining a circular fisheye image with a missing region, generating an equidistant cylindrical projection image through equidistant cylindrical transformation processing, and setting a predetermined pixel value in the corresponding region of the projection image to ensure that the missing region has a pixel value, thereby enabling proper processing and display of the image in VR.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If equidistant cylindrical transformation processing is performed on a circular fisheye image with a missing region, then the image can be transformed into an equidistant cylindrical projection image, but the missing region results in no pixel values being present in the corresponding area

Engineering Contradiction:
Improveimage transformation accuracyVSAvoidpixel value completeness
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent applies preliminary action by filling in the missing region with a predetermined pixel value (such as black or white) before performing the equidistant cylindrical transformation processing. This ensures that the transformation can proceed without encountering empty data regions, and the final projected image contains complete pixel information in the corresponding area.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary approach by introducing a placeholder pixel value in the missing region before transformation. This intermediary pixel value acts as a mediator that enables the transformation algorithm to process the entire image uniformly, and after transformation, the placeholder is replaced or adjusted to maintain image quality in the corresponding region.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a circular fisheye image with a missing region is used for three-dimensional virtual reality processing, then the VR image can be generated, but the missing region causes incomplete or degraded VR display quality

Engineering Contradiction:
ImproveVR image generation capabilityVSAvoidVR display quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies preliminary action by filling in the missing region with a predetermined pixel value before performing the equidistant cylindrical transformation processing. This ensures that the transformation can proceed without encountering empty data regions, and the final projected image contains complete pixel information in the corresponding area.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent converts the harmful effect of the missing region into a beneficial outcome by using the missing region information to identify and preserve important structural features during transformation. The absence of pixel values in the original image helps the algorithm understand the boundaries and characteristics of the missing area, allowing for more accurate reconstruction and better VR display quality.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS12212732B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2025.01.28 CANON KK
  • US12212732B2 patent drawing
  • US12212732B2 patent drawing
  • US12212732B2 patent drawing

AI summary

There is provided an image processing apparatus comprising. An obtainment unit obtains a first circular fisheye image accompanied by a first missing region in which no pixel value is present. A generation unit generates a first equidistant cylindrical projection image by performing first equidistant cylindrical transformation processing based on the first circular fisheye image. The generation unit generates the first equidistant cylindrical projection image such that a first corresponding region corresponding to the first missing region has a pixel value in the first equidistant cylindrical projection image.