Fisheye Image Conversion with Selective Interpolation for Real-Time Stereo

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing live streaming technologies face challenges in distributing stereoscopic images for right and left eyes in real-time due to the increased processing time required for providing separate images, which is not feasible with conventional frame rates.

Innovation Solution

An image processing apparatus and method that converts fisheye image regions into equidistant cylindrical image regions using correspondence relationships and varying interpolation methods to efficiently generate stereoscopic images, allowing for real-time distribution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate images for right eye and left eye are processed using conventional live streaming methods, then stereoscopic viewing capability is achieved, but processing time increases and real-time distribution becomes difficult

Engineering Contradiction:

Improvestereoscopic viewing capabilityVSAvoidprocessing speed

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The image is divided into multiple regions (first image region, second image region, third image region, fourth image region) representing different fisheye lens captures. Each region is processed independently using appropriate interpolation methods, allowing parallel processing and reducing overall processing time while maintaining stereoscopic capability

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different interpolation methods are applied to different regions based on their specific characteristics. First and second regions use one interpolation approach while third and fourth regions use another, optimizing processing efficiency for each region while preserving local image quality and stereoscopic effects

Inventive Principle:

Principle #3Local quality

2Manufacturing precision

If complex interpolation processing is applied to all image regions, then image quality is maintained, but processing time increases

Engineering Contradiction:

Improveimage qualityVSAvoidprocessing time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies different interpolation processing strategies to different image regions. Some regions receive more complex interpolation to maintain high quality, while other regions use simpler methods, achieving overall good image quality with reduced total processing time

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

Instead of applying uniform complex interpolation to all regions, the patent applies interpolation selectively and partially to specific regions where it is most needed, reducing overall processing complexity while maintaining acceptable image quality in critical areas

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS12462332B2Image processing apparatus, image processing method, and non-transitory computer readable medium for processing images including two image regions

Publication Date: 2025.11.04 CANON KK

AI summary

An image processing apparatus acquires an image in which first and second image regions, each of which is a region of a fisheye image, are arranged, and converts the first and second image regions into third and fourth image regions, each of which is a region of an equidistant cylindrical image, respectively, wherein in the conversion, as interpolation processing to acquire pixel values in an equidistant cylindrical image from a plurality of pixel values in a fisheye image, first interpolation processing is performed on a specific region in the third and fourth image regions, and second interpolation processing, which is simpler than the first interpolation processing, is performed on a region other than the specific region.