Omnidirectional Image Joining Position Validity Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current omnidirectional imaging devices face challenges in accurately joining partial-view images captured by wide-angle or fish-eye lenses due to distortion and overlapping areas, leading to inconsistencies and reduced image quality in composite images.

Innovation Solution

An image processing device and method that evaluates the validity of past joining positions between partial-view images and generates a composite image based on criteria, using a receiver, memory, and circuitry to correct distortion and improve image alignment, employing pattern matching and conversion tables for precise joining and combining of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pattern matching method is used to detect joining positions between partial-view images, then image alignment accuracy is improved, but processing time and computational complexity increase

Engineering Contradiction:
Improvejoining position detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-divides the overlapping area into multiple portions and pre-stores joining positions for each portion in memory. This preliminary preparation allows the system to quickly retrieve and evaluate pre-computed joining positions rather than performing complex pattern matching in real-time, thus maintaining detection accuracy while significantly reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The overlapping area between partial-view images is divided into multiple portions, with each portion having its own pre-stored joining position. This segmentation allows the system to evaluate only specific portions rather than the entire overlapping area, reducing computational complexity and processing time while maintaining overall alignment accuracy.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If joining positions are determined for all portions in the overlapping area, then image alignment quality is improved, but processing load and power consumption increase

Engineering Contradiction:
Improveimage alignment qualityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies different processing strategies to different portions of the overlapping area. The validity evaluation unit selectively determines whether to use pre-stored joining positions based on local image characteristics and validity criteria. This allows the system to maintain high alignment quality where needed while reducing processing load and power consumption in areas where pre-stored positions are sufficient.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of determining joining positions for all portions without discrimination, the system performs partial action by evaluating validity only for portions where it matters. The validity evaluation unit selectively applies processing based on whether pre-stored joining positions meet validity criteria, avoiding unnecessary processing and reducing power consumption while maintaining sufficient alignment quality.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If pre-stored joining positions are used for all portions, then processing speed is improved, but image alignment accuracy deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidjoining position accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the validity evaluation unit continuously monitors the quality of pre-stored joining positions by evaluating them against validity criteria. When pre-stored positions fail the validity check, the system responds by determining new joining positions through pattern matching. This feedback loop ensures processing speed is maintained when possible while automatically correcting accuracy issues when they arise.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts its strategy for each portion based on validity evaluation results. For portions where pre-stored joining positions are valid, the system uses them for fast processing. For portions where they are invalid, the system dynamically switches to pattern matching to determine new joining positions. This dynamic adaptation maintains both processing speed and accuracy according to local conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11657477B2Image processing device, image processing system, imaging device, image processing method, and recording medium storing program code
Publication Date: 2023.05.23 RICOH CO LTD
  • US11657477B2 patent drawing
  • US11657477B2 patent drawing
  • US11657477B2 patent drawing

AI summary

An image processing device, an image processing system, an imaging device, an image processing method, and a recording medium storing program code. The image processing device includes a receiver configured to receive a first image and a second image, a memory configured to store a joining position at each one of a plurality of portions between the first image and the second image received by the receiver, and circuitry configured to evaluate, for each of the plurality of portions, validity of the joining position in a past stored in the memory, and generate a composite image based on the first image and the second image received by the receiver and the joining position in the past stored in the memory on a site where the validity meets a criterion. The method includes reading a past joining position at each one of a plurality of portions between a pair of images.