Fisheye Camera Distortion Correction via Reference Line Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera systems, particularly those using fisheye cameras, require cumbersome user-settting processes to correct distortion, which can be difficult and time-consuming, especially in vehicle navigation systems where camera properties and mounting positions vary.

Innovation Solution

A moving object periphery image correction apparatus that automatically corrects image distortion by detecting reference lines, calculating distortion parameters, and applying correction using a distortion correction unit, eliminating the need for user-set camera properties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If distortion correction is performed using pre-set camera properties, then distortion correction can be achieved, but the setting work becomes cumbersome and difficult for users

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidsetting work complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects reference lines in the periphery image and self-calibrates distortion parameters without requiring user input or manual camera property setting. The distortion correction is performed autonomously by the image pickup unit and correction unit working together, eliminating the need for users to measure or input camera properties.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary detection of reference lines and calculation of distortion parameters automatically before the actual distortion correction is applied. This preliminary action eliminates the need for users to perform complex measurement and setting work in advance.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If automatic distortion correction is implemented, then setting work is eliminated, but the system complexity increases

Engineering Contradiction:
Improvesetting work eliminationVSAvoidsystem structure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The image pickup unit performs multiple functions: it captures periphery images, detects reference lines, calculates distortion parameters, and executes distortion correction. This multi-functionality reduces the need for separate dedicated components for each function, thereby limiting the increase in overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the image pickup unit and distortion correction unit into an integrated system where the correction unit processes images directly from the image pickup unit. This merging of functions reduces system complexity compared to having separate autonomous components for image capture and correction.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If user measurement and setting of camera properties is required, then accurate distortion correction can be achieved, but the process becomes time-consuming and may be interrupted

Engineering Contradiction:
Improvecamera property accuracyVSAvoidsetting work time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically measures camera properties by detecting reference lines in the periphery image and calculating distortion parameters without requiring user measurement. This self-service approach eliminates time loss due to user interruption while maintaining accurate distortion correction through automated reference line detection and parameter calculation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical measurement and setting processes with automated image processing. Instead of requiring users to physically measure camera properties, the system uses image analysis algorithms to automatically determine distortion parameters, significantly reducing setting time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10178314B2Moving object periphery image correction apparatus
Publication Date: 2019.01.08 MITSUBISHI ELECTRIC CORP
  • US10178314B2 patent drawing
  • US10178314B2 patent drawing
  • US10178314B2 patent drawing

AI summary

A reference line detection unit 12 extracts an edge from a distorted image taken by a fisheye camera to thereby determine a curved reference line. A distortion parameter calculation unit 13 calculates a distortion parameter such that the reference line is made linear. A distortion correction unit 14 corrects distortion of the distorted image by a distortion correction equation by using the distortion parameter.