Vehicle Camera Calibration via Synthetic Image Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for vehicles face challenges in aligning camera images from multiple onboard cameras, leading to misalignment issues that require manual calibration, which can be cumbersome and time-consuming, especially when replacing or adjusting individual cameras.

Innovation Solution

An image processing apparatus with a generating unit, display control unit, and change receiving unit that generates and displays a synthetic image from multiple camera views, allowing for easy calibration by adjusting the positional relation between camera images through a user-friendly interface, enabling intuitive movement and alignment of image regions within the synthetic image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual calibration is performed by workers using markers and parameter setting, then camera alignment accuracy is improved, but calibration time and operational complexity increase

Engineering Contradiction:
Improvecamera alignment accuracyVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs automatic calibration by having the vehicle move through a course marked with markers, using the vehicle's own motion and the markers to automatically determine and correct camera alignment parameters without requiring manual intervention from workers

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Markers are pre-placed around the vehicle's movement course before calibration begins, preparing the environment in advance so that when the vehicle moves through the course, the calibration data can be automatically captured and processed

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If manual calibration with markers is performed, then camera alignment accuracy is improved, but the complexity of the calibration process increases

Engineering Contradiction:
Improvecamera alignment accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The calibration system automatically executes the entire calibration process by capturing images of markers during vehicle movement, processing the images to determine alignment parameters, and applying corrections without requiring workers to manually set parameters or understand complex calibration procedures

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of workers physically positioning markers and adjusting camera parameters is replaced with an automated optical and computational system that uses image processing and algorithmic calculation to determine and apply calibration parameters

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If conventional calibration methods are used, then alignment accuracy is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvealignment accuracyVSAvoidcalibration ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The calibration process is fully automated and executes itself without requiring skilled workers to perform manual adjustments or understand complex calibration procedures, making the process easy to operate while maintaining high alignment accuracy

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10328866B2Image processing apparatus and image processing method for generating synthetic image and changing synthetic image
Publication Date: 2019.06.25 FUJITSU TEN LTD
  • US10328866B2 patent drawing
  • US10328866B2 patent drawing
  • US10328866B2 patent drawing

AI summary

An image processing apparatus for processing an image according to one embodiment includes a generating unit, a display control unit, and a change receiving unit. The display control unit generates a synthetic image providing a view of a vehicle from a virtual viewpoint, based on a plurality of onboard camera images. The display control unit displays the generated synthetic image on a display unit. The change receiving unit receives a change in the relative positional relation between an image region that is based on one of the camera images and image regions that are based on the other camera images in the synthetic image. The generating unit generates a synthetic image, based on a changed positional relation every time a change in the positional relation is received.