Image Processing System for Vehicle Damage Detection via Landmark Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing systems are unable to quickly and effectively detect changes in objects, such as damage to vehicles or buildings, due to difficulties in comparing images from different perspectives, angles, and camera distortions, leading to inaccurate or incomplete change detection.

Innovation Solution

An image processing system that compares base object models with target images, using landmarks and correlation filters to correct for camera distortions and align images, followed by convolutional neural networks to quantify changes and display them as heat maps, enabling accurate detection and analysis of damage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If images are compared directly without correction, then processing speed is improved, but measurement precision deteriorates due to camera distortions and perspective differences

Engineering Contradiction:
Improveprocessing speedVSAvoidchange detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by detecting landmarks and determining camera models before comparing images. This includes identifying corresponding landmarks in base and target images, estimating camera parameters, and correcting perspective distortions in advance of the actual change detection process, thereby enabling accurate measurements without requiring slow manual alignment

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary elements including landmark detectors that identify key points, camera models that represent perspective transformations, and correction algorithms that serve as mediators between raw images and comparison data. These intermediaries translate distorted images into a common reference framework, enabling precise change detection while maintaining processing efficiency

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If images are obtained from different cameras and perspectives, then adaptability is improved, but measurement precision deteriorates due to distortion and alignment difficulties

Engineering Contradiction:
Improveability to process images from different sourcesVSAvoidalignment accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system changes parameters by detecting and utilizing camera-specific parameters including focal length, principal point, and distortion coefficients. By estimating these parameters from landmark positions in images from different cameras and perspectives, the system transforms varied image data into a standardized reference framework, enabling both high adaptability and measurement precision

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent transitions from two-dimensional image comparison to three-dimensional spatial reasoning by detecting landmarks in 3D space and using them to establish camera models. This dimensional elevation allows the system to handle images from different perspectives and cameras by mapping them to a common 3D reference frame before projecting back to 2D for comparison

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If statistical processing techniques are used for feature detection, then ease of operation is improved, but measurement precision deteriorates due to inability to detect actual object changes

Engineering Contradiction:
Improveautomatic feature detection capabilityVSAvoidchange detection capability
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the image processing task into distinct functional components: landmark detection, camera model determination, perspective correction, and change detection. Each segment handles a specific aspect of the problem, with landmark detectors identifying key points, camera models handling distortion correction, and change detection algorithms focusing solely on identifying actual object changes after alignment is achieved

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10657647B1Image processing system to detect changes to target objects using base object models
Publication Date: 2020.05.19 CCC INTELLIGENT SOLUTIONS INC
  • US10657647B1 patent drawing
  • US10657647B1 patent drawing
  • US10657647B1 patent drawing

AI summary

An image processing system detects changes in objects, such as damage to automobiles, by comparing a base object model, which depicts the object in an expected condition, to one or more target images of the object in the changed condition. The image processing system first processes a target object image to detect one or more predefined landmarks in the target object image and corrects for camera and positional distortions by determining a camera model for the target object image based on the detected landmarks. The image processing system then determines contours of the target object within the target object image by overlaying an aligned base object model with the target object image, removes background pixels or other extraneous information based on this comparison, and then performs a statistical processing routine on the identified target object image to detect changes, the likelihood of changes, and/or a quantification of an amount or type of change, to the target object as depicted in the target object image as compared to the base object model.