Vehicle Identification via Multi-Modal Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle model identification technologies face challenges in accurately identifying factory models, particularly in security inspection fields, due to limited application range and difficulty in combining appearance and internal structure information effectively.

Innovation Solution

A vehicle inspection system that combines appearance information from sensors like CCD cameras and infrared curtains with internal structure information from X-ray radiation imaging to accurately identify vehicle models by forming feature descriptions and comparing them to a database, using image processing units to determine the best matched vehicle model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If only appearance information is used for vehicle model identification, then the identification process is simple and fast, but the identification accuracy is insufficient especially for factory model identification

Engineering Contradiction:
Improvevehicle model identification accuracyVSAvoididentification system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines appearance information from sensors (CCD cameras, infrared curtains) with internal structure information from X-ray radiation imaging to form comprehensive feature descriptions. This merging of multiple information sources enables accurate factory model identification while maintaining system feasibility through integrated processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The identification process is segmented into distinct stages: acquiring appearance information, acquiring transmission images, obtaining external features, obtaining internal features, forming feature descriptions, and determining vehicle models. This segmentation allows complex multi-source information processing to be managed systematically while improving identification accuracy at each stage.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multiple types of sensors and imaging systems are combined to improve identification range and accuracy, then the identification precision and range improve, but the device complexity and cost increase

Engineering Contradiction:
Improveidentification system rangeVSAvoidsystem structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs multi-functional sensors and imaging devices that serve multiple purposes: CCD cameras capture both visible light images for appearance analysis and work with infrared curtains for thermal imaging; X-ray systems provide transmission images for internal structure analysis. This multi-functionality expands identification range while controlling device complexity through shared hardware resources.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an image processing unit as an intermediary that receives data from multiple sensors (CCD cameras, infrared curtains, X-ray systems) and integrates them into unified feature descriptions. This intermediary component coordinates information from diverse sources, enabling versatile identification without requiring direct complex interconnections between all sensor components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If non-contact and non-invasive methods are used for vehicle identification, then the vehicle remains undisturbed and inspection is faster, but the ability to obtain detailed internal structure information is limited

Engineering Contradiction:
Improvecontactless inspection capabilityVSAvoidinternal structure information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent replaces mechanical contact-based inspection methods with non-contact sensing technologies: CCD cameras capture optical images without touching the vehicle, infrared curtains detect thermal patterns remotely, and X-ray radiation imaging penetrates the vehicle body to reveal internal structures. This substitution maintains the ease of contactless operation while overcoming information loss through advanced radiation-based imaging.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system utilizes different physical parameters for non-contact information acquisition: optical parameters for appearance imaging, thermal parameters for infrared detection, and radiation transmission parameters for internal structure imaging. By changing the physical parameter domain, the system obtains comprehensive vehicle information without mechanical contact, resolving the contradiction between ease of operation and information completeness.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables contactless, non-invasive, and accurate vehicle model identification, enhancing security inspection and intelligent transportation systems by improving identification precision and range.

Implementation Method 1

internal structure information from X-ray radiation imaging

Methodology Applied
Scientific EffectX-Ray: X-Ray

Implementation Method 2

X-ray radiation imaging to accurately identify vehicle models

Methodology Applied
Scientific EffectAbsorption (EM radiation): Absorption (EM radiation)

Implementation Method 3

appearance information from sensors like CCD cameras and infrared curtains

Methodology Applied
Scientific EffectInfrared Radiation: Infrared Radiation

Data Source

PatentEP3128496B1Vehicle identification method and system
Publication Date: 2023.08.23 NUCTECH CO LTD
  • EP3128496B1 patent drawingFigure 1~2
  • EP3128496B1 patent drawingFigure 3~4
  • EP3128496B1 patent drawingFigure 5~6

AI summary

Disclosed is a vehicle identification method and system. The method includes: acquiring appearance information of an inspected vehicle; obtaining external features of the vehicle based on the appearance information; acquiring a transmission image of the vehicle and obtaining internal features of the vehicle from the transmission image; forming descriptions on the vehicle at least based on the external features and the internal features; and determining a vehicle model of the vehicle from a vehicle model databased by utilizing the descriptions. This method merges various types of modality information, especially introducing the transmission image, and combines the internal structure information with the appearance information, so that the present disclosure can identify a vehicle model more practically.