Fine-Grained Vehicle Classification via Saliency-Aware Sampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Fine-grained image classification using deep convolutional neural networks (CNNs) is hindered by the lack of large-scale training data and over-fitting issues due to small datasets, where obtaining fine-grained class labels is difficult, especially in tasks like vehicle classification.

Innovation Solution

The system employs a scale-aware detection and multinomial object-centric sampling approach for CNN training, utilizing saliency-aware object detection and Regionlet detectors to construct effective training data, which emphasizes potential object locations and handles occlusions, improving detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep CNN is used for fine-grained image classification, then classification accuracy can be improved, but over-fitting occurs due to lack of large-scale training data

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining data quantity
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent performs preliminary object detection and salient region identification before training the CNN. By detecting objects and their salient regions in advance, the system creates a pre-processed training dataset that highlights important areas, effectively increasing the information density of training data without requiring more raw images.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts salient regions from images using detection algorithms and uses only these extracted regions for training the CNN, rather than using the entire image. This extraction approach concentrates the training data on the most informative portions, reducing the need for large quantities of complete images.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If traditional detection approaches are used, then detection can be performed, but response to salient objects is insufficient

Engineering Contradiction:
Improvedetection responseVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by differentiating between salient and non-salient regions within images. The detection system assigns different weights and processing levels to different regions based on their salience, allowing the system to focus computational resources on the most important areas while maintaining overall detection capability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces a dynamic detection response mechanism that adjusts detection sensitivity and region emphasis based on the specific characteristics of each image and object. The system adapts its detection parameters in real-time based on the detected object's properties, enhancing response to salient objects without requiring a completely complex static system.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9665802B2Object-centric fine-grained image classification
Publication Date: 2017.05.30 NEC CORP
  • US9665802B2 patent drawing
  • US9665802B2 patent drawing
  • US9665802B2 patent drawing

AI summary

Systems and methods are disclosed for classifying vehicles by performing scale aware detection; performing detection assisted sampling for convolutional neural network (CNN) training, and performing deep CNN fine-grained image classification to classify the vehicle type.