Unified Face Representation and Vehicle Logo Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video-based face recognition systems face challenges due to uncontrolled poses and lighting conditions, particularly when matching frontal gallery data with non-frontal probe data from surveillance videos, and low-resolution vehicle logos in surveillance videos, which affects recognition accuracy.

Innovation Solution

The method involves generating a unified face image (UFI) from multiple video frames aligned to a common frontal view template for improved face recognition and using canonical correlation analysis (CCA) for vehicle logo super-resolution, enhancing coherence between high-resolution and low-resolution logo images through gamma transformations and manifold learning techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple video frames are aligned and fused to generate unified face images, then face recognition accuracy is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improveface recognition accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The face recognition process is segmented into distinct stages: face detection, alignment to frontal view template, feature extraction, and recognition. By dividing the complex task of processing multiple video frames into these manageable segments, the system can efficiently handle the computational requirements while maintaining high recognition accuracy through selective processing at each stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary alignment of video frames to a frontal view template before recognition. This preliminary action of warping and normalizing frames to a common reference view reduces the variability in pose and lighting, making the subsequent recognition process more efficient and accurate without requiring exhaustive processing of all possible frame variations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If video frames are aligned to a common frontal view template, then discrepancy between probe and gallery data is reduced, but processing time increases

Engineering Contradiction:
Improverecognition performanceVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies alignment and warping operations selectively to key frames that contain sufficient facial information, rather than processing every frame in the video sequence. This partial action approach maintains recognition reliability by focusing computational resources on informative frames while reducing overall processing time.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system transforms video frames by changing their geometric parameters (warping to frontal view) and temporal parameters (selective frame sampling). These parameter changes enable the probe data to better match the gallery data format, improving reliability while the selective application of these transformations controls processing time.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If super-resolution is applied to vehicle logos, then recognition rate improves, but computational resources required increase

Engineering Contradiction:
Improvelogo recognition rateVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The super-resolution system creates a high-resolution copy of the low-resolution vehicle logo by synthesizing additional image details through learned patterns. Instead of requiring the original high-resolution logo, the system generates a computationally efficient copy that preserves the essential features needed for accurate recognition, reducing the need for extensive computational resources.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system replaces traditional mechanical or optical magnification methods with a computational approach using canonical correlation analysis and manifold learning. This substitution allows super-resolution to be achieved through mathematical transformations and pattern recognition rather than physical processes, significantly reducing the computational energy required compared to conventional high-resolution imaging.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10127437B2Unified face representation for individual recognition in surveillance videos and vehicle logo super-resolution system
Publication Date: 2018.11.13 RGT UNIV OF CALIFORNIA
  • US10127437B2 patent drawing
  • US10127437B2 patent drawing
  • US10127437B2 patent drawing

AI summary

A method is disclosed of recognizing a logo of a vehicle. The method including obtaining a limited number of high resolution logos; populating a training dataset for each of the limited number of high resolution logos using gamma transformations; obtaining a low resolution image of a vehicle; and matching the low resolution image of the vehicle with the training dataset.