2D Image Analyzer Parallel Scaling for FPGA Pattern Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 2D image processing methods, such as the Viola-Jones classifier, are inefficient when used on parallel architectures like FPGAs due to the need for sequential processing of multiple scaling stages to recognize patterns like faces or eyes, which are scaled differently in images.

Innovation Solution

A 2D image analyzer that generates an overview image with multiple scaled copies of an input image, allowing a pattern finder on an FPGA to compare the pattern across all relevant scaling stages simultaneously, thereby identifying the optimal scaling stage and position within the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sequential processing of multiple scaling stages is used to recognize patterns at different sizes, then pattern recognition accuracy is improved, but processing time and computational complexity increase significantly

Engineering Contradiction:
Improvepattern recognition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the image into multiple scaling stages and processes each stage in parallel using separate processing pipelines. Instead of sequentially processing one scaling stage at a time, the system segments the processing task across multiple concurrent paths, each handling a specific scaling stage simultaneously, thereby reducing total processing time while maintaining recognition accuracy across all scales.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the sequential processing problem into a parallel processing architecture by adding the dimension of concurrent execution. Multiple scaling stages that were previously processed one after another in time are reorganized to execute simultaneously in parallel, effectively converting a time-based sequence into a spatially distributed parallel computation model that runs all scaling stages at once.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If sequential processing of scaling stages is implemented, then memory usage is reduced, but processing efficiency on parallel architectures deteriorates

Engineering Contradiction:
Improvememory usageVSAvoidprocessing efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent segments the processing workload into independent parallel pipelines, each handling a specific scaling stage. This segmentation allows each pipeline to operate with its own optimized memory resources rather than requiring the entire dataset to be loaded into memory sequentially, improving both memory efficiency and processing speed by enabling concurrent execution across multiple scaling stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent processes only the necessary portions of the image at each scaling stage in parallel, rather than loading and processing the entire image dataset sequentially. By performing partial processing actions on subsets of data across multiple parallel pipelines, the system achieves high processing efficiency without requiring excessive memory resources to hold all data simultaneously.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of manufacture

If multiple scaling stages are processed sequentially, then implementation simplicity is maintained, but adaptability to parallel architectures like FPGA is reduced

Engineering Contradiction:
Improveimplementation simplicityVSAvoidadaptability to parallel architectures
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent segments the image processing task into independent, modular scaling stage pipelines that can be independently implemented and configured. Each scaling stage is divided into separate processing blocks that map naturally to parallel FPGA architecture, allowing the system to maintain implementation simplicity through modular design while simultaneously achieving high adaptability to parallel hardware platforms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a dynamic processing architecture where the number and configuration of parallel scaling pipelines can be adjusted based on the specific application requirements. The system can dynamically activate or deactivate certain scaling stages and adjust the parallelism level to match the capabilities of different hardware platforms, thereby maintaining ease of implementation while achieving high adaptability to various parallel architectures including FPGA.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10074031B22D image analyzer
Publication Date: 2018.09.11 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US10074031B2 patent drawing
  • US10074031B2 patent drawing
  • US10074031B2 patent drawing

AI summary

A 2D image analyzer includes an image scaler, an image generator and a pattern finder. The image scaler is configured to scale an image according to a scaling factor. The image generator is configured to produce an overview image including a plurality of copies of the received and scaled image, wherein every copy is scaled about a different scaling factor. Thereby, the respective position can be calculable by an algorithm, which considers a gap between the scaled images in the overview image, a gap of the scaled image towards one or more borders of the overview image and/or other predefined conditions. The pattern finder is configured to perform a feature transformation and classification of the overview image in order to output a position at which an accordance of the searched pattern and the predetermined pattern is maximal. A post-processing unit for smoothening and correcting the position of local maxima in the classified overview image may also be provided.