Cascaded Convolutional Neural Networks for Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques for identifying objects, such as faces, in digital images are time-consuming, leading to user frustration due to delays in identification.

Innovation Solution

The use of cascaded convolutional neural networks, which involve multiple layers of convolutional neural networks that progressively analyze candidate windows in an image, with earlier layers quickly rejecting non-object windows and later layers providing more accurate object identification, along with an optional window alignment neural network for improved accuracy and reduced analysis time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple candidate windows are analyzed to identify objects in an image, then object detection accuracy is improved, but processing time increases significantly

Engineering Contradiction:
Improveobject detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system segments the object detection process into multiple cascade stages, where each stage analyzes a subset of candidate windows. Early stages perform rapid filtering of clearly non-object regions, while later stages conduct more thorough analysis on remaining candidates. This segmentation allows the system to maintain high detection accuracy across all candidate windows while significantly reducing overall processing time by avoiding exhaustive analysis of every window.

Inventive Principle:
Principle #1Segmentation

2Reliability

If all candidate windows are thoroughly analyzed to ensure accurate object identification, then detection reliability is improved, but computational complexity increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system applies partial analysis to all candidate windows through early cascade stages that perform quick rejection of non-object regions. Full thorough analysis is applied only to the subset of candidate windows that survive early filtering. This approach ensures detection reliability is maintained for all windows while reducing computational complexity by avoiding excessive analysis on windows that will be rejected anyway.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If a single neural network analyzes all candidate windows, then simplicity of the system is maintained, but processing speed decreases

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides the neural network analysis into multiple cascade stages, each containing one or more neural networks that analyze specific subsets of candidate windows. This segmentation enables parallel processing and early rejection of non-object regions, significantly improving processing speed. While this increases system complexity compared to a single neural network, the performance gains in processing speed and efficiency justify the additional architectural complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9697416B2Object detection using cascaded convolutional neural networks
Publication Date: 2017.07.04 ADOBE INC
  • US9697416B2 patent drawing
  • US9697416B2 patent drawing
  • US9697416B2 patent drawing

AI summary

Different candidate windows in an image are identified, such as by sliding a rectangular or other geometric shape of different sizes over an image to identify portions of the image (groups of pixels in the image). The candidate windows are analyzed by a set of convolutional neural networks, which are cascaded so that the input of one convolutional neural network layer is based on the input of another convolutional neural network layer. Each convolutional neural network layer drops or rejects one or more candidate windows that the convolutional neural network layer determines does not include an object (e.g., a face). The candidate windows that are identified as including an object (e.g., a face) are analyzed by another one of the convolutional neural network layers. The candidate windows identified by the last of the convolutional neural network layers are the indications of the objects (e.g., faces) in the image.