Random Forest Regression Voting for Deformable Shape Model Fitting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods for fitting deformable shape models to images are inefficient and inaccurate, particularly in using regression voting approaches, which have not been fully explored for deformable models despite their potential for fast and accurate feature detection.

Innovation Solution

The method employs a random forest regression approach to generate response images by scanning a patch image across the acquired image, accumulating votes for target point locations, and optimizing these positions based on a deformable shape model, using a subset of pixels and a reference image for efficient and accurate feature detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional discriminative or boosted regression methods are used for feature detection, then the approach is computationally simpler, but speed and accuracy are significantly lower

Engineering Contradiction:
Improvefeature detection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The image processing is divided into multiple independent stages: patch extraction, random forest regression voting, and deformable model fitting. Each stage processes specific aspects separately, allowing parallel computation and optimizing overall processing speed while maintaining high accuracy through specialized handling at each stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Response images are pre-computed using random forest regression voting before the actual deformable model fitting. This preliminary computation of probability maps for each target point location enables faster subsequent optimization by providing pre-processed guidance information, thereby improving both speed and accuracy.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If regression voting with random forest is implemented for deformable shape models, then feature detection speed and accuracy improve, but computational complexity and processing time increase

Engineering Contradiction:
Improvefeature detection robustnessVSAvoidalgorithm complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Response images serve as intermediary data structures that mediate between the random forest regression results and the deformable shape model fitting. These response images accumulate voting results from multiple random forest regressors and provide a simplified interface for the subsequent optimization stage, managing complexity while maintaining reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The algorithm dynamically adjusts the number of random forest trees and voting parameters based on the specific application requirements and data characteristics. This dynamic configuration allows the system to maintain high robustness while adapting computational complexity to match available resources and performance needs.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If all pixels are processed for regression voting, then detection accuracy improves, but processing time and computational load increase significantly

Engineering Contradiction:
Improvetarget point location accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The algorithm focuses computational effort on local regions around expected target point locations rather than uniformly processing the entire image. By concentrating random forest regression voting in relevant local areas identified through initial estimates or interest regions, the system achieves high location accuracy while minimizing unnecessary processing of irrelevant image areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of processing all possible pixel locations with equal detail, the algorithm applies partial processing to most areas and excessive (detailed) processing only to regions with high probability of containing target points. This selective approach, guided by the deformable model constraints and initial position estimates, optimizes the balance between accuracy and processing time.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9928443B2Image processing apparatus and method for fitting a deformable shape model to an image using random forest regression voting
Publication Date: 2018.03.27 UNIV OF MANCHESTER
  • US9928443B2 patent drawing
  • US9928443B2 patent drawing
  • US9928443B2 patent drawing

AI summary

One embodiment of the invention provides an image processing method for use in fitting a deformable shape model to an acquired image. The deformable shape model specifies a set of target points whose motion is governed by the model. The method comprises, for each target point, generating a corresponding response image by: providing a feature detector to locate a given target point within the acquired image, wherein said feature detector includes a random forest comprising one or more decision trees; scanning a patch image across the acquired image to define multiple sampling locations with respect to the acquired image; for each sampling location of the patch image with respect to the acquired image, performing regression voting using the random forest to produce one or more votes for the location of the given target point within the acquired image; and accumulating the regression votes for all of the multiple sampling locations to generate said response image corresponding to the given target point. The method further includes then performing an optimization to determine positions for the set of target points within the acquired image based on the corresponding response images and subject to constraint by the deformable shape model.