Articulated Object Motion Stabilization via Segmented Optical Flow

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing motion detection systems face challenges in accurately distinguishing and detecting articulated objects due to noise introduced by camera-centric and object-centric motion, which complicates the identification of part-centric motion that is crucial for recognizing specific objects.

Innovation Solution

The system isolates part-centric motion by stabilizing and removing camera-centric and object-centric motion, allowing for focused motion feature extraction using temporal differencing, thereby improving detection accuracy and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If optical flow is calculated for all pixels to model motion in visual scenes, then comprehensive motion information is obtained, but noise from camera-centric and object-centric motion deteriorates detection accuracy

Engineering Contradiction:
Improveobject detection accuracyVSAvoidmotion noise
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent segments motion into three distinct components: camera-centric motion, object-centric motion, and part-centric motion. By calculating optical flow at multiple scales (coarse and fine) and analyzing motion patterns differently across these scales, the system isolates part-centric motion from the noise of other motion types, thereby improving detection accuracy while filtering harmful motion noise.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating different regions of the visual scene with different analysis methods. Coarse optical flow is used for global motion estimation (camera and object-centric), while fine optical flow is applied locally to detect part-centric motion. This localized differentiation allows the system to extract useful motion information while suppressing noise from other motion sources.

Inventive Principle:
Principle #3Local quality

2Reliability

If all motion information is processed for object detection, then complete motion data is available, but processing complexity and time increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent divides motion processing into two parallel streams: coarse optical flow for global motion estimation and fine optical flow for local part-centric motion detection. This segmentation allows the system to process only relevant motion information at each scale, reducing overall processing time while maintaining detection reliability through the combined analysis of both streams.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary motion estimation using coarse optical flow to identify camera-centric and object-centric motion patterns before conducting fine-grained analysis. This preliminary action allows the system to pre-filter out irrelevant motion components, reducing the amount of data that requires intensive processing and thereby decreasing overall processing time while preserving detection reliability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9734404B2Motion stabilization and detection of articulated objects
Publication Date: 2017.08.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9734404B2 patent drawing
  • US9734404B2 patent drawing
  • US9734404B2 patent drawing

AI summary

The techniques and systems described herein are directed to isolating part-centric motion in a visual scene and stabilizing (e.g., removing) motion in the visual scene that is associated with camera-centric motion and/or object-centric motion. By removing the motion that is associated with the camera-centric motion and/or the object-centric motion, the techniques are able to focus motion feature extraction mechanisms (e.g., temporal differencing) on the isolated part-centric motion. The extracted motion features may then be used to recognize and/or detect the particular type of object and/or estimate a pose or position of a particular type of object.