Video Object Segmentation Using PIR and 3D Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital image processing systems face inefficiencies and unreliability in object segmentation, particularly when analyzing complex motion and depth in video sequences, leading to high computational resource consumption or low reliability.

Innovation Solution

A system that detects specific types of movement within a video sequence by using a combination of PIR sensors, infrared LEDs, and 3D sensors to selectively enable different operating modes, allowing for efficient object segmentation by focusing on human or non-human motion, thereby reducing computational load and improving accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system performs object segmentation with a high degree of complexity (analyzing depth and regions of interest), then the reliability of object segmentation is improved, but the computational resource consumption increases and processing speed decreases

Engineering Contradiction:
Improveobject segmentation reliabilityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary motion detection using PIR sensors and 3D sensors before conducting detailed object segmentation. This preliminary action identifies regions containing motion, allowing the system to focus subsequent complex segmentation operations only on those specific regions rather than processing the entire image, thus maintaining reliability while improving processing speed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system divides the image processing task into multiple segments: first detecting motion regions using sensors, then performing object segmentation only on those detected regions. This segmented approach reduces the overall computational load while maintaining segmentation reliability in the regions that require it

Inventive Principle:
Principle #1Segmentation

2Productivity

If the system performs object segmentation with a low degree of complexity, then the computational resource consumption decreases and processing speed increases, but the reliability of object segmentation deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidobject segmentation reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system applies different processing qualities to different regions of the image: simple motion detection is applied to the entire image, while complex object segmentation is applied only to specific regions where motion is detected. This local quality approach ensures high reliability where needed while maintaining overall processing efficiency

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the system uses multiple sensors (PIR sensors, infrared LEDs, 3D sensors) for motion detection, then the accuracy of motion classification is improved, but the device complexity increases

Engineering Contradiction:
Improvemotion detection accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system combines multiple sensor types (PIR sensors for thermal motion detection, infrared LEDs for illumination, and 3D sensors for depth detection) into a unified motion detection system. By merging these sensors and processing their combined data, the system achieves high measurement precision while managing device complexity through integrated processing

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system achieves real-time object segmentation with improved speed and reliability by hierarchically triggering segmentation on detected human or non-human motion, optimizing resource usage and enhancing the accuracy of motion classification.

Implementation Method 1

a low resolution passive infrared ("PIR") sensor (104) that measures infrared light that radiates from physical objects within its field of view

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Implementation Method 2

a three-dimensional ("3D") sensor (112) that measures light that radiates from physical objects within its field of view, which substantially overlaps the field of view of the PIR sensor (104)

Methodology Applied
Scientific EffectLight radiation measurement: Light

Data Source

PatentUS9053371B2Method, system and computer program product for identifying a location of an object within a video sequence
Publication Date: 2015.06.09 TEXAS INSTRUMENTS INC
  • US9053371B2 patent drawing
  • US9053371B2 patent drawing
  • US9053371B2 patent drawing

AI summary

In response to detecting a motion within a video sequence, a determination is made of whether the motion is a particular type of movement. In response to determining that the motion is the particular type of movement, a location is identified within the video sequence of an object that does the motion.