ISP Hot Region Detection for Low-Power Motion Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motion detection systems in digital devices require complex and power-consuming systems for computationally intensive analysis, often necessitating continuous operation and large infrastructure for image processing and communication.

Innovation Solution

A method utilizing an Image Signal Processor (ISP) to initiate a motion diagnostic process on digital images captured by a sensor, detecting hot regions by comparing image statistics and communicating the results to a third-party device, allowing for efficient motion detection and reduced power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a complex processing unit is used to perform computationally intensive motion detection analysis, then motion detection accuracy is improved, but power consumption and system complexity increase

Engineering Contradiction:
Improvemotion detection accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system divides the image processing task into two segments: the ISP performs initial hot region detection by comparing image statistics (summing pixel values in regions) to identify potential motion areas, then only these hot regions are transmitted to the requester for detailed analysis. This segmentation allows the low-power ISP to handle the bulk of processing while the complex analysis is performed only when necessary.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The hot region map serves as an intermediary data structure that bridges the ISP and the requester. Instead of transmitting entire images or raw pixel data, the system creates a compressed representation (hot region map) that indicates only the areas requiring further analysis, reducing communication overhead and enabling the requester to focus computational resources on specific regions of interest.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If a complex system with computing units and communication means is maintained in continuous operational mode, then motion detection reliability is improved, but power consumption and system complexity increase

Engineering Contradiction:
Improvemotion detection reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements periodic action by having the ISP continuously perform lightweight hot region detection on incoming images, while the requester device can remain in a low-power state and is activated only when hot regions are detected and need detailed analysis. This periodic activation pattern maintains reliability by ensuring motion is detected continuously while allowing the complex system to sleep when not needed.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If the requester device performs detailed motion detection analysis, then motion detection precision is improved, but the requester device cannot remain in low-power state

Engineering Contradiction:
Improvemotion detection precisionVSAvoidrequester device power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies local quality by having the requester device perform detailed analysis only on specific local regions (hot regions) identified by the ISP, rather than analyzing entire images. The hot region map provides precise location information, allowing the requester to concentrate computational resources only where motion is detected, thereby maintaining high precision while minimizing power consumption by keeping the requester in low-power mode when no hot regions exist.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient motion detection with reduced power consumption and simplified system requirements, allowing the requester device to remain in a low-power state when no hot regions are detected, facilitating effective communication of motion detection results.

Implementation Method 1

an image sensor can comprise a photosensitive cell array designed to transduce optical image of objects formed on the photosensitive cell array by incidence of light, into corresponding electronic signals

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10984536B2Motion detection in digital images and a communication method of the results thereof
Publication Date: 2021.04.20 DSP GROUP
  • US10984536B2 patent drawing
  • US10984536B2 patent drawing
  • US10984536B2 patent drawing

AI summary

The present invention discloses a method operable on a digital electronic device comprising an ISP, for initiating a motion diagnostic process on digital images captured by a sensor, and an image sensor. The method operable on a digital electronic device may also be designed to comprise additional steps such as reading a digital image stored in a memory unit, wherein the ISP is configured with computerized instructions comprising instructions to identify regions in the digital image, operating a hot region detection process to detect hot regions among the identified regions, creating a hot region map representing the hot regions detected among the identified regions, and then allowing the requester access to the captured hot region map via communicating with the memory unit, wherein said access allows the requester to perform a motion detection on the digital image. In some cases, the ISP or the digital electronic device may conduct a motion detection on the detected hot regions. Such an analysis may comprise a motion detection, classification process, and the like. In some cases, the requester may be an external device.