Image Capture Sampling Controller Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems in robotic devices face inefficiencies due to the need to process all captured images, which can lead to reduced accuracy and increased communication bandwidth, especially when dealing with dynamic scenes or computationally intensive operations.

Innovation Solution

Implementing an image capture system that determines sets of exposure parameter values at a high rate and samples images at a lower rate for processing, allowing only subsets of images to be sent to the image processing unit, thereby optimizing processing efficiency and reducing bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If all captured images are processed by the image processing unit, then processing accuracy is improved, but communication bandwidth consumption increases and processing efficiency decreases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidcommunication bandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent extracts only a subset of captured images for processing by the image processing unit, rather than processing all images. The controller selects representative images based on exposure parameter changes, scene dynamics, or time intervals, thereby reducing communication bandwidth consumption while maintaining processing accuracy for critical images.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by processing only a portion of the captured images instead of all images. The controller determines which images to send based on whether they meet specific criteria such as significant exposure parameter changes or scene activity, achieving sufficient processing accuracy with reduced bandwidth usage.

Inventive Principle:
Principle #16Partial or excessive action

2Reliability

If all captured images are sent to the image processing unit, then processing completeness is improved, but processing efficiency decreases due to computational load

Engineering Contradiction:
Improveprocessing completenessVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The controller extracts and sends only a representative subset of images to the image processing unit based on predetermined criteria such as exposure parameter changes exceeding thresholds, scene activity detection, or time-based sampling. This maintains processing completeness for critical images while significantly improving processing efficiency by reducing the total number of images requiring computational processing.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The controller performs preliminary filtering and selection of images before they reach the image processing unit. By pre-evaluating images against selection criteria and only forwarding those that meet the thresholds, the system ensures processing completeness for important images while improving overall processing efficiency through reduced computational load.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the sampling rate is increased to match the exposure determination rate, then image representation accuracy is improved, but communication bandwidth consumption increases

Engineering Contradiction:
Improveimage representation accuracyVSAvoidcommunication bandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent implements a dynamic sampling rate that adjusts based on scene conditions and exposure parameter changes. When significant changes are detected, the sampling rate increases to maintain image representation accuracy. When changes are minimal, the sampling rate decreases to reduce communication bandwidth consumption, optimizing the trade-off between accuracy and energy usage.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The controller dynamically changes the sampling rate parameter based on the determined exposure parameter values and scene characteristics. By adjusting the sampling rate according to actual needs rather than maintaining a constant high rate, the system achieves sufficient image representation accuracy while minimizing communication bandwidth consumption.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11910098B2Systems and methods for sampling images
Publication Date: 2024.02.20 GDM HOLDING LLC
  • US11910098B2 patent drawing
  • US11910098B2 patent drawing
  • US11910098B2 patent drawing

AI summary

An example method includes determining, by a controller of an image capture system, a plurality of sets of exposure parameter values for one or more exposure parameters. The plurality of sets of exposure parameter values are determined at an exposure determination rate. The method further includes capturing, by an image capture device of the image capture system, a plurality of images. Each image of the plurality of images is captured according to a set of exposure parameter values of the plurality of sets of exposure parameter values. The method also includes sending, by the controller of the image capture system to an image processing unit, a subset of the plurality of images. Each subset of images is sent at a sampling rate, and the sampling rate is less than the exposure determination rate.