Digital Image Pre-Processing for Sensor Movement Bitrate Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital image processing for encoding becomes computationally heavy and increases bitrate when an image sensor moves, leading to potential transmission issues and loss of visual information during camera movement.

Innovation Solution

Adapting pre-processing parameters based on movement information from the image sensor, such as disabling or reducing procedures like sharpening and tone mapping, and enabling blurring to reduce bitrate and maintain image usability during movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If pre-processing is performed on images captured during image sensor movement, then image quality may be improved, but bitrate increases unnecessarily and computational complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidbitrate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The pre-processing parameters are made dynamic and adaptable based on the detected image sensor movement. The system adjusts sharpening strength, noise filtering intensity, and other pre-processing parameters according to the magnitude of movement detected, allowing optimal image quality while minimizing unnecessary bitrate increase during movement periods.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes pre-processing parameters based on movement detection. When movement is detected, parameters such as sharpening intensity and filtering strength are modified to reduce the computational load and bitrate overhead while maintaining acceptable image quality for moving scenes.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If pre-processing is performed on images captured during image sensor movement, then image quality may be improved, but computational complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The pre-processing pipeline dynamically adjusts its complexity based on movement detection. When the image sensor is detected to be moving, the system reduces the intensity or disables certain computationally expensive pre-processing operations, thereby lowering computational complexity while adapting to the changing scene conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system modifies pre-processing parameters to reduce computational load during movement. By adjusting parameters such as filtering strength, sharpening intensity, and block size, the system maintains acceptable image quality while significantly reducing the computational complexity of pre-processing during periods of sensor movement.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If image encoding is frozen during camera movement, then bitrate is reduced, but visual information is lost and operator becomes disoriented

Engineering Contradiction:
ImprovebitrateVSAvoidvisual information
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

Instead of completely freezing encoding during movement, the system applies partial pre-processing actions adapted to the movement level. By applying reduced-intensity pre-processing operations rather than full processing or complete freezing, the system maintains visual information flow while keeping bitrate under control during camera movement periods.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10110929B2Method of pre-processing digital images, and digital image preprocessing system
Publication Date: 2018.10.23 AXIS
  • US10110929B2 patent drawing
  • US10110929B2 patent drawing
  • US10110929B2 patent drawing

AI summary

A method of pre-processing digital images captured by an image sensor for encoding is disclosed. The method comprises receiving a first digital image, receiving information representative of a movement of the image sensor at a time of capture of said first digital image), and pre-processing said first digital image. At least one parameter of said pre-processing is dependent on said information representative of movement. A digital image pre-processing system is also disclosed.