Privacy Mask Encoding Using Camera Motion Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Pixelated privacy masks in cameras with movable fields of view tend to oscillate or flicker, causing an unpleasant user experience due to noise changes during camera movement.

Innovation Solution

The method encodes pixel blocks within the privacy mask area as inter-coded blocks with a motion vector set equal to the camera movement and a residual set to zero, ensuring that pixel blocks remain copies of their reference blocks, thereby preventing flickering and noise-related brightness or color changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If pixelated privacy masks are applied to images captured by cameras with movable fields of view, then privacy protection is achieved, but the masks oscillate or flicker during camera movement causing unpleasant user experience

Engineering Contradiction:
Improveprivacy mask stabilityVSAvoiduser experience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent applies temporal smoothing by referencing previously decoded images to determine privacy mask areas before encoding current images. This preliminary action stabilizes the mask position across multiple frames, preventing flickering during camera movement while maintaining privacy protection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent copies privacy mask area information from previously decoded reference images to current images. By using the privacy mask area from a previous frame as a reference, the system maintains consistent mask positioning across frames, eliminating oscillation and flicker effects during camera movement.

Inventive Principle:
Principle #26Copying

2Productivity

If standard inter-coding is used for pixel blocks in privacy mask areas during camera movement, then compression efficiency is maintained, but noise changes cause brightness or color changes in the masked areas

Engineering Contradiction:
Improveencoding efficiencyVSAvoidpixel block consistency
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The patent applies different encoding strategies to different regions of the image. For pixel blocks within privacy mask areas, it uses a specialized encoding mode that copies reference blocks directly, while other regions use standard inter-coding. This local differentiation ensures consistency in masked areas without compromising overall encoding efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the image into pixel blocks and further identifies which blocks fall within privacy mask areas. This segmentation allows independent handling of masked and non-masked regions, applying appropriate encoding methods to each segment to maintain both efficiency and visual stability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11544878B2Method of encoding an image including a privacy mask
Publication Date: 2023.01.03 AXIS
  • US11544878B2 patent drawing
  • US11544878B2 patent drawing
  • US11544878B2 patent drawing

AI summary

Image encoding within a pixelated privacy mask area is adapted in order to reduce flickering during movement of a camera. Motion vectors are set equal to the movement of the camera, and residuals are set to zero, thereby encoding pixel blocks within the privacy mask area as copies of corresponding pixel blocks in a reference image.