Video Encoder Empty Frame Insertion for Privacy Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video processing systems face challenges in maintaining a high frame rate and reducing power consumption and bandwidth during privacy masking, as the masking process can slow down the frame rate and increase power consumption and network bandwidth due to the need for synchronization and repeated processing of frames.

Innovation Solution

The method involves adding empty frames to the encoded image stream until the masking evaluation is complete, which reduces the need for further processing and decreases bandwidth requirements, while maintaining a constant frame rate by using pre-computed empty frames that require minimal data and processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If masking is applied to moving objects in real time, then privacy protection is improved, but frame rate is reduced due to processing time

Engineering Contradiction:
Improveprivacy protectionVSAvoidframe rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-processing images to identify moving objects and generate mask data before the actual video encoding process. The mask data is prepared in advance and stored, allowing the video encoder to apply masking without real-time processing delays, thus maintaining high frame rates while ensuring privacy protection.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If masking synchronization is performed, then privacy protection is improved, but power consumption increases due to increased processing

Engineering Contradiction:
Improveprivacy protectionVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent reduces power consumption by performing mask synchronization in advance. The system identifies moving objects and prepares mask data before video encoding, storing the mask data for later use. This eliminates the need for continuous real-time synchronization processing during video encoding, significantly reducing power consumption while maintaining privacy protection.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If masking is applied, then privacy protection is improved, but bandwidth requirement increases due to increased information

Engineering Contradiction:
Improveprivacy protectionVSAvoidbandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential mask data from the full image processing pipeline. Instead of transmitting complete processed frames with masking applied, the system generates compact mask data that contains only the necessary information for privacy protection. This mask data is then applied at the decoder side, significantly reducing bandwidth requirements while maintaining privacy protection.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12056926B2Method and image-processing device for video processing
Publication Date: 2024.08.06 AXIS
  • US12056926B2 patent drawing
  • US12056926B2 patent drawing
  • US12056926B2 patent drawing

AI summary

A method for controlling video processing. A stream of images emanating from an image sensor is received. The contents of an image in the stream is evaluated. A part of the image stream, which part is antecedent the image being evaluated, is forwarded to a video encoder. Until the evaluation is complete, one or more empty frames are added at the end of an encoded image stream corresponding to the forwarded image stream.