Reinforcement Learning Audiovisual Sanitization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video sanitization techniques fail to effectively identify and mask sensitive information in audiovisual files, as they simply obfuscate regions of interest without quantifying or bounding privacy leakage, and do not address the need for robust analysis of large video data generated daily.

Innovation Solution

A system using reinforcement learning to separate audiovisual files into video and audio components, applying convolutional neural networks (CNN) and audio word2vec algorithms to identify sensitive portions, and implementing a masking algorithm to generate masked components, while optimizing the masking action policy through reinforcement learning for effective obfuscation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing video sanitization techniques are used to obfuscate regions of interest, then some level of privacy protection is achieved, but the techniques fail to effectively identify and mask sensitive information and do not quantify or bound privacy leakage

Engineering Contradiction:
Improveprivacy protection effectivenessVSAvoidprivacy leakage
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent implements a reinforcement learning framework where the masking algorithm receives feedback through a reward function that quantifies privacy protection effectiveness. The system continuously learns from the feedback signal, adjusting masking strategies to maximize privacy protection while minimizing information loss. The reward function provides explicit feedback on whether sensitive information was successfully masked, enabling iterative improvement of the sanitization process.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical/manual video sanitization techniques with an intelligent system based on deep learning and reinforcement learning. Instead of simple obfuscation algorithms, the system uses neural networks to identify sensitive information and reinforcement learning to optimize masking decisions, substituting rule-based mechanical processes with adaptive intelligent processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If reinforcement learning is applied to optimize masking action policy, then privacy protection is maximized, but computational complexity and processing time increase

Engineering Contradiction:
Improveprivacy protectionVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-processing the video content to identify potential sensitive regions before applying the full reinforcement learning masking process. The system prepares the environment and initial state representations in advance, reducing the computational burden during the actual masking optimization phase. This preliminary identification step simplifies the subsequent reinforcement learning task.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the video processing task into distinct components: initial sensitive region detection, reinforcement learning policy optimization, and final masking application. By dividing the complex processing into manageable segments, the system reduces overall computational complexity while maintaining effective privacy protection. Each segment can be optimized independently and processed efficiently.

Inventive Principle:
Principle #1Segmentation

3Reliability

If sensitive portions are identified and masked in real-time, then privacy is preserved, but processing speed and efficiency are reduced

Engineering Contradiction:
Improveprivacy preservationVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary identification of sensitive information using pre-trained detection models before applying the reinforcement learning masking process. This advance identification allows the system to prepare masking strategies in advance, reducing the time required for real-time processing while maintaining effective privacy preservation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial masking actions by focusing computational resources on identifying and masking only the most critical sensitive regions rather than processing every frame uniformly. The reinforcement learning agent learns to apply masking selectively where it is most needed, improving processing efficiency while maintaining adequate privacy protection for the most sensitive content.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11756299B2System for preserving image and acoustic sensitivity using reinforcement learning
Publication Date: 2023.09.12 BANK OF AMERICA CORP
  • US11756299B2 patent drawing
  • US11756299B2 patent drawing

AI summary

Systems, computer program products, and methods are described herein for preserving image and acoustic sensitivity using reinforcement learning. The present invention is configured to initiate a file editing engine on the audiovisual file to separate the audiovisual file into a video component and an audio component; initiate a convolutional neural network (CNN) algorithm on the video component to identify one or more sensitive portions in the one or more image frames; initiate an audio word2vec algorithm on the audio component to identify one or more sensitive portions in the audio component; initiate a masking algorithm on the one or more image frames and the audio component; generate a masked video component and a masked audio component based on at least implementing the masking action policy; and bind, using the file editing engine, the masked video component and the masked audio component to generate a masked audiovisual file.