Video Feed Object Detection for Privacy Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in sharing real-time video feeds during interactive content, such as video games, as they struggle to ensure that personal or copyrighted information is not inadvertently revealed, including family members, confidential documents, and copyrighted materials, which can compromise privacy and intellectual property rights.

Innovation Solution

A data processing apparatus and method that uses object detection techniques, like convolutional neural networks, to identify sensitive objects in the video feed and apply actions such as replacing faces with avatars, blurring copyrighted materials, and recommending the obstruction of windows, allowing users to control what is shared with other players.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If real-time video feed is shared with other users, then communication and game experience are enhanced, but privacy and intellectual property are compromised due to visible sensitive objects

Engineering Contradiction:
Improvecommunication capabilityVSAvoidprivacy risk
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary detection of sensitive objects in the video feed before transmission. Object detection algorithms analyze the video content in real-time to identify sensitive objects such as personal documents, copyrighted materials, and other privacy-sensitive items, and prepare appropriate obscuration actions before the video is shared with other users

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary processing layer between the video capture and transmission. This intermediary component detects sensitive objects and applies obscuration techniques (such as blurring or masking) to the video feed, acting as a mediator that protects privacy while allowing video communication to proceed

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If user manually checks field of view to remove sensitive objects, then privacy protection is improved, but user convenience and ease of operation deteriorate

Engineering Contradiction:
Improveprivacy protectionVSAvoiduser convenience
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The system enables self-service privacy protection by automatically detecting sensitive objects in the video feed and applying appropriate obscuration without requiring user intervention. The object detection and obscuration processes occur autonomously, allowing users to share video feeds without manually checking the field of view or adjusting camera angles

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides feedback to users about detected sensitive objects and the obscuration actions being applied. This feedback mechanism allows users to verify that their privacy concerns are being addressed while maintaining automatic operation, and to adjust settings if needed

Inventive Principle:
Principle #23Feedback

3Object-affected harmful factors

If object detection and obscuration processing is applied, then privacy and intellectual property protection are improved, but processing time and system complexity increase

Engineering Contradiction:
Improvesensitive information protectionVSAvoidprocessing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system performs preliminary analysis of the video feed to identify sensitive objects before full processing is applied. By detecting objects of interest early in the processing pipeline, the system can apply obscuration only to relevant regions, reducing overall processing complexity compared to analyzing and processing the entire video frame

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If automatic object detection is implemented, then ease of operation is improved, but measurement precision and detection accuracy may be affected by false positives

Engineering Contradiction:
Improveautomatic operationVSAvoiddetection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system applies different detection and obscuration strategies to different regions of the video feed based on local characteristics. By analyzing specific areas with different levels of scrutiny and applying appropriate obscuration techniques tailored to each detected object type and context, the system maintains high detection accuracy while enabling automatic operation

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20230401683A1Data processing apparatus and method
Publication Date: 2023.12.14 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20230401683A1 patent drawing
  • US20230401683A1 patent drawing
  • US20230401683A1 patent drawing

AI summary

A data processing apparatus includes circuitry configured to: receive an image of a user in an environment; detect an object in the image; perform one of a plurality of user-selectable processes associated with the object, each of the plurality of user-selectable processes being associated with hiding a visual characteristic of the object in the image; and after the one of the plurality of user-selectable processes has been performed, transmit data representing the image.