Automated Video Modifier Selection via Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current telecommunications devices face challenges in modifying video streams in real-time during video conferencing, requiring physical manipulation and lacking efficient systems for automated identification and presentation of image capture modifiers.

Innovation Solution

The system automates the identification and presentation of image capture modifiers by analyzing the image within the field of view of an image capture device and user interface interactions, allowing for real-time modification of video streams through the determination of user intent and object recognition within the video stream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical manipulation of the device is used to modify video streams, then the device can be operated, but the operation becomes cumbersome and requires physical manipulation

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces physical mechanical manipulation with automated image analysis and processing. The system automatically identifies objects in the video stream and applies modifiers without requiring physical device manipulation, thereby improving ease of operation while reducing the need for complex mechanical controls

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service by automatically analyzing the video stream, identifying objects of interest, and applying appropriate modifiers without user intervention. The automated identification and modification process eliminates the need for manual physical manipulation, enhancing ease of operation

Inventive Principle:
Principle #25Self-service

2Productivity

If automated identification of image modifiers is implemented, then productivity is improved, but device complexity increases

Engineering Contradiction:
ImproveproductivityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex manual processes with automated image analysis algorithms. The system uses computer vision and machine learning to automatically identify objects and determine appropriate modifiers, significantly improving productivity while the automated nature of the process manages the complexity through software rather than hardware

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary automated processing layer between the video capture and the modifier application. This intermediary system analyzes the video stream, identifies objects, and selects modifiers automatically, improving productivity by streamlining the workflow while containing complexity within a dedicated processing module

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If real-time modification of video streams is performed, then the speed of modification is improved, but the complexity of processing increases

Engineering Contradiction:
ImprovespeedVSAvoiddevice complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-processing the video stream to identify objects and characteristics before modification is needed. This preparation work is done in advance during normal video capture, allowing for rapid real-time modification without excessive processing complexity during the actual modification moment

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the video processing into distinct modules: object identification, characteristic analysis, modifier selection, and application. This segmentation allows each module to be optimized independently for speed while managing overall system complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250097376A1Selective identification and order of image modifiers
Publication Date: 2025.03.20 SNAP INC
  • US20250097376A1 patent drawing
  • US20250097376A1 patent drawing
  • US20250097376A1 patent drawing

AI summary

Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.