Context-Relevant Media Overlays for Mobile Image Augmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing number of digital photographs and videos taken with mobile wireless devices has outpaced those taken with dedicated cameras, necessitating improved experiences in mobile wireless digital photography and videography, particularly through context-relevant media augmentation.

Innovation Solution

A media overlay publication system that generates and applies context-relevant media overlays to images or videos based on geographic location, user context, and other contextual information, allowing users and merchants to upload, select, and bid on overlays, which can include audio, visual content, and visual effects, and are delivered via a client-server architecture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If mobile wireless devices are used to take photographs and videos, then accessibility and convenience are improved, but image and video quality deteriorate compared to dedicated cameras

Engineering Contradiction:
Improveconvenience of mobile photographyVSAvoidimage quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces media overlays as an intermediary layer that enhances mobile-captured media with additional contextual information (location, time, events, merchant content). This mediator compensates for the inherent quality limitations of mobile devices by adding value through supplementary data layers rather than attempting to improve the core capture quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a composite media product by combining the base mobile-captured image/video with multiple overlay layers containing different types of information (geographic data, temporal data, event data, merchant content). This composite structure allows the final output to exceed the quality and information content of the original mobile capture.

Inventive Principle:
Principle #40Composite materials

2Adaptability or versatility

If context-relevant media overlays are generated and applied, then user experience and content relevance are improved, but system complexity increases

Engineering Contradiction:
Improvecontext relevanceVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the media enhancement system into distinct functional modules: overlay generation module, overlay application module, and multiple independent data sources (geographic information, temporal information, event information, merchant content). Each module handles a specific aspect of context relevance, making the overall complex system manageable through functional decomposition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal media overlay system that can apply multiple types of contextual enhancements (location-based, time-based, event-based, merchant-sponsored) through a single integrated platform. This multi-functional approach allows the system to handle diverse context-relevance requirements without requiring separate specialized systems for each type of enhancement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Quantity of substance

If multiple media overlays from different sources are integrated, then content richness and personalization are improved, but information management complexity increases

Engineering Contradiction:
Improvecontent richnessVSAvoidinformation management
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent implements a nested structure where multiple layers of media overlays (geographic, temporal, event, merchant content) are integrated into a single unified overlay package that is applied to the base media. This nesting approach allows rich multi-source content to be managed as a cohesive layered structure, simplifying information management by providing a hierarchical organization rather than requiring parallel management of multiple independent content streams.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS12387403B2Media overlay publication system
Publication Date: 2025.08.12 SNAP INC
  • US12387403B2 patent drawing
  • US12387403B2 patent drawing
  • US12387403B2 patent drawing

AI summary

Systems and methods are presented that provide for receiving, at a media overlay publication system from a first client device, content to generate a media overlay, and generating the media overlay using the content received from the client device. The generated media overlay is stored in a database associated with the media overlay publication system and associated with a first characteristic of the content received from the first client device. The media overlay is provided to a second client device when a second characteristic of context data associated with the second client device correlates to the first characteristic for the media overlay, causing a display of the media overlay on a user interface of the second client device.