Messaging App Overlaying Contextual Item Graphics on Real-World Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face inefficiency when trying to add graphical elements or descriptions to real-world objects in messaging applications, as they need to navigate through multiple pages and launch separate web-based applications, which is tedious and resource-intensive.

Innovation Solution

The messaging application generates a template for image modification and associates application fragments with it, allowing users to select items from a list of contextually relevant information from web-based applications, such as menu items or garments, and overlays the selected graphical elements directly onto the image without leaving the messaging app.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users navigate through multiple pages and launch separate web-based applications to add graphical elements to real-world objects, then they can access comprehensive information, but the process becomes tedious and resource-intensive

Engineering Contradiction:
Improveease of useVSAvoidprocess time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent merges the messaging application interface with web-based application content by embedding web content fragments directly into the messaging app's display. This allows users to access menu items, garments, and other real-world object information without leaving the messaging app, eliminating the need to launch separate applications and navigate multiple pages.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The messaging application is enhanced to perform multiple functions: it not only communicates messages but also displays and interacts with web-based application content. The app can present lists of menu items, garments, and other items associated with real-world objects, allowing users to complete tasks that previously required separate applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If users navigate through multiple pages and launch separate web-based applications to add graphical elements, then they can access comprehensive information, but resource consumption increases

Engineering Contradiction:
Improveinformation accessVSAvoidresource consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

By combining the messaging application with web content display capabilities, the system allows users to access comprehensive information about real-world objects (menu items, garments) within the same application environment, eliminating the need to launch separate web-based applications and reducing overall resource consumption.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If the messaging application integrates web-based application content, then user experience is enhanced, but device resources are consumed

Engineering Contradiction:
Improveuser experienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements segmentation by dividing web-based application content into discrete fragments that can be independently managed and displayed within the messaging application. Each fragment represents a specific portion of web content (e.g., a list of menu items or garments) that can be presented without loading the entire web application, reducing memory and processing requirements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240412423A1Adding graphical representation of real-world object
Publication Date: 2024.12.12 SNAP INC
  • US20240412423A1 patent drawing
  • US20240412423A1 patent drawing
  • US20240412423A1 patent drawing

AI summary

Methods and systems are disclosed for modifying an image. For example, a messaging application implemented on a client device displays an image comprising a real-world object and determines a current location of the client device. The messaging application identifies a venue associated with the current location of the client device and obtains a list of items available for purchase at the venue. The messaging application receives input that selects a given item from the list of items that corresponds to the real-world object. The messaging application adds, to the image, a graphical representation of the given item that corresponds to the real-world object depicted in the image.