AR Product Image Editing Through 3D In-Context Manipulation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for editing static content items in graphical user interfaces, such as product images, are limited by the need to navigate away from the interface to use separate editing tools, restricting the ability to make direct, contextual edits.

Innovation Solution

Utilizing augmented reality (AR) to enable in situ editing of content items by allowing merchants to manipulate virtual 3D representations of products, which are then converted to 2D images for real-time replacement in the graphical user interface, using an AR engine that tracks user interactions and sensor data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If separate editing tools are used to edit content items, then editing functionality is provided, but the user must navigate away from the graphical user interface, reducing ease of operation

Engineering Contradiction:

Improveease of editing content itemsVSAvoidcomplexity of editing process

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the editing functionality directly into the graphical user interface by generating a virtual scene that includes both the content item and editing controls. This allows users to edit content items without navigating away from the interface, combining what were previously separate functions into a unified system.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a virtual scene as an intermediary layer between the user and the content item. This virtual scene contains both the visual representation of the content item and the editing controls, serving as a mediator that enables direct editing within the graphical user interface context.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If virtual 3D representations are used for editing, then direct contextual editing is enabled, but processing and conversion requirements increase device complexity

Engineering Contradiction:

Improvespeed of content editingVSAvoidcomplexity of AR processing

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent transitions from traditional 2D interface editing to 3D virtual scene editing. By representing content items as virtual 3D objects in an augmented reality scene, the system enables more intuitive manipulation while maintaining the ability to convert back to 2D for display, adding a spatial dimension to the editing process.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the state parameters of content items by generating virtual scenes with modified properties (position, scale, rotation, etc.). The system processes user interactions to determine parameter changes and applies these modifications to the virtual representations, enabling flexible editing through parameter adjustment.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250371832A1Systems and methods for editing content items in augmented reality

Publication Date: 2025.12.04 SHOPIFY INC

AI summary

A computer-implemented is disclosed. The method includes: generating an augmented reality (AR) scene that includes a virtual 3D representation of a product and a view of a first graphical user interface; monitoring user interactions with the virtual 3D representation of the product based on detected gestures of the user; determining modifications to the virtual 3D representation of the product based on the monitored user interactions; presenting, in the AR scene, a modified 3D representation of the product; converting the modified 3D representation of the product to a 2D image; and causing the 2D image to be displayed at a defined location of the first graphical user interface in AR.