Gesture-Based AR Content Trimming in Messaging Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Enabling computing devices to perform image processing operations on digital images captured in varying conditions, such as changes in scale, noise, lighting, movement, or geometric distortion, is computationally intensive and challenging, particularly in resource-constrained environments.
Innovation Solution
An augmented reality (AR) system that integrates real and virtual environments, enabling efficient image processing and rendering of AR content in messaging systems, including features like media overlays, transformations, and playback of audio content, while reducing latency and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image processing operations are performed on digital images captured in varying conditions, then image processing capability is improved, but computational intensity and resource consumption increase
Solution Approach 1:
The patent segments the image processing task by detecting and isolating specific objects of interest (such as faces, objects, or regions) within the image, then applying processing operations only to those segmented regions rather than the entire image. This reduces computational intensity while maintaining processing capability for relevant content.
Solution Approach 2:
The patent applies different processing qualities and operations to different local regions of the image based on their importance. Critical regions containing objects of interest receive enhanced processing, while less important regions receive minimal or no processing, optimizing the balance between processing capability and computational resource consumption.
2Ease of operation
If augmented reality content is rendered in messaging systems, then user experience is improved, but latency and power consumption increase
Solution Approach 1:
The patent performs preliminary actions by pre-processing images, pre-loading AR content assets, and pre-positioning virtual elements before the actual AR rendering is needed. This reduces latency during real-time AR content display by having components already prepared and positioned.
Solution Approach 2:
The patent uses copying by creating simplified representations or placeholders of AR content that can be rapidly rendered, and by copying processed image data to memory buffers for quick access during rendering, reducing the time required to display AR content.
3Ease of operation
If augmented reality content is rendered in messaging systems, then user experience is improved, but power consumption increases
Solution Approach 1:
The patent applies partial action by rendering only the necessary portions of AR content and images rather than processing and displaying the entire scene. This selective rendering approach maintains user experience for critical AR elements while significantly reducing overall power consumption.
Solution Approach 2:
The patent discards unused image data and AR content assets that are not currently needed, and recovers computational resources by releasing memory and processing capacity once AR content is no longer displayed, reducing power consumption during AR operations.
Data Source
AI summary
The subject technology receives frames of a source media content. The subject technology detects from the frames of the source media content, a first gesture indicating a cut point at a particular frame of the source media content, the cut point associated with a trimming operation to be performed on the source media content. The subject technology selects a starting frame and an ending frame from the frames based at least in part on the cut point at the particular frame. The subject technology performs the trimming operation based on the starting frame and the ending frame. The subject technology generates a second media content using the third set of frames. The subject technology provides for display at least a portion of the third set of frames of the second media content.