Trigger Finger Gestures for Collision-Based AR Content Selection

Solution Overview

Problem

Enabling computing devices to perform image processing operations on digital images captured in varying conditions, such as changes in image scales, noises, lighting, movement, or geometric distortion, is computationally intensive and challenging, especially on power and resource-constrained devices.

Innovation Solution

An augmented reality (AR) system that integrates real and virtual environments, allowing users to interact with electronic information overlaid in the enhanced real world, and includes features for capturing and modifying AR content on mobile devices, reducing latency and power consumption through efficient image processing techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image processing operations are performed on digital images captured in varying conditions, then image quality and AR content accuracy are improved, but computational complexity and power consumption increase

Engineering Contradiction:

Improveimage processing accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by capturing metadata (exposure time, ISO, focal length, distortion parameters) during image capture and pre-processing images to correct geometric distortions and normalize lighting conditions before AR content generation. This preliminary processing reduces the computational burden during real-time AR operations, thereby lowering power consumption while maintaining image processing accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary components including a camera calibration system that creates distortion maps and a metadata processing layer that standardizes image parameters. These intermediaries pre-process images to correct geometric distortions and normalize varying capture conditions, reducing the complexity of subsequent AR content generation and decreasing overall computational power requirements.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If image processing operations are performed on digital images captured in varying conditions, then image quality and AR content accuracy are improved, but computational complexity increases

Engineering Contradiction:

Improveimage processing accuracyVSAvoidcomputational complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by capturing metadata (exposure time, ISO, focal length, distortion parameters) during image capture and pre-processing images to correct geometric distortions and normalize lighting conditions before AR content generation. This preliminary processing reduces the computational burden during real-time AR operations, thereby lowering power consumption while maintaining image processing accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary components including a camera calibration system that creates distortion maps and a metadata processing layer that standardizes image parameters. These intermediaries pre-process images to correct geometric distortions and normalize varying capture conditions, reducing the complexity of subsequent AR content generation and decreasing overall computational power requirements.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Ease of operation

If AR content is captured and modified on mobile devices, then user interaction and customization are improved, but latency increases

Engineering Contradiction:

Improveuser interaction capabilityVSAvoidprocessing latency

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing metadata (exposure time, ISO, focal length, distortion parameters) during image capture and pre-processing images to correct geometric distortions and normalize lighting conditions before AR content generation. This preliminary processing reduces the computational burden during real-time AR operations, thereby lowering power consumption while maintaining image processing accuracy.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12374055B2Trigger gesture for selection of augmented reality content in messaging systems

Publication Date: 2025.07.29 SNAP INC

AI summary

The subject technology detects a first gesture corresponding to an open trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the open trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology detects a first collision event. The subject technology detects a second gesture corresponding to a closed trigger finger gesture. The subject technology selects the second virtual object. The subject technology renders the first virtual object as attached to the second virtual object in response to the selecting. The subject technology provides for display the rendered first virtual object as attached to the second virtual object within a first scene.