Native AR Code Scanning for Gesture-Controlled 3D Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing QR code scanning methods in augmented reality (AR) devices require dedicated mobile applications and do not support immersive 3D object display or interactive user experiences.

Innovation Solution

An AR device, such as a headset or smart glass, is configured to identify and read QR codes in the user's field of view, enabling the display of linked 3D objects and interactive features through hand gestures and wearable devices, enhancing user interaction with immersive applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If dedicated mobile applications are used for QR code scanning, then code scanning functionality is achieved, but device complexity and ease of operation are worsened

Engineering Contradiction:
Improvecode scanning functionalityVSAvoidapplication requirement
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The AR device integrates QR code scanning capability directly into its native operating system, allowing the device to perform both augmented reality display and code scanning functions without requiring separate dedicated applications. This multi-functionality approach eliminates the need for users to install and switch between specialized scanning apps while maintaining reliable code recognition and interpretation capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If traditional QR code scanning is used, then code recognition is achieved, but immersive 3D object display capability is lost

Engineering Contradiction:
Improvecode recognition accuracyVSAvoid3D object display capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system merges traditional QR code scanning functionality with immersive 3D object display capabilities by integrating the code recognition engine directly into the AR rendering pipeline. When a QR code is detected, the system automatically extracts embedded data, retrieves associated 3D models, and renders them in the augmented reality environment, seamlessly combining accurate code recognition with versatile 3D visualization without requiring separate processing steps or applications.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of time

If static code scanning is used, then simple information retrieval is achieved, but interactive user experience is reduced

Engineering Contradiction:
Improveinformation retrieval speedVSAvoiduser interaction capability
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The system implements continuous feedback loops between user gestures and virtual object manipulation. After retrieving information via QR code scanning, the system monitors user hand movements and gestures in real-time, providing immediate visual feedback as users rotate, scale, or examine 3D objects from different angles. This interactive feedback mechanism maintains rapid information retrieval while significantly enhancing user engagement and operational ease through natural gesture-based control.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12443288B2Code scanning via augmented reality device
Publication Date: 2025.10.14 META PLATFORMS TECHNOLOGIES LLC
  • US12443288B2 patent drawing
  • US12443288B2 patent drawing
  • US12443288B2 patent drawing

AI summary

A method and system for virtual object interactions based on code scanning. The method includes scanning, at a first device, a code (e.g., quick response (QR) code) printed on an object in a physical reality within a field of view (FOV) of a user. The method also includes accessing a network site associated with the object based on the code. The method also includes generating virtual content including at least one virtual object based on the network site. The method also includes displaying the virtual content in the first device. The method also includes navigating the virtual content in response to a gesture from the user.