Markerless AR Messaging on Handheld Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies for handheld devices, such as cellular phones, are limited by the need for predefined markers and cannot efficiently transfer or view rich media messages linked to specific physical objects, especially in low light and dynamic conditions.
Innovation Solution
A method and system for generating and viewing 3-D augmented reality features on handheld devices that allow users to take pictures of physical objects, select augmented reality themes, attach rich media messages, and transfer them to other devices, using sensor data and image processing for accurate positioning and rendering, even without markers, and in various lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If marker-based AR solutions are used, then AR viewing is enabled on handheld devices, but the system is limited to predefined objects and cannot perform real image analysis
Solution Approach 1:
The invention extracts and removes the marker dependency from the AR system. Instead of requiring predefined markers, the system directly analyzes images of physical objects using computer vision algorithms to extract object features and perform matching, thereby enabling AR on arbitrary objects without markers
Solution Approach 2:
The invention replaces the mechanical marker-based tracking system with an image-based computer vision system. The system uses image processing algorithms to detect, recognize, and track physical objects directly from camera input, substituting the need for physical markers with digital image analysis
2Ease of operation
If real-time AR rendering is performed on handheld devices, then interactive AR viewing is achieved, but computing resources are limited and processing speed is reduced
Solution Approach 1:
The system performs preliminary actions by pre-processing and caching object models, features, and matching data before runtime. This allows the device to skip complex computations during actual AR viewing, significantly improving real-time rendering performance on resource-constrained handheld devices
Solution Approach 2:
The system implements partial processing by focusing computational resources only on the specific object being viewed rather than processing the entire scene. This selective approach reduces the overall computational burden while maintaining interactive AR viewing capabilities
3Adaptability or versatility
If AR viewing is performed in low light conditions, then AR functionality is maintained, but image quality and recognition accuracy deteriorate
Solution Approach 1:
The system dynamically changes image processing parameters based on lighting conditions. In low light, the system adjusts parameters such as noise tolerance, feature detection sensitivity, and matching thresholds to maintain recognition accuracy despite degraded image quality
4Ease of operation
If fast camera movement is tolerated, then user mobility is improved, but AR tracking accuracy and stability deteriorate
Solution Approach 1:
The system implements dynamic tracking that adapts to camera movement characteristics. The tracking algorithm adjusts its parameters in real-time based on detected motion, maintaining stability during fast movements by increasing frame rate, adjusting feature matching sensitivity, and using predictive algorithms to compensate for motion blur
Data Source
AI summary
A method for generating and viewing on a handheld device a 3-D augmented reality feature containing a rich media message that is linked to a physical object comprises the steps of: a) by a first user: i. Taking a picture of a physical object; ii. selecting an augmented reality theme; iii. attaching the rich media animated object to the image taken, in the desired position and location on the physical object; iv. generating a reach media message from the augmented reality image obtained in step (iii); iv. optionally attaching an additional file to the rich media message; v. Transferring the physical object to a second user; and vi. sending to said second user a message via a communication channel, which contains the augmented reality rich media; b) by the second user (the recipient): vii. viewing the physical object received from the first user, using an AR viewer in the mobile phone camera, thereby to see the augmented reality rich media appearing on said physical object.