AR Image and Audio Overlay Using Marker-Feature Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle to accurately and continuously superimpose virtual images and audio data onto real scenes, especially when markers become partially or fully obscured, and require constant online synchronization for marker identification.
Innovation Solution
A method and device that uses a combination of geometric markers, such as QR codes, and natural features for tracking, allowing virtual objects to be anchored to real-world objects, enabling precise positioning even when markers are not visible, using a combination of image and audio processing to maintain accurate overlay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If geometric markers are used for tracking, then positioning accuracy is improved, but the system requires constant marker visibility which reduces robustness when markers are obscured
Solution Approach 1:
The patent combines geometric markers and natural features into a unified tracking system. The server receives tracking information from both marker recognition modules and natural feature recognition modules, integrates this data, and determines comprehensive positioning and orientation information. This merging allows the system to maintain positioning accuracy even when markers are obscured, as natural features can compensate for lost marker data.
2Measurement precision
If online synchronization is implemented for marker identification, then positioning accuracy is improved, but network dependency increases and system complexity grows
Solution Approach 1:
The patent implements preliminary action by having the server store pre-acquired image data and tracking information for multiple natural features before they are needed. When the mobile device needs positioning information, the server can quickly retrieve and process this pre-prepared data without requiring complex real-time synchronization. This reduces system complexity while maintaining identification accuracy.
3Adaptability or versatility
If continuous tracking is implemented over wide areas, then adaptability is improved, but computational requirements and processing time increase
Solution Approach 1:
The patent segments the tracking task by dividing the wide-area tracking into multiple smaller regions, each with its own set of natural features. The server determines positioning information for each region independently based on local tracking information from marker and natural feature recognition. This segmentation allows continuous tracking over wide areas while reducing computational requirements for each individual processing step.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for superimposing virtual image and audio data on an optical and acoustic portrayal of real scenery comprises a step of reading in portrayal data representing an optical and/or acoustic portrayal (108) of the real scenery (106), which portrayal is captured by at least one environment capture device (102) of a mobile device (100), a step of determining marker data (132) from the image data, wherein the marker data (132) represent a portrayal (116) and a positioning of a marker (112) arranged in the real scenery (106), a step of reading in virtual image and audio data (140), wherein the virtual image and audio data (140) represent image and audio data selected from a plurality of virtual image and audio data using the marker data (132), wherein the virtual image and audio data (140) comprise a presentation instruction for presenting the virtual image (124), a positioning instruction for positioning the virtual image (124) and a positioning instruction for playing back the audio data, a step of determining object data (134) from the image and audio data, wherein the object data (134) represent a portrayal (118) and a positioning of an object section (114) of an object (110) arranged in the environment of the marker (112) in the real scenery (106), and a step of determining a positioning rule (142) for positioning the virtual image (124) with respect to the portrayal (118) of the object section (114) using the object data (134) and the virtual image and audio data (140).