AR Video Stream Alignment Using Virtual-Real Marker Mapping

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality applications fail to provide dynamic integration of virtual objects in real-time video streams, requiring users to reposition objects to view from different angles, limiting the effectiveness of augmented reality experiences.

Innovation Solution

A method and system that utilize a virtual marker in a virtual environment and a corresponding real marker to establish a three-dimensional spatial reference system, allowing real-time dynamic placement of virtual objects in video streams by calculating and integrating their positions based on the relationship between the virtual and real environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If static object integration is used in augmented reality applications, then the integration process is simple, but the user cannot view real scenes from different angles without repositioning objects

Engineering Contradiction:

Improveease of object integrationVSAvoidadaptability to different viewing angles

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by transitioning from static object integration to dynamic real-time integration. Virtual objects are automatically repositioned and updated in real-time as the user moves the camera, allowing objects to adapt their positions dynamically relative to the camera's viewpoint and the real scene, thereby enabling viewing from different angles without manual repositioning

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system implements feedback by continuously monitoring the camera's position and orientation, and automatically adjusting virtual object positions based on this feedback. The virtual objects respond to camera movements in real-time, maintaining proper spatial relationships and enabling dynamic viewing from various angles

Inventive Principle:

Principle #23Feedback

2Adaptability or versatility

If real-time dynamic integration of virtual objects is implemented, then adaptability to user movements is improved, but computational complexity and processing time increase

Engineering Contradiction:

Improveadaptability to user movementsVSAvoidcomputational complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-defining virtual objects with their initial positions and characteristics before the user interacts with the system. This allows the system to efficiently compute real-time transformations without needing to calculate everything from scratch during user interaction

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system replaces complex mechanical calculation methods with more efficient computational approaches, using optimized algorithms to calculate virtual object positions based on camera parameters, reducing computational burden while maintaining real-time performance

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If virtual objects are integrated into video streams, then augmented reality experience is enhanced, but precision in object placement may be compromised

Engineering Contradiction:

Improveenhancement of augmented reality experienceVSAvoidprecision in object placement

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent replaces traditional mechanical positioning methods with computational geometry and algebraic calculations to determine virtual object positions. This substitution enables higher precision by using mathematical models to calculate exact positions based on camera parameters and virtual object definitions

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system continuously monitors camera position and orientation, using this feedback to dynamically adjust virtual object positions in real-time. This closed-loop feedback mechanism ensures that objects remain precisely positioned relative to the real scene and camera viewpoint, maintaining placement accuracy throughout user interaction

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12518493B2Real-time gateway between a virtual environment and a real environment

Publication Date: 2026.01.06 ATOS FRANCE

AI summary

A method for integrating in real time at least one virtual object (41, 42, 43, 44) into a video stream generated by a user equipment (20) and representing a real environment (RE), comprising the steps of calculating (C3) the so-called “real” position, in the real environment (RE), of a representation of the at least one virtual object (41, 42, 43, 44) relative to a predetermined reference position corresponding, in the real environment (RE), to the position of the virtual marker (30) in the virtual environment (VE), of integrating (U2) the representation of the at least one virtual object (41, 42, 43, 44) in a video stream generated at the calculated real position, and of displaying (U3) of the video stream so that said representation appears in real time on the images of the video stream generated at the calculated real position.