3D Caption Rendering With Adaptive Tracking for Stable AR Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual rendering systems face issues with inconsistent presentation of virtual objects in real-world environments due to environmental conditions and user actions, leading to erratic behavior and inefficient content authoring processes on mobile devices with limited display sizes.
Innovation Solution
A system and method for generating and rendering 3D captions within a real-world environment using a 3D caption system that includes an editing interface, preview functionality, and redundant tracking systems to maintain consistent object positioning, allowing users to create, edit, and preview 3D captions on mobile devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional virtual rendering systems are used to present virtual objects in real-world environments, then the system can provide augmented reality experiences, but the presentation becomes inconsistent due to environmental conditions and user actions
Solution Approach 1:
The system dynamically transitions between different tracking subsystems (visual feature tracking, inertial tracking, hybrid tracking) based on environmental conditions and tracking quality metrics. This allows the AR system to adapt to changing conditions while maintaining consistent virtual object presentation, resolving the contradiction between reliability and adaptability.
2Reliability
If multiple tracking subsystems are implemented to maintain consistent virtual object positioning, then the reliability of rendering improves, but the device complexity increases
Solution Approach 1:
The tracking system is segmented into multiple independent subsystems (visual feature tracker, inertial tracker) that operate separately but can be combined. Each subsystem handles specific tracking aspects, and the system selectively activates them based on conditions, improving reliability without requiring all subsystems to run simultaneously, thus managing device complexity.
Solution Approach 2:
The system dynamically configures which tracking subsystems are active based on environmental conditions and tracking quality. Not all subsystems run at all times - they are activated only when needed, reducing the effective complexity while maintaining high reliability when multiple subsystems are available.
3Ease of operation
If 3D caption rendering is implemented on mobile devices with limited display sizes, then the user can create and edit captions, but the authoring process becomes inefficient due to limited screen real estate
Solution Approach 1:
The system transitions from 2D screen-based caption editing to 3D spatial caption manipulation. Users can position, orient, and scale captions in three-dimensional space relative to real-world surfaces detected by the camera. This spatial dimension provides more editing freedom and efficiency despite limited screen size, as captions can be precisely positioned in 3D space rather than constrained to 2D screen coordinates.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.