Dual Video Call AR Streams Using RTP Timestamp Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video call technologies do not effectively integrate augmented reality (AR) content with real-world images in real time, limiting the enhanced user experience in applications like mapping, tourism, education, and retail.
Innovation Solution
Implementing a secondary data stream (ALT stream) for AR content alongside a primary data stream (MAIN stream) in video calls, synchronized using Real-time Transport Protocol (RTP) timestamps to overlay AR content with real-world images, enhancing the video call experience with additional functionality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single data stream is used for video calls, then the system complexity is low, but the functionality is limited and cannot integrate AR content with real-world images
Solution Approach 1:
The patent divides the data transmission into two separate streams: a primary stream for real-world video content and an alternative stream for AR content. This segmentation allows each stream to be optimized independently while maintaining overall system functionality, resolving the contradiction between enhanced adaptability and increased complexity.
Solution Approach 2:
The alternative stream is designed to carry multiple types of content including AR overlays, annotations, and additional visual information. This multi-functional approach enables a single data structure to serve various purposes, enhancing versatility without proportionally increasing system complexity.
2Ease of operation
If AR content is integrated with real-world images in real time, then the user experience is enhanced, but the data processing and transmission complexity increases
Solution Approach 1:
The patent introduces an intermediary data structure (alternative stream) that mediates between the AR content generation and the final composite display. This intermediary layer simplifies the processing by providing a standardized interface for integrating different content types, reducing the overall data processing complexity while maintaining enhanced user experience.
3Adaptability or versatility
If multiple data streams are used for video calls, then AR content can be integrated with real-world images, but the network bandwidth and processing requirements increase
Solution Approach 1:
The patent combines the primary video stream and alternative AR stream into a single composite output that is displayed together. This merging approach allows efficient utilization of network bandwidth by transmitting both content types through coordinated streams rather than requiring completely separate transmission channels, reducing overall bandwidth consumption while maintaining content integration capability.
Data Source
AI summary
Embodiments include methods performed by a processor of a receiving wireless device for rendering augmented reality content. The methods may include receiving real image data from a transmitting wireless device via a first data stream, and receiving augmented reality (AR) content from the transmitting wireless device via a second data stream that is an alt video stream, in which the AR content is for display with the real image data. Methods may further include displaying the AR content in conjunction with the real image data.In some embodiments, the first data stream and the second data stream are Real-time Transport Protocol (RTP) streams.