Stitched Audio Timeline From Multi-Device Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging systems face challenges in efficiently stitching together media content from multiple user devices to create a cohesive audio timeline, particularly for events like concerts or speeches, where users want to switch between different views of the same audio content.
Innovation Solution
The system extracts audio fingerprints from messages, matches them across devices, and stitches together data streams to create a dense audio timeline, allowing users to switch between different views of the same audio content in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system stitches together data streams from multiple user devices to create a dense audio timeline, then the comprehensiveness and interactivity of the audio content is improved, but the complexity of the stitching process and computational resources required increases
Solution Approach 1:
The patent uses audio fingerprints as an intermediary mechanism to match and stitch data streams from multiple devices. The server extracts audio fingerprints from incoming data streams, compares these fingerprints across different devices, and uses the matches to automatically synchronize and stitch the streams together into a cohesive dense audio timeline, resolving the complexity of manual stitching while maintaining comprehensiveness
Solution Approach 2:
The system creates audio fingerprints as simplified copies or representations of the actual audio content. These fingerprints serve as lightweight metadata that can be easily compared and matched across multiple devices without requiring direct comparison of the full audio streams, thereby reducing computational complexity while enabling comprehensive stitching
2Measurement precision
If the system processes and matches audio fingerprints across all pairs of messages to identify common audio content, then the accuracy of audio content matching is improved, but the processing time and computational load increases
Solution Approach 1:
The system performs preliminary extraction of audio fingerprints from data streams as they arrive, before the actual stitching process begins. This preliminary action prepares the matching data in advance, allowing for more efficient subsequent comparison and matching operations across message pairs, thereby reducing overall processing time while maintaining matching accuracy
Data Source
AI summary
Systems and methods provide for a server computer to receive a plurality of messages from a plurality of user computing devices, each message of the plurality of messages comprising a data stream, determine a subset of messages of the plurality of messages associated with a similar geolocation and time period, determine a set of messages of the subset of messages based on a match score for each pair of messages, and stitch together the set of messages to generate a stitched data stream from the data streams for each message of the set of messages based on a time period for each message, wherein the stitched data stream comprises messages with data streams that overlap in time periods such that there may be more than one data stream for a given time period.