Coordinated Activity Protocol for Multi-Device Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies lack the ability to coordinate complex, real-time interactive effects across multiple devices in video-centric and non-video-centric experiences, such as video calls, gaming, and shared media viewing, without affecting the initiating user's video feed and requiring cooperation from all participating devices.
Innovation Solution
A coordinated activity protocol that uses real-time communication channels and API calls to initiate and exchange data for synchronized effects, allowing developers to define data interpretation and supporting various data types, enabling effects like facial overlays, audio modifications, and state changes in video streams and non-video-centric activities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a coordinated activity protocol is implemented to enable synchronized effects across multiple devices, then the ability to coordinate complex real-time interactive effects is improved, but the device complexity and communication overhead increase
Solution Approach 1:
The coordinated activity protocol is segmented into distinct functional modules: effect initiation messages, effect data exchange messages, and effect execution logic. This segmentation allows each component to be developed, tested, and maintained independently, reducing overall system complexity while enabling sophisticated coordinated effects across multiple devices.
Solution Approach 2:
The patent introduces an intermediary message exchange mechanism that mediates between initiating and non-initiating devices. The protocol uses standardized message formats (effect initiation messages, effect data exchange messages) that act as intermediaries to coordinate actions without requiring direct complex interactions between all device pairs, thereby managing communication overhead.
2Speed
If real-time communication channels are used for effect coordination, then the synchronization speed and responsiveness are improved, but the network bandwidth consumption and latency increase
Solution Approach 1:
The protocol employs periodic message exchange patterns where effect data is transmitted at optimized intervals rather than continuously. Effect initiation messages trigger periodic effect data exchange messages that update non-initiating devices with synchronized effect information, maintaining real-time responsiveness while reducing unnecessary network traffic and bandwidth consumption.
Solution Approach 2:
The protocol performs preliminary actions by establishing communication channels and exchanging effect initialization data before actual coordinated effects begin. This preliminary setup includes defining effect parameters and data formats in advance, which reduces the amount of real-time data transmission needed during effect execution, thereby lowering latency and bandwidth usage.
3Adaptability or versatility
If the protocol allows flexible data types and developer-defined interpretations, then the versatility of coordinated effects is improved, but the difficulty of data interpretation and processing increases
Solution Approach 1:
The patent implements a universal message structure that can accommodate multiple data types (facial overlay data, audio modification data, state change data) through a common effect data exchange message format. This universal framework allows developers to define custom data interpretations while maintaining a consistent communication protocol, thereby achieving versatility without proportionally increasing interpretation difficulty.
Solution Approach 2:
The protocol uses parameter-based data structures where effect data is defined by configurable parameters rather than fixed formats. Developers can change parameters to define different effect types and data interpretations, allowing flexible customization while the underlying protocol structure remains constant, reducing the complexity of data processing.
4Ease of operation
If coordinated effects are applied to non-initiating users without their direct initiation, then the collaborative experience is improved, but the user control and consent management become more complex
Solution Approach 1:
The protocol enables self-service coordination where non-initiating devices automatically receive and execute coordinated effects based on effect initiation messages from other devices. The system handles consent and coordination automatically through the protocol's built-in message exchange mechanisms, improving collaborative experience while minimizing the need for complex manual consent management.
Solution Approach 2:
The protocol incorporates feedback mechanisms where non-initiating devices can respond to effect initiation messages with acceptance or rejection status. This feedback loop allows the initiating device to adjust its coordinated effects based on peer responses, maintaining user control and consent while enabling seamless collaborative experiences.
Data Source
AI summary
Exemplary embodiments relate to the application of coordinated or cooperative effects to a coordinated activity. A coordinated activity protocol is provided for synchronizing interactive effects and experiences across multiple devices. The protocol allows effects to be initiated and coordinated on multiple devices via a real-time communications (RTC) channel. Messages may be exchanged to cooperatively initiate the effect, and (once initiated) generic data may be exchanged via application programming interface (API) calls. According to some embodiments, the coordinated activity is a shared video experience, such as a video conference or shared video-watching experience. According to other embodiments, the coordinated activity relates to other types of experiences, such as single- or multi-player games, shared book reading, communal interactions with a photo album, etc.