Sensory Event Timeline Interludes for Latency-Masked Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network latency during transitions between creator and spectator modes in collaborative multi-party systems results in undesired effects on user experience, such as sporadic delays in sensory content output.

Innovation Solution

Implementing interludes using sensory event timelines to re-orient the timelines of spectator devices relative to the new creator device, mitigating the effects of network latency during mode transitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If devices transition between creator and spectator modes in real-time collaborative systems, then user collaboration and content creation capability are improved, but network latency causes sporadic delays and disruptions in sensory content output

Engineering Contradiction:
Improvemode transition capabilityVSAvoidsensory content output continuity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by having spectator devices output sensory events from a buffer before the creator device's sensory events are fully received and processed. This preliminary output using cached data prevents gaps and delays during mode transitions, ensuring continuous sensory content delivery despite network latency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements beforehand cushioning by maintaining buffers of sensory events at spectator devices and using these buffered events as a cushion during transitions. When a device switches from spectator to creator mode, the buffer provides a cushion that prevents sporadic delays, allowing smooth transition without disrupting the continuous output of sensory content.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Speed

If spectator devices immediately switch to outputting sensory events from a new creator device, then responsiveness to mode changes is improved, but network latency causes timing misalignment and output disruptions

Engineering Contradiction:
Improvemode transition responsivenessVSAvoidsensory event timing alignment
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

Spectator devices perform preliminary actions by pre-buffering sensory events and having them ready for immediate output when transitioning. This preliminary preparation allows the device to respond quickly to mode changes while maintaining proper timing alignment, as the buffered events are already synchronized and ready to be played back without causing delays or misalignment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system ensures continuity of useful action by maintaining continuous output of sensory events from buffers during transitions. Spectator devices continue to output sensory content without interruption by using pre-buffered events, ensuring that the useful action of content delivery remains continuous and properly timed even during mode switches.

Inventive Principle:
Principle #20Continuity of useful action

3Measurement precision

If devices wait for network synchronization during mode transitions, then timing alignment is improved, but transition delays and interruptions in sensory content output increase

Engineering Contradiction:
Improvesensory event timing precisionVSAvoidsensory content output continuity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Devices perform preliminary actions by pre-buffering and pre-synchronizing sensory events before mode transitions occur. This preliminary synchronization ensures timing precision is already established, allowing devices to switch modes immediately without waiting for network synchronization during the transition, thus maintaining both timing precision and output continuity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuity of useful action by ensuring sensory events are continuously buffered and ready for output. During mode transitions, devices continue to output sensory content from buffers without interruption, maintaining both timing precision and productivity. The useful action of synchronized content delivery continues uninterrupted through the use of pre-prepared buffered events.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP4430595B1Latency masking by an interlude in a multi-user music compositon game.
Publication Date: 2026.04.08 HARMONIX MUSIC SYSTEMS
  • EP4430595B1 patent drawingFigure 1A
  • EP4430595B1 patent drawingFigure 1B
  • EP4430595B1 patent drawingFigure 1C

AI summary

Embodiments described herein relate to techniques of coordinating sensory event timelines of multiple devices. The devices may use the sensory even timelines to output sensory events such as audio segments. The devices may take turns determining the sensory events to be output by the devices using their sensory event timelines. The techniques coordinate transitions of the devices between a first mode in which a device is allowed to determine sensory events to be output and a second mode in which a device outputs sensory events determined by another device.