Synthetic Performance Data Generator for Network Ensemble Timing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systems where multiple users participate in real-time ensemble performance via a network, data transmission delays hinder synchronized timing, making it difficult for users to perform in unison.

Innovation Solution

A program that includes an individual performance data receiver, a synthetic performance data generator, and a transmitter to synthesize and transmit performance data in real-time, using timing information from metronomes to ensure synchronized playback across user terminals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If performance data is transmitted via a network for real-time ensemble performance, then users can participate remotely, but network delays cause timing deviations that hinder synchronized performance

Engineering Contradiction:
Improveremote participation capabilityVSAvoidtiming synchronization accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary actions by having each user terminal generate and transmit timing information from a metronome before the actual performance data. The server receives this timing information in advance and uses it as a reference framework to synchronize the ensemble performance, ensuring that all participants align their performances to the same temporal structure despite network delays

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The server acts as an intermediary that receives timing information from multiple user terminals and uses it to generate synthetic performance data. This intermediary process mediates between the distributed user terminals and the final ensemble output, coordinating the timing information to produce synchronized performance data that compensates for network-induced timing deviations

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If individual performance data from multiple users is transmitted separately, then each user's performance is preserved, but synchronization across users becomes difficult due to network delays

Engineering Contradiction:
Improveindividual performance preservationVSAvoidensemble synchronization stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The server merges the timing information from multiple individual performance data streams by synthesizing them into unified synthetic performance data. This combining process integrates the temporal characteristics of all user performances while using the metronome-based timing information as a common reference, ensuring that individual performances are preserved but coordinated within a stable synchronized framework

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback by having each user terminal transmit timing information from their local metronome to the server. The server uses this feedback information to adjust and synchronize the ensemble performance, continuously referencing the timing data to maintain synchronization stability across all participants despite network variations

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11478710B2Information processing device, method and medium
Publication Date: 2022.10.25 SQUARE ENIX HLDG CO LTD
  • US11478710B2 patent drawing
  • US11478710B2 patent drawing
  • US11478710B2 patent drawing

AI summary

A computer functions as: an individual performance data receiver that receives a plurality of pieces of individual performance data from two or more performer user terminals connected via a network, each of the pieces of individual performance data being generated in accordance with a performance operation by a user on the corresponding performer user terminal and transmitted during a performance; a synthetic performance data generator that generates synthetic performance data by synthesizing pieces of individual performance data in an identical time slot, of the plurality of pieces of individual performance data received from the performer user terminals, during the performance, the synthetic performance data being used to reproduce sound in which individual performance contents on the two or more performer user terminals are mixed; and a synthetic performance data transmitter that transmits the synthetic performance data to at least one appreciator user terminal connected via the network during the performance.