Sound Output System with Synchronized Performance Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing self-playing piano systems fail to accurately and faithfully reproduce performance sounds due to poor conversion of performance sounds into MIDI data, leading to suboptimal sound reproduction during playback.

Innovation Solution

A sound output system comprising a speaker, an operation device with a drive unit and control unit, and a supply unit that synchronizes sound data and performance data, including MIDI data, to accurately drive keyboard operators and reproduce performance sounds, with reverb removal processing and delay adjustments to enhance sound fidelity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If performance sounds are converted into MIDI data for self-playing piano playback, then the piano can be performed automatically via network, but the faithful reproduction of performance sounds deteriorates due to poor conversion quality

Engineering Contradiction:
Improveautomatic performance capabilityVSAvoidsound reproduction fidelity
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The system separates the sound reproduction function from the performance control function by using two distinct data streams: sound data for audio output and performance data for keyboard operation control. This segmentation allows each data type to be optimized independently, preserving sound fidelity while enabling automatic performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary processing mechanism that receives both sound data and performance data, then synchronizes them through timing adjustment processing. This intermediary layer ensures that the converted MIDI data accurately reflects the original performance timing and dynamics, improving sound reproduction fidelity during automatic playback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If MIDI data is used to control keyboard operators, then automatic performance operation is enabled, but accurate timing synchronization with sound output deteriorates

Engineering Contradiction:
Improveperformance operation automationVSAvoidtiming synchronization accuracy
Core Design Contradiction:
Extent of automationVSLoss of time

Solution Approach 1:

The system implements dynamic timing adjustment by calculating the time difference between sound data output timing and performance data processing timing, then adjusting the performance data timing in real-time. This dynamic synchronization ensures accurate coordination between keyboard operations and sound output during automatic performance, preventing timing drift.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by monitoring the timing relationship between sound data and performance data, then using this information to adjust the timing of performance data. This closed-loop timing control ensures that MIDI-driven keyboard operations remain synchronized with sound output throughout the automatic performance.

Inventive Principle:
Principle #23Feedback

3Device complexity

If performance data is processed without timing adjustment, then processing complexity is reduced, but sound fidelity deteriorates due to timing mismatches

Engineering Contradiction:
Improvedata processing complexityVSAvoidsound fidelity
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system performs preliminary timing adjustment by calculating the time difference between sound data and performance data before processing the performance data. This advance timing correction ensures that subsequent keyboard operations are properly synchronized with sound output, improving sound fidelity without requiring complex real-time adjustment mechanisms.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240029692A1Sound output system
Publication Date: 2024.01.25 YAMAHA CORP
  • US20240029692A1 patent drawing
  • US20240029692A1 patent drawing
  • US20240029692A1 patent drawing

AI summary

A sound output system according to an embodiment includes a speaker configured to output a sound according to sound data supplied to the speaker, and an operation device comprising one or more operators, a drive unit configured to drive the one or more operators based on performance data supplied to the operation device in synchronization with the sound data supplied to the speaker, and a drive control unit configured to control the drive unit. According to the output system, it is possible to faithfully reproduce a performance sound at the time of performance and to accurately reproduce a performance at the time of performance by driving at operator based on the performance sound.