Synthesizer Lyrics Synchronization via Conditional Vocalization Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional singing sound synthesizers in electronic musical instruments often produce unnatural synthesized singing sounds when wrong keys are struck or grace notes are played, causing the lyrics to advance ahead of the performance, resulting in a mismatch between the lyrics and the performance.

Innovation Solution

A sound generation device with an electronic controller that acquires first lyrics data and a vocalization start instruction, outputting audio signals based on specific conditions to ensure synchronized vocalization with the performance, using a control module to manage the generation of audio signals corresponding to the correct characters in the lyrics data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the synthesizer automatically advances one character or one syllable at a time in response to key depression, then real-time performance operation is enabled, but the lyrics position may advance ahead of the performance causing unnatural synthesized singing sounds

Engineering Contradiction:
Improvereal-time performance capabilityVSAvoidsynchronization accuracy between lyrics and performance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The control module continuously monitors the timing relationship between key depression events and lyric character timing, and dynamically adjusts lyric display timing based on this feedback to maintain synchronization with the actual performance tempo

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system transitions from a static automatic advancement mechanism to a dynamic control system that adapts lyric display timing based on actual performance tempo variations, allowing flexible adjustment to maintain synchronization

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If the synthesizer processes each key depression to advance lyrics, then performance responsiveness is improved, but wrong keys or grace notes cause lyrics to advance ahead of performance

Engineering Contradiction:
Improveperformance responsivenessVSAvoidlyrics positioning accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The control module evaluates multiple conditions including time interval thresholds and lyric timing position before advancing lyrics, performing preliminary checks to prevent premature advancement due to wrong keys or grace notes

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The control module acts as an intermediary between key depression detection and lyric advancement, introducing conditional logic that filters out inappropriate key presses (wrong keys, grace notes) before allowing lyric position changes

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20230419946A1Sound generation device and control method thereof, program, and electronic musical instrument
Publication Date: 2023.12.28 YAMAHA CORP
  • US20230419946A1 patent drawing
  • US20230419946A1 patent drawing
  • US20230419946A1 patent drawing

AI summary

A sound generation device includes an electronic controller including at least one processor. The electronic controller is configured to execute a first acquisition module configured to acquire first lyrics data in which a plurality of characters to be vocalized are arranged in a time series and that include a first character and a second character that follows the first character, a second acquisition module configured to acquire a vocalization start instruction, and a control module configured to, in response to the acquiring of the vocalization start instruction, output an instruction to generate an audio signal based on a first vocalization corresponding to the first character, in response to the vocalization start instruction satisfying a first condition, and output an instruction to generate the audio signal based on a second vocalization corresponding to the second character, in response to the vocalization start instruction not satisfying the first condition.