Sound Processing Device for Natural Voice Expression Synthesis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Expertise is required to properly select and adjust voice expressions for impartation to a voice, making it a complex task even for experienced users.

Innovation Solution

A sound processing method that specifies an expression sample and period based on note data, using processing parameters to impart natural-sounding voice expressions to a singing voice, without requiring expertise, by synthesizing fundamental frequencies and spectrum envelope contours.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional techniques are used to select and adjust voice expressions from candidate expressions, then voice expressions can be imparted to voices, but expertise on voice expressions is required and the task becomes complex

Engineering Contradiction:

Improveease of voice expression impartationVSAvoidcomplexity of voice expression processing

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically selects and adjusts voice expressions by analyzing the musical score and audio signal themselves, without requiring external expert intervention. The voice expression imparting unit autonomously determines appropriate expressions based on note information and audio characteristics, making the system self-sufficient and eliminating the need for user expertise.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The voice expression imparting unit acts as an intermediary between the musical score and the audio signal, automatically translating musical notation into appropriate voice expressions. This intermediary component handles the complex processing internally, shielding the user from complexity while maintaining ease of operation.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If manual selection and adjustment of voice expressions is performed, then precise control over voice expressions is achieved, but the process requires significant time and effort

Engineering Contradiction:

Improveproductivity of voice processingVSAvoidtime for expression selection and adjustment

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the musical score and audio signal to pre-determine appropriate voice expressions before actual processing. By preparing expression selections in advance based on note information and audio characteristics, the system eliminates time-consuming manual adjustment during the processing stage, significantly improving productivity.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The manual mechanical process of selecting and adjusting voice expressions is replaced by an automated computational system. The voice expression imparting unit uses algorithmic processing to rapidly analyze and apply expressions, substituting the slow manual mechanical process with fast automated electronic processing, thereby dramatically reducing time loss and increasing productivity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3770906B1Sound processing method, sound processing device, and program

Publication Date: 2024.05.01 YAMAHA CORP

Figure 1~2
Figure 3
Figure 4~5

AI summary

The specifying processor specifies, in accordance with note data representative of a note, an expression sample representative of a voice expression to be imparted to the note and an expression period to which the voice expression is to be imparted and specifies, in accordance with the expression sample and the expression period, a processing parameter relating to an expression imparting processing for imparting the voice expression to a portion corresponding to the expression period in an audio signal.