Training support device, training support method, and program

The training support device helps wind instrument players understand and adjust their oral cavity muscles to match the acoustic characteristics needed for specific sounds by estimating and displaying the oral cavity shape based on pitch information, addressing individual variations in oral cavity shapes.

JP7593069B2Active Publication Date: 2024-12-03YAMAHA CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2020190868
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-11-17
Publication Date
2024-12-03
Estimated Expiration
2040-11-17

AI Technical Summary

Technical Problem

The shape of the oral cavity varies among individuals, leading to mismatched acoustic characteristics, which can hinder the achievement of the intended playing style in wind instrument performances.

Method used

A training support device and method that includes a pitch information acquisition unit, model information acquisition unit, characteristic information acquisition unit, and display unit to estimate and display the oral cavity shape based on pitch information, allowing performers to understand the acoustic characteristics necessary for producing target sounds.

Benefits of technology

Enables performers to recognize and adjust their oral cavity muscles to achieve the desired acoustic characteristics for playing wind instruments, facilitating better performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593069000001
    Figure 0007593069000001
  • Figure 0007593069000002
    Figure 0007593069000002
  • Figure 0007593069000003
    Figure 0007593069000003
Patent Text Reader

Abstract

To provide a training support device, a training support method, and a program for allowing a player to recognize an acoustic characteristics of a mouth with which a target sound can be played and an acoustic characteristics of the mouth of the player.SOLUTION: A training support device comprises: a pitch information acquisition unit that acquires pitch information on a sound to be played; a model information acquisition unit that acquires mouth acoustic characteristics to be a model in playing a sound according to the pitch information; a characteristic information acquisition unit that acquires characteristic information indicating the mouth acoustic characteristics of a player when the player plays the sound according to the pitch information; and an output unit that outputs the mouth acoustic characteristics of the player acquired by the characteristic information acquisition unit and the mouth acoustic characteristics to be the model acquired by the model information acquisition unit.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a training assistance device, a training assistance method, and a program. [Background technology]

[0002] When playing wind instruments such as brass and woodwind instruments, the mouth shape (embouchure) of the performer is important. This is because the performer can move various muscles in the mouth to form a space in the mouth that has acoustic characteristics that allow the desired sound to come out of the wind instrument, making it easier to play (blow) the desired sound. Patent Document 1 discloses a technology that measures the mouth shape and displays whether the measured shape matches a model. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-187898 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, because the muscles in the mouth and the length of the throat are different for each individual, there are individual differences in the shape of the mouth. Therefore, even if one imitates the mouth shape of a model, the acoustic characteristics in the mouth may not match the acoustic characteristics of the desired playing style, and the desired playing style may not be realized.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide a teaching support device, a teaching support method, and a program that are capable of enabling a performer to recognize the acoustic characteristics of an oral cavity that can produce a desired sound, and the acoustic characteristics of the performer's oral cavity. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, one aspect of the present invention is to provide a method for manufacturing a semiconductor device comprising the steps of:Performance using wind instruments a pitch information acquisition unit that acquires pitch information of a sound to be played; a model information acquisition unit that acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information; a characteristic information acquisition unit that acquires characteristic information that indicates oral acoustic characteristics of a player when playing a sound corresponding to the pitch information; the oral acoustic characteristics of the player acquired by the characteristic information acquisition unit; and the model oral acoustic characteristics acquired by the model information acquisition unit. Displayed as a relationship between pitch and resonance strength and an output unit for outputting the input signal. Another aspect of the present invention is a teaching support device that includes a pitch information acquisition unit that acquires pitch information of a sound to be played using a wind instrument, a model information acquisition unit that acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information, a characteristic information acquisition unit that acquires characteristic information that indicates the oral acoustic characteristics of the player when playing a sound corresponding to the pitch information, and an output unit that displays the oral acoustic characteristics of the player acquired by the characteristic information acquisition unit, the model oral acoustic characteristics acquired by the model information acquisition unit, and an oral shape of the player estimated based on the sound corresponding to the pitch information.

[0007] Another aspect of the present invention is a training assistance method performed by a computer of a training assistance device, the pitch information acquisition unit comprising: Performance using wind instruments Pitch information of a sound to be played is acquired, a model information acquisition unit acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information, a characteristic information acquisition unit acquires characteristic information indicating oral acoustic characteristics of a performer when playing a sound corresponding to the pitch information, and an output unit outputs the oral acoustic characteristics of the performer acquired by the characteristic information acquisition unit and the model oral acoustic characteristics acquired by the model information acquisition unit. Displayed as a relationship between pitch and resonance strength This is a teaching support method. Another aspect of the present invention is a teaching support method performed by a computer of a teaching support device, in which a pitch information acquisition unit acquires pitch information of a sound to be played using a wind instrument, a model information acquisition unit acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information, a characteristic information acquisition unit acquires characteristic information that indicates the oral acoustic characteristics of the player when playing a sound corresponding to the pitch information, and an output unit displays the oral acoustic characteristics of the player acquired by the characteristic information acquisition unit, the model oral acoustic characteristics acquired by the model information acquisition unit, and an oral shape of the player estimated based on the sound corresponding to the pitch information.

[0008] In addition, one aspect of the present invention is a computer of a training support device, Performance using wind instruments A pitch information acquisition means for acquiring pitch information of a sound to be played, a model information acquisition means for acquiring oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information, a characteristic information acquisition means for acquiring characteristic information that indicates the oral acoustic characteristics of a player when playing a sound corresponding to the pitch information, the oral acoustic characteristics of the player acquired by the characteristic information acquisition means, and the model oral acoustic characteristics acquired by the model information acquisition means. Displayed as a relationship between pitch and resonance strength and an output means for outputting the same. Another aspect of the present invention is a program that causes a computer of a teaching support device to execute: pitch information acquisition means for acquiring pitch information of a sound to be played when playing a wind instrument; model information acquisition means for acquiring oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information; characteristic information acquisition means for acquiring characteristic information that indicates the oral acoustic characteristics of the performer when playing a sound corresponding to the pitch information; and output means for displaying the oral acoustic characteristics of the performer acquired by the characteristic information acquisition means, the model oral acoustic characteristics acquired by the model information acquisition means, and an oral shape of the performer estimated based on the sound corresponding to the pitch information. Effect of the Invention

[0009] According to the present invention, it is possible to allow a player to recognize the acoustic characteristics of the oral cavity that can produce a desired sound and the acoustic characteristics of the player's oral cavity. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an example of the configuration of a training support device 10 according to an embodiment. [Diagram 2] 1A to 1C are diagrams illustrating a method for measuring an oral cavity acoustic characteristic according to an embodiment. [Diagram 3] 1A to 1C are diagrams illustrating a method for estimating an oral cavity shape according to an embodiment. [Figure 4] 1A to 1C are diagrams illustrating a method for estimating an oral cavity shape according to an embodiment. [Diagram 5] 1A to 1C are diagrams illustrating a method for estimating an oral cavity shape according to an embodiment. [Figure 6] 1A to 1C are diagrams illustrating a method for estimating an oral cavity shape according to an embodiment. [Figure 7] 1A to 1C are diagrams illustrating a method for estimating an oral cavity shape according to an embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of the configuration of model characteristic information 160 according to the embodiment. [Figure 9] 13 is a diagram showing an example of the configuration of model shape information 161 according to the embodiment. [Figure 10] 5A to 5C are diagrams illustrating examples of images displayed on a display unit 15 according to the embodiment. [Figure 11] 5A to 5C are diagrams illustrating examples of images displayed on a display unit 15 according to the embodiment. [Figure 12] 5A to 5C are diagrams illustrating examples of images displayed on a display unit 15 according to the embodiment. [Figure 13] 5A to 5C are diagrams illustrating examples of images displayed on a display unit 15 according to the embodiment. [Figure 14] 4 is a flowchart illustrating a flow of processing performed by a training assistance device 10 of an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the oral cavity refers to the airway extending from the lips to the glottis of a human being, which functions as an acoustic tube when playing a wind instrument and changes shape depending on the sound being played.

[0012] Fig. 1 is a block diagram showing an example of the configuration of a training support device 10 according to an embodiment. The training support device 10 is a computer that supports training related to playing a wind instrument, such as a PC (Personal Computer) or a server device. As shown in Fig. 1, the training support device 10 includes, for example, a pitch information acquisition unit 11, a model information acquisition unit 12, a characteristic information acquisition unit 13, an oral cavity acoustic characteristic measurement unit 14, a display unit 15, a storage unit 16, and an oral cavity shape estimation unit 17.

[0013] The pitch information acquisition unit 11 acquires pitch information. The pitch information is information indicating pitch. The pitch information acquisition unit 11 acquires, for example, information indicating pitch input from an input device such as a mouse or a keyboard as pitch information. Alternatively, the pitch information acquisition unit 11 may acquire, as pitch information, information indicating the pitch of a note indicated in musical score data. The pitch information acquisition unit 11 outputs the acquired pitch information to the model information acquisition unit 12.

[0014] The model information acquisition unit 12 acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to pitch information. The model here is an object that is shown as a model when teaching playing. The oral acoustic characteristics are acoustic characteristics in the space formed in the oral cavity. For example, the oral acoustic characteristics indicate the relationship between the magnitude of resonance (strength of resonance) for sounds of different frequencies in the space formed in the oral cavity (see FIG. 10). The model information acquisition unit 12 acquires pitch information from the pitch information acquisition unit 11, for example, and acquires model characteristic information 160 corresponding to a sound corresponding to the pitch information from the storage unit 16 based on the acquired pitch information. The model characteristic information 160 is information that indicates the oral acoustic characteristics that serve as a model (see FIG. 8).

[0015] Moreover, the model information acquisition unit 12 acquires a model oral cavity shape when playing a sound corresponding to the pitch information. The oral cavity shape is information indicating the shape of the oral cavity, for example, information indicating the cross-sectional area of ​​the airway at each part (lips, teeth, oral cavity, narrow mouth, hypopharynx, etc.) in the airway from the lips to the glottis (see FIG. 4). Alternatively, the oral cavity shape is information indicating a schematic diagram of the airway from the entrance of the oral cavity to the glottis viewed from the side (see image G4 in FIG. 12). The model information acquisition unit 12 acquires pitch information from the pitch information acquisition unit 11, for example, and acquires model shape information 161 corresponding to a sound corresponding to the pitch information from the storage unit 16 based on the acquired pitch information. The model shape information 161 is information indicating a model oral cavity shape (see FIG. 9).

[0016] The characteristic information acquisition unit 13 acquires oral acoustic characteristics of a performer who plays a sound corresponding to the pitch information. The characteristic information acquisition unit 13 acquires, for example, oral acoustic characteristics of the performer measured by the oral acoustic characteristic measurement unit 14. The characteristic information acquisition unit 13 also acquires the oral cavity shape of the performer who plays a sound corresponding to the pitch information. The characteristic information acquisition unit 13 acquires, for example, the oral cavity shape of the performer estimated by the oral cavity shape estimation unit 17.

[0017] The oral acoustic characteristic measurement unit 14 measures the oral acoustic characteristic of a performer who plays a sound corresponding to the pitch information. The oral acoustic characteristic measurement unit 14 may measure the oral acoustic characteristic of a performer using any measurement method. The method by which the oral acoustic characteristic measurement unit 14 measures the oral acoustic characteristic will be described in detail later.

[0018] The oral cavity shape estimation unit 17 estimates the oral cavity shape of the performer who plays the sound corresponding to the pitch information. The oral cavity shape estimation unit 17 may estimate the oral cavity shape of the performer using any measurement method. The method by which the oral cavity shape estimation unit 17 estimates the oral cavity shape will be described in detail later.

[0019] The processes performed by the above-mentioned components of the learning support device 10 (pitch information acquisition unit 11, model information acquisition unit 12, characteristic information acquisition unit 13, oral acoustic characteristic measurement unit 14, and oral cavity shape estimation unit 17) are configured to be realized by, for example, a processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor) included in the learning support device 10 executing a program stored in the storage unit 16. Alternatively, all or a part of the above-mentioned components of the learning support device 10 may be realized by dedicated hardware such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array).

[0020] The display unit 15 is composed of hardware having a function of displaying images, such as an LED (light emitting diode) or an LCD (liquid crystal display). The display unit 15 displays oral acoustic characteristics as a model for sounds corresponding to pitch information, and oral acoustic characteristics by the performer.

[0021] The storage unit 16 is, for example, a storage device (a storage device having a non-transitory storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or a combination of these. The storage unit 16 stores programs for implementing each component of the training support device 10, variables used when executing the programs, and various information. The storage unit 16 stores, for example, model characteristic information 160 and model shape information 161. The model characteristic information 160 is information indicating model oral cavity acoustic characteristics. The model shape information 161 is information indicating model oral cavity shape.

[0022] Here, a method for measuring oral acoustic characteristics by the oral acoustic characteristic measuring unit 14 will be described. Any method may be used for the measurement, and for example, Document 1 ("Saxophonists tune vocal tract resonances in advanced performance techniques, Jer-Ming Chen, et al, January 2011, The Journal of the Acoustical Society of America 129(1):415-26") disclosed by researchers at the University of New South Wales (UNSW) and other publications, or another document 2 ("A Single Microphone Capillary-Based System for Measuring the Complex Input Impedance of Musical Wind Instruments, DB Sharp, et al, September 2011, Acta Acustica united with Acustica 97(5):819-829") can be used. Document 2 describes the construction of a measurement environment in which reflection to a driving source (speaker) can be considered to be approximately 0 (zero) by using a thin and long acoustic tube.

[0023] Fig. 2 is a diagram for explaining a measurement method by the oral cavity acoustic characteristic measuring unit 14. As shown in Fig. 2, for example, the oral cavity acoustic characteristic measuring unit 14 measures the oral cavity acoustic characteristic of a player P using a special mouthpiece TM. The special mouthpiece TM includes a first acoustic tube C1 connected to a microphone M and a second acoustic tube C2 connected to a speaker S. The first acoustic tube C1 collects sound at the entrance of the oral cavity into the microphone M. The second acoustic tube C2 inputs sound produced by the speaker S into the oral cavity.

[0024] The performer forms an oral cavity shape for playing a sound according to the pitch information while wearing the special mouthpiece TM. The oral cavity acoustic characteristic measurement unit 14 causes the speaker S to emit a sound corresponding to a specific pitch via a digital-to-analog converter (DAC). As a result, the sound is input into the oral cavity of the performer via the second acoustic tube C2, the sound resonates in the oral cavity, and the resonating sound (resonant sound) is collected by the microphone M via the first acoustic tube C1. The oral cavity acoustic characteristic measurement unit 14 acquires the sound collected by the microphone M via an analog-to-digital converter (ADC). For example, the oral cavity acoustic characteristic measurement unit 14 acquires the strength of resonance in the oral cavity due to the sound by comparing the sound pressure of the sound generated by the speaker S with the sound pressure of the sound collected by the microphone M. The oral cavity acoustic characteristic measurement unit 14 sequentially generates sounds with different pitches from the speaker and acquires the strength of resonance corresponding to the generated sounds. In this way, oral cavity acoustic characteristic measuring section 14 measures the oral cavity acoustic characteristic of the performer.

[0025] The oral acoustic characteristic measurement unit 14 may measure the oral acoustic characteristic of the performer while the performer is wearing the special mouthpiece TM and playing a wind instrument. In this case, the oral acoustic characteristic measurement unit 14 performs filtering on the sound collected by the microphone M to attenuate the components corresponding to the sound output from the wind instrument during playing. The oral acoustic characteristic measurement unit 14 obtains the strength of resonance in the oral cavity using the sound pressure of the filtered sound.

[0026] Here, a method for estimating the oral cavity shape by oral cavity shape estimation unit 17 will be described. Any method may be used for the estimation, but for example, the algorithm of Ware and Aki (disclosed in Document 3, "A method for measuring airway cross-sectional area using sound and its clinical application," Journal of the Acoustical Society of Japan, Vol. 49, No. 4 (1993), etc.) can be used.

[0027] 3 to 7 are diagrams for explaining an estimation method by oral cavity shape estimation unit 17. As shown in FIG. 3, for example, oral cavity shape estimation unit 17 estimates the oral cavity shape of player P using a wave tube (sound tube) C3. Wave tube C3 is provided with a pressure transducer AT and a horn driver H. Horn driver H inputs sound into the oral cavity through wave tube C3. Pressure transducer AT outputs an electric signal according to the sound pressure of a reflected wave of sound output from the oral cavity to the outside through wave tube C3. Horn driver H is an example of a "speaker". Pressure transducer AT is an example of a "microphone".

[0028] While wearing the wave tube C3, the performer forms an oral cavity shape when playing a sound corresponding to pitch information. The oral cavity shape estimation unit 17 causes the horn driver H to generate an impulse waveform via a digital-to-analog converter (DAC). This causes sound to be input into the oral cavity of the performer via the wave tube C3. The sound is then reflected within the oral cavity, output outside the oral cavity via the wave tube C3, and measured by a pressure transducer AT. The oral cavity shape estimation unit 17 acquires the sound pressure measured by the pressure transducer AT via an analog-to-digital converter (ADC).

[0029] The oral cavity shape estimation unit 17 calculates the cross-sectional area of ​​the airway at a position distance x from the origin using the sound pressure of the acquired reflected wave. The origin here is the position that is the origin when measuring the input wave and the reflected wave, and is the position where the pressure transducer AT is provided in the wave tube C3. As a result, as shown in FIG. 4, the oral cavity shape estimation unit 17 can calculate the relationship between the distance x from the inlet and the cross-sectional area of ​​the airway, and can estimate the oral cavity shape based on this relationship.

[0030] 5 shows a simplified model of the oral cavity shape (hereinafter, the simple model). The simple model is a model in which the cross-sectional area of ​​the wave tube C3 at the origin is A0, and the cross-sectional area of ​​the airway changes to A1 at a position at a distance x0 from the origin. In this case, the oral cavity shape estimation unit 17 expresses the reflection coefficient r at a site at a distance x0 from the origin using the following formula (1).

[0031] r=(Pr / Pi)×(A0-A1) / (A0+A1) …(1)

[0032] In equation (1), Pr is the sound pressure of the reflected wave, Pi is the sound pressure of the input wave, A0 is the cross-sectional area at the origin, and A1 is the cross-sectional area of ​​the airway at a distance x0 from the origin.

[0033] Oral cavity shape estimation unit 17 solves equation (1) for area A1, transforms it into equation (2), and expresses area A1 as the product of coefficient K and cross-sectional area A0.

[0034] A1 = K × A0 … (2) Here, K = (Pr-rPi) / (Pr+rPi)

[0035] Since the area A0 is known, the oral cavity shape estimation unit 17 can calculate the area A1 by determining the coefficient K. The coefficient K can be calculated using the sound pressure of the input wave Pi, the sound pressure of the reflected wave Pr(T) measured at time T, and the reflection coefficient r. Here, the time T is the time required for the sound wave to propagate the round-trip distance (2×x0).

[0036] A model close to the actual shape of the oral cavity (hereinafter, the real model) is shown in Figure 6. In the real model, the cross-sectional area of ​​the airway at the inlet is A0, and the cross-sectional area of ​​the airway at positions away from the inlet by distances x0, 2x0, 3x0, 4x0, ... changes stepwise to A1, A2, A3, A4, ...

[0037] In the real model, an input wave Pi is input to a wave tube C3 connected to the oral cavity at time 0 (zero). Also, a reflected wave Pr(T) reflected at a cross section at a position distanced x0 from the origin is measured at time T. Similarly, reflected waves Pr(2T), Pr(3T), ... reflected at cross sections at positions distanced 2x0, 3x0, ... from the origin are measured at times 2T, 3T, ....

[0038] In the real model, there is no multiple reflection until time 2T, so the areas A1 and A2 can be calculated using equation (2) in the same way as in the simple model. However, as shown in Fig. 7, in the real model, at time T3, a wave that is a mixture of a reflected wave reflected at a position 3x0 away from the origin and a reflected wave that is multiple-reflected as indicated by the dashed arrows is measured by pressure transducer AT.

[0039] Oral cavity shape estimation unit 17 calculates the multiple reflected reflected waves using areas A0 to A2. Oral cavity shape estimation unit 17 subtracts the multiple reflected reflected wave sound pressure from the sound pressure of the reflected wave measured at time T3, and calculates area A3 by substituting the sound pressure after subtraction (i.e., consisting only of the reflected wave reflected on the cross section at a position distant from the origin by 3x0) into equation (2). By performing such estimation taking into account the influence of multiple reflections, it becomes possible to estimate the oral cavity shape with higher accuracy.

[0040] By performing the above-mentioned processes related to the measurement by the oral cavity acoustic characteristic measurement unit 14 and the estimation by the oral cavity shape estimation unit 17 using, for example, a DSP, the calculation process can be performed faster than when the processes are performed only by a CPU without using a DSP. Therefore, it is possible to perform the measurement of the oral cavity acoustic characteristic and the estimation of the oral cavity shape almost in real time with the change in the sound being played.

[0041] Fig. 8 is a diagram showing an example of the configuration of model characteristic information 160 according to an embodiment. As shown in Fig. 8, model characteristic information 160 includes items such as pitch information and model characteristics. The pitch information is information indicating a pitch. The model characteristics are information indicating oral acoustic characteristics that serve as a model when playing a sound identified by the pitch information. The model oral acoustic characteristics are, for example, oral acoustic characteristics that are actually measured (actually measured) during a performance by a skilled performer. Alternatively, the characteristics may be created using a method such as simulation rather than actual measurement.

[0042] Fig. 9 is a diagram showing an example of the configuration of model shape information 161 according to an embodiment. As shown in Fig. 9, model shape information 161 includes items such as pitch information and model shape. The pitch information is information indicating a pitch. The model shape is information indicating a model oral cavity shape when playing a sound specified by the pitch information. The model oral cavity shape is, for example, an oral cavity shape actually measured (actually measured) using a measuring device such as MRI (Magnetic Resonance Imaging) during playing by a skilled performer. Alternatively, the model oral cavity shape may be a shape created using a method such as simulation rather than actual measurement.

[0043] 10 to 13 are diagrams showing examples of images displayed on the display unit 15 of the embodiment. As shown in FIG. 10, the display unit 15 displays an oral acoustic characteristic L1 as a model and an oral acoustic characteristic L2 by a performer. In the example of this figure, an image G1 is displayed. The characteristic L1 and the characteristic L2 are displayed overlapping on the image G1. In this oral acoustic characteristic, the horizontal axis indicates pitch and the vertical axis indicates the strength of resonance. In this way, the pitch of the oral acoustic characteristic may be displayed by frequency. This makes it possible to make the performer recognize the difference between the characteristics L1 and L2. The performer can recognize how the acoustic characteristic changes by changing the way of moving the muscles in the oral cavity. Therefore, the performer can learn the relationship between the acoustic characteristic that can play the target sound and the way of moving the muscles in the oral cavity when playing the sound.

[0044] As shown in FIG. 11, the display unit 15 may display markers MK1 to MK3 in addition to the waveform indicating the oral acoustic characteristics. In the example of this figure, the display unit 15 displays images G2 and G3. In the image G2, a musical score GH and a marker MK1 indicating the playing position are displayed. By displaying the image G2, the performer can easily recognize the playing position and the playing sound. In addition, in the image G3, a marker MK2 indicating a frequency difference (described as "sound deviation" in FIG. 11) and a marker MK3 indicating an intensity difference are displayed. The frequency difference here is the difference between the frequency at which the resonance peak occurs in the model characteristic L1 and the frequency at which the resonance peak occurs in the performer characteristic L2. The intensity difference is the difference between the peak value of the resonance in the model characteristic L1 and the peak value of the resonance in the performer characteristic L2. As shown in the example of this figure, the display unit 15 may display the frequency difference in a unit that is easy for the performer to grasp, such as [cent]. Compared to displaying it in frequency (Hz), this allows the degree of frequency deviation to be recognized more intuitively.

[0045] As shown in Fig. 12, the display unit 15 may further display a model mouth shape L3 and a mouth shape L4 of the performer. In the example of this figure, an image G4 is further displayed. The shape L3 and the shape L4 are displayed in an overlapping manner in the image G4.

[0046] As shown in Fig. 13, the display unit 15 may display comments CM1 and CM2 on the shape of the oral cavity. In the example of this figure, the display unit 15 displays an image G5. In the image G5, the comment CM1 "keep your tongue down" is displayed at the position of the tongue in the shape of the oral cavity of the performer. Also, in the image G5, the comment CM2 "close your throat" is displayed at the position of the hypopharynx in the shape of the oral cavity of the performer. By adding such comments, it is possible to give the performer a hint on how to move his or her muscles.

[0047] FIG. 14 is a flowchart illustrating the flow of processing performed by the training support device 10 of the embodiment. The training support device 10 acquires pitch information (step S10). The training support device 10 acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information (step S11). The training support device 10 measures the oral acoustic characteristics of the performer when playing a sound corresponding to the pitch information (step S12). The training support device 10 displays the model oral acoustic characteristics and the oral acoustic characteristics of the performer (step S13).

[0048] Meanwhile, the training support device 10 acquires a model oral cavity shape when playing a sound corresponding to the pitch information (step S14). The training support device 10 estimates the oral cavity shape of the performer when playing a sound corresponding to the pitch information (step S15). The training support device 10 displays the model oral cavity shape and the oral cavity shape of the performer (step S16).

[0049] In the above-mentioned flowchart, the case where both the oral cavity acoustic characteristics and the oral cavity shape are displayed is described as an example. However, this is not limited to this. The training support device 10 only needs to display at least the oral cavity acoustic characteristics of the model and the oral cavity acoustic characteristics of the performer. In the above-mentioned flowchart, the oral cavity shape is estimated after displaying the oral cavity acoustic characteristics. However, this is not limited to the above. The training support device 10 may display the oral cavity acoustic characteristics and the oral cavity shape together. In this case, steps S14 and S15 are executed after step S12, and then steps S13 and S16 are executed.

[0050] In the above embodiment, the oral acoustic characteristic measurement unit 14 measures the oral acoustic characteristic of the performer. However, the present invention is not limited to this. The training support device 10 may acquire the oral acoustic characteristic measured by an external device. In this case, the external device includes a functional unit equivalent to the oral acoustic characteristic measurement unit 14, and transmits the oral acoustic characteristic measured by the functional unit to the training support device 10.

[0051] As described above, the teaching support device 10 of the embodiment includes a pitch information acquisition unit 11, a model information acquisition unit 12, a characteristic information acquisition unit 13, and a display unit 15. The display unit 15 is an example of an "output unit." The pitch information acquisition unit 11 acquires pitch information of the target to be played. The model information acquisition unit 12 acquires oral acoustic characteristics that serve as a model when playing a sound corresponding to the pitch information. The characteristic information acquisition unit 13 acquires oral acoustic characteristics when a performer plays a sound corresponding to the pitch information. The display unit 15 displays the oral acoustic characteristics of the performer acquired by the characteristic information acquisition unit 13 and the model oral acoustic characteristics acquired by the model information acquisition unit 12.

[0052] This allows the teaching support device 10 of the embodiment to show the oral acoustic characteristics of the performer and the model oral acoustic characteristics. The shape of the oral cavity formed during playing is merely a means for creating a space with desired acoustic resonance (oral acoustic characteristics) in the oral cavity. Whether or not a target sound can be played is more essential to presenting the oral acoustic characteristics than to presenting the oral cavity shape. For this reason, it is possible to make the performer recognize the difference from the model acoustic characteristics and to make him / her recognize how the acoustic characteristics change by changing the way the muscles in the oral cavity are moved. Therefore, it is possible for the performer to learn the relationship between the acoustic characteristics that allow the performance of the target sound and the way the muscles in the oral cavity are moved when playing the sound.

[0053] Moreover, the teaching support device 10 of the embodiment further includes a storage unit 16. The storage unit 16 stores model characteristic information 160. The model characteristic information 160 is information indicating model oral acoustic characteristics. The model information acquisition unit 12 reads out and acquires the model characteristic information 160 corresponding to a sound according to pitch information from the storage unit 16. This allows the teaching support device 10 of the embodiment to select the pre-stored model characteristic information 160 according to the pitch information, and to acquire the model characteristic information 160 even in an environment not connected to a communication network such as the Internet.

[0054] In addition, in the embodiment of the training support device 10, the display unit 15 displays the relationship between the pitch and the resonance strength of the oral acoustic characteristics of the performer and the oral acoustic characteristics of the model. This allows the training support device 10 of the embodiment to intuitively recognize the difference in frequency and strength from the model.

[0055] In addition, in the embodiment of the training support device 10, the display unit 15 marks and displays the resonance peak pitch in the oral acoustic characteristics of the performer and the resonance peak pitch in the oral acoustic characteristics of the model. This makes it possible for the training support device 10 of the embodiment to quantitatively recognize the sound deviation and intensity difference from the model.

[0056] Moreover, the training support device 10 of the embodiment further includes an oral acoustic characteristic measuring unit 14. As shown in FIG. 2, the oral acoustic characteristic measuring unit 14 inputs sound from a speaker S into the oral cavity of a player P. The oral acoustic characteristic measuring unit 14 causes a microphone M to collect resonance sounds in the oral cavity of the player P caused by the sound input into the oral cavity of the player P. The oral acoustic characteristic measuring unit 14 measures the oral acoustic characteristics of the player based on the resonance sounds collected by the microphone M. In this way, the training support device 10 of the embodiment can measure the oral acoustic characteristics of the player.

[0057] (First Modification of the Embodiment) Here, a first modified example of the embodiment will be described. This modified example differs from the above-described embodiment in that the process of measuring the acoustic characteristics of the oral cavity of the player and the process of estimating the shape of the oral cavity are carried out together.

[0058] In the following description, a case will be described in which the oral acoustic characteristic measurement unit 14 performs the measurement process of the oral acoustic characteristic of the performer and the estimation process of the oral shape together. However, this is not limited to this. The oral shape estimation unit 17 or other functional units in the training support device 10 may perform the measurement process of the oral acoustic characteristic of the performer and the estimation process of the oral shape together.

[0059] First, the player forms the mouth shape when playing a sound corresponding to the pitch information while wearing the mouthpiece. The mouthpiece in this case is not the special mouthpiece TM described above, but a normal mouthpiece.

[0060] Next, the performer produces a voiced sound while maintaining the shape of the oral cavity when performing. The oral cavity acoustic characteristic measurement unit 14 collects the voiced sound produced by the performer with a microphone and acquires the collected voiced sound. The oral cavity acoustic characteristic measurement unit 14 estimates a transfer function in the oral cavity by, for example, linear predictive coding (LPC) of the acquired sound, and measures the resonance characteristics (acoustic characteristics) in the oral cavity by determining resonance characteristics based on the estimated transfer function. Furthermore, the oral cavity acoustic characteristic measurement unit 14 estimates the shape of an equivalent acoustic tube (model of the oral cavity shape) having the transfer function based on the estimated transfer function.

[0061] As described above, the training support device 10 according to the first modified embodiment further includes an oral acoustic characteristic measurement unit 14. The oral acoustic characteristic measurement unit 14 performs linear prediction analysis on voiced sounds uttered while maintaining the shape of the oral cavity formed when the performer plays. The oral acoustic characteristic measurement unit 14 calculates the oral acoustic characteristics of the performer using the result of the linear prediction analysis. The oral acoustic characteristic measurement unit 14 calculates the oral cavity shape of the performer using the result of the linear prediction analysis. The characteristic information acquisition unit 13 acquires the oral acoustic characteristics and oral cavity shape of the performer calculated by the oral acoustic characteristic measurement unit 14. As a result, the training support device 10 according to the first modified embodiment can easily calculate the oral acoustic characteristics and oral cavity shape by arithmetic processing without using a special device (e.g., a special mouthpiece TM) with a built-in microphone or speaker.

[0062] (Modification 2 of the embodiment) Here, a second modified example of the embodiment will be described. This modified example differs from the above-mentioned embodiment in that a model oral cavity shape is stored for each sound corresponding to the same pitch. As described above, there may be cases where the target sound cannot be produced even if the oral cavity shape formed during playing is imitated to the sample oral cavity shape. As a countermeasure against this, an oral cavity shape by an expert with attributes similar to the attributes of the performer is presented. This is expected to increase the possibility of being able to produce the target sound by imitating the sample oral cavity shape. The attributes here may be any attribute, and are preferably attributes of parts that are thought to contribute to playing, such as gender, age, physical build such as height and weight, throat length, and lung capacity. Alternatively, the performer may be allowed to specify an expert to be used as a model. For example, by presenting the oral cavity shape of an expert that the performer admires, it is expected to increase the performer's motivation to practice.

[0063] The whole or part of the teaching support device 10 in the above-mentioned embodiment may be realized by a computer. In that case, a program for realizing this function may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to realize the function. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" may also include a medium that dynamically holds a program for a short period of time, such as a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and a medium that holds a program for a certain period of time, such as a volatile memory inside a computer system that is a server or client in that case. The above-mentioned program may be a program for realizing a part of the above-mentioned function, or may be a program that can realize the above-mentioned function in combination with a program already recorded in the computer system, or may be a program that is realized using a programmable logic device such as an FPGA.

[0064] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0065] 10...Learning support device, 11...Pitch information acquisition unit, 12...Model information acquisition unit, 13...Characteristics information acquisition unit, 14...Oral acoustic characteristics measurement unit (signal processing unit), 15...Display unit, 16...Memory unit, 160...Model characteristic information, 161...Model shape information, 17...Oral cavity shape estimation unit (signal processing unit)

Claims

1. A pitch information acquisition unit that acquires pitch information of a sound to be played using a wind instrument; a model information acquisition unit that acquires oral acoustic characteristics that serve as models for playing a sound corresponding to the pitch information; a characteristic information acquisition unit that acquires characteristic information indicating oral acoustic characteristics of a player when playing a sound corresponding to the pitch information; an output unit that displays the oral acoustic characteristic of the performer acquired by the characteristic information acquisition unit and the oral acoustic characteristic of the model acquired by the model information acquisition unit as a relationship between pitch and resonance strength; A teaching support device comprising:

2. A pitch information acquisition unit that acquires pitch information of a sound to be played using a wind instrument; a model information acquisition unit that acquires oral acoustic characteristics that serve as models for playing a sound corresponding to the pitch information; a characteristic information acquisition unit that acquires characteristic information indicating oral acoustic characteristics of a player when playing a sound corresponding to the pitch information; an output unit that displays the oral cavity shape of the player estimated based on the oral acoustic characteristics of the player acquired by the characteristic information acquisition unit, the model oral acoustic characteristics acquired by the model information acquisition unit, and a sound corresponding to the pitch information; A teaching support device comprising:

3. The output unit displays a comment on the mouth shape of the performer. The teaching support device according to claim 2.

4. A storage unit that stores model characteristic information indicating the model oral acoustic characteristic, the model information acquisition unit reads and acquires the model characteristic information corresponding to the sound according to the pitch information from the storage unit; The teaching support device according to any one of claims 1 to 3.

5. the output unit marks and displays a pitch that is a peak of resonance in the oral acoustic characteristics of the performer and a pitch that is a peak of resonance in the oral acoustic characteristics of the model. The teaching support device according to claim 1.

6. The apparatus further includes an oral cavity acoustic characteristic measuring unit that collects, with a microphone, a resonance sound in the oral cavity of the performer caused by a sound input from a speaker into the oral cavity of the performer, and measures the oral cavity acoustic characteristic of the performer based on the collected resonance sound, The characteristic information acquisition unit acquires the characteristic information measured by the oral acoustic characteristic measurement unit. The training support device according to any one of claims 1 to 5.

7. A signal processing unit that measures an oral cavity acoustic characteristic of a performer by performing linear predictive analysis on a voiced sound produced while maintaining the oral cavity shape formed when the performer is performing, and estimates the oral cavity shape of the performer, The characteristic information acquisition unit acquires the oral acoustic characteristic of the performer measured by the signal processing unit and the oral cavity shape of the performer estimated by the signal processing unit. The training support device according to any one of claims 1 to 5.

8. A training support method performed by a computer of a training support device, comprising: a pitch information acquisition unit that acquires pitch information of a sound to be played using a wind instrument; a model information acquisition unit acquires oral acoustic characteristics that serve as models for playing a sound corresponding to the pitch information; a characteristic information acquisition unit acquires characteristic information indicating oral acoustic characteristics of a performer when playing a sound corresponding to the pitch information; an output unit displays the oral acoustic characteristic of the performer acquired by the characteristic information acquisition unit and the oral acoustic characteristic of the model acquired by the model information acquisition unit as a relationship between pitch and resonance strength; Teaching support methods.

9. The computer of the teaching support device, A pitch information acquisition means for acquiring pitch information of a sound to be played using a wind instrument; A model information acquisition means for acquiring oral acoustic characteristics that serve as a model for playing a sound corresponding to the pitch information; a characteristic information acquiring means for acquiring characteristic information indicating oral acoustic characteristics of a player when playing a sound corresponding to the pitch information; an output means for displaying the oral acoustic characteristic of the performer acquired by the characteristic information acquisition means and the oral acoustic characteristic of the model acquired by the model information acquisition means as a relationship between pitch and resonance strength; A program that executes the following.

10. A training support method performed by a computer of a training support device, comprising: a pitch information acquisition unit that acquires pitch information of a sound to be played using a wind instrument; a model information acquisition unit acquires oral acoustic characteristics that serve as models for playing a sound corresponding to the pitch information; a characteristic information acquisition unit acquires characteristic information indicating oral acoustic characteristics of a performer when playing a sound corresponding to the pitch information; an output unit displays the oral cavity shape of the player estimated based on the oral acoustic characteristics of the player acquired by the characteristic information acquisition unit, the model oral acoustic characteristics acquired by the model information acquisition unit, and a sound corresponding to the pitch information; Teaching support methods.

11. The computer of the teaching support device, A pitch information acquisition means for acquiring pitch information of a sound to be played using a wind instrument; A model information acquisition means for acquiring oral acoustic characteristics that serve as a model for playing a sound corresponding to the pitch information; a characteristic information acquiring means for acquiring characteristic information indicating oral acoustic characteristics of a player when playing a sound corresponding to the pitch information; an output means for displaying the oral cavity shape of the player estimated based on the oral acoustic characteristics of the player acquired by the characteristic information acquisition means, the model oral acoustic characteristics acquired by the model information acquisition means, and a sound corresponding to the pitch information; A program that executes the following.

Citation Information

Patent Citations

  • Method for displaying estimated articulation state and computer-readable recording medium with recorded computer program therefor

    JP2001249675A

  • Device and method for displaying playing

    JP2002091290A

  • Resonance frequency detecting method, resonance frequency selecting method, and resonance frequency detecting device

    JP2005318094A

  • Wind instrument practice system and wind instrument practice device

    JP2007187898A

  • Sound control device and program

    JP2009180957A