Sound information learning support device, sound information learning support method, sound information learning support program, and recording medium
The sound information learning support device provides personalized feedback and guidance for musical choir and language pronunciation practice, allowing learners to objectively assess their progress and maintain concentration through repeated practice.
Patent Information
- Application Number
- JP2023222781
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-12-28
- Publication Date
- 2024-11-20
- Estimated Expiration
- 2043-12-28
AI Technical Summary
Existing educational tools for musical choir practice and language pronunciation lack the ability to provide individualized feedback and guidance, making it difficult for learners to objectively assess their progress and achieve accurate vocalization, pitch, and pronunciation.
A sound information learning support device and method that allows learners to select, adjust, and record sound information, synthesize it with their performance, and receive objective feedback based on predetermined criteria, enabling personalized practice and guidance.
Enables learners to objectively assess their progress, receive personalized guidance, and maintain concentration through repeated practice, fostering a sense of accomplishment and unity in their learning.
Smart Images

Figure 0007587670000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a sound information learning support device, a sound information learning support method, a sound information learning support program, and a recording medium for supporting the learning of sound information in educational settings such as musical choir practice, instrumental music practice, and language pronunciation practice. [Background technology]
[0002] In educational settings, for example, when practicing choral music or pronunciation in language learning, one instructor usually instructs many trainees by having them all speak at once. Also, when practicing choral music with multiple parts, a CD for part practice is played and trainees practice the designated part. When pronouncing words in a foreign language or reading a sentence aloud, the trainees practice their pronunciation by imitating the instructor's pronunciation.
[0003] This type of instruction and practice is led by the instructor to encourage vocalization. For the trainee, it is passive instruction, and they do not pay particular attention to the accuracy of vocalization, pitch, or pronunciation. Even if they are interested in vocalization and pronunciation, it is difficult to receive individual instruction in educational settings. It is not possible to judge whether the vocalization and pronunciation are good, and there are few opportunities to acquire accurate vocalization, pitch, and pronunciation.
[0004] Instructors also want to help students realize the joy and value of learning by mastering accurate vocalization, pitch, and pronunciation, but providing individual instruction for each student's practice is not easy in terms of time or physical effort.
[0005] As a means for solving such a problem, for example, Patent Document 1 can be mentioned. Patent Document 1 discloses a technique related to an audio playback device capable of playing back a performance suitable for choral practice. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Utility Model Registration No. 3163184 DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]
[0007] The audio reproducing device described in Patent Document 1 has a DVD on which multiple audio data are recorded, a reproducing section for reproducing the multiple audio data recorded on the DVD, and multiple audio output sections for outputting from the reproducing section, and is configured to simultaneously output multiple audio corresponding to the multiple audio data recorded on the DVD from the multiple audio output sections, allowing multiple audio to be heard simultaneously. Thus, in the audio reproducing device described in Patent Document 1, the multiple audio includes the audio of each part of a choir and the stereo audio of the choir. Therefore, the audio reproducing device described in Patent Document 1 is a device that simultaneously outputs the audio of each part of a choir from a separate speaker, allowing each part to be practiced at the same time.
[0008] Therefore, by using the audio playback device described in Patent Document 1, when practicing a chorus, trainees can, in addition to receiving group instruction from the instructor, split into any part they like and practice while playing back the accurate audio for that part.
[0009] However, such devices simply allow the trainee to practice the part while listening to the corresponding part. It is difficult for the trainee to objectively view his / her own situation and accurately grasp the problem, such as whether he / she is actually singing well or why he / she is not singing well. As a result, it is not possible to realize learning that is tailored to each individual's understanding status, ability, and aptitude (= individually optimized learning) as required in the educational field.
[0010] Choir teaching materials are also attractive because they allow students to intuitively learn the sense of unity and accomplishment that comes from combining different parts of a piece of music with different voices to create a harmony that cannot be achieved by one person alone, and they can also cultivate cooperation and concentration. If students simply repeat their assigned parts by themselves in monotonous practice, they will get bored without realizing the value of the practice.
[0011] An object of the present invention is to provide a sound information learning support device, a sound information learning support method, a sound information learning support program, and a recording medium for supporting the learning of sound information in educational settings such as music choir practice and language pronunciation practice. [Means for solving the problem]
[0012] In view of the above problems, the inventors have come up with a means for achieving the following. First, it is better to objectively grasp the learning status so that the trainee can repeatedly practice what he / she wants to practice in the most convenient setting. Also, if there is a learning support device that allows the trainee to feel a sense of accomplishment and unity, it is easier for the instructor to grasp the learning status and learning results of the trainee, and the trainee can feel that he / she is receiving the instructor's guidance accurately. In addition, it is better to support learning without losing concentration.
[0013] Representative configurations of the sound information learning support device, sound information learning support method, sound information learning support program, and recording medium according to the present invention that solve the above problems are as follows. Note that, in order to facilitate understanding of the present invention, reference symbols used in the drawings of the embodiments described below are used here, but the present invention is not limited to the configurations indicated by these reference symbols.
[0014] (1) A sound information recording means for storing multiple pieces of sound information to be practiced; a sound information selection means for selecting one or more pieces of sound information stored in the sound information recording means; a sound output means for outputting the sound information selected by the sound information selection means; a volume adjustment means for adjusting the volume of the sound information output by the sound output means, including muting the sound; an output sound information recording means for recording and storing the sound information output by the sound output means; a voice information recording means for recording and storing voice information generated in response to the sound information output by the sound output means; a synthesis means for synthesizing any sound information stored in the output sound information recording means and voice information stored in the voice information recording means; A synthesis information recording means for recording and storing synthesis information synthesized by the synthesis means; A learning support device for sound information comprising:
[0015] (2) A judgment means for judging voice information recorded and stored in a voice information recording means, which is generated in response to the sound information, based on the sound information stored in the sound information recording means as a judgment criterion and on a predetermined threshold value set for one or more judgment items; A determination result recording means for recording and storing the determination result by the determination means; The sound information learning support device according to (1) above,
[0016] (3) a linking means for linking the judgment result stored in the judgment result recording means to the sound information or voice information output by the sound output means, and for executing a process for displaying the judgment result on the display unit when the sound information is output or when the voice information or the synthetic information is reproduced; The sound information learning support device according to (2) above,
[0017] (4) A learning support device for sound information described in any one of (1) to (3) above, wherein the sound information is one or more pieces of sound information selected from accompaniment for the entire musical piece, accompaniment for each part, and singing for each part such as chorus, lead, tenor, soprano, alto, bass, etc., and the audio information is singing produced by a trainee.
[0018] (5) A learning support device for sound information as described in (1) above, wherein the sound information is a reading of a sentence and the voice information is a voice uttered by a trainee.
[0019] (6) a step (step 1) of selecting one or more pieces of sound information by a sound information selection means (3) from a plurality of pieces of sound information to be practiced that are stored in a sound information recording means (21); A step (step 2) of adjusting and setting the volume of the selected sound information output from the sound output means (4) by the sound adjustment means (5); A step (step 3) of outputting the selected sound information by a sound output means (4); A step (step 4) of recording and storing the output information of the selected sound information in an output sound information recording means (22); A step (step 5) of recording and storing the voice information generated corresponding to the selected sound information in a voice information recording means (23); A step (step 6) of synthesizing any sound information stored in the output sound information recording means (22) and the voice information stored in the voice information recording means (23) by a synthesis means (7); A step (step 7) of recording and storing the composite information synthesized by the synthesis means in a composite information recording means (24); A method for supporting learning of sound information, comprising:
[0020] (7) A learning support program for sound information such as reading out music or text, or pronunciation of words, comprising: a sound information selection means for selecting one or more pieces of sound information; a sound output means for outputting the sound information selected by the sound information selection means; a volume control means for controlling the volume of sound information output by the sound output means; an output sound information recording means for recording and storing the sound information output by the sound output means; a voice information recording means for recording and storing voice information generated in response to the sound information output by the sound output means; a synthesis means for synthesizing any sound information stored in the output sound information recording means and voice information stored in the voice information recording means; A synthesis information recording means for recording and storing synthesis information synthesized by the synthesis means; Due to A learning support program for sound information, characterized by operating a synthesis information recording means which selects sound information necessary for practice, adjusts the volume of the sound information to be output, and stores the sound information recorded by an output sound information recording means, and synthesizes, records, and stores the sound information generated in response to the sound information and stored by a sound information recording means, using a synthesis means.
[0021] (8) audio information recorded in the audio information recording means, which is generated in response to the audio information stored in the output audio information recording means; The sound information learning support program described above in (7) uses sound information as a judgment criterion, judges using a recorded information judgment means based on a predetermined threshold value set for one or more judgment items, and operates a judgment result recording means to record and store the judgment result.
[0022] (9) A learning support program for sound information described in (7) above, which links the result of the judgment by the recorded information judgment means to the sound information or voice information output by the sound output means, and causes a linking means to function to execute processing to display the judgment result on the display unit when the sound information is output or the voice information is played back.
[0023] (10) A recording medium having recorded thereon a sound information learning support program, characterized in that the program according to any one of (7) to (9) above is recorded thereon. Effect of the Invention
[0024] According to the sound information learning support device, sound information learning support method, sound information learning support program, and recording medium of the present invention, sound information to be used as a practice target is selected from a plurality of pieces of sound information, voice information emitted corresponding to the sound information is recorded and saved, and the sound information and the voice information are synthesized by a synthesis means. Therefore, the trainee can set the most convenient setting for what he or she wants to practice, and record and save the practice content. In addition, a synthesis record combining any sound information can be created. Furthermore, since the trainee can practice repeatedly in the same environment, the learning progress can be objectively grasped, and in addition, learning support that allows the trainee to feel a sense of accomplishment and unity can be provided. Furthermore, the volume can be adjusted for each sound information, and each output sound information is recorded and saved, so the combinations can be changed as desired depending on the practice content, making it easy to continue learning. In addition, the instructor can easily grasp the learning situation and learning results of the trainees, and the trainees can receive accurate instruction from the instructor as if they were receiving individual lessons, so they can study without losing concentration and can practice repeatedly to achieve their learning goals. [Brief description of the drawings]
[0025] [Figure 1]FIG. 1 is a block diagram illustrating a functional configuration of an embodiment of a learning support device according to the present invention. [Diagram 2] FIG. 2 is an explanatory diagram showing an example of a hierarchical structure of a sound information recording means in the embodiment of the learning support device according to the present invention. [Diagram 3] FIG. 3 is an explanatory diagram showing an example of a hierarchical structure of a sound information recording means in the embodiment of the learning support device according to the present invention. [Figure 4] FIG. 4 is an explanatory diagram of an example of a determination in the embodiment of the learning support device according to the present invention. [Diagram 5] FIG. 5 is a flow chart showing an embodiment of the learning support method according to the present invention. [Figure 6] FIG. 6 is a flowchart illustrating a determination process in the embodiment of the learning support device according to the present invention. [Figure 7] FIG. 7 is a flowchart illustrating the linking process in the embodiment of the learning support device according to the present invention. [Figure 8] FIG. 8 is an explanatory diagram showing an example of what is displayed on a learning terminal in one embodiment of the learning support device according to the present invention. [Figure 9] FIG. 9 is an explanatory diagram showing an example of a display on a study terminal in another embodiment of the study support device according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] The embodiment of the learning support device according to the present invention will be described with reference to the drawings. Note that the shapes, numerical conditions, and the like of the following embodiments of the invention are merely preferred examples. Therefore, the present invention is not limited to the following embodiments, and many modifications can be made that achieve the effects of the present invention without departing from the scope of the configuration of the present invention.
[0027] [Functional configuration] 1 is a block diagram for explaining a functional configuration of an embodiment of a learning support device 1 according to the present invention. The learning support device 1 includes an information recording unit 2. The information recording unit 2 includes a sound information recording means 21, an output sound information recording means 22, a voice information recording means 23, a synthesis information recording means 24, and a judgment result recording means 25. The learning support device 1 also includes a sound information selection means 3, a sound output means 4, a speaker 41, a volume adjustment means 5, a voice input means 6, a microphone 61, a synthesis means 7, a judgment means 8, a linking means 9, a control unit 10, an operation unit 11, and a display unit 12.
[0028] 1, the learning support device 1 is composed of an information recording unit 2 equipped with at least a sound information recording means 21, an output sound information recording means 22, a voice information recording means 23, and a synthesis information recording means 24, a sound information selection means 3, a sound output means 4, a volume adjustment means 5, a voice input means 6, a synthesis means 7, an operation unit 11, a display unit 12, and a control unit 10, and each means is controlled by the control unit 10 to execute the learning support device 1. The learning support device 1 preferably includes a determination means 8 and a linking means 9, and the information recording unit 2 includes a determination result recording means 25.
[0029] 1 is one embodiment, and the information recording unit 2 may be stored in a learning device such as a device on which the learning support device 1 is executed or a mobile terminal, or may be stored in a cloud server device on a network. The information recording unit 2 is composed of a ROM for storing an OS, application programs, etc., a RAM for working area, and an HDD (Hard Disk Drive) or SSD (Solid State Drive) for storing various information. In this embodiment, it is stored in a tablet terminal on which the learning support device 1 is executed, and the control unit 10 executes the information recording unit 2.
[0030] The control unit 10 includes a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and controls a program that runs the learning support device 1.
[0031] The learning device is not particularly limited, and may be an electronic device operated by the trainee, such as a smartphone, tablet terminal, computer device, etc. In addition to the information recording unit 2 and the control unit 10, the learning device is equipped with a speaker 41, sound output means 4 such as an earphone terminal, a volume adjustment means 5 for adjusting the volume including muting, a voice input means 6 for the trainee to input voice, a sound recording means / video recording means 13 for recording / video output sound information and voice information, an operation unit 11, and a display unit 12.
[0032] The operation unit 11 may be a touch screen in which the display unit 12 and a touch panel are integrated. Input may also be made from a keyboard or a pen. Input may also be made by voice.
[0033] In the learning support device 1 according to the present invention, The sound information recording means 21 is a means for storing a plurality of pieces of sound information that are the subject of practice. The sound information selection means 3 is a means for selecting one or more pieces of sound information stored in the sound information recording means 21 . The sound output means 4 is a means for outputting the sound information selected by the sound information selection means 3. The volume adjustment means 5 is a means for adjusting the volume of the sound information output by the sound output means 4, including muting the sound. The output sound information recording means 22 is a means for recording and storing the sound information output by the sound output means 4. The audio information recording means 23 is a means for recording and storing audio information generated in response to the audio information output by the sound output means 4. The synthesis means 7 is a means for synthesizing any sound information stored in the output sound information recording means 22 and voice information stored in the voice information recording means 23, The composite information recording means 24 is a means for recording and storing the composite information synthesized by the synthesis means 7 . Each means will be described in detail below.
[0034] [Sound information] In the present invention, sound information includes all information related to sounds other than the voice uttered by the trainee when the learning subject is sound. Therefore, when learning to sing a choral piece, in addition to the accompaniment for the entire choral piece, the accompaniment for each part is also independent sound information, and the model singing voice for each part that makes up the choral piece is also independent sound information for each part. In addition, information accompanying these sound information, such as video data of model singing for each part, video data of facial expressions, mouth movements, and gestures, musical score for the entire piece, musical score for each part, unique pitch, indications for keeping rhythm, etc., are also sound information, and the data of these sound information are stored in the sound information recording means 21.
[0035] The above is an example of choral learning, but the learning support device 1 according to the present invention is not limited to this and can support various types of learning. In the case of music, it can support not only choral learning but also learning of instrumental music. For example, when learning a foreign language, the sound information includes the voice of a sentence read aloud for practice, the pronunciation of each word, the pronunciation of each phrase, etc., and the accompanying text information, phonetic symbol information, video information of the mouth movements during pronunciation, etc., and the data of these sound information are each selectably stored in the sound information recording means 21.
[0036] [Sound information recording means] The sound information recording means 21 is a means for converting sound information to be practiced into data and storing it in advance, and the trainee can select any sound information he / she wants to practice from the sound information recording means 21 and practice it. The sound information data stored in the sound information recording means 21 is also used for synthesis recording, which is synthesized with the corresponding voice information, i.e., data of the voice information emitted by the trainee, and stored.
[0037] 2 and 3 are explanatory diagrams showing an example of the hierarchical structure of the sound information recording means 21 in the embodiment of the learning support device 1 according to the present invention. The embodiment of Fig. 2 and Fig. 3 is an example of choral learning, and is shown in a hierarchical structure to facilitate understanding, but the recording structure of the sound information is not limited to the hierarchical structure shown in the figure, and may be any structure that allows trainees to arbitrarily select various kinds of sound information.
[0038] A plurality of practice pieces to be practiced are stored in the sound information recording means 21. For each practice piece, sound information data such as accompaniment, singing (sound), musical score, singing, and performance video is stored so as to be readable and reproducible.
[0039] The sound information for the accompaniment, singing (sound), sheet music, singing, and performance video is stored as sound information for the entire etude and sound information for each part.For example, the sound information for the entire accompaniment etude can include several performance versions, such as standard sound information from a standard performance, sound information from a version performed by an orchestra, and sound information from a digital performance.
[0040] In addition, the sound information for each part is stored separately, such as Part 1 being accompaniment sound information for soprano practice, Part 2 being accompaniment sound information for alto practice, Part 3 being accompaniment sound information for tenor practice, and Part 4 being accompaniment sound information for bass practice.
[0041] For the accompaniment for each part, in addition to the standard performance, multiple versions may be provided, such as piano accompaniment, orchestra accompaniment, digital sound accompaniment, etc. By providing multiple accompaniment versions in this way, the learner is encouraged to continue practicing voluntarily while having fun, practicing with piano accompaniment or orchestra accompaniment according to his / her own level of learning.
[0042] Similarly, for singing, the overall sound information and the sound information for each part are stored in the sound information recording means 21. The trainee may practice singing while listening to the singing sound information and refer to the singing. Also, the trainee may mute the sound information of the part he / she is practicing and practice while checking the overall balance by matching his / her voice with the sounds of the other parts. In this way, the present invention is configured to allow the trainee to freely select the style he / she wants to practice from the sound information.
[0043] For example, in addition to the sound information of a standard model singing (model singing), the overall sound information of the singing may be created and stored separately for a mixed male and female choir version, a male-only choir version, a female-only choir version, etc. Then, as the singing sound information for each part, the singing sound information for soprano practice in part 1, the singing sound information for alto practice in part 2, the singing sound information for tenor practice in part 3, and the singing sound information for bass practice in part 4 are stored.
[0044] Furthermore, in addition to the standard singing sound information, each part can also store multiple model singing (model singing), such as those by a teacher, a professional male musician, a professional female musician, etc. By providing such variations, trainees can synthesize the audio information of their own singing with the accompaniment of a full-scale orchestra and the singing of a professional musician, and enjoy a full-scale chorus. This fosters a desire to improve, and also gives a sense of accomplishment from a realistic synthesis record that includes their own singing voice.
[0045] In educational settings, teaching materials that children, pupils, students, etc. (hereinafter referred to as "trainees") learn aloud include sound information that is the source of the learning. If sound information that has previously been provided by instructors is stored as data in the sound information recording means 21, the learning support device 1 of the present invention can be used for any type of learning and will demonstrate excellent effects. Note that the types and variations of sound information described above are examples, and the sound information recording means 21 can store any sound information data required for learning.
[0046] [Audio information] In the present invention, audio information refers to the audio produced by a trainee for practice. This may be a song or a foreign language pronunciation. When it is necessary to learn by producing audio, the audio produced for learning is considered to be audio information. In addition, in the present invention, depending on the subject of learning, for example, in the case of wind instrument practice, the sound produced by the instrument played by the trainee is also classified as audio information.
[0047] [Audio information recording means] The audio information recording means 23 is a means for recording and storing audio information generated in response to the audio information output by the sound output means 4. The audio information is information generated in response to audio information arbitrarily selected from the audio information stored in the audio information recording means 21.
[0048] The audio information is recorded by the audio recording means and stored in the audio information recording means 23. The timing of turning on and off the audio recording and video recording can be selected, and it is also possible to select only a portion of the audio recording and video recording. The audio recording data and video recording data of the audio information recorded and stored by the audio information recording means 23 are subject to the creation of composite information, as well as to judgment processing and linking processing, which will be described later.
[0049] As another example, an instructor can view the audio and video data stored in the audio information recording means 23 to check the trainee's learning status, or check the way the mouth opens and the movement of the lips when speaking. This makes it possible to provide instruction to each trainee. Therefore, not only general trainees, but also students who have been absent for a long time and students taking correspondence courses can receive the same instruction as if they were attending classes.
[0050] [Sound information selection means] The sound information selection means 3 is a means for selecting sound information to be used for practice from the sound information stored in the sound information recording means 21. In the present invention, the sound information output is configured to be selectable not only for one but for multiple items.
[0051] When practicing, for example, one can select "Etude 1" from the list of sound information displayed on the display unit 12 of the terminal, and then select from "Full accompaniment," "Singing by part," "Soprano" and "Bass," "Score by part," "Alto," "Singing video," "Soprano" and "Bass." When selected by the sound information selection means 3, the data of the corresponding sound information is loaded and can be played back.
[0052] The sound information selection means 3 may be configured to select from a hierarchical folder, or may be configured to select by clicking an icon image linked to sound information, or may be configured to select by voice, and the configuration of the execution instruction of the sound information selection means 3 is not particularly limited as long as it is configured to be easy for the trainee to select.
[0053] [Sound output means] The sound output means 4 is a means for outputting sound information selected by the sound information selection means 3 from among the sound information stored by the sound information recording means 21. In Fig. 1, this means corresponds to a speaker 41, an earphone output, etc. In the case of choral learning, the sound output means 4 reproduces sound information, and in the case of learning the pronunciation of words, a voice reading the relevant word is output.
[0054] [Volume adjustment means] The volume adjustment means 5 is a means for adjusting the volume of the sound information output by the sound output means 4, i.e., a volume control means. In the present invention, the adjustment of the volume by the volume adjustment means 5 can be set individually for each piece of sound information stored in the sound information recording means 21.
[0055] Therefore, when there are a plurality of pieces of sound information selected by the sound information selection means 3, it is possible to adjust the volume of each piece of sound information. Also, it is possible to adjust the volume of each piece of sound information during output (playback).
[0056] The volume control means 5 can also be set to mute. When set to mute, the sound information is not output, so for example, you can practice a part you want to practice while listening to the sound information at first, and then mute the sound halfway through. When a moving image is displayed as the audio information, the volume adjustment means 5 can be used to adjust and set not only the volume of the sound but also the start and stop of the display of the moving image from the middle.
[0057] [Output sound information recording means] The output sound information recording means 22 is a means for recording and storing sound information output by the sound output means 4. The sound information output by the sound output means 4 is the output of sound information stored in the sound information recording means 21. At the time of output, the volume can be adjusted, including muting, by the volume adjustment means 5. Therefore, the sound information output by the sound output means 4 differs from the sound information stored in the sound information recording means 21. Therefore, the output sound information recording means 22 records and stores the output sound information including these settings.
[0058] In addition, when sound information is output, various controls can be performed, such as displaying the musical score related to the sound information, displaying a singing video, lyrics, etc. When such controls are performed, it is also possible to record and save the settings of these controls in the output sound information recording means 22 as desired.
[0059] The output sound information stored in the output sound information recording means 22 can be used to create synthesis information, which will be described later, or as a preferred embodiment, can be used for linking processing, which will be described later. Furthermore, the sound information recorded in the output sound information recording means 22 can be called up the next time a practice session is held, and used for repeated practice.
[0060] Recording by the output sound information recording means 22 is performed according to settings. Therefore, recording can be performed only when it is desired to use the sound for synthesis or repetitive practice, or only the parts that are desired to be saved can be recorded and saved as output sound information.
[0061] [Synthesis means] The synthesis means 7 is a means for synthesizing any sound information stored in the output sound information recording means 22 or sound information stored in the sound information recording means 21 with the sound information stored in the sound information recording means 23. The output sound information recording means 22 records and stores each output sound information, and the sound information recording means 21 also records and stores various sound information. Among them, any output sound information or sound information is synthesized by the synthesis means 7 with the sound information uttered by the trainee.
[0062] The method of synthesizing the sound information and the voice information can be a known voice synthesis method, and may be a method of synthesizing by adjusting based on the time code of the sound information and the voice information, or a method of synthesizing by synchronizing based on the waveform. If the sound information and the voice information are saved starting from the output time of the sound information so that the trainee can easily synthesize them, it is preferable that they can be synchronized on the same time axis and synthesized into one.
[0063] The synthesis means 7 can combine multiple sound information, output sound information, and voice information to create synthesis information of any combination, such as synthesis of singing only or synthesis of singing video. For example, synthesis information that sounds like singing in a chorus with professional musicians can be created.
[0064] In addition, if the learning terminal has a communication function, trainees can set each other's voice information recording means 23 to be accessible, so that they can synthesize the voice information of other trainees. In this case, for example, in music learning, synthesized information can be obtained as if the trainees were singing together with other trainees. In this case, the communication function is not particularly limited, and may be a wired, wireless, Internet line, intranet line, LAN, etc. that can transmit and receive information between learning terminals or upload information to a server.
[0065] [Synthetic information recording means] The synthesis information recording means 24 is a means for recording and storing the synthesis information synthesized by the synthesis means 7. By checking the synthesis information recorded in the synthesis information recording means 24, problems with the voice information, in other words, good and bad points, can be objectively viewed. This makes it easy for the trainee to find areas that need particular practice. Instructors can also check and evaluate the synthesis information.
[0066] [Determination Means and Determination Result Recording Means] The learning support device 1 in the present invention preferably includes a judgment means 8 and a judgment result recording means 25. The judgment means 8 is a means for judging the voice information recorded and stored in the voice information recording means 23, which is generated corresponding to the sound information, based on a predetermined threshold value set for one or a plurality of judgment items, using the sound information stored in the sound information recording means 21 or the output sound information recording means 22 as a judgment criterion.
[0067] That is, it is a means for making a judgment between model sound information and speech information practiced using the model sound information. For example, items to be judged may be determined in advance, and a threshold value may be set for each item to make a judgment.
[0068] Fig. 4 is an explanatory diagram of an example of judgment in the learning support device according to the present invention. In Fig. 4, the sound information indicates the pronunciation of the model pitch in the blackened parts. The audio information indicates the pitch that matches the model pitch in the blackened parts. The lightly shaded parts indicate pitches that are different from the model pitch.
[0069] The first sound to the fifteenth sound of the sound information are used as the judgment criteria, and the first sound to the fifteenth sound of the audio information are judged by the judgment means 8. As a result, the second sound and the sixth sound are deviated from the judgment criteria by -2, the tenth sound is deviated from the judgment criteria by +1, and the eleventh sound and the fourteenth sound are deviated by -1.
[0070] 4, the judgment means 8 judges a match with the judgment criteria as an A judgment, a deviation of 1 as a B judgment, and a deviation of 2 as a C judgment. Therefore, the judgment results are that the second and sixth sounds are judged as a C judgment, and the tenth, eleventh, and fourteenth sounds are judged as a B judgment.
[0071] The judgment result recording means 25 records and stores the judgment result. The judgment by the judgment means 8 is set so that the criteria, judgment items, etc. can be appropriately changed.
[0072] [Stringing means] The judgment result stored in the judgment result recording means 25 is linked to the sound information or voice information output by the sound output means 4. Then, the linking means 9 links the judgment result in order to execute a process for displaying the judgment result on the display unit 12 when the sound information is output or when the voice information or synthetic information is played back. This is to reflect the information on the judgment result in the corresponding portion of the sound information, voice information or synthetic information in order to utilize it for subsequent learning.
[0073] For example, a configuration may be adopted in which, among the parts linked by the linking means 9, a predetermined comment is displayed on the display unit 12 at a part where the judgment result exceeds a threshold. For example, in the case of singing, a part where the judgment result exceeds a threshold is a part in the song where the pitch is off by more than the threshold. Also, a configuration may be adopted in which a comment is displayed on the display unit 12 at a part where the judgment result shows a succession of A judgments where the pitch matches. In the case of singing, a part where the judgment result shows a succession of A judgments where the pitch matches is a part where the singing is done well.
[0074] In the example shown in Figure 4, the third to fifth notes are judged as A, so the display shows that the singing is done well, and is linked to the synthesis information and displayed as a comment when the synthesis information is played back. Also, the tenth and eleventh notes are judged as B, so a comment is displayed on the display when the synthesis information is played back, to help the viewer recognize that this is a section where the pitch is likely to be off.
[0075] In this way, the linking means 9 links the judgment result judged by the judging means 8 and recorded and stored in the judgment result recording means 25 to the sound information, voice information, synthesis information, etc. output by the sound output means 4. This makes it possible to present comments reflecting the judgment result when these are output or played back. Therefore, the trainee can continue practicing as if he or she were receiving private instruction.
[0076] In addition, if the object to be linked is model sound information, the next time that sound information is selected and played back, a comment can be displayed at the relevant location. The comment is not limited to being displayed in text form, and may be, for example, a predetermined warning (attention-calling) sound that calls attention, or a mark that serves as a marker displayed on the screen. In short, a configuration is adopted that can recognize the areas that need to be practiced and the areas that are being vocalized well.
[0077] The comments can be set so that a highly versatile comment is automatically displayed by the linking means 9 based on the result of the judgment made based on the judgment criteria previously determined by the judgment means 8. In addition, the instructor can set arbitrary judgment criteria and evaluation criteria, and when a certain judgment result is recorded in the judgment result recording means 25, the instructor can be prompted to input a comment in the corresponding location.
[0078] In this case, the part where the comment is displayed can be selected at will. At that time, it is also possible to input advice useful for practice as a comment by referring to information that cannot be determined by the determination means 8, for example, a video recorded during singing and stored in the audio information recording means 23. When giving advice that is difficult to give in text form, the instructor may create a video and control which video can be viewed in the comment section. By using the learning support device 1 in this way, it is possible to provide support similar to the guidance that an instructor would normally give to a trainee in an educational setting.
[0079] In addition, the following example can be given to utilize the judgment results in future learning. If it is analyzed that the cause of the part judged as B or C was influenced by the singing of other parts, the result can be linked to the sound information of the practice target. Then, at the next practice, it is possible to support learning by temporarily lowering or raising the singing volume of the other parts that were influenced by the part judged as B or C.
[0080] The judgment means 8 judges the sound information and the voice information with respect to the predetermined judgment items. For this reason, it is assumed that the judgment items include a judgment item for judging the pitch deviation and analyzing how many of the deviations match with the sounds of other parts. For example, if it is analyzed that 60% or more of the deviations match with the sounds of a specific other part, it is judged that the deviations in pitch, judged as B and C, are due to the influence of the singing of the other parts.
[0081] Based on the result of the judgment, the part where the pitch is off can be linked to display a comment to pay attention to the singing of other parts. In addition, by linking information to lower the singing volume of other parts during playback, for example, the judgment result can be used more effectively, and it becomes easier to concentrate on practicing the part where you are not singing well.
[0082] Next, a learning support method using the learning support device 1 according to the present invention will be described with reference to the drawings. Fig. 5 is a flow chart showing an embodiment of the learning support method according to the present invention.
[0083] First, one or more pieces of sound information are selected by the sound information selection means 3 from a plurality of pieces of sound information to be practiced that are stored in the sound information recording means 21 (step 1).
[0084] In this case, the necessary sound information is selected depending on the content of the practice. When practicing soprano singing in music studies, the sound information to be selected is the entire accompaniment or accompaniment for soprano. If one wishes to practice only the soprano without being influenced by other parts, one does not select a part and only selects the accompaniment. If one wishes to practice while listening to model singing (exemplary singing), one selects sound information for soprano singing. If one wishes to practice together with the singing of other parts, one selects singing of parts other than soprano.
[0085] In addition, other information stored in the sound information recording means 21 is also selected. For example, if a trainee wishes to practice while watching a singing video, he / she selects the soprano singing video stored in the sound information recording means 21 (see FIG. 3). In addition, if a trainee wishes to display the musical score for the singing part, he / she selects the musical score for soprano from the sound information. Such selection of sound information can be made according to the content that the trainee wishes to practice, and the training environment is prepared actively rather than passively.
[0086] Next, when sound information is selected by the sound information selection means 3, the sound information is read from the sound information recording means 21. The read sound information is then adjusted and set as the volume to be output from the sound output means 4 by the volume adjustment means 5 (step 2). Note that since the volume of the sound information can be adjusted arbitrarily while it is being output, the volume adjustment here is the initial setting.
[0087] Therefore, if you want to practice with the sound information of other parts from the middle of the lesson, the initial setting is muted. When you reach the part you want to practice together, you can manually increase the volume. Also, if you have selected a singing video as the sound information, and you want to watch the video but do not want to sing, you can set the sound to muted first. If you plan to change the speed or musical notation in addition to the volume, adjust these settings as well.
[0088] Then, the selected sound information is output by the sound output means 4 (step 3). The sound output means 4 may be a speaker or an earphone, etc., and is output by a means that is easy for the trainee to use in practice.
[0089] The output information of the selected sound information is recorded and stored in the output sound information recording means 22 (step 4). At that time, the volume settings and speed adjustment settings that have been set or changed for each piece of sound information may also be stored. In this way, when practicing repeatedly, by first selecting the output sound information recorded and stored in the output sound information recording means 22, repeated practice is possible without having to set the same volume multiple times.
[0090] At the same time that the output sound information is recorded and stored in the output sound information recording means 22, the voice information emitted corresponding to the selected sound information is recorded and stored in the voice information recording means 23 (step 5). This is the recording and storage of the voice portion emitted by the trainee practicing using the sound information. The voice information recording means 23 can record not only the singing alone, but also a video recording of the singing that shows the mouth movements while singing, and these can be set by the trainee at his / her discretion.
[0091] Then, the arbitrary sound information stored in the output sound information recording means 22 and the voice information stored in the voice information recording means 23 are synthesized by the synthesis means 7 (step 6). Note that the sound information to be synthesized with the voice information may not be the output sound information, but may be model sound information stored in the sound information recording means 21. For example, in the case of learning music, if a person sings well, synthesis information similar to that of a full chorus can be created by synthesizing the sound information of the singing of the other parts with the voice information that was only the accompaniment of the part being practiced during practice.
[0092] The synthesis process in step 6 is not essential, and the voice information alone may be recorded and saved without being synthesized with the sound information. In this way, when practicing, if you practice singing other parts as sound information and feel that you cannot harmonize well with the other parts, you can look back and check your own singing recorded in the voice information.
[0093] Thereafter, the synthesized information synthesized by the synthesis means 7 is recorded and stored in the synthesized information recording means 24 (step 7). If the synthesized information stored in the synthesized information recording means 24 can be viewed not only by the trainee but also by the instructor and other trainees, the instructor can individually check to what extent the trainee has achieved the learning goal, whether there are any stumbling blocks in the practice, etc., and can provide guidance as necessary.
[0094] In addition, if other trainees can view the synthesized information, they can check the progress of the other trainees. If they can check in this way, they can be motivated and encouraged to practice, just as if they were practicing together nearby.
[0095] In the learning support method using the learning support device 1 of the present invention, it is preferable to judge the voice information to assist in learning support. The judgment process by the judgment means 8 of the learning support device 1 according to the present invention uses the voice information recorded and stored in the voice information recording means 23, which is generated in response to the sound information, and the sound information stored in the sound information recording means 21 as the judgment criterion, and judges based on a predetermined threshold value set for one or more judgment items.
[0096] 6 is a flow chart for explaining the judgment process in the embodiment of the learning support device according to the present invention. Since the judgment process is executed at any timing, the judgment means 8 is started as necessary (step 21). The judgment means 8 acquires the voice information to be judged from the voice information recording means 23 (step 22).
[0097] Next, sound information that will be the basis for the judgment is acquired (step 23). In the initial setting, the sound information that will be the basis for the judgment is the accompaniment and musical score that are modeled after the voice information to be judged, but the judgment process can be performed by changing the sound information to any desired sound information.
[0098] Then, in the judgment process, the judgment items in the voice information are confirmed (step 24). If there is a judgment item (step 24, YES), when the sound information is used as a criterion for that item, it is calculated whether the voice information exceeds a predetermined threshold (step 25).
[0099] If the threshold is exceeded (step 25, YES), the judgment result is recorded in the judgment result recording means 25 as, for example, an "A" judgment (step 26). If the threshold is not exceeded (step 25, NO), the judgment result is recorded in the judgment result recording means 25 as a "B" judgment (step 27). On the other hand, if there is no judgment item (step 24, NO), the process proceeds to step 29.
[0100] Then, it is checked whether there are any other judgment items (step 28), and if there are not (step 28, NO), all judgment results are recorded and stored in the judgment result recording means 25 (step 29) and then the process ends. If there are other judgment items (step 28, YES), the process returns to step 24, judgments are made on the other judgment items, and the same process is repeated until there are no more judgment items.
[0101] The judgment results by the judgment means 8 of the learning support device 1 of the present invention are compared with model sound information to analyze problem areas such as differences or deviations in the sounds produced and whether the sounds have been mastered sufficiently well, making it possible to recognize the learning status from an objective point of view.
[0102] However, even if a judgment process is performed, the effect of the judgment cannot be fully achieved unless the judgment process is utilized. Therefore, the learning support device 1 according to the present invention provides a method of support that makes learning easier by linking the judgment results recorded and stored in the judgment result recording means 25 with the voice information and the synthesis information.
[0103] 7 is a flow chart for explaining the linking process in the embodiment of the learning support device according to the present invention. Since it is optional whether or not to perform the linking process, the linking means 9 is started as necessary (step 31).
[0104] The linking means 9 obtains the judgment result obtained by the judgment means 8 from the judgment result recording means 25 (step 32). Next, information to be linked to the judgment result is selected from sound information, voice information, and synthesis information, and is read and obtained (step 33).
[0105] Then, the selected and acquired information, for example, the synthesis information, is linked to the judgment result (step 34). The linking is performed in accordance with the judgment means, and for example, when the judgment is performed based on whether the model sound information and the voice information match sound by sound, the linking is also processed sound by sound.
[0106] If the linking result is compared with the requirements for whether or not a comment should be added to the trainee's knowledge (step 35), and the requirements are not met, i.e., there are no special circumstances for adding a comment (step 35, not met), the linking process ends.
[0107] If the requirements for adding a comment are met (step 35, met), the comment to be added is selected (step 36). In step 36, if comments are prepared in advance for each requirement for which a comment should be added, the comment is automatically selected.
[0108] The selected comment is then linked to the relevant portion of any one or all of the sound information, voice information, and / or synthetic information (step 37). The linked comment is controlled so that the comment is displayed at the linked portion when any one of the sound information, voice information, and synthetic information is output or reproduced, for example, when it is output by the output means for practice, or when the synthetic information or voice information is reproduced for review (step 38).
[0109] When musical scores are displayed on the display unit 12, the comments may be displayed so as to overlap the display of the musical scores, and when lyrics are displayed on the display unit, the comments may be displayed so as to overlap the relevant portion of the lyrics. Furthermore, the comments are not limited to text; for example, when a judgment C is followed and lyrics corresponding to a portion requiring attention to pitch are displayed in a particular color, or the font size is made larger to make them more noticeable and serve as a marker to call attention to the comment, which will have the same effect as displaying a comment.
[0110] By linking the results in this way, the next time you practice, you can use the results to learn without having to check the results one by one. This allows you to repeatedly practice while being aware of the parts you are not good at singing, so you can naturally achieve your learning goal.
[0111] 〔program〕 The sound information learning support program according to the present invention is a program for supporting learning of sound information such as reading out a piece of music or a sentence, or pronunciation of a word, and includes a sound information selection means 3 for selecting one or more pieces of sound information; a sound output means for outputting the sound information selected by the sound information selection means; a volume control means 5 for controlling the volume of sound information output by the sound output means 4; an output sound information recording means 22 for recording and storing the sound information output by the sound output means 4; a voice information recording means 23 for recording and storing voice information generated in response to the sound information output by the sound output means 4; A synthesis means 7 for synthesizing any sound information stored in the output sound information recording means 22 and voice information stored in the voice information recording means 23; A synthesis information recording means 24 for recording and storing the synthesis information synthesized by the synthesis means 7; Due to The sound information required for practice is selected, the volume is adjusted, the sound information is output, and stored by the output sound information recording means 22. The voice information is generated corresponding to the sound information and stored by the voice information recording means 23. The synthesis information recording means 24 is operated to synthesize the sound information by the synthesis means 7, record the sound information, and store the synthesized information.
[0112] Furthermore, the sound information learning support program according to the present invention uses, as a judgment criterion, sound information recorded in the sound information recording means 23 that is emitted in response to the sound information stored in the output sound information recording means 22. Then, the judgment means 8 makes a judgment based on a predetermined threshold value set for one or more judgment items, and causes the judgment result recording means 25 to function to record and store the judgment result.
[0113] Furthermore, the learning assistance program causes a linking means 9 to function, which links the result of the judgment by the judgment means 8 to the sound information or voice information output by the sound output means 4, and executes processing to display the judgment result on the display unit 12 when the sound information is output or the voice information is played back.
[0114] Each means of the learning support program performs the same functions as those described for the learning support device 1, and the present invention constitutes a program for realizing the functions of the embodiment. The object of the present invention can also be achieved by storing a recording medium on which the program is recorded in a system or device and reading and executing the program.
[0115] In this case, the program itself read from the recording medium realizes the novel functions of the present invention, and the recording medium on which the program is recorded constitutes the present invention. As a recording medium for supplying the program, for example, a hard disk, an optical disk, a CD-ROM, a DVD-ROM, a ROM, etc. can be used.
[0116] Fig. 8 is an explanatory diagram showing an example of a learning support device according to the present invention, which is displayed on a learning terminal. In Fig. 8, the learning support device 1 includes a sound information selection button 31 which executes a sound information selection means 3 for selecting sound information stored in a sound information recording means 21 which stores a plurality of pieces of sound information to be practiced, a speaker 41 which executes a sound output means 4 which outputs sound information selected by the sound information selection means 3, a volume control 51 which executes a volume adjustment means 5 which adjusts the volume of sound information output by the sound output means 4, including muting, a video record button 13a and a sound record button 13b which execute an output sound information recording means 22 which respectively records and stores the sound information output by the sound output means 4, video record buttons 230a and 230b which execute a sound information recording means 23 which records and stores the sound information generated in response to the sound information output by the sound output means 4, a microphone 61 as a sound input means 6, and a display unit 12 and an operation unit 11 of the learning terminal.
[0117] It is further configured with a synthesis button 70 which executes synthesis means 7 which synthesizes any sound information stored in the output sound information recording means 22 and the voice information stored in the voice information recording means 23, a judgment button 80 which executes the processing of judgment means 8, and a linking button 90 which executes the processing of linking means 9.
[0118] In the example shown in Fig. 8, the sound information to be used for practice is selected with the sound information selection button 31. In the drawing, the sound information 30 selected is "professional tenor" singing sound information 30, "professional soprano" singing sound information, and "professional bass" singing sound information, and the overall accompaniment sound information is ON. In this embodiment, the selection of sound information can be selected with the sound information selection button 31. Then, a video or display showing the selected sound information is displayed on the sound information selection button 31, making it clear at a glance which sound information is currently being used. And, since the student is practicing the alto, the background of the sound information selection button 31 is darkened to make it easier to see the sound information that the student is practicing.
[0119] Display unit 12 displays a video of a professional singing in each sound information column, and is provided with a video record button 13a and a sound record button 4 for recording the singing. In the drawing, sound record button 13a for the video is ON. On the other hand, the audio information selection button 31 displaying the trainee includes a video recording button 230a and a sound recording button 230b for recording the trainee's audio information, and in the drawing, the video recording button 230a is ON. The video recording button 13a, the video recording button 230a, the sound recording button 13b, and the sound recording button 230b can be turned on or off during the performance of the accompaniment or during singing practice, so if you want to record suddenly, start recording with the video recording button 13a, and when you want to stop recording, press the video recording button 13a again to stop it. Similarly, if you want to record only singing, start recording with the video recording button 13b, and when you want to stop it, press the video recording button 13b again.
[0120] In addition, on the display unit 12, a volume control bar 51 for executing the volume adjustment means 5 is disposed above each piece of sound information 30. Therefore, for each piece of sound information 30 for which the volume is to be adjusted, the volume can be adjusted by using the volume control bar above.
[0121] In Fig. 8, the tenor, soprano and bass parts of the sound information are set to maximum volume, and only the alto part is muted. Therefore, a trainee can practice singing the alto part while listening to the singing of the other parts.
[0122] In addition, the operation unit 11 is provided with a synthesis button 70 for executing the synthesis means 7, a determination button 80 for executing the process of the determination means 8, and a linking button 90 for executing the process of the linking means 9, so that each process can be easily operated. The lyrics selected by the sound information are displayed on the display unit 12. When a musical score is selected by the sound information, the designated score can be displayed in this area so that it is easy to see during practice.
[0123] Fig. 9 is an explanatory diagram showing an example of display on a learning terminal in another embodiment of the learning support device according to the present invention. Fig. 9 shows an example in which the voice information generated in response to the sound information and recorded and stored in the voice information recording means 23 is used as a judgment criterion for the sound information stored in the sound information recording means 21, the result of the judgment by the judgment means 8 is linked to the voice information, and the judgment result is displayed on the display unit when the voice information is played back, and a comment 14 is displayed by the linking means 9.
[0124] In the example shown in Fig. 9, the part where the pitch is off is displayed on the display unit 12, and a comment 14 from the instructor is displayed, such as "The pitch is low, so try tightening your abdominal muscles a little more." In this way, by visualizing the judgment results of the audio information from the previous practice on the display surface, the trainee's anxiety is eliminated, and the trainee feels as if he or she is receiving personal instruction, which makes it easier for the trainee to take the learning more seriously. [Industrial Applicability]
[0125] The learning support device and learning support method according to the present invention can be used in educational settings related to sound information where multiple people need to learn at the same time. Students can repeatedly practice what they want to practice by setting it in a way that is most convenient for them, and their learning progress can be objectively grasped.
[0126] Although the example was explained using the system for music learning, the sound information can be used not only for music, but also for learning foreign languages and learning classical literature. It can be used in various subjects because it is easy to practice and teach model sound information in advance. In addition, if the learning terminal is equipped with a communication function and an environment is created where information is shared on a server, it is possible to create synthetic information that makes it seem as if you are practicing together with overseas trainees regardless of distance, and the range of applications is thought to be endless. [Explanation of symbols]
[0127] 1. Learning support device 2. Information Recording Section 21 Sound information recording means 22 Output sound information recording means 23 Audio information recording means 24. Means of recording synthetic information 25. Recording means for judgment results 3. Sound information selection method 4. Sound output means 41 Speaker 5 Volume adjustment means 6. Voice input means 61 Mike 7 Synthesis means 70 Composite Button 8 Judgment means 80 Judgment button 9 Linking means 90 String Button 10 Control section 11 Control section 12 Display section 13. Sound and video recording means 13a Record button 13b Record button 14 Comments
Claims
1. A sound information recording means for storing a plurality of pieces of sound information to be practiced; a sound information selection means for selecting one or more pieces of sound information stored by the sound information recording means; a sound output means for outputting the sound information selected by the sound information selection means; a volume adjustment means for adjusting the volume of the sound information output by the sound output means, including muting the sound; an output sound information recording means for recording and storing the sound information output by the sound output means; a voice information recording means for recording and storing voice information generated in response to the sound information output by the sound output means; a synthesis means for synthesizing any sound information stored in the output sound information recording means and voice information stored in the voice information recording means; A synthesis information recording means for recording and storing synthesis information synthesized by the synthesis means; a judgment means for judging the voice information recorded and stored in the voice information recording means, which is generated in response to the sound information, based on a predetermined threshold value set for one or more judgment items, with the sound information stored in the sound information recording means as a judgment criterion; A determination result recording means for recording and storing the determination result by the determination means; a linking means for linking the judgment result stored in the judgment result recording means to the sound information or the voice information output by the sound output means, and for executing a process for recognizably displaying the judgment result on a display unit at a position where the same judgment result occurs consecutively in any one of the sound information, the voice information, or the composite information when the sound information is output or when the voice information or the composite information is reproduced; A learning support device for sound information comprising:
2. The sound information learning support device according to claim 1 , wherein the associating means executes a process for displaying a plurality of judgment results corresponding to deviations from the judgment criterion on a display unit in a recognizable manner.
3. The judgment criteria set by the judgment means can be arbitrarily set, 2. The sound information learning support device according to claim 1, wherein the linking means executes a process for prompting input of a comment in a corresponding location when the judgment result does not match an arbitrary judgment criterion.
4. 4. The sound information learning support device according to claim 3, wherein the comment includes information that cannot be determined by the determination means.
5. The sound information learning support device according to any one of claims 1 to 4, wherein the sound information is one or more pieces of sound information selected from accompaniment for the entire piece of music, accompaniment for each part, and singing for each part including chorus, lead, tenor, soprano, alto, and bass, and the voice information is singing produced by a trainee.
6. 2. The learning support device for sound information according to claim 1, wherein the sound information is a reading of a sentence, and the voice information is a voice uttered by a trainee.
7. A step (step 1) of selecting one or more pieces of sound information by a sound information selection means (3) from a plurality of pieces of sound information to be practiced that are stored in a sound information recording means (21); A step (step 2) of adjusting and setting the volume of the selected sound information output from the sound output means (4) by a volume adjustment means (5); a step (step 3) of outputting the selected sound information by a sound output means (4); a step (step 4) of recording and storing the output information of the selected sound information in an output sound information recording means (22); a step (step 5) of recording and storing voice information corresponding to the selected sound information in a voice information recording means (23); A step (step 6) of synthesizing any sound information stored in the output sound information recording means (22) and voice information stored in the voice information recording means (23) by a synthesis means (7); A step (step 7) of recording and storing the composite information synthesized by the synthesis means in a composite information recording means (24); a step (step 8) of judging the voice information recorded and stored in the voice information recording means (23) that is generated in response to the sound information, based on the sound information stored in the sound information recording means (21) as a judgment criterion and on a predetermined threshold value set for one or more judgment items; A step of recording and storing the judgment result (step 9); a step (step 10) of executing a process for linking the judgment result to the sound information or the voice information output by the sound output means (4) and recognizably displaying the judgment result on a display unit at a location where the same judgment result occurs consecutively in any one of the sound information, the voice information, or the composite information when the sound information is output or when the voice information or the composite information is reproduced; A method for supporting learning of sound information, comprising:
8. A learning support program for audio information including reading out music and text and pronunciation of words, a sound information selection means for selecting one or more pieces of sound information; a sound output means for outputting the sound information selected by the sound information selection means; a volume control means for muting the sound information output by the sound output means; an output sound information recording means for recording and storing the sound information output by the sound output means; a voice information recording means for recording and storing voice information generated corresponding to the sound information output by the sound output means; a synthesis means for synthesizing any sound information stored in the output sound information recording means and voice information stored in the voice information recording means; a synthesis information recording means for recording and storing synthesis information synthesized by the synthesis means; Due to a synthesis information recording means for synthesizing, by a synthesis means, the sound information necessary for practice, which is outputted after adjusting the volume, and which is stored by the output sound information recording means, and the voice information which is generated corresponding to the sound information and which is stored by the voice information recording means, and recording and storing the synthesized information recording means; a judgment means for judging the voice information recorded and stored in the voice information recording means, which is generated in response to the sound information, based on a predetermined threshold value set for one or more judgment items, with the sound information stored in the sound information recording means as a judgment criterion; Activating a judgment result recording means for recording and storing the judgment result by the judgment means; A learning support program for sound information, characterized in that the judgment result stored in the judgment result recording means is linked to the sound information or the voice information output by the sound output means, and when the sound information is output or when the voice information or the synthetic information is played back, the judgment result is displayed recognizably on a display unit at locations where the same judgment result occurs consecutively in any of the sound information, the voice information, or the synthetic information, by causing a linking means to function.
9. 9. A recording medium on which the sound information learning support program according to claim 8 is recorded.
Citation Information
Patent Citations
Pronunciation comparing learning device
JP1996016089A
Mixer and headphone amplifier
JP1999150783A
Learning device, pronunciation exercise device, their method, and record medium
JP1999212438A
Music joint practice device
JP2000163054A
Language education system, voice data processor, voice data processing method, voice data processing program, and recording medium
JP2003307997A
