Sound information learning support device, sound information learning support method, sound information learning support program and recording medium

The learning support device addresses the lack of individualized guidance in music and language practice by recording and synthesizing sound and voice information, offering adjustable volume settings and feedback, thereby improving vocalization and pronunciation skills.

JP2025104750AActive Publication Date: 2025-07-10中内 悠介
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2023222781
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-12-28
Publication Date
2025-07-10
Estimated Expiration
2043-12-28

AI Technical Summary

Technical Problem

Existing educational methods for music chorus practice and language pronunciation lack individualized guidance, making it difficult for trainees to objectively assess their performance and maintain concentration, leading to a lack of accurate vocalization and pronunciation skills.

Method used

A learning support device that records and synthesizes sound and voice information, allowing trainees to practice with adjustable volume settings, record their performance, and receive objective feedback on pitch and pronunciation, facilitating individualized learning.

Benefits of technology

Enables trainees to practice with personalized settings, receive accurate feedback, and maintain concentration, enhancing the learning experience by providing a sense of accomplishment and unity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025104750000001_ABST
    Figure 2025104750000001_ABST
Patent Text Reader

Abstract

To provide a sound information learning support device, sound information learning support method, sound information learning support program and recording medium for supporting learning sound information in an education site such as a practice for a musical chorus, practice for a language pronunciation and the like.SOLUTION: A sound information learning support device comprises: sound information recording means that stores a plurality of pieces of sound information targeted for a practice; sound information selection means that selects one or plurality of pieces of sound information stored by the sound information recording means; sound output means that outputs the sound information selected by the sound information selection means; volume adjustment means that adjusts volume including muted sound of the sound information output by the sound output means; output sound information recording means that stores the sound information to be output by sound output means respectively; sound information recording means that records and stores sound information to be output corresponding to the sound information output by the sound output means; synthesis means that synthesizes the arbitrary sound information stored in the output sound information recording means, and the sound information stored in the sound information recording means; and synthesis information recording means that stores synthesis information synthesized by the synthesis means.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a learning support device for sound information, a learning support method for sound information, a learning support program for sound information, and a recording medium for supporting learning of sound information in educational fields such as chorus of music, practice of instrumental music, and practice of pronunciation of languages.

Background Art

[0002] In educational fields, for example, in the practice of chorus of music or the practice of pronunciation of languages, usually, one instructor guides a number of trainees while having them vocalize simultaneously. Also, when practicing a choral piece with multiple parts, the sound of a part-practice CD is played, and the trainees are made to take the sound of the designated part and practice. For the pronunciation of foreign language words or the reading aloud of sentences, after the instructor vocalizes, the trainees imitate and vocalize to practice pronunciation.

[0003] Such guidance and practice are led by the instructor's vocalization. For the trainees, it is a passive form of guidance, and they do not particularly pay attention to the accuracy of vocalization, pitch, or pronunciation. Even if they are interested in vocalization or pronunciation, it is difficult to receive individual guidance in an educational field. They cannot judge whether they are vocalizing or pronouncing well, and they have few opportunities to acquire accurate vocalization, pitch, or pronunciation.

[0004] Also, the instructor wants the trainees to notice the accurate vocalization, pitch, pronunciation, and the joy and value of learning by acquiring them. However, it is not easy either temporally or physically to provide guidance while paying attention to each individual's practice.

[0005] As a means for solving such problems, for example, Patent Document 1 can be cited. Patent Document 1 discloses a technology related to an audio playback device capable of playing back performances suitable for chorus practice.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Disclosure of the Invention

Problems to be Solved by the Invention

[0007] The audio playback device described in Patent Document 1 includes a DVD on which a plurality of audio data is recorded, a playback unit that plays back the plurality of audio data recorded on the DVD, and a plurality of audio output units that output from the playback unit. A plurality of voices corresponding to the plurality of audio data recorded on the DVD are simultaneously output from the plurality of audio output units, and a configuration allows a plurality of voices to be listened to simultaneously. Thus, in the audio playback device described in Patent Document 1, the plurality of voices include the voices of each part of the chorus and the stereo voice of the chorus. Therefore, the audio playback device described in Patent Document 1 is a device that can simultaneously output the voices of each part of the chorus from different speakers and perform each part practice simultaneously.

[0008] Therefore, by using the audio playback device described in Patent Document 1, during chorus practice, in addition to the instructor's simultaneous guidance, the trainees can be divided into arbitrary parts and practice while playing back the accurate voice of that part.

[0009] However, in such a device, one simply practices the corresponding part while listening to it. And it is difficult for trainees to objectively observe their own situation and accurately grasp problems such as whether they are actually singing well or why they cannot sing well. Along with this, it is impossible to achieve learning (= individually optimized learning) that suits each person's understanding situation, ability, and appropriateness, which is required in the educational field.

[0010] In addition, chorus teaching materials are attractive teaching materials that allow people to learn the sense of unity and achievement generated by combining different voices of different parts of a single piece of music to create a harmony that cannot be achieved alone, and cultivate teamwork, concentration, etc. Simply repeating the assigned part alone in a monotonous practice will make one bored without realizing its value.

[0011] An object of the present invention is to provide a learning support device for sound information, a learning support method for sound information, a learning support program for sound information, and a recording medium for supporting learning of sound information in educational fields such as music chorus practice and language pronunciation practice.

Means for Solving the Problems

[0012] In view of the above problems, the present inventors have come up with means capable of realizing the following content. First, it is better to be able to objectively grasp the acquisition status so that the trainee can set what he / she wants to practice to the most easily practicable setting and repeat the practice. In addition, if there is a learning support device that can give a sense of accomplishment and unity, it will be easier for the instructor to grasp the learning status and results of the trainee, and the trainee can actually feel that he / she can accurately receive the instructor's guidance. In addition, it is better to be able to support learning without breaking concentration.

[0013] Typical configurations of the sound information learning support device, sound information learning support method, sound information learning support program, and recording medium according to the present invention that solve the above problems are as follows. Here, for ease of understanding of the present invention, reference numerals used in the drawings of the embodiments described later are attached, but the present invention is not limited to the configurations indicated by these reference numerals.

[0014] (1) Sound information recording means for storing a plurality of sound information to be practiced Sound information selection means for selecting one or a plurality of sound information stored in the sound information recording means Sound output means for outputting the sound information selected by the sound information selection means Volume adjustment means for adjusting the volume including muting of the sound information output by the sound output means Output sound information recording means for respectively recording and storing the sound information output by the sound output means Voice information recording means for recording and storing voice information uttered corresponding to the sound information output by the sound output means Combining means for combining any sound information stored in the output sound information recording means and the voice information stored in the voice information recording means A synthetic information recording means for recording and storing synthetic information synthesized by a synthetic means A learning support device for sound information, characterized by comprising the above.

[0015] (2) A determination means for determining the voice information recorded and stored in the voice information recording means issued corresponding to the sound information, based on the sound information stored in the sound information recording means as a determination criterion and a predetermined threshold value defined for one or more determination items; A determination result recording means for recording and storing the determination result by the determination means The learning support device for sound information according to (1) above, comprising the above.

[0016] (3) An association means for associating the determination result stored in the determination result recording means with the sound information or voice information output by the sound output means, and executing a process for displaying the determination result on the display unit when the sound information is output, or when the voice information or synthetic information is reproduced The learning support device for sound information according to (2) above, comprising the above.

[0017] (4) The learning support device for sound information according to any one of (1) to (3) above, wherein the sound information is one or more sound information selected from accompaniment in the whole piece of music, accompaniment for each part, chorus, lead, tenor, soprano, alto, bass, etc., and the voice information is the singing voice emitted by the trainee.

[0018] (5) The learning support device for sound information according to (1) above, wherein the sound information is the reading aloud of a text, and the voice information is the voice emitted by the trainee.

[0019] (6) A step (step 1) of selecting one or more sound information from a plurality of sound information to be practiced stored in the sound information recording means (21) by the sound information selection means (3); A step (step 2) of adjusting and setting the volume output from the sound output means (4) by the volume adjustment means (5) for the selected sound information; A step (step 3) of outputting the selected sound information by the sound output means (4); The step of recording and storing the output information of the selected sound information in the output sound information recording means (22) (step 4); The step of recording and storing the voice information emitted corresponding to the selected sound information in the voice information recording means (23) (step 5); The step of synthesizing, by the synthesizing means (7), any sound information stored in the output sound information recording means and the voice information stored in the voice information recording means (step 6); The step of recording and storing the synthesized information synthesized by the synthesizing means in the synthesized information recording means (24) (step 7); A method for assisting in the learning of sound information, characterized by comprising the above.

[0020] (7) A learning support program for sound information such as reading music and text, pronunciation of words, etc., Sound information selection means for selecting one or more pieces of sound information; Sound output means for outputting the sound information selected by the sound information selection means; Volume adjustment means including muting of the sound information output by the sound output means; Output sound information recording means for recording and storing the sound information output by the sound output means respectively; Voice information recording means for recording and storing the voice information emitted corresponding to the sound information output by the sound output means; Synthesizing means for synthesizing any sound information stored in the output sound information recording means and the voice information stored in the voice information recording means; Synthesized information recording means for recording and storing the synthesized information synthesized by the synthesizing means; By which, A learning support program for sound information, characterized by causing the synthesized information recording means to function so as to select the sound information necessary for practice, adjust the volume and output it, store the sound information stored by the output sound information recording means, and synthesize and record and store the voice information emitted corresponding to the sound information and stored by the voice information recording means by the synthesizing means.

[0021] (8) The voice information recorded in the voice information recording means corresponding to the sound information stored in the output sound information recording means, A learning support program for sound information according to (7) above, which uses sound information as a criterion for determination, determines by a recording information determination means based on a predetermined threshold value set for one or more determination items, and functions a determination result recording means for recording and storing the determination result.

[0022] (9) A learning support program for sound information according to (7) above, which functions an association means for executing a process for associating the result of determination by the recording information determination means with the sound information or voice information output by the sound output means and displaying the determination result on the display unit when the sound information is output or when the voice information is reproduced.

[0023] (10) A recording medium recording a learning support program for sound information, characterized in that the program according to any one of (7) to (9) above is recorded.

Effects of the Invention

[0024] According to the sound information learning support device, sound information learning support method, sound information learning support program, and recording medium according to the present invention, sound information to be used as a practice target is selected from a plurality of sound informations, voice information emitted corresponding to the sound information is recorded and stored, and the sound information and the voice information are synthesized by a synthesizing means. For this reason, what the trainee wants to practice is set to the most easily practicable setting by himself / herself, and the practice content can be recorded and stored. In addition, a synthesized recording combined with arbitrary sound information can also be created. Furthermore, since repeated practice can be performed in the same environment, the acquisition status can be objectively grasped, and in addition, learning support that can give a sense of accomplishment and unity can be provided. Furthermore, the volume can be adjusted for each sound information, and since it is recorded and stored for each output sound information, the combination can also be arbitrarily changed according to the practice content, so continuous learning is easy. In addition, the instructor can easily grasp the learning status and learning results of the trainee, and the trainee can receive guidance from the instructor accurately, as if receiving individual lessons, so that learning can be carried out without losing concentration, and repeated practice can be performed to achieve the learning goal.

Brief Description of the Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0026] A mode for carrying out the learning support device according to the present invention will be described based on the drawings of the embodiments. Note that, regarding the following embodiments of the invention, the shape, numerical conditions, etc. are merely preferred examples. Therefore, the present invention is not limited to the following embodiments, and many modifications can be made without departing from the scope of the configuration of the present invention and achieving the effects of the present invention.

[0027] 〔Functional Configuration〕 FIG. 1 is a block diagram for explaining the functional configuration of a learning support device 1 according to the present invention. The learning support device 1 includes an information recording unit 2. The information recording unit 2 includes a sound information recording means 21, an output sound information recording means 22, a voice information recording means 23, a synthesis information recording means 24, and a determination result recording means 25. Further, the learning support device 1 includes a sound information selection means 3, a sound output means 4, a speaker 41, a volume adjustment means 5, a voice input means 6, a microphone 61, a synthesis means 7, a determination means 8, an association means 9, a control unit 10, an operation unit 11, and a display unit 12.

[0028] As shown in FIG. 1, the learning support device 1 includes an information recording unit 2 having at least a sound information recording means 21, an output sound information recording means 22, a voice information recording means 23, and a synthesis information recording means 24, and is composed of a sound information selection means 3, a sound output means 4, a volume adjustment means 5, a voice input means 6, a synthesis means 7, an operation unit 11, a display unit 12, and a control unit 10. Each means is controlled by the control unit 10 and the learning support device 1 is executed. The learning support device 1 preferably includes a determination means 8 and an association means 9, and the information recording unit 2 includes a determination result recording means 25.

[0029] The configuration shown in FIG. 1 is an example. The information recording unit 2 may be stored in a learning device such as a device on which the learning support device 1 is executed or a portable terminal, or may be stored in a cloud server device on a network. The information recording unit 2 is composed of a ROM that stores an OS, an application program, etc., a RAM that serves as a work area, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various information, and the like. In this embodiment, it is stored in a tablet terminal on which the learning support device 1 is executed, and execution processing is performed by the control unit 10.

[0030] The control unit 10 includes a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and controls a program for executing the learning support device 1.

[0031] The aforementioned learning device is not particularly limited and may be an electronic terminal operated by a trainee, such as a smartphone, a tablet terminal, a computer device, etc. Further, in addition to the information recording unit 2 and the control unit 10, the learning device includes a speaker 41, a sound output means 4 such as a headphone terminal, a volume adjustment means 5 for adjusting the volume including muting, a voice input means 6 for the trainee to input voice, a recording means and a recording means 13 for recording and video-recording the output sound information and voice information, and further includes an operation unit 11 and a display unit 12.

[0032] The operation unit 11 may be a touch screen in which the display unit 12 and the touch panel are integrated. Further, it may be an input from a keyboard, an input by a pen, or an input by voice.

[0033] In the learning support device 1 according to the present invention, The sound information recording means 21 is a means for storing a plurality of pieces of sound information to be the subject of practice, The sound information selection means 3 is a means for selecting one or a plurality of pieces of sound information stored in the sound information recording means 21. And the sound output means 4 is a means for outputting the sound information selected by the sound information selection means 3, The volume adjustment means 5 is a means for adjusting the volume including muting of the sound information output by the sound output means 4. Further, the output sound information recording means 22 is a means for respectively recording and storing the sound information output by the sound output means 4, The voice information recording means 23 is a means for recording and storing the voice information uttered corresponding to the sound information output by the sound output means 4. And the synthesizing means 7 is a means for synthesizing any sound information stored in the output sound information recording means 22 and the voice information stored in the voice information recording means 23, The synthesized information recording means 24 is a means for recording and storing the synthesized information synthesized by the synthesizing means 7. Each means will be described in detail below.

[0034] 〔Sound Information〕 In the present invention, sound information includes all information related to sounds other than the voices emitted by trainees when the object to be learned is sound. Therefore, when learning to sing a chorus song, in addition to the overall accompaniment of the chorus song, the accompaniment for each part is also independent sound information, and the exemplary singing voices for each part that make up the chorus song are also independent sound information for each part. Also, information associated with these sound information, such as video data of shooting the exemplary singing for each part, video data of shooting expressions, mouth movements, body movements and gestures, the musical score of the entire piece, the musical score for each part, unique pitches, displays for taking rhythms, etc. are also regarded as sound information, and the data of these sound information are stored in the sound information recording means 21.

[0035] The above is the case of chorus learning, but the learning support device 1 according to the present invention is not limited thereto and enables various learning supports. In the case of music, it can support not only chorus learning but also instrumental music learning. Also, for example, when learning a foreign language, the voices of reading aloud the sentences for practice, the pronunciation of each word, the pronunciation of each clause, etc. are sound information, and the text information, pronunciation symbol information, video information of mouth movements during pronunciation, etc. associated with these are also regarded as sound information, and the data of these sound information are selectively stored in the sound information recording means 21 respectively.

[0036] 〔Sound Information Recording Means〕 The sound information recording means 21 is a means for digitizing and storing in advance the sound information to be practiced, and is configured such that a trainee can select any sound information to be practiced from the sound information recording means 21 for practice. Also, the sound information data stored in the sound information recording means 21 is also used for the composite recording in which it is combined with the corresponding voice information, that is, the voice information data emitted by the trainee and stored.

[0037] Figures 2 and 3 are explanatory diagrams showing an example of the hierarchical structure of the sound information recording means 21 in an embodiment of the learning support device 1 according to the present invention. The embodiments of Figures 2 and 3 are an example in the case of choral learning, and are represented in a hierarchical structure to aid understanding. However, the recording structure of the sound information is not limited to the hierarchical structure shown in the figures, and any structure that allows the trainee to arbitrarily select various sound information may be used.

[0038] A plurality of practice pieces to be practiced are stored in the sound information recording means 21. For each practice piece, data of sound information such as accompaniment, singing (voice), sheet music, singing, and performance video are stored so as to be readable and reproducible.

[0039] The sound information of accompaniment, singing (voice), sheet music, singing, and performance video stores the sound information of the entire practice piece and the sound information for each part respectively. For example, as the sound information of the entire practice piece of accompaniment, several performance versions can be provided, such as standard sound information by standard performance, sound information of the version performed by an orchestra, and sound information by digital performance.

[0040] Also, the sound information for each part is stored separately by part, such as the sound information of the accompaniment for practicing soprano as part 1, the sound information of the accompaniment for practicing alto as part 2, the sound information of the accompaniment for practicing tenor as part 3, and the sound information of the accompaniment for practicing bass as part 4.

[0041] For the accompaniment for each part, multiple versions may be provided, such as accompaniment by piano, accompaniment by orchestra, and accompaniment by digital sound, in addition to the standard performance. By providing such multiple accompaniment versions, it encourages the trainee to continue practicing spontaneously while enjoying it, such as practicing with piano accompaniment or practicing with orchestra accompaniment according to their own level of acquisition.

[0042] Similarly, regarding singing, the overall sound information and the sound information for each part are stored in the sound information recording means 21. The sound information of singing may be practiced while listening with reference to one's own singing. Also, the sound information of the part one is practicing may be muted, and one may practice while combining the sounds of other parts and one's own voice to check the overall balance. Thus, in the present invention, the configuration is such that a trainee can arbitrarily select the style they want to practice from the sound information.

[0043] For example, in the overall sound information of singing, in addition to the sound information of a standard exemplary singing (model singing), the sound information may be created and stored separately into versions such as a mixed male and female chorus version, a male chorus only version, a female chorus only version, etc. And as the sound information of singing for each part, the sound information of singing for soprano practice in part 1, the sound information of singing for alto practice in part 2, the sound information of singing for tenor practice in part 3, and the sound information of singing for bass practice in part 4 are stored respectively according to the parts.

[0044] Furthermore, for each part, in addition to the standard singing sound information, it is also possible to store a plurality of exemplary singings (model singings) such as those by the instructor, those by professional male musicians, those by professional female musicians, etc. By providing such variations, a trainee can also synthesize the voice information they sang with that of a full-scale orchestra accompaniment and the singing of professional musicians, and experience a full-scale chorus. Along with this, it can cultivate the aspiration to become better, and one can also experience a sense of achievement through a synthetic recording full of a sense of presence including one's own singing voice.

[0045] In the educational field, for teaching materials for children, students, pupils, etc. (hereinafter referred to as "trainees") to learn by making sounds, there is sound information that serves as the basis for their learning. If the sound information provided by the instructor so far is stored as data in the sound information recording means 21, the learning support device 1 according to the present invention can be used for all learning and exhibits excellent effects. Note that the types and variations of the above sound information are examples, and the sound information recording means 21 can store data of any sound information required for learning.

[0046] 〔Voice information〕 In the present invention, voice information is the voice emitted by a trainee learning for practice. This can be a song or a foreign language pronunciation. When it is necessary to learn by making a sound, that sound emitted for learning is regarded as voice information. Also, in the present invention, depending on the learning object, for example, in the case of practicing wind instruments, the sound emitted by the instrument played by the trainee is also classified as voice information.

[0047] 〔Voice information recording means〕 The voice information recording means 23 is a means for recording and storing voice information emitted corresponding to the sound information output by the sound output means 4. The voice information is information emitted corresponding to the sound information arbitrarily selected from the sound information stored in the sound information recording means 21.

[0048] The voice information is recorded by a recording means or a video recording means and stored in the voice information recording means 23. The ON / OFF timing of recording and video recording can be selected, and it is also possible to select only partial recording or video recording. The recording data and video recording data of the voice information recorded and stored by the voice information recording means 23 are targets for creating composite information, determination processing, and association processing, which will be described later.

[0049] Additionally, as another example, for instance, an instructor views the recorded data or video data stored in the audio information recording means 23 to check the learning status of the trainees, or checks the way of opening the mouth and the movement of the lips when speaking. This enables individualized instruction for each trainee. Therefore, not only ordinary trainees but also students with long-term absences or students under distance learning can receive the same kind of instruction as if they were participating in the class.

[0050] 〔Audio Information Selection Means〕 The audio information selection means 3 is a means for selecting the audio information to be used in practice from among the audio information stored in the audio information recording means 21. In the present invention, not only one but multiple audio information outputs can be selected.

[0051] When practicing, for example, "Practice Piece 1" can be selected from the list of audio information displayed on the display unit 12 of the terminal, and selections can be made such as "Full Accompaniment", "Part-by-Part Singing", "Soprano" and "Bass", "Part-by-Part Sheet Music", "Alto", "Singing Video", "Soprano" and "Bass". When selected by the audio information selection means 3, the data of the corresponding audio information is read and can be reproduced.

[0052] The audio information selection means 3 may be configured to select from a folder with a hierarchical structure, or may be configured to select by clicking on an icon image linked to the audio information. It may also be configured to select by voice, and as long as it is a configuration that is easy for the trainees to select, the configuration of the execution instruction of the audio information selection means 3 is not particularly limited.

[0053] 〔Audio Output Means〕 The audio output means 4 is a means for outputting the audio information selected by the audio information selection means 3 from among the audio information stored by the audio information recording means 21. In Fig. 1, the speaker 41, earphone output, etc. correspond to this means. In the case of chorus learning, the audio information is reproduced by the audio output means 4, and in the case of learning the pronunciation of words, the voice reading the corresponding words is output.

[0054] 〔Volume Adjustment Means〕 The volume adjustment means 5 is a means for adjusting the volume of the sound information output by the sound output means 4, that is, a volume control means. In the present invention, the volume adjustment by the volume adjustment means 5 can be individually set for the sound information stored in the sound information recording means 21.

[0055] Therefore, when there is a plurality of sound information selected by the sound information selection means 3, each volume adjustment setting is possible. And it is also possible to adjust the volume during output (during playback) for each sound information.

[0056] Also, the volume adjustment means 5 can also be set to mute. When set to mute, the sound information is not output. So, for example, for a part that you want to practice, you can first practice while listening to the sound information and then practice with the sound muted halfway through. In addition, when a video is being displayed as the sound information, not only the volume of the sound can be adjusted, but also controls such as starting or stopping the display of the video can be adjusted and set by the volume adjustment means 5.

[0057] 〔Output Sound Information Recording Means〕 The output sound information recording means 22 is a means for recording and storing the sound information output by the sound output means 4. The sound information output by the sound output means 4 is the one output from the sound information stored in the sound information recording means 21. At the time of output, volume adjustment including muting is possible by the volume adjustment means 5. For this reason, the sound information output by the sound output means 4 is different from the sound information stored in the sound information recording means 21. Therefore, the output sound information recording means 22 records and stores the sound information output including these settings.

[0058] Also, at the time of sound information output, various controls can be performed such as displaying the musical score related to the sound information, displaying a singing video or lyrics. When such controls are performed, it is also possible to enable recording and storage in the output sound information recording means 22 including the settings of these controls arbitrarily.

[0059] The output sound information stored in the output sound information recording means 22 can be used for creating the synthesis information described later and, as a preferred embodiment, for the association process described later. Furthermore, the sound information recorded in the output sound information recording means 22 can be called up during the next practice and used for repeated practice.

[0060] Note that the recording by the output sound information recording means 22 is executed according to the setting. Therefore, it is also possible to record only when it is desired to be used for synthesis or repeated practice, or to record and save only the portions that are desired to be saved by recording / recording only those portions as output sound information.

[0061] 〔Synthesis means〕 The synthesis means 7 is a means for synthesizing any sound information stored in the output sound information recording means 22, sound information stored in the sound information recording means 21, and voice information stored in the voice information recording means 23. In the output sound information recording means 22, the output sound information is respectively recorded and saved, and in the sound information recording means 21, various sound information is respectively recorded and saved. From among them, any output sound information or sound information and the voice information uttered by the trainee are synthesized by the synthesis means 7.

[0062] As a method for synthesizing sound information and voice information, a well-known voice synthesis method can be used, such as a method of adjusting and synthesizing based on the time code of the sound information and voice information, or a method of synchronously synthesizing based on the waveform. If the sound information and voice information are saved starting from the output time of the sound information so that the trainee can easily synthesize them, it is suitable to synchronize them on the same time axis and synthesize them into one.

[0063] The synthesis means 7 can combine a plurality of sound information, output sound information, and voice information to create synthesis information of any combination, such as synthesis of only singing or synthesis of a singing video. For example, synthesis information such as singing in chorus with a professional musician can be created.

[0064] In addition, when the learning terminal is provided with a communication function, trainees can be configured to be able to access each other's voice information recording means 23, so that they can synthesize with the voice information of other trainees. In this case, for example, in music learning, synthesized information can be obtained as if singing in chorus with other trainees. In this case, the communication function includes wired, wireless, Internet line, intranet line, LAN, etc. that can mutually transmit and receive information between learning terminals or upload to a server, and is not particularly limited.

[0065] 〔Synthesized Information Recording Means〕 The synthesized information recording means 24 is means for recording and storing the synthesized information synthesized by the synthesizing means 7. By checking the synthesized information recorded in the synthesized information recording means 24, the problems of the voice information, that is, the good parts and the not-so-good parts, can be objectively viewed. Therefore, it is easy for trainees to discover what they should practice in particular. Also, the instructor can also check and evaluate the synthesized information.

[0066] 〔Judgment Means and Judgment Result Recording Means〕 The learning support device 1 in the present invention preferably includes a judgment means 8 and a judgment result recording means 25. The judgment means 8 is means for judging the voice information recorded and stored in the voice information recording means 23 issued corresponding to the sound information, based on the sound information stored in the sound information recording means 21 or the output sound information recording means 22 as a judgment criterion, and based on a predetermined threshold value determined for one or a plurality of judgment items.

[0067] That is, it is means for judging between exemplary sound information and voice information practiced using that sound information. For example, items to be judged in advance can be determined, and a threshold value can be set for each item for judgment.

[0068] FIG. 4 is an explanatory diagram of an example of judgment in the learning support device according to the present invention. In FIG. 4, for the sound information, the black-filled part is the pronunciation of the pitch that serves as an example. For the voice information, the black-filled part is the pitch that matches the example. The lightly shaded part represents a pitch deviated from the example pitch.

[0069] Then, taking the first to the 15th sounds of the sound information as the criteria, the first to the 15th sounds of the voice information are judged by the judging means 8. As a result, the second and sixth sounds deviate by -2 from the criteria, the tenth sound deviates by +1 from the criteria, and the eleventh and fourteenth sounds deviate by -1.

[0070] In the example shown in FIG. 4, the judging means 8 makes an A judgment when it matches the criteria, a B judgment when it deviates by 1, and a C judgment when it deviates by 2. Therefore, the judgment results are that the second and sixth sounds are C judgments, and the tenth, eleventh, and fourteenth sounds are B judgments.

[0071] The judgment result recording means 25 records and stores the judgment results. The judgment by the judging means 8 is set to be appropriately changeable in terms of its criteria, judgment items, etc.

[0072] 〔Linking means〕 The judgment results stored in the judgment result recording means 25 are linked to the sound information or voice information output by the sound output means 4. Then, the linking means 9 links them in order to execute a process for displaying the judgment results on the display unit 12 when the sound information is output or when the voice information or the synthesized information is reproduced. This is to reflect the information of the judgment results in the corresponding parts of the sound information, voice information, or synthesized information in order to utilize them for subsequent learning.

[0073] For example, among the parts linked by the linking means 9, a configuration can be adopted in which a predetermined comment is displayed on the display unit 12 at the part where the judgment result exceeds the threshold value. The part where the judgment result exceeds the threshold value is, for example, in singing, the part where the pitch deviates beyond the threshold value in that song. Also, a configuration can be adopted in which a comment is displayed on the display unit 12 at the part where the A judgment of the matching pitch continues. The part where the A judgment of the matching pitch continues means, in singing, the part where the singing is done well.

[0074] In the example shown in FIG. 4, since the A determination continues from the third sound to the fifth sound, an evaluation that the user is singing well is associated with the synthesized information and displayed as a comment when the synthesized information is reproduced. Also, since the B determination continues for the tenth and eleventh sounds, a comment is displayed on the display unit when the synthesized information is reproduced so that it can be recognized that this part is a place where the pitch is likely to deviate.

[0075] As described above, the association means 9 associates the determination result determined by the determination means 8 and recorded and stored in the determination result recording means 25 with the sound information output by the sound output means 4, voice information, synthesized information, etc. Thereby, a comment reflecting the determination result can be presented at the time of these outputs or reproductions. Therefore, the trainee can continue practicing as if receiving personal guidance.

[0076] In addition, when the object to be associated is exemplary sound information, when the sound information is selected and reproduced and output next, a comment can be displayed at the corresponding location. The comment is not particularly limited to being displayed in text, and may be, for example, a predetermined warning sound (attention - calling sound) that calls attention, or a mark that serves as a landmark is displayed on the screen. In short, a configuration is adopted that can recognize the parts where practice should be repeated and can also recognize the parts where the user is singing well.

[0077] In addition, the comment can be set so that a highly versatile comment is automatically displayed by the association means 9 based on the result determined based on the determination criteria determined in advance by the determination means 8. In addition to this, the instructor can arbitrarily set the determination criteria and evaluation criteria, and when a certain determination result is recorded in the determination result recording means 25, it can also be set to prompt the instructor to input a comment at the corresponding location.

[0078] Also, in this case, the location where the comment is to be displayed can be selected arbitrarily. At this time, the determination means 8 can refer to information that cannot be determined, for example, a video taken during singing stored in the voice information recording means 23, and input advice useful for practice as a comment. In addition, when giving advice that is difficult to guide in text, the instructor may create a video and control which video can be viewed from the comment column. By using the learning support device 1 in this way, support similar to that which an instructor provides to a trainee in an educational setting can be achieved.

[0079] Also, in order to utilize the determination result for subsequent learning, the following examples can be cited. When it is analyzed that the parts with B determination or C determination are caused by being affected by the singing of other parts, the result is associated with the sound information of the practice target. Then, at the time of the next practice, it is also possible to support learning by temporarily lowering or conversely raising the singing volume of the other parts that the singing of the part determined as B determination or C determination has been affected by.

[0080] The determination means 8 makes determinations on the sound information and voice information for predetermined determination items. From this, assuming that a determination item for analyzing how many of the deviated pitches match the sounds of other parts is set in the determination item together with the determination of the pitch deviation. For example, when it is analyzed that 60% or more of the deviated pitches match the sounds of a specific other part, it is determined that the parts with B determination and C determination where the pitch is deviated are affected by the singing of other parts.

[0081] Then, based on the determination result, it can be associated so that a comment to pay attention to the singing of other parts is displayed at the location where the pitch is deviated. Along with this, for example, by associating information to lower the singing volume of other parts during playback, the determination result can be utilized more effectively, and it becomes easier to intensively practice the parts that cannot be sung well.

[0082] Next, a learning support method using the learning support device 1 according to the present invention will be described with reference to the drawings. FIG. 5 is a flowchart showing an embodiment of the learning support method according to the present invention.

[0083] First, one or a plurality of pieces of sound information are selected from a plurality of pieces of sound information that are the objects of practice stored in the sound information recording means 21 by the sound information selection means 3 (step 1).

[0084] At this time, necessary sound information is selected according to the content to be practiced. When practicing soprano singing in music learning, as the sound information to be selected, the overall accompaniment or the accompaniment for soprano is selected. When you want to practice only the soprano so as not to be dragged by other parts, select only the accompaniment without selecting the part. When you want to practice while listening to a model singing (demonstration singing), select the sound information of soprano singing. When you want to practice with the singing of other parts, select the singing of parts other than soprano.

[0085] In addition, other information stored in the sound information recording means 21 is also selected. For example, when you want to practice while watching a singing video, select the soprano of the singing video stored in the sound information recording means 21 (see FIG. 3). In addition, when you want to display the music score of the singing part, select the music score for soprano from the sound information. Such selection of sound information can be selected according to the content that the trainee wants to practice, and the practice environment is arranged actively rather than passively.

[0086] Next, when the sound information is selected by the sound information selection means 3, the sound information is read from the sound information recording means 21. Then, the read sound information is adjusted and set to the volume output from the sound output means 4 by the volume adjustment means 5 (step 2). Note that since the sound information can be arbitrarily adjusted in volume during output, the volume adjustment here is the initial setting.

[0087] Therefore, if you want to practice with the sound information of other parts from the middle, set it to mute in the initial settings. When you reach the part you want to practice with, manually adjust the volume up. Also, when selecting a singing video as the sound information, if you want to watch the video but don't need the singing, set the mute first. If you plan to adjust other settings such as speed settings and musical score notations in addition to the volume, adjust them together.

[0088] Then, the selected sound information is output by the sound output means 4 (step 3). As the sound output means 4, in addition to speakers, earphones, etc. may also be used, and it is output by a means that is easy for the trainee to practice with.

[0089] The output information of the selected sound information is recorded and saved in the output sound information recording means 22 (step 4). At that time, it may also be saved including the volume settings and speed adjustment settings set and changed for each sound information. By doing so, when practicing repeatedly, if you select the output sound information initially recorded and saved in the output sound information recording means 22, repeat practice can be performed without setting the same volume each time.

[0090] Simultaneously with recording and saving the output sound information in the output sound information recording means 22, the voice information emitted corresponding to the selected sound information is recorded and saved in the voice information recording means 23 (step 5). This is the recording and saving of the voice part emitted by the trainee who practices using the sound information. In the voice information recording means 23, in addition to recording only singing, recording by a singing video that shows the mouth movement during singing is also possible, and these can be arbitrarily set by the trainee.

[0091] Then, the arbitrary sound information stored in the output sound information recording means 22 and the voice information stored in the voice information recording means 23 are synthesized by the synthesizing means 7 (step 6). Note that the sound information to be synthesized with the voice information may be the exemplary sound information stored in the sound information recording means 21 instead of the output sound information. For example, in the case of music learning, when singing well, if the sound information of singing in other parts is synthesized with the voice information that was only the accompaniment of the part to be practiced during practice, synthetic information similar to that of a full chorus can be created.

[0092] Note that the synthesis process in step 6 is not essential, and only the voice information may be recorded and saved as it is without synthesizing it with the sound information. Then, during practice, when it is felt that it is impossible to harmonize well with other parts when practicing singing in other parts as sound information, it is possible to check while looking back at one's own singing recorded in the voice information.

[0093] Thereafter, the synthetic information synthesized by the synthesizing means 7 is recorded and saved in the synthetic information recording means 24 (step 7). If the synthetic information stored in the synthetic information recording means 24 can be viewed not only by the trainee but also by the instructor and other trainees, the instructor can individually check how well the trainee has achieved the learning goal, whether there are any difficulties in practice, etc. And can give guidance as needed.

[0094] Also, if the configuration is such that other trainees can view the synthetic information, the degree of learning of the surrounding trainees can be confirmed. If such confirmation can be performed, it is possible to receive stimulation in the same way as when practicing together nearby and use it as an incentive for practice.

[0095] In the learning support method using the learning support device 1 according to the present invention, preferably, it is possible to judge voice information and assist learning support. The judgment process by the judgment means 8 of the learning support device 1 according to the present invention uses the voice information recorded and saved in the voice information recording means 23 that is emitted corresponding to the sound information, with the sound information saved in the sound information recording means 21 as the judgment criterion, and the judgment is made based on a predetermined threshold value determined for one or more judgment items.

[0096] FIG. 6 is a flowchart for explaining the determination process in an embodiment of the learning support apparatus according to the present invention. Since the determination process is executed at an arbitrary timing, the determination means 8 is activated as necessary (step 21). The determination means 8 acquires the voice information to be determined from the voice information recording means 23 (step 22).

[0097] Next, the sound information serving as the determination criterion is acquired (step 23). As the sound information serving as the determination criterion, in the initial setting, the accompaniment and musical score that serve as the model of the voice information to be determined are acquired, but the determination process can also be performed by changing to arbitrary sound information.

[0098] Then, in the determination process, the determination items in the voice information are confirmed (step 24). When there are determination items (step 24, YES), if the sound information is used as a reference for that item, it is calculated whether the voice information exceeds a predetermined threshold value (step 25).

[0099] When it exceeds the threshold value (step 25, YES), as a determination result, for example, it is determined as "A" and recorded in the determination result recording means 25 (step 26). When it does not exceed the threshold value (step 25, NO), it is determined as "B" as a determination result and recorded in the determination result recording means 25 (step 27). On the other hand, when there are no determination items (step 24, NO), the process proceeds to step 29.

[0100] Then, it is confirmed whether there are other determination items (step 28). When there are none (step 28, NO), after all the determination results are recorded and saved in the determination result recording means 25 (step 29), the process ends. When there are other determination items (step 28, YES), the process returns to step 24 to perform the determination of other determination items, and the same process is repeated until there are no more determination items.

[0101] The determination result by the determination means 8 of the learning support device 1 according to the present invention is analyzed for problems such as the emitted sound being different or deviated compared with the exemplary sound information, and for the fact that the learning has been sufficiently well acquired. Therefore, it is possible to recognize the learning status from an objective perspective.

[0102] However, even if the determination process is performed, if the result cannot be utilized, the effect of the determination cannot be fully exerted. Therefore, the learning support device 1 according to the present invention associates the determination result recorded and stored in the determination result recording means 25 with voice information or synthesized information, and provides a more easily learnable support method.

[0103] FIG. 7 is a flowchart for explaining the association process in an embodiment of the learning support device according to the present invention. Since it is optional whether to perform the association process, the association means 9 is activated as necessary (step 31).

[0104] The association means 9 acquires the determination result obtained by the determination of the determination means 8 from the determination result recording means 25 (step 32). Next, the information to be associated with the determination result is selected, read, and acquired from the sound information, voice information, and synthesized information (step 33).

[0105] Then, the selected and acquired information, for example, the synthesized information, is associated with the determination result (step 34). The association is adjusted according to the determination means. For example, when the determination is made by whether each sound of the exemplary sound information and the voice information matches one by one, the association is also processed one sound by one sound.

[0106] In light of the requirement of whether a comment to be made known to the trainee should be given based on the associated result (step 35), if the requirement is not satisfied, that is, if there is no special circumstance where a comment should be given (step 35, not satisfied), the association process ends.

[0107] When the requirement for giving a comment is satisfied (step 35, satisfied), the comment to be given is selected (step 36). In step 36, if comments are prepared in advance for each requirement for giving a comment, the comments are automatically selected.

[0108] Then, the selected comment is associated with any one or all of the sound information, voice information, or synthesized information at the corresponding locations (step 37). When any one of the sound information, voice information, or synthesized information is output and played back, for example, when it is output by the output means for practice or when the synthesized information or voice information is played back for review, the associated comment is controlled to be displayed at the associated location (step 38).

[0109] When the musical score is displayed on the display unit 12, the comment may be displayed so as to overlap the display of the musical score. When the lyrics are displayed on the display unit, the comment may be displayed so as to overlap the corresponding part of the lyrics. Also, the comment is not limited to text. For example, if determination C continues and the lyrics corresponding to the part where attention is required for the pitch are displayed in a specific color or the font size is enlarged to be conspicuous to serve as a mark to prompt attention, it has the same effect as displaying the comment.

[0110] By performing the association process in this way, without checking the determination results one by one, the results are reflected during the next practice, and learning can be carried out using them. As a result, it is possible to repeatedly practice while being aware of the parts that cannot be sung well, so that it becomes possible to naturally achieve the learning goal.

[0111] 〔Program〕 The learning support program for sound information according to the present invention is a program for supporting the learning of sound information such as reading of music or text, pronunciation of words, etc., and includes sound information selection means 3 for selecting one or more pieces of sound information, sound output means 4 for outputting the sound information selected by the sound information selection means 3, volume adjustment means 5 including muting of the sound information output by the sound output means 4, output sound information recording means 22 for recording and storing the sound information output by the sound output means 4 respectively, Voice information recording means 23 that records and stores voice information uttered corresponding to the sound information output by the sound output means 4 Combining means 7 that combines arbitrary sound information stored in the output sound information recording means 22 and the voice information stored in the voice information recording means 23 Combined information recording means 24 that records and stores the combined information combined by the combining means 7 By Select the sound information necessary for practice, adjust the volume and output it, and cause the combined information recording means 24 that combines, records, and stores the sound information stored by the output sound information recording means 22 and the voice information stored by the voice information recording means 23 corresponding to the sound information to function.

[0112] Also, the learning support program for sound information according to the present invention uses the voice information recorded in the voice information recording means 23 uttered corresponding to the sound information stored in the output sound information recording means 22 as a criterion for the sound information. Then, it functions as a determination result recording means 25 that determines by the determination means 8 based on a predetermined threshold value set for one or a plurality of determination items and records and stores the result of the determination.

[0113] Furthermore, the learning support program functions as an association means 9 that associates the result of the determination by the determination means 8 with the sound information or voice information output by the sound output means 4 and executes processing for displaying the determination result on the display unit 12 when the sound information is output or the voice information is reproduced.

[0114] Each means of the learning support program exhibits the same function as that described for the learning support device 1, and the present invention constitutes a program for realizing the functions of the embodiment. Also, the object of the present invention can be achieved by storing the program recording medium in a system or device, reading out the program, and executing it.

[0115] In this case, the program itself read from the recording medium realizes the novel functions of the present invention, and the recording medium storing the program constitutes the present invention. As the recording medium for supplying the program, for example, a hard disk, an optical disk, a CD-ROM, a DVD-ROM, a ROM, etc. can be used.

[0116] FIG. 8 is an explanatory diagram showing an example displayed on a learning terminal in an embodiment of a learning support device according to the present invention. In FIG. 8, the learning support device 1 includes a sound information selection button 31 that executes a sound information selection means 3 for selecting sound information stored in a sound information recording means 21 that stores a plurality of pieces of sound information to be practiced, a speaker 41 that executes a sound output means 4 for outputting the sound information selected by the sound information selection means 3, a volume control 51 that executes a volume adjustment means 5 for adjusting the volume including muting of the sound information output by the sound output means 4, a recording button 13a that executes an output sound information recording means 22 for recording and storing the sound information output by the sound output means 4 respectively, a recording button 13b, a recording button 230a that executes a voice information recording means 23 for recording and storing voice information emitted corresponding to the sound information output by the sound output means 4, a recording button 230b, a microphone 61 as a voice input means 6, and a display unit 12 and an operation unit 11 of the learning terminal.

[0117] And it is configured to include a synthesis button 70 that executes a synthesis means 7 for synthesizing arbitrary sound information stored in the output sound information recording means 22 and voice information stored in the voice information recording means 23, a determination button 80 that executes the processing of the determination means 8, and an association button 90 that executes the processing of the association means 9.

[0118] In the example shown in FIG. 8, sound information for practice is selected by the sound information selection button 31. In the drawing, the sound information 30 includes the singing sound information of "tenor professional", the singing sound information of "soprano professional", and the singing sound information of "bass professional", and the sound information of the overall accompaniment is ON. In this embodiment, the selection of sound information can be performed by the sound information selection button 31. Then, a video or display indicating the selected sound information is displayed on the sound information selection button 31, making it clear which sound information is currently being used. Since the practice is for alto, the background of the sound information selection button 31 is darkened to make it easier for the trainee to understand the sound information for practice.

[0119] On the display unit 12, a video of professional singing is displayed in each column of sound information, and a recording button 13a for recording singing and a recording button 4 are provided. In the drawing, the video recording button 13a is ON. On the other hand, the sound information selection button 31 on which the trainee is displayed is provided with a recording button 230a and a recording button 230b for recording the voice information of the trainee. In the drawing, the video recording button 230a is ON. The recording button 13a, the recording button 230a, the recording button 13b, and the recording button 230b can be turned ON or OFF during the performance of the accompaniment or during the singing practice. Therefore, when you want to start recording suddenly, press the recording button 13a to start recording, and when you want to stop recording, press the recording button 13a again to stop it. Similarly, when you want to record only the singing, press the recording button 13b to start recording, and press the recording button 13b again to stop it.

[0120] Also, on the display unit 12, a volume control bar 51 for executing the volume adjustment means 5 is arranged above each sound information 30. Therefore, for each sound information 30 for which the volume is to be adjusted, the volume can be adjusted respectively with the upper volume control bar.

[0121] In FIG. 8, the tenor, soprano, and bass of the sound information are set at the maximum volume, and only the alto is muted. Therefore, the trainee can practice singing the alto part while listening to the singing of other parts.

[0122] In addition, a synthesis button 70 for executing the synthesis means 7, a determination button 80 for executing the process of the determination means 8, and an association button 90 for executing the process of the association means 9 are provided on the operation unit 11, and each process is configured to be easy to operate. And on the display unit 12, the lyrics selected by the sound information are displayed. When a musical score is selected by the sound information, the musical score designated for this part can be displayed so as to be easy to see during practice.

[0123] FIG. 9 is an explanatory diagram showing an example displayed on a learning terminal in another embodiment of the learning support device according to the present invention. FIG. 9 shows the voice information recorded and stored in the voice information recording means 23 corresponding to the sound information, using the sound information stored in the sound information recording means 21 as a determination criterion, and for the result determined by the determination means 8, it is associated with the voice information, and when the voice information is reproduced, a process for displaying the determination result on the display unit is executed, and an example is shown when a comment 14 is displayed by the association means 9.

[0124] In the example shown in FIG. 9, the part where the pitch is off is displayed on the display unit 12, and a comment 14 from the instructor saying "Since the pitch has dropped, try applying more force to your abdominal muscles" is displayed. By visualizing the determination result of the voice information when practicing earlier in this way, the uneasiness of the trainee is removed, and the trainee feels as if receiving personal guidance, making it easier to seriously engage in learning.

Industrial Applicability

[0125] The learning support device and learning support method according to the present invention can be used in an educational field related to sound information that requires multiple people to learn simultaneously. The trainee can set what they want to practice to the most convenient setting for practice and repeat the practice, and can objectively grasp the acquisition status.

[0126] Although the example has been described in the case of being used exclusively for music learning, the sound information is not limited to music and can also be used in foreign language acquisition, classical learning, etc. Since the exemplary sound information is easy to practice and easy to instruct in advance, it can be used in various textbooks. Also, if the learning terminal is provided with a communication function and the information is shared on the server, it is possible to create synthetic information as if practicing together beyond the distance from overseas trainees, and the scope of application is considered infinite.

Explanation of Signs

[0127] 1 Learning support device 2 Information recording unit 21 Sound information recording means 22 Output sound information recording means 23 Voice information recording means 24 Synthetic information recording means 25 Judgment result recording means 3 Sound information selection means 4 Sound output means 41 Speaker 5 Volume adjustment means 6 Voice input means 61 Microphone 7 Synthesis means 70 Synthesis button 8 Judgment means 80 Judgment button 9 Association means 90 Association button 10 Control unit 11 Operation unit 12 Display unit 13 Recording means · Recording means 13a Recording button 13b Recording button 14 Comment

Claims

1. Sound information recording means for storing a plurality of sound information to be practiced Sound information selection means for selecting one or more pieces of sound information stored by the sound information recording means Sound output means for outputting the sound information selected by the sound information selection means Volume adjustment means for adjusting the volume including muting of the sound information output by the sound output means Output sound information recording means for recording and storing the sound information output by the sound output means respectively Voice information recording means for recording and storing voice information uttered corresponding to the sound information output by the sound output means Combining means for combining any sound information stored in the output sound information recording means and voice information stored in the voice information recording means Combined information recording means for recording and storing the combined information combined by the combining means A learning support device for sound information, characterized by comprising the above components

2. Judgment means for judging the voice information recorded and stored in the voice information recording means uttered corresponding to the sound information, using the sound information stored in the sound information recording means as a judgment criterion, based on a predetermined threshold value determined for one or more judgment items Judgment result recording means for recording and storing the judgment result by the judgment means The learning support device for sound information according to Claim 1, comprising the above components

3. Linking means for associating the judgment result stored in the judgment result recording means with the sound information output by the sound output means or the voice information, and executing processing for displaying the judgment result on a display unit when the sound information is output, or when the voice information or combined information is reproduced The learning support device for sound information according to Claim 2, comprising the above components

4. The learning support device for sound information according to any one of Claims 1 to 3, wherein the sound information is one or more pieces of sound information selected from the accompaniment in the whole piece of music, the accompaniment for each part, the chorus, the lead, the tenor, the soprano, the alto, the bass, etc., and the voice information is the singing uttered by the trainee

5. The learning support device for sound information according to Claim 1, wherein the sound information is the reading aloud of a text, and the voice information is the voice uttered by the trainee

6. Step (Step 1) of selecting one or more pieces of sound information by the sound information selection means (3) from a plurality of pieces of sound information to be practiced stored in the sound information recording means (21) Step (Step 2) of adjusting and setting the volume output from the sound output means (4) by the volume adjustment means (5) for the selected sound information Outputting the selected sound information by the sound output means (4) (step 3); Recording and storing the output information of the selected sound information in the output sound information recording means (22) (step 4); Recording and storing the voice information generated corresponding to the selected sound information in the voice information recording means (23) (step 5); Synthesizing, by the synthesizing means (7), any sound information stored in the output sound information recording means (22) and the voice information stored in the voice information recording means (step 6); Recording and storing the synthesized information synthesized by the synthesizing means in the synthesized information recording means (24) (step 7); A learning support method for sound information, characterized by comprising the above steps.

7. A learning support program for sound information such as reading of music or text, pronunciation of words, etc., comprising: Sound information selection means for selecting one or more pieces of sound information; Sound output means for outputting the sound information selected by the sound information selection means; Volume adjustment means including muting of the sound information output by the sound output means; Output sound information recording means for recording and storing the sound information output by the sound output means respectively; Voice information recording means for recording and storing the voice information generated corresponding to the sound information output by the sound output means; Synthesizing means for synthesizing any sound information stored in the output sound information recording means and the voice information stored in the voice information recording means; Synthesized information recording means for recording and storing the synthesized information synthesized by the synthesizing means; By means of: Selecting the sound information required for practice, adjusting the volume and outputting it, and causing the synthesized information recording means to synthesize, record and store the sound information stored by the output sound information recording means and the voice information stored by the voice information recording means corresponding to the sound information by the synthesizing means. A learning support program for sound information, characterized by this.

8. Using the sound information stored in the output sound information recording means as a criterion, determining by the recording information determination means based on a predetermined threshold value set for one or more determination items, and causing the determination result recording means to function to record and store the result of the determination. The learning support program for sound information according to Claim 7.

9. The voice information recorded in the voice information recording means corresponding to the sound information stored in the output sound information recording means. A linking means is caused to function to execute a process for associating the result of determination by the recording information determination means with sound information output by the sound output means or the voice information, and displaying the determination result on a display unit when the sound information is output or when the voice information is reproduced. The learning support program for sound information according to claim 7.

10. A recording medium recording a learning support program for sound information, characterized in that the program according to any one of claims 7 to 9 is recorded.

Citation Information

Patent Citations

  • Pronunciation comparing learning device

    JP1996016089A

  • Mixer and headphone amplifier

    JP1999150783A

  • Learning device, pronunciation exercise device, their method, and record medium

    JP1999212438A

  • Music joint practice device

    JP2000163054A

  • Language education system, voice data processor, voice data processing method, voice data processing program, and recording medium

    JP2003307997A