Karaoke equipment

Abstract

To provide a Karaoke device capable of properly evaluating vibrato singing.SOLUTION: A Karaoke device includes: an identification unit identifying a first peak frequency and a second peak frequency; a calculation unit determining a sound name of the first frequency and a first difference value and determining a sound name of the second frequency and a second difference value; a first determination unit determining whether the first difference value and the second difference value each satisfy predetermined conditions, when the sound name of the first frequency and the sound name of the second frequency match a sound name of a chord component sound corresponding to chord information of a singing section; and an evaluation unit that performs a score addition process when performing a scoring process for a song, when it is determined that the first difference value and the second difference value each satisfy the predetermined conditions.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a karaoke machine. [Background technology]

[0002] The karaoke device is equipped with a scoring function for scoring the skill of karaoke singing by comparing singing voice data extracted from singing voice input by a microphone with reference data showing the main melody of the song performed as karaoke.

[0003] For example, Patent Document 1 discloses a technology for extracting pitch data and duration data from a singing voice signal input from a microphone in time with a karaoke performance, and scoring and evaluating the singing skill by comparing it with a guide melody that is read out in parallel with the karaoke performance.

[0004] Some people also sing karaoke using special singing techniques. Patent Document 2 discloses a technique for detecting vibrato singing as a special singing technique and evaluating the karaoke singing. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 10-69216 [Patent Document 2] JP 2008-268369 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, when using the technology of Patent Document 2, there is a possibility that a high score can be obtained simply by singing with vibrato. Therefore, some karaoke singers ignore the chords and scales of the song and sing with vibrato that the audience finds unnatural.

[0007] An object of the present invention is to provide a karaoke apparatus capable of appropriately evaluating vibrato singing. [Means for solving the problem]

[0008] One invention for achieving the above object includes an identification unit which, when vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing, and a frequency determining unit which determines a note name of the first frequency which is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and determines the note name of the identified second peak frequency. a calculation unit that calculates a note name of a second frequency that is most similar to a frequency of a first peak frequency and a second difference value between the second peak frequency and the second frequency; a first determination unit that determines whether or not the first difference value and the second difference value each satisfy a predetermined condition when the note name of the first frequency and the note name of the second frequency match the note names of chord constituent notes corresponding to chord information of the certain singing section; and an evaluation unit that performs a point addition process when performing a scoring process for the song when it is determined that the first difference value and the second difference value each satisfy the predetermined condition. Another invention for achieving the above object includes an identification unit which, when vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing; a pitch name of a first frequency which is closest to the identified first peak frequency, and a first difference value between the first peak frequency and the first frequency, and identifies a pitch name of a second frequency which is closest to the identified second peak frequency; and a calculation unit that calculates a second difference value between the second peak frequency and the second frequency; a second judgment unit that judges whether or not the first difference value and the second difference value each satisfy a predetermined condition when the difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch and when the note name of the first frequency and the note name of the second frequency match the note names of scale notes corresponding to chord information of the certain singing section; and an evaluation unit that performs a point addition process when performing a scoring process for the song when it is judged that the first difference value and the second difference value each satisfy the predetermined condition. Other features of the present invention will become apparent from the following specification and drawings. Effect of the Invention

[0009] According to the present invention, vibrato singing can be appropriately evaluated. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing a karaoke device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing a karaoke main unit according to the first embodiment. [Diagram 3] FIG. 4 is a diagram showing code information according to the first embodiment. [Figure 4] 4 is a flowchart showing the process of the karaoke device according to the first embodiment. [Diagram 5]FIG. 4 is a diagram showing an example of the relationship between first and second peak frequencies, first and second frequencies, pitch names, and first and second difference values ​​according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing a karaoke main unit according to a second embodiment. [Figure 7] FIG. 11 is a diagram showing code information according to the second embodiment. [Figure 8] 10 is a flowchart showing the process of the karaoke device according to the second embodiment. [Figure 9] FIG. 11 is a diagram showing an example of the relationship between the first and second peak frequencies, the first and second frequencies, the note names, and the first and second difference values ​​according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] First Embodiment A karaoke device according to a first embodiment will be described with reference to FIGS. 1 to 5.

[0012] ==Karaoke Equipment== A karaoke device is a device for playing karaoke music and for users to sing karaoke. As shown in Fig. 1, a karaoke device K according to this embodiment includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0013] The karaoke main unit 10 performs various controls related to karaoke performance and singing, such as controlling the karaoke performance of the selected song, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke main unit 10. The display device 30 is configured to display videos and images on a screen based on the signal from the karaoke main unit 10. The microphone 40 is configured to convert the singing voice of the user singing karaoke into an analog audio signal and input it to the karaoke main unit 10. The remote control device 50 is a device for performing various operations on the karaoke main unit 10.

[0014] 2, the karaoke machine 10 according to this embodiment includes a storage means 10a, a communication means 10b, an input means 10c, a performance means 10d, and a control means 10e. Each of these components is connected to a bus B via an interface (not shown).

[0015] [Storage means] The storage means 10a is a large-capacity storage device that stores various types of data. The storage means 10a stores music data.

[0016] The song data is provided with song identification information for identifying each song. The song identification information is information unique to each song, such as a song ID for identifying the song. The song data includes accompaniment data, reference data, etc. The accompaniment data is data that is the source of the karaoke performance sound. The reference data is data that indicates the main melody of the song that is performed karaoke.

[0017] The music data includes information about a performance section. A performance section is a section where karaoke is performed. A performance section includes a singing section and a non-singing section. A singing section is a section in which lyrics to be sung are set in a certain music piece, such as a bar constituting an A-melody, B-melody, chorus, etc. A non-singing section is a section in which lyrics to be sung are not set in a certain music piece, such as a bar constituting an introduction, interlude, or postlude.

[0018] In this embodiment, each performance section is assigned chord information, which is information that indicates the chord progression of the performance section, such as "C", "Am", "Em", etc.

[0019] In this embodiment, each piece of chord information is associated with a chord constituent note within a predetermined range. For example, the storage means 10a stores a table in which chord information is associated with a chord constituent note.

[0020] For example, if the predetermined range is "A0" to "C8" (88 keys in total) on a piano keyboard, the chord notes "A0", "C1", "E1", ... "A6", "C7", "E7", "A7", and "C8" correspond to the chord information "Am" (see FIG. 3). Note that instead of adding chord information to each performance section of the music data, the music data may be analyzed using known technology to identify the chord progression.

[0021] The storage means 10a stores lyrics caption data for displaying lyrics captions corresponding to each piece of music on the display device 30 or the like in sync with the karaoke performance, background image data to be displayed on the display device 30 or the like during the karaoke performance, and attribute information of the piece of music. The attribute information of the piece of music includes, for example, the singer's name, the musical genre of the piece of music, etc.

[0022] [Communication means, input means, performance means] The communication means 10b provides an interface for communicating with the remote control device 50. The input means 10c is configured to allow the user to input various instructions. The input means 10c is a button or the like provided on the karaoke main unit 10. Alternatively, the remote control device 50 may function as the input means 10c. The performance means 10d performs karaoke performance of a song and processes a signal based on the singing voice input through the microphone 40 under the control of the control means 10e.

[0023] [Control Means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which are shown in the figures). The CPU realizes various functions by executing programs stored in the memory.

[0024] In this embodiment, the control means 10e functions as a specification unit 100, a calculation unit 200, a first determination unit 300, and an evaluation unit 400 by the CPU executing a program stored in the memory.

[0025] (Specific part) When vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, the identification unit 100 identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing, and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing.

[0026] Vibrato singing is a technique in which the pitch of a karaoke singer is slightly raised and lowered to make the voice waver when a sound is extended. Vibrato singing can be detected using a known method such as the technique described in Patent Document 2. Vibrato singing can be detected, for example, by the identifying unit 100. In this embodiment, vibrato singing is detected for each singing section.

[0027] The first peak frequency is a frequency indicating a point (i.e., a peak) where the pitch transition changes from positive to negative among the frequencies indicated by the singing voice data corresponding to vibrato singing. The second peak frequency is a frequency indicating a point (i.e., a valley) where the pitch transition changes from negative to positive among the frequencies indicated by the singing voice data corresponding to vibrato singing. In general, when vibrato singing is detected in a certain singing section, there are multiple first peak frequencies and multiple second peak frequencies.

[0028] When vibrato singing is detected in a singing section of a song, the identification unit 100 analyzes singing voice data corresponding to the vibrato singing and identifies a number of first peak frequencies indicating peaks and a number of second peak frequencies indicating valleys.

[0029] (Calculation section) The calculation unit 200 determines the note name of a first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and also determines the note name of a second frequency that is closest to the identified second peak frequency and a second difference value between the second peak frequency and the second frequency.

[0030] One frequency is associated with one note name. For example, assume that the frequency value associated with the note name "A4" is 440 Hz. In this case, the frequency value associated with the note name "A3" is 220 Hz, and the frequency value associated with the note name "A5" is 880 Hz. For example, the storage means 10a may store a table that associates frequencies with note names, or the calculation unit 200 may associate note names with frequencies using a predetermined formula.

[0031] The difference value is a value that indicates the difference between the value of one frequency and the value of another frequency. The difference value can be expressed in cents. The cents can be calculated using a predetermined formula or a known method (for example, https: / / achapi2718.blogspot.com / 2012 / 01 / cent-java-script.html).

[0032] The calculation unit 200 compares the identified first peak frequency with the frequency associated with each pitch name, and obtains the frequency with the most approximate value as the first frequency. Then, the calculation unit 200 identifies the pitch name with which the first frequency is associated. The calculation unit 200 also compares the identified second peak frequency with the frequency value associated with each pitch name, and obtains the frequency with the most approximate value as the second frequency. Then, the calculation unit 200 identifies the pitch name with which the second frequency is associated.

[0033] After that, the calculation unit 200 calculates a difference value between the identified first peak frequency and the obtained first frequency (i.e., a first difference value).The calculation unit 200 also calculates a difference value between the identified second peak frequency and the obtained second frequency (i.e., a second difference value).

[0034] When a plurality of first peak frequencies and a plurality of second peak frequencies are identified, the calculation unit 200 calculates the note name of the first frequency and the first difference value for each of the identified plurality of first peak frequencies, and calculates the note name of the second frequency and the second difference value for each of the identified plurality of second peak frequencies.

[0035] (First judgment section) When the note name of the first frequency and the note name of the second frequency match the note names of chord constituent notes corresponding to chord information of a certain singing section, the first judgment unit 300 judges whether the first difference value and the second difference value each satisfy a predetermined condition.

[0036] The predetermined condition is a condition for judging the calculated difference value. For example, a range is set in advance for the predetermined condition, such as within ±30 cents or within ±45 cents. Different predetermined conditions may be set for the first difference value and the second difference value. For example, "within ±30 cents" may be set as the predetermined condition for the first difference value, and "within ±45 cents" may be set as the predetermined condition for the second difference value.

[0037] The first determination unit 300 refers to the chord information of a certain singing section and checks whether or not the pitch names of the chord constituent tones associated with the chord information include a pitch name that matches the pitch name of the first frequency. The first determination unit 300 also refers to the chord information of a certain singing section and checks whether or not the pitch names of the chord constituent tones associated with the chord information include a pitch name that matches the pitch name of the second frequency.

[0038] When the note names of the first frequency and the second frequency match the note names of the chord constituent notes corresponding to the chord information of a certain singing section, the first judgment unit 300 judges whether the first difference value satisfies a predetermined condition and whether the second difference value satisfies a predetermined condition. The first judgment unit 300 outputs the judgment result to the evaluation unit 400.

[0039] In addition, when the first frequency note name and the first difference value are calculated for each of the identified multiple first peak frequencies, and the second frequency note name and the second difference value are calculated for each of the identified multiple second peak frequencies, the first judgment unit 300 judges whether all of the multiple first frequency note names and multiple second frequency note names match the note names of chord constituent tones corresponding to the chord information of a certain singing section. Alternatively, in this case, the first judgment unit 300 may make a judgment based on whether or not a predetermined ratio or more of the multiple first frequency note names and multiple second frequency note names (for example, more than half of the total, or more than half of the first frequency note names and more than half of the second frequency note names) match the note names of chord constituent tones corresponding to the chord information of a certain singing section.

[0040] Furthermore, when it is determined that the multiple first frequency note names and multiple second frequency note names match the note names of chord constituent notes corresponding to the chord information of a certain singing section, the first judgment unit 300 judges whether or not all of the multiple first difference values ​​and multiple second difference values ​​satisfy a predetermined condition. Alternatively, in this case, the first judgment unit 300 may make a judgment based on whether or not a predetermined ratio or more of the multiple first difference values ​​and multiple second difference values ​​(for example, more than half of the total, or more than half of the first difference values ​​and more than half of the second difference values) satisfy the predetermined condition.

[0041] (Evaluation Department) The evaluation unit 400 performs a scoring process for the karaoke singing. A known method can be used for the scoring process for the karaoke singing. For example, the evaluation unit 400 performs a scoring process based on the degree of agreement of the pitches of the notes constituting each singing section, using reference data of the song to be sung by the user as karaoke and singing voice data based on the singing voice of the user. The result of the scoring process can be indicated by a numerical value (score value) ranging from 0 to 100 points, for example.

[0042] Here, when it is determined that the first difference value and the second difference value each satisfy a predetermined condition, the evaluation section 400 according to the present embodiment performs a point addition process when performing a scoring process for the music piece.

[0043] The point addition process can be performed in various ways. For example, when it is determined that the first difference value and the second difference value each satisfy a predetermined condition, the evaluation unit 400 can add a predetermined number of points to the score value of a certain singing section, or increase the score value of the certain singing section by a predetermined percentage. Alternatively, the evaluation unit 400 can add a predetermined number of points to the score value of the entire song including the certain singing section.

[0044] If it is determined that at least one of the first difference value and the second difference value does not satisfy the predetermined condition, the evaluation unit 400 performs only normal scoring without adding points. Alternatively, in this case, the evaluation unit 400 can subtract a predetermined number of points from the score value of a certain singing section, or decrease the score value of a certain singing section by a predetermined percentage.

[0045] ==About the operation of the karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flow chart showing an example of the operation of the karaoke device K. In this example, it is assumed that the frequency value associated with the note name "A4" is 440 Hz. It is also assumed that the predetermined condition for the first difference value is set to "within ±30 cents," and the predetermined condition for the second difference value is set to "within ±45 cents."

[0046] The karaoke device K performs the karaoke performance of the song X selected by the user (karaoke performance starts; step 10). The user sings the karaoke performance of the song X.

[0047] When vibrato singing is detected in a certain singing section of song X based on the singing voice of a user singing karaoke (Y in step 11), the identification unit 100 identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing (identifying the first peak frequency and the second peak frequency; step 12).

[0048] In this example, in the singing section S of the song X in which vibrato singing was detected, four first peak frequencies PF1-1 (530 Hz), PF1-2 (525 Hz), PF1-3 (516 Hz), PF1-4 (520 Hz) and four second peak frequencies PF2-1 (430 Hz), PF2-2 (443 Hz), PF2-3 (446 Hz), PF2-4 (436 Hz) were identified.

[0049] The calculation unit 200 determines the note name of a first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and also determines the note name of a second frequency that is closest to the identified second peak frequency and a second difference value between the second peak frequency and the second frequency (calculating the note name and first difference value of the first frequency, and the note name and second difference value of the second frequency; step 13).

[0050] In this example, the calculation unit 200 compares the identified first peak frequency PF1-1 with the frequencies associated with each pitch name, and determines the frequency (here, 523.251 Hz) with which the value is most similar as the first frequency F1-1. Then, the calculation unit 200 identifies the pitch name N1-1 (here, C5) with which the first frequency F1-1 is associated. Similarly, the calculation unit 200 compares the identified first peak frequencies PF1-2 to PF1-4 with the frequencies associated with each pitch name, and determines the frequency with which each value is most similar as the first frequencies F1-2 to F1-4. Then, the calculation unit 200 identifies the pitch names N1-2 to N1-4 with which the first frequencies F1-2 to F1-4 are associated (see FIG. 5).

[0051] Thereafter, the calculation unit 200 calculates a difference value D1-1 (here, +22.187 cents) between the identified first peak frequency PF1-1 (530 Hz) and the found first frequency F1-1 (523.251 Hz). Similarly, the calculation unit 200 calculates difference values ​​D1-2 to D1-4 between the identified first peak frequencies PF1-2 to PF1-4 and the found first frequencies F1-2 to F1-4 (see FIG. 5). The difference values ​​D1-1 to D1-4 correspond to the "first difference value."

[0052] The calculation unit 200 also compares the identified second peak frequency PF2-1 with the frequencies associated with each pitch name, and determines the frequency (here, 440 Hz) with which the value is most similar as the second frequency F2-1. The calculation unit 200 then identifies the pitch name N2-1 (here, A4) with which the second frequency F2-1 is associated. Similarly, the calculation unit 200 compares the identified second peak frequencies PF2-2 to PF2-4 with the frequencies associated with each pitch name, and determines the frequency with which the respective values ​​are most similar as the second frequencies F2-2 to F2-4. The calculation unit 200 then identifies the pitch names N2-2 to N2-4 with which the second frequencies F2-2 to F2-4 are associated (see FIG. 5).

[0053] Thereafter, the calculation unit 200 calculates a difference value D2-1 (here, −39.800 cents) between the identified second peak frequency PF2-1 (430 Hz) and the obtained second frequency F2-1 (440 Hz). Similarly, the calculation unit 200 calculates difference values ​​D2-2 to D2-4 between the identified second peak frequencies PF2-2 to PF2-4 and the obtained second frequencies F2-2 to F2-4 (see FIG. 5). The difference values ​​D2-1 to D2-4 correspond to the “second difference value.”

[0054] If the note names of the first frequency and the second frequency match the note names of the chord constituent notes corresponding to the chord information of a certain singing section (Y in step 14), the first judgment unit 300 judges whether the first difference value and the second difference value each satisfy a predetermined condition.

[0055] For example, in the example of Figure 5, the first judgment unit 300 refers to the chord information of the singing section S and checks whether or not there is a note name that matches the note name N1-1 (C5) of the first frequency F1-1 among the note names of the chord constituent notes associated with the chord information.

[0056] Here, it is assumed that the chord information of the singing section S is "Am." In this case, the chord notes shown in Fig. 3 correspond to the chord information "Am." Therefore, the first determination unit 300 determines that the note name N1-1 (C5) matches the note name (C5) of the chord note corresponding to the chord information of the singing section S.

[0057] In this case, the first determination unit 300 determines whether the difference value D1-1 between the first peak frequency PF1-1 and the first frequency F1-1 satisfies a predetermined condition. In this example, the difference value D1-1 (+22.187 cents) satisfies the predetermined condition (within ±30 cents).

[0058] By performing similar processing, the first judgment unit 300 judges that each of the pitch names N1-2 to N1-4 matches the pitch names of the chord constituent notes corresponding to the chord information of the singing section S. The first judgment unit 300 also judges that each of the difference values ​​D1-2 to D1-4 satisfies a predetermined condition (within ±30 cents).

[0059] On the other hand, the first judgment unit 300 refers to the chord information of the singing section S and checks whether or not there is a note name that matches the note name N2-1 (A4) of the second frequency F2-1 among the note names of the chord constituent notes associated with the chord information.

[0060] Here, the chord information of the singing section S is “Am.” Therefore, the first determination unit 300 determines that the note name N2-1 (A4) matches the note name (A4) of the chord constituent note corresponding to the chord information of the singing section S.

[0061] In this case, the first determination section 300 determines whether the difference value D2-1 between the second peak frequency PF2-1 and the second frequency F2-1 satisfies a predetermined condition. In this example, the difference value D2-1 (-39.800 cents) satisfies the predetermined condition (within ±45 cents).

[0062] By performing similar processing, the first judgment unit 300 judges that each of the note names N2-2 to N2-4 matches the note names of the chord constituent notes corresponding to the chord information of the singing section S. The first judgment unit 300 also judges that each of the difference values ​​D2-2 to D2-4 satisfies a predetermined condition (within ±45 cents).

[0063] If it is determined that the first difference value and the second difference value each satisfy a predetermined condition (Y in step 15), the evaluation unit 400 performs a point addition process when performing a scoring process for the song X (point addition process; step 16).

[0064] As described above, it is assumed that the difference values ​​D1-1 to D1-4 and the difference values ​​D2-1 to D2-4 are determined to satisfy the predetermined conditions. In this case, the evaluation section 400 adds a predetermined number of points to the score value of the singing section S, for example.

[0065] Karaoke device K repeats the processes from step 11 to step 16 until the karaoke performance of song X is completed (Y in step 17). If the answer is N in steps 11, 14, and 15 (i.e., if vibrato singing is not performed or if vibrato singing is not performed appropriately), evaluation unit 400 does not perform point addition processing and performs only normal scoring processing. If point addition processing is to be performed for the entire song X, evaluation unit 400 performs the process of step 16 after the karaoke performance is completed.

[0066] As is apparent from the above, the karaoke apparatus K according to this embodiment includes an identification unit 100 that, when vibrato singing is detected in a singing section of a song based on the singing voice of a karaoke user, identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing, and a frequency identification unit 102 that calculates a note name of a first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and The system further includes a calculation unit 200 that calculates the note name of a second frequency that is closest to the determined second peak frequency and a second difference value between the second peak frequency and the second frequency, a first judgment unit 300 that judges whether the first difference value and the second difference value each satisfy a predetermined condition when the note name of the first frequency and the note name of the second frequency match the note names of chord constituent notes corresponding to chord information of a certain singing section, and an evaluation unit 400 that performs a point addition process when scoring the song when it is judged that the first difference value and the second difference value each satisfy the predetermined condition.

[0067] When the note names of the first frequency and the second frequency match the note names of the chord constituent tones corresponding to the chord information of a certain singing section, it can be determined that the vibrato singing is performed according to the chord set in the certain singing section. Also, when the first difference value and the second difference value each satisfy a predetermined condition, it can be determined that the natural vibrato singing (vibrato singing that is not extremely high or low compared to the chord constituent tones) is performed. Here, according to the karaoke device K of this embodiment, only when the note names of the first frequency and the second frequency match the note names of the chord constituent tones corresponding to the chord information of a certain singing section and when the first difference value and the second difference value each satisfy a predetermined condition, the karaoke device K of this embodiment performs a score addition process for the vibrato singing. That is, according to the karaoke device K of this embodiment, the vibrato singing can be appropriately evaluated.

[0068] <Second embodiment> Next, a karaoke device according to a second embodiment will be described with reference to Fig. 6 to Fig. 9. In this embodiment, an example will be described in which scale constituent tones are used instead of chord constituent tones. Detailed description of the same configuration as the first embodiment will be omitted.

[0069] ==Karaoke Equipment== [Storage means] The storage means 10a is a large-capacity storage device that stores various types of data. The storage means 10a stores music data.

[0070] In this embodiment, each chord information is associated with a scale note. For example, chord information "Am" is associated with the scale notes "A0", "B0", ... "E4", "F#4", "G#4", ... "B7", and "C8" (see FIG. 7). The scale is set for each piece of music, such as a melodic scale, a harmonic scale, a natural scale, etc.

[0071] [Control Means] In this embodiment, the CPU executes a program stored in the memory, whereby the control means 10e functions as a specification unit 100, a calculation unit 200, a second determination unit 500, and an evaluation unit 400 (see FIG. 6).

[0072] (Second Judgment Section) The second judgment unit 500 judges whether the first difference value and the second difference value each satisfy a predetermined condition when the difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch, and when the note names of the first frequency and the second frequency match the note names of scale notes corresponding to chord information of a certain singing section.

[0073] The predetermined interval is a condition for determining the difference value between the first frequency and the second frequency. The predetermined interval is set to a value in advance, such as a minor third (corresponding to 300 cents) or a major second (corresponding to 200 cents). The calculation of the difference value between the first frequency and the second frequency can use the same method as the method available for obtaining the first difference value and the second difference value.

[0074] The second judgment unit 500 calculates a difference value between the first frequency and the second frequency calculated by the calculation unit 200, and checks whether the difference value is equal to or greater than a predetermined pitch. The second judgment unit 500 also refers to chord information for a certain singing section, and checks whether the note names of the scale tones associated with the chord information include a note name that matches the note name of the first frequency. The second judgment unit 500 also refers to chord information for a certain singing section, and checks whether the note names of the scale tones associated with the chord information include a note name that matches the note name of the second frequency.

[0075] If the difference between the first and second frequencies is equal to or greater than a predetermined pitch, and if the pitch names of the first and second frequencies match the pitch names of scale notes corresponding to chord information in a certain singing section, the second judgment unit 500 judges whether the first difference value and the second difference value satisfy a predetermined condition. The second judgment unit 500 outputs the judgment result to the evaluation unit 400.

[0076] In addition, there may be cases where at least some of the values ​​of the multiple first frequencies (or multiple second frequencies) calculated by the calculation unit 200 are different. In this case, the second judgment unit 500 calculates the difference values ​​between the first and second frequencies that are successive in time series, and judges whether all the difference values ​​are equal to or greater than the predetermined pitch. Alternatively, in this case, the second judgment unit 500 may judge whether a predetermined proportion or more (for example, more than half of the total) of the multiple difference values ​​are equal to or greater than the predetermined pitch.

[0077] ==About the operation of the karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 8 and Fig. 9. Fig. 8 is a flow chart showing an example of the operation of the karaoke device K. In this example, it is assumed that the frequency value associated with the note name "A4" is 440 Hz. Also, it is assumed that a minor third (equivalent to 300 cents) is set as the predetermined interval. It is also assumed that "within ±30 cents" is set as the predetermined condition for the first difference value, and "within ±45 cents" is set as the predetermined condition for the second difference value.

[0078] In steps 20 to 23, the karaoke apparatus K performs the same processes as those in steps 10 to 13 described in the first embodiment.

[0079] In this example, in the singing section S of the song X in which vibrato singing was detected, four first peak frequencies PF3-1 (590Hz), PF3-2 (595Hz), PF3-3 (580Hz), PF3-4 (585Hz) and four second peak frequencies PF4-1 (430Hz), PF4-2 (443Hz), PF4-3 (446Hz), PF4-4 (436Hz) were identified.

[0080] In this example, the calculation unit 200 compares the identified first peak frequency PF3-1 with the frequencies associated with each pitch name, and determines the frequency (here, 587.330 Hz) with which the value is most similar as the first frequency F3-1. Then, the calculation unit 200 identifies the pitch name N3-1 (here, D5) with which the first frequency F3-1 is associated. Similarly, the calculation unit 200 compares the identified first peak frequencies PF3-2 to PF3-4 with the frequencies associated with each pitch name, and determines the frequency with which each value is most similar as the first frequencies F3-2 to F3-4. Then, the calculation unit 200 identifies the pitch names N3-2 to N3-4 with which the first frequencies F3-2 to F3-4 are associated (see FIG. 9).

[0081] Thereafter, the calculation unit 200 calculates a difference value D3-1 (here, +7.853 cents) between the identified first peak frequency PF3-1 (590 Hz) and the found first frequency F3-1 (587.330 Hz). Similarly, the calculation unit 200 calculates difference values ​​D3-2 to D3-4 between the identified first peak frequencies PF3-2 to PF3-4 and the found first frequencies F3-2 to F3-4 (see FIG. 9). The difference values ​​D3-1 to D3-4 correspond to the "first difference value."

[0082] The calculation unit 200 also compares the identified second peak frequency PF4-1 with the frequencies associated with each pitch name, and determines the frequency (here, 440 Hz) with which the value is most similar as the second frequency F4-1. The calculation unit 200 then identifies the pitch name N4-1 (here, A4) with which the second frequency F4-1 is associated. Similarly, the calculation unit 200 compares the identified second peak frequencies PF4-2 to PF4-4 with the frequencies associated with each pitch name, and determines the frequency with which the respective values ​​are most similar as the second frequencies F4-2 to F4-4. The calculation unit 200 then identifies the pitch names N4-2 to N4-4 with which the second frequencies F4-2 to F4-4 are associated (see FIG. 9).

[0083] Thereafter, the calculation unit 200 calculates a difference value D4-1 (here, −39.800 cents) between the identified second peak frequency PF4-1 (430 Hz) and the obtained second frequency F4-1 (440 Hz). Similarly, the calculation unit 200 calculates difference values ​​D4-2 to D4-4 between the identified second peak frequencies PF4-2 to PF4-4 and the obtained second frequencies F4-2 to F4-4 (see FIG. 9). The difference values ​​D4-1 to D4-4 correspond to the “second difference value.”

[0084] If the difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch (Y in step 24), and if the note names of the first frequency and the second frequency match the note names of scale notes corresponding to chord information in a certain singing section (Y in step 25), the second judgment unit 500 judges whether the first difference value and the second difference value each satisfy a predetermined condition.

[0085] 9, the second judgment unit 500 obtains the difference between the first frequency F3-1 and the second frequency F4-1 and compares it with the predetermined pitch. In this example, the difference is 500 cents (a perfect fourth), which satisfies the condition of being equal to or greater than the predetermined pitch (300 cents).

[0086] Next, the second judgment unit 500 refers to the chord information of the singing section S and checks whether or not there is a note name that matches the note name N3-1 (D5) of the first frequency F3-1 among the note names of the scale constituent notes associated with the chord information.

[0087] Here, it is assumed that the chord information of the singing section S is "Am." In this case, the scale notes shown in Fig. 7 correspond to the chord information "Am." Therefore, the second judgment unit 500 judges that the note name N3-1 (D5) matches the note name (D5) of the scale note corresponding to the chord information of the singing section S.

[0088] In this case, the second determination section 500 determines whether the difference value D3-1 between the first peak frequency PF3-1 and the first frequency F3-1 satisfies a predetermined condition. In this example, the difference value D3-1 (+7.853 cents) satisfies the predetermined condition (within ±30 cents).

[0089] By performing similar processing, the second judgment unit 500 judges that each of the note names N3-2 to N3-4 matches the note names of the scale notes corresponding to the chord information of the singing section S. The second judgment unit 500 also judges that each of the difference values ​​D3-2 to D3-4 satisfies a predetermined condition (within ±30 cents).

[0090] On the other hand, the second judgment unit 500 refers to the chord information of the singing section S and checks whether or not there is a note name among the note names of the scale constituent notes associated with the chord information that matches the note name N4-1 (A4) of the second frequency F4-1.

[0091] Here, the chord information of the singing section S is “Am.” Therefore, the second determination unit 500 determines that the note name N4-1 (A4) matches the note name (A4) of the scale note corresponding to the chord information of the singing section S.

[0092] In this case, the second judgment section 500 judges whether the difference value D4-1 between the second peak frequency PF4-1 and the second frequency F4-1 satisfies a predetermined condition. In this example, the difference value D4-1 (-39.800 cents) satisfies the predetermined condition (within ±45 cents).

[0093] By performing similar processing, the second judgment unit 500 judges that each of the note names N4-2 to N4-4 matches the note names of the scale notes corresponding to the chord information of the singing section S. The second judgment unit 500 also judges that each of the difference values ​​D4-2 to D4-4 satisfies a predetermined condition (within ±45 cents).

[0094] If it is determined that the first difference value and the second difference value each satisfy a predetermined condition (Y in step 26), the evaluation section 400 performs a point addition process when performing a scoring process for the song X (point addition process; step 27).

[0095] As described above, it is assumed that the difference values ​​D3-1 to D3-4 and the difference values ​​D4-1 to D4-4 are determined to satisfy the predetermined conditions. In this case, the evaluation unit 400 adds a predetermined number of points to the score value of the singing section S, for example.

[0096] Karaoke device K repeats the processes from step 21 to step 27 until the karaoke performance of song X is completed (Y in step 28). If the answer is N in steps 21, 24, 25, and 26 (i.e., if vibrato singing is not performed or if vibrato singing is not performed appropriately), evaluation unit 400 does not perform point addition processing and performs only normal scoring processing. If point addition processing is to be performed for the entire song X, evaluation unit 400 performs the process of step 27 after the karaoke performance is completed.

[0097] As is apparent from the above, the karaoke apparatus K according to this embodiment includes an identification unit 100 that, when vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, identifies at least one first peak frequency which is a frequency indicating a peak in the vibrato singing and at least one second peak frequency which is a frequency indicating a valley in the vibrato singing, and a frequency identification unit 102 that calculates the note name of the first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and calculates the note name of the first frequency that is closest to the identified second peak frequency. The system further comprises a calculation unit 200 which calculates a note name of a second frequency which is similar to the first frequency and a second difference value between the second peak frequency and the second frequency, a second judgment unit 500 which judges whether the first difference value and the second difference value each satisfy a predetermined condition when the difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch and when the note name of the first frequency and the note name of the second frequency match the note names of scale notes corresponding to chord information of a certain singing section, and an evaluation unit 400 which performs a point addition process when scoring the song when it is judged that the first difference value and the second difference value each satisfy the predetermined condition.

[0098] When the note names of the first frequency and the second frequency match the note names of the scale tones corresponding to the chord information of a certain singing section, it can be determined that the vibrato singing is performed according to the scale of the music. When the first difference value and the second difference value each satisfy a predetermined condition, it can be determined that the natural vibrato singing (vibrato singing that is not extremely high or low compared to the scale tones) is performed. Furthermore, since the determination is performed only when the difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch, it is possible to perform an evaluation that takes into account vibrato singing with a large change in pitch that is particularly likely to be felt unnatural. Here, according to the karaoke device K of this embodiment, only when the note names of the first frequency and the second frequency match the note names of the scale tones corresponding to the chord information of a certain singing section and when the first difference value and the second difference value each satisfy a predetermined condition, the karaoke device K of this embodiment performs a score addition process for vibrato singing. In other words, according to the karaoke device K of this embodiment, it is possible to appropriately evaluate the vibrato singing.

[0099] <Modification> In the above embodiment, the evaluation unit 400 can perform the point addition process by adding a score calculated based on the first difference value and / or the second difference value to the score value obtained by the scoring process.

[0100] Specifically, the evaluation unit 400 can add a score y1 (=0.5×(1−x1 / z1)) when the average value of the absolute values ​​of the first difference values ​​is x1, and can add a score y2 (=0.5×(1−x2 / z2)) when the average value of the absolute values ​​of the second difference values ​​is x2. That is, when the first peak frequency and the second peak frequency in one vibrato singing completely match the frequencies of the chord constituent notes (or scale constituent notes), the maximum score of “1.0” is added. z1 is the absolute value of a predetermined condition corresponding to the first difference value. z2 is the absolute value of a predetermined condition corresponding to the second difference value.

[0101] For example, in the first embodiment, the average value x1 of the absolute values ​​of the first difference values ​​is 15.728 cents. The average value x2 of the absolute values ​​of the second difference values ​​is 22.706 cents. The absolute value z1 of the predetermined condition corresponding to the first difference value is "30", and the absolute value z2 of the predetermined condition corresponding to the second difference value is "45". Therefore, the score y1 is "0.238", and the score y2 is "0.248".

[0102] For example, the evaluation section 400 can add the score (0.486=0.238+0.248) due to the vibrato singing in the singing section S to the score (85 points) for the entire song X, to calculate a score of 85.486 points.

[0103] The evaluation unit 400 may add only one of the scores y1 and y2 (for example, only the larger one). If it is determined that at least one of the first difference value and the second difference value does not satisfy a predetermined condition, the score based on the difference value that does not satisfy the predetermined condition indicates a negative value. In this case, the evaluation unit 400 may add (i.e., subtract) a score indicating a negative value to the score of the entire song, for example.

[0104] <Other> The above embodiment is presented as an example, and does not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The above embodiment and its modifications are included in the scope of the invention and its equivalents described in the claims, as well as the scope and gist of the invention. [Explanation of symbols]

[0105] 100 Specific section 200 Calculation Section 300 First Judgment Section 400 Evaluation Department 500 Second Judgment Section K Karaoke equipment

Claims

1. an identification unit that, when vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, identifies at least one first peak frequency that is a frequency indicating a peak in the vibrato singing and at least one second peak frequency that is a frequency indicating a valley in the vibrato singing; a calculation unit that calculates a note name of a first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and calculates a note name of a second frequency that is closest to the identified second peak frequency and a second difference value between the second peak frequency and the second frequency; a first determination unit that determines whether or not the first difference value and the second difference value each satisfy a predetermined condition when the note name of the first frequency and the note name of the second frequency match the note names of chord constituent notes corresponding to the chord information of the certain singing section; an evaluation unit that performs a point addition process when performing a scoring process for the song when it is determined that the first difference value and the second difference value each satisfy a predetermined condition; A karaoke device having the above configuration.

2. an identification unit that, when vibrato singing is detected in a singing section of a song based on the singing voice of a user singing karaoke, identifies at least one first peak frequency that is a frequency indicating a peak in the vibrato singing and at least one second peak frequency that is a frequency indicating a valley in the vibrato singing; a calculation unit that calculates a note name of a first frequency that is closest to the identified first peak frequency and a first difference value between the first peak frequency and the first frequency, and calculates a note name of a second frequency that is closest to the identified second peak frequency and a second difference value between the second peak frequency and the second frequency; a second determination unit that determines whether or not each of the first difference value and the second difference value satisfies a predetermined condition when a difference value between the first frequency and the second frequency is equal to or greater than a predetermined pitch and when a note name of the first frequency and a note name of the second frequency match a note name of a scale tone corresponding to chord information of the certain singing section; an evaluation unit that performs a point addition process when performing a scoring process for the song when it is determined that the first difference value and the second difference value each satisfy a predetermined condition; A karaoke device having the above configuration.

3. 3. The karaoke apparatus according to claim 2, wherein the scale constituent tones are any of constituent tones of a plurality of scales including at least a natural scale, a harmonic scale, and a melodic scale, which are set for each piece of music.

4. The karaoke device according to any one of claims 1 to 3, characterized in that, as the point addition process, the evaluation unit adds a point calculated based on the first difference value and / or the second difference value to the score value obtained by the scoring process.

Images