Karaoke device and karaoke system

The karaoke device and system use heart rate monitoring and song data analysis to prevent heart rate spikes by skipping or modifying song sections, ensuring cardiovascular safety during karaoke performance.

JP2025177637APending Publication Date: 2025-12-05DAIICHI KOSHO COMPANY
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024084661
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-05-24
Publication Date
2025-12-05

AI Technical Summary

Technical Problem

Existing karaoke systems do not prevent sudden increases in heart rate during singing, which can be detrimental to users' health.

Method used

A karaoke device and system that includes a heart rate monitor, a server, and a karaoke device, which acquires prohibited singing conditions based on heart rate spikes and song data to prevent users from singing sections that may cause heart rate spikes by either skipping or modifying the song performance.

Benefits of technology

Prevents sudden heart rate increases by identifying and preventing users from singing sections that could trigger such spikes, thereby maintaining cardiovascular stability during karaoke sessions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025177637000001_ABST
    Figure 2025177637000001_ABST
Patent Text Reader

Abstract

To provide a karaoke device which can previously prevent sudden rise of a heart rate when a user performs karaoke singing.SOLUTION: A karaoke device includes: an acquisition part for acquiring a prohibited singing condition including a heart rate sudden rise time, which is a time from a start time to an end time of a section in which a heart rate when a user performs karaoke singing of a certain piece of music suddenly rises, and pitches of a plurality of notes of the certain piece of music included in the section in which the heart rate suddenly rises and an order of the pitches; and a performance processing part for inhibiting karaoke performance of a prohibited singing section corresponding to the prohibited singing condition of the user when the user selects one piece of music for karaoke singing.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a karaoke device and a karaoke system. [Background technology]

[0002] Patent document 1 discloses a technology that displays vital signs (blood pressure, heart rate, blood oxygen saturation, body temperature) detected while the singer is singing, thereby drawing attention to the singer's health condition and providing an opportunity to check information to maintain and improve it. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-134599 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide a karaoke device and a karaoke system that can prevent a sudden rise in the heart rate when a user sings karaoke. [Means for solving the problem]

[0005] One invention for achieving the above object is a karaoke device having an acquisition unit that acquires prohibited singing conditions including a heart rate spike time, which is the time from the start time to the end time of a section in which the heart rate spikes when a user sings karaoke of a certain song, and the pitches and order of the pitches of multiple notes of the certain song included in the section in which the heart rate spikes, and a performance processing unit that, when the user selects a song to sing karaoke, prohibits the user from performing karaoke in the prohibited singing section that meets the prohibited singing conditions. Another invention for achieving the above object is a karaoke system including a heart rate measuring device for measuring a user's heart rate, a server device, and a karaoke device, wherein the karaoke device has an acquisition unit that acquires prohibited singing conditions including a heart rate spike time, which is the time from the start time to the end time of a section in which the heart rate spikes when the user sings karaoke of a certain song, and the pitches and order of the pitches of multiple notes of the certain song included in the section in which the heart rate spikes, and a performance processing unit that, when the user selects a song to sing karaoke, prohibits the user from performing karaoke in the prohibited singing section that meets the prohibited singing conditions. Other features of the present invention will become apparent from the following description and drawings. [Effects of the Invention]

[0006] According to the present invention, a sudden rise in the heart rate can be prevented when a user sings karaoke. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing a karaoke system according to an embodiment; [Figure 2] 1 is a diagram showing a karaoke device according to an embodiment; [Figure 3] 1 is a diagram showing a karaoke machine main body according to an embodiment; [Figure 4] FIG. 10 is a diagram showing reference data according to the embodiment. [Figure 5] 4 is a flowchart showing the process of the karaoke device according to the embodiment. [Figure 6] FIG. 10 is a diagram showing transition data according to the embodiment. [Figure 7] FIG. 10 is a diagram showing note numbers, pitches of each note, sounding start times, and sounding end times of a piece of music X according to an embodiment. [Figure 8] FIG. 10 is a diagram showing prohibited singing conditions according to the embodiment. [Figure 9] 4 is a flowchart showing the process of the karaoke device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] <Embodiment> A karaoke device and a karaoke system according to an embodiment will be described with reference to FIGS.

[0009] ==Karaoke System== The karaoke system includes a heart rate monitor, a server device, and a karaoke device, which are communicatively connected to each other.

[0010] The heart rate monitor is a device for measuring the heart rate of a user. The heart rate monitor may be a portable device such as a smartwatch owned by the user, or a heart rate monitor installed in the karaoke room where the karaoke machine is installed. Alternatively, as described in JP 2005-134599 A, the microphone of the karaoke machine may have the function of a heart rate monitor.

[0011] The server device is a device for managing various information in the karaoke system. The server device according to this embodiment can also execute some of the same processes as the karaoke device (details will be described later).

[0012] A karaoke machine is a device that allows users to sing karaoke songs and play karaoke music.

[0013] As shown in FIG. 1, the karaoke system 1 according to this embodiment includes a heart rate measuring device HRM, a server device S, and a karaoke device K.

[0014] ==Karaoke Equipment== As shown in FIG. 2, the karaoke device K includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0015] The karaoke machine 10 controls various aspects of karaoke performance and singing, such as controlling the karaoke performance of the selected song, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke machine 10. The display device 30 is configured to display videos and images on a screen based on the signal from the karaoke machine 10. The microphone 40 is configured to convert the singing voice of the user into an analog audio signal and input it to the karaoke machine 10. The remote control device 50 is a device for performing various operations on the karaoke machine 10.

[0016] 3, the karaoke machine 10 according to this embodiment includes a storage unit 10a, a communication unit 10b, an input unit 10c, a performance unit 10d, and a control unit 10e. Each component is connected to a bus B via an interface (not shown).

[0017] [Storage means] The storage means 10a is a large-capacity storage device that stores various types of data, including music data.

[0018] The song data is provided with song identification information for identifying each song. The song identification information is information unique to each song, such as a song ID for identifying the song. The song data includes accompaniment data, reference data, section information, etc. The accompaniment data is data that forms the basis of the karaoke performance sound. The reference data is data that indicates the singing melody of the song performed karaoke, and is data used when evaluating the user's karaoke singing.

[0019] The reference data consists of multiple notes (musical notes), and each note has a note number, pitch, sounding start time (so-called note-on) and sounding end time (so-called note-off). The note number indicates the order of the notes. For example, the note number corresponding to the first note of a song is "1." The sounding start time and sounding end time are indicated by a time reference (0) that is the start time of the karaoke performance of the song.

[0020] 4 shows an example of reference data for song M1. For example, note No. 1 has a pitch of "E3," a sound start time of "0 msec," and a sound end time of "500 mec," while note No. n has a pitch of "E4," a sound start time of "45000 msec," and a sound end time of "47000 mec."

[0021] The section information indicates a performance section. A performance section is a section in which karaoke performance is performed. A performance section includes a singing section and a non-singing section. A singing section is a section in which lyrics to be sung are set in a song (for example, the A-melody, B-melody, or chorus of the first verse, or even a more detailed phrase unit). A non-singing section is a section in which lyrics to be sung are not set in a song, such as an introduction, interlude, or postlude. Each performance section is associated with a performance start time and a performance end time. The performance start time is the time when karaoke performance for a certain performance section starts. The performance end time is the time when karaoke performance for a certain performance section ends. The performance start time and performance end time are indicated using the start of the karaoke performance as the reference time (i.e., "0")

[0022] The storage means 10a stores lyric data for displaying lyrics corresponding to each song on the display device 30 or the like in sync with the karaoke performance, background video data such as background video to be displayed on the display device 30 or the like during the karaoke performance, and song attribute information (song title, singer name, genre, performance time, etc.). The lyric data is associated with a display start time and a display end time. The display start time is the time when the display of certain lyrics (lyric characters or a sentence consisting of multiple lyric characters) begins. The display end time is the time when the display of certain lyrics ends. The display start time and display end time are indicated using the start of the karaoke performance as the reference time (i.e., "0")

[0023] [Communication means / input means] The communication means 10b provides an interface for communicating with the remote control device 50. The input means 10c is configured to allow the user to input various operations. The input means 10c is a button or the like provided on the karaoke machine main unit 10. Alternatively, the remote control device 50 may function as the input means 10c.

[0024] [Means of performance] Based on the control of the control means 10e, the performance means 10d performs karaoke performance of music pieces and processes audio signals input through the microphone 40. The performance means 10d includes a sound source, a mixer, an amplifier, etc. (none of which are shown).

[0025] [Control means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which is shown). The CPU executes programs stored in the memory to realize various functions.

[0026] In this embodiment, the CPU executes a program stored in the memory, causing the control means 10e to function as an acquisition section 100 and a performance processing section 200 (see FIG. 3).

[0027] (Acquisition Department) The acquisition unit 100 acquires the prohibited singing conditions.

[0028] The prohibited singing conditions include the heart rate sudden rise time, which is the time from the start time to the end time of the section in which the heart rate suddenly rises when the user sings a certain song karaoke, and the pitches of multiple notes of the certain song included in the section in which the heart rate suddenly rises and the order of the pitches (so-called note pattern).

[0029] The singing prohibition conditions can be acquired by various methods. For example, the acquisition unit 100 can determine the singing prohibition conditions using a first threshold determined according to the user's heart rate measured immediately before starting to sing a certain song at karaoke, a second threshold that is lower than the first threshold and indicates a predetermined heart rate, a predetermined time period for determining that the heart rate has suddenly increased, transition data indicating the transition of the heart rate measured while the user is singing the certain song at karaoke, and reference data for the certain song. The acquisition unit 100 acquires the determined singing prohibition conditions.

[0030] The heart rate can be measured by a heart rate measuring device HRM. The heart rate measuring device HRM transmits the measured heart rate together with user identification information and the measurement time to the karaoke device K. The measurement time is expressed as a time reference (0) relative to the start of the karaoke performance of a song. For example, if the heart rate is measured at the start of singing a certain song, the measurement time of the heart rate is "0 msec." The user identification information is information unique to each user, such as a user ID for identifying the user. The first threshold is a value that generally indicates an increased heart rate, such as a value obtained by adding 15 to the heart rate immediately before starting karaoke singing (i.e., at normal times). The second threshold (i.e., a predetermined heart rate) is the intermediate value between the first threshold and the heart rate immediately before starting karaoke singing. The predetermined time is a time, such as 7 seconds or 10 seconds, for determining that the heart rate has suddenly increased. A unique predetermined time is set for each song.

[0031] Specifically, the user operates the remote control device 50, inputs his / her user identification information and password, and then selects the login icon.

[0032] The karaoke device K transmits a login request including the input user identification information and password to the server device S. The server device S completes the login by storing the user identification information and password included in the received login request in a storage means. The server device S transmits a signal to the karaoke device K indicating that the login has been completed.

[0033] Thereafter, the user starts measuring his / her heart rate using the heart rate measuring device HRM immediately before starting to sing a certain song. The heart rate measuring device HRM transmits the measured heart rate together with the user's user identification information and the time of measurement to the karaoke device K. The heart rate measuring device HRM measures the heart rate at predetermined intervals (for example, every second) while the user is singing a certain song.

[0034] The acquisition unit 100 determines a first threshold value based on the heart rate measured immediately before the user starts singing the received karaoke piece of music. The acquisition unit 100 also determines a second threshold value based on the determined first threshold value and the heart rate measured immediately before the user starts singing the received karaoke piece of music. The acquisition unit 100 also generates transition data based on the transition of the heart rate received while the user is singing the karaoke piece of music.

[0035] After the karaoke singing of a certain song is finished, the acquiring unit 100 refers to the transition data and checks whether any heart rate has exceeded the first threshold. If no heart rate has exceeded the first threshold, the acquiring unit 100 does not execute the subsequent processes (i.e., does not determine the prohibited singing conditions for this karaoke singing).

[0036] On the other hand, if there is a heart rate that is equal to or greater than the first threshold, the acquisition unit 100 identifies the measurement time when that heart rate was first measured as the heart rate threshold reaching time.

[0037] Next, the acquisition unit 100 refers to the transition data and checks the heart rate measured before the time when the heart rate threshold was reached. The acquisition unit 100 identifies the measurement time when the heart rate that became the second threshold was measured as the time when the heart rate started to rise.

[0038] The acquisition unit 100 obtains the elapsed time from the time when the heart rate starts to increase to the time when the heart rate reaches the threshold value. The acquisition unit 100 checks whether the elapsed time is less than a predetermined time. If the elapsed time is equal to or greater than the predetermined time, the acquisition unit 100 does not execute the subsequent processing (i.e., does not determine the prohibited singing conditions for the current karaoke singing).

[0039] On the other hand, if the elapsed time is less than the predetermined time, the acquisition unit 100 regards the elapsed time as the heart rate sudden rise time. In other words, the heart rate sudden rise time is the time from the time when the heart rate starts to rise to the time when the heart rate threshold is reached. The heart rate rise start time is the start time of the section in which the heart rate suddenly rose, and the heart rate threshold reach time is the end time of the section in which the heart rate suddenly rose.

[0040] The acquisition unit 100 refers to reference data for a certain piece of music and identifies notes included in the section corresponding to the time of sudden heart rate rise (i.e., the time from the time the heart rate starts to rise to the time the heart rate reaches the threshold value). The acquisition unit 100 can identify notes based on the sounding start time and sounding end time of each note.

[0041] The acquisition unit 100 determines the prohibited singing conditions by associating the pitches corresponding to the identified notes and the order of the pitches with the time period during which the heart rate suddenly increases. The acquisition unit 100 stores the determined prohibited singing conditions in the storage means 10a in association with the user's user identification information. Alternatively, the acquisition unit 100 can transmit the determined prohibited singing conditions to the server device S in association with the user's user identification information. In this case, the server device S stores the received prohibited singing conditions and user identification information.

[0042] In the above example, the prohibited singing conditions are determined after the karaoke singing of a certain song has been completed, but the karaoke device K (acquisition unit 100) can also determine the prohibited singing conditions by performing the above-mentioned process while the karaoke singing of a certain song is being performed.

[0043] Furthermore, by having the server device S execute the above-mentioned process, the prohibited singing conditions can be determined on the server device S side. In this case, the acquisition unit 100 acquires the prohibited singing conditions transmitted from the server device S. When the prohibited singing conditions are determined on the server device S side, the heart rate measuring device HRM transmits the measured heart rate and the measurement time together with the user's user identification information to the server device S.

[0044] (Performance processing unit) The performance processing unit 200 performs karaoke performance of the music piece.

[0045] Specifically, the user operates the remote control device 50, inputs his / her user identification information and password, and then selects the login icon.

[0046] The karaoke device K transmits a login request including the input user identification information and password to the server device S. The server device S completes the login by storing the user identification information and password included in the received login request in a storage means. The server device S transmits a signal to the karaoke device K indicating that the login has been completed.

[0047] Thereafter, a user wishing to sing karaoke operates the remote control device 50 to input search criteria. The search criteria include song title, singer name, genre, era, etc. The karaoke device K extracts songs that match the input search criteria and displays song information (song title and singer name) on the display screen of the remote control device 50. The user refers to the displayed song information and selects a song they wish to sing karaoke. The performance processing unit 200 reads accompaniment data from the storage means 10a based on the song identification information of the selected song. The performance processing unit 200 outputs the read accompaniment data to the performance means 10d and controls the performance means 10d to perform a karaoke performance. The user sings karaoke using the microphone 40 along with the karaoke performance.

[0048] Here, when a user selects a piece of music to sing karaoke, the performance processing unit 200 according to this embodiment prohibits the user from performing karaoke in the prohibited singing section that satisfies the prohibited singing condition of the user.

[0049] A prohibited singing section is a section identified based on the prohibited singing conditions, and is a section in which karaoke performance is prohibited (i.e., a section in which users are not allowed to sing karaoke). A prohibited singing section is associated with a prohibition start time and a prohibition end time. The prohibition start time is the time when the prohibition of karaoke performance begins. The prohibition end time is the time when the prohibition of karaoke performance ends. The prohibition start time and prohibition end time are indicated as times relative to the start of karaoke performance (i.e., "0").

[0050] As described above, when a user selects a song that he or she wishes to sing karaoke, if the selected song contains multiple notes with the same pitches and pitch order as those included in the prohibited singing conditions, and if the total sounding time from the first note to the last note of the multiple notes is longer than the heart rate sudden rise time, and if the total sounding time of notes other than the first and last notes of the multiple notes is shorter than the heart rate sudden rise time, the performance processing unit 200 identifies the section from the first note to the last note as a prohibited singing section.

[0051] The section from the first note to the last note is the section from the sounding start time of the first note to the sounding end time of the last note. In other words, the prohibition start time is the sounding start time of the first note, and the prohibition end time is the sounding end time of the last note.

[0052] Specifically, the performance processing unit 200 reads out the reference data of the selected piece of music from the storage unit 10a. Also, the performance processing unit 200 reads out the prohibited singing conditions from the storage unit 10a (or the server device S) based on the input user identification information.

[0053] The performance processing unit 200 refers to the reference data for the read music piece and checks whether it contains the same pitches and pitch order of the multiple notes as those included in the prohibited singing conditions. If the reference data contains the same pitches and pitch order of the multiple notes as those included in the prohibited singing conditions, the performance processing unit 200 calculates the total sounding time from the first note to the last note of the multiple notes. The performance processing unit 200 checks whether the calculated total is longer than the heart rate sudden rise time. Furthermore, the performance processing unit 200 calculates the total sounding time of the multiple notes other than the first and last notes. The performance processing unit 200 checks whether the calculated total is shorter than the heart rate sudden rise time.

[0054] The performance processing unit 200 identifies the section from the first note to the last note as a prohibited singing section when the section includes the same pitches and pitch order as the pitches and pitch order of the multiple notes included in the prohibited singing conditions, the total sounding time from the first note to the last note among the multiple notes is longer than the heart rate sudden rise time, and the total sounding time of notes other than the first note and the last note among the multiple notes is shorter than the heart rate sudden rise time.

[0055] The performance processing unit 200 performs the above process for all notes in a song. As a result, multiple prohibited singing sections may be identified in a song. Furthermore, if there are multiple prohibited singing conditions, the performance processing unit 200 performs the above process for each prohibited singing condition.

[0056] When a prohibited singing section is identified, the performance processing section 200 prohibits the karaoke performance of the prohibited singing section when causing the performance means 10d to perform karaoke performance of a piece of music.

[0057] Prohibiting karaoke performance can be achieved in various ways. For example, when performing karaoke of a song, the performance processing unit 200 can skip the karaoke performance of the prohibited singing section, thereby prohibiting the karaoke performance of the prohibited singing section. Specifically, the performance processing unit 200 monitors the time from the start of the karaoke performance of the song, and when the prohibition start time associated with the prohibited singing section arrives, controls the performance unit 10d to skip the karaoke performance until the prohibition end time associated with the prohibited singing section. If a song has multiple prohibited singing sections, the performance processing unit 200 repeats the above process for each prohibited singing section. Note that song data includes lyric data and background video data in addition to accompaniment data. Therefore, when a karaoke performance is skipped, the corresponding lyrics and background video are also skipped.

[0058] Alternatively, the performance processing unit 200 can prohibit karaoke performance of the prohibited singing section by performing karaoke based on new accompaniment data for the song generated without including the prohibited singing section. Specifically, the performance processing unit 200 references the accompaniment data for the song and cuts the accompaniment data from the prohibition start time to the prohibition end time associated with the prohibited singing section. The performance processing unit 200 generates new accompaniment data by splicing together the accompaniment data before and after the cut. The process of generating new accompaniment data can be based on, for example, the editing process for medley songs described in Japanese Patent Application Laid-Open No. 2000-148167. The performance processing unit 200 outputs the generated new accompaniment data to the performance means 10d and controls the performance means 10d to perform karaoke.

[0059] ==About the operation of the Karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to FIGS. 5 to 9. FIG. 5 is a flowchart showing an example of the operation of the karaoke device K to acquire prohibited singing conditions. FIG. 6 is an example of progression data when a user U sings a song X. FIG. 7 is an example showing the note numbers, pitches of each note, and the start and end times of pronunciation of the song X. FIG. 8 is an example of prohibited singing conditions acquired when a user U sings a song X, stored in the storage means 10a. FIG. 9 is a flowchart showing an example of the operation of the karaoke device K to prohibit a karaoke performance reservation. In this example, it is assumed that the user U has completed logging in to the karaoke device K. It is also assumed that the predetermined time for the song X is "7000 msec." The storage means 10a also stores reference data for the song M1 shown in FIG. 4.

[0060] [Acquire the forbidden singing conditions] User U starts measuring his / her heart rate using the heart rate measuring device HRM immediately before starting to sing karaoke of song X. The heart rate measuring device HRM transmits the measured heart rate and the measurement time together with user U's user ID ***U to karaoke device K. The acquisition unit 100 sequentially acquires the heart rates transmitted from the heart rate measuring device HRM (acquires the measured heart rates; step 10).

[0061] The acquisition unit 100 determines the prohibited singing conditions C (determine prohibited singing conditions; step 11) using a first threshold SH1 determined according to the heart rate of the user U measured immediately before starting to sing karaoke the song X, a second threshold SH2 that is lower than the first threshold SH1 and indicates a predetermined heart rate, a predetermined time (7000 msec) for determining that the heart rate has suddenly increased, transition data TD indicating the transition of the heart rate measured while the user U is singing karaoke the song X, and reference data for the song X. The acquisition unit 100 acquires the determined prohibited singing conditions C (acquire prohibited singing conditions; step 12). The acquisition unit 100 stores the determined prohibited singing conditions C in the storage means 10a in association with the user ID ***U of the user U.

[0062] Specifically, suppose that the heart rate of user U measured immediately before starting to sing karaoke the song X is "85." In this case, the acquisition unit 100 adds "15" to this heart rate to determine "100" as the first threshold SH1. The acquisition unit 100 then determines "93," which is the intermediate value between the determined first threshold SH1 value "100" and the user U's heart rate of "85" measured immediately before starting to sing karaoke the song X, as the second threshold SH2. The acquisition unit 100 also generates transition data TD (see FIG. 6) based on the transition of the heart rate received while user U is singing karaoke the song X.

[0063] The acquisition unit 100 refers to the transition data TD and checks whether or not there is a heart rate that is equal to or greater than the first threshold value SH1.

[0064] 6, the heart rate reaches "100" at 60,000 msec after the start of karaoke singing. Therefore, the acquisition unit 100 determines that there is a heart rate that is equal to or greater than the first threshold SH1. In this case, the acquisition unit 100 identifies "60,000 msec," the measurement time when the heart rate "100" was first measured, as the heart rate threshold reaching time t1.

[0065] Next, the acquisition unit 100 refers to the transition data TD and checks the heart rate measured before the heart rate threshold arrival time t2.

[0066] 6, the heart rate reaches 93 at 55,000 msec after the start of karaoke singing. In this case, the acquisition unit 100 identifies 55,000 msec, the measurement time when the heart rate reached the second threshold SH2, as the time t2 when the heart rate began to rise.

[0067] The acquisition unit 100 obtains the elapsed time PT from the time t2 when the heart rate starts to increase to the time t1 when the heart rate reaches the threshold value. The acquisition unit 100 checks whether the elapsed time PT is less than a predetermined time.

[0068] In this example, the elapsed time PT from the heart rate rise start time t2 to the heart rate threshold reaching time t1 is 5000 msec. Therefore, the acquisition unit 100 confirms that the elapsed time PT is less than the predetermined time (7000 msec). In this case, the acquisition unit 100 regards the elapsed time PT as the heart rate sudden rise time ST.

[0069] The acquisition unit 100 refers to the reference data of the song X and identifies the notes (note No. n53 to note No. n57) included in the section corresponding to the heart rate sudden rise time ST (i.e., the time from the heart rate rise start time t2 to the heart rate threshold reaching time t1) (see FIG. 7).

[0070] The acquisition unit 100 determines the prohibited singing condition C by associating the pitches corresponding to the identified notes (note No. n53 to note No. n57) and the order of the pitches (pitch "E4" is No. 1, pitch "E4" is No. 2, pitch "F4" is No. 3, pitch "G4" is No. 4, and pitch "B4" is No. 5) with the heart rate sudden rise time ST (5000 msec). The acquisition unit 100 stores the determined prohibited singing condition C in the storage means 10a in association with the user ID of the user U (see FIG. 8).

[0071] [Karaoke is prohibited] The user U operates the remote control device 50 to input any search criteria. The karaoke device K extracts songs that match the input search criteria and displays song information on the display screen of the remote control device 50. The user U refers to the displayed song information and selects a song that they wish to sing karaoke (selecting a song; step 20). The performance processing unit 200 reads reference data for the selected song from the storage means 10a. The performance processing unit 200 also reads out the prohibited singing conditions C from the storage means 10a based on the user U's user ID ***U.

[0072] In a piece of music selected in step 20, if the music contains multiple notes with the same pitches and pitch order as the multiple notes included in the prohibited singing condition C, and the total sounding time from the first note to the last note among the multiple notes is longer than the heart rate sudden rise time, and the total sounding time of notes other than the first note and the last note among the multiple notes is shorter than the heart rate sudden rise time, the performance processing unit 200 identifies the section from the first note to the last note as the prohibited singing section PS (identifying the prohibited singing section; step 21).

[0073] The performance processing unit 200 prohibits the karaoke performance of the prohibited singing section PS that satisfies the prohibited singing condition C for the one piece of music selected by the user U (prohibiting the karaoke performance of the prohibited singing section; step 22).

[0074] Specifically, the user U operates the remote control device 50 and inputs the search criteria "artist Y." The karaoke device K extracts songs that meet the input search criteria and displays song information on the display screen of the remote control device 50. The user U refers to the displayed song information and selects song M1 as the song he or she wishes to sing karaoke. The performance processing unit 200 reads out reference data for the selected song M1 from the storage means 10a. The performance processing unit 200 also reads out the prohibited singing conditions C (see FIG. 8) from the storage means 10a based on the input user ID ***U.

[0075] The performance processing unit 200 refers to the read reference data for the musical piece M1 and checks whether the reference data contains the same pitches and pitch order of the multiple notes as those included in the prohibited singing condition C (pitch "E4" as 1, pitch "E4" as 2, pitch "F4" as 3, pitch "G4" as 4, and pitch "B4" as 5). The performance processing unit 200 checks, for example, whether the reference data for the musical piece M1 contains the same pitches and pitch order of the multiple notes included in the prohibited singing condition C, i.e., the note pattern that matches the note pattern of the prohibited singing condition C. According to the examples of Figures 4 and 8, note patterns that match the note pattern of prohibited singing condition C (pitch "E4" is number 1, pitch "E4" is number 2, pitch "F4" is number 3, pitch "G4" is number 4, and pitch "B4" is number 5) are included in the reference data of song M1 (from note No. n to note No. n+4).

[0076] In this case, the performance processing unit 200 refers to the reference data of the song M1 and calculates the total sounding time of the multiple notes (note No. n to note No. n+4) from the first note (note No. n) to the last note (note No. n+4), which is "8000 msec." The performance processing unit 200 checks whether the calculated total value "8000 msec" is longer than the heart rate sudden rise time ST. Here, the heart rate sudden rise time ST included in the prohibited singing condition C is "5000 msec." Therefore, the performance processing unit 200 can confirm that the calculated total value "8000 msec" is longer than the heart rate sudden rise time ST (5000 msec).

[0077] Furthermore, the performance processing unit 200 calculates the total sounding time of all notes (note No. n to note No. n+4) other than the first note (note No. n) and the last note (note No. n+4) (i.e., notes No. n+1 to note No. n+3) to be "4000 msec." The performance processing unit 200 checks whether the calculated total value "4000 msec" is less than the heart rate sudden rise time ST. Here, the heart rate sudden rise time ST included in the prohibited singing condition C is "5000 msec." Therefore, the performance processing unit 200 can confirm that the calculated total value "4000 msec" is less than the heart rate sudden rise time ST (5000 msec).

[0078] As described above, the musical piece M1 includes multiple note pitches and pitch sequences identical to those included in the prohibited singing condition C, and the total sounding time from the first note to the last note is longer than the heart rate sudden rise time ST, and the total sounding time of notes other than the first and last notes is shorter than the heart rate sudden rise time ST. Therefore, the performance processing unit 200 identifies the section from the first note to the last note (specifically, the section from the sounding start time of note No. n, 45,000 msec, to the sounding end time of note No. n+4, 53,000 msec) as the prohibited singing section PS. The sounding start time of note No. n, 45,000 msec, is the prohibition start time, and the sounding end time of note No. n+4, 53,000 msec, is the prohibition end time.

[0079] If a prohibited singing section PS is identified, the performance processing unit 200 prohibits the performance means 10d from performing karaoke in the prohibited singing section PS when causing the performance means 10d to perform karaoke of the song M1. For example, when performing karaoke of the song M1, the performance processing unit 200 controls the performance means 10d so that, when the sounding start time of note No. n arrives, the karaoke performance is skipped until the sounding end time of note No. n+4.

[0080] Alternatively, the performance processing unit 200 can prohibit karaoke performance of the prohibited singing section PS by performing karaoke based on new accompaniment data of the song M1 generated by excluding the prohibited singing section PS. For example, the performance processing unit 200 references the accompaniment data of the song M1 and cuts the accompaniment data from the prohibition start time (45,000 msec) to the prohibition end time (53,000 msec) associated with the prohibited singing section PS. The performance processing unit 200 generates new accompaniment data by splicing together the accompaniment data before and after the cut. The performance processing unit 200 outputs the generated new accompaniment data to the performance means 10d and controls the performance means 10d to perform karaoke.

[0081] As is clear from the above, the karaoke device K of this embodiment has an acquisition unit 100 that acquires prohibited singing conditions including the heart rate spike time, which is the time from the start time to the end time of the section in which the heart rate spikes when a user sings karaoke of a certain song, and the pitches and order of the pitches of multiple notes of the certain song included in the section in which the heart rate spikes, and a performance processing unit 200 that, when a user selects a song to sing karaoke, prohibits the user from performing karaoke in the prohibited singing section that meets the prohibited singing conditions.

[0082] With this karaoke device K, when a user sings a selected song, the user can be prohibited from singing the prohibited section that satisfies the prohibited singing condition. This prevents the user from singing the section that is likely to cause a sudden rise in heart rate. In other words, the karaoke device K according to this embodiment can prevent a sudden rise in heart rate when the user sings karaoke.

[0083] The acquisition unit 100 of the karaoke machine K according to this embodiment can acquire singing prohibition conditions determined using a first threshold determined based on the user's heart rate measured immediately before starting to sing a certain song, a second threshold that is lower than the first threshold and indicates a predetermined heart rate, a predetermined time period for determining that the heart rate has suddenly increased, transition data indicating the transition of the heart rate measured while the user is singing the certain song, and reference data for the certain song. The karaoke machine K can acquire singing prohibition conditions based on the user's actual heart rate.

[0084] Furthermore, the performance processing unit 200 of the karaoke device K according to this embodiment can identify the section from the first note to the last note as a prohibited singing section when a song contains multiple note pitches and pitch orders that are the same as the multiple note pitches and pitch order included in the prohibited singing conditions, and the total sounding time from the first note to the last note of the multiple notes is longer than the heart rate sudden rise time, and the total sounding time of notes other than the first and last notes of the multiple notes is shorter than the heart rate sudden rise time. This karaoke device K can accurately identify the prohibited singing section.

[0085] Furthermore, the performance processing unit 200 of the karaoke device K according to this embodiment can prohibit the karaoke performance of a prohibited section by skipping the prohibited section when performing karaoke of a certain song. Alternatively, the performance processing unit 200 of the karaoke device K according to this embodiment can prohibit the karaoke performance of the prohibited section by performing karaoke based on new accompaniment data for the certain song that has been generated without the prohibited section. In this way, the karaoke device K according to this embodiment can prohibit the karaoke performance of the prohibited section by various methods.

[0086] The karaoke system 1 according to this embodiment includes a heart rate monitor HRM for measuring a user's heart rate, a server S, and a karaoke machine K. The karaoke machine K includes an acquisition unit 100 for acquiring prohibited singing conditions, including a heart rate spike time, which is the time from the start to the end of a section in a song where the user's heart rate spikes when singing karaoke, and the pitches and order of the notes in the song included in the section in which the heart rate spikes. The performance processing unit 200 also includes a processing unit 200 for prohibiting a user from performing karaoke in a section that meets the prohibited singing conditions when the user selects a song for karaoke singing. The karaoke system 1 thus configured can prevent a sudden rise in the user's heart rate when singing karaoke based on the prohibited singing conditions acquired based on the user's actual heart rate measured by the heart rate monitor HRM.

[0087] <Modification> In some embodiments, karaoke performance may be prohibited for only a portion of a singing section (for example, only a portion of the bridge of the first verse). In such cases, the user may find it difficult to sing karaoke. Therefore, in this modified example, an example will be described in which karaoke performance is prohibited using the section information and / or the timing of displaying lyrics of a song.

[0088] When performing karaoke for a song, the performance processing unit 200 of this modified example can prohibit the karaoke performance of a specified section including a prohibited singing section by skipping the karaoke performance of the prohibited singing section based on the section information of the song and / or the display timing of the lyric subtitles.

[0089] The predetermined section is a section that is considered to be a good division in terms of the composition of a piece of music. Specifically, the predetermined section is a certain performance section (a section from the start time of the first note in a certain performance section to the end time of the last note in that performance section), or a section in which certain lyrics are displayed (a section from the start time of the display of certain lyrics to the end time of the display of certain lyrics).

[0090] For example, suppose that a prohibited singing section PS has been identified as described in the embodiment. The performance processing unit 200 references the section information of the song M1 and extracts a performance section that includes the prohibited singing section PS (the section from note No. n to note No. n+4). When performing karaoke of the song M1, the performance processing unit 200 controls the performance means 10d so that, when the sounding start time of the first note included in the extracted performance section arrives, the karaoke performance of the extracted performance section is skipped until the sounding end time of the last note included in the extracted performance section.

[0091] Furthermore, it is assumed that the prohibited singing section PS has been identified as described in the embodiment. The performance processing unit 200 references the timing of the lyrics display of the song M1 and extracts a section in which lyrics including the lyrics of the prohibited singing section PS (lyrics corresponding to note No. n to note No. n+4) are displayed. When performing karaoke of the song M1, the performance processing unit 200 controls the performance means 10d so that, when the pronunciation start time of the first note included in the section in which the extracted lyrics are displayed arrives, the karaoke performance is skipped until the pronunciation end time of the last note included in the section in which the extracted lyrics are displayed.

[0092] Alternatively, the performance processing unit 200 of this modified example can prohibit karaoke performance in the prohibited singing section by performing karaoke based on new accompaniment data for a song that is generated by excluding the section including the prohibited singing section identified based on the section information and / or the display timing of the lyrics of the song.

[0093] For example, assume that a prohibited singing section PS has been identified as described in the embodiment. The performance processing unit 200 references the accompaniment data and section information of the song M1 to identify a performance section that includes accompaniment data from the prohibited start time to the prohibited end time that is associated with the prohibited singing section PS. The performance processing unit 200 cuts the identified performance section. The performance processing unit 200 generates new accompaniment data by splicing together the accompaniment data before and after the cut. The performance processing unit 200 outputs the generated new accompaniment data to the performance means 10d and controls the performance means 10d to perform karaoke.

[0094] Also, assume that the prohibited singing section PS has been identified as described in the embodiment. The performance processing unit 200 references the accompaniment data of the song M1 and the timing of displaying the lyrics to identify a section in which lyrics including the lyrics of the prohibited singing section PS are to be displayed. The performance processing unit 200 cuts the identified section. The performance processing unit 200 generates new accompaniment data by splicing together the accompaniment data before and after the cut. The performance processing unit 200 outputs the generated new accompaniment data to the performance means 10d and controls the performance means 10d to perform karaoke.

[0095] As is clear from the above, the performance processing unit 200 according to this modification can prohibit karaoke performance of a specific section including a prohibited singing section by skipping the karaoke performance of the specific section based on the section information and / or the display timing of the lyrics of the specific song. Alternatively, the performance processing unit 200 according to this modification can prohibit karaoke performance of the specific section by performing karaoke performance based on new accompaniment data for the specific song that is generated by excluding the section including the prohibited singing section identified based on the section information and / or the display timing of the lyrics of the specific song. As described above, the karaoke device K according to this modification can prohibit karaoke performance of a specific section including a prohibited singing section by various methods. This makes it easier for users to sing karaoke.

[0096] <Other> The program can also be supplied to a computer using a non-transitory computer-readable medium with an executable program stored thereon. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), CD-ROMs (Read Only Memory), etc.

[0097] The above-described embodiments are presented as examples and do not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The above-described embodiments and their modifications are included in the scope and spirit of the invention, as well as in the inventions described in the claims and their equivalents. [Explanation of symbols]

[0098] 100 Acquisition Department 200 Performance processing unit K Karaoke equipment

Claims

1. an acquisition unit that acquires prohibited singing conditions including a heart rate spike time, which is the time from the start time to the end time of a section in which the heart rate spikes when the user sings a certain song karaoke, and pitches and the order of pitches of multiple notes of the certain song included in the section in which the heart rate spikes; a performance processing unit that, when the user selects one piece of music to be karaoke-sung, prohibits the user from performing karaoke in a prohibited singing section that satisfies the prohibited singing condition; A karaoke device having:

2. 2. The karaoke device according to claim 1, wherein the acquisition unit acquires the prohibited singing conditions determined using a first threshold determined in accordance with the user's heart rate measured immediately before starting to sing the certain song, a second threshold that is lower than the first threshold and indicates a predetermined heart rate, a predetermined time period for determining that the heart rate has suddenly increased, trend data indicating the trend in the heart rate measured while the user is singing the certain song, and reference data for the certain song.

3. 2. The karaoke device of claim 1, wherein the performance processing unit identifies the section from the first note to the last note as the prohibited singing section when the pitches and pitch order of the multiple notes in the one song are the same as the pitches and pitch order of the multiple notes included in the prohibited singing condition, and when the total sounding time from the first note to the last note among the multiple notes is longer than the heart rate sudden rise time and the total sounding time of notes other than the first note and the last note among the multiple notes is shorter than the heart rate sudden rise time.

4. 4. The karaoke apparatus according to claim 1, wherein the performance processing unit, when performing karaoke of the one piece of music, skips the karaoke performance of the prohibited singing section, thereby prohibiting the karaoke performance of the prohibited singing section.

5. 4. The karaoke apparatus according to claim 1, wherein the performance processing unit prohibits karaoke performance of the prohibited singing section by performing karaoke based on new accompaniment data for the one piece of music generated by excluding the prohibited singing section.

6. The karaoke device of any one of claims 1 to 3, characterized in that, when performing karaoke of the one song, the performance processing unit skips the karaoke performance of a predetermined section including the prohibited singing section based on the section information and / or the display timing of the lyrics of the one song, thereby prohibiting the karaoke performance of the prohibited singing section.

7. The karaoke device of any one of claims 1 to 3, characterized in that the performance processing unit prohibits karaoke performance of the prohibited singing section by performing karaoke based on new accompaniment data for the one song generated by excluding the section including the prohibited singing section identified based on the section information and / or the display timing of the lyrics of the one song.

8. A karaoke system including a heart rate measuring device for measuring the heart rate of a user, a server device, and a karaoke device, The karaoke device an acquisition unit that acquires prohibited singing conditions including a heart rate spike time, which is the time from the start time to the end time of a section in which the heart rate spikes when the user sings a certain song karaoke, and pitches and the order of pitches of multiple notes of the certain song included in the section in which the heart rate spikes; a performance processing unit that, when the user selects one piece of music to be karaoke-sung, prohibits the user from performing karaoke in a prohibited singing section that satisfies the prohibited singing condition; A karaoke system having:

Citation Information

Patent Citations

  • Karaoke system having vital detection function

    JP2005134599A