Karaoke System
The karaoke system addresses the lack of user information by selecting and storing excellent singing voice data and generating user video data with tips, enhancing user trust and motivation through easy communication of model singer information.
Patent Information
- Application Number
- JP2021028968
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-25
- Publication Date
- 2024-12-09
- Estimated Expiration
- 2041-02-25
AI Technical Summary
Existing karaoke systems lack the ability to provide specific information about the user who performed an excellent singing role as a model, which hinders user trust, affinity, and motivation for practicing singing.
A karaoke system that includes a server device and karaoke devices connected via a network, which selects and stores excellent singing voice data, generates user identification information, and creates video data of the user providing singing tips and comments, allowing easy communication of this information to other users.
Enables easy conveyance of specific information about the model singer, enhancing user trust and motivation by providing singing tips and comments, thereby improving the singing experience.
Smart Images

Figure 0007596033000001 
Figure 0007596033000002 
Figure 0007596033000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a karaoke system having a function of providing a user with a model singing voice. [Background technology]
[0002] A service that allows other users of a karaoke system to use the excellent singing voice of a user as a model for singing is becoming popular. In this service, the singing voices of multiple users of the karaoke system, each singing to a karaoke song, are stored and collected, and the best singing voice is selected from the collected singing voices of the multiple users. The selected singing voice is made available for playback along with the song when the other users sing the song. The other users can easily grasp the tricks of singing by listening to the selected singing voice or singing while listening to the selected singing voice. The following Patent Document 1 describes a technology related to such a service. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2003-91291 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, other users who have listened to a user's excellent singing voice as a singing model may want to know more about the user who sang the excellent voice. By conveying specific information about the user who sang the excellent voice to other users, the other users may develop trust or affinity with the user who sang the excellent voice, and the other users may become more motivated or enjoy practicing singing. For example, if the user who sang the excellent voice can convey to other users the singing tips that he or she thinks are important or points to be careful about when singing, the other users may obtain information that is useful for practicing singing.
[0005] The present invention has been made in consideration of the problems such as those mentioned above, and an object of the present invention is to provide a karaoke system that makes it possible to easily communicate specific information about a user who has performed an exemplary singing performance, or comments made by that user, to other users. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems, a first karaoke system of the present invention is a karaoke system including a server device and a karaoke device communicably connected to the server device, the server device including a determination unit that determines one singing voice data that satisfies a predetermined condition from among a plurality of singing voice data of a plurality of users singing to a single piece of music as specific singing voice data, and stores the specific singing voice data in a storage device in association with user identification information of a specific user who is a user corresponding to the specific singing voice data and music identification information of the single piece of music, and a determination unit that, when receiving user identification information of the specific user from the karaoke device, generates specific user photographed data, which is video data of a video of the specific user, in the karaoke device. The karaoke system is characterized in that it comprises an instruction unit that gives instructions to an orchestra device, and a storage control unit that receives the specific user photographed data from the karaoke device and stores the received specific user photographed data in the storage device in association with the specific singing voice data, user identification information of the specific user, or song identification information of the one song, and the karaoke device comprises a login unit that transmits user identification information of a user who logs into the karaoke system to the server device, a generation unit that generates the specific user photographed data by photographing the specific user when instructed by the server device to generate the specific user photographed data, and a first transmission unit that transmits the specific user photographed data generated by the generation unit to the server device.
[0007] In the first karaoke system of the present invention, the determination unit of the server device determines one singing voice data that satisfies a predetermined condition as the specific singing voice data from among a plurality of singing voice data of a plurality of users singing to a single piece of music. The predetermined condition is, for example, a criterion for judging whether or not singing is excellent. In this case, the singing voice data corresponding to the best singing is determined as the specific singing voice data from among the plurality of singing voice data. Furthermore, the determination unit of the server device stores the specific singing voice data in association with the user identification information of the specific user who is the user corresponding to the specific singing voice data and the music identification information of the single piece of music in the storage device. Thereafter, the login unit of the karaoke device transmits the user identification information of the user who logs into the karaoke system to the server device. When the specific user operates the karaoke device to log into the karaoke system, for example, the user identification information of the specific user is transmitted from the karaoke device to the server device. When the instruction unit of the server device receives the user identification information of the specific user from the karaoke device, it instructs the karaoke device to generate specific user photographed data, which is video data of the specific user. The generating unit of the karaoke device generates specific user photographed data by photographing the specific user when instructed by the server device to generate specific user photographed data. The generating unit, for example, photographs the appearance of the specific user, and if the specific user states his / her name, the image is recorded, and if the specific user states singing tips or points to note when singing, the image is recorded. The specific user photographed data generated in this manner includes specific information about the specific user or statements of the specific user. Furthermore, the first transmitting unit of the karaoke device transmits the specific user photographed data generated by the generating unit to the server device. The storage control unit of the server device receives the specific user photographed data from the karaoke device, and stores the received specific user photographed data in the storage device in association with the specific singing voice data, the user identification information of the specific user, or the song identification information of the one song.According to the first karaoke system of the present invention, specific information about a specific user, i.e., a user who has performed exemplary singing, or remarks by the user, can be easily conveyed to other users using the specific user photographed data. For example, in response to a request from a karaoke device, etc., a server device transmits specific user photographed data to the karaoke device, etc., and the karaoke device, etc. plays a video of the specific user based on the received specific user photographed data, so that specific information about a user who has performed exemplary singing, or remarks by the user, can be easily conveyed to users using the karaoke device, etc.
[0008] In the first karaoke system of the present invention, the generating unit of the karaoke device may generate the specific user photographed data by playing a question video, which is a video that asks the specific user a question, and photographing the specific user responding to the question video, when instructed by the server device to generate the specific user photographed data. By using the question video, it is possible to ask the specific user questions about matters that many other users would like to know, such as the specific user's name, singing tips, or points to note when singing, or matters that are generally useful for singing practice, and obtain answers from the specific user. Therefore, it is possible to generate specific user photographed data whose content meets the needs of many users.
[0009] In order to solve the above-mentioned problems, a second karaoke system of the present invention is a karaoke system including a server device, a plurality of mobile terminals each used by a plurality of users and communicably connected to the server device, and a karaoke device communicably connected to the server device, wherein the server device includes a determination unit that determines one singing voice data that satisfies a predetermined condition as specific singing voice data from among a plurality of singing voice data of the plurality of users singing to a piece of music, and stores the specific singing voice data in a storage device in association with user identification information of a specific user who is a user corresponding to the specific singing voice data and music identification information of the piece of music; and a specific user record unit that stores video data of the specific user, the specific user record being video data of the specific user. the mobile terminal comprises an instruction unit that instructs a mobile terminal among the plurality of mobile terminals used by the specific user to generate specific user photographed data, and a storage control unit that receives the specific user photographed data from the mobile terminal used by the specific user and stores the received specific user photographed data in the storage device in association with the specific singing voice data, user identification information of the specific user or song identification information of the one song, and each of the mobile terminals comprises a generation unit that generates the specific user photographed data by photographing the specific user when instructed by the server device to generate the specific user photographed data, and a first transmission unit that transmits the specific user photographed data generated by the generation unit to the server device.
[0010] In the second karaoke system of the present invention, the determination unit of the server device determines one singing voice data that satisfies a predetermined condition from among a plurality of singing voice data of a plurality of users singing to a single piece of music as a specific singing voice data. Furthermore, the determination unit of the server device stores the specific singing voice data in association with the user identification information of the specific user who is the user corresponding to the specific singing voice data and the music identification information of the single piece of music in the storage device. Furthermore, the instruction unit of the server device instructs a mobile terminal used by the specific user among the plurality of mobile terminals to generate specific user photographed data that is video data of the specific user. The generation unit of the mobile terminal instructed by the server device to generate the specific user photographed data generates the specific user photographed data by photographing the specific user. Then, the first transmission unit of the mobile terminal transmits the specific user photographed data generated by the generation unit to the server device. The storage control unit of the server device receives the specific user photographed data from the mobile terminal used by the specific user, and stores the received specific user photographed data in association with the specific singing voice data, the user identification information of the specific user, or the music identification information of the single piece of music in the storage device. The second karaoke system of the present invention has the same effect as the first karaoke system of the present invention. In addition, according to the second karaoke system of the present invention, the specific user's photographed data can be generated via the mobile terminal used by the specific user, so that the burden on the specific user who has to be photographed for generating the specific user's photographed data can be reduced.
[0011] In addition, in the second karaoke system of the present invention, when the generation unit of each mobile terminal is instructed by the server device to generate the specific user photographed data, the generation unit may generate the specific user photographed data by playing a question video which is a video asking a question to the specific user, and photographing the specific user responding to the question video.
[0012] In addition, in the first or second karaoke system of the present invention, the server device may be provided with a second transmission unit that receives song identification information of the one song from the karaoke device and, when requested by the karaoke device to transmit the specific user photographed data and the specific singing voice data corresponding to the one song, transmits the specific user photographed data and the specific singing voice data associated with the song identification information of the one song to the karaoke device, and the karaoke device may be provided with a request unit that transmits song identification information of the one song to the server device and requests the server device to transmit the specific user photographed data and the specific singing voice data corresponding to the one song, and a playback unit that plays back a video photographed of the specific user and the singing voice of the specific user based on the specific user photographed data and the specific singing voice data corresponding to the one song received from the server device.
[0013] In the karaoke system of this aspect, the requesting unit of the karaoke device transmits the song identification information of the one song to the server device, and requests the server device to transmit the specific user photographed data and specific singing voice data corresponding to the one song. The second transmitting unit of the server device receives the song identification information of the one song from the karaoke device, and when the karaoke device requests the transmission of the specific user photographed data and specific singing voice data corresponding to the one song, transmits the specific user photographed data and specific singing voice data associated with the song identification information of the one song to the karaoke device. The reproducing unit of the karaoke device reproduces the video of the specific user and the singing voice of the specific user based on the specific user photographed data and specific singing voice data corresponding to the one song received from the server device. In this way, by reproducing the video of the specific user based on the specific user photographed data on the karaoke device, specific information about the specific user, i.e., the user who has performed excellent singing as an example, or the remarks of the user, can be easily conveyed to the user who sings using the karaoke device. Effect of the Invention
[0014] According to the present invention, specific information about a user who has performed a model singing performance or comments made by that user can be easily communicated to other users. [Brief description of the drawings]
[0015] [Figure 1] 1 is a block diagram showing a karaoke system according to a first embodiment of the present invention. [Diagram 2] 5 is a flowchart showing a guide vocal related data generating process in the karaoke system according to the first embodiment of the present invention. [Diagram 3] FIG. 2 is an explanatory diagram showing a data structure of guide vocal data in the karaoke system according to the first embodiment of the present invention. [Figure 4] FIG. 2 is an explanatory diagram showing the data structures of guide vocal data and interview video data in the karaoke system according to the first embodiment of the present invention. [Diagram 5] 5 is a flowchart showing a guide vocal related data reproducing process in the karaoke system according to the first embodiment of the present invention. [Figure 6] FIG. 11 is a block diagram showing a karaoke system according to a second embodiment of the present invention. [Figure 7] 10 is a flowchart showing a guide vocal related data generating process in the karaoke system according to the second embodiment of the present invention. [Figure 8] FIG. 11 is an explanatory diagram showing terminal association information in the karaoke system according to the second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] [First embodiment] (Karaoke system) Fig. 1 shows the configuration of a karaoke system 1 according to a first embodiment of the present invention. As shown in Fig. 1, the karaoke system 1 includes a server device 11 and a karaoke device 31. The server device 11 and the karaoke device 31 are connected to each other so as to be able to communicate with each other via a computer network 5 such as the Internet. Although not shown, the karaoke system 1 includes a plurality of karaoke devices 31, and each karaoke device 31 is connected to the server device 11 so as to be able to communicate with each other.
[0017] The server device 11 is, for example, a server computer, and includes an arithmetic processing unit 12, a storage unit 13, an operation unit 14, and a display unit 15. The arithmetic processing unit 12 includes a CPU (Central Processing Unit). The storage unit 13 is a magnetic storage device or a semiconductor storage device capable of storing information, such as a hard disk drive or a solid state drive. The operation unit 14 is a device for operating the server device 11 and inputting information, such as a keyboard or a mouse. The display unit 15 is a device for displaying information, such as a liquid crystal display.
[0018] The arithmetic processing unit 12 of the server device 11 functions as a singing voice data collection unit 21, a determination unit 22, an instruction unit 23, a storage control unit 24, a guide vocal related data transmission control unit 25, a device control unit 26, and a communication control unit 27, for example, by reading and executing a computer program stored in the storage unit 13. The singing voice data collection unit 21, the determination unit 22, the instruction unit 23, and the storage control unit 24 will be described together with the description of the guide vocal related data generation process described later. The guide vocal related data transmission control unit 25 will be described together with the description of the guide vocal related data reproduction process described later. The device control unit 26 performs basic control of the server device 11, and the communication control unit 27 performs basic communication control between the server device 11 and the karaoke device 31. The device control unit 26 and the communication control unit 27 correspond to, for example, an operating system.
[0019] The karaoke device 31 includes a calculation processing unit 32, a memory unit 33, an operation unit 34, a display unit 35, a sound source 36, an acoustic processing unit 37, a display processing unit 38, and a photographing unit 39. The calculation processing unit 32 includes a CPU. The memory unit 33 is a magnetic storage device or a semiconductor storage device capable of storing information, such as a hard disk drive or a solid state drive. The operation unit 34 is buttons, a touch panel, and the like provided on the karaoke device 31 for operating the karaoke device 31 and inputting information. The display unit 35 is a device for displaying information, such as a small liquid crystal display provided on the karaoke device 31. The sound source 36 is a synthesizer for playing music. The acoustic processing unit 37 is a circuit for performing a process of mixing the sound of the music output from the sound source 36 and the singing voice of the user input through a microphone 40 connected to the karaoke device 31, and outputting the mixed sound to a speaker 41 connected to the karaoke device 31. Moreover, the sound processing unit 37 can perform analog-digital conversion of the singing voice of the user inputted through the microphone 40, and output the digital data of the singing voice of the user to the calculation processing unit 32. The display processing unit 38 is a circuit that controls displaying images, lyrics, and the like on an external display 42 (for example, a large liquid crystal display device) connected to the karaoke device 31. The photographing unit 39 is, for example, a video camera, and can photograph the user of the karaoke device 31, specifically, the user singing along with the performance of the music, or the user responding to an interview, etc. Also, a remote controller 43 is connected to the karaoke device 31, for example, by short-distance wireless communication. The remote controller 43 is a device similar to a tablet terminal, and includes a display unit such as a liquid crystal display and an operation unit such as a touch panel. The user can remotely operate the karaoke device 31 using the remote controller 43.
[0020] The calculation processing unit 32 of the karaoke device 31 functions as a login unit 51, a singing scoring unit 52, a generating unit 53, a photographed data transmission control unit 54, a request unit 55, a reproducing unit 56, a device control unit 57, and a communication control unit 58, for example, by reading and executing a computer program stored in the storage unit 33. The login unit 51, the singing scoring unit 52, the generating unit 53, and the photographed data transmission control unit 54 will be described together with the description of the guide vocal related data generation process described later. The request unit 55 and the reproducing unit 56 will be described together with the description of the guide vocal related data reproduction process described later. The device control unit 57 performs basic control of the karaoke device 31, and the communication control unit 58 performs basic communication control between the karaoke device 31 and the server device 11.
[0021] (Guide vocal related data generation processing) In explaining the guide vocal related data generation process, some terms are defined. "User identification information" is information for identifying individual users. "Music identification information" is information for identifying individual songs. "Singing voice data" is voice data of a user singing along with a song. "Guide vocal" means singing that serves as a model for a user to sing along with a song. "Guide vocal data" is voice data of a guide vocal. "Guide vocalist" means a person who performed the guide vocal, that is, a person who performed singing that serves as a model for a user to sing along with a song. "Interview video" is a video of a guide vocalist responding to an interview. "Interview video data" is data of an interview video. "Interviewer video" is a video of an interviewer (interviewer) interviewing a guide vocalist. The guide vocal data is a specific example of specific singing voice data in the scope of the claims. Also, the guide vocalist is a specific example of a specific user in the scope of the claims. The interview video data is a specific example of specific user photographed data in the claims, and the interviewer video is a specific example of question video in the claims.
[0022] 2 shows a guide vocal related data generation process executed in the karaoke system 1. The guide vocal related data generation process is a process for determining guide vocal data and generating interview video data. The guide vocal related data generation process is executed for a plurality of songs, but here, a case will be described where the guide vocal related data generation process is executed for one song M of the plurality of songs.
[0023] Before the guide vocal related data generation process is performed, a plurality of singing voice data for the song M is stored and accumulated in the storage unit 13 of the server device 11. Each singing voice data for the song M is associated with song identification information for the song M, user identification information of the user who sang the song M, and scoring data for the user's singing of the song M. The accumulation of a plurality of singing voice data for the song M is performed by the following process. That is, while the user is singing along with the song M played by the karaoke device 31, the singing voice of the user inputted to the sound processing unit 37 of the karaoke device 31 via the microphone 40 is analog-digitally converted by the sound processing unit 37 and outputted as digital data to the calculation processing unit 32. In addition, the singing scoring unit 52 of the karaoke device 31 scores the singing of the song M by the user, and generates scoring data indicating the scoring result of the singing when the user finishes singing the song M. The scoring data is data indicating the singing score given by the singing scoring unit 52. A high score is given by the singing scoring section 52 to an excellent singing performance, for example, a singing performance with good pitch, rhythm, intonation, etc. After the scoring data of the singing of the song M by the user is generated, the karaoke device 31 transmits the digital data of the singing of the song M by the user as singing voice data to the server device 11 together with the song identification information of the song M, the user identification information of the user, and the scoring data of the singing of the song M by the user. The singing voice data collecting section 21 of the server device 11 stores the singing voice data, song identification information, user identification information, and scoring data received from the karaoke device 31 in the storage section 13 in association with each other. The above process is executed every time the user sings along with the song M. When a plurality of users sing the song M, a plurality of singing voice data for the song M is stored and accumulated in the storage section 13 of the server device 11. The process of accumulating singing voice data is also executed for other songs.
[0024] In the guide vocal related data generation process shown in FIG. 2, first, the determination unit 22 of the server device 11 determines one singing voice data that satisfies a predetermined condition as the guide vocal data for the song M from among the multiple singing voice data for the song M stored in the storage unit 13 (step S1). In this embodiment, the predetermined condition is that the score indicated by the scoring data is the highest among the multiple singing voice data for the song M. In step S1, the determination unit 22 compares the scores indicated by the scoring data associated with the multiple singing voice data for the song M, respectively, and selects one singing voice data with the highest score as the guide vocal data for the song M. As a result, the singing voice data with the best singing for the song M is selected as the guide vocal data for the song M. As a result, the user corresponding to the guide vocal data for the song M (the user who performed the best singing for the song M) is selected as the guide vocalist for the song M.
[0025] Next, the determination unit 22 of the server device 11 stores the determined guide vocal data for the song M in association with the song identification information of the song M and the user identification information of the user corresponding to the guide vocal data, i.e., the user identification information of the guide vocalist for the song M, in the storage unit 13 (step S2). In this embodiment, the association between the singing voice data determined as the guide vocal data for the song M, the song identification information of the song M, and the user identification information of the user corresponding to the singing voice data has already been formed by the above-mentioned process of storing the singing voice data, so in step S2, the determination unit 22 uses this already-formed association to form an association between the guide vocal data for the song M, the song identification information of the song M, and the user identification information of the guide vocalist for the song M.
[0026] Fig. 3 shows an example of the data structure of the guide vocal data. In Fig. 3, user identification information 62 and song identification information 63 are added to the guide vocal data 61 as metadata. By adding the user identification information 62 and song identification information 63 to the guide vocal data 61 in this way, an association is formed between the guide vocal data 61, the user identification information 62, and the song identification information 63. In step S2, the determination unit 22 adds the user identification information of the guide vocalist for song M and the song identification information of song M to the guide vocal data for song M, for example, as shown in Fig. 3, thereby forming an association between the guide vocal data for song M, the user identification information of the guide vocalist for song M, and the song identification information of song M.
[0027] Thereafter, suppose that a user performs a login operation using, for example, the remote controller 43 wirelessly connected to the karaoke device 31 in order to log in to the karaoke system 1 (step S3 in FIG. 2: YES). In the login operation, the user inputs his / her own user identification information. When such a login operation is performed, the login unit 51 of the karaoke device 31 transmits the user identification information of the user who performed the login operation to the server device 11 (step S4).
[0028] The device control unit 26 of the server device 11 receives the user identification information transmitted from the karaoke device 31 and performs a login process (step S5). In the login process, the device control unit 26 checks whether the user who performed the login operation is a registered user based on the received user identification information, and if the user who performed the login operation is a registered user, permits the user to log in to the karaoke system 1.
[0029] In the login process, after the login of the user who performed the login operation is permitted, the instruction unit 23 of the server device 11 judges whether or not guide vocal data for the song M corresponding to the logged-in user exists (step S6). The instruction unit 23 searches the storage unit 13 based on the user identification information transmitted from the karaoke device 31, and if guide vocal data associated with the user identification information is found, it judges that guide vocal data for the song M corresponding to the logged-in user exists. If guide vocal data for the song M corresponding to the logged-in user exists, it means that the logged-in user is the guide vocalist for the song M.
[0030] If there is no guide vocal data for the song M corresponding to the logged-in user (step S6: NO), the process returns to step S3. On the other hand, if there is guide vocal data for the song M corresponding to the logged-in user (step S6: YES), the instruction unit 23 of the server device 11 issues an instruction to the karaoke device 31 to generate interview video data of the logged-in user, i.e., the guide vocalist for the song M (step S7). For example, the instruction unit 23 transmits an interview video generation command signal indicating such an instruction to the karaoke device 31.
[0031] The generation unit 53 of the karaoke device 31 receives an instruction from the server device 11 to generate interview video data of the guide vocalist for the song M (e.g., receives an interview video generation command signal), and in response to the instruction, starts a process of generating interview video data of the guide vocalist for the song M.
[0032] In the process of generating the interview video data, the generating unit 53 of the karaoke device 31 first plays the interview video (step S8). The interview video is a video in which a number of predetermined questions are asked to the user who has sung the song. The data of the interview video is stored in advance in the storage unit 33 of the karaoke device 31. For example, the interview video includes audio of the questions and a video of the interviewer asking the questions. For example, the interview video includes audio of questions such as "Please introduce yourself," "Please tell us any tips for singing or points to note when singing," and "Are there any points to get a high score?". The video of the interview video is displayed on the external display 42 connected to the karaoke device 31 or on the display unit of the remote controller 43 wirelessly connected to the karaoke device 31. The audio of the interview video is output from the speaker 41 connected to the karaoke device 31.
[0033] Furthermore, the generating unit 53 simultaneously plays back the interview video, photographs the guide vocalist for song M by the photographing unit 39, and records the voice of the guide vocalist via the microphone 40. In response to questions from the interviewer in the interview video, the guide vocalist for song M speaks into the microphone 40 about his / her own name, tips for singing song M, points to note when singing song M, points for obtaining a high score for singing song M, etc. The content spoken by the guide vocalist for song M is recorded via the microphone 40, and the image of the guide vocalist for song M answering questions is photographed by the photographing unit 39.
[0034] In the process of generating interview video data, the generation unit 53 next combines audio data of the guide vocalist speaking for song M recorded via the microphone 40 with video data of the guide vocalist speaking for song M filmed by the filming unit 39 to generate interview video data of the guide vocalist for song M (step S9).
[0035] After the generation of the interview video data of the guide vocalist for the song M is completed, the captured data transmission control unit 54 of the karaoke device 31 transmits the generated interview video data of the guide vocalist for the song M to the server device 11 (step S10).
[0036] The storage control unit 24 of the server device 11 receives the interview video data of the guide vocalist for the song M transmitted from the karaoke device 31, and stores the received interview video data in the storage unit 13 in association with the guide vocalist data for the song M (step S11). In step S11, the interview video data of the guide vocalist for the song M transmitted from the karaoke device 31 may be associated with the user identification information of the guide vocalist for the song M or the song identification information of the song M. Since the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information of the song M are associated with each other, if the interview video data of the guide vocalist for the song M transmitted from the karaoke device 31 is associated with any one of the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information of the song M, the interview video data is associated with the other two of the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information of the song M.
[0037] 4 shows an example of the data structure of the guide vocal data and the interview video data. In FIG. 4, user identification information 62, music identification information 63, and link information 64 are added to the guide vocal data 61 as metadata. The link information 64 is information for linking the guide vocal data 61 with the interview video data 65, and is, for example, information indicating a location (address) where the interview video data 65 is stored in the storage unit 13. By adding the link information 64 to the guide vocal data 61 to which the user identification information 62 and music identification information 63 are added, the interview video data 65 is associated with the guide vocal data 61, the user identification information 62, and the music identification information 62. In step S11, the determination unit 22 associates the interview video data of the guide vocalist for song M with the guide vocalist for song M, the user identification information of the guide vocalist for song M, and the song identification information of song M, by adding link information indicating the location where the interview video data of the guide vocalist for song M is stored in the memory unit 13 to the guide vocal data for song M to which the user identification information of the guide vocalist for song M and the song identification information of song M have been added, as shown in FIG. 4, for example.
[0038] (Guide vocal related data playback processing) 5 shows a guide vocal related data reproduction process executed in the karaoke system 1. The guide vocal related data reproduction process is a process for reproducing an interview video and a guide vocal based on interview video data and guide vocal data.
[0039] In the guide vocal related data reproduction process, it is assumed that a user operates the remote controller 43 wirelessly connected to the karaoke device 31 to reserve a song M (step S21: YES). It is assumed here that a user who is not the guide vocalist for song M logs into the karaoke system 1 and then reserves song M.
[0040] When song M is reserved, the request unit 55 of the karaoke device 31 transmits song identification information of song M to the server device 11 and issues a request to the server device 11 to transmit guide vocal data for song M and interview video data of the guide vocalist for song M to the karaoke device 31 (step S22). For example, when song M is reserved, the request unit 55 transmits a guide vocal related data request signal, which requests transmission of guide vocal data for song M and interview video data of the guide vocalist for song M, to the server device 11 together with the song identification information of song M.
[0041] When the guide vocal related data transmission control unit 25 of the server device 11 receives the song identification information of the song M and a request to transmit the guide vocal data for the song M and the interview video data of the guide vocalist for the song M to the karaoke device 31 (for example, when the song identification information of the song M and the guide vocal related data request signal are received), the guide vocal data for the song M and the interview video data of the guide vocalist for the song M that are associated with the received song identification information of the song M. Then, the guide vocal related data transmission control unit 25 transmits the identified guide vocal data for the song M and the interview video data of the guide vocalist for the song M to the karaoke device 31 (step S23).
[0042] Next, the playback unit 56 of the karaoke device 31 receives the guide vocal data for song M and the interview video data of the guide vocalist for song M transmitted from the server device 11, and first plays the interview video of the guide vocalist for song M based on the interview video data of the guide vocalist for song M (step S24). The video of this interview video is displayed on the external display 42 connected to the karaoke device 31, or on the display unit of the remote controller 43 wirelessly connected to the karaoke device 31. The audio of the interview video is output from the speaker 41. The user who has reserved song M can see the appearance of the guide vocalist for song M, know the name of the guide vocalist for song M, and learn tips for singing song M, points to note, and points for obtaining a high score, by watching the video of the interview video and listening to the audio of the interview video.
[0043] Next, the playback unit 56 plays the song M and simultaneously plays the guide vocal for the song M based on the guide vocal data for the song M (step S25). At this time, the playback unit 56 synchronizes the performance of the song M with the playback of the guide vocal. The voices of the song M and the guide vocal are output from the speaker 41. This reproduces the singing of the song M by the guide vocalist in sync with the performance of the song M. A user who has reserved the song M can listen to the singing of the guide vocalist, and can compare his or her own singing by singing along with the performance of the song M.
[0044] There may be a case where the guide vocalist's interview video data for song M has not been generated yet when the guide vocalist related data transmission control section 25 of the server device 11 receives a request from the karaoke device 31 to transmit the guide vocalist data for song M and the guide vocalist's interview video data for song M to the karaoke device 31. In this case, the guide vocalist related data transmission control section 25 does not transmit the guide vocalist's interview video data for song M to the karaoke device 31 in step S23. In this case, the playback section 56 of the karaoke device 31 does not play back the guide vocalist's interview video for song M (skip step S24).
[0045] As described above, the karaoke system 1 according to the first embodiment of the present invention generates interview video data of the guide vocalist. According to the karaoke system 1, specific information about the guide vocalist or the remarks of the guide vocalist (in this embodiment, advice about singing) can be easily conveyed to the user using the interview video data. By conveying specific information about the guide vocalist to the user, the desire of the user to know about the guide vocalist can be met. Furthermore, by conveying specific information about the guide vocalist to the user, the user's trust or affinity with the guide vocalist is formed, and the user's motivation or enjoyment in practicing singing can be increased. Furthermore, by conveying the remarks of the guide vocalist to the user, the user can obtain information useful for practicing singing, such as singing tips and points to note when singing.
[0046] In addition, the karaoke system 1 of this embodiment stores the interview video data in the storage unit 13 of the server device 11, transmits the interview video data from the server device 11 to the karaoke device 31 in response to a request from the karaoke device 31, and plays the interview video by the karaoke device 31. This makes it possible to easily convey specific information about the guide vocalist or the remarks of the guide vocalist to a user who sings using the karaoke device 31. The user can sing using the karaoke device 31 immediately after receiving singing tips and points to note when singing from the guide vocalist, so that the user can effectively practice singing. In addition, by storing the interview video data in the storage unit 13 of the server device 11, the interview video data can be transmitted to a plurality of karaoke devices 31 that can communicate with the server device 11. Therefore, specific information about the guide vocalist or the remarks of the guide vocalist can be widely conveyed to many users.
[0047] Furthermore, when a user reserves a song, the karaoke system 1 of this embodiment transmits interview video data of the guide vocalist for the song reserved by the user from the server device 11 to the karaoke device 31. This allows the user to watch the interview video of the guide vocalist for the song when singing along with the song played by the karaoke device 31, and immediately practice singing the song according to the singing tips or points of attention given by the guide vocalist via the interview video.
[0048] Furthermore, in response to a request from the karaoke device 31, the karaoke system 1 of this embodiment transmits guide vocal data for a certain piece of music and interview video data of the guide vocalist for that piece of music from the server device 11 to the karaoke device 31. This allows the user to simultaneously watch the interview video of the guide vocalist for a certain piece of music and listen to the singing voice of the guide vocalist for that piece of music, such as listening to the singing voice of the guide vocalist for that piece of music immediately after watching the interview video of the guide vocalist for that piece of music. This allows the user to specifically understand tips for singing a piece of music, etc.
[0049] Furthermore, the karaoke system 1 of this embodiment generates interview video data of the guide vocalist when the guide vocalist logs in to the karaoke system 1. This allows the interview video data of the guide vocalist to be generated efficiently and reliably. For example, in order to generate the interview video data of the guide vocalist, it is possible to eliminate the trouble of contacting the guide vocalist in advance and creating a schedule for generating the interview video data. Furthermore, it is possible to prevent failure to generate the interview video data of the guide vocalist due to the difficulty in creating such a schedule.
[0050] Furthermore, the karaoke system 1 of this embodiment generates interview video data of the guide vocalist using the karaoke device 31. This allows the guide vocalist to be filmed at the location where he or she sings karaoke (such as in a karaoke room) and the interview video data to be generated. This allows the generation of interview videos with a sense of realism, improving the quality of the interview videos.
[0051] In addition, the karaoke system 1 of this embodiment generates interview video data by playing back an interview video and filming the guide vocalist responding to the interview video. By using the interview video, it is possible to ask the guide vocalist questions about matters that many users would like to know, such as the guide vocalist's name, singing tips, or points to note when singing, or matters that are generally useful for singing practice, and to obtain answers from the guide vocalist. Therefore, it is possible to generate interview video data whose content meets the needs of many users.
[0052] [Second embodiment] Fig. 6 shows the configuration of a karaoke system 2 according to a second embodiment of the present invention. In the karaoke system 2 of the second embodiment shown in Fig. 6, the same components as those in the karaoke system 1 of the first embodiment are given the same reference numerals, and their description will be omitted. In the karaoke system 2 of the second embodiment, a mobile terminal 81 is included in the karaoke system 2, and the mobile terminal 81 generates interview video data of the guide vocalist.
[0053] As shown in Fig. 6, the karaoke system 2 includes a server device 71, a karaoke device 75, and a mobile terminal 81. The server device 71 and the karaoke device 75 are connected to each other so as to be able to communicate with each other via a computer network 5 such as the Internet. The server device 71 and the mobile terminal 81 are connected to each other so as to be able to communicate with each other via a mobile communication network (not shown) and a computer network 5 such as the Internet. Although not shown, the karaoke system 2 includes a plurality of karaoke devices 75 and a plurality of mobile terminals 81, each of which is connected to the server device 71 so as to be able to communicate with each other, and each of which is connected to the server device 71 so as to be able to communicate with each other. The plurality of mobile terminals 81 are used by each of a plurality of users who use the karaoke system 2.
[0054] The server device 71 is similar to the server device 11 in the first embodiment, except for the instruction unit 73 and the storage control unit 74 of the calculation processing unit 72. The instruction unit 73 and the storage control unit 74 in the server device 71 will be described together with the guide vocal related data generation process of the second embodiment described later.
[0055] Karaoke device 75 is similar to karaoke device 31 in the first embodiment, except that karaoke device 75 does not have generation unit 53 and photographed data transmission control unit 54 that karaoke device 31 in the first embodiment has.
[0056] The mobile terminal 81 is, for example, a smartphone, a tablet, or a notebook personal computer. The mobile terminal 81 includes an arithmetic processing unit 82, a memory unit 83, an operation unit 84, a display unit 85, a microphone 86, a speaker 87, and a photographing unit 88. The arithmetic processing unit 82 includes a CPU. The memory unit 83 is a semiconductor storage device capable of storing information. The operation unit 84 is buttons, a touch panel, and the like provided on the mobile terminal 81 for operating the mobile terminal 81 and inputting information. The display unit 85 is a device for displaying information, and is a display provided on the mobile terminal 81. The microphone 86 and the speaker 87 are built into the mobile terminal 81. The photographing unit 88 is a camera built into the mobile terminal 81 or connected to the mobile terminal 81, and is capable of photographing moving images.
[0057] The calculation processing unit 82 of the mobile terminal 81 reads and executes a computer program (e.g., application software provided by a karaoke business operator) stored in the storage unit 83 of the mobile terminal 81, thereby functioning as a generation unit 91, a shooting data transmission control unit 92, a terminal control unit 93, and a communication control unit 94. The generation unit 91 and the shooting data transmission control unit 92 will be described together with the description of the guide vocal related data generation process of the second embodiment described later. The terminal control unit 93 performs basic control of the mobile terminal 81, and the communication control unit 94 performs basic communication control between the mobile terminal 81 and the server device 71.
[0058] 7 shows a guide vocal related data generating process of the second embodiment executed in the karaoke system 2. The guide vocal related data generating process is executed for a plurality of songs, but here, a case will be described in which the guide vocal related data generating process is executed for one song M among the plurality of songs.
[0059] Similar to the guide vocal related data generation process of the first embodiment, before the guide vocal related data generation process of the second embodiment is performed, multiple singing voice data for the song M are stored and accumulated in the memory unit 13 of the server device 71.
[0060] In the guide vocal related data generation process of the second embodiment shown in FIG. 7, first, the determination unit 22 of the server device 71 determines one singing voice data that satisfies a predetermined condition as the guide vocal data for the song M from among a plurality of singing voice data for the song M stored in the storage unit 13 (step S31). The predetermined condition is that, as in the first embodiment, the score indicated by the scoring data is the highest among the plurality of singing voice data for the song M. The content of the process of step S31 is the same as the content of the process of step S1 in the guide vocal related data generation process of the first embodiment shown in FIG. 2. By the process of step S31, the singing voice data with the best singing for the song M is selected as the guide vocal data for the song M. As a result, the user corresponding to the guide vocal data for the song M is selected as the guide vocalist for the song M.
[0061] Next, the determination unit 22 of the server device 71 stores the guide vocal data for the determined song M in the storage unit 13 in association with the song identification information of the song M and the user identification information of the guide vocalist for the song M (step S32). The process of step S32 is the same as the process of step S2 in the guide vocal related data generation process of the first embodiment shown in FIG.
[0062] Next, the instruction unit 73 of the server device 71 specifies the terminal identification information of the mobile terminal 81 used by the guide vocalist for the song M based on the user identification information of the guide vocalist for the song M (step S33). The terminal identification information of the mobile terminal 81 is information for identifying each mobile terminal 81. In this embodiment, the server device 11 uses the terminal identification information of the mobile terminal 81 to perform a push notification to the mobile terminal 81, so the terminal identification information of the mobile terminal 81 is the terminal identification information (e.g., device token) used for the push notification. For example, the storage unit 13 of the server device 71 stores terminal association information as shown in FIG. 8 in advance. The terminal association information describes an association between the user identification information (e.g., "U*****") of each registered user and the terminal identification information (e.g., "T*****") of the mobile terminal 81 used by each registered user. The instruction unit 73 specifies the terminal identification information of the mobile terminal 81 used by the guide vocalist for the song M using the terminal association information as shown in FIG. 8.
[0063] Next, the instruction unit 73 of the server device 71 issues an instruction to generate interview video data to the mobile terminal 81 (hereinafter simply referred to as the "mobile terminal 81") used by the guide vocalist for the song M based on the terminal identification information identified in step S33 (step S34). Specifically, the instruction unit 73 sends a push notification indicating such an instruction to the mobile terminal 81.
[0064] The terminal control unit 93 of the mobile terminal 81 notifies the guide vocalist for song M by displaying a banner or ringing a tone, etc., that the push notification sent from the server device 71 has been received. Then, when the guide vocalist for song M operates the mobile terminal 81 to respond to the push notification, the generation unit 91 of the mobile terminal 81 starts a process of generating interview video data of the guide vocalist for song M. The contents of the process of generating interview video data of the guide vocalist for song M are similar to the process of generating interview video data of the guide vocalist for song M in the guide vocal related data generation process of the first embodiment (steps S8 and S9 in FIG. 2), and therefore will be described briefly here.
[0065] In the process of generating interview video data of the guide vocalist for the musical piece M, first, the generating unit 91 of the mobile terminal 81 plays the interview video (step S35). The interview video is displayed on the display unit 85 of the mobile terminal 81. The data of the interview video is stored in advance in the storage unit 83 of the mobile terminal 81. The generating unit 91 also shoots the guide vocalist for the musical piece M responding to the questions of the interviewer in the interview video, using the shooting unit 88 of the mobile terminal 81, while playing back the interview video, and records the voice of the guide vocalist via the microphone 86 of the mobile terminal 81. Next, the generating unit 91 combines the audio data of the voice of the guide vocalist for the musical piece M, recorded via the microphone 86, with the video data of the guide vocalist for the musical piece M, shot by the shooting unit 88, to generate interview video data of the guide vocalist for the musical piece M (step S36).
[0066] After the generation of the interview video data of the guide vocalist for song M is completed, the captured data transmission control unit 92 of the mobile terminal 81 transmits the generated interview video data of the guide vocalist for song M to the server device 71 (step S37).
[0067] The storage control unit 74 of the server device 71 receives the interview video data of the guide vocalist for song M transmitted from the mobile terminal 81, and stores the received interview video data in the storage unit 13 in association with the guide vocal data for song M, the user identification information of the guide vocalist for song M, or the song identification information of song M (step S38).
[0068] The guide vocal related data reproducing process in the karaoke system 2 of the second embodiment is the same as that in the karaoke system 1 of the first embodiment, so a description thereof will be omitted here.
[0069] The karaoke system 2 of the second embodiment of the present invention also provides the same effects as the karaoke system 1 of the first embodiment of the present invention. In the karaoke system 2 of the second embodiment, the mobile terminal 81 generates interview video data of the guide vocalist based on a push notification from the server device 71 to the mobile terminal 81. The guide vocalist can start the process of generating the interview video data by responding to the push notification at any timing. Therefore, the guide vocalist can use his / her free time, etc. to be interviewed for the interviewer video. This reduces the burden on the guide vocalist involved in generating the interview video.
[0070] In the above embodiments, in the process of generating the interview video data of the guide vocalist for the song M, the generating unit 53 of the karaoke device 31 (or the generating unit 91 of the mobile terminal 81) generates an interview video in which the voice of the guide vocalist for the song M speaking in response to a question and the video of the guide vocalist responding to the question are combined, but the video of the guide vocalist singing the song M may be synthesized with this interview video. In this case, in the guide vocal related data generating process, after the server device 11 (71) receives the interview video data of the guide vocalist for the song M from the karaoke device 31 (75) (after step S10 in FIG. 2 or after step S37 in FIG. 7), the server device 11 synthesizes the video of the guide vocalist for the song M singing the song M with the video of the guide vocalist speaking in response to a question included in the interview video of the guide vocalist for the song M, for example, by using a picture-in-picture method or the like. In this case, the video data of the guide vocalist for the song M singing the song M is acquired, for example, by the following method. That is, as described above, the karaoke system 1 (2) performs a process of storing singing voice data of a plurality of users who sing the song M in the storage unit 13 of the server device 11. In this process, together with the singing voice data of the plurality of users who sing the song M, video data of the plurality of users who sing the song M is stored in the storage unit 13 of the server device 11. When synthesizing the video of the guide vocalist who sings the song M with the interview video of the guide vocalist for the song M, the video data of the guide vocalist who sings the song M is acquired from the video data of the plurality of users who sing the song M, which is stored in the storage unit 13 of the server device 11. By synthesizing the video of the guide vocalist who sings the song M with the interview video of the guide vocalist for the song M, the amount and quality of information conveyed to the user through the interview video can be increased.In addition, when combining a video of the guide vocalist singing song M with a video of an interview with the guide vocalist about song M, the video of the guide vocalist responding to questions included in the video of the interview with the guide vocalist about song M may be replaced with a video of the guide vocalist about song M singing song M.
[0071] In addition, in each of the above embodiments, an interview video is played in the process of generating interview video data of the guide vocalist, but instead of this, a still image showing questions to be asked to the guide vocalist may be displayed on the external display 42 connected to the karaoke device 31, or on the display unit 85 of the mobile terminal 81. Also, instead of an interview video of the guide vocalist, a video of the guide vocalist's free talk may be generated.
[0072] In the karaoke system 1 of the first embodiment, when a guide vocalist for song M logs in to the karaoke system 1, interview video data of the guide vocalist for song M is generated (see steps S3 to S9 in FIG. 2). In this process, if interview video data of the guide vocalist for song M has already been generated when the guide vocalist for song M logs in to the karaoke system 1, the process of generating interview video data of the guide vocalist for song M may not be performed. This makes it possible to prevent interview videos of the same guide vocalist from being generated twice for the same song.
[0073] In the above embodiments, in the guide vocal related data playback process, the guide vocal data is played after the guide vocalist's interview video is played (steps S24 and S25 in FIG. 5). However, in the guide vocal related data playback process, the order of playing the guide vocalist's interview video and the guide vocal data is not limited.
[0074] In the guide vocal related data playback process, playback of the guide vocalist interview video for one song may be limited to one time for each user. This process can be realized, for example, by storing the playback history of the guide vocalist interview video for each song for each user in the storage unit 13 of the server device 11 (71).
[0075] In the above embodiments, the guide vocalist's interview video data generated in the karaoke system 1 (2) is transmitted from the server device 11 (71) to the karaoke device 31 (75) in response to a request from the karaoke device 31 (75), and is played by the karaoke device 31 (75). However, the method of using the guide vocalist's interview video data generated in the karaoke system 1 (2) is not limited to this. For example, a user may connect to the Internet using a mobile terminal or the like, and download the guide vocalist's interview video data or play it in a streaming format.
[0076] Furthermore, the method of associating the guide vocal data with the user identification information and the music identification information, or the method of associating the guide vocal data with the interview video data is not limited to the method described in the embodiment.
[0077] In addition, in each of the above embodiments, the condition for determining guide vocal data from among multiple singing voice data is that the score indicated by the scoring data is the highest, but the condition for determining guide vocal data from among multiple singing voice data is not limited to this.
[0078] Furthermore, the present invention can be modified as appropriate within the scope that does not deviate from the gist or concept of the invention that can be read from the claims and the entire specification, and karaoke systems involving such modifications are also included in the technical concept of the present invention. [Explanation of symbols]
[0079] 1, 2 Karaoke system 11, 71 Server equipment 12, 72 Processing unit 13 Storage unit (storage device) 22 Decision Section 23, 73 Instruction section 24, 74 Memory control unit 25 Guide vocal related data transmission control unit (second transmission unit) 31, 75 Karaoke equipment 32 Processing unit 39 Photography Department 51 Login section 53 Generation part 54 Shooting data transmission control unit (first transmission unit) 55 Request part 56 Playback Department 81 Mobile Devices 82 Processing unit 88 Photography Department 91 Generation part 92 Shooting data transmission control unit (first transmission unit)
Claims
1. A karaoke system including a server device and a karaoke device communicably connected to the server device, The server device includes: a determining unit for determining one singing voice data satisfying a predetermined condition as specific singing voice data from among a plurality of singing voice data of a plurality of users singing to one piece of music, and storing the specific singing voice data in a storage device in association with user identification information of a specific user corresponding to the specific singing voice data and music identification information of the one piece of music; an instruction unit that instructs the karaoke device to generate specific user image data, which is video data of the specific user, when the user identification information of the specific user is received from the karaoke device; a storage control unit that receives the specific user photographed data from the karaoke device, and stores the received specific user photographed data in the storage device in association with the specific singing voice data, user identification information of the specific user, or song identification information of the one song; The karaoke device includes: a login unit for transmitting user identification information of a user who logs into the karaoke system to the server device; a generating unit that generates the specific user photographed data by photographing the specific user when the generating unit receives an instruction from the server device to generate the specific user photographed data; a first transmitting unit that transmits the specific user photographed data generated by the generating unit to the server device.
2. The karaoke system according to claim 1, characterized in that in the karaoke device, when instructed by the server device to generate the specific user photographed data, the generation unit plays a question video which is a video asking a question to the specific user, and generates the specific user photographed data by photographing the specific user responding to the question video.
3. A karaoke system including a server device, a plurality of mobile terminals each used by a plurality of users and communicatively connected to the server device, and a karaoke device communicatively connected to the server device, The server device includes: a determining unit for determining one singing voice data that satisfies a predetermined condition as specific singing voice data from among a plurality of singing voice data of the plurality of users singing to one piece of music, and storing the specific singing voice data in a storage device in association with user identification information of a specific user who is a user corresponding to the specific singing voice data and music identification information of the one piece of music; an instruction unit that instructs a mobile terminal used by the specific user among the plurality of mobile terminals to generate specific user photographed data which is video data of the specific user; a storage control unit that receives the specific user photographed data from a mobile terminal used by the specific user, and stores the received specific user photographed data in the storage device in association with the specific singing voice data, user identification information of the specific user, or song identification information of the one song; Each of the mobile terminals includes: a generating unit that generates the specific user photographed data by photographing the specific user when the generating unit receives an instruction from the server device to generate the specific user photographed data; a first transmitting unit that transmits the specific user photographed data generated by the generating unit to the server device.
4. The karaoke system of claim 3, wherein in each of the mobile terminals, when instructed by the server device to generate the specific user photographed data, the generation unit plays a question video which is a video asking a question to the specific user, and generates the specific user photographed data by photographing the specific user responding to the question video.
5. The server device includes: a second transmission unit that receives song identification information of the one song from the karaoke device, and transmits the specific user photographed data and the specific singing voice data associated with the song identification information of the one song to the karaoke device when the karaoke device requests transmission of the specific user photographed data and the specific singing voice data corresponding to the one song; The karaoke device includes: a request unit that transmits song identification information of the one song to the server device and requests the server device to transmit the specific user photograph data and the specific singing voice data corresponding to the one song; The karaoke system according to any one of claims 1 to 4, further comprising a playback unit which plays back a video of the specific user and the singing voice of the specific user based on the specific user photographed data and the specific singing voice data corresponding to the one song received from the server device.
Citation Information
Patent Citations
Karaoke system, karaoke device and server device, for karaoke system
JP2003091291A
Submission music performance system and submission music performance method
JP2015045823A
Karaoke system
JP2016099539A
Karaoke network system for recording sound and image of temporal top singing
JP2016153866A
