Music reproduction toy
Patent Information
- Application Number
- JP2023087522
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-10-28
- Filing Date
- 2023-05-29
- Publication Date
- 2025-06-09
- Estimated Expiration
- 2042-05-30
AI Technical Summary
Conventional music reproducing toys that simulate karaoke lack the ability to output the original musical piece, limiting the user's experience to only the accompaniment portion and preventing simultaneous listening to or singing along with the original singing part.
The toy includes a music data storage unit that stores first and second sound source data, allowing for volume suppression control and synthesis, enabling output of both accompaniment and singing parts, with additional features for dialogue audio and short-range wireless communication for synchronized playback with other devices.
Enhances user engagement by allowing simultaneous output of both singing and accompaniment parts, and enables synchronized playback with other devices, providing a more diverse and engaging musical experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a music playback toy that plays and outputs music.
Background Art
[0002] Conventionally, there has been known a toy that collects the user's singing voice by a microphone and synthesizes and outputs the collected singing voice and the sound source data of music (see, for example, Patent Document 1). By using this conventional toy, the user can enjoy karaoke while listening to the music that is played and output.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, in the case of a toy for enjoying karaoke as in Patent Document 1, what is output as music is not the original music itself but the sound source data of the accompaniment part thereof. In the case of outputting the karaoke sound of a solo piece or an ensemble piece, only the sound source data of the accompaniment part that does not include the solo part or the main melody part is output. Therefore, it is only possible to enjoy karaoke from the beginning to the end of the music, and it is not possible to enjoy listening to the original singing part or the like separately from karaoke, or to sing along while listening to the singing part or the like. That is, the趣味性 was lacking.
[0005] The problem to be solved by the present invention is to provide a technology for a music playback toy that can add new趣味性.
Means for Solving the Problems
[0006] It should be noted that the term "趣味性" in the original text is not a common English word. A more appropriate translation might be "entertainment value" or "amusement", but since the original text is preserved as is, "趣味性" is left untranslated. If you have any further questions or need more specific help, please feel free to ask.An aspect of the present invention is a music playback toy comprising: a music data storage unit that stores first sound source data and second sound source data relating to a predetermined music; an audio output control unit that synthesizes and outputs audio based on the first sound source data and audio based on the second sound source data at a given volume ratio; and a first sound source volume suppression control unit that performs first sound source volume suppression control to mute or reduce the volume relating to the first sound source data synthesized and output by the audio output control unit in accordance with a predetermined operation.
[0007] Furthermore, the aforementioned song is a song that includes a predetermined vocal part and a predetermined musical part, the first sound source data is data that includes at least the sound source of the predetermined vocal part, and the second sound source data may be data that does not include the sound source of the predetermined vocal part but includes the sound source of the predetermined musical part.
[0008] The system may further include a dialogue audio data storage unit that stores dialogue audio data relating to a predetermined line of dialogue, and a dialogue audio output control unit that performs the first sound source volume suppression control in response to a predetermined dialogue audio output operation, and also plays back the dialogue audio data and outputs the audio.
[0009] Furthermore, the audio output control unit may, in a predetermined basic playback state, synthesize and output the volume of the first sound source data and the volume of the second sound source data at approximately equal volume ratios, and the first sound source volume suppression control unit may, in response to the predetermined operation, perform first sound source volume suppression control while maintaining the volume of the second sound source data.
[0010] Furthermore, the system may also include a second sound source volume control unit that performs a second sound source volume control to increase the volume of the second sound source data in conjunction with the first sound source volume suppression control unit performing the first sound source volume suppression control in response to the predetermined operation.
[0011] Furthermore, the audio output control unit may, in a predetermined basic playback state, mute the volume of the second sound source data, or synthesize and output a volume ratio that is lower than the volume of the first sound source data.
[0012] Furthermore, the music data storage unit stores the first sound source data and the second sound source data relating to an ID-associated music track, which is linked to a predetermined other device ID, as the music track, and may further include a short-range wireless communication unit for short-range wireless communication with other devices, and a communication playback function unit that, when the other device ID is received from the other device via short-range wireless communication, activates the audio output control unit with respect to the ID-associated music track.
[0013] Furthermore, the other device may perform an ID transmission process that includes transmitting the other device ID via short-range wireless communication, and immediately after the successful communication related to the ID transmission process, it may start playback output of sound source data related to the ID-attached song. The communication playback function unit may perform an ID reception process that includes receiving the other device ID from the other device, and immediately after the successful communication related to the ID reception process, it may cause the audio output control unit to start the synthesized output for the ID-attached song. [Effects of the Invention]
[0014] According to the present invention, it is possible to provide a technology for a music playback toy that can add new entertainment value. [Brief explanation of the drawing]
[0015] [Figure 1] A diagram showing an example of the basic configuration of a music playback toy. [Figure 2] A diagram showing other schematic configuration examples of music playback toys. [Figure 3] A diagram illustrating the playback and output of music and dialogue audio. [Figure 4] A diagram illustrating audio data related to duet songs. [Figure 5] A diagram illustrating the communication playback function and playback output start function of a music playback toy. [Figure 6] A diagram showing a modified example where a music playback toy can play a duet song. [Figure 7] A block diagram showing an example of the functional configuration of a music playback toy. [Figure 8]Flowchart showing the process performed by the music playback toy. [Figure 9] Flowchart showing the processes of communication playback control and playback output start control. [Figure 10] Flowchart showing the process during playback. [Figure 11] Diagram showing another morphological example of the music playback toy. [Figure 12] Diagram showing another morphological example of the music playback toy. [Figure 13] Diagram explaining the communication playback function and playback output start function of the music playback toy. [Figure 14] Diagram explaining music playback / output and voice line playback / output in a modification example. [Figure 15] Flowchart showing the process performed by the music playback toy in a modification example. [Figure 16] Flowchart showing the processes of communication playback control and playback output start control in a modification example. [Figure 17] Flowchart showing the process during playback in a modification example.
Mode for Carrying Out the Invention
[0016] Hereinafter, referring to the drawings, a preferred embodiment of the present invention will be described by taking a music playback toy whose overall shape is a microphone shape as an example. Note that the present invention is not limited by the embodiments described below, nor is the applicable form of the present invention limited to the following embodiments. Also, in the description of the drawings, the same parts are denoted by the same reference numerals.
[0017] Figures 1 and 2 show schematic configuration examples of the music playback toy 1 of this embodiment. As shown in Figures 1 and 2, in this embodiment, two types of music playback toys 1 (1-1, 1-2) with different appearances are provided. Three or more types may also be provided. Although all are shaped like microphones, they are each designed to resemble different singers or characters (characters C1 and C2 in Figures 1 and 2; hereinafter also referred to as "image characters"), and have different appearances in terms of the color scheme and decorations of each part. Hereinafter, the types of music playback toys 1 will be referred to as "types," and the type in Figure 1-1 will be referred to as "Type X," and the type in Figure 1-2 will be referred to as "Type Y" for identification.
[0018] Music playback toy 1 can play and output predetermined songs and predetermined dialogue sounds. In this embodiment, the song is a song that includes a predetermined singing part and a predetermined musical part. Specifically, for example, the song that can be played and output by music playback toy 1-1 is a song with vocals sung by the corresponding image character C1. The dialogue sounds that can be played and output are the dialogue sounds of the corresponding image character C1. On the other hand, the song that can be played and output by music playback toy 1-2 is a song with vocals sung by the corresponding image character C2. The dialogue sounds that can be played and output are the dialogue sounds of the corresponding image character C2.
[0019] More specifically, as shown in Figures 1 and 2, each music playback toy 1 (1-1, 1-2) is capable of playing and outputting, for example, three solo songs, two duet songs, and five types of dialogue sounds.
[0020] A solo song is a piece of music consisting of a solo vocal part and a musical part. The musical part is played in the background, with the image character corresponding to the toy singing the vocal part solo. Because it is a solo, the vocal part can be considered a single vocal part.
[0021] A duet song is a musical piece consisting of two vocal parts and a musical part. The musical part is played in the background, with the image character corresponding to the toy in question and the image character corresponding to another toy (which can be called another machine) each singing their respective vocal parts. In this embodiment, one of the two vocal parts is called the main part (MP), and the other is called the sub-part (SP) to distinguish them.
[0022] Specifically, for example, for each type of music playback toy 1, one duet song is prepared in which that type is assigned as the main part (a duet song in which the image character of that type sings the main part). In this embodiment, since there are two types, duet song Sxy, in which the main part is assigned to type X and the sub-part is assigned to type Y, and duet song Syx, in which the main part is assigned to type Y and the sub-part is assigned to type X, are prepared as duet songs that can be played and output by each type of music playback toy 1. If there are three or more types, duet songs in which a different type from the main part is assigned as the sub-part are prepared as duet songs that can be played and output by each type of music playback toy 1 for the main part and sub-part.
[0023] Duet songs correspond to songs with IDs that are associated with predetermined IDs. As will be explained in detail later, duet songs can only be played and output if predetermined communication using the IDs is successful between the main part and sub-part types of song playback toys 1.
[0024] Users can hold the music playback toy 1 (1-1, 1-2) like a microphone and enjoy listening to the audio output of songs, singing along to solo or duet songs while pretending to be the singer or other character associated with the toy, or outputting dialogue. The number of playable solo songs, duets, and dialogues that can be output is just an example and is not limited to the number shown.
[0025] 1. About the device configuration As shown in Figure 1, each type of music playback toy 1 is equipped with an A button 11 for inputting instructions to start a song, a B button 13 for inputting instructions to start dialogue, a vocal switch 15 for inputting instructions to switch between "vocal on" and "vocal off", a speaker 17 for outputting music audio data and dialogue audio data, and an infrared communication module 19. In addition, it is equipped with a power button, volume buttons, a built-in battery, etc. It is also possible to add a microphone function and configure it to output the user's singing voice in sync with the music output.
[0026] When the music playback toy 1 is powered on, it enters a standby mode that accepts commands to start a song (solo or duet) or spoken dialogue. Button A 11 is a button that can be used for various operations. In standby mode, a single press of the button can be used to input a command to start a solo song, and repeated presses can be used to sequentially switch between the solo songs being output.
[0027] Additionally, users can input the command to start a duet song by long-pressing button A11 while in standby mode.
[0028] Additionally, the user can input a command to stop the output by pressing and holding button A11 while a song (solo or duet) is playing. When a stop command is given, playback and output of the song are forcibly terminated, and the device switches to standby mode.
[0029] Button B 13 is used to input a command to start dialogue audio when pressed during standby mode or while music audio is being output (dialogue audio output operation).
[0030] The vocal switch 15 is configured, for example, using a slide switch to switch between vocal on and vocal off. The slide switch may be of the type that switches by displacing a button to one of two positions, or it may be of the type that operates by sliding a button that is biased to return to a predetermined initial position against that biasing force. In the latter case, it is preferable that the switching operation by the vocal switch 15 is only effective (i.e., accepts operation input) while the audio output of the song is active.
[0031] The infrared communication module 19 performs infrared communication, a type of short-range wireless communication, with other music playback toys 1. Note that the communication with other music playback toys 1 is not limited to infrared communication; other short-range wireless communication methods such as Bluetooth® may also be used. In that case, the other short-range wireless communication method will be used instead of the infrared communication method described in this embodiment.
[0032] 2. About playback and output As described above, the music playback toy 1 of this embodiment plays and outputs music, as well as dialogue audio. During output, it is possible to mute the volume of the vocal part to zero so that only the music part is output, or to re-output the muted vocal part together with the music part. It is also possible to output dialogue audio while music audio is being output.
[0033] To this end, the music playback toy 1 stores, for each song, a first sound source data and a second sound source data as the sound source data for that song. The first sound source data is, for example, data that includes the sound source of the vocal part and the sound source of the song in question (hereinafter referred to as "vocal sound source data"), and the second sound source data is data that does not include the sound source of the vocal part of the song in question, but includes the sound source of the song part (hereinafter referred to as "vocalless sound source data"). In addition, the music playback toy 1 stores dialogue audio data for each line of dialogue.
[0034] Figure 3 illustrates the playback and output of a song, as well as the playback and output of dialogue audio during the output of the song, using a solo song as an example. It shows the changes in volume of the sound source data and dialogue audio data in response to the operation input. As shown in Figure 3, when button A 11 is pressed in standby mode to input the command to start a solo song, the music playback toy 1 selects the solo song to be played. The music playback toy 1 then performs an audio output control process that simultaneously plays the vocal sound source data and the instrumental sound source data of the selected solo song and outputs them as a combined sound. For example, the music playback toy 1 combines and outputs the vocal sound source data and the instrumental sound source data of the solo song at a predetermined volume set as the basic volume. As a result, the music playback toy 1 enters the basic playback state of the song (in this case, the solo song).
[0035] Then, if button B 13 is pressed during the output of the solo song to input a command to start the dialogue audio, the music playback toy 1 selects the dialogue audio to be played, for example, randomly. The music playback toy 1 then performs a dialogue audio output control process that mutes the volume of the vocal audio data by performing first sound source volume suppression control, and plays the selected dialogue audio data and outputs it at the basic volume. At this time, since the non-vocal audio data is still being output, the non-vocal audio data and the dialogue audio data are combined and output. Once the playback and output of the dialogue audio data is finished, the music playback toy 1 returns the volume of the vocal audio data to the basic volume. That is, it returns to a state where the vocal audio data and non-vocal audio data are simultaneously combined and output at the basic volume (basic playback state).
[0036] Furthermore, if the vocal switch 15 is switched to vocal off while the audio output of the solo song is playing, the music playback toy 1 performs a first sound source volume suppression control process, which suppresses the volume of the vocal sound source data. This process sets the volume of the vocal sound source data to zero. As a result, the vocal part becomes inaudible, and only the instrumental sound source data (only the song part of the solo song) is played, resulting in a karaoke mode. Note that since the overall volume also decreases because the volume of the vocal sound source data is set to zero, the system may be configured to adjust the volume of the instrumental sound source data to be higher than the base volume.
[0037] Furthermore, if the vocal switch 15 is subsequently switched to vocal on, the music playback toy 1 returns the volume of the vocal-enabled audio data to the basic volume. If the volume of the non-vocal audio data was adjusted to a level higher than the basic volume during the first audio source volume suppression control process, that volume is returned to the basic volume. As a result, the device returns to a state where the vocal-enabled audio data and the non-vocal audio data are simultaneously synthesized and output at the basic volume (basic playback state), and the vocal part becomes audible again. By performing predetermined operations during the synthesized output, the user can switch to karaoke mode where only the non-vocal audio data is heard, or return to a state where both the vocal-enabled and non-vocal audio data are synthesized, allowing for diverse ways to enjoy the audio output. For example, the user can switch to karaoke mode in the middle of enjoying the vocal audio and sing along to the chorus of the song, enjoying it in their own way.
[0038] 3. Regarding the playback of duet songs Basically, the sound source data for duet songs is also stored in the music playback toy 1, and it is played back and output in the same manner as solo songs, as explained with reference to Figure 3. However, duet songs are songs with IDs, and a predetermined ID is associated with their sound source data. Duet songs can only be played back and output if communication using the ID related to the duet song is successful between one type of music playback toy 1 (hereinafter referred to as "the player") and another type of music playback toy 1 that is not the player's type (hereinafter referred to as "the other player"). Below, we will focus on one duet song, Sxy, and explain the structure of its sound source data and the functions of the music playback toy 1 related to its playback and output.
[0039] 3-1. Regarding the audio data for duet songs As described above, a duet song consists of two vocal parts, a main part and a sub-part, and a song part. It can be played back and output by a song playback toy 1 of the type assigned to the main part and a song playback toy 1 of the type assigned to the sub-part. Figure 4 is a diagram illustrating the sound source data for the duet song Sxy. In this embodiment, the sound source data for each song, both solo and duet, is stored in the memory unit 150 (see Figure 7) of each song playback toy 1-1, 1-2, along with the song data for the corresponding song.
[0040] Specifically, as shown in Figure 4, the song data 200 stores a song number 201 for identifying the song, a song type 202 indicating whether the song is a solo or duet, vocal audio data 207 (207-1, 207-2), and instrumental audio data 209. Furthermore, if the song is a duet, the song data 200 also stores a main part type 203, a sub-part type 204, and an ID 205.
[0041] Main part type 203 is set to the type of music playback toy 1 assigned to the main part of the duet song. Sub part type 204 is set to the type of music playback toy 1 assigned to the sub part of the duet song.
[0042] ID205 is associated with an ID indicating the type of music playback toy 1 assigned to the sub-part of the duet song. Since the sub-part of the example duet song Sxy is assigned type Y, ID205 is set to "Y".
[0043] If we consider music playback toy 1-1 as the player's machine, the ID205 of the duet song Sxy indicates type Y of music playback toy 1-2, which is another machine, and corresponds to another machine's ID. Therefore, for music playback toy 1-1, the duet song Sxy is a song with an ID that is associated with another machine's ID. On the other hand, if we consider music playback toy 1-2 as the player's machine, the ID205 of the duet song Sxy indicates the player's machine type. Therefore, for music playback toy 1-2, the duet song Sxy does not correspond to a song with an ID that is associated with another machine's ID.
[0044] The audio data for a duet song, like that for a solo song, consists of a first audio data, which is the vocal audio data 207, and a second audio data, which is the instrumental audio data 209. However, in the case of a duet song, the content of the vocal audio data 207 differs depending on whether the player's machine type is assigned to the main part or the sub-part. Taking the duet song Sxy in Figure 4 as an example, the music playback toy 1-1 of type X, which is assigned to the main part, stores data including the main part's audio source and the song part's audio source (data for the main part) as the vocal audio data 207-1. On the other hand, the music playback toy 1-2 of type Y, which is assigned to the sub-part, stores data including the sub-part's audio source and the song part's audio source (data for the sub-part) as the vocal audio data 207-2. In the case of the duet song Syx, the main and sub parts of each song playback toy 1 are reversed compared to the duet song Sxy, so the stored audio data (whether it's data for the main part or data for the sub part) is also reversed.
[0045] Then, when the A button 11 is pressed and held while each music playback toy 1 is in standby mode, and a command to start a duet song is input, the duet song playback function described later will start audio output control processing for the duet song to be output. As a result, each music playback toy 1 will be in the basic playback state of a song (in this case, a duet song). However, the duet song to be output will change depending on which music playback toy 1's A button 11 is pressed and held while in standby mode. To start the example duet song Sxy, the A button 11 of music playback toy 1-1 must be pressed and held. When the A button 11 of music playback toy 1-1 is pressed and held, if communication such as sending a duet request to music playback toy 1-2 via the communication playback function is successful, it will start audio output control processing and simultaneously play and combine the main part data, the vocal sound source data 207-1 and the non-vocal sound source data 209, and output them.
[0046] Meanwhile, when music playback toy 1-2 successfully receives a duet request from music playback toy 1-1, it starts audio output control processing at the same time as music playback toy 1-1 using its playback output start function, and simultaneously plays and combines the sub-part data, vocal sound source data 207-2 and non-vocal sound source data 209. In other words, the main part and song part of the duet song Sxy are output by the combined output of music playback toy 1-1, and in synchronization with this, the sub-part and song part of the duet song Sxy are output by the combined output of music playback toy 1-2. As a result, the combined outputs of each music playback toy overlap, achieving audio output of the main part and sub-part that matches the song part.
[0047] Furthermore, if the vocal switch 15 is switched to vocal off in music playback toy 1-1 while the duet song Sxy is being output, music playback toy 1-1 will execute the first sound source volume suppression control process, thereby muting the main part. On the other hand, if the vocal switch 15 is switched to vocal off in music playback toy 1-2, music playback toy 1-2 will execute the first sound source volume suppression control process, thereby muting the sub-part.
[0048] In other words, for duet songs, the following combinations of sounds can be output by the two music playback toys 1. (1) "Main part + sub-part + song part" Music Playback Toy 1-1: Audio output of main part + song part Music Playback Toy 1-2: Audio output of sub-parts + song parts (2) "Main part + song part" Music Playback Toy 1-1: Audio output of main part + song part Music Playback Toy 1-2: Audio Output of Song Part (Vocals Off) (3) "Sub-part + Song part" Music Playback Toy 1-1: Audio Output of Song Part (Vocals Off) Music Playback Toy 1-2: Audio output of sub-parts + song parts (4) "Song part only" Music Playback Toy 1-1: Audio Output of Song Part (Vocals Off) Music Playback Toy 1-2: Audio Output of Song Part (Vocals Off)
[0049] Therefore, by having different types of music playback toys 1 each play a duet song based on the music data 200 stored in them, users can sing along while listening to both the main and sub-parts, or enjoy a karaoke mode by muting one or both of the sounds. Even with the same duet song, the range of enjoyment can be broadened by diversifying the output sounds.
[0050] 3-2. About the duet song playback function In the music playback toy 1 (1-1, 1-2) of this embodiment, among the duet songs that can be played and output, the only duet songs that can accept a user start command for the player's machine are those in which the player's machine type is assigned to the main part. In other words, the only duet songs that can accept a user start command are those in which a machine other than the player's machine is assigned to the sub-part, and an ID 205 indicating that other machine type is associated with it. That is, the only duet songs that can accept a user start command for the player's machine are songs with an ID associated with the ID of another machine.
[0051] In this embodiment, each type is assigned one song to the main part, so the duet song to be played and output is determined by which music playback toy 1 has the A button 11 pressed and held down. Specifically, music playback toy 1-1 accepts the press and hold of the A button 11 as an instruction to start the duet song Sxy (see Figure 1). Music playback toy 1-2 accepts the press and hold of the A button 11 as an instruction to start the duet song Syx (see Figure 2).
[0052] Each music playback toy 1 then performs a communication playback control process to implement a communication playback function, which starts playback and output of a duet song when the A button 11 is pressed and held to receive a command to start a duet song, and a playback output start control process to implement a duet song playback function, which starts playback and output of a duet song when a command to start a duet song is given by another music playback toy 1.
[0053] Figure 5 illustrates the communication playback function and playback output start function of music playback toy 1. In Figure 5, when playing the duet song Sxy, music playback toy 1-1 performs communication playback control processing, and music playback toy 1-2 performs playback output start control processing, showing the communication between music playback toys 1-1 and 1-2 using the ID related to the duet song Sxy. Also in Figure 5, the relationship between the duet song and ID stored in each music playback toy 1 (1-1, 1-2) is shown in a callout.
[0054] As described above, when the music playback toy 1 is powered on, it enters standby mode, and along with this transition to standby mode, it enters a standby state where it waits to receive infrared signals.
[0055] Then, as shown in Figure 5, when the A button 11 of the music playback toy 1-1 is pressed and held during standby mode, and a command to start a duet song is given, the playback target is determined to be the duet song Sxy. Then, the music playback toy 1-1 that received the command to start the duet song (hereinafter also referred to as the "requesting toy") releases the standby state described above and then performs the communication playback control process. In the communication playback control process, first, the requesting toy 1-1 transmits its own type information "X" via infrared communication, thereby sending a duet request to the music playback toy 1 within the communication range.
[0056] On the other hand, if a music playback toy 1 that is in standby mode receives a duet request from another music playback toy 1, it will release the standby mode and then execute the playback output start control process. In the example in Figure 5, communication is established between the requesting toy 1-1 and the music playback toy (hereinafter also referred to as the "receiving toy") 1-2, and the receiving toy 1-2 receives a duet request from the requesting toy 1-1, causing the receiving toy 1-2 to start the playback output start control process.
[0057] In the playback output start control process, first, the receiving toy 1-2 identifies duet song Sxy from among the playable duet songs Syx and Sxy, where the type "Y" of the receiving toy 1-2 is assigned to the sub-part, and the self-type information "X" related to the duet request is assigned to the main part, as the duet song to be played. Subsequently, the receiving toy 1-2 performs an ID transmission process, which includes transmitting the ID "Y" related to the identified duet song via infrared communication. Then, immediately after the successful communication related to the ID transmission process, the receiving toy 1-2 starts the audio output control process for duet song Sxy, thereby starting the combined output of the vocal sound source data 207-2 and the instrumental sound source data 209.
[0058] Meanwhile, requesting toy 1-1, after sending a duet request, executes an ID reception process that includes receiving the ID of the duet song Sxy to be played. Requesting toy 1-1 then receives the ID "Y" from receiving toy 1-2, and determines that the communication related to the ID reception process was successful when it matches the ID 205 of the duet song Sxy to be played. In this case, immediately after the successful communication, requesting toy 1-1 starts audio output control processing for the duet song Sxy, thereby starting the combined output of the vocal sound source data 207-1 and the instrumental sound source data 209. This enables a configuration in which songs with IDs associated with other devices are played in sync with other devices.
[0059] In this embodiment, there are two types of music playback toy 1. However, if there are three or more types, and the duet songs played and output by the combination of two music playback toys 1 are different, then, in the manner described above, one duet song is prepared for each type of music playback toy 1 assigned to the main part, and an ID indicating the type assigned to the sub-part is associated with the sound source data of that duet song.
[0060] Figure 6 shows an example of duet songs that can be stored as playable in each of the three types of music playback toys 1 (1-1, 1-2, 1-3) when there are three types of music playback toys 1 (for example, types X, Y, and Z). In this modified example, in addition to the duet songs Sxy and Syx exemplified in Figures 1 and 2, duet songs Szx and Szy with type Z assigned to the main part, and duet songs Sxz and Syz with type Z assigned to the sub-part are also provided. This makes it possible to achieve a configuration in which, even when there are three or more types of music playback toys 1, the duet songs to be played can be played simultaneously (synchronized) by having the music playback toy 1 of the sub-part type respond to the infrared communication that sends a duet request made by the music playback toy 1 of the main part type by sending an ID.
[0061] For example, suppose a Type Z music playback toy 1-3 receives a command to start a duet song, causing the music playback toy (requesting toy) 1-3 to execute communication playback control processing and send its own type information "Z" as a duet request. Then, suppose a Type Y music playback toy (receiving toy) 1-2 receives the duet request from the requesting toy 1-3 and starts playback output start control processing. Since the start command came from music playback toy 1-3, the playback target for music playback toy 1-3 is confirmed to be the duet song Szy.
[0062] In that case, the receiving toy 1-2 identifies the duet song Szy as the one to be played from among the three playable duet songs, where the type "Y" of the receiving toy 1-2 is assigned to the sub-part, and the type information "Z" received as a duet request is assigned to the main part. The receiving toy 1-2 then executes an ID transmission process to send the ID "Y" related to the duet song Szy, and immediately after successful communication, starts the audio output control process for the duet song Szy.
[0063] Meanwhile, requesting toys 1-3 perform an ID reception process, which includes receiving the ID "Y" related to the duet song Szy to be played, and immediately after successful communication, initiate audio output control processing for the duet song Szy.
[0064] 4. Functional Configuration Figure 7 is a block diagram showing an example of the functional configuration of the music playback toy 1. As shown in Figure 7, the music playback toy 1 comprises an operation input unit 110, a sound output unit 120, a short-range wireless communication unit 130, a control unit 140, and a storage unit 150.
[0065] The operation input unit 110 outputs an operation input signal to the control unit 140 in accordance with the user's operation input. This can be achieved by, for example, a push switch, slide switch, dial switch, lever switch, etc. In Figures 1 and 2, this corresponds to button A 11, button B 13, and vocal switch 15.
[0066] The sound output unit 120 performs various sound outputs based on the sound signals from the control unit 140. In this embodiment, it outputs sound source data of the music to be played and dialogue audio data of the dialogue audio. In Figures 1 and 2, the speaker 17 corresponds to this.
[0067] The short-range wireless communication unit 130 enables short-range wireless communication with other music playback toys 1. For example, it consists of a short-range wireless device that performs communication using infrared communication or Bluetooth®. In Figures 1 and 2, the infrared communication module 19 corresponds to this.
[0068] The control unit 140 is implemented using various processors such as a CPU (Central Processing Unit) and a DSP (Digital Signal Processor), as well as electronic components such as an ASIC (Application Specific Integrated Circuit), an FPGA (field-programmable gate array), and an IC memory, and controls data input and output with each part of the device. It then performs various calculations based on predetermined programs and data, operation input signals from the operation input unit 110, and data received from other music playback toys 1, and comprehensively controls the operation of the music playback toy 1.
[0069] Furthermore, the control unit 140 includes an audio output control unit 141, a first sound source volume suppression control unit 143, a dialogue audio output control unit 145, a communication playback function unit 147, and a playback output start control unit 149. These functional units may be processing blocks implemented as software by executing a program, or they may be circuit blocks implemented by hardware circuits such as ASICs or FPGAs.
[0070] The audio output control unit 141 is a functional unit that performs audio output control processing, and synthesizes and outputs audio based on vocal audio data and audio based on non-vocal audio data related to the song to be played at a given volume ratio. In this embodiment, in the basic playback state, the audio output control unit 141 synthesizes and outputs the volume of the vocal audio data and the volume of the non-vocal audio data at approximately equal volume ratios. For example, when the A button 11 is pressed during standby mode to input a song start command, the audio output control unit 141 synthesizes and outputs the vocal audio data and non-vocal audio data at the basic volume.
[0071] The first sound source volume suppression control unit 143 is a functional unit that executes the first sound source volume suppression control process. When the vocal switch 15 is switched to vocal off while the audio output control unit 141 is outputting music audio, the first sound source volume suppression control unit 143 performs the first sound source volume suppression control to mute the volume of the vocal-inclusive audio data of the music being output. In this embodiment, the first sound source volume suppression control unit 143 performs the first sound source volume suppression control while maintaining the volume of the instrumental-free audio data of the music.
[0072] The dialogue audio output control unit 145 is a functional unit that executes dialogue audio output control processing. When the B button 13 is pressed while music audio is being output, it first randomly selects a dialogue audio to be played. Then, the dialogue audio output control unit 145 performs first sound source volume suppression control in the same manner as the first sound source volume suppression control unit 143, muting the volume of the vocal sound source data of the music being output, and playing the dialogue audio data of the selected dialogue audio for audio output. In this embodiment, the dialogue audio output control unit 145 also selects a dialogue audio to be played if the B button 13 is pressed while in standby mode, and plays the dialogue audio data of the selected dialogue audio for audio output.
[0073] The communication playback function unit 147 is a functional unit that realizes the communication playback function by executing communication playback control processing. Specifically, when the A button 11 is pressed and held during standby mode to receive a command to start a duet song, the communication playback function unit 147 performs short-range wireless communication (e.g., infrared communication) with other music playback toys 1. The communication playback function unit 147 then executes the ID reception processing described with reference to Figure 5, and if the communication related to the ID reception processing is successful, it activates the audio output control unit 141 immediately after success to start audio output control processing for the duet song.
[0074] The playback output start control unit 149 is a functional unit that performs playback output start control processing to realize the playback output start function. Specifically, when the playback output start control unit 149 receives a duet notification from another music playback toy 1 after another music playback toy 1 has issued a command to start a duet song and the communication playback function unit 147 in the music playback toy 1 has performed communication playback control processing, it performs the ID transmission processing described with reference to Figure 5. If the communication related to the ID transmission processing is successful, the audio output control unit 141 is activated immediately after the success to start audio output control processing for the duet song.
[0075] The memory unit 150 pre-stores programs for operating the music playback toy 1 and realizing its various functions, as well as data used during the execution of these programs, or temporarily stores them each time processing is performed. For example, this can be implemented using IC memory such as RAM or ROM, magnetic disks such as hard disks, or optical disks such as CD-ROMs or DVDs.
[0076] For example, the memory unit 150 stores the music playback program 151. The music playback program 151 is a program that causes the control unit 140 to function as the audio output control unit 141, the first sound source volume suppression control unit 143, the dialogue audio output control unit 145, the communication playback function unit 147, and the playback output start control unit 149.
[0077] Furthermore, the memory unit 150 stores music data 200 as a music data memory unit, and also stores dialogue data 300 as a dialogue voice data memory unit.
[0078] A song data file 200 is prepared for each playable and outputtable song. Figure 4 shows an example of the data structure of song data 200 when the song is a duet. If the song is a solo song, the structure of song data 200 will be the same as the structure in Figure 4, but with the main part type 203, sub-part type 204, and ID 205 omitted (or not set).
[0079] A dialogue data file 300 is prepared for each playable / outputtable dialogue audio. Each dialogue data file 300 includes the dialogue number 301 of the corresponding dialogue audio and the dialogue audio data 303 related to that dialogue audio.
[0080] 5. About the processing flow Figure 8 is a flowchart showing the processing flow performed by the music playback toy 1 when the power button is pressed and the power is turned on in this embodiment. The processing described here is achieved by the control unit 140 reading and executing the music playback program 151.
[0081] As shown in Figure 8, when the music playback toy 1 is powered on, it enters standby mode (step S1). When it enters standby mode, the control unit 140 sets a standby state to wait for infrared reception (step S3).
[0082] Then, if the A button 11 is pressed during standby mode (step S5: YES), the control unit 140 releases the standby state (step S7) and selects the solo song to be played (step S9). If the A button 11 is pressed repeatedly, the control unit selects the solo song to be played by sequentially selecting the playable solo songs each time the button is pressed. After this selection, the audio output control unit 141 executes audio output control processing and starts playback and output of the solo song selected in step S9 (step S11). In the audio output control processing, the audio output control unit 141 refers to the music data 200 related to the solo song and simultaneously plays and combines the audio data with vocals and the audio data without vocals for output. After playback and output have started, playback processing is performed (step S13).
[0083] Furthermore, if the A button 11 is pressed and held while in standby mode (step S15: YES), the control unit 140 releases the standby state (step S17), and then the communication playback function unit 147 executes the communication playback control process (step S19).
[0084] Furthermore, if the B button 13 is pressed while the control unit 140 is in standby mode (step S21: YES), the control unit 140 will release the standby state (step S23), and then the dialogue audio output control unit 145 will randomly select a dialogue audio to be played back (step S25). The dialogue audio output control unit 145 will then play back the dialogue audio data of the selected dialogue audio and output the audio (step S27).
[0085] Furthermore, if the control unit 140 establishes communication with another music playback toy 1 while in standby mode and receives a duet request (step S29: YES), after releasing the standby state (step S31), the playback output start control unit 149 executes the playback output start control process (step S33).
[0086] Subsequently, the control unit 140 performs a termination check, and until it determines that the process is complete (step S35: NO), it returns to step S1 and enters standby mode, repeating the process described above. For example, if the power button is pressed and the power is cut off (step S35: YES), this process ends.
[0087] Figure 9 is a flowchart showing the flow of the communication playback control process performed in step S19 and the playback output start control process performed in step S33 of Figure 8. The following explanation assumes a scenario where the communication playback function unit 147 performs the communication playback control process in one of the two types of music playback toys (requesting toy) 1, and after communication with the other type of music playback toy (receiving toy) 1 is established, the playback output start control unit 149 of the receiving toy 1 performs the playback output start control process. In Figure 9, the preceding processes of the communication playback control process in the requesting toy 1 are shown as steps S15 and S17, and the preceding processes of the playback output start control process in the receiving toy 1 are shown as steps S29 and S31.
[0088] As shown in Figure 9, when the A button 11 is pressed and held while the requesting toy 1 is in standby mode (step S15: YES), the standby state is released (step S17), and then the communication playback function unit 147 executes the communication playback control process (step S19). In other words, in the communication playback control process, the communication playback function unit 147 first transmits a duet request by transmitting its own type information, which indicates the type of its own device, via infrared communication (step S191).
[0089] On the other hand, when the receiving toy 1 receives a duet request (step S29: YES), after releasing the standby state (step S31), the playback output start control unit 149 executes playback output start control processing (step S33). That is, the playback output start control unit 149 identifies the duet song to be played based on its own type information related to the duet request (step S331). Next, the playback output start control unit 149 executes ID transmission processing and transmits the ID related to the identified duet song via infrared communication (step S332). Then, if the communication related to the ID transmission processing executed in step S332 is successful (step S333: YES), the playback output start control unit 149 starts playback of the duet song to be played by starting audio output control processing immediately after the success (step S334). Then, after playback has started, it finishes the playback output start control processing and executes playback processing (step S335).
[0090] Furthermore, in the requesting toy 1, the communication playback function unit 147 sends a duet request in step S191 and then executes ID reception processing (step S192). After that, the communication playback function unit 147 waits to receive an ID related to the duet song to be played. Then, if the communication playback function unit 147 receives the ID and succeeds in the communication related to the ID reception processing executed in step S192 (step S193: YES), it starts the audio output control processing immediately after success, thereby starting playback of the duet song to be played (step S194). Then, once playback has started, it finishes the communication playback control processing and executes playback processing (step S195).
[0091] Next, we will explain the playback processing performed in step S13 in Figure 8, and steps S195 and S335 in Figure 9. Figure 10 is a flowchart showing the flow of the playback processing.
[0092] During playback processing, if the playback processing is performed in step S13 in Figure 8, various user operations will be accepted until the playback and output of the solo song, which was started in step S11, is finished. If the playback processing is performed in step S195 or step S335 in Figure 9, various user operations will be accepted until the playback and output of the duet song, which was started in step S194 or step S334 in Figure 9, is finished.
[0093] In other words, during playback processing, if button A 11 is pressed and held (step S101: YES), the control unit 140 terminates the playback and output (the ongoing audio output control processing) of the song (solo or duet) that is currently being output (step S103).
[0094] Furthermore, if button B 13 is pressed (step S105: YES), the dialogue audio output control unit 145 executes dialogue audio output control processing, first selecting a dialogue audio to be played, for example, randomly (step S107). Next, the dialogue audio output control unit 145 performs first sound source volume suppression control, muting the volume of the vocal sound source data of the song being output (step S109), and then plays the dialogue audio data of the dialogue audio selected in step S107 and outputs the audio (step S111). Once the playback and output of the dialogue audio data is finished, the dialogue audio output control unit 145 returns the volume of the vocal sound source data that was muted in step S109 back to the basic volume (step S113).
[0095] Furthermore, if the vocal switch 15 is switched from vocal on to vocal off (step S115: YES), the first sound source volume suppression control unit 143 executes the first sound source volume suppression control process and performs the first sound source volume suppression control to mute the volume of the vocal sound source data of the song being output (step S117).
[0096] Furthermore, if the vocal switch 15 is switched from vocal off to vocal on (step S119: YES), the first sound source volume suppression control unit 143 returns the volume of the vocal sound source data that was muted in step S117 back to the basic volume (step S121).
[0097] Then, once playback of the currently playing / outputting music has finished (step S123: YES), the playback processing is terminated. Note that when changing the volume of the sound source data as described above, the volume may be gradually changed during playback and muting (fade in, fade out).
[0098] As described above, according to this embodiment, by switching the vocal switch 15 during the combined output of the audio of a song including the vocal part and the music part, it is possible to mute the vocal part and output only the music part, or to output the muted vocal part again, thereby enjoying the playback of the song. By pressing the B button 13, it is also possible to mute the vocal part and output dialogue audio. Furthermore, when playing and outputting a duet song, by communicating with another music playback toy 1 using an ID via short-range wireless communication (e.g., infrared communication), the duet song can be played in synchronization with the other music playback toy 1. Therefore, it becomes possible to enjoy the audio of the output song in a variety of ways, and it is possible to provide a music playback toy 1 that adds a new level of interest to the audio output of songs.
[0099] It should be noted that the applicable embodiments of the present invention are not limited to those described above, and components can be added, omitted, or modified as appropriate.
[0100] For example, in the embodiment described above, the external form of the music playback toy 1 was exemplified as a form resembling a microphone, but the external form of the music playback toy 1 is not particularly limited. For example, as shown in Figure 11, the external form may be that of a plush toy of a corresponding image character or the like. Alternatively, as shown in Figure 12, the external form may be that of a plastic or soft vinyl chloride figure resembling an image character or the like. In addition, the external form may be that of an item used by the image character or the like. Even when implemented as a plush toy or figure, the A button 11, B button 13, vocal switch 15, speaker 17, etc., as described with reference to Figure 1, are placed in appropriate locations.
[0101] Furthermore, in the above embodiment, a configuration was provided in which duet songs can only be played when communicating with another type of music playback toy 1. In contrast, for duet songs where the main part is assigned to the player's type, a configuration may be provided that allows playback independently regardless of whether or not there is communication with the sub-part music playback toy 1.
[0102] Furthermore, in the above embodiment, an example was described in which data including the sound source of the vocal part and the sound source of the song is used as the first sound source data, and data including the sound source of the song part but not the vocal part is used as the second sound source data, and each data is played simultaneously and synthesized for output. In contrast, the first sound source data can also be data consisting only of the sound source of the vocal part. In that case as well, by playing the first sound source data and the second sound source data simultaneously and synthesizing them for output, audio output of the vocal part that matches the song part is achieved.
[0103] Furthermore, while the above embodiment exemplifies a musical piece including a vocal part and a musical part, it is not limited to this. For example, it can be similarly applied to musical pieces composed of multiple musical parts, such as solo pieces with accompaniment or ensemble pieces consisting of a solo part and an accompaniment part. For example, data including the sound source of the solo part may be designated as the first sound source data, and data that does not include the sound source of the solo part but includes the sound source of the accompaniment part may be designated as the second sound source data.
[0104] Furthermore, in the above embodiment, an example was shown in which the volume of the vocal-enabled audio source data is muted by setting it to zero as the first sound source volume suppression control performed when the vocal switch 15 is switched to vocal off or when the B button 13 is pressed to input a command to start dialogue audio. However, it is not necessarily required to set it to zero, and the volume may be reduced by adjusting it to a level lower than the basic volume (for example, by halving the volume or setting it to about 10%). This can be achieved by pre-determining the volume level when the volume is reduced.
[0105] Furthermore, in the above embodiment, with respect to duet songs, for example, it was explained that the Type X music playback toy 1-1 assigned to the main part stores data including the sound source for the main part and the sound source for the song part (data for the main part) associated with the other device ID "Y", and the Type Y music playback toy 1-2 assigned to the sub-part stores data including the sound source for the sub-part and the sound source for the song part (data for the sub-part) associated with its own device ID "Y". However, the associated IDs may be reversed.
[0106] Specifically, the Type X music playback toy 1-1 assigned to the main part may store data for the main part in association with its own ID "X", while the Type Y music playback toy 1-2 assigned to the sub-part may store data for the sub-part in association with the ID "X" of other machines.
[0107] In this case, communication between the two music playback toys 1 is as shown in Figure 13, for example. Figure 13 is a diagram showing communication between music playback toys 1-1 and 1-2 using an ID related to the duet song Sxy, and is shown as a modified example corresponding to Figure 5, with differences from Figure 5 indicated by thick lines and bold text.
[0108] First, when the requesting toy 1-1 is in standby mode and the A button 11 is pressed and held, and a command to start a duet song is given, it confirms that the duet song Sxy, in which the player's unit is the main part, will be played as the duet song. Next, the requesting toy 1-1 sends a duet request that includes the player's type information "X", which indicates the player's unit type.
[0109] Upon receiving a duet request, the receiving toy 1-2 identifies duet song Sxy from among the playable duet songs Syx and Sxy, where the type "Y" of the receiving toy 1-2 is assigned to the sub-part and the self-type information "X" related to the duet request is assigned to the main part, as the duet song to be played. Next, the receiving toy 1-2 transmits a reception confirmation notification via infrared communication to indicate that the identification has been successful, and immediately after the successful communication related to the reception confirmation notification, it starts voice output control processing for duet song Sxy.
[0110] Meanwhile, requesting toy 1-1 determines that communication is successful after receiving a confirmation notification from receiving toy 1-2 following the transmission of the duet request. Immediately after the successful communication, requesting toy 1-1 starts audio output control processing for the duet song Sxy.
[0111] Furthermore, while the above-described embodiment shows an example in which the volume of the vocal audio data and the volume of the non-vocal audio data are combined and output at approximately equal volume ratios during the basic playback state of the music, the embodiment is not limited to this. Figure 14 is a diagram illustrating the playback and output of the music in this modified example, and the playback and output of the dialogue audio during the output of the music, using a solo song as an example, and shows the changes in volume of the sound source data and dialogue audio data in response to the operation input.
[0112] In this modified example, if button A 11 is pressed during standby mode to input a command to start a solo song, the music playback toy 1 selects the solo song to be played, similar to the embodiment described above. The music playback toy 1 then performs an audio output control process that synthesizes and outputs the audio based on the vocal audio data of the selected solo song and the audio based on the instrumental audio data. In this modified example, as shown in Figure 14, the music playback toy 1 performs the synthesizer output with a volume ratio in which the volume of the vocal audio data of the solo song is set to the base volume and the volume of the instrumental audio data of the solo song is muted (zero). As a result, the music playback toy 1 enters the basic playback state of the song (in this case, the solo song). In other words, the basic playback state in this modified example means that the instrumental audio data is not output, and only the vocal audio data is output.
[0113] Then, if button B 13 is pressed during the output of the solo song to input a command to start the dialogue audio, the music playback toy 1 selects the dialogue audio to be played, for example, randomly. The music playback toy 1 then performs first sound source volume suppression control, muting the volume of the vocal sound source data. In conjunction with the execution of the first sound source volume suppression control, the music playback toy 1 also performs second sound source volume control, increasing the volume of the non-vocal sound source data. For example, the music playback toy 1 increases the volume of the non-vocal sound source data to the base volume. The music playback toy 1 then performs dialogue audio output control processing, playing the selected dialogue audio data and outputting it at the base volume. Therefore, the volume of the vocal sound source data is muted (zero), the volume of the non-vocal sound source data is set to the base volume, and the volume of the selected dialogue audio data is set to the base volume, resulting in a combined output with a volume ratio. As a result, the audio the user hears will consist of the audio from the instrumental track data (only the song part of the solo track) with the dialogue audio data superimposed on top.
[0114] Once playback and output of the dialogue audio data is complete, the music playback toy 1 returns the volume of the vocal audio data to the default volume and the volume of the instrumental audio data to zero (mute). In other words, it returns to a state where only the vocal audio data is output (default playback state). At this time, the music playback toy 1 controls the volume of the vocal audio data to gradually increase from zero to the default volume and fade in. The music playback toy 1 also controls the volume of the instrumental audio data to gradually decrease from the default volume to zero and fade out.
[0115] Furthermore, if the vocal switch 15 is switched to vocal off during the audio output of the solo song, the music playback toy 1 executes a first sound source volume suppression control process, which suppresses the volume of the vocal sound source data by muting it. In addition, the music playback toy 1 performs a second sound source volume control, which increases the volume of the non-vocal sound source data to, for example, the base volume, in conjunction with the execution of the first sound source volume suppression control. As a result, the music playback toy 1 mutes (sets to zero) the volume of the vocal sound source data and outputs a combined volume ratio with the volume of the non-vocal sound source data set to the base volume. Consequently, the vocal part becomes inaudible, and a karaoke mode is created where only the non-vocal sound source data (only the song part of the solo song) is played. Here, the music playback toy 1 controls the volume of the vocal sound source data by gradually decreasing it from the base volume to zero and fading it out. The music playback toy 1 also controls the volume of the non-vocal sound source data by gradually increasing it from zero to the base volume and fading it in.
[0116] Furthermore, if the vocal switch 15 is subsequently switched to vocal on, the music playback toy 1 returns the volume of the vocal audio data to the basic volume and the volume of the instrumental audio data to zero. At this time, the music playback toy 1 controls the volume of the vocal audio data to gradually increase from zero to the basic volume and fade in. The music playback toy 1 also controls the volume of the instrumental audio data to gradually decrease from the basic volume to zero and fade out. As a result, the device returns to a state where only the vocal audio data is output (basic playback state), and the vocal part becomes audible again.
[0117] Thus, in this modified version, when in basic playback mode, only the audio data with vocals is output at the basic volume, and when dialogue audio data is being played or output, or in karaoke mode, only the audio data without vocals is output at the basic volume. Therefore, the volume will not change significantly before and after the start of dialogue audio or operation of the vocal switch 15 during the audio output of a song.
[0118] Figures 15 to 17 are flowcharts illustrating the processing flow performed by the music playback toy 1 in this modified example. Figure 15 is a flowchart illustrating the processing flow performed by the music playback toy 1 when the power button is pressed and the power is turned on in this modified example. Figure 16 is a flowchart illustrating the communication playback control processing performed in step S19 of Figure 15 and the playback output start control processing performed in step S33. Figure 17 is a flowchart illustrating the playback processing flow performed in step S13 of Figure 15, and in steps S195 and S335 of Figure 16. In each of Figures 15 to 17, the same processing steps as those described with reference to Figures 8 to 10 in the above embodiment are indicated by the same reference numerals.
[0119] As shown in Figure 15, in this modified example, the music playback toy 1 selects a solo song to be played in step S9, then performs an audio output control process that synthesizes and outputs audio based on the vocal audio data and the non-vocal audio data of the solo song, and starts playing and outputting the solo song (step S91). In the audio output control process of this modified example, the music playback toy 1 refers to the music data 200 related to the solo song, and performs the synthesized output with a volume ratio in which the volume of the vocal audio data is set to the base volume and the volume of the non-vocal audio data is muted (zero). After starting playback and output, it proceeds to step S13 to perform playback processing.
[0120] In this modified example, the music playback toy (requesting toy) 1, in the communication playback control process (step S19) shown in Figure 16, if the communication related to the ID reception process performed in step S192 is successful (step S193: YES), starts the audio output control process immediately after success, thereby starting playback of the duet song to be played (step S196). In this audio output control process, the music playback toy (requesting toy) 1 refers to the music data 200 related to the duet song and synthesizes and outputs audio based on the vocal audio source data and audio based on the non-vocal audio source data. At that time, the music playback toy (requesting toy) 1 performs the synthesizer output with a volume ratio in which the volume related to the vocal audio data is set to the base volume and the volume related to the non-vocal audio source data is muted (zero). Once playback has started, the communication playback control process is completed and the playback processing in step S195 is performed.
[0121] In this modified example, the music playback toy (receiving toy) 1, in the playback output start control process (step S33) shown in Figure 16, starts playback of the duet song to be played by starting the audio output control process immediately after the success of the communication related to the ID transmission process performed in step S332 (step S333: YES). In this audio output control process, the music playback toy (receiving toy) 1 refers to the music data 200 related to the duet song and synthesizes and outputs audio based on the vocal sound source data and audio based on the non-vocal sound source data. At that time, the music playback toy (receiving toy) 1 performs the synthesizer output with a volume ratio in which the volume related to the vocal sound data is set to the base volume and the volume related to the non-vocal sound source data is muted (zero). Once playback has started, the playback output start control process is completed and the playback processing in step S335 is performed.
[0122] Furthermore, in this modified example, in the dialogue voice output control process executed during playback processing as shown in Figure 17, the music playback toy 1 selects the dialogue voice to be played back in step S107, and then determines whether the vocal switch 15 is on or off. If the vocal is not on (off) (step S131: NO), the music playback toy 1 plays the dialogue voice data of the dialogue voice selected in step S107 and outputs the voice (step S133).
[0123] On the other hand, if the vocal switch 15 is set to vocal ON (step S131: YES), the music playback toy 1 performs first sound source volume suppression control to mute the volume of the vocal sound source data of the song currently being output (step S135). Also, as a second sound source volume control unit, the music playback toy 1 performs second sound source volume control to raise the volume of the non-vocal sound source data to, for example, the basic volume, in conjunction with the execution of the first sound source volume suppression control in step S135 (step S137). Then, the music playback toy 1 plays the dialogue audio data of the dialogue audio selected in step S107 and outputs the audio (step S139). Once the playback and output of the dialogue audio data is finished, the music playback toy 1 returns the volume of the vocal sound source data that was mute in step S135 back to the basic volume, and returns the volume of the non-vocal sound source data that was raised in step S137 back to zero (mute) (step S141). In this process, the music playback toy 1 controls the volume of the audio data with vocals to fade in and the volume of the audio data without vocals to fade out.
[0124] Furthermore, if the vocal switch 15 is switched from vocal on to vocal off (step S115: YES), the first sound source volume suppression control unit 143 executes the first sound source volume suppression control process and performs the first sound source volume suppression control to mute the volume of the vocal sound source data of the song currently being output (step S143). In addition, the music playback toy 1, acting as a second sound source volume control unit, performs the second sound source volume control to raise the volume of the instrumental sound source data to, for example, the basic volume, in conjunction with the execution of the first sound source volume suppression control in step S143 (step S145).
[0125] Furthermore, if the vocal switch 15 is switched from vocal off to vocal on (step S119: YES), the music playback toy 1 returns the volume of the vocal audio data that was muted in step S143 back to the basic volume, and returns the volume of the non-vocal audio data that was increased in step S145 back to zero (muted) (step S147). At that time, the music playback toy 1 controls the volume of the vocal audio data to fade in and the volume of the non-vocal audio data to fade out. In the above embodiment, an example was described in which the volume of the audio data is gradually changed and the volume is faded in and faded out, but it is not limited to this, and it may also be specified to switch the volume of the audio data immediately. Gradually changing the volume of the audio data is preferable because it allows for a more natural voice switch.
[0126] In the modified examples described above, the volume of the instrumental audio data is set to zero and muted during the audio output control process. However, it is not always necessary to set it to zero. The volume can be set to a level lower than the volume of the instrumental audio data (basic volume) (for example, by half or to about 10%).
[0127] According to the above embodiments and modifications, when playing and outputting music, it is possible to synthesize and output audio based on a first sound source data and audio based on a second sound source data related to the music at a given volume ratio. Furthermore, the volume of the first sound source data being synthesized and output can be muted or reduced according to a predetermined operation. Therefore, for example, by performing a predetermined operation during synthesized output, it is possible to make the listener primarily listen to the second sound source data, or return to a state where both synthesized voices can be heard, thereby realizing a technology that allows for diverse enjoyment of the output music's audio. This makes it possible to realize a music playback toy that adds a new level of interest to the audio output of music.
[0128] [Summary] The disclosures of this specification by the embodiments described above can be summarized as follows, for example.
[0129] An aspect of the present disclosure is a music playback toy comprising: a music data storage unit that stores first sound source data and second sound source data relating to a predetermined music; an audio output control unit that synthesizes and outputs audio based on the first sound source data and audio based on the second sound source data at a given volume ratio; and a first sound source volume suppression control unit that performs first sound source volume suppression control to mute or reduce the volume relating to the first sound source data synthesized and output by the audio output control unit in accordance with a predetermined operation.
[0130] According to this embodiment, when playing and outputting music, it is possible to synthesize and output audio based on a first sound source data and audio based on a second sound source data related to the music at a given volume ratio. Furthermore, the volume of the first sound source data being synthesized and output can be muted or reduced according to a predetermined operation. Therefore, for example, by performing a predetermined operation during the synthesized output, it is possible to make the listener primarily listen to the second sound source data, or return to a state where both synthesized voices can be heard, thereby realizing a technology that allows for diverse enjoyment of the output music's audio. This makes it possible to realize a music playback toy that adds a new level of interest to the audio output of music.
[0131] Furthermore, the aforementioned song is a song that includes a predetermined vocal part and a predetermined musical part, the first sound source data is data that includes at least the sound source of the predetermined vocal part, and the second sound source data may be data that does not include the sound source of the predetermined vocal part but includes the sound source of the predetermined musical part.
[0132] When playing back and outputting a song that includes both vocal and instrumental parts, it is possible to simultaneously play back and output a first audio source data that includes at least the vocal part's audio source, and a second audio source data that does not include the vocal part's audio source but includes the instrumental part's audio source. Therefore, for example, by performing a predetermined operation during the combined output, it is possible to switch to a state where the listener can primarily focus on listening to the instrumental part, or to return to a state where both the vocal and instrumental parts' combined audio can be heard, thereby realizing a technology that allows for diverse enjoyment of the outputted song's audio.
[0133] The system may further include a dialogue audio data storage unit that stores dialogue audio data relating to a predetermined line of dialogue, and a dialogue audio output control unit that performs the first sound source volume suppression control in response to a predetermined dialogue audio output operation, and also plays back the dialogue audio data and outputs the audio.
[0134] When a dialogue audio output operation is performed, the volume of the first sound source data for the currently playing / outputting music can be muted or reduced, and then the dialogue audio data can be played and output.
[0135] Furthermore, the audio output control unit may, in a predetermined basic playback state, synthesize and output the volume of the first sound source data and the volume of the second sound source data at approximately equal volume ratios, and the first sound source volume suppression control unit may, in response to the predetermined operation, perform first sound source volume suppression control while maintaining the volume of the second sound source data.
[0136] In a predetermined basic playback state, the volume of the first sound source data and the volume of the second sound source data can be combined and output at approximately equal volume ratios. Furthermore, the volume of the first sound source data that is output in the combined state can be muted or reduced according to a predetermined operation.
[0137] Furthermore, the system may also include a second sound source volume control unit that performs a second sound source volume control to increase the volume of the second sound source data in conjunction with the first sound source volume suppression control unit performing the first sound source volume suppression control in response to the predetermined operation.
[0138] When the volume of the first sound source data is muted or reduced, the volume of the second sound source data can be increased.
[0139] Furthermore, the audio output control unit may, in a predetermined basic playback state, mute the volume of the second sound source data, or synthesize and output a volume ratio that is lower than the volume of the first sound source data.
[0140] In a predetermined basic playback state, the volume of the second sound source data can be muted, or the volume of the second sound source data can be made lower than the volume of the first sound source data in the said basic playback state.
[0141] Furthermore, the music data storage unit stores the first sound source data and the second sound source data relating to an ID-associated music track, which is linked to a predetermined other device ID, as the music track, and may further include a short-range wireless communication unit for short-range wireless communication with other devices, and a communication playback function unit that, when the other device ID is received from the other device via short-range wireless communication, activates the audio output control unit with respect to the ID-associated music track.
[0142] Prior to playing or outputting a song with an associated ID from another device, short-range wireless communication can be performed with that device. Once the other device's ID is received from that device, playback or output of the song with that ID can begin. By using this device in conjunction with other devices, a music playback toy with a wider range of entertainment possibilities can be realized.
[0143] Furthermore, the other device may perform an ID transmission process that includes transmitting the other device ID via short-range wireless communication, and immediately after the successful communication related to the ID transmission process, it may start playback output of sound source data related to the ID-attached song. The communication playback function unit may perform an ID reception process that includes receiving the other device ID from the other device, and immediately after the successful communication related to the ID reception process, it may cause the audio output control unit to start the synthesized output for the ID-attached song.
[0144] Prior to playback and output of an ID-associated song, short-range wireless communication is conducted with another device using the other device's ID, and the other device receives the other device's ID. The other device then transmits its own ID via short-range wireless communication. Immediately after the successful reception and transmission of the other device's ID, both devices can begin playback and outputting the ID-associated song. Therefore, for ID-associated songs linked to another device's ID, synchronized audio output with the other device becomes possible. [Explanation of Symbols]
[0145] 1(1-1,2,3),1A,1B…Music playback toy 110... Operation input section 120...Sound output section 130…Near field communication department 140... Control Unit 141...Audio Output Control Unit 143...First sound source volume suppression control unit 145...Dialogue Voice Output Control Unit 147...Communication and playback function unit 149...Playback Output Start Control Unit 150...Storage section 151... Music playback program 200...Song data 201... Track number 202…Song Type 203...Main part type 204... Subpart type 205…ID 207 (207-1,2)...Audio data with vocals 209...Audio data without vocals 300... Dialogue data 301... Dialogue number 303... Dialogue audio data 11…A button 13... B button 15…Vocal Switch 17…Speakers 19…Infrared communication module
Claims
A music data storage unit that stores first sound source data and second sound source data related to a music piece including a predetermined song part and a predetermined music part; An audio output control unit that outputs the audio based on the first sound source data and the audio based on the second sound source data at a given volume ratio; A first sound source volume suppression control unit that performs first sound source volume suppression control to mute or reduce the volume of the first sound source data output by the audio output control unit in response to a predetermined operation; Comprising; The first sound source data is data including the sound sources of the predetermined song part and the predetermined music part; The second sound source data is data that does not include the sound source of the predetermined song part and includes the sound source of the predetermined music part, a music playback toy.
2. A dialogue voice data storage unit that stores dialogue voice data related to a predetermined dialogue voice; A dialogue voice output control unit that performs the first sound source volume suppression control and plays and outputs the dialogue voice data in response to a predetermined dialogue voice output operation; The music playback toy according to claim 1, further comprising.
3. In a predetermined basic playback state, the audio output control unit outputs the volume of the first sound source data and the volume of the second sound source data at a volume ratio of substantially the same amount; The first sound source volume suppression control unit performs the first sound source volume suppression control while maintaining the volume of the second sound source data in response to the predetermined operation. The music playback toy according to claim 1 or 2.
4. A second sound source volume control unit that performs second sound source volume control to increase the volume of the second sound source data in accordance with the first sound source volume suppression control being executed by the first sound source volume suppression control unit in response to the predetermined operation; The music playback toy according to claim 1 or 2, further comprising.
5. In a predetermined basic playback state, the audio output control unit performs a combined output at a volume ratio such that the volume of the second sound source data is muted or smaller than the volume of the first sound source data. The music playback toy according to claim 4.
6. The music data storage unit stores the first sound source data and the second sound source data related to the music piece with an ID associated with a predetermined other device ID as the music piece; A short-range wireless communication unit for performing short-range wireless communication with another device; A communication playback function unit that causes the audio output control unit to function with respect to the music piece with the ID when the other device ID is received from the other device by the short-range wireless communication; The music playback toy according to claim 1 or 2, further comprising
7. The other device executes an ID transmission process including transmitting the other device ID by short-range wireless communication, and has a function of starting reproduction output of sound source data related to the music with the ID immediately after the success of communication related to the ID transmission process. The communication reproduction function unit executes an ID reception process including receiving the other device ID from the other device, and causes the voice output control unit to start the synthesis output with respect to the music with the ID immediately after the success of communication related to the ID reception process. The music playback toy according to claim 6.