Voice recording device and voice recording program

Abstract

To provide a voice recording device capable of generating recording data which can be easily synchronized with music reproduction.SOLUTION: This voice recording device comprises: a music reproduction unit that reproduces music and outputs a music sound; a signal sound generation unit that generates a signal sound having a rising position at a music reproduction start position; a first path through which the music sound and the signal sound are output; a second path through which a voice is input; and a recording unit that monitors the first path, starts generation of recording data at the rising position of the signal sound, and switches, after the generation start of the recording data, to the second path to perform recording data generation.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an audio recording device that records audio in synchronization with music being played back, and an audio recording program that enables an information processing device to realize the functions of the audio recording device. [Background technology]

[0002] Karaoke, in which people enjoy singing along to musical accompaniment, has traditionally been performed at social gatherings, etc. In addition to enjoying singing in real time, karaoke machines also allow users to enjoy recording their singing voices.

[0003] Patent Document 1 discloses a singing voice data generating device that generates singing voice data for karaoke singing to be combined with video data of karaoke singing captured by a video camera. This singing voice data generating device emits a synchronous sound from a speaker and records it in the audio data of the user's video data and the singing voice data with accompaniment. It also describes how the user's video data and the singing voice data with accompaniment are mixed using the synchronous sound recorded in both. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-1503 Summary of the Invention [Problem to be solved by the invention]

[0005] The singing voice data generating device described in Patent Document 1 employs a recording format in which accompaniment and singing voice data are recorded together. Alternatively, there is also a recording format in which singing is performed in synchronization with the playback of musical sounds, and only the singing voice input from a microphone is recorded. In this recording format, the recorded voice can be reproduced by playing it back in synchronization with the playback of the music used during recording.

[0006] However, when using such a recording format, it can be difficult to fully synchronize the playback of the music sound with the recorded voice, and even a slight misalignment can cause a sense of discomfort to the ear. In consideration of this situation, one object of the present invention is to provide a voice recording device that, in a recording format for recording singing voices, creates recording data that can be easily synchronized with the playback of the music. [Means for solving the problem]

[0007] Therefore, the voice recording device according to the present invention employs the following configuration. a music playback unit that plays music and outputs music sounds; a signal sound generating unit that generates a signal sound having a rising edge at the playback start position of the music piece; a first path through which music sounds and signal sounds are output; a second path through which audio is input; The recording unit monitors the first path, starts forming recorded data at the rising edge of the signal sound, and after starting to form the recorded data, switches to the second path and forms the recorded data.

[0008] Furthermore, the voice recording device according to the present invention comprises: a music playback unit that plays music and outputs music sounds; a signal sound generating unit that generates a signal sound having a falling edge at a playback start position of the music piece; a first path through which the music piece sound and the signal sound are output; a second path through which audio is input; The device is equipped with a recording unit that monitors the first path, starts forming recorded data at the falling edge of the signal sound, and after starting to form the recorded data, switches to the second path and forms the recorded data.

[0009] Furthermore, in the voice recording device according to the present invention, It has a first muting unit that mutes the beginning of the recorded data.

[0010] Furthermore, in the voice recording device according to the present invention, The first muting unit mutes the recorded data up to a position corresponding to the falling edge of the signal sound.

[0011] Furthermore, in the voice recording device according to the present invention, The first muting unit mutes the sound from the trailing edge of the signal sound to a position where a predetermined time has elapsed.

[0012] Furthermore, in the voice recording device according to the present invention, The first muting unit mutes the sound input from the first path before it is formed as recording data.

[0013] Furthermore, in the voice recording device according to the present invention, The recording unit switches to the second path based on the falling edge of the signal tone.

[0014] Furthermore, in the voice recording device according to the present invention, The recording unit switches to the second path after a predetermined time has elapsed since the start of recording data formation.

[0015] Furthermore, the voice recording device according to the present invention comprises: When playing music in the music playback section, The recording device includes a recording data playback unit that plays back the recorded data.

[0016] Furthermore, the voice recording device according to the present invention comprises: a sound effect imparting unit provided in the first path and configured to impart a sound effect; In the first path, the sound effect imparting section is located before the signal sound generating section.

[0017] Furthermore, the voice recording device according to the present invention comprises: a sound effect imparting unit provided in the first path and configured to impart a sound effect; In the first path, the sound effect imparting unit is located after the signal sound generating unit, While the signal sound generating unit is outputting a signal sound, the application of the sound effect by the sound effect applying unit is turned off or the signal sound is not output via the sound effect applying unit.

[0018] Furthermore, in the voice recording device according to the present invention, The device includes a second muting section that mutes the signal sound output from the speaker 42 when the signal sound generating section generates the signal sound.

[0019] The voice recording program according to the present invention also includes: A voice recording program executed by an information processing device, a music playback process for playing back music and outputting music sounds to a first path; a signal sound generating unit that generates a signal sound having a rising edge at the playback start position of the music piece and outputs the signal sound to a first path; an input process for inputting voice into the second path; The first path is monitored, and recording of the recorded data is started at the rising edge of the signal sound. After the recording of the recorded data has started, the recording is switched to the second path and the recorded data is recorded.

[0020] The voice recording program according to the present invention also includes: A voice recording program executed by an information processing device, a music playback process for playing back music and outputting music sounds to a first path; a signal sound generating unit that generates a signal sound having a falling edge at the playback start position of the music piece and outputs the signal sound to a first path; an input process for inputting voice into the second path; The first path is monitored, and recording of the sound data is started at the falling edge of the signal sound. After the recording of the sound data has started, the recording is switched to the second path and the sound data is recorded. [Effects of the Invention]

[0021] According to the voice recording device and the voice recording program of the present invention, it is possible to provide a voice recording device that generates recorded data that can be easily synchronized with the playback of music. [Brief explanation of the drawings]

[0022] [Figure 1]FIG. 1 shows the configuration of a karaoke system according to an embodiment of the present invention. [Figure 2] Time chart explaining the recording and playback behavior in audio separation recording format [Figure 3] A time chart illustrating the recording state of this embodiment. [Figure 4] A block diagram showing the configuration of an acoustic control unit according to the present embodiment. [Figure 5] A block diagram showing the configuration of the acoustic control unit of this embodiment (first recording state). [Figure 6] A block diagram showing the configuration of the acoustic control unit of this embodiment (second recording state). [Figure 7] 1 is a diagram showing various data configurations according to the present embodiment; [Figure 8] Flow diagram showing the overall processing of this embodiment [Figure 9] FIG. 10 is a diagram showing a music confirmation screen according to the present embodiment; [Figure 10] FIG. 10 is a diagram showing a recording information selection screen according to the present embodiment. [Figure 11] Flow diagram showing the performance processing of this embodiment [Figure 12] 1 is a flowchart showing a signal adding process according to the present embodiment; [Figure 13] 1 is a flowchart showing the recording process of the present embodiment. [Figure 14] Time chart for explaining the recording state of another embodiment [Figure 15] FIG. 10 is a block diagram showing the configuration of an acoustic control unit according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0023] Fig. 1 is a diagram showing the configuration of a karaoke system according to this embodiment. The karaoke system according to this embodiment includes a karaoke device 2 (sometimes called a commander) and a remote control device 1. The karaoke device 2 according to this embodiment corresponds to the audio recording device according to the present invention. The recording and playback device may not only be the karaoke device 2, but also various information processing devices. The karaoke device 2 and the remote control device 1 are connected to each other via a LAN 100 and an access point 130 to form a network.

[0024] The karaoke machine 2 installed in a store such as a karaoke booth includes an audio control unit 25 that performs various audio-related processes, such as playing music and recording singing voices. The karaoke machine 2 also includes an operation unit 21 that accepts various inputs from the user. The karaoke machine 2 also includes an operation processing unit 22 that interprets inputs from the operation unit 21 and transmits them to the CPU 30. The karaoke machine 2 also includes a hard disk 32 that serves as a storage unit for storing various information. The karaoke machine 2 also includes a LAN communication unit 24a that serves as communication means for connecting to the LAN 100 and joining the network. The karaoke machine 2 of this embodiment also includes a wireless LAN communication unit 24b, and can therefore establish a wireless network connection using the wireless LAN communication unit 24b instead of a wired network connection using the LAN communication unit 24a.

[0025] The karaoke device 2 also includes a video playback unit that displays a lyric video and a background video on the monitor 41. This video playback unit includes a video formation unit 29 that plays video based on video data, a video RAM 28 that temporarily stores the video to be played, and a video control unit 31 that superimposes the lyric video on the played video and applies video effects. In this embodiment, the background video is a moving image, but the other images are moving images or still images.

[0026] Furthermore, in this karaoke device 2, various information can be displayed on the touch panel monitor 33 in addition to the externally connected monitor 41. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays the image input from the image control unit 31 and a touch panel 34 that outputs the touch input position to the operation processing unit 22. This touch panel monitor 33 is disposed on the front of the housing of the karaoke device 2, and functions as an input unit similar to the operation unit 21 of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. By selecting a song on the touch panel monitor 33, the user can perform various operations on the karaoke device 2, such as directly reserving a song on the karaoke device 2.

[0027] Furthermore, the karaoke device 2 is configured with a control unit including a CPU 30 for controlling each component in an integrated manner, and a memory 27 for temporarily storing information required for executing various programs.

[0028] With this configuration, the karaoke device 2 executes various processes, but its main functions include song reservation processing and song playback processing. The song reservation processing is a processing for specifying and reserving a song based on a user's specification, and is executed in cooperation with the remote control device 1. Reservation information formed by the song selection processing of the remote control device 1 is sent to the karaoke device 2. The karaoke device 2 registers the received reservation information in a reservation table in the memory 27. The song playback processing is a processing for playing back a reserved song, and is a processing in which a performance processing, a lyric display processing, and a video playback processing are executed synchronously.

[0029] The performance process is a process in which the audio control unit 25 performs a performance based on the performance data included in the music data. The music performed by the audio control unit 25 is output from the speaker 42 together with the singing voice input from the microphone 43. The lyrics display process is a process in which a lyrics video based on the lyrics data included in the music data is displayed on the monitor 41 to provide singing assistance. A background video display process may be executed to superimpose a background video on the lyrics video displayed in the lyrics display process.

[0030] Meanwhile, the remote control device 1 is capable of executing a song selection process, which searches for songs based on instructions from the user and transmits reservation information for the song instructed to be played to the karaoke device 2. The remote control device 1 is also capable of receiving various information from the karaoke device 2 or a server device 5 connected to the Internet and executing various processes. In this embodiment, the remote control device 1 is provided with an operation unit 17 and a touch panel monitor 11 as a user interface for receiving various instructions from the user. The touch panel monitor 11 is configured with a display unit 11a and a touch panel 11b, and displays various information on the display unit 11a and is capable of receiving touch inputs from the user.

[0031] Furthermore, the remote control device 1 has a memory 14 as a storage unit for storing databases required for the music selection process, various programs, and various information generated as the programs are executed. It also has a remote control control unit for controlling the overall operation of the various components. The remote control control unit includes a CPU 15, an image control unit 13 that forms images to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores image data for the images to be displayed, and an operation processing unit 18 that interprets inputs from the touch panel monitor 11 or the operation unit 17 and transmits the inputs to the CPU 15.

[0032] The remote control device 1 is connected to the network formed by the LAN 100 by wirelessly connecting to the access point 130 via the wireless LAN communication unit 16. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

[0033] With this configuration of the remote control device 1, various inputs from the user can be received from the touch panel monitor 11 or the operation unit 17, and various information can be provided by displaying it on the touch panel monitor 11, making it possible to perform various processes such as song selection processing, which transmits reservation information to be output to the karaoke device 2.

[0034] Figure 2 is a time chart that explains the recording and playback behavior in an audio-separated recording format in which singing is performed in synchronization with the playback of music and only the singing voice input from the microphone is recorded. In the audio-separated recording format, as shown in Figures 2(a) and 2(b), the timing at which music playback and audio recording begin is the same, t1. Then, as shown in Figure 2(c), by setting the timing at which music playback and the timing at which recorded audio playback begin to the same, T1, it is possible to synchronize the music and the recorded audio.

[0035] However, when recording audio, even a slight deviation in the audio recording timing from the start of music playback can cause an audible discomfort during playback. Until now, it has sometimes been difficult to accurately synchronize the start of music playback and the start of audio recording due to hardware or software considerations. Therefore, the purpose of this embodiment is to create recording data that is sufficiently synchronized with music data in this type of audio separation recording format.

[0036] FIG. 3 is a time chart illustrating the state of recording in this embodiment. One feature of this embodiment is the use of a signal sound that rises in synchronization with the start of music playback. Note that synchronization does not exclude slight delays (for example, a few milliseconds to several tens of milliseconds), but rather means that there is no obvious audible delay between the start of music playback and the start of recorded data. In FIG. 3, the shaded area corresponds to the output period of the signal sound. As shown in FIG. 3(a), the signal sound rises in synchronization with the start of music playback. In this embodiment, a sine wave with a predetermined frequency is used as the signal sound. The signal sound is not limited to a sine wave, and various signal sounds can be used.

[0037] As shown in Figure 3(b1), the recording unit that performs recording starts monitoring the data to be recorded at timing t0 before the start of music playback. The music sound and the signal sound are output from the same path (first path), and the sound output from the microphone 43 is output from the second path. Here, the first path and second path refer to the following paths: The first path starts at the performance unit 25a, passes through the sound effect imparting unit 25b, the signal sound generating unit 25c, the gate 251d, and the adder 252b, and ends at the recording unit 25d.

[0038] The second path is a path that starts at the position where the microphone signal is input in the acoustic control unit 25, passes through the gate 251b and the adder 252b, and ends at the recording unit 25d. In this embodiment, during the period from timing t0 to timing t2, the recording unit monitors the data input from the first path.

[0039] In this embodiment, the recording unit discards input data (the portion marked "Del") during the first path and does not form recorded data until it detects the rising edge of the signal sound. Then, by detecting the rising edge of the signal sound (timing t1), it starts forming recorded data. Therefore, it is possible to make the beginning position of the recorded data coincide (or approximately coincide) with the playback start position of the music. After that, in this embodiment, by detecting the falling edge of the signal sound (timing t2), it switches from the first path to the second path, and the sound output from microphone 43 is used to form recorded data.

[0040] In this embodiment, while the first path is selected, i.e., while the signal sound is being output, the data input to the recording unit is muted to form the recorded data. The silent period is muted from timing t2, which is the falling edge of the signal sound, until timing t3, which is a certain time (for example, several tens of milliseconds). By providing a margin in this silent period, no signal sound remains in the recorded data. Note that t1 to t3 is a very short period, for example, several tens of milliseconds, and in many songs, this is the silent period from when the song starts to be played until the performance sound is produced.

[0041] In this embodiment, the deletion and muting of audio is performed in a process before the recorded data is stored on the hard disk 32, but instead of this, it may be performed after the data has been stored on the hard disk 32.

[0042] The principle of this embodiment has been explained above. According to this embodiment, by monitoring the signal sound output on the same path (first path) as the music and starting to form recording data at the rising edge of the signal sound, it is possible to form recording data having a playback start position synchronized with the playback start position of the music.

[0043] Next, the specific configuration and processing of this embodiment will be described. 4 is a block diagram showing the configuration of the sound control unit 25 of this embodiment. The sound control unit of this embodiment has the functions of a performance unit 25a, a sound effect imparting unit 25b, a signal sound generating unit 25c, and a recording unit 25d. It also has gates 251a to 251d that mute sound signals, and addition units 252a and 252b that add input sound signals. Note that although the various components within the sound control unit 25 are described as "units," they may be realized as either hardware or software.

[0044] The sound input from microphone 43 has a path that passes through gate 251a and adder 252a and is output to speaker 42, and a path that passes through gate 251b and adder 252b and is output to recording unit 25d. On the other hand, the performance sound or signal sound output from performance unit 25a or signal sound generation unit 25c has a path that passes through gate 251c and adder 252a and is output to speaker 42, and a path that passes through gate 251d and adder 252b and is output to recording unit 25d.

[0045] In this embodiment, a sound effect imparting unit 25b is provided that imparts various sound effects, such as echo, to the performance sound output from the performance unit 25a. If sound effects are imparted to a signal sound, it may be impossible to properly detect the signal sound. For this reason, in this embodiment, the sound effect imparting unit 25b is provided after the signal sound generating unit 25c. With this configuration, sound effects are not imparted to the signal sound output from the signal sound generating unit 25c, making it possible to properly detect the signal sound.

[0046] In this embodiment, in the configuration of Fig. 4, two recording states can be achieved by changing the states of gates 251a to 251d. Fig. 5 is a block diagram showing the configuration (first recording state) of sound control unit 25 of this embodiment. The first recording state is a state in which sound input from microphone 43 is recorded by recording unit 25d. In the first recording state, gate 251d is muted, so that sounds output from performance unit 25a, sound effect imparting unit 25b, and signal sound generating unit 25c are not recorded.

[0047] In addition, the first recording state is a state in which the gate 251b is set to an unmute state (muted state) so that the sound input from the microphone 43 is recorded. In the first recording state, the gate 251a is set to an unmute state so that the sound input from the microphone 43 is output from the speaker 42. In the first recording state, the gate 251c is set to an unmute state so that the sounds output from the performance unit 25a, sound effect unit 25b, and signal sound generation unit 25c are output from the speaker 42. In the time chart described in FIG. 3, this first recording state is in effect from timing t3 onwards.

[0048] 6 is a block diagram showing the configuration (second recording state) of the sound control unit 25 of this embodiment. The second recording state is a state in which the signal sound output from the signal sound generation unit 25c is input to the recording unit 25d. The second recording state is a state in which the gate 251b is muted so that the sound input from the microphone 43 is not recorded. The second recording state is also a state in which the gate 251d is unmuted so that the sounds output from the performance unit 25a, sound effect imparting unit 25b, and signal sound generation unit 25c are recorded.

[0049] In the second recording state, gate 251a is set to the unmute state, so that the sound input from microphone 43 is output from speaker 42. In the second recording state, gate 251c is set to the mute state, so that the sounds output from performance unit 25a, sound effect imparting unit 25b, and signal sound generating unit 25c are not output from speaker 42. In the time chart described in FIG. 3, this second recording state is in place during the period from timing t0 to t3.

[0050] Next, various processes executed by the karaoke device 2 of this embodiment will be described. Fig. 7 shows various data configurations in this embodiment. Fig. 7(a1) shows the data configuration of reservation information registered in the reservation table for reserving a song. The reservation information includes a song ID for identifying the song, a user ID indicating the user who made the reservation, and setting information indicating various settings for playback, such as pitch settings and recording settings.

[0051] 7(a2) shows the data structure of reservation information registered in the reservation table for reserving recording information. The reservation information includes a recording ID for identifying the recording information. 7(b) shows the data structure of the music information, which includes meta information such as a music ID, music title, and artist name, as well as actual information such as performance data, lyrics data, and background image data. 7(c) shows the data structure of the recording information. The song information includes meta information such as a song ID, a recording ID, a user ID, and the recording date and time, as well as actual information such as the recording data.

[0052] FIG. 8 is a flow diagram showing the overall processing of this embodiment. The karaoke device 2 checks the reservation information registered in the reservation table (S101) to confirm whether there is a song to be played next. FIG. 9 is a diagram showing a song confirmation screen of this embodiment. The karaoke system of this embodiment allows users to log in by entering authentication information (user ID and password) from the touch panel monitor 11 of each remote control device 1. In particular, the karaoke system of this embodiment allows multiple users to log in, and information about logged-in users (logged-in users) is always displayed at the top of the screen. A logged-in user field 103 is provided for displaying an avatar of the logged-in user. The avatar can be in various forms, such as an image of a person or character, as well as a figure or symbol.

[0053] Also displayed are a guest icon 102 for users who do not have an account, and a user changeover switch 101 for switching users. A logged-in user can receive various services that use their own user information by selecting an avatar image displayed in the logged-in user field 103 or by operating the user changeover switch 101.

[0054] 9 shows the screen when user A is using the service, with a comment for A displayed in the upper right corner and a service being provided using A's user information. A user without an account can receive general services such as song selection by operating the guest icon 102. When switching users, authentication using a password or the like may be performed, but switching may also be performed simply without authentication.

[0055] The song confirmation screen is displayed when a song search is performed using the remote control device 1 and a song is selected by the user. On the song confirmation screen, a song-related information display field 104 displays various information about the song selected by the user, such as the singer's name (artist name), song title, opening verse, etc. After checking the content of the displayed song, the user can reserve the song on the karaoke device 2 by operating the reservation button displayed in the lower right corner of the song confirmation screen. Specifically, reservation information including song identification information of the selected song is transmitted from the remote control device 1 to the karaoke device 2. Upon receiving the reservation information, the karaoke device 2 adds the received reservation information to a reservation table and performs song playback management.

[0056] In this embodiment, when reserving a song, it is possible to set the pitch and the recording settings. The pitch setting field 105a displays the set pitch ("-1" in the example of FIG. 9). To change the pitch, the user can operate the pitch change button 105b, which allows the user to change the pitch using a user interface for changes. The recording setting field 106a displays settings related to recording (set to record in the example of FIG. 9). To change the pitch, the user can operate the recording change button 106b, which allows the user to change the recording settings using a user interface for changes.

[0057] Fig. 10 is a diagram showing the recording information selection screen of this embodiment. In this embodiment, a user logs in to use the karaoke device 2, and so the user ID is associated with the recording information as described in Fig. 7(c). A logged-in user can display the recording data selection screen to schedule playback of previously recorded recording data. In the recording data selection screen, the recording data selection field 109 displays the song title, artist name, and recording date and time obtained by referencing the song ID included in the recording information.

[0058] The recording data selection field 109 can be scrolled by operating scroll bars 109a and 109b. The user can reserve recording information by selecting any song in the recording data selection field 109. When recording information is reserved, the recording reservation information shown in Fig. 7(a2) is registered in the reservation table.

[0059] As described above, in this embodiment, there are three playback methods: (1) playback without recording, (2) playback after recording, and (3) playback of recorded music. In the overall process, the type is confirmed based on the reservation information or the recording reservation information. The following describes three types of music playback.

[0060] (1) Playback without recording If the setting information of the reservation information indicates that there is no recording setting (S103: No) and the recorded data is not to be played (S109: No), an instruction to start playing the song corresponding to the song ID in the reservation information is output (S113).

[0061] 11 is a flow diagram showing the performance processing of this embodiment. In the performance processing, when a performance start instruction is received (S111: Yes), performance sounds are generated (S112) and output (S113) based on the performance information included in the music information. The performance processing ends when the performance of the music ends (S114: Yes). In the overall processing, when the playback of the music ends (S114: Yes), the process returns to checking the reservation table (S101).

[0062] (2) When recording and playing back If the setting information in the reservation information indicates that recording is set (S103: Yes), first, a recording start instruction is output (S104). Then, after a predetermined time has elapsed (S105: Yes), a music playback start instruction is output (S106). As described in FIG. 3, in this embodiment, the recording start timing (timing t0) precedes the music playback start timing (timing t1).

[0063] 12 is a flow diagram showing the signal providing process of this embodiment. The signal providing process is a process for outputting a signal sound when playback of a song starts. The signal providing process monitors the output of performance sounds from the performance unit 25a, and executes the process from S121 onwards for each performance sound of a certain size. If a performance sound of a certain size is received (S121: Yes), the signal sound generating unit 25c outputs a signal sound (S123) until a certain time has elapsed since the start of performance (S122: No).

[0064] On the other hand, after a certain time has elapsed since the start of performance (S122: Yes), performance sounds are output from the performance unit 25a (S124). The processes of S121 to S124 are continuously executed until the performance ends (S125: Yes). In this way, in the signal providing process, a signal sound is output during the period from timing t1 when performance starts to timing t1 after a certain time has elapsed, as shown in FIG. 3, and a performance sound is output during the period from timing t2 until the end of performance.

[0065] 13 is a flow diagram showing the recording process of this embodiment. The recording process is started based on a recording start instruction (S104) output in the overall process. When a recording start instruction is received (S131: Yes), the acoustic control unit 25 changes its state to the second recording state shown in FIG. 5(a) (S132). Next, the acoustic control unit 25 sets the state to "before signal" (S133).

[0066] The recording unit 25d monitors data input thereto at regular intervals (S134). When the recording unit 25d receives data of a regular size (S134: Yes), it determines the current state (S135). Immediately after the start of the recording process, the state is set to "before signal" (S133), so it determines the current state as "before signal" (S135:before signal), and determines whether the received data of a regular size is a signal sound (S136).

[0067] If a signal sound is not detected (S136: No), the recording unit 25d discards the received data (S138). On the other hand, if a signal sound is detected (S136: Yes), the state is changed to "signaling" (S137), and the recording unit 25d discards the received data (S138). Therefore, as shown in Figure 3 (b2), the data received during the period from timing t0 to timing t1 is deleted without being recorded as data.

[0068] After that, when data of a certain size is received, the current state is determined to be "signal in progress" (S135: signal in progress). Then, it is determined whether the received data of a certain size is a signal sound (S139). If the received data is a signal sound (S139: Yes), the received data is muted (S141). Here, "silent" means that the data exists but will be output as a silent output when played back.

[0069] The received muted data is then stored as recording data on the hard disk 32 (S145). The received data is encoded before being converted into recording data. In this way, the start timing of the recording data coincides (or nearly coincides) with the rising edge of the signal sound.

[0070] If it is determined that the received data is not a signal sound (S139: No), the state is changed to "after signal" (S140). Then, the received data is muted (S141), and the muted received data is stored as recorded data on the hard disk 32 (S145). In this embodiment, during the period from the end of the signal sound (S135: after signal) until a certain time has elapsed (S142: No), the received data is muted (S144) and stored on the hard disk 145 (S145). This period is the short time from timing t2 to t3 shown in FIG. 3(b3), and by providing this period, the signal sound is prevented from remaining in the recorded data.

[0071] If a certain period of time has elapsed (S142: Yes), the state is changed to the first recording state (S143), and the received data is stored as recorded data on the hard disk 145 (S145). In the first recording state, as shown in FIG. 5(a), the audio input to the microphone 43 is input to the recording unit 25d via the gate 251b and the adder 252b. Therefore, from timing t3 onwards when a certain period of time has elapsed, the audio input from the microphone 43 is recorded as recorded data. The above processing continues until the playback of the music ends (S146: Yes).

[0072] (3) Playing back recorded music Returning to the overall processing in FIG. 8, (3) the case of playing back a recorded piece of music will be described. The sound recording data generated by the sound recording process is stored as sound recording information, including meta information, in the hard disk 32. The sound recording information may also be stored in the server device 5.

[0073] When playing back recording information, the user reserves the recording information using the recording information selection screen described in FIG. 10. In the overall process, if the reservation information is recording reservation information (S109: Yes), the recording information assigned with the recording ID included in the recording reservation information is read out (S110). Then, the recording data in the read out recording information and the music information corresponding to the music ID included in the recording information are simultaneously started to be played out (S111). As described above, the beginning of the recording data coincides (or nearly coincides) with the playback start position of the music, so the recording data and the performance sound produced by playing back the music are synchronized (or nearly synchronized).

[0074] As described above, in this embodiment, a signal sound is generated in synchronization with the start of playback of a song, and recording data formation begins at the rising edge of the signal sound, making it possible to form recording data whose starting position coincides (or nearly coincides) with the start position of playback of the song.

[0075] After recording starts, by switching from the second recording state in Fig. 6(b) to the first recording state in Fig. 6(a), it is possible to create recorded data based on the sound input from the microphone 43. During the period when a signal sound is being generated, the second recording state is set and the gate 251c is muted, so that the signal sound is not output from the speaker 42. This prevents the signal sound from being output from the speaker 42 and causing discomfort to the listener.

[0076] The present invention is not limited to the above-described embodiment, and various modifications can be adopted. Various modifications will be described below.

[0077] [First Modification] FIG. 14 is a time chart illustrating the state of recording in another embodiment (first modified example). In the above-described embodiment, the formation of recording data started at the rising edge of the signal sound. In addition to this, the formation of recording data may also start at the falling edge of the signal sound. As shown in FIG. 14(b1), data input to the recording unit 25d starts before the start of playback of the signal sound (timing t0). Note that data input to the recording unit 25d may also be during the output period of the signal sound, as long as it is before playback of the music starts.

[0078] The signal sound is generated and output during the period from timing t1 to t2. In the second recording state shown in FIG. 6(b), the recording unit 25d monitors the falling edge of the signal sound (timing t2). Data input to the recording unit 25d is discarded until timing t2 is detected. Then, when the falling edge of the signal sound (timing t2) is detected, the recording unit 25d starts forming recorded data based on the input data.

[0079] Therefore, the start position of the recorded data to be created will coincide (or approximately coincide) with the playback start position of the music. After that, by switching from the second recording state to the first recording state at an appropriate timing, such as after a predetermined time has passed, recorded data based on the sound input from microphone 43 will be created. Note that it is preferable to silence the sound for a certain period of time from timing t2 to t3. This makes it possible to prevent signal sounds from being mixed into the recorded data.

[0080] [Second Modification] FIG. 15 is a block diagram showing the configuration of a control unit of another embodiment (second modified example). In the above-described embodiment, as described in FIG. 4, the sound effect imparting unit 25b is located before the signal sound generating unit 25c, so that sound effects are not imparted to the signal sound. However, due to limitations in hardware and software, as shown in FIG. 15, the sound effect imparting unit 25b may be located after the signal sound generating unit 25c. In such a case, it is preferable to turn off the imparting of sound effects by the sound effect imparting unit 25b while the signal sound generating unit 25c is outputting the signal sound, or to output the signal sound via a path that does not pass through the sound effect imparting unit 25b. By providing a signal sound without imparting sound effects, it is possible to properly detect the signal sound.

[0081] [Third Modification] In the above-described embodiment, the second recording mode is switched to the first recording mode using the falling edge of the signal sound. Switching from the second recording mode to the first recording mode can be performed not only using the falling edge of the signal sound, but also at any convenient timing. For example, the switching can be performed after a predetermined time has elapsed since the start of playback of the music, i.e., since the start of output of the signal sound.

[0082] [Fourth Modification] In the above-described embodiment, the signal sound is prevented from being mixed into the recorded data by using a configuration for silencing the signal sound. However, the configuration (processing) for silencing the signal sound may be omitted. For example, the signal sound may be set to a frequency outside the audible range. In such a case, even if the signal sound is mixed into the recorded data, the auditory disturbance is suppressed.

[0083] [Fifth Modification] In the above-described embodiment, a configuration was adopted in which the period from timing t2 to t3 was muted. This configuration prevented signal sounds from being mixed into the recorded data. Depending on the specifications of the hardware or software, it may be possible to prevent signal sounds from being mixed into the recorded data even if the period from timing t2 to t3 is not muted. Furthermore, as explained in the third modified example, it is possible to make the signal sounds outside the audible frequency range. Therefore, a configuration may be adopted in which muting is not performed from the falling edge of the signal sound until a predetermined time has elapsed (timings t2 to t3).

[0084] [Sixth Modification] In the above-described embodiment and the second modified example, a configuration has been described in which the sound effect imparting unit 25b is provided in the sound control unit 25. The sound control unit 25 does not necessarily need to be provided with the sound effect imparting unit 25b, and may be omitted from the configurations of Figs. 4 and 15.

[0085] In the above embodiment, the karaoke machine 2 has been used as an example of an audio recording device, but the present invention is not limited to the karaoke machine 2 and can be applied to various information processing devices. Furthermore, an audio recording program that is executed by the karaoke machine 2 or various information processing devices and realizes the functions of the present invention also falls within the scope of the present invention. [Explanation of symbols]

[0086] 1: Remote control device 29: Image formation unit 2: Karaoke device 30: CPU 5: Server device 31: Video control unit 11: Touch panel monitor 32: Hard disk 11a: Display unit 33: Touch panel monitor 11b: Touch panel 34: Touch panel 12: Video RAM 35: Display 13: Video control unit 41: Monitor 14: Memory 42: Speaker 15:CPU 43:Microphone 16: Wireless LAN communication unit 101: User changeover switch 17: Operation panel 102: Guest icon 18: Operation processing section 103: Login user column 21: Operation section 104: Song-related information display section 22: Operation processing section 105a: Pitch setting section 24a: LAN communication section 105b: Pitch change button 24b: Wireless LAN communication section 106a: Recording setting section 25: Sound control section 106b: Recording change button 25a: Performance section 109: Recording data selection column 25b: Sound effect applying unit 109a, 109b: Scroll bar 25c: Signal sound generator 130: Access point 25d: Recording section 145: Hard disk 27: Memory 251a~251d 28: Video RAM 252a, 252b: Addition section

Claims

1. a music playback unit that plays music and outputs music sounds; a signal sound generating unit that generates a signal sound having a rising edge at the playback start position of the music piece; a first path through which music sounds and signal sounds are output; a second path through which audio is input; a recording unit that monitors the first path, starts recording data at the rising edge of the signal sound, and switches to the second path after starting to record the data. Audio recording device.

2. a music playback unit that plays music and outputs music sounds; A signal sound having a falling edge is generated at the playback start position of the music piece. a signal sound generating unit; a first path through which music sounds and signal sounds are output; a second path through which audio is input; a recording unit that monitors the first path, starts recording data at the falling edge of the signal sound, and switches to the second path after starting to record the data. Audio recording device.

3. A first muting unit mutes the beginning of the recorded data.

2. The audio recording device according to claim 1.

4. The first muting unit mutes the recorded data up to a position corresponding to the falling edge of the signal sound.

4. The audio recording device according to claim 3.

5. The first muting unit mutes the recorded data from the falling edge of the signal sound to a position where a predetermined time has elapsed.

5. The audio recording device according to claim 4.

6. The first muting unit mutes the sound input from the first path before it is formed into recording data.

4. The audio recording device according to claim 3.

7. The recording unit switches to the second path based on the falling edge of the signal tone.

2. The audio recording device according to claim 1.

8. The recording unit switches to the second path after a predetermined time has elapsed since the start of recording data formation.

2. The audio recording device according to claim 1.

9. When playing music in the music playback section, Equipped with a recording data playback unit that plays back recorded data 2. The audio recording device according to claim 1.

10. a sound effect imparting unit provided in the first path and configured to impart a sound effect; In the first path, the sound effect imparting unit is located before the signal sound generating unit.

2. The audio recording device according to claim 1.

11. a sound effect imparting unit provided in the first path and configured to impart a sound effect; In the first path, the sound effect imparting unit is located after the signal sound generating unit, While the signal sound generating unit is outputting a signal sound, the sound effect applying unit is turned off or the signal sound is not output via the sound effect applying unit.

2. The audio recording device according to claim 1.

12. The signal sound generating unit includes a second muting unit that mutes the signal sound output from the speaker when the signal sound generating unit generates the signal sound.

2. The audio recording device according to claim 1.

13. A voice recording program executed by an information processing device, a music playback process for playing back music and outputting music sounds to a first path; a signal sound generating unit that generates a signal sound having a rising edge at the playback start position of the music piece and outputs the signal sound to a first path; an input process for inputting voice into the second route; a recording process of monitoring the first path, starting to form sound recording data at the rising edge of the signal sound, and switching to the second path after starting to form sound recording data; A program for recording audio.

14. A voice recording program executed by an information processing device, a music playback process for playing back music and outputting music sounds to a first path; a signal sound generating unit that generates a signal sound having a falling edge at the playback start position of the music piece and outputs the signal sound to a first path; an input process for inputting voice into the second route; a recording process of monitoring the first path, starting to form sound recording data at the falling edge of the signal sound, and switching to the second path after the start of the sound recording data formation, and forming the sound recording data; A program for recording audio.

Images