Terminal device, and program for terminal device

Abstract

To provide a terminal device and program that suppress degradation of acoustic signals transmitted to the other party and enable high-quality two-way communication.SOLUTION: In a terminal device (Karaoke device), an acoustic control unit 25 includes: receiving means (LAN communication unit) for receiving monaural acoustic signals from other terminal devices; conversion means for converting the monaural acoustic signals received by the receiving means into two sets of monaural acoustic signals; inversion means for inverting phase of one of the two divided sets of monaural acoustic signals; addition means 25g for adding the phase-inverted monaural audio signal and the non-phase-inverted monaural audio signal; and transmission means (LAN communication unit) for transmitting the monaural audio signal added by the addition means to other terminal devices.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a terminal device that performs voice communication with other terminal devices, and a terminal device program executed by an information processing device. [Background technology]

[0002] Currently, two-way communication using terminals such as personal computers is becoming increasingly common in various industries. In two-way communication, video and audio captured on a terminal can be transmitted to other terminals, enabling events such as web conferences. In web conferences, sharing video and audio makes it possible to hold conferences and meetings between people in remote locations.

[0003] Patent Document 1 discloses an echo cancellation device that removes components corresponding to reference data from input digital data corresponding to a signal from a microphone in a hands-free system for conversations via a telephone in a car. In particular, Patent Document 1 delays signal components of different frequency bands that have passed through multiple filter sections based on the arrival time of sound from each of multiple speakers to the microphone. This configuration enables the echo cancellation device disclosed in Patent Document 1 to reduce the number of adaptive filters used to remove components corresponding to reference data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-97293 Summary of the Invention [Problem to be solved by the invention]

[0005] In the echo cancellation device disclosed in Patent Document 1, when removing the component corresponding to the reference data, the signal to be transmitted to the other party is also processed, which may result in degradation of the signal transmitted to the other party.

[0006] The present invention has been developed in consideration of such circumstances, and one of its objectives is to provide a terminal device and a program for the terminal device that suppress degradation of the acoustic signal transmitted to the other party and enable high-quality two-way communication. [Means for solving the problem]

[0007] Therefore, the terminal device according to the present invention employs the following configuration. receiving means for receiving a monaural audio signal from another terminal device; a conversion means for converting the monaural audio signal received by the receiving means into two-system monaural audio signals; a phase reversal means for performing phase reversal processing on one of the two systems of the monaural audio signal; an adding means for adding the phase-reversed monaural audio signal and the phase-unreversed monaural audio signal; and a transmitting means for transmitting the monaural audio signal added by the adding means to another terminal.

[0008] Furthermore, the terminal device according to the present invention comprises: The apparatus includes a switching means for switching between a first mode in which the phase reversal means executes the phase reversal process and a second mode in which the phase reversal means does not execute the phase reversal process.

[0009] Furthermore, the terminal device according to the present invention comprises: an analyzing means for analyzing the monaural audio signal received by the receiving means or the monaural audio signal converted by the converting means; The system further includes an echo cancellation unit that performs echo cancellation processing on the monaural acoustic signal added by the addition unit based on the analysis result by the analysis unit.

[0010] Furthermore, the terminal device according to the present invention comprises: The audio signal processing device includes an output means for outputting the monaural audio signal that has been subjected to the phase reversal processing by the phase reversal means and the monaural audio signal that has not been subjected to the phase reversal processing to a speaker.

[0011] Furthermore, the terminal device according to the present invention comprises: a performance means for performing a performance based on music information; The transmitting means transmits the performance sound produced by the performance means to another terminal device.

[0012] Furthermore, in the terminal device according to the present invention, The phase reversal means performs phase reversal processing during the period when the performance means is performing the performance.

[0013] Furthermore, the terminal device according to the present invention comprises: The transmitting means transmits the acoustic signal input from the microphone to another terminal device.

[0014] The program for a terminal device according to the present invention includes: A terminal device program executed on a terminal device, a receiving process for receiving a monaural audio signal from another terminal device; a conversion process for converting the monaural audio signal received by the receiving means into two-system monaural audio signals; A phase reversal process for reversing the phase of one of the two separate mono audio signals; an addition process of adding the phase-reversed monaural audio signal and the phase-unreversed monaural audio signal; A transmission process is performed to transmit the monaural acoustic signal added by the adding means to another terminal. [Effects of the Invention]

[0015] The terminal device and the program for the terminal device according to the present invention can suppress deterioration of the acoustic signal transmitted to the other party, enabling two-way communication of high quality sound. [Brief explanation of the drawings]

[0016] [Figure 1] Network configuration diagram for a karaoke store [Figure 2] FIG. 1 is a diagram showing the configuration of a karaoke system according to an embodiment of the present invention; [Figure 3] FIG. 1 is a diagram illustrating a communication configuration according to the present embodiment. [Figure 4] FIG. 1 shows the configuration of an acoustic control unit according to the present embodiment (in normal mode). [Figure 5] FIG. 1 shows the configuration of an acoustic control unit according to the present embodiment (in singing mode); [Figure 6] 2 is a table for explaining the acoustic signals of the second adding means and the selector according to this embodiment. [Figure 7] 1 is a flowchart showing a music playback process according to the present embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0017] FIG. 1 shows an example of a network configuration in a karaoke store. Each room (karaoke room), from Room A to Room K, is equipped with karaoke machines 2a to 2k and monitors 41a to 41k. The karaoke machines 2a to 2k are connected to a LAN 100 via LAN cables to form a network. The LAN 100 is connected to the Internet via a router 120 and an optical modem 121, and can communicate with a server (not shown). In this network environment, the karaoke machines 2a to 2k can communicate with the server to download new song information or to manage user information, usage history, and the like on the server.

[0018] In this embodiment, by connecting to the karaoke devices 2a-2k of other stores or your own store, two-way communication is possible between the connected karaoke devices 2a-2k. In two-way communication, sounds, videos, and images can be transmitted and received between the connected karaoke devices 2a-2k, allowing users to enjoy conversation or singing together.

[0019] The remote control device 1, which outputs song selection instructions and various control commands to the karaoke device 2, is managed at a counter by a manager (also called an employee or staff member). Customers (users) who visit a karaoke store complete the necessary procedures at the counter, borrow a remote control device 1, and then move to the room instructed by the manager. The remote control device 1 has a wireless LAN function and is connected to a LAN 100 via one of the access points 110a to 110c installed in the store, enabling it to communicate with the associated karaoke device 2.

[0020] A management computer 6 operated by a manager is also installed inside the counter. The management computer 6 is an information processing device that manages customers who visit the bar, and is capable of managing the number of customers entering each room, the time of arrival, the length of stay, the time of departure, the fee, etc. The management computer 6 is connected to a LAN 100, and is capable of communicating via the Internet or with the karaoke machines 2a to 2k installed in each room or the remote control device 1.

[0021] Fig. 2 is a diagram showing the configuration of a karaoke system according to an embodiment of the present invention. The karaoke system in this embodiment includes a karaoke device 2 and a remote control device 1. The karaoke device 2 and the remote control device 1 are communicatively connected using a LAN 100 and an access point 110. Note that in Fig. 1, the karaoke devices 2a to 2k and the monitors 41a to 41k installed in each room are given suffixes a to k so that they can be identified, but in Fig. 2, the suffixes a to k are omitted.

[0022] The karaoke machine 2 is equipped with an audio control unit 25 as a performance means for playing music. The karaoke machine 2 is equipped with an operation unit 21 as an input means consisting of switches and the like for receiving various inputs from the user. The karaoke machine 2 is equipped with an operation processing unit 22 for interpreting inputs from the operation unit 21 and transmitting them to the control unit 20. The karaoke machine 2 is also equipped with an HDD 26 (hard disk) as storage means on the karaoke machine 2 side for storing various information. The karaoke machine 2 is equipped with a LAN communication unit 24 as karaoke machine side communication means for connecting to the LAN 100.

[0023] The karaoke device 2 also includes a video playback means for displaying images such as lyrics and background video on the monitor 41. The video playback means includes a video playback unit 29 for playing background video based on background video information, a video RAM 28 for temporarily storing the background video to be played, and a video control unit 30 for displaying lyrics superimposed on the played background video. The video control unit 30 may also have a function for applying visual effects to the background video.

[0024] Furthermore, the karaoke device 2 is capable of displaying various information on the touch panel monitor 31 in addition to the externally connected monitor 41. The touch panel monitor 31 is configured by superimposing a display section 31a that displays video information input from the video control section 30 and a touch panel 31b that outputs a touch input position to the operation processing section 22.

[0025] The touch panel monitor 31 can function as an operating means similar to the touch panel monitor 11, which is the operating means of the remote control device 1. The user can use the touch panel monitor 31 to select a song and make a reservation directly on the karaoke device 2, and the touch panel monitor 31 can function as an operating means equivalent to the remote control device 1.

[0026] Furthermore, the karaoke device 2 is equipped with a control unit 20, which is composed of a CPU and the like, as a control means for controlling each component in an integrated manner, and a memory 27 for temporarily storing information required for executing various programs.

[0027] With this configuration, the karaoke device 2 executes various processes, but its main functions include song selection and song playback. The song selection process is a process for specifying and reserving a song based on a user's selection, and is executed in cooperation with the remote control device 1. Reservation information including a song ID that identifies the song transmitted from the remote control device 1 is registered in a reservation table stored in the memory 27. The song playback process is a process for playing a song based on the song ID included in the reservation information registered in the reservation table, and is a process in which the performance process and the lyric playback process are executed synchronously.

[0028] The performance process for playing back a song is a process for causing the audio control unit 25 to play the performance information included in the song information. The song played by the audio control unit 25 is output from the speakers 42R, 42L together with the singing voice input from the singing microphones 43a, 43b. The lyrics playback process is a process for providing singing assistance by displaying lyrics on the monitor 41 based on the lyrics information included in the song information. A background video display process may be executed to superimpose a background video on the lyrics displayed in this lyrics playback process.

[0029] Meanwhile, the remote control device 1 transmits various instructions, such as reservation information, to the karaoke device 2, and receives various information from the karaoke device 2 or various servers connected on the Internet. In this embodiment, the remote control device 1 is provided with an operation unit 13 such as buttons as a user interface, and a touch panel monitor 11. The touch panel monitor 11 is configured with a display unit 11a and a touch panel 11b, and displays various interfaces on the display unit 11a and is capable of receiving touch inputs from the user.

[0030] Furthermore, the remote control device 1 is equipped with a memory 10b for storing a database required for music search, various programs, and various information generated as the programs are executed, and remote control control means for controlling these components in an integrated manner. The remote control control means includes a control section 10a made up of a CPU etc., a video control section 10c for forming images to be displayed on the display section 11a, a video RAM 10e for temporarily storing the image information to be displayed, and an operation processing section 12 for interpreting input from an operation section 13 and transmitting the input to the control section 10a. Furthermore, the audio control unit 10d can cause the speaker 14 to output various audio signals and can also receive audio signals input from the audio microphone 18 under the control of the control unit 10a.

[0031] Furthermore, the remote control device 1 of this embodiment has a camera 17 disposed on its housing above the touch panel monitor 11, which is capable of taking pictures or reading images. The remote control device 1 is wirelessly connected to an access point 110 via a wireless LAN communication unit 16, thereby being connected to a network formed by a LAN 100. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2. The karaoke device 2 can also be operated using a mobile device such as a smartphone carried by the user (customer). In this case, when the user visits the karaoke bar, the mobile device carried by the user is associated with the karaoke device 2.

[0032] Here, a description will be given of the process of associating the remote control device 1 with the karaoke device 2. The process of associating can be performed in two ways: (1) by a store employee in advance, or (2) by a customer.

[0033] In the case of (1), the remote control device 1 and the karaoke device 2 are associated in advance by an employee, and the store counter lends out the remote control device 1 associated with the karaoke device 2 installed in the room the customer will enter.

[0034] In the case of (2), the remote control device 1 rented at the counter is in a state where the association is cancelled, and when the customer enters the room, the association process is executed by the customer's operation, and the rented remote control device 1 is associated with the karaoke device 2 installed in the room.

[0035] In the karaoke system of this embodiment, two-way communication with another karaoke device 2 (or another information processing device) can be performed using the camera 17 and audio microphone 18 (or singing microphones 43a, 43b) provided on the remote control device 1, making it possible to enjoy two-way communication such as conversation with a remote location or singing.

[0036] 3 is a diagram illustrating a communication configuration according to this embodiment. In this embodiment, optical modems 121a to 121c in each of stores A to C are communicatively connected to the Internet. A management server 51, a first server 52a, and a second server 52b are provided on the Internet, and function as a means for two-way communication between the karaoke machines 2 installed in each of stores A to C. In the two-way communication of this embodiment, users can communicate with each other and sing karaoke at different locations by communicating images, videos, and sounds between their terminals (karaoke machines 2).

[0037] In this embodiment, the management server 51 manages code information issued to the mobile terminals carried by the users. The code information is information used for two-way communication between the karaoke devices 2, and is configured by a QR code (registered trademark) or the like. The user can start two-way communication by having the karaoke system read the issued code information (for example, by having the camera 17 of the remote control device 1 read it).

[0038] The first server 52a is a server used in the two-way communication service, and the karaoke devices 2 to be connected access the first server 52a to determine which karaoke devices 2 share the same virtual room. Thereafter, video and audio communication between the karaoke devices 2 to which the same virtual room is assigned is performed peer-to-peer, without going through the first server 52a. Alternatively, the karaoke devices 2 to be connected access the second server 52b to determine which karaoke devices 2 share the same virtual room. Thereafter, video and audio communication between the karaoke devices 2 to which the same virtual room is assigned may be performed via the second server 52b.

[0039] In this way, by using the two-way communication service, it is possible to carry out two-way communication services involving video, images and sound between the karaoke device 2 or the information processing device.

[0040] Here, in two-way communication, it is required to provide high-quality sound. The karaoke device 2 emits sound signals, such as voices or performance sounds, transmitted from the other karaoke device 2 or information processing device sharing the same virtual room from the speakers 42R, 42L. If the sound signal transmitted from the other device is transmitted back to the other device and emitted from the speaker, echoes and feedback may occur at the other device. In consideration of such a situation, this embodiment aims to suppress echoes and feedback and provide the user with high-quality sound signals. Therefore, the karaoke device 2 according to this embodiment has a distinctive feature in the sound control unit 25.

[0041] In a two-way communication service, the acoustic control unit 25 of this embodiment can operate in two modes: a normal mode during normal operation and a singing mode during music playback processing. Fig. 4 is a diagram showing the configuration of the acoustic control unit 25 according to this embodiment (in normal mode). The acoustic control unit 25 is configured to have the functions of a performance means 25a, a first addition means 25c, an effect application means 25b, a decoder (self) 25d, a decoder (other party) 25e, an analysis means 25f, a second addition means 25g, a selector 25h, a monauralization means 25i, an AEC application means 25j, and an encoder 25k.

[0042] The performance means 25a is a means for reproducing performance information included in the music information during music playback processing. In this embodiment, it outputs two stereo signals, one for left and one for right. The effect imparting means 25b is a means for imparting sound effects, such as echo, to the sound signal input from the singing microphone 43a.

[0043] The first adding means 25c adds the performance sound signal output from the performance means 25a and the sound signal to which the sound effect has been applied by the effect applying means 25b, and outputs two systems of left and right sound signals S1cR, S1cL to the second adding means 25g. Note that in the normal mode, no output is made from the performance means 25a and the effect applying means 25b, and therefore the performance means 25a and the effect applying means 25b are depicted in dashed lines in Fig. 4.

[0044] In this embodiment, conversation with the other party can be carried out using either the audio microphone 18 or the singing microphone 43a (43b can also be used) provided on the remote control device 1. Whether to use the audio microphone 18 or the singing microphones 43a, 43b for conversation can be switched using a user interface displayed on the touch panel monitor 11 of the remote control device 1.

[0045] An audio signal S1b input from the singing microphone 43a (an audio signal to which no effect is applied by the effect applying means 25b) is input to the selector 25h. An audio signal input from the audio microphone 18 is encoded by the remote control device 1 and input to the decoder (own) 25d from the LAN communication unit 24 of the karaoke device 2. An audio signal S1a decoded by the decoder (own) 25d is input to the selector 25h.

[0046] The selector 25h selects as input the acoustic signal (acoustic signal S1a or acoustic signal S1b) of the selected microphone based on the setting of whether to use the singing microphone 43a, 43b or the audio microphone 18. In this manner, in this embodiment, the acoustic signal of conversation can be transmitted to the other party during two-way communication using the singing microphone 43a or the audio microphone 18 provided on the remote control device 1.

[0047] An acoustic signal received by the LAN communication unit 24 from the other party (or parties) is decoded by the decoder (other party) 25e and converted into an acoustic signal S2. In this embodiment, to prevent echoes, an analysis means 25f analyzes the characteristics (frequency characteristics, etc.) of the acoustic signal S2. The acoustic signal S2 is output (emitted as sound) from the left and right speakers 42R and 42L via a second addition means 25g. Note that in FIGS. 4 and 5, amplifiers, effect imparting devices, and other devices provided between the acoustic control unit 25 and the speakers 42R and 42L are omitted from the illustration.

[0048] Next, the acoustic signal S1 to be transmitted to the other party will be described. In this embodiment, acoustic signals S1dR and S1dL are used as the acoustic signals to be transmitted to the other party, with the aim of transmitting as much of the sounds heard from the speakers 42R and 42L (excluding sounds from the other party) to the other party as possible. The selector 25h adds the acoustic signal S1a or the acoustic signal S1b to the acoustic signals S1dR and S1dL, and outputs the result as acoustic signals S1eR and S1eL. In this embodiment, the acoustic signal to be transmitted to the other party is a monaural signal, so the two systems of acoustic signals S1eR and S1eL are added together in the monaural conversion means 25i (corresponding to "addition means") and converted into a single system of acoustic signal S1'.

[0049] Since the acoustic signal S1' also includes the acoustic signal S2 received from the other party, the AEC application means 25j removes the acoustic signal S2. The AEC application means 25j is an echo cancellation means that performs acoustic echo cancellation (AEC) processing. The AEC application means 25j suppresses echoes, howling, and the like caused by transmitted audio in two-way communication using a network.

[0050] In this embodiment, the audio signal S2 is removed from the audio signal S1' based on the analysis result of the audio signal S2 analyzed by the analysis means 25f. The audio signal S1 to which AEC has been applied by the AEC application means 25j is encoded using the encoder 25k and transmitted to the other party's karaoke machine 2 or information processing device via the LAN communication unit 24.

[0051] The configuration of the sound control unit 25 in normal mode has been described above. Now, let us consider a case where the performance means 25a and the effect applying means 25b are operated in normal mode. The first adding means 25c adds the performance sound output from the performance means 25a to the sound signal to which an effect has been applied by the effect applying means 25b, and the resulting sound signals S1cR and S1cL are then included in the sound signals S1eR and S1eL via the selector 25h.

[0052] When the AEC application unit 25j applies AEC to the audio signal S1', it is necessary to sufficiently remove the components of the audio signal S2 contained in the audio signal S1'. Removing the audio signal S2 will result in a decrease in the quality of the audio signals S1cR and S1cL that are intended to be transmitted. In particular, in a karaoke device 2 for enjoying music and singing, it is required that the audio signals S1cR and S1cL be heard with high quality. For this reason, this embodiment employs a singing mode in addition to a normal mode.

[0053] 5 is a diagram showing the configuration of the acoustic control unit 25 according to this embodiment (in singing mode). Note that in the description of the singing mode, the same points as in the normal mode will not be described. In this embodiment, the use of the singing microphones 43a, 43b and the audio microphone 18 is exclusive, so the audio microphone 18 is not used while the singing microphones 43a, 43b are in use. Therefore, in the singing mode, the decoder (own) 25d is not used, and is indicated by a dashed frame in FIG. 5.

[0054] The first adding means 25c adds the performance sound output from the playing means 25a and the sound signal to which the effect has been applied by the effect applying means 25b, and the resulting sound signal is output to the second adding means 25g. In the singing mode, it is assumed that no conversation takes place while singing, and therefore the output of the sound signal S1b from the singing microphones 43a, 43b and the sound signal S1a of the audio signal input from the audio microphone 18 is stopped.

[0055] On the other hand, an acoustic signal received by the LAN communication unit 24 from a counterpart (or multiple counterparts) is decoded by a decoder (communication counterpart) 25e and converted into an acoustic signal S2. In this embodiment, the acoustic signal S2 is multiplexed (copied) by a conversion means 25m and converted into two systems of acoustic signals S2. Then, a phase reversal means 25n reverses the phase of one of the multiplexed acoustic signals S2.

[0056] In this embodiment, the output signals of the phase reversal means 25n are audio signals S2R and S2L, and the audio signal S2L is reversed in phase. The normal-phase audio signal S2R and the phase-reversed audio signal S2L are added to stereo audio signals S1cR and S1cL by a second addition means 25g, and the resulting audio signals are output (emitted as sound) from the speakers 42R and 42L as audio signals S1dR and S1dL.

[0057] The acoustic signals S1dR and S1dL output from the speakers 42R and 42L include, as components, an in-phase acoustic signal S2R and an in-phase processed acoustic signal S2L. Because the in-phase acoustic signal S2R and the in-phase processed acoustic signal S2L output from the speakers 42R and 42L are transmitted to the ears of the listening user through space, the degree to which they cancel each other out is small, and the user can hear them. The user hears the acoustic signals S2R and S2L transmitted from the other party and emitted from the speakers 42R and 42L.

[0058] On the other hand, when transmitting the acoustic signals S1dR and S1dL to the other party, it is necessary to remove the components of the acoustic signals S2R and S2L from the acoustic signals S1dR and S1dL. In the normal mode, this is removed using the AEC application means 25j, but as mentioned above, this may result in degradation of the acoustic signals S1cR and S1cL.

[0059] In this embodiment, the audio signals S2R and S2L are multiplexed by the conversion means 25m, one of the audio signals S2 is subjected to phase inversion processing by the phase inversion means 25n, and then added together by the monaural conversion means 25i, thereby removing the audio signals S2R and S2L.

[0060] Here, the sound signals S1eR, S1eL to be transmitted are mixed with sound signals S2R, S2L emitted from speakers 42R, 42L and picked up by singing microphones 43a, 43b. The AEC application means 25j removes these mixed sound signals S2R, S2L from the sound signals S1eR, S1eL. At this time, because the sound signal S2 (sound signals S2R, S2L) transmitted from the other party has been removed by the monaural conversion means 25i, the AEC application means 25j does not need to remove a large amount of the sound signal S2, and it is possible to prevent significant degradation of the sound signals S1cR, S1cL.

[0061] Therefore, the acoustic signal S1 to be transmitted to the other party is generated as follows: The selector 25h outputs the acoustic signals S1dR and S1dL output from the speakers 42R and 42L to the monaural conversion means 25i as acoustic signals S1eR and S1eL without modification. The monaural conversion means 25i adds the left and right acoustic signals S1eR and S1eL and outputs the result as acoustic signal S1'.

[0062] The AEC application means 25j removes the components of the audio signal S2 from the audio signal S1' based on the analysis result of the analysis means 25f. At this time, the components of the audio signal S2 removed by the AEC application means 25j are only the components of the audio signals S2R and S2L emitted from the speakers 42R and 42L that have been mixed in from the singing microphone 43a, etc., so degradation of the audio signal S1 (and consequently the components of the audio signals S1cR and S1cL) is suppressed. The audio signal S1 is encoded by the encoder 25k and transmitted to the other party via the LAN communication unit 24.

[0063] As described above, in the acoustic control unit 25 of this embodiment, (1) the acoustic signal S2 received by the LAN communication unit 24 is converted into two systems of acoustic signals S2 by the conversion means 25m. (2) The phase inversion means 25n performs phase inversion processing on one of the two systems of the acoustic signal S2. (3) By adding the phase-inverted acoustic signal S2R and the non-phase-inverted acoustic signal S2L together, the components of the acoustic signal S2 are sufficiently removed from the acoustic signal S1' to be transmitted to the other party, enabling sufficient echo cancellation. At this time, the acoustic signals S2R and S2L contained in the acoustic signals S1dR and S1dL emitted from the speakers 42R and 42L are audible.

[0064] 6 is a table illustrating the acoustic signals of the second adder 25g and the selector 25h according to this embodiment. In normal mode, the acoustic signals S1dR and S1dL output by the second adder 25g to the selector 25h and the speakers 42R and 42L are only the acoustic signal S2. In normal mode, the acoustic signals S1eR and S1eL output by the selector 25h to the monaural conversion means 25i are obtained by adding the acoustic signal S1a or the acoustic signal S1b to the acoustic signals S1dR and S1dL.

[0065] In the singing mode, the audio signals S1dR and S1dL output by the second adding means 25g to the selector 25h and the speakers 42R and 42L are obtained by adding the audio signals S2R and S2L to the audio signals S1cR and S1cL, respectively. In the singing mode, the audio signals S1eR and S1eL output by the selector 25h to the monauralizing means 25i are used as they are.

[0066] 7 is a flow diagram showing the music playback process according to this embodiment. The music playback process is executed by the karaoke device 2, and is a process for playing music information. Performance information included in the music information is played by the performance means 25a of the audio control unit 25.

[0067] In the music playback process, the reservation table is checked to see if there is a next music to play (S101). If there is a next music to play (S102: Yes), the mode of the acoustic control unit 25 is set to the singing mode described in Fig. 5 (S103). After the mode is changed to the singing mode (S103), music information is played (S104).

[0068] In the singing mode, the conversion means 25m, the phase reversal means 25n, and the monauralization means 25i function to effectively remove the components of the received acoustic signal S2 from the acoustic signal S1 to be transmitted. When the music playback is completed (S105: Yes), the mode of the acoustic control unit 25 is changed to the normal mode described in Fig. 4 (S106). In this way, in this embodiment, the singing mode and the normal mode are switched depending on the playback status of the music.

[0069] Although the karaoke system of this embodiment has been described above, various modifications can be adopted to the terminal device according to the present invention. Various modifications will be described below.

[0070] [First Modification] In the above embodiment, the singing mode and the normal mode are switched depending on the playback status of the music piece, but the singing mode may be used all the time without switching modes.

[0071] [Second Modification] In the above-described embodiment, the audio microphone 18 and the singing microphones 43a, 43b are used exclusively, and either one can be used at a time. Alternatively, the audio microphone 18 and the singing microphones 43a, 43b may be used simultaneously.

[0072] [Third Modification] In the above embodiment, the monaural conversion means 25i is arranged after the selector 25h, but the monaural conversion means 25i may be arranged before the selector 25h. Also, the analysis means 25f may be arranged after the conversion means 25m or after the phase inversion means 25n.

[0073] The terminal device according to the present invention has been described above using the karaoke machine 2 as an example, but the terminal device according to the present invention is not limited to the karaoke machine 2 and may be various information processing devices capable of two-way communication, such as a personal computer or a mobile terminal. Furthermore, the terminal device program executed by the karaoke machine 2 or the various information terminals described above also falls within the scope of the present invention. [Explanation of symbols]

[0074] 1: Remote control device 25f: Analysis means 2(a-k): karaoke device 25g: second adding means 6:Administrative computer 25h:Selector 10a: control unit 25i: monaural conversion means 10b: Memory 25j: AEC application means 10c: Video control unit 25k: Encoder 10d: Acoustic control unit 25m: Conversion means 10e: Video RAM 25n: Reverse phase means 11: Touch panel monitor 26: HDD 11a: Display unit 27: Memory 11b: Touch panel 28: Video RAM 12: Operation processing unit 29: Video playback unit 13: Operation unit 30: Image control unit 14: Speaker 31: Touch panel monitor 16: Wireless LAN communication section 31a: Display section 17: Camera 31b: Touch panel 18: Audio microphone 41 (41a to 41k): Monitor 20: Control unit 42R, 42L: Speaker 21: Operation unit 43a, 43b: Singing microphone 22: Operation processing unit 51: Management server 24: LAN communication unit 52a: First server 25: Acoustic control unit 52b: Second server 25a: Performance means 110(a-c): Access point 25b: Effect applying means 120(a-c): Router 25c: First adding means

Claims

1. receiving means for receiving a monaural audio signal from another terminal device; a conversion means for converting the monaural audio signal received by the receiving means into two-system monaural audio signals; a phase reversal means for performing phase reversal processing on one of the two systems of the monaural audio signal; an adding means for adding the phase-reversed monaural audio signal and the phase-unreversed monaural audio signal; a transmitting means for transmitting the monaural audio signal added by the adding means to another terminal. Terminal device.

2. A switching means is provided for switching between a first mode in which the reverse phase processing is performed by the reverse phase processing means and a second mode in which the reverse phase processing is not performed by the reverse phase processing means. The terminal device according to claim 1 .

3. an analyzing means for analyzing the monaural audio signal received by the receiving means or the monaural audio signal converted by the converting means; and an echo canceling means for executing echo cancellation processing on the monaural acoustic signal added by the adding means based on the analysis result by the analyzing means. The terminal device according to claim 1 .

4. and an output means for outputting to a speaker the monaural audio signal that has been subjected to the phase reversal processing by the phase reversal means and the monaural audio signal that has not been subjected to the phase reversal processing. The terminal device according to claim 1 .

5. a performance means for performing a performance based on music information; The transmitting means transmits the performance sound produced by the performance means to another terminal device. The terminal device according to claim 1 .

6. The phase reversal means performs phase reversal processing during the period in which the performance is being performed by the performance means. The terminal device according to claim 5.

7. The transmitting means transmits the acoustic signal input from the microphone to another terminal device. The terminal device according to claim 1 .

8. A terminal device program executed on a terminal device, a receiving process for receiving a monaural audio signal from another terminal device; a conversion process for converting the monaural audio signal received by the receiving means into two-system monaural audio signals; a phase reversal process for reversing the phase of one of the two systems of the monophonic audio signal; an addition process of adding the phase-reversed monaural audio signal and the phase-unreversed monaural audio signal; a transmission process for transmitting the monaural acoustic signal added by the adding means to another terminal; Terminal device program.

Images