Two-way communication system

Abstract

To provide a two-way communication service that can be selected from a new perspective as one objective.SOLUTION: A two-way communication system according to the present invention is a two-way communication system that performs two-way communication using audio and video between a plurality of terminals, and is capable of executing a selection process in which a first service or a second service is selected by a user. The first service limits the number of terminals that can be communication connected to n or less, and the second service limits the number of terminals that can be communication connected to n+1 or more.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to a two-way communication system that enables video and audio communication between terminals. [Background technology]

[0002] Currently, two-way communication using terminals such as personal computers is becoming increasingly common in various industries. In two-way communication, video and audio captured on a terminal can be transmitted to other terminals, enabling events such as web conferences. In web conferences, sharing video and audio makes it possible to hold conferences and meetings between people in remote locations.

[0003] Patent Document 1 discloses that in a Web conference system using two-way communication, an event occurring in each room is detected and bandwidth control is performed within the range of the communication bandwidth allocated to each room. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-112845 Summary of the Invention [Problem to be solved by the invention]

[0005] Meanwhile, various services that use two-way communication require appropriate management of usage fees, communication quality, etc. In some cases, web conferencing systems have limitations on the usage time per access, depending on whether the version is paid or free. However, it is difficult to properly manage services that use two-way communication based solely on usage time.

[0006] The present invention has been made in view of the above circumstances, and one of its objects is to provide a selectable two-way communication service from a new perspective. [Means for solving the problem]

[0007] Therefore, the two-way communication system according to the present invention employs the following configuration. A two-way communication system for two-way communication using audio and video between multiple terminals, A selection process is executed in which the user selects the first service or the second service; The first service limits the number of devices that can be connected to communication to n or less. The second service has a limit of (n+1) or more terminals that can be connected for communication.

[0008] Furthermore, in the two-way communication system according to the present invention, The service fees for the first and second services are different.

[0009] Furthermore, the two-way communication system according to the present invention includes: The management server manages information relating to the first service and the second service.

[0010] Furthermore, in the two-way communication system according to the present invention, In the first service, when the number of terminals connected for communication is n or less, a connection availability notification process is executed to notify the terminal that desires connection that connection is available.

[0011] Furthermore, in the two-way communication system according to the present invention, The first service and the second service perform bidirectional communication using different communication methods.

[0012] Furthermore, the two-way communication system according to the present invention includes: a switching notification process for notifying a user of a switching notification to a second service when n or more terminals are connected to the first service; In response to a user operation, a switching process is executed to switch from the first service to the second service.

[0013] Furthermore, in the two-way communication system according to the present invention, The second service has a time limit for use. [Effects of the Invention]

[0014] The two-way communication system according to the present invention makes it possible to vary the number of terminals that can be connected for communication depending on the service selected by the user. This makes it possible to vary the fees, communication format, etc. depending on the selected service, making it possible to provide services that are suited to the communication quality or system operating costs. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram showing a network configuration in a karaoke store. [Figure 2] 1 is a diagram showing the configuration of a karaoke system according to an embodiment of the present invention; [Figure 3] FIG. 1 is a diagram illustrating a communication configuration according to the present embodiment. [Figure 4] 10 is a flowchart showing a screen display process according to the present embodiment; [Figure 5] 10 is a flowchart showing a My Code screen (free) display process according to the present embodiment; [Figure 6] 10 is a flowchart showing a My Code screen (paid) display process according to the present embodiment; [Figure 7] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 8] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 9] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 10] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 11] FIG. 1 is a flowchart showing a two-way communication process according to the present embodiment. [Figure 12] FIG. 10 is a diagram showing a reading instruction screen according to the present embodiment; [Figure 13] FIG. 10 is a diagram showing a code reading screen according to the present embodiment; [Figure 14] FIG. 10 is a diagram showing a monitor screen during two-way communication according to the present embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0016] FIG. 1 shows an example of a network configuration in a karaoke store. Each room (karaoke room), from Room A to Room K, is equipped with karaoke machines 2a to 2k and monitors 41a to 41k. The karaoke machines 2a to 2k are connected to a LAN 100 via LAN cables to form a network. The LAN 100 is connected to the Internet via a router 120 and an optical modem 121, and can communicate with a server (not shown). In this network environment, the karaoke machines 2a to 2k can communicate with the server to download new song information or to manage user information, usage history, and the like on the server.

[0017] In this embodiment, by connecting to the karaoke devices 2a-2k of other stores or your own store, two-way communication is possible between the connected karaoke devices 2a-2k. In two-way communication, audio and video can be transmitted and received between the connected karaoke devices 2a-2k, allowing users to enjoy conversation or singing together.

[0018] The remote control device 1, which outputs song selection instructions and various control commands to the karaoke device 2, is managed at a counter by a manager (also called an employee or staff member). Customers (users) who visit a karaoke store complete the necessary procedures at the counter, borrow a remote control device 1, and then move to the room instructed by the manager. The remote control device 1 has a wireless LAN function and is connected to a LAN 100 via one of the access points 110a to 110c installed in the store, enabling it to communicate with the associated karaoke device 2.

[0019] A management computer 6 operated by a manager is also installed inside the counter. The management computer 6 is an information processing device that manages customers who visit the bar, and is capable of managing the number of customers entering each room, the time of arrival, the length of stay, the time of departure, the fee, etc. The management computer 6 is connected to a LAN 100, and is capable of communicating via the Internet or with the karaoke machines 2a to 2k installed in each room or the remote control device 1.

[0020] Fig. 2 is a diagram showing the configuration of a karaoke playback system according to an embodiment of the present invention. The karaoke system in this embodiment includes a karaoke device 2 and a remote control device 1. The karaoke device 2 and the remote control device 1 are connected for communication using a LAN 100 and an access point 110. Note that in Fig. 1, the karaoke devices 2a to 2k and the monitors 41a to 41k installed in each room are given suffixes a to k so that they can be identified, but in Fig. 2, the suffixes a to k are omitted.

[0021] The karaoke machine 2 is equipped with an audio control unit 25 as a performance means for playing music. The karaoke machine 2 is equipped with an operation unit 21 as an input means composed of switches and the like for receiving various inputs from the user. The karaoke machine 2 is equipped with an operation processing unit 22 for interpreting inputs from the operation unit 21 and transmitting them to the control unit 20. The karaoke machine 2 is also equipped with an HDD 26 (hard disk) as storage means on the karaoke machine 2 side for storing various information. The karaoke machine 2 is equipped with a LAN communication unit 24 as communication means on the karaoke machine 2 side for connecting to the LAN 100.

[0022] The karaoke device 2 also includes a video playback means for displaying images such as lyrics and background video on the monitor 41. The video playback means includes a video playback unit 29 for playing background video based on background video information, a video RAM 28 for temporarily storing the background video to be played, and a video control unit 30 for displaying lyrics superimposed on the played background video. The video control unit 30 may also have a function for applying visual effects to the background video.

[0023] Furthermore, the karaoke device 2 is capable of displaying various information on the touch panel monitor 31 in addition to the externally connected monitor 41. The touch panel monitor 31 is configured by superimposing a display section 31a that displays video information input from the video control section 30 and a touch panel 31b that outputs a touch input position to the operation processing section 22.

[0024] The touch panel monitor 31 can function as an operating means similar to the touch panel monitor 11, which is the operating means of the remote control device 1. The user can use the touch panel monitor 31 to select a song and make a reservation directly on the karaoke device 2, and the touch panel monitor 31 can function as an operating means equivalent to the remote control device 1.

[0025] Furthermore, the karaoke device 2 is equipped with a control unit 20, which is composed of a CPU and the like, as a control means for controlling each component in an integrated manner, and a memory 27 for temporarily storing information required for executing various programs.

[0026] With this configuration, the karaoke device 2 executes various processes, but its main functions include song selection and song playback. The song selection process is a process for specifying and reserving a song based on a user's specification, and is executed in cooperation with the remote control device 1. Reservation information including a song ID that identifies the song transmitted from the remote control device 1 is registered in a reservation table stored in the memory 27. The song playback process is a process for playing back song information based on the song ID of the reservation information registered in the reservation table, and is a process in which the performance process and the lyric playback process are executed synchronously.

[0027] The performance process for playing back a song is a process for causing the audio control unit 25 to play the performance information included in the song information. The performance information played by the audio control unit 25 is output from the speaker 42 together with the singing voice input from the singing microphones 43a and 43b. The lyric playback process is a process for providing singing assistance by displaying lyrics on the monitor 41 based on the lyric information included in the song information. A background video display process may be executed to superimpose a background video on the lyrics displayed in this lyric playback process.

[0028] Meanwhile, the remote control device 1 transmits various instructions, such as reservation information, to the karaoke device 2, and receives various information from the karaoke device 2 or various servers connected on the Internet. In this embodiment, the remote control device 1 is equipped with an operation unit 13 such as buttons as an interface, and a touch panel monitor 11. The touch panel monitor 11 is configured with a display unit 11a and a touch panel 11b, and displays various interfaces on the display unit 11a and is capable of receiving touch inputs from the user.

[0029] Furthermore, the remote control device 1 is configured with a memory 10b that stores a database required for music search, various programs, and various information generated as the programs are executed, and a control means on the remote control device 1 side for controlling these components in an integrated manner. The control means on the remote control device 1 side includes a control unit 10a consisting of a CPU etc., a video control unit 10c that forms images to be displayed on the display unit 11a, a video RAM 10e that temporarily stores the image information to be displayed, and an operation processing unit 12 that interprets input from an operation unit 13 and transmits it to the control unit 10a. Furthermore, an audio control unit 10d can output various audio signals to a speaker 14 and can also receive audio signals input from a microphone 18 based on the control of the control unit 10a.

[0030] Furthermore, the remote control device 1 of this embodiment has a camera 17 disposed on its housing above the touch panel monitor 11, which is capable of taking pictures or reading images. The remote control device 1 is wirelessly connected to an access point 110 via a wireless LAN communication unit 16, thereby being connected to a network formed by a LAN 100. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2. The karaoke device 2 can also be operated using a mobile device such as a smartphone carried by the user (customer). In this case, when the user visits the karaoke bar, the mobile device carried by the user is associated with the karaoke device 2.

[0031] Here, a description will be given of the process of associating the remote control device 1 with the karaoke device 2. The process of association can be performed in two ways: (1) by a store employee in advance, or (2) by a customer.

[0032] In the case of (1), the remote control device 1 and the karaoke device 2 are associated in advance by an employee, and the store counter lends out the remote control device 1 associated with the karaoke device 2 installed in the room the customer will enter.

[0033] In the case of (2), the remote control device 1 rented at the counter is in a state where the association is cancelled, and when the customer enters the room, the association process is executed by the customer's operation, and the rented remote control device 1 is associated with the karaoke device 2 installed in the room.

[0034] In the karaoke system of this embodiment, the camera 17 and microphone 18 (or singing microphones 43a, 43b) provided on the remote control device 1 are used to perform two-way communication with another karaoke device 2 (or another information processing device), making it possible to enjoy conversation or singing with people in remote locations.

[0035] 3 is a diagram illustrating a communication configuration according to this embodiment. In this embodiment, each of the stores A to C is communicatively connected to the Internet by optical modems 121a to 121c. A management server 51, a first server 52a, and a second server 52b are provided on the Internet, and function as a means for two-way communication between the karaoke machines 2 installed in each of the stores A to C.

[0036] In this embodiment, a free two-way communication service (corresponding to a "first service") and a paid two-way communication service (corresponding to a "second service") are provided. In this embodiment, the management server 51 manages the paid two-way communication service and information related to the paid two-way communication service. The free two-way communication service and the paid two-way communication service differ in the number of karaoke device 2 terminals that can be connected for communication (hereinafter referred to as the "number of locations" or "number of rooms"). The free two-way communication service allows communication connections for up to n locations (n=3 in this embodiment). To connect to more than (n+1) locations, the user needs to use a paid two-way communication service.

[0037] The management server 51 manages information related to free two-way communication services and paid two-way communication services, such as codes (corresponding to "identification information") issued to mobile terminals owned by users. Code management includes whether the code belongs to a free two-way communication service or a paid two-way communication service, the expiration date of the code, the validity of the code, the code usage history, the number of points that can be connected to for paid two-way communication services, etc.

[0038] The first server 52a is a server used in the free two-way communication service. In the free two-way communication service, the karaoke device 2 to be connected accesses the first server 52a, and the karaoke device 2 that shares the same virtual room is determined. Thereafter, video and audio communication between the karaoke devices 2 that are assigned the same virtual room is performed peer-to-peer, without going through the first server 52a. On the other hand, in the paid two-way communication service, the karaoke device 2 to be connected accesses the second server 52b, and the karaoke device 2 that shares the same virtual room is determined. Thereafter, video and audio communication between the karaoke devices 2 that are assigned the same virtual room is performed via the second server 52b.

[0039] Next, the acquisition of a code used to perform a two-way communication service will be described. Fig. 4 is a flow diagram showing the screen display process according to this embodiment, and Figs. 7 to 9 are diagrams showing various screens displayed on the display unit 71 of the mobile terminal. In this embodiment, a user uses a mobile terminal owned by the user to acquire a code for performing a two-way communication service.

[0040] In this embodiment, when a user executes a predetermined program (application) on a mobile terminal or connects to a predetermined website using a browser, the main screen shown in Fig. 7(A) is displayed on the display unit 71 (S101). The user can manage his / her own information by obtaining an account in advance and logging in. The state in Fig. 7(A) shows the state when "Takken Taro" has logged in.

[0041] The main screen is provided with a My Code (free) button 71a, a My Code (paid) button 71b, a reservation list button 71c, and a logout button 71d. Here, the My Code is a code acquired by the user and is used when performing two-way communication services. When the My Code (free) button 71a is operated (S102: Yes), a My Code screen (free) display process (S200) is executed.

[0042] 5 is a flow diagram showing the My Code screen (free) processing according to this embodiment. When the My Code screen (free) display processing (S200) starts, first, the My Code (free) screen shown in FIG. 7(B) is displayed on the display unit 71 of the mobile terminal (S201). The My Code (free) screen has a free code display area 711 and a back button 71e. When the back button 71e is operated (S207: Yes), the My Code screen (free) display processing (S200) ends, and the main screen of FIG. 7(A) is displayed (S101).

[0043] The free code display area 711 displays a title input field 711a, a free code 711b, a URL display field 711c, an SNS selection button 711d, and a code change button 711e. A user can use the free two-way communication service by having the camera 17 of the remote control device 1 read the free code 711b. In this embodiment, a two-dimensional code is used for the free code 711b. When using the two-way communication service, the user needs to provide information for connecting to the same virtual room to the other user with whom the virtual room is shared.

[0044] The user can transmit the free code 711b to the other user by sending the URL displayed in the URL display field 711c to the other user via email or SNS. In this embodiment, the user can easily transmit the free code 711b to the other user by operating the SNS selection button 711d. The SNS selection button 711d is provided for each type of SNS. By operating the desired SNS selection button 711d, the user can launch the SNS app and transmit the URL for obtaining the free code 711b to the other user.

[0045] Furthermore, by inputting a title that the user wishes to convey to the other party in a title input field 711a, the title can be displayed when the other party receives the free code 711b. In this embodiment, the free code 711b has an expiration date. If the expiration date has passed, the user can obtain a new free code 711b by operating a code change button 711e.

[0046] 5, when the code change button 711e is operated (S202: Yes), the mobile terminal accesses the management server 51 and reacquires the free code 711b (S203). Then, the mobile terminal displays the free code (free) screen in which the reacquired free code 711b is displayed in the free code display area 711 (S201). On the other hand, when the SNS selection button is operated (S204: Yes), the mobile terminal starts the selected SNS app (S205) and transmits a URL for acquiring the free code 711b to the SNS app to the other user (S206).

[0047] 10(A) is a diagram showing the screen of a mobile device of a user who has received a URL for acquiring a free code 711b in an SNS app. A message received from Tokkyo Taro, the user in FIG. 7(B), is displayed in the other party's message display field 71o. A message sent in reply to Tokkyo Taro is displayed in the own message display field 71p.

[0048] The other party message display field 71o, which is the second from the top in Fig. 10(A), displays the URL displayed in the URL display field 711c or the URL entered by Tokkyo Taro operating the SNS selection button 711d. When the URL displayed in the other party message display field 71o is touched, the browser starts, the URL is accessed, and the code display screen shown in Fig. 10(B) is displayed.

[0049] The code display screen displays a title 71q (the character string entered in the title input field 711a in FIG. 7(B)), a free code 71r, a URL display field 71s, an SNS selection button 71t, and a list of participating stores button 71u. The user who receives the free code 71r can have the camera 17 of the remote control device 1 read the free code 71r, thereby enabling two-way communication between the karaoke machine 2 used by Tokkyo Taro, who is the sender of the code, and the karaoke machine 2 used by the user who received the free code 71r.

[0050] Furthermore, a user who receives the free code 71r can share the URL displayed in the URL display field 71s with others, or can allow other users to participate in the two-way communication service by operating the SNS selection button 711d. In this embodiment, the user must go to a karaoke store and specify a model of karaoke machine 2 that can use the two-way communication service. For this reason, a note stating "Please tell the store that you are using model A" is printed below the free code 71r.

[0051] Also, a compatible store list button 71u is provided so that stores that can use model A can be searched for. When the compatible store list button 71u is operated, a list of stores that have model A installed is displayed. The user can use the two-way communication service by selecting a desired store from the displayed list of stores and making a reservation.

[0052] Next, the process for acquiring a paid code will be described. When the My Code (paid) button 71b is operated on the main screen of Fig. 7(A) (S103: Yes), a My Code screen (paid) display process (S300) is executed.

[0053] 6 is a flow diagram showing the My Code screen (paid) processing according to this embodiment. When the My Code screen (paid) display processing (S300) starts, first, a My Code issuance screen is displayed on the display unit 71 of the mobile terminal (S301).

[0054] Fig. 8(A) is a diagram showing the My Code issuance screen. The My Code issuance screen has a paid code display area 712 and a back button 71e. When the back button 71e is operated (S303: Yes), the My Code screen (paid) display process (S300) is terminated, and the main screen of Fig. 7(A) is displayed (S101). The back button 71e has the same function on other screens such as Fig. 7(B) and Fig. 7(C).

[0055] The paid code display area 712 displays a title input field 712a, a paid code display field 712b, and a code issue button 712c. FIG. 8(A) shows the state before the paid code has been acquired, so the paid code display field 712b does not display a paid code (it displays "Not Purchased"). When the code issue button 712c is operated (S302: Yes), the selection screen of FIG. 7(B) is displayed (S304). The selection screen displays a location number / time selection button 71f, a confirmation / payment button 71g, and a back button 71e.

[0056] In this embodiment, the number of locations refers to the number of rooms (number of terminals) in a karaoke store that share a virtual room using the two-way communication service, and there are two options available in the number of locations / time selection button 71f: 10 rooms or less and 30 rooms or less. The time refers to the duration of connection to the virtual room, and there are two options available in the number of locations / time selection button 71f: 3 hours or less and 24 hours or less (a total of four options). The user can select the desired number of locations and time by selecting one of the multiple number of location / time selection buttons 71f displayed on the display unit 71. When the confirmation / payment button 71g is operated with the number of locations / time selection button 71f selected, confirmation / payment processing (S306) is executed.

[0057] In the confirmation and payment process (S306), the mobile terminal communicates with the management server 51 to confirm the selected number of locations and time, and to pay the fee (screen not shown). When the confirmation and payment process is completed (S307: Yes), the management server 51 transmits a pay code to the mobile terminal. The mobile terminal that has received the pay code displays the My Code (paid) screen shown in FIG. 8(C). The My Code (paid) screen has a pay code display area 712 and a back button 71e.

[0058] The paid code display area 712 is substantially similar to the free code display area 711 described in FIG. 7(B), and displays a title input field 712a, a paid code 712e, a URL display field 712g, and an SNS selection button 712d. The paid code display area 712 also displays a code discard button 712f. The user can use a paid two-way communication service by scanning the paid code 712e with the camera 17 of the remote control device 1. The user can transmit the paid code 712e to the other user with whom they want to share a virtual room by sending the URL displayed in the URL display field 712g by email or SNS.

[0059] In addition, in this embodiment, by operating the SNS selection button 712d, the user can easily transmit the paid code 712e to the other user sharing the virtual room. The SNS selection button 712d is provided for each type of SNS. By operating the desired SNS selection button 712d, the user can launch the SNS app and send a URL for obtaining the paid code 712e. Furthermore, by entering a title that the user wants to convey to the other user in the title input field 712a, the entered title can be displayed when the other user obtains the paid code 712e. In addition, in this embodiment, the paid code 712e has an expiration date. By operating the code discard button 712f, the purchased paid code can be discarded.

[0060] In the My Code screen (paid) display process shown in Figure 6, if the SNS selection button is operated (S310: Yes), the mobile device launches the selected SNS app (S311) and sends a URL for obtaining the paid code 712e to the SNS app (S312).

[0061] The screen appearance of the mobile terminal that has acquired the paid code 712e via an SNS app or the like is the same as that of the free code described in Fig. 10, and therefore will not be described here. On the other hand, when the code discard button 712f shown in Fig. 8(C) is operated (S313: Yes), the paid code 712e is discarded. Specifically, when the code discard button 712f is operated, an instruction to discard the paid code is sent to the management server 51, and processing to discard the paid code 712e managed by the management server 51 is executed.

[0062] The paid code 712d acquired in Fig. 8(C) can be confirmed and managed by operating the reservation list button 71c on the main screen in Fig. 7(A). If the purchase code list button 71c displayed in Fig. 7(A) is operated during the screen display processing of Fig. 4 (S104: Yes), a purchase code list display process (S105) is executed.

[0063] Fig. 9(A) is a diagram showing the purchase code list screen (unused state), and Fig. 9(B) is a diagram showing the purchase code list screen (used state). Fig. 9(A) is the screen before a paid code is used, and displays a code-related information display field 71h and a back button 71m. The code-related information display field 71h displays related information 71i and a code display button 71k. The related information 71i displays the title entered in the title input field 712a in Fig. 8(C), the usage status of the paid code (unused), and the expiration date of the paid code.

[0064] When the code display button 71k is operated, the pay code 712e displayed in the pay code display area of Fig. 8(C) is displayed (not shown) on the display unit 71. When the back button 71m is operated (S106: Yes), the screen returns to the main screen of Fig. 7(A) (S101).

[0065] On the other hand, when a pay code is used to receive a two-way communication service, the pay code is considered to have been used. Figure 9(B) shows the screen after the pay code has been used, in which a code-related information display field 71h and a back button 71m are displayed. Related information 71i and a delete button 71n are displayed in the code-related information display field 71h.

[0066] 8(C), the usage status (used), and the period during which the two-way communication service was used. When the Delete button 71n is operated, the code related information display field 71h of the paid code for which the Delete button 71n was operated is deleted from the purchase code list screen of the display unit 71.

[0067] In this manner, in this embodiment, it is possible to use the purchase code list screen to check the contents of pay codes, display pay codes, and perform various other management functions.

[0068] The above has described the acquisition and management of free codes and paid codes. A user will use the acquired free codes and paid codes to receive two-way communication services. FIG. 11 is a flow diagram showing two-way communication processing according to this embodiment. A user starts two-way communication processing in the program of the karaoke device 2 by selecting a menu displayed on the remote control device 1. When the two-way communication processing starts, a reading instruction screen shown in FIG. 12 is displayed on the touch panel monitor 11 of the remote control device 1 (S401). The reading instruction screen displays how to read the code (two-dimensional code) acquired by the user.

[0069] In this embodiment, the user displays the acquired code (a free code or a paid code) on a mobile terminal such as a smartphone. The code may be displayed on the mobile terminal or may be printed out and used. The code displayed on the mobile terminal is read using the camera 17 provided in the remote control device 1. Reading of the code is started by operating the read button 112.

[0070] When read button 112 is operated on the reading instruction screen shown in Fig. 12, the code reading screen shown in Fig. 13 is displayed (S402). On this code reading screen, an image captured by camera 17 is displayed on touch panel monitor 11. A code reading range 113 is displayed on touch panel monitor 11, and the user adjusts the positional relationship between the mobile terminal and remote control device 1 so that the code displayed on the mobile terminal is displayed within this code reading range 113.

[0071] When the code is displayed within the code reading range 113 and the remote control device 1 recognizes the code, the remote control device 1 reads the code information contained in the code (S403). The remote control device 1 checks with the management server 51 via the program of the karaoke device 2 whether the read code information is valid (S404). The program of the karaoke device 2 receives information about the code information from the management server 51, and if the program receives an indication that the code information is valid (S405: Yes), it executes processing according to the information contained in the information about the code information from the management server 51 indicating whether the code is free or paid (S407).

[0072] On the other hand, if the remote control device 1 receives from the management server 51 a message indicating that the code information is invalid (S405: No), the remote control device 1 displays an error message on the touch panel monitor 11 (S406), and the two-way communication process ends.

[0073] If the karaoke machine 2 has a toll-free code (S407: toll-free), the karaoke machine 2 connects to the first server 52a for communication (S408). As described above, the first server 52a, which executes processes related to the two-way communication service using the toll-free code, executes processes necessary to start two-way communication, such as allocating a virtual room, but does not execute video and audio communication between the karaoke machines 2. Therefore, video and audio communication is performed in a peer-to-peer format between the karaoke machines 2 without going through the first server 52a (S409).

[0074] After communication starts, two-way communication begins between the karaoke devices 2 participating in the virtual room by connecting to the virtual room (S410). Note that in two-way communication services using free codes, the number of connectable locations (number of terminals) is limited to three (n). Therefore, if a fourth karaoke device 2 attempts to connect for two-way communication, the connection for two-way communication from the fourth karaoke device 2 is rejected.

[0075] Fig. 14 shows the monitor 41 display when using a two-way communication service (free or paid). The state in Fig. 14 is two locations (two karaoke machines 2 participating in the two-way communication service). Fig. 14(A) shows the monitor 41 on the side where music playback processing is being performed using the karaoke machine 2.

[0076] Monitor 41 displays an image display field (other party) 411 in which an image transmitted from the other party's karaoke system is displayed, and an image display field (self) 412 in which an image of the user himself / herself captured by camera 17 provided on remote control device 1 or a camera installed in a room of the store is displayed. Also, lyrics 413 are displayed on monitor 41 on the side performing the music playback process. Also, voice input from singing microphones 43a, 43b on the other party or microphone 18 provided on remote control device 1 is output from speaker 42.

[0077] 14(B) shows the monitor 41 on the side listening to the singing. An image display field (other person) 411 and an image display field (self) 412 are also displayed on the monitor 41 on the side listening to the singing. In this embodiment, lyrics 413 are not displayed on the monitor 41 on the side of the audience. By not displaying lyrics 413, it is possible to enjoy the singing on the image display field (other person) 411 without being disturbed by the display of lyrics 413. Instead of this configuration, lyrics 413 may be displayed on the monitor 41 on the side of the audience, from the viewpoint of enjoying karaoke together.

[0078] In this way, with the two-way communication service, it is possible to hear the video and audio of the other party with whom the communication connection is established, and to enjoy conversation and karaoke together. Note that Fig. 14 illustrates the monitor 41 in a two-point two-way communication service; in the case of three or more points, an image display field (other party) 411 corresponding to the number of points is displayed. If an end operation is performed using a user interface such as the remote control device 1 during two-way communication using a free code (S411: Yes), the two-way communication connection is terminated (S417).

[0079] On the other hand, in the case of two-way communication using a pay code (S407: pay), the program of the karaoke machine 2 connects to the second server 52b for communication (S412). In this embodiment, after connecting to the second server 52b, the pay code is considered to have been used. The karaoke machine 2 notifies the management server 51 that the pay code has been used, and records the date and time when the pay code began to be used.

[0080] As described above, the second server 52b, which executes processes related to the paid two-way communication service, executes processes necessary for starting two-way communication, such as allocation of a virtual room, and executes video and audio communication between the karaoke devices 2. Therefore, video and audio communication between the karaoke devices 2 is performed via the second server 52b (S413).

[0081] After communication starts, two-way communication begins between the karaoke devices 2 participating in the virtual room by connecting to the virtual room (S414). In a two-way communication service using a paid code, a limit is set on the number of locations (number of terminals) according to the purchased paid code. Therefore, if the (n+1)th karaoke device 2 attempts to establish a two-way communication connection, the two-way communication connection of the (n+1)th karaoke device 2 will be rejected.

[0082] The state of the monitor 41 for the two-way communication service in the case of a pay code is the same as that shown in Figures 14(A) and 14(B), and therefore will not be described here. During two-way communication using a pay code, if an end operation is performed using a user interface such as the remote control device 1 (S415: Yes), or if the validity period of the pay code has expired (the end time has arrived) (S416: Yes), the two-way communication connection is terminated (S417). When the two-way communication connection is terminated, the karaoke device 2 notifies the management server 51 that the two-way communication using the pay code has ended. The management server 51 records the date and time when the use of the pay code ended.

[0083] The two-way communication system of this embodiment has been described above, but the present invention is not limited to the above-described embodiment and various modifications can be adopted. Various modifications will be described below.

[0084] [First Modification] In the above-described embodiment, when a free code is used, the number of connectable locations (number of terminals) is limited to three. Therefore, if an attempt is made to connect two-way communication beyond the number of connectable locations, the karaoke machine 2 attempting to connect is rejected. Alternatively, if an attempt is made to connect two-way communication beyond the number of connectable locations, a paid code may be purchased so that the karaoke machine 2 attempting to connect two-way communication is not rejected and the new karaoke machine 2 is allowed to connect two-way communication.

[0085] For example, if connection is refused, a switching notification process to notify the user that a service will be switched to one that uses a paid code is displayed on the karaoke machine 2 currently in use, or on the remote control device 1, or on the mobile terminal that sent the free code. The user purchases a paid code using the mobile terminal, karaoke machine 2, remote control device 1, etc., and then has the remote control device 1 read the purchased code, thereby executing a switching process to switch to a paid two-way communication service.

[0086] [Second Modification] In the above-described embodiment, the pay code is considered as used immediately after it is started to be used. In addition to this configuration, the pay code may be considered as used after a predetermined time (e.g., 10 minutes) has elapsed since its start of use and two-way communication has been used. According to this configuration, if, for example, a user is unable to fully enjoy two-way communication services due to a network line malfunction, the user can easily take measures such as changing the karaoke machine 2 by moving to another room in the same store.

[0087] [Third Modification] In the above-described embodiment, two types of two-way communication services, a free code and a paid code, are employed, and the peer-to-peer two-way communication service using the first server 52a is free. However, this peer-to-peer two-way communication service using the first server 52a may also be charged. In this case, the fee for the peer-to-peer two-way communication service using the first server 52a may be set lower than the fee for the two-way communication service using the second server 52b.

[0088] [Fourth Modification] In the above embodiment, a two-way communication service between karaoke machines 2 has been described. The terminal used for the two-way communication service can be not only the karaoke machine 2 but also various other terminals. Various terminals such as a personal computer, a game device, a smartphone, and a tablet can be used as the terminal.

[0089] [Fifth Modification] In the above-described embodiment, when the validity period of the paid code expires (the expiration time arrives), the two-way communication connection is terminated. However, a notification of the expiration of the paid period may be sent a predetermined time before the expiration of the validity period of the paid code, and an operation to extend the validity period may be accepted.

[0090] [Sixth Modification] In the above-described embodiment, when the code discard button 712f is operated, a pay code discard instruction is sent to the management server 51, and the management server 51 executes the process of discarding the pay code 712e managed by the management server 51. It is also possible to accept changes to the number of connection points and duration before using a purchased pay code. Specifically, a setting change button may be provided in the code-related information display field 71h shown in FIG. 9(A), which accepts changes to the number of connection points and duration of the purchased code and charges or refunds the difference. Alternatively, it is also possible to accept an extension of the expiration date of use. In this case, a fee for the extension will be charged.

[0091] The two-way communication system of the present embodiment has been described above, but the two-way communication system of the above-mentioned embodiment is configured to include at least various terminals that perform two-way communication, such as the karaoke machine 2. In addition, the program that is executed on various terminals, such as the karaoke machine 2, and that realizes two-way communication also falls within the scope of the present invention. [Explanation of symbols]

[0092] 1: Remote control device 71c: Purchase code list button 2(a~k): Karaoke device 71d: Logout button 6:Administrative computer 71e:Back button 10a: Control unit 71f: Time selection button 10b: Memory 71g: Payment button 10c: Video control section 71h: Code related information display section 10d: Acoustic control section 71i: Related information 10e:Video RAM 71k:Code display button 11: Touch panel monitor 71m: Back button 11a: Display 71n: Delete button 11b: Touch panel 71o: Message display area 12: Operation processing section 71p: Self message display section 13: Operation section 71q: Title 14:Speaker 71r:Free Code 16: Wireless LAN communication section 71s: URL display field 17: Camera 71t: SNS selection button 18:Mic 71u:Supported store list button 20: Control unit 110(a-c): Access point 21: Operation unit 110c: Access point 22: Operation processing unit 112: Read button 24: LAN communication unit 113: Code reading range 25: Acoustic control unit 120(a-c): Router 26: HDD 121(a~c): Optical modem 27: Memory 413: Lyrics 28: Video RAM 711: Free code display area 29: Video playback section 711a: Title input field 30: Video control unit 711b: Free code 31: Touch panel monitor 711c: URL display field 31a: Display 711d: SNS selection button 31b: Touch panel 711e: Code change button 41(a~k): Monitor 712: Paid code display area 42: Speaker 712a: Title input field 43a, 43b: Singing microphone 712b: Paid code display column 51: Management server 712c: Code issue button 52a: First server 712d: SNS selection button 52b: Second server 712e: Paid code 71: Display 712f: Code discard button 71a: My Code (free) button 712g: URL display field 71b: My Code (paid) button

Claims

1. A two-way communication system for two-way communication using audio and video between multiple terminals, A selection process is executed in which the user selects the first service or the second service; The first service limits the number of terminals that can be connected to communication to n or less, The second service has a limit of (n+1) or more terminals that can be connected for communication. Two-way communication system.

2. The service fees for the first and second services are different 2. The two-way communication system according to claim 1.

3. The management server manages information related to the first service and the second service.

2. The two-way communication system according to claim 1.

4. In the first service, when the number of terminals connected for communication is n or less, a connection availability notification process is executed to notify the terminal that the connection is available.

2. The two-way communication system according to claim 1.

5. The first service and the second service perform bidirectional communication using different communication methods.

2. The two-way communication system according to claim 1.

6. a switching notification process for notifying a user of a switching notification to the second service when there is a terminal requesting a number of connections exceeding a limit in the first service; and executing a switching process for switching from the first service to the second service in response to a user operation.

2. The two-way communication system according to claim 1.

7. The second service has a time limit for use.

2. The two-way communication system according to claim 1.

Images