Two-way communication system

Abstract

To achieve convenience in a two-way communication service as one object.SOLUTION: A two-way communication system includes a terminal device and a server, and enables two-way communication by voices, images, and videos between terminals. The terminal device comprises control means for transmitting identification information read by reading means to the server and setting it in a control form in two-way communication on the basis of notification information notified from the server. The server executes: specification processing for managing a plurality of services corresponding to the identification information and specifying one service from the plurality of services being a management object on the basis of the identification information received from the terminal device; and notification processing for notifying the terminal device of notification information corresponding to the service specified by the specification processing.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a two-way communication system that enables video, images, and audio to be transmitted between terminal devices. [Background technology]

[0002] Currently, two-way communication using various terminal devices such as personal computers is actively used in various industries. In two-way communication, video, images, and audio captured by a terminal can be transmitted to other terminal devices, enabling events such as web conferences. In web conferences, sharing video, images, and audio makes it possible to hold conferences and meetings between remote locations.

[0003] Patent Document 1 discloses that in a Web conference system using two-way communication, an event occurring in each room is detected and bandwidth control is performed within the range of the communication bandwidth allocated to each room. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-112845 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in web conferences and other similar services that use two-way communication, the service content is generally uniform, and it is not assumed that multiple services with different content will be provided. The inventors of the present application considered providing multiple services with different content when providing two-way communication services. They then discovered the need to provide different control modes for each service when providing multiple services with different content.

[0006] The present invention has been made in consideration of such circumstances, and one of its objects is to provide control appropriate to the services to be provided by changing the control mode for each service when providing multiple services in two-way communication. [Means for solving the problem]

[0007] Therefore, the two-way communication system according to the present invention employs the following configuration. A two-way communication system including a terminal device and a server, which enables two-way communication between the terminal devices using sound, images, and video, The terminal device a control means for transmitting the identification information read by the reading means to a server, and setting a control mode for two-way communication based on notification information notified from the server; The server Manage multiple services corresponding to identity information, an identification process for identifying one service from a plurality of services managed based on identification information received from the terminal device; A notification process is executed to notify the terminal device of notification information corresponding to the service identified in the identification process.

[0008] Furthermore, in the two-way communication system according to the present invention, The control means adjusts the screen layout to be displayed on the display unit of the terminal device based on the notified information.

[0009] Furthermore, in the two-way communication system according to the present invention, The control means sets sound-related control in the terminal device based on the notified information.

[0010] Furthermore, in the two-way communication system according to the present invention, The terminal device has a music playback function for playing back music information, The control means sets control relating to the music playback function based on the notified notification information.

[0011] Furthermore, in the two-way communication system according to the present invention, One of the services is a service that uses the host function, The control means enables control from the host when the service of the notified notification information is a service that uses a host function.

[0012] Furthermore, in the two-way communication system according to the present invention, The notification information is service identification information that identifies the service.

[0013] Furthermore, in the two-way communication system according to the present invention, The notification information is control information that indicates the content of control corresponding to the service. [Effects of the Invention]

[0014] According to the two-way communication system of the present invention, by setting a control mode for each service, it becomes possible to perform control suited to the service to be provided. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram showing a network configuration in a karaoke store. [Figure 2] 1 is a diagram showing the configuration of a karaoke system according to an embodiment of the present invention; [Figure 3] FIG. 1 is a diagram illustrating a communication configuration according to the present embodiment. [Figure 4] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 5] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 6] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 7] 10A to 10C are diagrams showing various screens of a mobile terminal according to the present embodiment; [Figure 8] FIG. 1 is a flowchart showing a two-way communication process according to the present embodiment. [Figure 9] FIG. 10 is a diagram showing a reading instruction screen according to the present embodiment; [Figure 10]FIG. 10 is a diagram showing a code reading screen according to the present embodiment; [Figure 11] Table for explaining various services and control settings according to this embodiment [Figure 12] FIG. 10 is a diagram showing a monitor screen during two-way communication according to the present embodiment; [Figure 13] FIG. 10 is a diagram showing a screen of the remote control device during two-way communication according to the embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0016] FIG. 1 shows an example of a network configuration in a karaoke store. Each room (karaoke room), from Room A to Room K, is equipped with karaoke machines 2a to 2k and monitors 41a to 41k. The karaoke machines 2a to 2k are connected to a LAN 100 via LAN cables to form a network. The LAN 100 is connected to the Internet via a router 120 and an optical modem 121, and can communicate with a server (not shown). In this network environment, the karaoke machines 2a to 2k can communicate with the server to download new song information or to manage user information, usage history, and the like on the server.

[0017] In this embodiment, by connecting to the karaoke devices 2a-2k of other stores or your own store, two-way communication is possible between the connected karaoke devices 2a-2k. In two-way communication, audio, images, and videos are transmitted and received between the connected karaoke devices 2a-2k, allowing users to enjoy conversation, singing, etc. with each other.

[0018] The remote control device 1, which outputs song selection instructions and various control commands to the karaoke device 2, is managed at a counter by a manager (also called an employee or staff member). Customers (users) who visit a karaoke store complete the necessary procedures at the counter, borrow a remote control device 1, and then move to the room instructed by the manager. The remote control device 1 has a wireless LAN function and is connected to a LAN 100 via one of the access points 110a, 110b, or 110c installed in the store, enabling it to communicate with the associated karaoke device 2.

[0019] A management computer 6 operated by a manager is also installed inside the counter. The management computer 6 is an information processing device that manages customers who visit the bar, and is capable of managing the number of customers entering each room, the time of arrival, the length of stay, the time of departure, the fee, etc. The management computer 6 is connected to a LAN 100, and is capable of communicating via the Internet or with the karaoke machines 2a to 2k installed in each room or the remote control device 1.

[0020] Fig. 2 is a diagram showing the configuration of a karaoke playback system according to an embodiment of the present invention. The karaoke system in this embodiment includes a karaoke device 2 and a remote control device 1. The karaoke device 2 and the remote control device 1 are connected for communication using a LAN 100 and an access point 110. Note that in Fig. 1, the karaoke devices 2a to 2k and the monitors 41a to 41k installed in each room are given suffixes a to k so that they can be identified, but in Fig. 2, the suffixes a to k are omitted.

[0021] The karaoke machine 2 is equipped with an audio control unit 25 having a music playback function. The karaoke machine 2 is equipped with an operation unit 21 as input means composed of switches and the like that accept various inputs from the user. The karaoke machine 2 is equipped with an operation processing unit 22 that interprets inputs from the operation unit 21 and transmits them to the control unit 20. The karaoke machine 2 also has an HDD 26 (hard disk) as storage means on the karaoke machine 2 side that stores various information. The karaoke machine 2 is equipped with a LAN communication unit 24 as communication means on the karaoke machine 2 side to connect to the LAN 100.

[0022] The karaoke device 2 also includes a video playback means for displaying images such as lyrics and background video on the monitor 41. The video playback means includes a video playback unit 29 for playing background video based on background video information, a video RAM 28 for temporarily storing the background video to be played, and a video control unit 30 for displaying lyrics superimposed on the played background video. The video control unit 30 may also have a function for applying visual effects to the background video.

[0023] Furthermore, the karaoke device 2 is capable of displaying various information on the touch panel monitor 31 in addition to the externally connected monitor 41. The touch panel monitor 31 is configured by superimposing a display section 31a that displays video information input from the video control section 30 and a touch panel 31b that outputs a touch input position to the operation processing section 22.

[0024] The touch panel monitor 31 can function as an operating means similar to the touch panel monitor 11, which is the operating means of the remote control device 1. The user can use the touch panel monitor 31 to select a song and make a reservation directly on the karaoke device 2, and the touch panel monitor 31 can function as an operating means equivalent to the remote control device 1.

[0025] Furthermore, the karaoke device 2 is equipped with a control unit 20, which is composed of a CPU and the like, as a control means for controlling each component in an integrated manner, and a memory 27 for temporarily storing information required for executing various programs.

[0026] With this configuration, the karaoke device 2 executes various processes, but its main functions include song selection and song playback. The song selection process is a process for specifying and reserving a song based on a user's specification, and is executed in cooperation with the remote control device 1. Reservation information including a song ID that identifies the song transmitted from the remote control device 1 is registered in a reservation table stored in the memory 27. The song playback process is a process for playing back song information based on the song ID of the reservation information registered in the reservation table, and is a process in which the performance process and the lyric playback process are executed synchronously.

[0027] The performance process for playing back a song is a process for causing the audio control unit 25 to play the performance information included in the song information. The performance information played by the audio control unit 25 is output from the speaker 42 together with the singing voice input from the singing microphones 43a and 43b. The lyric playback process is a process for providing singing assistance by displaying lyrics on the monitor 41 based on the lyric information included in the song information. A background video display process may be executed to superimpose a background video on the lyrics displayed in this lyric playback process.

[0028] Meanwhile, the remote control device 1 transmits various instructions, such as reservation information, to the karaoke device 2, and receives various information from the karaoke device 2 or various servers connected on the Internet. In this embodiment, the remote control device 1 is equipped with an operation unit 13 such as buttons as an interface, and a touch panel monitor 11. The touch panel monitor 11 is configured with a display unit 11a and a touch panel 11b, and displays various interfaces on the display unit 11a and is capable of receiving touch inputs from the user.

[0029] Furthermore, the remote control device 1 is configured with a memory 10b that stores a database required for music search, various programs, and various information generated as the programs are executed, and a control means on the remote control device 1 side for controlling these components in an integrated manner. The control means on the remote control device 1 side includes a control unit 10a consisting of a CPU etc., a video control unit 10c that forms images to be displayed on the display unit 11a, a video RAM 10e that temporarily stores the image information to be displayed, and an operation processing unit 12 that interprets input from an operation unit 13 and transmits it to the control unit 10a. Furthermore, an audio control unit 10d can output various audio signals to a speaker 14 and can also receive audio signals input from a microphone 18 based on the control of the control unit 10a.

[0030] Furthermore, the remote control device 1 of this embodiment has a camera 17 disposed on its housing above the touch panel monitor 11, which is capable of taking pictures or reading images. The remote control device 1 is wirelessly connected to an access point 110 via a wireless LAN communication unit 16, thereby being connected to a network formed by a LAN 100. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2. The karaoke device 2 can also be operated using a mobile device such as a smartphone carried by the user (customer). In this case, when the user visits the karaoke bar, the mobile device carried by the user is associated with the karaoke device 2.

[0031] Here, a description will be given of the process of associating the remote control device 1 with the karaoke device 2. The process of associating can be performed in two ways: (1) by a store employee in advance, or (2) by a customer.

[0032] In the case of (1), the remote control device 1 and the karaoke device 2 are associated in advance by an employee, and the store counter lends out the remote control device 1 associated with the karaoke device 2 installed in the room the customer will enter.

[0033] In the case of (2), the remote control device 1 rented at the counter is in a state where the association is cancelled, and when the customer enters the room, the association process is executed by the customer's operation, and the rented remote control device 1 is associated with the karaoke device 2 installed in the room.

[0034] In the karaoke system of this embodiment, the camera 17 and microphone 18 (or singing microphones 43a, 43b) provided on the remote control device 1 are used to perform two-way communication with another karaoke device 2 (or another information processing device), making it possible to enjoy conversation or singing with people in remote locations.

[0035] FIG. 3 is a diagram for explaining the communication configuration according to this embodiment. In the two-way communication system of this embodiment, three types of services A to C are provided. Each of the services A to C has a different control form for the karaoke machine 2 that functions as a terminal device in the two-way communication system. Services A and B are services provided separately by a host on the business side and a guest on the user side. Service C is a service provided between users.

[0036] In services A and B, hosts Ha and Hb participate in a two-way communication service using personal computers 82a and 82b at host homes A and B. For example, as shown in FIG. 3, host homes A and B are provided with personal computers 82a and 82b connected to optical modems 81a and 81b. Peripheral devices such as cameras 83a and 83b, monitors 84a and 84b, and headsets 85a and 85b are connected to the personal computers 82a and 82b, and hosts Ha and Hb can provide a two-way communication service by logging into the two-way communication system. Note that the devices used on the host side are not limited to the configuration shown in FIG. 3; various configurations are possible, such as using various cameras and microphones installed in a studio, or using a karaoke system installed in a store, as with the guests.

[0037] Each of the stores A and B is connected to the Internet by optical modems 121a and 121b. A management server 51 and a communication server 52 are provided on the Internet, and function as means for two-way communication between personal computers 82a and 82b installed in the host homes A and B and the karaoke machines 2 installed in each of the stores A and B. A mobile base station 83 is also connected to the Internet, allowing a mobile terminal 7 carried by a user to be connected to the Internet and communicate with the management server 51 and the like.

[0038] The management server 51 manages each of the services A to C provided by the two-way communication system. The management of each of the services A to C includes issuing a code (corresponding to "identification information") to the mobile terminal 7 or the like possessed by the user, managing the control mode of the karaoke machine 2 corresponding to the services A to C, the expiration date of the code, the validity of the code, the code usage history, and managing the association between the code and one of the services A to C.

[0039] Next, the acquisition of a code used to perform a two-way communication service will be described. Figures 4 to 7 are diagrams showing various screens displayed on the display unit 71 of the mobile terminal 7. In this embodiment, the user uses the mobile terminal 7 owned by the user to acquire a code for performing a two-way communication service.

[0040] In this embodiment, the user executes a predetermined program (application) on the mobile terminal 7, or connects to a predetermined website using a browser, causing the main screen shown in FIG. 7(A) to be displayed on the display unit 71. The user can manage his / her own information by obtaining an account in advance and logging in. The state in FIG. 7(A) shows the state in which "Tenkyo Taro" has logged in.

[0041] The main screen is provided with a reservation button 71a, a code purchase button 71b, a code list button 71c, and a logout button 71d. Services A and B provided in this embodiment are services for which the date and time of use are specified. Therefore, a user can use services A and B by making a reservation for the use of the service. When the reservation button 71a is operated, the service selection screen shown in FIG. 7(B) is displayed.

[0042] The service selection screen displays summary display fields 711a and 711b for service A or service B provided to users (guests) by the karaoke system operator. The summary display field 711a displays the title, date, and duration of service A. The summary display field 711b displays the title, date, and duration of service B.

[0043] In addition, a confirmation details button 71f is displayed at the bottom right of the summary display fields 711a and 711b, and the user can confirm the details and proceed to the service reservation process by operating the confirmation details button 71f. In addition, a search button 71e is provided above the service selection screen. When the search button 71e is operated, the search screen shown in Figure 7(C) is displayed.

[0044] The search screen is provided with a maximum charge input field 71g, a service selection field 71h, date input fields 71i and 71j, time input fields 71k and 71l, and a details input field 71m. The user can input desired conditions into these input fields 71g to 71m and operate the search button 71n to search for services that meet the conditions. The search results are displayed in summary display fields 711a and 711b, similar to the service selection screen in FIG. 7(B).

[0045] Fig. 5(A) is a diagram showing a service details screen that is displayed when the details confirmation button 71f in the overview display field 711a (service A) is operated on the service selection screen of Fig. 4(B). The service details screen displays a service content display field 712 and a back button 71o.

[0046] The service content display field 712 displays the title of service A, "Let's play with XX," the date and time of the event, as well as detailed service information 712a such as thumbnail images, and a confirmation / payment button 712b. After checking the content of service A, the user operates the confirmation / payment button 712b to perform payment processing on a payment screen (not shown) or the like, and completes the reservation for service A.

[0047] The process for reserving service B is similar to that for reserving service A. On the service selection screen in Fig. 7(B), the user operates the details confirmation button 71f in the summary display field 711b (service B) to display the service details screen and perform payment processing, thereby completing the reservation for service B.

[0048] The codes for service A and service B for which reservations have been completed can be confirmed by operating the code list button 71c in Fig. 4(A). Fig. 6(A) is a diagram showing the code list screen that is displayed when the code list button 71c is operated. The code list screen displays summary display fields 713a to 713c. The code list screen here shows the state in which a code corresponding to one of services A to C has been obtained.

[0049] Note that Fig. 6(A) shows the chord list screen beyond the display area of the display unit 71, and is therefore longer in height than the other screens of the display unit 71. When the chord list screen is actually displayed beyond the display area of the display unit 71, it is possible to view the entirety of Fig. 6(A) by scrolling the display.

[0050] On the code list screen, a summary display field 713a is a field that shows a summary of service A. The summary display field 713a displays the title, event date, event time, and code display button 71r. On the code list screen, a summary display field 713b is a field that shows a summary of service B. The summary display field 713b displays the title, event date, event time, and code display button 71r. When the user operates the code display button 71r, the code display screen shown in FIG. 6(B) is displayed on the display unit 71.

[0051] Fig. 6(B) shows the code display screen when the code display button 71r in the summary display field 713a (service A) is operated. The code display screen displays a code display area 714 and a back button 71o. Operating the back button 71o returns to the code list screen in Fig. 6(A) or the main screen in Fig. 4(A). Similarly, the back button 71o provided on other screens has the function of returning to the screen that was displayed immediately before the currently displayed screen or the main screen in Fig. 4(A).

[0052] The title, event date, event time, code 714a, and participating store list button 714b are displayed in the code display area 714. The user can use the two-way communication service (service A) by displaying this code display screen on the mobile terminal 7 and having the karaoke system read the code 714a.

[0053] Furthermore, the two-way communication service can only be used in stores that have a compatible karaoke system installed. Therefore, a compatible store list button 714b is provided so that stores that can use the compatible karaoke system can be searched for. When the compatible store list button 714b is operated, a list of stores that have installed models that are compatible with the two-way communication service is displayed. The user can use the two-way communication service by selecting the desired store from the displayed list and making a reservation.

[0054] The code display for service B is similar to that for service A. On the code list screen, the user can operate the code display button 71r in the summary display field 713b to display the code display screen for service B.

[0055] Next, we will explain how to obtain a code for service C. As mentioned above, service C is a service that allows two-way communication between users, whereas services A and B are services hosted by hosts Ha and Hb. Therefore, service C does not require a reservation by specifying a date and time, and can be used by sharing a code between users.

[0056] On the main screen of FIG. 4(A), a user who uses service C purchases a code by operating the code purchase button 71b. In this embodiment, use of service C is subject to a fee, but it may be free of charge. When the code purchase button 71b is operated, the service content selection screen shown in FIG. 5(B) is displayed. The service content selection screen displays a location number / time selection button 71p, a confirmation / payment button 71q, and a back button 71o.

[0057] In this embodiment, the number of locations refers to the number of rooms (number of terminals) in a karaoke store that share a virtual room using a two-way communication service, with two options available: 10 rooms or less and 30 rooms or less. The time refers to the duration of connection to the virtual room, with two options available on the number of locations / time selection button 71p: within 3 hours and within 24 hours (four options in total).

[0058] The user can select the desired number of locations and time by selecting one of the multiple location number / time selection buttons 71p displayed on the display unit 71. When the location number / time selection button 71p is selected and the confirmation / payment button 71q is operated, the confirmation / payment process is executed.

[0059] In the confirmation and payment process, the mobile terminal 7 communicates with the management server 51 to confirm the selected number of locations and time, and to pay the fee (screen not shown). Once the confirmation and payment process is complete, the mobile terminal 7 can display a code for using service C.

[0060] Fig. 6(A) shows the code list screen after a code has been acquired for service C. The code list screen displays a summary display field 713c for service C. In summary display field 713c, the user can see that no title has been assigned (No Title), that the code has not yet been used, and the code display button 71r. To display the code for service C, the user operates the code display button 71r to display the code display screen shown in Fig. 6(C).

[0061] The code display screen in Fig. 6(C) displays a code display area 715 and a back button 71o. The code display area 715 displays a title input field 715a, a code 715b, a URL display field 715c, an SNS selection button 715d, and a list of participating stores button 715e. The user can use service C by having the camera 17 of the remote control device 1 read the code 715b. The user can communicate the code 715b to the other user with whom they want to share the virtual room by sending the URL displayed in the URL display field 715c by email or via SNS.

[0062] In this embodiment, by operating the SNS selection button 715d, the user can easily transmit the code 715b to the other user with whom the virtual room is shared. The SNS selection button 715d is provided for each type of SNS. By operating the desired SNS selection button 715d, the user can launch the SNS app and transmit a URL for acquiring the code 715b.

[0063] Furthermore, by inputting a title that you want to convey to the other user in the title input field 715a, the input title can be displayed when the other user acquires the code 715b.

[0064] When the SNS selection button 715d is operated, the mobile terminal 7 starts the selected SNS application and transmits a URL for acquiring the code 715b to the SNS application.

[0065] 7(A) is a diagram showing the screen of the mobile terminal 7 of the other user who has received the URL for acquiring the code 715b in the SNS app. The other user's message display field 71s displays a message received from Tokkyo Taro, the user in FIG. 6(C). The user's own message display field 71t displays a message sent in reply to Tokkyo Taro.

[0066] The other party message display field 71s, which is the second from the top in Fig. 7(A), displays the URL displayed in the URL display field 715c or the URL entered by operating the SNS selection button 715d. When the URL displayed in the other party message display field 71s is touched, the browser starts, the URL is accessed, and the shared code display screen shown in Fig. 7(B) is displayed.

[0067] The shared code display screen displays a title 71u (the character string entered in the title input field 715a in FIG. 6(C)), a code 71v, a URL display field 71w, an SNS selection button 71x, and a list of participating stores button 71y. The user who receives the code 71v can have the camera 17 of the remote control device 1 read the code 71v, thereby enabling the use of a two-way communication service between the karaoke machine 2 used by Tokkyo Taro, who is the sender of the code, and the karaoke machine 2 used by the user who received the code 71v.

[0068] Furthermore, a user who receives code 71v can share the URL displayed in URL display field 71w with others, or can allow additional users to participate in the two-way communication service by operating SNS selection button 71x. In this embodiment, the user must go to a karaoke store and specify a model of karaoke machine 2 that can use the two-way communication service. For this reason, a note stating "Please tell the store that you are using model A" is printed below code 71v.

[0069] Also, a compatible store list button 71y is provided so that a search can be made for stores that can use model A. The function of the compatible store list button 71y is the same as the function of the compatible store list button 715e described in FIG.

[0070] The above has described how codes are obtained and managed for each service. Users will use the obtained codes to access two-way communication services. Figure 8 is a flow diagram showing two-way communication processing executed in the karaoke system according to this embodiment. The user starts two-way communication processing in the program of the karaoke device 2 by selecting a menu displayed on the remote control device 1. When the two-way communication processing starts, a reading instruction screen shown in Figure 9 is displayed on the touch panel monitor 11 of the remote control device 1 (S101). The reading instruction screen displays how to read the code (two-dimensional code) obtained by the user.

[0071] In this embodiment, the user displays the acquired code on a mobile terminal 7 such as a smartphone. The code may be displayed on the mobile terminal 7 or may be printed out and used. The code displayed on the mobile terminal 7 is read using the camera 17 provided in the remote control device 1. Reading of the code is started by operating the read button 112.

[0072] When the read button 112 is operated on the reading instruction screen shown in Fig. 9, the code reading screen shown in Fig. 10 is displayed (S102). On the code reading screen, an image captured by the camera 17 is displayed on the touch panel monitor 11. A code reading range 113 is displayed on the touch panel monitor 11, and the user adjusts the positional relationship between the mobile terminal 7 and the remote control device 1 so that the code displayed on the mobile terminal 7 is displayed within this code reading range 113.

[0073] When the code is displayed within the code reading range 113 and the remote control device 1 recognizes the code, the remote control device 1 reads the code information contained in the code (S103). The remote control device 1 transmits the read code to the management server 51 via a program in the karaoke device 2 (S104). Based on the received code information, the management server 51 checks the validity of the code information and which service (any of services A to C) the code information is associated with, and transmits notification information to the karaoke system. The notification information in this embodiment includes service identification information indicating whether the code information is valid or not, and, if the code information is valid, indicating service A to C.

[0074] The karaoke system receives the notification information from the management server 51 (S105: Yes), and if the code information is valid (S106: Yes), it checks which service the notification information indicates.

[0075] If the notification information indicates service A (S107: Yes), the karaoke system is set to the first control (S111). If the notification information indicates service B (S109: Service B), the karaoke system is set to the second control (S111). If the notification information indicates service C (S109: Service C), the karaoke system is set to the third control (S112). In this manner, in this embodiment, when using the two-way communication service, the karaoke system is set to the first to third control corresponding to each of services A to C. The settings of the first to third controls corresponding to each of services A to C will be explained later.

[0076] The user can use the service with the karaoke system by simply having the karaoke system read the code without being aware of the service they are using, and can also set the first to third control modes appropriate for that service.

[0077] On the other hand, if the code information is invalid (S106: No) received from the management server 51, an error message is displayed on the touch panel monitor 11 of the remote control device 1 (S108), and the two-way communication process ends.

[0078] After setting the first to third control modes (S110 to S112), the karaoke device 2 connects to the communication server 52 for communication (S113). After starting communication with the communication server 52, the karaoke system connects to the virtual room (S114), thereby starting two-way communication between the karaoke device 2 and the personal computers 82a and 82b participating in the virtual room.

[0079] Thereafter, if it is determined that the two-way communication is to be terminated (S115: Yes), that is, if a quit operation is performed on the user side or on the other side (the other user or the host) that is the connection destination, the communication connection is terminated (S116). Then, the first to third control settings are returned to the initial settings (S117), and the two-way communication process is terminated. In this way, in the two-way communication process of this embodiment, the karaoke system is set to the first to third controls corresponding to services A to C, so that it is possible to perform control according to services A to C.

[0080] Next, the first to third control setting contents corresponding to each of services A to C will be explained. In this embodiment, control settings corresponding to services A to C are made. FIG. 11 is a table for explaining various services and control settings according to this embodiment, and is a table for explaining the control settings of the karaoke system corresponding to each of services A to C. Service A is a service provided with a host function. As an example of service A, a singer, artist, talent, etc. may be used as a host, and online interaction (fan meeting) between the host and users (guests) who are fans of the host may be considered.

[0081] Service A has a date and time specification and is held at a predetermined date and time. As mentioned above, a user can participate in the two-way communication service of Service A by reserving Service A in advance. The screen layout on the user (guest) side uses the lesson view shown in Figure 12(A).

[0082] 12(A), in the lesson view, a first video display area 411 is provided in the center of the screen of monitor 41. In addition, a plurality of second video display areas 412a to 412e are provided at the bottom of the screen. In the lesson view, for example, it is conceivable that a video of the host is displayed in first video display area 411, and videos of participating guests are displayed in second video display areas 412a to 412e.

[0083] Note that the video displayed in the first video display area 411 may be controlled by the host side using the host function. For example, displaying a video of a guest speaking can increase the guest's sense of participation in the event. Microphone volume control in Service A differs between the host side and the guest side. Note that microphone volume control targets the volume of the microphone audio signal transmitted from the karaoke system, and includes muting to set the volume to 0.

[0084] The host can mute all guests (everyone) to set their microphone volume to 0, and can also unmute all guests. In events with many guests, controlling the volume all at once in this way can facilitate the progress of the event. It is also possible to mute each guest individually to set their microphone volume to 0, and unmute each guest individually.

[0085] For example, if a guest participating in an event disrupts the event by making inappropriate remarks or other audio disturbances, the guest's microphone can be muted individually to ensure the event proceeds smoothly. Regarding guest microphone volume control in Service A, the volume control settings made by the host cannot be changed. However, volume control that is made voluntarily by the guest, such as muting the audio on the guest side, to set the volume to 0, may be changeable.

[0086] The breakout room function allows the host to select one or more guests from among the participating guests and have a conversation using video, images, and audio only between the host and the selected guests. Service A makes this breakout room function available. At fan meetings, the breakout room function allows for conversations to be held only between the host and the selected guests.

[0087] Karaoke systems are equipped with a music playback function that plays music information. However, at fan meetings and other events, guests using the music playback function without permission could be disruptive to the event. For this reason, Service A does not allow guests to use the music playback function.

[0088] Next, the control settings for Service B will be described. Service B is a service that is equipped with a host function. Service B can be, for example, singing lessons by a host, or a host participating in a party for guests as an MC. Service B has a date and time specification, and is held at a predetermined date and time. By reserving Service B in advance, a user can participate in the two-way communication service of Service B.

[0089] The screen layout on the user (guest) side uses the lesson view shown in Figure 12(A). Regarding microphone volume control, the host can only mute (and unmute) each guest individually, setting the microphone volume to 0; he cannot mute (and unmute) all guests. As with Service A, guests cannot change the microphone volume control settings made by the host.

[0090] In this way, in Service B, as in Service A, the host has the right to control the volume of the guest's microphone, allowing the host to ensure the smooth progress of the event. Service B does not allow the breakout room function that was available in Service A. The guest's music playback function can only be controlled from the host, and the guest cannot control or set the music playback function. The host can reserve songs on the guest's karaoke system and control the playback of songs during lessons or parties.

[0091] Next, the control settings for service C will be described. Service C is a service that does not have a host function and allows two-way communication between users. Service C can be used, for example, for users to converse with each other or to enjoy singing together by playing music. As mentioned above, service C is a two-way communication service that is performed by users sharing a code and starting two-way communication at the same time. Therefore, no date and time specification is provided.

[0092] The screen layout uses the gallery view shown in Fig. 12(B). As shown in Fig. 12(B), in the gallery view, individual video display areas 413a to 413h are arranged in a grid pattern. Videos of users participating in service C are displayed in individual video display areas 413a to 413h. Regarding microphone volume control, service C allows the setting of volume control for its own microphone, but does not allow the setting of volume control for the other party's microphone.

[0093] Service C does not allow for the breakout room function. As for the music playback function, it is possible to reserve songs and set music playback control settings for your own karaoke system, just like a regular karaoke system. Possible music playback control settings include stopping (ending) the performance, pausing, and changing the pitch. It is also possible to reserve songs and control music playback for the other karaoke system participating in the two-way communication.

[0094] A user can designate a user who will execute control settings among the other users participating in the two-way communication, and can reserve songs and control song playback for the karaoke system used by the designated user. By being able to control the other user's karaoke system in this way, a user can request songs that they would like the other user participating in the two-way communication to sing. Note that some of the song playback control functions for the karaoke system used by the other user participating in the two-way communication may not be controllable.

[0095] 13 is a diagram showing the screen of the remote control device 1 when using the two-way communication service according to this embodiment, showing the screen of the remote control device 1 when using service C. The screen has a first display field 115 and a second display field 116. The first display field 115 is an operation area mainly used for playing music. By operating various buttons displayed in the first display field 115, the user can reserve music and control the playback of music that is being played.

[0096] The second display field 116 is an operation area used during two-way communication. The second display field 116 displays a communication status display field 116a, a service content display field 116b, a mute button 116c, a video stop button 116d, a participant confirmation button 116e, an exit button 116f, and a volume control field 116g. The communication status display field 116a is a field that indicates the communication status of two-way communication, and in Fig. 13 it shows that the communication is connected (two-way communication is in progress).

[0097] The service content display field 116b is a field that displays information about the service being used, and in Fig. 13, for service C, the title (the character string entered in the title input field 715a in Fig. 6(C)) and the user names of users who will participate with a common code are displayed. The mute button 116c is a button that sets the volume of the audio to be transmitted to the other party to 0. The video stop button 116d is a button that stops the video to be transmitted to the other party.

[0098] The participant confirmation button 116e is a button for displaying details of users participating in two-way communication using a common code. The exit button 116f is a button for stopping and terminating the use of two-way communication. The volume control field 116g displays a minus button 116h to the left for lowering the volume, a plus button 116i to the right for raising the volume, and the set microphone volume is displayed in the center. By using the volume control field 116g, the user can adjust and check the volume of the audio to be transmitted to the other party.

[0099] The screen of the remote control device 1 shown in Fig. 13 is the screen that is displayed when service C is used. On the other hand, for services A and B described in Fig. 11 etc., some of the guest side functions are restricted, and only the host side can control and set them. Therefore, when using services A and B, it is conceivable to hide some of the various buttons of the remote control device 1 displayed in Fig. 13 or to control them so that they cannot be used.

[0100] Although the two-way communication system of this embodiment has been described above, the present invention is not limited to the above-described embodiment and various modifications can be adopted. Various modifications will be described below.

[0101] [First Modification] In the above-described embodiment, the management server 51 transmits notification information including service identification information indicating services A to C to the karaoke system. The karaoke system that receives the notification information sets the control setting corresponding to the received service identification information to one of the first to third controls, thereby performing two-way communication using the functions shown in FIG. 11. Alternatively, the notification information may include control information corresponding to services A to C. In this configuration, the management server 51 can manage the control information corresponding to services A to C, making it possible to flexibly and quickly handle the control information.

[0102] [Second Modification] In the above-described embodiment, as explained in Fig. 11 etc., various control settings are different for services A to C. The types of services and their settings are not limited to the above-described services A to C and the contents of their control settings, and it is possible to provide further types of services and to provide the contents of their control settings.

[0103] The two-way communication system of the present embodiment has been described above, and the two-way communication system of the above-mentioned embodiment is configured to include at least various terminal devices, such as the karaoke machine 2, that perform two-way communication. Furthermore, the terminal device is not limited to the karaoke machine 2, and terminal devices that enable two-way communication, such as personal computers and game devices, also fall within the scope of the present invention. Furthermore, programs that are executed on various terminal devices, such as the karaoke machine 2, and that realize two-way communication also fall within the scope of the present invention. [Explanation of symbols]

[0104] 1: Remote control device 71p: Number of bases and time selection button 2(2a~2k): Karaoke device 71q: Confirmation and payment button 6:Administrative computer 71r:Code display button 7: Mobile device 71s: Message display field 10a: Control unit 71t: Self message display field 10b:Memory 71u:Title 10c: Video control unit 71v: Code 10d: Sound control section 71w: URL display section 10e:Video RAM 71x:SNS selection button 11: Touch panel monitor 71y: Supported store list button 11a: Display unit 81a, 81b: Optical modem 11b: Touch panel 82a, 82b: PC 12: Operation processing unit 83: Mobile base station 13: Operation unit 83a, 83b: Camera 14: Speaker 84a, 84b: Monitor 16: Wireless LAN communication unit 85a, 85b: Headset 17: Camera 110 (110a~110c): Access point 18: Microphone 112: Read button 20: Control unit 113: Code reading range 21: Operation section 115: 1st display column 22: Operation processing unit 116: Second display column 24: LAN communication section 116a: Communication status display field 25: Sound control section 116b: Service content display section 26: HDD 116c: Mute button 27: Memory 116d: Video stop button 28: Video RAM 116e: Participant confirmation button 29: Video playback section 116f: Exit button 30: Video control section 116g: Volume control section 31: Touch panel monitor 116h: Minus button 31a: Display 116i: Plus button 31b: Touch panel 120 (120a, 120b): Router 41 (41a to 41k): Monitor 121 (121a, 121b): Optical modem 42: Speaker 411: First video display area 43a, 43b: Singing microphone 412a to 412e: Second image display area 51: Management server 413a to 413h: Individual video display area 52: Communication server 711a: Summary display column 71:Display section 711b:Summary display field 71a: Reservation button 71x: SNS selection button 71b: Code purchase button 712: Service details display field 71c: Code list button 712b: Confirmation and payment button 71d: Logout button 713a~713c: Summary display field 71e: Search button 714: Code display area 71f:Details confirmation button 714a:Code 71g: Maximum price input field 714b: List of participating stores button 71h: Service selection field 715: Code display area 71i, 71j: Date input field 715a: Title input field 71k, 71l: Time input field 715b: Code 71m:Details input field 715c:URL display field 71n: Search button 715d: SNS selection button 71o: Back button 715e: List of participating stores button

Claims

1. A two-way communication system including a terminal device and a server, which enables two-way communication between the terminal devices using sound, images, and video, The terminal device a control means for transmitting the identification information read by the reading means to a server, and setting a control mode for two-way communication based on notification information notified from the server; The server Manage multiple services corresponding to identity information, an identification process for identifying one service from a plurality of services managed based on identification information received from the terminal device; a notification process for notifying the terminal device of notification information corresponding to the service identified by the identification process; Two-way communication system.

2. The control means sets the screen layout to be displayed on the display unit of the terminal device based on the notified information.

2. The two-way communication system according to claim 1.

3. The control means sets sound-related control in the terminal device based on the notified information.

2. The two-way communication system according to claim 1.

4. The terminal device has a music playback function for playing back music information, The control means sets control relating to the music playback function based on the notified notification information.

2. The two-way communication system according to claim 1.

5. One of the services is a service that uses the host function, The control means enables control from the host when the service of the notified notification information is a service that uses a host function.

2. The two-way communication system according to claim 1.

6. The notification information is service identification information that identifies the service.

2. The two-way communication system according to claim 1.

7. The notification information is control information that indicates the content of control corresponding to the service.

2. The two-way communication system according to claim 1.

Images