Conversation control device, conversation system, and conversation control method

Abstract

To provide a conversation control device, a conversation system and a conversation control method which allow a user to more easily select a desired conversation or conference from plural conversations or conferences.SOLUTION: In a system in which a conversation control device has a conversation with a plurality of user terminals via a network, the conversation control device 20 comprises: a display information generation unit 233 which generates display data necessary for displaying on a user terminal a conference room region image being an image showing a conference room that is currently set up and is a virtual conference room that allows a conversation via the network and an icon image showing a user; a conference room control unit 232 which controls participation in the conference room according to the user operation; and a conversation control unit 234 which controls a conversation between the users who participate in the same conference room.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a technology for realizing online conversation.

Background Art

[0002] Conventionally, systems for conducting conversations and meetings via a network have been proposed. In these systems, it is common to display face images of participants taken by a camera, icons of participants, and the like. For example, Patent Document 1 describes extracting an image of the face region of a photographed user and displaying it with a blurred background. By visually recognizing the displayed face image icon, the user can grasp who is participating.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventionally, web conferences have been conducted on the premise of participating in a conference whose participation has been determined in advance. Therefore, a situation where a plurality of web conferences are being conducted in parallel has not been assumed. In the future, there is a possibility that a plurality of web conferences will be held in parallel. In such a case, the user needs to determine whether to participate or not in each web conference. Such a problem is not necessarily limited to web conferences, but is a common problem in conversations and meetings conducted via a network.

[0005] In view of the above circumstances, an object of the present invention is to provide a technology that enables easier selection of a desired conversation or meeting from among a plurality of conversations and meetings.

Means for Solving the Problem

[0006] One aspect of the present invention is a virtual conference room for conducting conversations via a network, comprising a display information generation unit that generates display data necessary for displaying a conference room area image, which is an image showing the currently installed conference room, and an icon image showing a user, on a user terminal; a conference room control unit that controls participation in the conference room according to a user operation; and a conversation control unit that controls conversations between users participating in the same conference room.

[0007] One aspect of the present invention is the above-described conversation control device, wherein the conference room control unit performs a process of allowing the user to participate in a conference room corresponding to the conference room area image in response to a predetermined operation by the user on the conference room area image. One aspect of the present invention is the above-described conversation control device, wherein the conversation control unit outputs the speech content of the user participating in the conference room to the user connected in a mode different from participating in the conference room, and the conversation control unit does not output the speech content of the user connected to the conference room in the above mode to the user participating in the conference room.

[0008] One aspect of the present invention is a virtual conference room for conducting conversations via a network, comprising an image data generation unit that generates image data including a conference room area image, which is an image showing the currently installed conference room, and an icon image showing a user; a conference room control unit that controls participation in the conference room according to a user operation; and a conversation control unit that controls conversations between users participating in the same conference room, wherein the image data generation unit generates image data in which the icon images of users participating in the conference room are arranged inside the conference room area image showing the conference room.

[0009] One aspect of the present invention is a conversation control method having a display information generation step of generating display data necessary for displaying a conference room area image, which is an image showing the currently installed conference room, and an icon image showing a user, on a user terminal; a conference room control step of controlling participation in the conference room according to a user operation; and a conversation control step of controlling conversations between users participating in the same conference room.

[0010] One aspect of the present invention is a virtual conference room for conducting conversations via a network, which includes an image data generation step of generating image data including a conference room area image that is an image showing the currently installed conference room and an icon image showing a user, a conference room control step of controlling participation in the conference room according to a user's operation, and a conversation control step of controlling conversations between users participating in the same conference room. In the image data generation step, the present invention is a conversation control method for generating image data in which an icon image of a user participating in the conference room is arranged inside a conference room area image showing the conference room.

Advantages of the Invention

[0011] According to the present invention, it becomes possible to more easily select a desired conversation or conference from among a plurality of conversations and conferences.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Mode for Carrying Out the Invention

[0013] Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing the system configuration of the conversation system 100 of the present invention. The conversation system 100 is a system for users operating user terminals 10 to have conversations via a network 30. The conversation system 100 includes a plurality of user terminals 10 and a conversation control device 20. The plurality of user terminals 10 and the conversation control device 20 are communicably connected via the network 30. The network 30 may be a network using wireless communication or a network using wired communication. The network 30 may be configured by combining a plurality of networks.

[0014] Figure 2 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10. The user terminal 10 is configured using an information device such as a smartphone, tablet, personal computer, portable game machine, stationary game machine, or dedicated device. The user terminal 10 includes a communication unit 11, an operation unit 12, a display unit 13, an audio input unit 14, an audio output unit 15, a storage unit 16, and a control unit 17.

[0015] The communication unit 11 is a communication device. The communication unit 11 may be configured as, for example, a network interface. The communication unit 11 performs data communication with other devices via the network 30 in accordance with the control of the control unit 17. The communication unit 11 may be a device that performs wireless communication or a device that performs wired communication.

[0016] The operation unit 12 is configured using existing input devices such as a keyboard, pointing device (mouse, tablet, etc.), buttons, or touch panel. The operation unit 12 is operated by the user when inputting the user's instructions into the user terminal 10. The operation unit 12 may be an interface for connecting the input device to the user terminal 10. In this case, the operation unit 12 inputs the input signal generated in response to the user's input in the input device into the user terminal 10. The operation unit 12 may be configured using a microphone and a voice recognition device. In this case, the operation unit 12 recognizes the speech spoken by the user and inputs the character string information of the recognition result into the user terminal 10. The operation unit 12 may be configured in any manner as long as it can input the user's instructions into the user terminal 10.

[0017] The display unit 13 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 13 displays the image data used when having a conversation. The display unit 13 may be an interface for connecting the image display device to the user terminal 10. In this case, the display unit 13 generates a video signal for displaying the image data and outputs the video signal to the image display device connected to itself.

[0018] The voice input unit 14 is configured using a microphone. The voice input unit 14 may be configured as the microphone itself, or may be configured as an interface for connecting a microphone as an external device to the user terminal 10. The microphone acquires the speech voice of the user who is having a conversation. The voice input unit 14 outputs the voice data acquired by the microphone to the control unit 17.

[0019] The voice output unit 15 is configured using a voice output device such as a speaker, headphones, or earphones. The voice output unit 15 may be configured as the voice output device itself, or may be configured as an interface for connecting a voice output device as an external device to the user terminal 10. It is desirable for the voice output device to output voice so that the user who is having a conversation can hear the voice. The voice output unit 15 outputs voice corresponding to the voice signal output by the control unit 17.

[0020] The storage unit 16 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 16 stores the data used by the control unit 17. The storage unit 16 may function as, for example, a user information storage unit 161. The user information storage unit 161 stores information about the user who operates the user terminal 10 (hereinafter referred to as "user information"). The user information may include, for example, the user's handle name, the user's icon data, and the user's attribute information. The handle name is the name (nickname or real name) used by the user when having a conversation in the conversation system 100. The icon data is the image data used by the user when having a conversation in the conversation system 100. The attribute information may include, for example, information about the user's age, gender, and affiliation.

[0021] The control unit 17 is composed of a processor such as a CPU (Central Processing Unit) and a memory. The control unit 17 functions as a display control unit 171, a conference control unit 172, and a conversation control unit 173 when the processor executes a program. Note that all or part of each function of the control unit 17 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. A computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a semiconductor storage device (e.g., SSD: Solid State Drive), or a storage device such as a hard disk or a semiconductor storage device built into a computer system. The above program may be transmitted via a telecommunication line.

[0022] The display control unit 171 receives display information from the conversation control device 20 via the communication unit 11. The display control unit 171 generates an image signal based on the acquired display information and causes it to be displayed on the display unit 13. The display information may be, for example, image data indicating the image itself to be displayed. In this case, the entity that generates the image data (image data generation unit) is the display information generation unit 233 of the conversation control device 20. The display information may be, for example, data indicating information necessary for generating the image to be displayed (e.g., the position, size, and display mode of the conference room to be displayed, and information indicating the position and icon image of the user). In this case, the display control unit 171 generates image data for display on the display unit 13 based on the display data. In this case, the entity that generates the image data (image data generation unit) is the display control unit 171.

[0023] The conference control unit 172 controls the conferences virtually provided in the conversation control device 20. For example, when the user instructs to set up a new conference room by operating the operation unit 12, the conference control unit 172 performs the process for setting up the new conference room.

[0024] The conversation control unit 173 controls the conversations with the users of other user terminals 10. The conversations with the users of other user terminals 10 may be carried out as conversations without entering the conference room (hereinafter referred to as "private conversations"), or may be carried out as conversations with the users participating in the installed conference room (hereinafter referred to as "conference room conversations"). The conversation control unit 173 transmits, for example, the voice data input from the voice input unit 14 to the conversation control device 20 via the communication unit 11. When the conversation control unit 173 receives the voice data from the conversation control device 20, it outputs the received voice data from the voice output unit 15.

[0025] Figure 3 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20. The conversation control device 20 is configured by using an information processing device such as a personal computer or a server device. The conversation control device 20 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0026] The communication unit 21 is a communication device. The communication unit 21 may be configured as, for example, a network interface. The communication unit 21 performs data communication with other devices via the network 30 according to the control of the control unit 23. The communication unit 21 may be a device that performs wireless communication or a device that performs wired communication.

[0027] The storage unit 22 is configured using a storage device such as a magnetic hard disk drive or a semiconductor memory device. The storage unit 22 stores data used by the control unit 23. The storage unit 22 may function as, for example, a user information storage unit 221 and a conference room information storage unit 222. The user information storage unit 221 stores information (user information) regarding a plurality of users who operate the user terminal 10. The user information of the plurality of users may be registered in the conversation control device 20 in advance.

[0028] The conference room information storage unit 222 stores information regarding a conference room (hereinafter referred to as "conference room information"). A conference room is a virtual room installed for users to have conversations in the conversation system 100. The conference room information may include, for example, information indicating the theme set for the conference room, information indicating the name set for the conference room, information indicating the reserved date and time when the conference room is installed, and information regarding the attributes of the conference room. The information regarding the attributes of the conference room may include, for example, the number of people who can enter the conference room and information indicating the users who can enter the conference room. The conference room information may further include information indicating whether the conference room is currently installed or reserved, and information indicating the users currently present in the conference room.

[0029] The control unit 23 is configured using a processor such as a CPU and a memory. The control unit 23 functions as a user control unit 231, a conference room control unit 232, a display information generation unit 233, and a conversation control unit 234 when the processor executes a program. Note that all or part of each function of the control unit 23 may be realized using hardware such as an ASIC, a PLD, or an FPGA. The above program may be recorded on a computer-readable recording medium. A computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a semiconductor memory device (e.g., SSD), or a storage device such as a hard disk or a semiconductor memory device built into a computer system. The above program may be transmitted via a telecommunication line.

[0030] The user control unit 231 performs control processing related to the user. For example, the user control unit 231 may perform processing for login (e.g., authentication processing) for the user terminal 10 that accesses the conversation control device 20. The user control unit 231 may register the user information received from the user terminal 10 in the user information storage unit 221.

[0031] The conference room control unit 232 performs control processing related to the conference room. For example, when the conference room control unit 232 receives an instruction from the user terminal 10 to newly install a conference room, it may generate conference room information based on the received information and register it in the conference room information storage unit 222. Also, when it is time to install a conference room, the conference room control unit 232 virtually installs the conference room. The timing to install a conference room is, for example, at that time when an instruction is received from the user terminal 10 to newly install a conference room immediately, or when the date and time has arrived if a reservation for installing a conference room has been registered in advance. When a predetermined operation for the user to participate in the conference room is performed and predetermined conditions are satisfied, the conference room control unit 232 performs processing to allow the user to participate in the conference room. For example, the conference room control unit 232 registers that a new user has participated in the conference room by updating the conference room information storage unit 222.

[0032] The display information generation unit 233 generates information (display information) necessary for generating an image to be displayed on the user terminal 10. The display information may include, for example, information related to the currently installed conference room and information related to the users of each user terminal 10 accessing the conversation control device 20. The display information generation unit 233 transmits the generated display information to the user terminal 10.

[0033] The conversation control unit 234 receives voice data from the user terminal 10. The conversation control unit 234 generates voice data to be output to each user terminal 10 (hereinafter referred to as "conversation voice data"), and transmits the conversation voice data to each user terminal 10. The conversation control unit 234 may generate the conversation voice data based on, for example, what kind of conversation the user of each user terminal 10 is participating in.

[0034] Next, the relationship between the image displayed on the user terminal 10 and the conversation voice data output when each image is displayed will be described.

[0035] FIG. 4 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In FIG. 4, on the display unit 13, a conference room area image 31, an icon image 41, and an operation area image 51 are displayed. On the display unit 13, an image of a virtual space where a conference room can be installed is displayed. The virtual space is mainly composed of a conference room area and an area outside the conference room. The conference room area is displayed as the conference room area image 31. The area outside the conference room (hereinafter referred to as the "outdoor area") is the area represented by the reference numeral 91, and is the area where the icon images 41 of the users who have not entered the conference room are displayed.

[0036] The conference room area image 31 is represented as an image of a geometric shape indicating an area of a predetermined size. In the example of the present embodiment, the conference room area image 31 is represented as a circular image having a hollow area 311 in the center. Part or all of the conference room information may be displayed in the hollow area 311. For example, a character string indicating the theme set for the conference room and a value indicating the number of users currently in the conference room may be displayed in the hollow area 311. Instead of the character string indicating the theme of the conference room, the title of the conference may be displayed in the hollow area 311. In the example of FIG. 4, a conference room with a theme of casual conversation is installed, and the number of users in the room is "0".

[0037] The icon image 41 is an image indicating the virtual position of the user and information about the user. The icon image 41 may be displayed according to, for example, icon data included in the user information.

[0038] The operation area image 51 is an image of an area where buttons and information for performing operations related to conversations and meeting rooms are displayed. The operation area image 51 includes, for example, a meeting room installation button 511, a meeting room information image 512, and a user information display area 513. When the meeting room installation button 511 is operated, a process for installing a new meeting room is performed by the meeting control unit 172. In response to the process of the meeting control unit 172, the meeting room control unit 232 registers information (meeting room information) about the new meeting room in the meeting room information storage unit 222.

[0039] The meeting room information image 512 is an image indicating information about the currently installed meeting room. In the example of FIG. 4, a character string (text) indicating the theme of the currently installed meeting room is displayed on the meeting room information image 512. The meeting room information image 512 may include a character string or an image in which link information for moving to another URL is embedded in response to an operation (such as tapping or clicking) by the user. The meeting room information image 512 may further display an operation target image such as a button for operating on that meeting room. For example, a button for the user to enter that meeting room may be included in the meeting room information image 512.

[0040] Information about the user, such as an icon image, is displayed in the user information display area 513. When a predetermined operation is performed in the user information display area 513, an image (hereinafter referred to as a "user state setting image") for setting information indicating the current state of the user (hereinafter referred to as the "user state") may be further displayed. The predetermined operation may be, for example, that the icon image in the user information display area 513 is tapped or clicked, or that the pointer moves on the icon image in the user information display area 513, or other operations.

[0041] FIG. 5 is a diagram showing a specific example of a user state setting image. When a predetermined operation is performed in the user information display area 513 shown in FIG. 4, the user state setting image 514 is displayed. In FIG. 5, the user state setting image 514 shows display examples of icons and character strings of three user states, "Online", "Out of the room", and "Importing".

[0042] "Online" indicates that, for example, the user has accessed the conversation control device 20 and is in an operable state. "Out of the room" indicates that, for example, the user has accessed the conversation control device 20 but is in a state where neither screen browsing nor operation is performed for a while. "Importing" indicates that, for example, the user has accessed the conversation control device 20 and is browsing the screen to some extent but is not performing operations for a while. The specific examples of the user states described above are merely examples, and the user states may be defined in other ways. As other examples, the following definitions may be made. "Online" is a state in which the voice input unit 14 and the voice output unit 15 of the user terminal 10 are enabled, "Out of the room" is a state in which the voice input unit 14 and the voice output unit 15 of the user terminal 10 are disabled, and "Importing" is a state in which the voice input unit 14 of the user terminal 10 is disabled and the voice output unit 15 is enabled. When such a definition is made, when the user state is changed by the user operating the operation unit 12, the control unit 17 may control the operations of the voice input unit 14 and the voice output unit 15 of the user terminal 10 so as to be in the changed state. With such a configuration, the user can easily set the enabling and disabling of the voice input unit 14 and the voice output unit 15 by operating the user state setting image 514. Note that the names indicating the user states do not necessarily have to be limited to "Online", "Out of the room", and "Importing". For example, they may be defined by the words "Open", "Zone", and "Work", respectively.

[0043] FIG. 6 is a diagram showing a specific example of the icon image 41. The icon image 41 may be configured to indicate the user state. In the specific example shown in FIG. 6, the icon image 41 includes a user state image 42 indicating the user state. The user state image 42 is an image indicating the user state. The user state image 42 may be configured to indicate the user state, for example, by its shape or color. As the user state image 42, for example, the icon images of each user state shown in the user state setting image 514 may be shown. Note that the mode of indicating the user state in the icon image 41 is not necessarily limited to the mode using the user state image 42. For example, the user state may be indicated in such a mode that the color of the icon image 41 itself is changed according to the user state. For example, when online, the icon image 41 may be displayed in a normal color, when leaving the room, the icon image 41 may be displayed in a sepia tone color, and when offline, the icon image 41 may be displayed as a black and white image (for example, a binary image).

[0044] FIG. 7 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 7, the icon images 41 (41_1 and 41_2) of two users and the conference room area image 31 of one conference room are displayed. No user has yet participated in the conference room indicated by the conference room area image 31. The two users have not participated in any conference room. Therefore, the icon images 41_1 and 41_2 are displayed in the outdoor area 91 instead of inside the conference room area image 31.

[0045] Users who wish to participate in a meeting room can do so by performing a predetermined operation. For example, in the operation area image 51, by performing a predetermined operation on the meeting room information image 512 that the user wishes to participate in, the user can participate in that meeting room. The predetermined operation may be, for example, an operation on a button for participation. For example, by performing a predetermined operation such as clicking or tapping on the meeting room area image 31, the user can participate in that meeting room. For example, by dragging and dropping the icon image 41 displayed in the outdoor area 91 onto the meeting room area image 31, the user can participate in that meeting room. When an access restriction is set for a meeting room, only the users whose access is permitted in the access restriction can participate in that meeting room.

[0046] FIG. 8 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 8, one user has participated in a meeting room with chitchat as the theme. Therefore, inside the meeting room area image 31 indicating the meeting room with chitchat as the theme, an icon image 41 (41_2) of one user is displayed. At this point, there are no other users participating in the same meeting room as the user of the icon image 41_2. Therefore, the user of the icon image 41_2 cannot have a conversation with other users in the meeting room with chitchat as the theme.

[0047] When a user of the icon image 41_1 in the outdoor area 91 performs an operation to participate in a conference room where the theme is casual conversation, the users participating in that conference room are notified that there is a user who wishes to participate. For example, a predetermined sound (such as the sound of knocking on a door) may be output on the user terminal 10 of each user. The users to be notified may be all the users participating in that conference room, or only a predetermined part of the users (such as the user who is the administrator of that conference room). After the notification is made, when a predetermined condition is satisfied, the user of the icon image 41_1 can participate in the conference room where the theme is casual conversation. The predetermined condition may be, for example, simply that a predetermined time (such as 1 second, 3 seconds, 5 seconds, etc.) has elapsed, or that participation has been permitted by a predetermined user (such as the administrator or participant of that conference room), or that the participation conditions preset for that conference room are satisfied.

[0048] FIG. 9 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 9, two users are participating in a conference room where the theme is casual conversation. Therefore, inside the conference room area image 31 indicating the conference room where the theme is casual conversation, icon images 41 (41_1 and 41_2) of two users are displayed. At this point, the user of the icon image 41_1 and the user of the icon image 41_2 are participating in the same conference room. Therefore, the user of the icon image 41_1 and the user of the icon image 41_2 can have a conversation in the conference room where the theme is casual conversation. That is, users participating in the same conference room can have a conversation using the user terminal 10.

[0049] More specifically, it is as follows. The user terminal 10 of a user participating in the conference room receives and outputs the voice data spoken by another user participating in the same conference room. Also, the user terminal 10 of a user participating in the conference room transmits the voice data spoken by that user to the conversation control device 20. By this transmission, the voice data is output on the user terminals 10 of other users participating in the same conference room. When a user of the icon image 41_3 in the outdoor area 91 performs an operation to participate in a conference room with small talk as the theme, after a predetermined condition is satisfied, the user of the icon image 41_3 can participate in the conference room with small talk as the theme.

[0050] FIG. 10 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 10, three users are participating in a conference room with small talk as the theme. Therefore, inside the conference room area image 31 indicating the conference room with small talk as the theme, icon images 41 (41_1, 41_2, and 41_3) of three users are displayed. At this point, the user of the icon image 41_1, the user of the icon image 41_2, and the user of the icon image 41_3 are participating in the same conference room. Therefore, the user of the icon image 41_1, the user of the icon image 41_2, and the user of the icon image 41_3 can have a conversation in the conference room with small talk as the theme. The same applies when four or more users participate in the same conference room.

[0051] FIG. 11 is a diagram showing a specific example of an image displayed on a conference room screen. In the example of FIG. 11, a specific example of the conference room screen of a conference room where small talk in the state shown in FIG. 10 is the theme is shown. The conference room screen is a screen showing the state of the interior of each conference room. On the conference room screen, the icon images 41 of each user participating in the conference room may be displayed. In the example of FIG. 11, the icon images 41 (41_1, 41_2, and 41_3) of three users are displayed on the conference room screen. The user terminal 10 of the user participating in the conference room receives and outputs the voice data spoken by other users participating in the same conference room. At that time, the volume of the voice output may be controlled according to the position of the icon image.

[0052] For example, the distance on the image with respect to the icon image 41_3 is closer to the icon image 41_2 than to the icon image 41_1. Therefore, in the user terminal 10 of the icon image 41_3, the voice of the user of the icon image 41_2 may be output louder than the voice of the user of the icon image 41_1. Such control may be executed by the conversation control device 20 or may be executed by the user terminal 10.

[0053] FIG. 12 is a diagram showing a specific example of the conference room area image 31 of the conference room to which the attached user is connected. The attached user cannot speak, but can listen to the conversation content of other users in the conference room. In other words, the conversation content of the attached user is not output to other users connected to the same conference room, but the conversation content of other users connected to the same conference room is output to the attached user.

[0054] In the example of FIG. 12, a pinned user is connected to the conference room where the casual conversation is the theme. The icon image 41_3 of the pinned user may be displayed in a different manner from the icon images 41 of users who are not pinned users (for example, icon images 41_1 and 41_2). For example, as shown in FIG. 12, the outer frame of the icon image 41 may be displayed in a manner similar to or the same as the display manner of the conference room area image 31 of the connected conference room. In the example of FIG. 12, the icon image 41_3 of the pinned user is surrounded by a frame with the same pattern as the pattern of the conference room area image 31. Also, the icon image 41_3 of the pinned user may be displayed in a form that protrudes from the conference room area image 31 instead of inside the conference room area image 31. By being displayed in this way, it becomes possible for the user to easily determine which user is connected as the pinned user in each conference room.

[0055] The conference room area image 31 of the conference room connected by the pinned user may be displayed in a different manner from the conference room area image 31 of the conference room not connected by the pinned user. For example, as shown in FIG. 12, the conference room area image 31 connected by the pinned user may be composed of a plurality of concentric circles having the same pattern. By being displayed in this way, it becomes possible for the user to easily determine whether a pinned user is connected in each conference room.

[0056] FIG. 13 is a diagram showing a specific example of the icon image 41 of a user engaged in a private conversation. A user engaged in a private conversation can conduct it with the other party to the private conversation in such a way that the voice is not output to other users except the other party to the private conversation. In other words, the utterance content in the private conversation is output only to the user conducting the private conversation and not to other users. The private conversation may be started, for example, by a certain user performing a predetermined operation (such as clicking or tapping) on the icon image 41 of another user who desires to conduct a private conversation. In this case, the conversation control device 20 may notify the user terminal 10 of the user of the operated icon image 41 that a private conversation start request has been made. The user of the operated icon image 41 may input at the user terminal 10 whether to accept or reject the private conversation start request. The private conversation may be started in response to the input of accepting. Also, when a private conversation is already being conducted, it may be configured such that other users can participate in the private conversation.

[0057] In the example of FIG. 13, the user of the icon image 41_3 and the user of the icon image 41_4 are engaged in a private conversation. The icon images 41_3 and 41_4 of the users engaged in the private conversation may be displayed in a different manner from the icon images 41 (for example, the icon images 41_1 and 41_2) of the users not engaged in the private conversation. For example, as shown in FIG. 13, the outer frame of the icon image 41 may be displayed in the same pattern as the outer frame of the other party to the private conversation. Also, the icon images 41 of the users engaged in the private conversation may be displayed attached to each other. By being displayed in this way, it becomes possible for the user to easily determine which user is having a private conversation with which other party.

[0058] In a private conversation, users participating in the private conversation or users who are about to start a private conversation can set the secret mode. In a private conversation with the secret mode set, no new users can join that private conversation. When the secret mode is set, the icon image 41 of the user having the private conversation may be displayed in a manner different from that of the icon image 41 of a user having a normal private conversation. For example, when the secret mode is set, a specific image (e.g., an image showing the shape of a key) may be added to the icon image 41 of the user participating in that private conversation.

[0059] FIG. 14 is a diagram showing a specific example of an image displayed on the private conversation screen. In the example of FIG. 14, a specific example of the private conversation screen regarding the private conversation between two users in the state shown in FIG. 13 is shown. The private conversation screen is a screen showing the state of each private conversation. On the private conversation screen, the icon image 41 of each user participating in that private conversation may be displayed. In the example of FIG. 14, the icon image 41_3 and the icon image 41_4 are displayed. Such a private conversation screen may be displayed only on the user terminal 10 of the user participating in that private conversation. By being displayed in this way, the user can easily determine with which user they are currently having a private conversation.

[0060] FIG. 15 is a diagram showing a specific example of a virtual space. The virtual space is a virtual space where meeting rooms are arranged or the icon images 41 of users are arranged. In the virtual space, each user can move or set up a meeting room. Also, it is not necessary for all of the virtual space to be displayed on the user terminal 10. Also, it is not necessary for only the same location in the virtual space to be displayed on the user terminals 10 of all users. That is, on the user terminal 10 of each user, only an arbitrary space within the virtual space may be displayed. The size of the area of the space to be displayed may also be different for each. For example, in the example of FIG. 15, the area 60_1 displayed on the user terminal 10 of the first user, the area 60_2 displayed on the user terminal 10 of the second user, and the area 60_3 displayed on the user terminal 10 of the third user are all different in position. Also, the area 60_1 and the area 60_2 are the same size, but the area 60_1 and the area 60_3 are different sizes. The screen of the area 60_1 displayed on the user terminal 10 of the first user is the one shown in FIG. 13.

[0061] FIGS. 16 and 17 are diagrams showing specific examples of images displayed on the display unit 13 of the user terminal 10. The screen of the area 60_2 displayed on the user terminal 10 of the second user is the one shown in FIG. 16. The screen of the area 60_3 displayed on the user terminal 10 of the third user is the one shown in FIG. 17. Since screens of different areas can be displayed for each user in this way, it is possible to display the area that each user wants to check in a desired size, and it becomes possible to easily determine the situation of conversations at any position in the virtual space. Also, while remaining in a state of participating in one of the meeting rooms, the screen can be changed so that the other meeting room area image 31 is displayed. In this case, by performing an operation for entering the other meeting room area image 31, the user can also easily move from one meeting room to another.

[0062] In the conversation system 100 configured as described above, it is possible to more easily select a desired conversation or meeting from among a plurality of conversations and meetings. Specifically, it is as follows. On the screen where the position or a plurality of icon images 41 or conference room area images 31 are displayed, the user can easily select a desired conversation or meeting by performing a predetermined operation on the icon image 41 of the person with whom they wish to have a conversation (for example, a private conversation) or the conference room area image 31 of the conference room they wish to participate in. Therefore, compared to the conventional case where, for example, the URL for a web conference is preset on a one-to-one basis with the conference room, it is possible to easily select and participate in a desired conversation or conference room.

[0063] Also, after seeing the icon image 41, it is possible to select the person with whom to have a conversation (for example, a private conversation). Therefore, it is possible to start a conversation after obtaining a certain amount of information about the person with whom to have the conversation. Also, on the conference room area image 31, the icon images 41 of the users participating in that conference room are displayed. Therefore, when participating in a conference room, it is possible to participate in the conference room after obtaining a certain amount of information about the other users participating in that conference room.

[0064] As described above, the embodiments of the present invention have been described in detail with reference to the drawings, but the specific configuration is not limited to this embodiment, and designs and the like within the scope not departing from the gist of the present invention are also included.

Explanation of Reference Numerals

[0065] 100…Conversation system, 10…User terminal, 20…Conversation control device, 11…Communication unit, 12…Operation unit, 13…Display unit, 14…Voice input unit, 15…Voice output unit, 16…Memory unit, 161…User information memory unit, 17…Control unit, 171…Display control unit, 172…Conference control unit, 173…Conversation control unit, 21…Communication unit, 22…Memory unit, 221…User information memory unit, 222…Conference room information memory unit, 23…Control unit, 231…User control unit, 232…Conference room control unit, 233…Display information generation unit, 234…Conversation control unit, 31…Conference room area image, 311…Hollow area, 41…Icon image, 42…User status image, 51…Operation area image, 511…Conference room installation button, 512…Conference room information image, 513…User information display area, 514…User status setting image, 91…Outdoor area

Claims

1. A virtual conference room for conducting conversations via a network, comprising: a display information generation unit that generates display data necessary for displaying on a user terminal a plurality of conference room area images, which are images each showing one of the plurality of conference rooms currently installed in a virtual space, and an icon image showing a user; A conference room control unit that controls participation in the conference room according to a user operation; A conversation control unit that controls conversations between users participating in the same conference room; Comprising: The conversation control unit outputs the speech content of a user participating in the conference room to a user connected in a manner different from participation in the conference room; The conversation control unit does not output the speech content of a user connected to the conference room in the manner to a user participating in the conference room; The icon image of a user participating in the conference room and the icon image of a user participating in the manner are displayed in different display modes; A conversation control device, wherein the conference room area image of a conference room in which a user participating in the manner exists and the conference room area image of a conference room in which a user participating in the manner does not exist are displayed in different display modes.

2. The conference room control unit according to claim 1, wherein, in response to a predetermined operation by a user on the conference room area image, the conference room control unit performs a process of allowing the user to participate in the conference room corresponding to the conference room area image.

3. A virtual conference room for conducting conversations via a network, comprising: an image data generation unit that generates image data including a plurality of conference room area images, which are images each showing one of the plurality of conference rooms currently installed in a virtual space, and an icon image showing a user; A conference room control unit that controls participation in the conference room according to a user operation; A conversation control unit that controls conversations between users participating in the same conference room; Comprising: The image data generation unit generates image data in which the icon image of a user participating in the conference room is arranged inside the conference room area image showing the conference room; The conversation control unit outputs the speech content of a user participating in the conference room to a user connected in a manner different from participation in the conference room; The conversation control unit does not output the speech content of a user connected to the conference room in the manner to a user participating in the conference room; The icon images of the users participating in the meeting room and the icon images of the users participating in the above-described manner are displayed in different display manners. A conversation system in which the meeting room area image of the meeting room where the users participating in the above-described manner exist and the meeting room area image of the meeting room where the users participating in the above-described manner do not exist are displayed in different display manners.

4. A virtual meeting room for conducting conversations via a network, comprising: a display information generation step of generating display data necessary for displaying, on a user terminal, a plurality of meeting room area images each being an image showing one of the plurality of meeting rooms currently installed in a virtual space, and icon images showing users; A meeting room control step of controlling participation in the meeting room according to a user operation; A conversation control step of controlling conversations between users participating in the same meeting room; having In the conversation control step, the speech content of the user participating in the meeting room is output to a user connected in a manner different from participation in the meeting room. In the conversation control step, the speech content of the user connected to the meeting room in the above-described manner is not output to the users participating in the meeting room. The icon images of the users participating in the meeting room and the icon images of the users participating in the above-described manner are displayed in different display manners. A conversation control method in which the meeting room area image of the meeting room where the users participating in the above-described manner exist and the meeting room area image of the meeting room where the users participating in the above-described manner do not exist are displayed in different display manners.

5. A virtual meeting room for conducting conversations via a network, comprising: an image data generation step of generating image data including a plurality of meeting room area images each being an image showing one of the plurality of meeting rooms currently installed in a virtual space, and icon images showing users; A meeting room control step of controlling participation in the meeting room according to a user operation; A conversation control step of controlling conversations between users participating in the same meeting room; having In the image data generation step, image data is generated in which the icon images of the users participating in the meeting room are arranged inside the meeting room area image showing the meeting room. In the conversation control step, the speech content of the user participating in the meeting room is output to a user connected in a manner different from participation in the meeting room. In the conversation control step, the speech content of the user connected to the conference room in the mode is not output to the users participating in the conference room. The icon image of the user participating in the conference room and the icon image of the user participating in the mode are displayed in different display modes. A conversation control method in which the conference room area image of the conference room where the user participating in the mode exists and the conference room area image of the conference room where the user participating in the mode does not exist are displayed in different display modes.