Conversation control device, conversation system, and conversation control method

Abstract

To enable a non-regular user to temporarily participate in an online conference.SOLUTION: There is provided a conversation control device comprising: a display information generation unit for generating display data that is needed for a conference room area image that indicates a plurality of currently installed conference rooms which are virtual conference rooms for conducting a conversion via a network and an icon image that indicates a user to be displayed on a user terminal; a conference room control unit for controlling participation to the conference rooms in accordance with a user's operation; and a conversion control unit for controlling the conversation of the users participating in the same conference room. The conference room control unit performs processing differently for the case where preliminarily registered regular users among the users are participating in the conference room, and the case where guest users having been approved for temporary participation by the regular uses among the users are participating in the conference room.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technology for realizing online conversation.

Background Art

[0002] Conventionally, systems for conducting conversations and meetings via a network have been proposed. In these systems, it is common to display face images of participants captured by a camera, icons of participants, etc. For example, Patent Document 1 describes extracting an image of the face region of a captured user and displaying it with a blurred background. By visually recognizing the displayed face image icon, a user can grasp who is participating.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventionally, online meetings have been conducted by pre-determining the members participating in the meeting and issuing URLs and meeting IDs for online meetings to each participating member. Therefore, the situation where multiple online meetings are conducted in parallel and participating members enter and exit multiple online meetings has not been assumed. In the future, it is possible that multiple online meetings will be held in parallel. For example, not only the online meeting that one is participating in, but also the status of multiple online meetings being held in parallel may be displayed in a visible state, and a mechanism may be provided that allows one to enter and exit through operations on the screen without using information (such as a URL) for accessing those online meetings. In the future, it is necessary to further improve the convenience of such a system. For example, a mechanism that only allows registered regular users to participate in online meetings lacks convenience. Therefore, a mechanism that allows unregistered irregular users to temporarily participate in online meetings has been demanded.

[0005] In view of the above circumstances, an object of the present invention is to provide a technology that enables an irregular user to temporarily participate in an online meeting.

Means for Solving the Problem

[0006] One aspect of the present invention is a virtual meeting room for conducting conversations via a network, comprising a display information generation unit that generates display data necessary for displaying on a user terminal a meeting room area image that is an image showing a plurality of currently installed meeting rooms, and an icon image showing a user, a meeting room control unit that controls participation in the meeting room according to a user's operation, and a conversation control unit that controls conversations between users participating in the same meeting room, wherein the meeting room control unit performs different processes when a registered regular user among the users participates in the meeting room and when a guest user who has been temporarily allowed to participate by a regular user among the users participates in the meeting room.

[0007] One aspect of the present invention is the above-described conversation control device, further comprising a message control unit that controls conversations between users using text messages conducted in the conference room, and the display information generation unit generates display data further including the messages of the conversations in the conference room.

[0008] One aspect of the present invention is a virtual conference room for conducting conversations via a network, comprising an image data generation unit that generates image data including a conference room area image, which is an image showing a plurality of currently installed conference rooms, and an icon image showing a user, a conference room control unit that controls participation in the conference room according to a user's operation, and a conversation control unit that controls conversations between users participating in the same conference room. The conference room control unit performs different processes when a regular user, who is a user registered in advance among the users, participates in the conference room and when a guest user, who is temporarily allowed to participate by a regular user among the users, participates in the conference room. The image data generation unit generates different image data for a regular user terminal, which is a user terminal operated by the regular user, and a guest user terminal, which is a user terminal operated by the guest user. It is a conversation system.

[0009] One aspect of the present invention is the above-described conversation system, further comprising a message control unit that controls conversations between users using text messages conducted in the conference room, and the image data generation unit generates image data further including the messages of the conversations in the conference room.

[0010] One aspect of the present invention is a virtual conference room for a computer to conduct conversations via a network, including a conference room area image that is an image showing a plurality of currently installed conference rooms, and an icon image showing a user. A display information generation step of generating display data necessary for displaying on a user terminal; a conference room control step in which a computer controls participation in the conference room according to a user's operation; and a conversation control step in which a computer controls conversations between users participating in the same conference room. In the conference room control step, the computer performs different processes when a registered regular user among the users participates in the conference room and when a guest user temporarily allowed to participate by a regular user among the users participates in the conference room. This is a conversation control method.

[0011] One aspect of the present invention is the above conversation control method, further including a message control step in which a computer controls conversations between users using text messages conducted in the conference room, and in the display information generation step, generating display data further including the messages of the conversations in the conference room.

[0012] One aspect of the present invention is a virtual conference room for a computer to conduct conversations via a network, including an image data generation step of generating image data including a conference room area image, which is an image showing a plurality of currently installed conference rooms, and an icon image showing a user; a conference room control step in which the computer controls participation in the conference room according to a user's operation; and a conversation control step in which the computer controls conversations between users participating in the same conference room. In the conference room control step, the computer performs different processes when a registered regular user among the users participates in the conference room and when a guest user temporarily permitted to participate by a regular user among the users participates in the conference room. In the image data generation step, the computer generates different image data for a regular user terminal, which is a user terminal operated by the regular user, and a guest user terminal, which is a user terminal operated by the guest user. This is a conversation control method.

[0013] One aspect of the present invention is the above conversation control method, further including a message control step in which the computer controls conversations between users using text messages conducted in the conference room. In the image data generation step, the computer generates image data further including the messages of the conversations in the conference room.

Advantages of the Invention

[0014] According to the present invention, it becomes possible for non-regular users to temporarily participate in an online conference.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Embodiments for Carrying out the Invention

[0016] Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings. [First Embodiment] FIG. 1 is a schematic block diagram showing the system configuration of the first embodiment of the conversation system 100 of the present invention. The conversation system 100 is a system for users operating user terminals 10 to have conversations with each other via a network 90. The conversation system 100 includes a plurality of user terminals 10 and a conversation control device 20. The plurality of user terminals 10 and the conversation control device 20 are communicably connected via the network 90. The network 90 may be a network using wireless communication or a network using wired communication. The network 90 may be configured by combining a plurality of networks.

[0017] FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10. The user terminal 10 is configured using an information device such as a smartphone, a tablet, a personal computer, a portable game machine, a stationary game machine, or a dedicated device. The user terminal 10 includes a communication unit 11, an operation unit 12, a display unit 13, an audio input unit 14, an audio output unit 15, a storage unit 16, and a control unit 17.

[0018] The communication unit 11 is a communication device. The communication unit 11 may be configured as, for example, a network interface. The communication unit 11 performs data communication with other devices via the network 90 according to the control of the control unit 17. The communication unit 11 may be a device that performs wireless communication or a device that performs wired communication.

[0019] The operation unit 12 is configured using existing input devices such as a keyboard, a pointing device (mouse, tablet, etc.), buttons, a touch panel, etc. The operation unit 12 is operated by the user when inputting the user's instructions to the user terminal 10. The operation unit 12 may be an interface for connecting the input device to the user terminal 10. In this case, the operation unit 12 inputs the input signal generated in response to the user's input in the input device to the user terminal 10. The operation unit 12 may be configured using a microphone and a voice recognition device. In this case, the operation unit 12 performs voice recognition on the words spoken by the user, and inputs the character string information of the recognition result to the user terminal 10. The operation unit 12 may be configured in any way as long as it can input the user's instructions to the user terminal 10.

[0020] The display unit 13 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 13 displays the image data used when having a conversation. The display unit 13 may be an interface for connecting the image display device to the user terminal 10. In this case, the display unit 13 generates a video signal for displaying the image data, and outputs the video signal to the image display device connected to itself.

[0021] The voice input unit 14 is configured using a microphone. The voice input unit 14 may be configured as the microphone itself, or may be configured as an interface for connecting the microphone to the user terminal 10 as an external device. The microphone acquires the voice of the user speaking during the conversation. The voice input unit 14 outputs the voice data acquired by the microphone to the control unit 17.

[0022] The voice output unit 15 is configured using a voice output device such as a speaker, headphones, or earphones. The voice output unit 15 may be configured as the voice output device itself, or may be configured as an interface for connecting a voice output device to the user terminal 10 as an external device. It is desirable for the voice output device to output voice so that a user who is having a conversation can hear the voice. The voice output unit 15 outputs voice according to the voice signal output by the control unit 17.

[0023] The storage unit 16 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 16 stores data used by the control unit 17. The storage unit 16 may function, for example, as a user information storage unit 161. The user information storage unit 161 stores information about the user who operates the user terminal 10 (hereinafter referred to as "user information"). The user information may include, for example, the user's handle name, the user's icon data, and the user's attribute information. The handle name is the name (nickname or real name) used by the user when having a conversation in the conversation system 100. The icon data is the image data used by the user when having a conversation in the conversation system 100. The attribute information may include, for example, information about the user's age, gender, and affiliation.

[0024] The control unit 17 is composed of a processor such as a CPU (Central Processing Unit) and a memory. By the processor executing a program, the control unit 17 functions as a display control unit 171, a conference control unit 172, and a conversation control unit 173. Note that all or part of each function of the control unit 17 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. A computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a semiconductor storage device (e.g., SSD: Solid State Drive), or a storage device such as a hard disk or a semiconductor storage device built into a computer system. The above program may be transmitted via a telecommunication line.

[0025] The display control unit 171 receives display information from the conversation control device 20 via the communication unit 11. The display control unit 171 generates an image signal based on the acquired display information and causes it to be displayed on the display unit 13. The display information may be, for example, image data indicating the image itself to be displayed. In this case, the entity that generates the image data (image data generation unit) is the display information generation unit 233 of the conversation control device 20. The display information may be, for example, data indicating information necessary for generating the image to be displayed (e.g., the position, size, and display mode of the conference room to be displayed, and information indicating the position and icon image of the user). In this case, the display control unit 171 generates image data for display on the display unit 13 based on the display data. In this case, the entity that generates the image data (image data generation unit) is the display control unit 171.

[0026] The conference control unit 172 controls conferences that are virtually provided in the conversation control device 20. For example, when a user instructs to set up a new conference room by operating the operation unit 12, the conference control unit 172 performs processing for setting up a new conference room.

[0027] The conversation control unit 173 controls conversations with users of other user terminals 10. The conversation with the user of the other user terminal 10 may be, for example, a conversation with one or more users participating in the installed conference room (hereinafter referred to as "conference room conversation"). The conversation control unit 173 transmits, for example, voice data input from the voice input unit 14 to the conversation control device 20 via the communication unit 11. When the conversation control unit 173 receives voice data from the conversation control device 20, it outputs the received voice data from the voice output unit 15.

[0028] FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20. The conversation control device 20 is configured using an information processing device such as a personal computer or a server device. The conversation control device 20 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0029] The communication unit 21 is a communication device. The communication unit 21 may be configured as, for example, a network interface. The communication unit 21 performs data communication with other devices via the network 90 according to the control of the control unit 23. The communication unit 21 may be a device that performs wireless communication or a device that performs wired communication.

[0030] The storage unit 22 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 22 stores data used by the control unit 23. The storage unit 22 may function as, for example, a regular user information storage unit 221, a guest user information storage unit 222, and a conference room information storage unit 223.

[0031] The regular user information storage unit 221 stores information (regular user information) regarding a plurality of regular users who operate the user terminal 10. A regular user is a person who has been registered in advance through a predetermined procedure as a user who can use the conversation system 100. A regular user can use one or more functions (hereinafter referred to as "regular user functions") provided for regular users in the conversation system 100 by logging in using, for example, a user ID and a password.

[0032] A regular user can spontaneously log in to the conversation system 100 without receiving an invitation from another regular user. By logging in to the conversation system 100, a regular user can have an online conversation with other users who are logged in to the conversation system 100. The regular user information of a plurality of regular users may be registered in the conversation control device 20 in advance. The regular user information may include, for example, the handle name of the regular user, the icon data of the regular user, and the attribute information of the regular user.

[0033] The guest user information storage unit 222 stores information (guest user information) regarding guest users. A guest user is a person who can access the conversation system 100 by receiving an invitation from a regular user. A guest user receives information for accessing the conversation system 100 (hereinafter referred to as "guest access information") as an invitation from a regular user, for example, and accesses the conversation system 100 as a guest user by using the guest access information. As the guest access information, for example, a URL (Uniform Resource Locator), a character string such as an ID, or the like may be used.

[0034] In the conversation system 100, guest users can use one or more functions provided for guest users (hereinafter referred to as "guest user functions"). However, the guest user functions are restricted compared to the regular user functions. That is, the functions provided as guest user functions are part of the regular user functions. Note that functions not provided as regular user functions may be included in the guest user functions. Guest information may include, for example, the handle name of the guest user and the attribute information of the guest user. The handle name is the name (nickname or real name) used by the guest user when having a conversation in the conversation system 100. The attribute information may include, for example, information regarding the age, gender, and affiliation of the guest user. Note that the term "user" includes both regular users and guest users.

[0035] The conference room information storage unit 223 stores information regarding the conference room (hereinafter referred to as "conference room information"). A conference room is a virtual room installed in the conversation system 100 for users to have conversations. The conference room information may include, for example, information indicating the name set for the conference room and information regarding the attributes of the conference room. The information regarding the attributes of the conference room may include, for example, information indicating whether the conference room is in a state that permits guests to enter (hereinafter referred to as "public state") or a state that does not permit guests to enter (hereinafter referred to as "non-public state"). The conference room information may further include information indicating the regular users and guest users currently present in the conference room.

[0036] The control unit 23 is composed of a processor such as a CPU and a memory. By the processor executing a program, the control unit 23 functions as a user control unit 231, a conference room control unit 232, a display information generation unit 233, and a conversation control unit 234. Note that all or part of each function of the control unit 23 may be realized using hardware such as an ASIC, a PLD, or an FPGA. The above program may be recorded on a computer-readable recording medium. A computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a semiconductor storage device (e.g., SSD), or a storage device such as a hard disk or a semiconductor storage device built into a computer system. The above program may also be transmitted via a telecommunication line.

[0037] The user control unit 231 performs control processing regarding regular users and guest users. For example, the user control unit 231 may perform processing for login (e.g., authentication processing) for a regular user who accesses the conversation control device 20. The user control unit 231 may register the regular user information received from the user terminal 10 in the regular user information storage unit 221. The user control unit 231 may request a guest user who accesses the conversation control device 20 to input guest user information, and register the input guest user information (e.g., a handle name, attribute information, etc.) in the guest user information storage unit 222.

[0038] The conference room control unit 232 performs control processing related to the conference room. For example, when the conference room control unit 232 receives an instruction from the user terminal 10 to newly install a conference room, it may generate conference room information based on the received information and register it in the conference room information storage unit 223. When a predetermined operation for the user to participate in the conference room is performed and a predetermined condition is satisfied, the conference room control unit 232 performs processing to allow the user to participate in the conference room. For example, the conference room control unit 232 updates the conference room information storage unit 223 to register that a new user has participated in the conference room. At this time, the conference room control unit 232 may perform different processing depending on whether the participation request is made by a regular user or a guest user.

[0039] For example, when the conference room control unit 232 receives an operation request from a regular user logged in to the conversation system 100 to enter a specific conference room, it determines whether the regular user has the qualification to enter the conference room. For example, in the case of a normal conference room, it may be determined that any regular user has the qualification to enter. For example, in the case of a conference room with restricted access, it may be determined whether the user has the qualification to enter on the condition that the user is a pre-registered regular user.

[0040] The conference room control unit 232 determines, for example, whether the conference room designated as the access destination is in a public state for a guest user who has accessed the conversation system 100 using specific guest access information. If the conference room designated as the access destination is in a non-public state, the conference room control unit 232 does not permit the guest user to enter. If the conference room designated as the access destination is in a public state, the conference room control unit 232 permits the guest user to enter. At this time, instead of permitting the guest user to enter, the conference room control unit 232 may permit the guest user to enter the waiting room provided in the conference room. After the guest user enters the waiting room, if an operation is performed by a regular user to permit the guest user to enter the conference room, the conference room control unit 232 may permit the guest user to enter the conference room.

[0041] The display information generation unit 233 generates information (display information) necessary for generating an image to be displayed on the user terminal 10. The display information may include, for example, information about the currently installed conference room and information about the users of each user terminal 10 accessing the conversation control device 20. The display information generation unit 233 transmits the generated display information to the user terminal 10.

[0042] The images displayed on each user terminal 10 differ depending on whether the user is a regular user or a guest user, even if the user terminals 10 belong to users who have entered the same conference room. The amount of information shown in the image displayed on the user terminal 10 (guest user terminal) operated by a guest user is less than the amount of information shown in the image displayed on the user terminal 10 (regular user terminal) operated by a regular user.

[0043] For example, on the user terminal 10 operated by a regular user, information about conference rooms other than the conference room where the regular user has entered is also displayed. However, on the user terminal 10 operated by a guest user, it may be configured such that information about conference rooms other than the conference room where the guest user has entered is not displayed. When a guest user is invited to a plurality of conference rooms, on the guest user terminal, information about the plurality of conference rooms to which the guest user is invited may be displayed, and it may be configured such that information about conference rooms to which the guest user is not invited is not displayed. For example, on the user terminal 10 operated by a regular user, information about conference rooms other than the conference room where the regular user has entered is also displayed. However, on the user terminal 10 operated by a guest user, it may be configured such that information about conference rooms other than the conference room where the guest user has entered is not displayed.

[0044] The conversation control unit 234 receives voice data from the user terminal 10. The conversation control unit 234 generates voice data to be output to each user terminal 10 (hereinafter referred to as "conversation voice data"), and transmits the conversation voice data to each user terminal 10. The conversation control unit 234 may generate the conversation voice data based on, for example, what kind of conversation each user of the user terminal 10 is participating in. For example, the conversation control unit 234 may transmit conversation voice data including the voice received from the user terminals 10 of all the users participating in the conference room where each user has entered to the user terminal 10 of each user.

[0045] Next, the relationship between the images displayed on the user terminal 10 and the conversation voice data output when each image is displayed will be described.

[0046] FIG. 4 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In FIG. 4, on the display unit 13, a conference room area image 30, a conversation area 31, a listening ear area 32, an icon image 41, and an operation area image 51 are displayed. An image of a virtual space where a conference room can be installed is displayed on the display unit 13. The virtual space mainly consists of a conference room area and an area outside the conference room. The conference room area is displayed as the conference room area image 30. The area outside the conference room (hereinafter referred to as the "outdoor area") is the area represented by reference numeral 91, and is the area where the icon images 41 of users who have not entered the conference room are displayed.

[0047] The conference room area image 30 includes a conversation area 31 and a listening ear area 32. A user whose icon image 41 is displayed in the conversation area 31 can talk to other users whose icon images 41 are displayed in the conversation area 31 of the same conference room. That is, the voices of each user whose icon image 41 is displayed in the conversation area 31 are transmitted and received to and from each other. In the following description, entering the conference room means that the icon image 41 is displayed in the conversation area 31. That is, entering the conference room means that it becomes possible to talk to other entrants.

[0048] A user whose icon image 41 is displayed in the listening ear area 32 (hereinafter referred to as the "listening ear user") can listen to the conversation of the user (the user who has entered the room) whose icon image 41 is displayed in the conversation area 31 of that conference room. However, the listening ear user cannot speak in that conference room. That is, the voice spoken by the listening ear user is not output on the user terminal 10 of other users who have entered that conference room or on the user terminal 10 of other listening ear users in that conference room.

[0049] The conference room area image 30 is represented as an image of a geometric shape indicating an area of a predetermined size. In the example of this embodiment, the conference room area image 30 is represented as a circular image. Near the center of the conference room area image 30, the name 311 of the conference room is displayed. In the example of FIG. 4, "Chat" is the name of the conference room. By displaying the name of the conference room, even a user (regular user) located in the outdoor area 91 can infer approximately what kind of conversation is being held in that conference room without entering the conference room.

[0050] An entry button 312 and a detail button 313 may be displayed inside the conference room area image 30. The entry button 312 is a button for requesting entry into the conference room. In response to the entry button 312 being operated by a user located in the outdoor area 91, the conference room control unit 232 determines that the user is requesting entry into the conference room. The conference room control unit 232 determines whether to permit entry in response to the request, and controls the entry of the user according to the determination result.

[0051] The detail button 313 is a button for displaying detailed information about the conference room. In response to the detail button 313 being operated, a detail display area is displayed on the screen. In the detail display area, detailed information about the conference room, buttons and input fields for operating on the conference room are displayed. For example, a button for issuing guest access information, an area where guest access information is displayed, a button for changing the state to a public state or a non - public state, the name of the conference room, a button for changing the name of the conference room, an input field for entering the changed name of the conference room, etc. may be displayed.

[0052] The icon image 41 is an image showing the virtual position of the user and information about the user. The icon image 41 may be displayed according to, for example, icon data included in the user information.

[0053] FIG. 5 is a diagram showing a specific example of a user state setting image. In response to a predetermined operation being performed, a user state setting image 511 is displayed on the screen. In FIG. 5, the user state setting image 511 shows display examples of icon images and character strings for three user states, namely, "Welcome", "Flat", and "Zone".

[0054] "Welcome" indicates that, for example, the user has accessed the conversation control device 20 and is in a state where conversation is possible, and the user wants to actively engage in conversation. "Flat" indicates that, for example, the user has accessed the conversation control device 20 and is in a state where conversation is possible, and it does not matter whether conversation takes place or not. "Zone" indicates that, for example, the user has accessed the conversation control device 20 and is browsing the screen to some extent, but will not perform operations for a while or does not want to engage in conversation. The specific examples of the user states described above are merely examples, and the user states may be defined in other ways.

[0055] FIG. 6 is a diagram showing a specific example of the icon image 41. The icon image 41 may be configured to indicate the user state. In the specific example shown in FIG. 6, the icon image 41 includes a user state image 42 that indicates the user state. The user state image 42 is an image that indicates the user state. The user state image 42 may be configured to indicate the user state, for example, by its shape or color. As the user state image 42, for example, the icon images of each user state shown in the user state setting image 511 may be shown.

[0056] Note that the mode of indicating the user state in the icon image 41 does not necessarily have to be limited to the mode using the user state image 42. For example, the user state may be indicated in such a mode that the color of the icon image 41 itself is changed according to the user state. For example, when it is "Welcome", the icon image 41 may be displayed in the normal color, when it is "Flat", the icon image 41 may be displayed in a sepia tone color, and when it is "Zone", the icon image 41 may be displayed as a black-and-white image (for example, a binary image).

[0057] FIG. 7 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 7, icon images 41 (41_1 and 41_2) of two users and a conference room area image 30 of one conference room are displayed. No user has yet participated in the conference room indicated by the conference room area image 30. The two users have not participated in any conference room. Therefore, the icon images 41_1 and 41_2 are displayed in the outdoor area 91 rather than inside the conference room area image 30.

[0058] A user who wishes to participate in a conference room can participate (enter) the conference room by performing a predetermined operation. For example, by operating the entry button 312 in the conference room area image 30 that the user wishes to participate in, the user can participate in that conference room. Note that the operation for entering is not necessarily limited to the above-described one. When an entry restriction is set for a conference room, only the users who are permitted to enter in the entry restriction can enter that conference room.

[0059] FIG. 8 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 8, one user has participated in a conference room with chitchat as the theme. Therefore, an icon image 41 (41_2) of one user is displayed inside the conference room area image 30 indicating the conference room with chitchat as the theme. At this point, there is no other user who has participated in the same conference room as the user of the icon image 41_2. Therefore, the user of the icon image 41_2 cannot have a conversation with other users in the conference room with chitchat as the theme.

[0060] When a user of the icon image 41_1 in the outdoor area 91 performs an operation to participate in a conference room where the theme is casual conversation, the users participating in that conference room are notified that there is a user who wishes to participate. For example, a predetermined sound (such as the sound of knocking on a door) may be output on the user terminal 10 of each user. The users to be notified may be all the users participating in that conference room, or may be only a predetermined part of the users (such as the user who is the administrator of that conference room).

[0061] After the notification is made, when a predetermined condition is satisfied, the user of the icon image 41_1 can participate in the conference room where the theme is casual conversation. The predetermined condition may be, for example, simply that a predetermined time (such as 1 second, 3 seconds, 5 seconds, etc.) has elapsed, or that participation has been permitted by a predetermined user (such as the administrator or participant of that conference room), or that the participation conditions preset for that conference room have been satisfied.

[0062] FIG. 9 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 9, two users are participating in the conference room where the theme is casual conversation. Therefore, inside the conference room area image 30 indicating the conference room where the theme is casual conversation, icon images 41 (41_1 and 41_2) of two users are displayed. At this point, the user of the icon image 41_1 and the user of the icon image 41_2 are participating in the same conference room. Therefore, the user of the icon image 41_1 and the user of the icon image 41_2 can have a conversation in the conference room where the theme is casual conversation. That is, users participating in the same conference room can have a conversation using the user terminal 10.

[0063] More specifically, it is as follows. The user terminal 10 of the user participating in the meeting room receives and outputs the voice data spoken by other users participating in the same meeting room. Also, the user terminal 10 of the user participating in the meeting room transmits the voice data spoken by that user to the conversation control device 20. By this transmission, in the user terminals 10 of other users participating in the same meeting room, that voice data is output. When the user of the icon image 41_3 in the outdoor area 91 performs an operation for participating in a meeting room with chitchat as the theme, after a predetermined condition is satisfied, the user of the icon image 41_3 can participate in the meeting room with chitchat as the theme.

[0064] FIG. 10 is a diagram showing a specific example of an image displayed on the display unit 13 of the user terminal 10. In the example of FIG. 10, three users are participating in a meeting room with chitchat as the theme. Therefore, inside the meeting room area image 30 indicating the meeting room with chitchat as the theme, icon images 41 (41_1, 41_2, and 41_3) of three users are displayed. At this point, the user of the icon image 41_1, the user of the icon image 41_2, and the user of the icon image 41_3 are participating in the same meeting room. Therefore, the user of the icon image 41_1, the user of the icon image 41_2, and the user of the icon image 41_3 can have a conversation in the meeting room with chitchat as the theme. Note that the same applies when four or more users participate in the same meeting room.

[0065] FIG. 11 is a diagram showing a specific example of the meeting room area image 30 of the meeting room to which the eavesdropping user is connected. The eavesdropping user cannot speak but can listen to the conversation content of other users in that meeting room. In other words, the conversation content of the eavesdropping user is not output to other users connected to the same meeting room, but the conversation content of other users entering the same meeting room is output to the eavesdropping user.

[0066] In the example of FIG. 11, a listening user is connected to a conference room with small talk as the theme. The icon image 41_3 of the listening user is displayed in the listening area 32. The icon image 41_3 of the listening user may be displayed in a different manner from the icon images 41 (for example, icon images 41_1 and 41_2) of users who are not listening users.

[0067] Next, a specific example of a procedure for notifying guest access information to a person to be invited to the conversation system 100 (a candidate for a guest user) will be described. FIG. 12 is a diagram showing a specific example of an operation screen for setting a conference room to a public state. When a regular user operates the details button 313, a details display area 512 is displayed. The details display area 512 includes a conference room name setting area 513 and a public setting area 514.

[0068] In the conference room name setting area 513, the current conference room name (for example, "small talk") and a conference room name change button are displayed. The conference room name change button may be displayed as a character string such as "Change Conference Room Name".

[0069] In the public setting area 514, a character string indicating the current state (for example, "Guest Public") and a guest access information display area 515 are displayed. In the example of FIG. 12, "Guest Public" is displayed as the character string indicating the current state. This indicates that it is in a public state. When a regular user operates the public setting area 514, it may transition from the current public state to a non-public state. For example, when a regular user performs a predetermined operation such as clicking or tapping in the public setting area 514, the conference room control unit 232 may transition from the public state to the non-public state or from the non-public state to the public state. Also, when a regular user transitions the state of the conference room from the public state to the non-public state, the conference room control unit 232 may forcibly log out all guest users who have entered that conference room from that conference room.

[0070] Guest access information is displayed in the guest access information display area 515. In the specific example of FIG. 12, the guest access information is a URL. For example, a regular user can set a conference room to the public state by operating the public setting area 514 and send the guest access information displayed in the guest access information display area 515 to the person to be invited. Through such an operation, the person to be invited can be invited as a guest user to the "Chat" conference room of the conversation system 100.

[0071] When the conference room control unit 232 receives an instruction to issue guest access information (URL or ID) from a user, it may issue new guest access information and transition the state of the conference room from the non-public state to the public state.

[0072] Note that in this embodiment, the guest access information is different for each conference room. Therefore, even if a certain guest user is invited to the first conference room, that guest user cannot enter other conference rooms using the guest access information at that time. Also, an expiration period may be provided for the guest access information. For example, the time during which a guest user can access the conference room using the guest access information may be limited after the guest access information is issued by operating the public setting area 514. Such control may be executed by, for example, the conference room control unit 232. Guest access information that allows access to a specific plurality of conference rooms may be issued as the guest access information.

[0073] The conference room area image 30 of a public conference room may be displayed in a different manner from the conference room area image 30 of a non-public conference room. For example, although the image of the conference room area image 30 itself does not change, an image indicating that it is in the public state (hereinafter referred to as the "public notice image") 516 may be displayed near the conference room area image 30. For example, it may be displayed so that the color, decoration, etc. of the conference room area image 30 itself are different, or the public notice image may be displayed inside the conference room area image 30.

[0074] FIG. 13 is a diagram showing a specific example of an image displayed when a guest user accesses a meeting room. When a guest user accesses the meeting room of the conversation system 100 using guest access information, a screen for entering a name is displayed on the user terminal 10 of the guest user. The guest user enters their own name (handle name). In the example of FIG. 13, the guest user entered the handle name "Patent Taro". Accordingly, a part of the handle name, "Patent", is displayed on the icon image 44 of the guest user. In this way, the icon image 44 of the guest user may be generated in a manner different from the icon image 41 of the regular user. For example, the color of the inside or the frame may be different, or a restriction may be provided such that the icon image 44 of the guest user is generated only with characters. The same applies to the above-described icon image 43 and the image 518. With such a configuration, it becomes possible to easily determine which icon belongs to the guest user.

[0075] When the guest user enters the waiting room and waits, an image as shown in FIG. 13 is displayed on the user terminal 10 of the regular user who has entered the meeting room. That is, a waiting notification image 517 is displayed. The waiting notification image 517 displays a predetermined image 518 indicating that the user is waiting, the handle name of the guest user waiting, and an approval / denial button. As the approval / denial button, an approval button for permitting the entry of the guest user and a denial button for approving or denying the entry of the guest user are displayed. The regular user approves or denies the entry of the guest user by operating either of the approval / denial buttons.

[0076] In addition, when a guest user enters the waiting room and waits in this way, a predetermined image indicating that the user is waiting may be displayed as the icon image 43 in the conversation area 31. By making such a display, the regular user can easily grasp in which conference room the waiting guest user is. Also, the image 518 and the icon image 43 may be the same image or different images. For example, an image indicating a bell may be used for the image 518 and the icon image 43.

[0077] FIG. 14 is a diagram showing a specific example of an image after a guest user enters the conference room. The icon image indicating the guest user may be displayed in a manner different from the icon image indicating the regular user. For example, in the example of FIG. 14, for the regular user, the image set for the regular user or the initial setting image is displayed as the icon image, but characters are displayed on the icon image of the guest user. This character may be, for example, part or all of the handle name of the guest user. By being displayed in different manners like this, each user who has entered can easily determine which user is the guest user and which user is the regular user.

[0078] FIG. 15 is a diagram showing a specific example of an image displayed on the user terminal 10 of the regular user. The image in FIG. 15 shows a specific example of an image displayed on the user terminal 10 of the regular user (the user of the icon image 41_4) in the conference room area image 30_1 particularly at the upper right of the screen. On the user terminal 10 of the regular user, images of conference rooms other than the conference room in which the user himself / herself has entered are also displayed. For example, images of other conference rooms ("New OS Development Project", "Meditation" conference rooms) and the icon images 41 of the users who have entered those conference rooms are displayed.

[0079] FIG. 16 is a diagram showing a specific example of an image displayed on the user terminal 10 of a guest user. The image in FIG. 16 shows a specific example of an image displayed on the user terminal 10 of a guest user (the user of the icon image 44_1) in the conference room area image 30_1 particularly located in the upper right of the screen. On the user terminal 10 of the guest user, images of conference rooms other than the conference room in which the user himself / herself has entered are not displayed. For example, neither the images of other conference rooms (each conference room of "New OS Development Project" and "Meditation") nor the icon images 41 of the users entering those conference rooms are displayed. By performing such control, the guest user cannot obtain any information about conference rooms other than the conference room to which the user has been invited (in the case of FIG. 16, the "Chat" conference room). Furthermore, the detail button 313 is not displayed on the user terminal 10 of the guest user. Therefore, the guest user cannot perform an operation using the detail button 313. As a result, it becomes possible to maintain security for the guest.

[0080] Also, as shown in FIG. 16, an image indicating the conference room in which the guest user has entered (such as the conference room area image 30 and images of other users entering that conference room) may be displayed in the center of the screen on the user terminal 10 of the guest user. At this time, depending on the size of the display frame on the user terminal 10, it may be displayed as large as possible within a possible range. For example, the conference room area image 30 may be enlarged and displayed within the range where the entire conference room area image 30 can be displayed. However, a predetermined margin may be provided in the vertical direction and / or the horizontal direction.

[0081] In the conversation system 100 configured as described above, it becomes possible to temporarily allow an informal user to participate in an online meeting (conversation in a conference room) as a guest user. Specifically, by setting the conference room to a public state and notifying the informal user to be invited of the guest access information, the informal user can enter the public conference room as a guest user.

[0082] In addition, the amount of information displayed on the user terminal 10 of the guest user is less than that displayed on the user terminal 10 of the regular user. For example, on the user terminal 10 of the guest user, information is not displayed for conference rooms other than the conference room in which the guest user is participating or the plurality of conference rooms to which the guest user has been invited. Therefore, in the conversation system 100 where it is assumed that an image showing a plurality of conference rooms is displayed, it is possible to realize the participation of guest users while maintaining a certain level of security.

[0083] [Second Embodiment] Next, a second embodiment of the conversation system 100 of the present invention will be described. In the conversation system 100 in the second embodiment, a user can communicate with other users belonging to the same conference room in text information by operating the operation unit 12 of the user terminal 10. Specifically, in the display unit 13 of the user terminal 10, a message display area showing text information (hereinafter referred to as "message") input by users belonging to the same conference room is displayed. Hereinafter, among the configurations of such a second embodiment, devices and configurations different from those of the first embodiment will be described.

[0084] FIG. 17 is a schematic block diagram showing a specific example of the functional configuration of the user terminal 10 in the second embodiment. The user terminal 10 in the second embodiment is different from that in the first embodiment in that the control unit 17 further functions as a message control unit 174.

[0085] The message information storage unit 174 transmits the character string input by the user via the operation unit 12 or the voice input unit 14 to the conversation control device 20 as a message.

[0086] FIG. 18 is a schematic block diagram showing a specific example of the functional configuration of the conversation control device 20 in the second embodiment. The conversation control device 20 in the second embodiment is different from that in the first embodiment in that the storage unit 22 further functions as a message information storage unit 224 and the control unit 23 further functions as a message control unit 235.

[0087] The message information storage unit 224 stores information regarding messages transmitted from each user terminal 10. For example, for each message, the message information storage unit 224 may store, in association with each other, the content of the message (the character string constituting the message), identification information indicating the user who is the sender of the message, information indicating the date and time when the message was input, and information indicating the conference room that is the destination of the message.

[0088] When the message control unit 235 receives a message from the user terminal 10, it registers information regarding the received message in the message information storage unit 224. The message control unit 235 instructs the display information generation unit 233 to display the content of the received message in the message display area of the user terminal 10 of the user belonging to the conference room that is the destination of the message. In this instruction, the message control unit 235 designates the user terminal 10 that is the display target for each individual message. For example, the content of the message is displayed only on the user terminals 10 of the users (including guest users) belonging to the same conference room, and is not displayed on the user terminals 10 of the users who have not entered the conference room.

[0089] When a predetermined situation change occurs regarding the conference room, the message control unit 235 receives a notification about the content from the conference room control unit 232. The message control unit 235 instructs the display information generation unit 233 to display a character string indicating the situation change in the message display area of the user terminal 10 of the user belonging to the conference room in which the predetermined situation change has occurred. Specific examples of the predetermined situation change may include, for example, that the setting of the conference room has been changed (for example, changed from a non - public state to a public state). Specific examples of the predetermined situation change may also include, for example, that a user has entered the conference room, a user has left the conference room, and a user outside the conference room has been invited (called to enter).

[0090] The message control unit 235 deletes messages that meet a predetermined condition among the messages stored in the message information storage unit 224. The predetermined condition may be, for example, that all users have left the conference room that is the destination of the message. In this case, all messages in the conference room where all users have left may be deleted at that time, or may be deleted after a predetermined time (for example, 1 minute, 1 hour, 24 hours, etc.) has elapsed since all users have left. The predetermined condition may be, for example, that even if there are users remaining in the conference room that is the destination of the message, the message may be deleted when a predetermined period (for example, 1 hour, 24 hours, 48 hours, etc.) has elapsed since the message was posted, or may be deleted when a predetermined time (for example, 0:00 am, 1:00 am, etc.) arrives after a predetermined period (for example, 1 hour, 24 hours, 48 hours, etc.) has elapsed since the message was posted.

[0091] The message control unit 235 may cause the user terminal 10 to display the message display area in a plurality of different modes. For example, a message notification mode and a message history mode are defined, and the message display area may be displayed in different modes in each mode. Hereinafter, specific examples of the display mode of the message display area in each mode will be described.

[0092] FIGS. 19 and 20 are diagrams showing specific examples of the message display area in the message notification mode. In the message notification mode, the message display area 61 and the message operation area 70 are displayed in a part of the operation area image 51. In the message operation area 70, a message input field 71, a message post button 72, and a mode change button 73 are displayed. In the message input field 71, the character string of the message input by the user via the operation unit 12 or the voice input unit 14 is displayed. The message post button 72 is a button for posting the character string displayed in the message input field 71 as a message when operated. The mode change button 73 is a button for switching between the message notification mode and the message history mode.

[0093] The posting of messages may be performed only by, for example, the users who have entered the conference room. It may be controlled so that the users participating as eavesdropping users in the conference room can also post messages. It may be controlled so that the users participating as guest users in the conference room can also post messages. The users who have not entered the conference room and are not participating as eavesdropping users or guest users may be controlled so that they cannot post messages to that conference room and cannot view (display) messages either.

[0094] The size of the message display area 61 displayed in the message notification mode is relatively small compared to the message display area 62 displayed in the message history mode. Therefore, the number of messages displayed in the message display area 61 in the message notification mode is relatively small compared to the message display area 62 displayed in the message history mode. With this configuration, in the message notification mode, a view for workspace and material sharing can be secured. In other words, in the message notification mode, it is possible to secure a large space for displaying characters and images other than messages.

[0095] In the message notification mode, the message is displayed in the message display area 61 immediately after it is posted. When a predetermined time (for example, several seconds, 5 seconds, 10 seconds, etc.) has elapsed since the message was posted, even if there is space to display the message in the message display area 61, the message will no longer be displayed in the message display area 61 (the display is deleted). The predetermined time is shorter than the end of a general conversation and may be several seconds as described above or may be 5 to 10 seconds long. With this configuration, old messages disappear from the screen one after another, making it possible to provide a lively and dynamic appearance.

[0096] In the message display area 61 of FIG. 19, five messages are displayed. Each message is displayed in the order in which it was posted. For example, the message "Calling Mr. Patent" displayed at the top is the message posted by the user of the icon image 41_1 and is the oldest message among the five messages. The message "Called Mr. Patent" displayed below it is a message displayed in response to a predetermined change in the situation in the conference room and is the second oldest message among the five messages. The message "Mr. Patent has entered the room" displayed below it is a message displayed in response to a predetermined change in the situation in the conference room and is the third oldest message among the five messages. The message "I'm Patent. Nice to meet you" displayed below it is the message posted by the guest user of the icon image 44 and is the fourth oldest message among the five messages. The message "Nice to meet you, Mr. Patent" displayed at the bottom (the very bottom) is the message posted by the user of the icon image 41_4 and is the fifth (the newest) oldest message among the five messages.

[0097] FIG. 20 is a screen shown after a predetermined time (for example, several seconds) has elapsed since the screen shown in FIG. 19 was displayed. In FIG. 20, two messages for which a predetermined time has elapsed since they were posted are not displayed among the five messages displayed at the time of FIG. 19.

[0098] FIGS. 21 and 22 are diagrams showing specific examples of the message display area in the message history mode. In the message history mode, a message display area 62 is displayed in a part of the operation area image 51. The size of the message display area 62 displayed in the message history mode is relatively larger than the message display area 61 displayed in the message notification mode. Therefore, more messages are displayed. By being configured in this way, in the message history mode, a view for checking the message history can be secured.

[0099] In the message history mode, all the message histories recorded in the message information storage unit 224 in that conference room are displayed in the message display area 62. However, the number of messages displayed in the message display area 62 at one time is determined according to the size and resolution of the display unit 13 of the user terminal 10, the size of the operation area image 51, etc. Therefore, it may not be possible to display all the messages recorded in the message information storage unit 224 at one time. In such a case, as shown in FIG. 21, a scroll bar 621 is displayed, and it becomes possible to view all the messages by scrolling the screen.

[0100] The guest user can only view the messages posted during the period when the conference room is in the public state among the messages recorded for the conference room entered. Therefore, an image indicating a message posted when the conference room is in the non-public state is not transmitted to the user terminal 10 of the guest user. Only an image indicating a message posted when the conference room is in the public state is transmitted to the user terminal 10 of the guest user.

[0101] In the message display area 62 of FIG. 21, 11 messages are displayed. Among these messages, the messages before (above) the 6th message, ""Chat"" has been made public"" are messages posted when the conference room is in the non-public state. Among these messages, the messages after (below) the 6th message, ""Chat"" has been made public"" are messages posted when the conference room is in the public state. Therefore, the image shown in FIG. 21 is displayed on the user terminal 10 of a user who is not a guest user. On the other hand, as shown in FIG. 22, messages posted when the conference room is in the non-public state are not displayed on the user terminal 10 of the guest user.

[0102] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and designs and the like within the scope not departing from the gist of the present invention are also included.

Explanation of Reference Numerals

[0103] 100... Conversation system, 10... User terminal, 20... Conversation control device, 11... Communication unit, 12... Operation unit, 13... Display unit, 14... Voice input unit, 15... Voice output unit, 16... Storage unit, 161... User information storage unit, 17... Control unit, 171... Display control unit, 172... Conference control unit, 173... Conversation control unit, 21... Communication unit, 22... Storage unit, 221... Regular user information storage unit, 222... Guest user information storage unit, 223... Conference room information storage unit, 23... Control unit, 231... User control unit, 232... Conference room control unit, 233... Display information generation unit, 234... Conversation control unit, 30... Conference room area image, 31... Conversation area, 311... Name of the conference room, 312... Entrance button, 313... Details button, 32... Listening area, 41... Icon image, 42... User status image, 91... Outdoor area

Claims

1. A virtual conference room for conducting conversations via a network, comprising a conference room area image which is an image showing the currently installed conference room, and an icon image showing a user, and when a plurality of conference rooms are installed, generating display data necessary for displaying an image including a plurality of conference room area images according to the number thereof to a user terminal, a display information generation unit; A conference room control unit that controls participation in the conference room according to a user's operation; A conversation control unit that controls conversations between users participating in the same conference room; Comprising; When a regular user who is pre-registered among the users participates in the conference room, and when a guest user who is temporarily allowed to participate by a regular user among the users participates in the conference room, the conference room control unit performs different processes; The display information generation unit generates the display data so that information about conference rooms other than the conference room in which the regular user has entered is also displayed on the user terminal of the regular user, and information about conference rooms other than the conference room in which the guest user has entered is not displayed on the user terminal of the guest user. A conversation control device.

2. Further comprising a message control unit that controls conversations between users using text messages conducted in the conference room; The display information generation unit generates display data further including the messages of the conversations in the conference room. The conversation control device according to Claim 1.

3. A virtual conference room for conducting conversations via a network, comprising a conference room area image which is an image showing the currently installed conference room, and an icon image showing a user, and when a plurality of conference rooms are installed, generating image data including a plurality of conference room area images according to the number thereof, an image data generation unit; A conference room control unit that controls participation in the conference room according to a user's operation; A conversation control unit that controls conversations between users participating in the same conference room; Comprising; When a regular user who is pre-registered among the users participates in the conference room, and when a guest user who is temporarily allowed to participate by a regular user among the users participates in the conference room, the conference room control unit performs different processes; the image data generation unit generates different image data for a regular user terminal which is a user terminal operated by the regular user and a guest user terminal which is a user terminal operated by the guest user; the image data generation unit generates the image data such that information about conference rooms other than the conference room in which the authorized user is present is also displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room in which the guest user is present is not displayed on the user terminal of the guest user. Conversation system.

4. A message control unit controls a conversation between users using text messages in the conference room, The chat system according to claim 3 , wherein the image data generating unit generates image data further including a message of the conversation in the conference room.

5. a display information generating step in which the computer generates display data necessary for displaying on a user terminal an image including a conference room area image, which is an image showing a currently installed conference room, and an icon image showing a user, as a virtual conference room for conversations via a network, and a plurality of conference room area images according to the number of conference rooms installed when a plurality of conference rooms are installed; a conference room control step in which a computer controls participation in the conference room in response to an operation by a user; A conversation control step in which the computer controls a conversation between users participating in the same conference room; In the conference room control step, the computer performs different processes depending on whether a pre-registered regular user among the users participates in the conference room or whether a guest user who is permitted to temporarily participate by a regular user among the users participates in the conference room; A conversation control method, in which, in the display information generation step, the computer generates the display data so that information about conference rooms other than the conference room in which the authorized user is present is displayed on the user terminal of the authorized user, and information about conference rooms other than the conference room in which the guest user is present is not displayed on the user terminal of the guest user.

6. The method further comprises a message control step of controlling a conversation between users using text messages in the conference room, The conversation control method according to claim 5, wherein in the display information generation step, display data further including the messages of the conversation in the conference room is generated.

7. A virtual conference room for a computer to conduct a conversation via a network, including a conference room area image that is an image showing the currently installed conference room and an icon image showing a user, and generating image data including a plurality of conference room area images according to the number when a plurality of conference rooms are installed. An image data generation step; A conference room control step in which a computer controls participation in the conference room according to a user's operation; A conversation control step in which a computer controls the conversation between users participating in the same conference room; Comprising: In the conference room control step, the computer performs different processes when a regular user who is pre-registered among the users participates in the conference room and when a guest user who is temporarily allowed to participate by a regular user among the users participates in the conference room. In the image data generation step, the computer generates different image data for a regular user terminal that is a user terminal operated by the regular user and a guest user terminal that is a user terminal operated by the guest user. In the image data generation step, information about conference rooms other than the conference room in which the regular user has entered is also displayed on the user terminal of the regular user, and the image data is generated so that information about conference rooms other than the conference room in which the guest user has entered is not displayed on the user terminal of the guest user. Conversation control method.

8. The computer further has a message control step of controlling the conversation between users using the text messages conducted in the conference room. The conversation control method according to claim 7, wherein in the image data generation step, the computer generates image data further including the messages of the conversation in the conference room.

Images