Information processing system, information processing method, and information processing program

Abstract

To efficiently prompt conversations including the start of conversations between avatars in a virtual space and the activization of such conversations.SOLUTION: An information processing system includes: an image generating unit that generates a terminal-outputting image that represents a virtual space including avatars associated with respective users; an information outputting unit that outputs, on the basis of conversation-relevant inputs from the respective users associated with the avatars in the virtual space, character information or speech information that each user can view or listen together with the terminal-outputting image; a theme identifying unit that identifies the theme of the conversations on the basis of the conversation-relevant inputs regarding the conversations established between the users on the basis of the character information or the speech information output by the information outputting unit; and a theme information outputting process unit that executes a theme information outputting process that causes theme information representing the identified theme of the conversation by the theme identifying unit to be contained in the terminal-outputting image.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] There is known a technique for changing the position of a virtual character (avatar) in a virtual space in response to the occurrence of a conversation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-009681 Summary of the Invention [Problem to be solved by the invention]

[0004] With the conventional techniques described above, it is difficult to effectively promote conversation, including initiating and activating conversation, between avatars in a virtual space.

[0005] Therefore, in one aspect, an object of the present disclosure is to effectively promote conversation, including initiating conversation and activating conversation, between avatars in a virtual space. [Means for solving the problem]

[0006] On one side, a theme identification unit that identifies a theme of a conversation based on a conversation-related input regarding a conversation that is being held between users based on character information or voice information in a virtual space; a user information storage unit that stores information about the user in association with the user; A user extraction unit that extracts users to be guided; a guidance processing unit that determines a theme to be guided to the guidance target user, is provided. Effect of the Invention

[0007] In one aspect, the present disclosure makes it possible to effectively promote conversation, including initiating and activating conversation, between avatars in a virtual space. In another aspect, according to the present disclosure, it is possible to simultaneously achieve a reduction in data volume and processing load and increased communication. In another aspect, according to the present disclosure, it is possible to reduce the number of operations by the user, thereby achieving improved usability and reduced processing load. In still another aspect, according to the present disclosure, it becomes possible to effectively display information required by a user. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram of a virtual reality generation system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an explanatory diagram of a terminal image viewable through a head mounted display. [Diagram 3] FIG. 1 is a conceptual diagram of a talk room in a virtual space. [Figure 4] FIG. 13 is a conceptual diagram of another talk room in a virtual space. [Diagram 5] 1 is an explanatory diagram of an example of a virtual space that can be generated by a virtual reality generation system. [Figure 6] FIG. 13 is an explanatory diagram of areas with different attributes around a moderator avatar in a virtual space. [Figure 7] FIG. 13 is an explanatory diagram of an example of a moderator avatar (talk room) generation mode based on a specified talk theme. [Figure 8] FIG. 13 is an explanatory diagram of another example of a moderator avatar (talk room) generation mode based on a specified talk theme. [Figure 9] FIG. 13 is an explanatory diagram showing an overview of a talk room formed based on a specified talk theme. [Figure 10] This is an explanatory diagram (part 1) of various chat room configurations. [Figure 11] This is an explanatory diagram (part 2) of various chat room configurations. [Figure 12] FIG. 13 is an explanatory diagram of an example of the arrangement of talk rooms according to the level of detail (hierarchy) of the talk topic. [Figure 13]FIG. 11 is an explanatory diagram showing an example of a talk room selection screen for viewing on a smartphone or the like. [Figure 14] 14 is a diagram showing an example of a talk room image (image for terminal) for a participating user when the participating user enters one talk room via the talk room selection screen shown in FIG. 13. FIG. [Figure 14A] FIG. 13 is a diagram showing another example of a talk room image for participating users. [Figure 14B] FIG. 13 is a diagram showing another example of a talk room image for participating users. [Figure 15] 11 is an explanatory diagram illustrating an example of a talk room selection screen for viewing on a head mounted display. FIG. [Figure 16] A schematic block diagram showing the functions of a server device related to the above-mentioned talk theme. [Figure 17] FIG. 2 is an explanatory diagram showing an example of data in a talk history storage unit. [Figure 18] 11 is an explanatory diagram showing an example of data in a talk status storage unit. FIG. [Figure 19] FIG. 4 is an explanatory diagram showing an example of data in a user information storage unit. [Figure 20] FIG. 4 is an explanatory diagram of various tables. [Figure 21] FIG. 2 is an explanatory diagram illustrating an example of data in an avatar information storage unit. [Figure 22] FIG. 2 is an explanatory diagram of a hierarchical structure of talk topics. [Figure 23] A schematic block diagram showing the functions of a terminal device related to a talk topic. [Figure 24] FIG. 13 is an explanatory diagram showing an example of an effect of an output by an activity output unit. [Diagram 25] FIG. 13 is a diagram showing an example of a user interface suitable for a virtual space in which an avatar can move freely. [Figure 26] 11A and 11B are diagrams illustrating a part direction operation input by a gesture. [Figure 27] FIG. 13 is a diagram showing an example of an image for a user's terminal for explaining an example of a guidance process. [Figure 28] An explanatory diagram of the operational flow from the creation of a talk room to the end of distribution. [Figure 29] 2 is a flow chart showing an example of the operation of the virtual reality generation system shown in FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] An overview of a virtual reality generation system 1 according to an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram of the virtual reality generation system 1 according to the present embodiment. Fig. 2 is an explanatory diagram of a terminal image viewable through a head mounted display.

[0011] The virtual reality generation system 1 includes a server device 10 and one or more terminal devices 20. For simplicity, three terminal devices 20 are illustrated in Fig. 1, but the number of terminal devices 20 may be two or more.

[0012] The server device 10 is, for example, an information processing system such as a server managed by an operator that provides one or more virtual realities. The terminal device 20 is, for example, a device used by a user, such as a mobile phone, a smartphone, a tablet terminal, a PC (Personal Computer), a head-mounted display, or a game device. A plurality of terminal devices 20 can be connected to the server device 10 via the network 3, typically in a different manner for each user.

[0013] The terminal device 20 is capable of executing a virtual reality application according to this embodiment. The virtual reality application may be received by the terminal device 20 from the server device 10 or a predetermined application distribution server via the network 3, or may be stored in advance in a storage device provided in the terminal device 20 or a storage medium such as a memory card readable by the terminal device 20. The server device 10 and the terminal device 20 are communicatively connected via the network 3. For example, the server device 10 and the terminal device 20 cooperate to execute various processes related to virtual reality.

[0014] In the virtual reality generation system 1, users may be classified into a host side (content distribution side) and a participant side (content viewing side), or the users may be used on an equal footing without distinguishing between the two. When users are classified into a host side and a participant side, the terminal device 20 includes a terminal device 20A on the host side (content distribution side) and a terminal device 20B on the participant side (content viewing side). When users are not classified into a host side and a participant side, the terminal device 20 is not classified into a terminal device 20A on the host side and a terminal device 20B on the participant side. In the following, for the sake of explanation, the terminal device 20A on the host side and the terminal device 20B on the participant side are described as separate terminal devices, but the terminal device 20A on the host side may become the terminal device 20B on the participant side, or vice versa. In the following, when the terminal device 20A and the terminal device 20B are not particularly distinguished from each other, they may be simply referred to as "terminal device 20".

[0015] The terminal devices 20 are connected to each other so as to be able to communicate with each other via the server device 10. In the following, "one terminal device 20 transmits information to another terminal device 20" means "one terminal device 20 transmits information to another terminal device 20 via the server device 10". Similarly, "one terminal device 20 receives information from another terminal device 20" means "one terminal device 20 receives information from another terminal device 20 via the server device 10". However, in a modified example, the terminal devices 20 may be connected to each other so as to be able to communicate with each other without going through the server device 10.

[0016] The network 3 may include a wireless communication network, the Internet, a Virtual Private Network (VPN), a Wide Area Network (WAN), a wired network, or any combination of these.

[0017] 1, the virtual reality generation system 1 includes studio units 30A and 30B. The studio units 30A and 30B are devices on the host side, similar to the host side terminal device 20A. The studio units 30A and 30B may be arranged in a studio, room, hall, or the like for content production.

[0018] Each studio unit 30 can have the same functions as the terminal device 20A on the host side and / or the server device 10. In the following, when distinguishing between the host side and the participant side, for simplicity of explanation, a mode in which the terminal device 20A on the host side distributes various contents to the terminal devices 20B on each participant side via the server device 10 will be mainly described. However, instead of or in addition to this, the studio units 30A and 30B facing the host side user may have the same functions as the terminal device 20A on the host side, and distribute various contents to the terminal devices 20B on each participant side via the server device 10. In addition, in a modified example, the virtual reality generation system 1 may not include the studio units 30A and 30B.

[0019] In the following, the virtual reality generation system 1 realizes an example of an information processing system, but each element of a specific terminal device 20 (see the terminal communication unit 21 to the terminal control unit 25 in FIG. 1) may realize an example of an information processing system, or a plurality of terminal devices 20 may cooperate to realize an example of an information processing system. Also, the server device 10 may independently realize an example of an information processing system, or the server device 10 and one or more terminal devices 20 may cooperate to realize an example of an information processing system.

[0020] Here, an overview of the virtual reality according to the present embodiment will be described. The virtual reality according to the present embodiment is a virtual reality for any reality, such as education, travel, role-playing, simulation, entertainment such as games and concerts, and a virtual reality medium such as an avatar is used in conjunction with the execution of the virtual reality. For example, the virtual reality according to the present embodiment is realized by a three-dimensional virtual space, various virtual reality media appearing in the virtual space, and various contents provided in the virtual space.

[0021] The virtual reality medium is electronic data used in virtual reality, and includes any medium, such as cards, items, points, in-service currency (or in-virtual reality currency), tokens (e.g., Non-Fungible Token (NFT)), tickets, characters, avatars, parameters, etc. The virtual reality medium may also be virtual reality-related information, such as level information, status information, parameter information (stamina value and attack power, etc.), or ability information (skills, abilities, spells, jobs, etc.). The virtual reality medium is electronic data that can be acquired, owned, used, managed, exchanged, synthesized, enhanced, sold, discarded, or donated by a user in virtual reality, but the manner of use of the virtual reality medium is not limited to those explicitly described in this specification.

[0022] In this embodiment, when users are classified into a host side and a participant side, the users include a participant side user who watches various contents and a host side user who distributes a specific talk content (an example of a predetermined digital content) described later via a moderator avatar M2 described later. When users are not classified into a host side and a participant side, the users include a plurality of equal users.

[0023] In addition, the host user, as a participating user, can also view specific talk content by other host users, and conversely, the participating user, as a host user, can also distribute specific talk content. However, in the following, for the convenience of preventing the explanation from becoming complicated, the participating user is the participating user at that time, and the host user is the host user at that time. In addition, in the following, when there is no particular distinction between the host user and the participating user, they may be simply referred to as "users". In addition, in the following, when there is no particular distinction between the participant avatar M1 and the moderator avatar M2 related to the participating user, they may be simply referred to as "avatars". In addition, in the following, due to the nature of the avatar, the user and the avatar may be described as being the same. Therefore, for example, "one avatar does ____" may be synonymous with "one user does ____".

[0024] The avatar is typically a character facing forward, and may be a human, animal, or similar. The avatar can have a variety of appearances (appearances when drawn) by being associated with various avatar items.

[0025] The participant users and the host users may wear a wearable device on their head or part of their face and view the virtual space through the wearable device. The wearable device may be a head-mounted display or a glasses-type device. The glasses-type device may be so-called AR (Augmented Reality) glasses or MR (Mixed Reality) glasses. In either case, the wearable device may be separate from the terminal device 20, or may realize some or all of the functions of the terminal device 20. The terminal device 20 may be realized by a head-mounted display.

[0026] Alternatively, the participant users and the host users may view the virtual space through a display screen using a device having a screen such as a smartphone or a personal computer. In this case, the virtual space may be represented substantially in two dimensions.

[0027] The following mainly describes specific talk content that allows conversation between users (avatars) among various contents distributed by the server device 10. In addition, the following description describes content that is suitable for viewing via a head-mounted display, a smartphone, or the like.

[0028] The specific talk content by the host user is a user-participation type talk content that allows participation by users other than the host user, and is a video content involving conversations between multiple users through their avatars. The specific talk content by the host user may be a type of content in which a conversation is held along a theme determined by the host user. In addition, in the specific talk content by the host user, a moderator avatar M2 related to the host user may appear in the virtual space, and the moderator avatar M2 changes its orientation, position, movement, etc. according to the orientation, position, movement, etc. of the host user. Note that the orientation, position, and movement of the host user are concepts that include not only the orientation, position, and movement of a part or all of the host user's body, such as the face and hands, but also the orientation, position, movement, or the like of the host user's gaze.

[0029] The specific talk content by the host user typically involves a conversation in any manner via the moderator avatar M2. For example, the specific talk content by the host user may be related to a chat, a meeting, a gathering, a conference, or the like.

[0030] In addition, the specific talk content by the host user may include a form of collaboration between two or more host users (hereinafter, abbreviated as "collaboration"). This enables distribution in various forms and promotes interaction between host users.

[0031] The server device 10 can also distribute content other than the specific talk content by the host user. The type and number of content (content provided in virtual reality) provided by the server device 10 is arbitrary, but in the present embodiment, as an example, the content provided by the server device 10 may include digital content such as various images. The images may be real-time images or non-real-time images. The images may also be images based on real images or images based on CG (Computer Graphics). The images may be images for providing information. In this case, the images may be related to an information providing service in a specific genre (information providing service related to travel, housing, food, fashion, health, beauty, etc.), a broadcasting service by a specific user (for example, Youtube (registered trademark)), etc.

[0032] The manner in which content is provided in virtual reality is diverse and may be other than the manner in which it is provided using the display function of a head-mounted display. For example, if the content is a video, the content may be provided by drawing the video on a display of a display device (virtual reality medium) in the virtual space. The display device in the virtual space may be in any form, and may be a screen installed in the virtual space, a large-screen display installed in the virtual space, a display of a mobile terminal in the virtual space, or the like.

[0033] In addition, the content in the virtual reality may be viewable by a method other than through a head-mounted display, as described above. For example, the content in the virtual reality may be viewed directly (without through a head-mounted display) through a smartphone, tablet, or the like.

[0034] (Server device configuration) The configuration of the server device 10 will be specifically described. The server device 10 is composed of a server computer. The server device 10 may be realized by a plurality of server computers working together. For example, the server device 10 may be realized by a server computer that provides various contents, a server computer that realizes various authentication servers, and the like working together. The server device 10 may also include a Web server. In this case, some of the functions of the terminal device 20 described later may be realized by a browser processing an HTML document received from the Web server and various programs (Javascript) associated therewith.

[0035] As shown in FIG. 1, the server device 10 includes a server communication unit 11, a server storage unit 12, and a server control unit 13.

[0036] The server communication unit 11 includes an interface that communicates with an external device wirelessly or wiredly and transmits and receives information. The server communication unit 11 may include, for example, a wireless LAN (Local Area Network) communication module or a wired LAN communication module. The server communication unit 11 is capable of transmitting and receiving information to and from the terminal device 20 via the network 3.

[0037] The server memory unit 12 is, for example, a storage device, and stores various information and programs necessary for various processes related to virtual reality.

[0038] The server control unit 13 may include a dedicated microprocessor or a CPU (Central Processing Unit) that realizes a specific function by reading a specific program, a GPU (Graphics Processing Unit), etc. For example, the server control unit 13 cooperates with the terminal device 20 to execute a virtual reality application in response to a user operation on the display unit 23 of the terminal device 20.

[0039] (Terminal Device Configuration) The following describes the configuration of the terminal device 20. As shown in Fig. 1, the terminal device 20 includes a terminal communication unit 21, a terminal storage unit 22, a display unit 23, an input unit 24, and a terminal control unit 25.

[0040] The terminal communication unit 21 includes an interface for communicating with an external device wirelessly or wiredly and transmitting and receiving information. The terminal communication unit 21 may include a wireless communication module, a wireless LAN communication module, or a wired LAN communication module that supports mobile communication standards such as LTE (Long Term Evolution) (registered trademark), LTE-A (LTE-Advanced), a fifth generation mobile communication system, and UMB (Ultra Mobile Broadband). The terminal communication unit 21 is capable of transmitting and receiving information to and from the server device 10 via the network 3.

[0041] The terminal storage unit 22 includes, for example, a primary storage device and a secondary storage device. For example, the terminal storage unit 22 may include a semiconductor memory, a magnetic memory, an optical memory, or the like. The terminal storage unit 22 stores various information and programs used in the virtual reality processing received from the server device 10. The information and programs used in the virtual reality processing may be acquired from an external device via the terminal communication unit 21. For example, a virtual reality application program may be acquired from a predetermined application distribution server. Hereinafter, the application program may also be simply referred to as an application.

[0042] The terminal storage unit 22 also stores data for rendering virtual spaces, such as images of indoor spaces such as buildings and outdoor spaces. Note that multiple types of data for rendering virtual spaces may be prepared for each virtual space and used separately.

[0043] The terminal storage unit 22 also stores various images (texture images) to be projected (texture mapping) onto various objects arranged in the three-dimensional virtual space.

[0044] For example, the device storage unit 22 stores avatar drawing information related to a participant avatar M1 as a virtual reality medium associated with each user. The participant avatar M1 is drawn in the virtual space based on the avatar drawing information related to the participant avatar M1.

[0045] The device storage unit 22 also stores avatar drawing information for a moderator avatar M2 as a virtual reality medium associated with each host user. The moderator avatar M2 is drawn in the virtual space based on the avatar drawing information for the moderator avatar M2.

[0046] The terminal storage unit 22 also stores drawing information related to various objects different from the participant avatar M1 and the moderator avatar M2, such as various gift objects, buildings, walls, or NPCs (Non Player Characters). Various objects in the virtual space are drawn based on the drawing information. A gift object is an object corresponding to a gift from one user to another user, and is a part of an item. The gift object may be something worn by the avatar (clothes or accessories), something to decorate the chat room image (or the corresponding space in the virtual space) (fireworks, flowers, etc.), a background (wallpaper), or the like, or a ticket or the like that can be used to spin a gacha (lottery). The term "gift" used in the present application means the same concept as the term "token". Therefore, the technology described in the present application can be understood by replacing the term "gift" with the term "token".

[0047] The display unit 23 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 23 is capable of displaying a variety of images. The display unit 23 is configured with, for example, a touch panel, and functions as an interface that detects a variety of user operations. Note that the display unit 23 may be in a form built into a head-mounted display, as described above.

[0048] The input unit 24 may include a physical key, or may further include any input interface including a pointing device such as a mouse. The input unit 24 may also be capable of accepting non-contact user input such as voice input, gesture input, and gaze input. For gesture input, a sensor (such as an image sensor, an acceleration sensor, or a distance sensor) for detecting various states of the user, a dedicated motion capture device integrating sensor technology and a camera, or a controller such as a joypad may be used. The camera for gaze detection may also be disposed in a head-mounted display. As described above, the various states of the user are, for example, the user's orientation, position, movement, or the like. In this case, the user's orientation, position, and movement are concepts that include not only the orientation, position, and movement of a part or the whole of the user's body such as the face or hands, but also the orientation, position, movement, or the like of the user's gaze.

[0049] The terminal control unit 25 includes one or more processors. The terminal control unit 25 controls the operation of the entire terminal device 20.

[0050] The terminal control unit 25 transmits and receives information via the terminal communication unit 21. For example, the terminal control unit 25 receives various information and programs used for various processes related to virtual reality from at least one of the server device 10 and another external server. The terminal control unit 25 stores the received information and programs in the terminal storage unit 22. For example, the terminal storage unit 22 may store a browser (Internet browser) for connecting to a Web server.

[0051] The terminal control unit 25 starts a virtual reality application in response to a user's operation. The terminal control unit 25 cooperates with the server device 10 to execute various processes related to virtual reality. For example, the terminal control unit 25 causes the display unit 23 to display an image of a virtual space. For example, a GUI (Graphic User Interface) that detects a user operation may be displayed on the screen. The terminal control unit 25 can detect a user operation via the input unit 24. For example, the terminal control unit 25 can detect various operations by a user's gesture (operations corresponding to a tap operation, a long tap operation, a flick operation, a swipe operation, etc.). The terminal control unit 25 transmits operation information to the server device 10.

[0052] The terminal control unit 25 draws the moderator avatar M2 and the participant avatar M1 together with the virtual space (image), and displays the terminal image on the display unit 23. In this case, for example, as shown in FIG. 2, a stereoscopic image may be generated by generating images G200 and G201 that are viewed by the left and right eyes, respectively. In FIG. 2, the images G200 and G201 that are viewed by the left and right eyes, respectively, are shown typically. In the following, unless otherwise specified, the image of the virtual space refers to the entire image represented by the images G200 and G201. In addition, the terminal control unit 25 realizes various movements of the moderator avatar M2 in the virtual space in response to various operations by the host user, for example. A specific drawing process of the terminal control unit 25 will be described later.

[0053] In the case of user-participation talk content, such as specific talk content by a host user, if many users, including beginner users, can participate, the conversation becomes lively and active, increasing the appeal of the talk content. In addition, this also has the effect of promoting interaction between users and increasing the appeal of the virtual space.

[0054] However, when a large number of user-participation talk contents are distributed, it may not be easy for each user to find talk contents that are easy to participate in. For example, if the theme of the talk content cannot be understood from the thumbnail alone, the hurdle to viewing or participating in the talk content is likely to be high. In addition, there may be differences in the language used, and there is also a problem that it is not possible to reach talk contents where people who are having interesting conversations gather. There is also a problem that it is not possible to know what language the other person speaks or what their interests are unless you have a conversation or speak.

[0055] Such a problem may occur not only in specific talk content by a host user when users are classified as host and participant, but also in free-to-join (free-to-enter) talk rooms when users are not classified as host and participant. For example, in a virtual space (a world-type virtual space) in which avatars can move around freely, various talk rooms may be set up in the virtual space, or multiple avatars may gather and naturally generate talk rooms. In a world-type virtual space, specific talk content is generated based on a terminal image from the viewpoint of a virtual camera placed in the virtual space. In such a case, if the topic of the conversation taking place in the talk room cannot be known from the outside, the hurdle of entering the talk room is likely to be high.

[0056] Therefore, in this embodiment, as described in detail below, a talk theme (conversation theme) is specified and output for a conversation in a specific talk content or a free-to-join (free-to-enter) talk room by a host user, thereby lowering the hurdle for each user to view and participate in a conversation in a specific talk content or a talk room. That is, it is possible to promote each user's viewing and participation in a conversation in a specific talk content or a talk room. In addition, by activating viewing and participation, it is possible to effectively promote new users to participate in a conversation, that is, to start a new conversation. In addition, in this embodiment, it is possible to simultaneously achieve a reduction in the amount of data and processing load and an activation of communication. For example, if an information processing system is designed to output all the details before entering a conversation, the amount of communication data increases and the amount of information becomes too much for the user to understand. In contrast, in this embodiment, as described in detail below, only the talk theme display is executed before entering a conversation, and the details can be viewed only after participating in the conversation, thereby simultaneously achieving a reduction in the processing load of the server and terminal and an activation of communication by efficiently selecting a conversation in which the user wants to participate. Furthermore, in this embodiment, it is possible to reduce the number of operations performed by the user, thereby improving usability and reducing the processing load. That is, in this embodiment, as described in detail below, by searching for conversations by talk topic, displaying talk topics before participating in a conversation, and guiding to a conversation with a favorite talk topic, it is possible to reduce the number of operations required for the user to reach a desired conversation, thereby improving usability and reducing the processing load.

[0057] Here, the configuration regarding the talk theme will be described with reference to FIG. 3 to FIG.

[0058] FIG. 3 is a conceptual diagram of one talk room in a virtual space. In the example shown in FIG. 3, a talk room 300R in a conference format is associated with a display medium 302R (an example of a predetermined display medium) indicating the talk theme. The display medium 302R may include images, videos, 3D objects, and the like in addition to character information indicating the corresponding talk theme. As described later, the talk theme may be identified by extracting keywords in the conversation held in the talk room, but a table of association between the extracted keywords and character information of the talk theme and images, videos, 3D objects, and the like may be prepared, and the talk theme may be identified by images, videos, 3D objects, and the like corresponding to the talk theme. In the following description, when character information and the like is mentioned, it is used as a concept including images, videos, 3D objects, and the like obtained in this way. By having such a display medium 302R, it is possible to promote viewing and participation of each user in the conversation in the talk room 300R. In FIG. 3, the display medium 302R is in the form of a signboard (second object M3), but it may be in another form.

[0059] FIG. 4 is a conceptual diagram of another talk room in a virtual space. In the example shown in FIG. 4, a talk room 400R in a presentation format or a panel discussion format is associated with a display medium 402R indicating the talk theme. The display medium 402R may include text information indicating the corresponding talk theme. By having such a display medium 402R, it is possible to promote each user's viewing and participation in the conversation in the talk room 400R. In other words, by allowing a user to understand the content of a conversation before participating in an already started conversation, participation in the conversation can be promoted and communication between users can be activated.

[0060] FIG. 5 is an explanatory diagram of an example of a virtual space that can be generated by the virtual reality generation system 1. As shown in FIG.

[0061] In this embodiment, the virtual space may include a plurality of spatial parts. Each of the plurality of spatial parts is a spatial part into which the participating avatar M1 can enter, and each of the plurality of spatial parts may be capable of providing unique content. Each of the plurality of spatial parts may be generated in a manner that forms a space that is continuous with each other in the virtual space, similar to various spaces in reality. Alternatively, some or all of the plurality of spatial parts may be separated by walls or doors (second objects M3), or may be discontinuous with each other. Discontinuity refers to a relationship that is connected in a manner that violates the physical laws in reality, for example, a relationship between spatial parts that allows movement in a manner of instantaneous movement such as warp.

[0062] 5, the virtual space includes a space section 70 for multiple talk rooms and a free space section 71. In the free space section 71, the participant avatar M1 can basically move freely. Note that even in the free space section 71, conversations related to specific talk content (for example, specific talk content provided in the space section 70, which will be described later) can take place as appropriate.

[0063] The space section 70 may be a space section at least partially separated from the free space section 71 by a wall (an example of the second object M3) or a movement prohibition section (an example of the second object M3). For example, the space section 70 may have an entrance / exit (e.g., a hole, a second object M3 such as a door) through which the participating avatar M1 can enter and exit the free space section 71. The space section 70 may function as a talk room in which the participating avatar M1 located in the space section 70 can participate (i.e., it may function as the space section 70 in which a virtual camera for a terminal image related to a specific talk content is placed). Note that, although the space section 70 and the free space section 71 are drawn as two-dimensional planes in FIG. 5, the space section 70 and the free space section 71 may be set as a three-dimensional space. For example, the space section 70 and the free space section 71 may be a space having walls and a ceiling in a corresponding range with the planar shape shown in FIG. 5 as the floor, and apart from the example shown in FIG. 5, they may also be worlds that mimic a space having height such as a dome or sphere, a structure such as a building, a specific place on Earth, or outer space in which an avatar can fly around.

[0064] FIG. 6 is an explanatory diagram of areas with different attributes around a moderator avatar M2 in a virtual space. As described later, an area R1 with a first attribute and an area R2 with a second attribute are provided in the virtual space. Area R1 is an area where users can view details of conversations in the virtual space (such as conversation voices and chat text) and can also talk, while area R2 is an area where users can view details of conversations in the virtual space but cannot talk. Outside area R2, users can view the talk topic, and after entering area R2, users can view details of the conversation. At this time, the talk topic display may disappear.

[0065] In this embodiment, a region R1 of a first attribute and a region R2 of a second attribute different from the first attribute may be formed around the moderator avatar M2 in the virtual space. The region R1 of the first attribute and the region R2 of the second attribute are each composed of a set of a plurality of positions. The region R1 of the first attribute and the region R2 of the second attribute may be defined in a manner that they are included in a talk room. In other words, the talk room may be defined by the region R1 of the first attribute and the region R2 of the second attribute. However, the talk room may include an area outside the region R2 of the second attribute. In a modified example, other attribute regions may be defined, such as a region of a third attribute in which collaboration with the moderator avatar M2 is possible, or a region of a fourth attribute in which only the moderator avatar M2 can be located. In FIG. 6, the regions R1 and R2 are drawn in a circular shape on a two-dimensional plane, but the regions R1 and R2 may be set in a spherical shape in a three-dimensional space, as in FIG. 5.

[0066] The first attribute region R1 is a region where conversation between the moderator avatar M2 and the participant avatar M1 and / or conversation between multiple participant avatars M1 are possible, and may be set closer to the moderator avatar M2 than the second attribute region R2. In the example shown in Fig. 6, the first attribute region R1 corresponds to a circular region of radius r1 around the moderator avatar M2, but the shape and size are arbitrary. For example, the size of the first attribute region R1 (e.g., the size of the radius r1) may be constant (fixed) or may be variable in a manner that increases as the number of participant avatars M1 in the first attribute region R1 increases.

[0067] The region R2 of the second attribute is an area where only the conversation between the moderator avatar M2 and the participating avatar M1 in the region R1 of the first attribute can be viewed. That is, unlike the region R1 of the first attribute, the region R2 of the second attribute is an area where conversation with the moderator avatar M2 is not possible, but the conversation between the moderator avatar M2 and the participating avatar M1 in the region R1 of the first attribute can be viewed. Due to such attributes, the region R2 of the second attribute may be set farther from the moderator avatar M2 than the region R1 of the first attribute. For example, the region R2 of the second attribute may be set adjacent to the region R1 of the first attribute. In the example shown in FIG. 6, the region R2 of the second attribute corresponds to a circular region with an inner radius r1 and an outer radius r2 in a manner surrounding the region R1 of the first attribute, but the shape and size are arbitrary. For example, the size of the second attribute region R2 (e.g., the size of the radius r2) may be constant (fixed) or may be variable in such a way that it increases as the number of participating avatars M1 in the second attribute region R2 (or the value of a specific parameter such as the activity parameter described below) increases.

[0068] Meanwhile, in the virtual space, a moderator avatar M2 may be determined in advance together with a talk room. For example, a user associated with the moderator avatar M2 may reserve an area (for example, the space section 70) associated with the talk room in advance and hold a talk event or the like. Alternatively, a talk room may be newly generated in response to a creation instruction from a user associated with the moderator avatar M2. Alternatively, a talk room may be generated naturally (for example, ad hoc) in, for example, the free space section 71. For example, as shown in FIG. 7, a poster (second object M3) related to a talk theme may be posted on a wall (second object M3) in advance, and an avatar M9 related to a user who wants to talk with another user may hold the poster related to the corresponding desired talk theme to form a talk room (and accordingly become the moderator avatar M2 related to the talk room). Instead of a poster related to a talk theme, a talk theme may be written on a pamphlet or booklet (second object M3) placed on a flyer rack or a bookshelf (second object M3) as shown in FIG. 8. In this way, by allowing a user to select a talk topic from a poster or pamphlet to form a talk room, the psychological hurdle of starting a conversation can be lowered, and the effect of contributing to active communication between users in a virtual space can be obtained. Note that these talk topics may be edited or newly created by a specific user or the administrator. In this case, the avatar M9 of a user who wants to become the moderator avatar M2 may become the moderator avatar M2 by picking up a pamphlet related to the corresponding desired talk topic. When the moderator avatar M2 is generated in this way, the above-mentioned first attribute region R1 and second attribute region R2 may be set around the moderator avatar M2 as shown in FIG. 9, or a talk room in a form shown in FIG. 3 to FIG. 5, FIG. 10, FIG. 11, etc. may be generated by the user picking up a poster or pamphlet.In this case, the pamphlet (display medium 902R showing the talk topic) held by the moderator avatar M2 may function as a billboard that can be seen from many directions. This allows the talk topic to be easily seen by avatars positioned in any direction around the moderator avatar M2. When the moderator avatar M2 moves in the virtual space, the first attribute region R1 and the second attribute region R2 may also move accordingly.

[0069] 10 and 11 are diagrams illustrating various types of talk rooms. For example, as shown in Fig. 10, a talk room may be set up in a space 70 in the form of a cafe, or as shown in Fig. 11, a plurality of talk rooms may be set up in a space 70 in the form of a relatively large event hall.

[0070] For example, in the example shown in FIG. 10, a display medium 1002R indicating a talk theme is associated with a wall (second object M3) in the space 70 related to a cafe. The display medium 1002R may include text information indicating the corresponding talk theme. The display medium 1002R may be installed in a position that is easily visible from the viewpoint of an avatar M7 entering the area R2 from outside the area R2 as another user. This makes it possible to promote viewing and participation of each user in the conversation in the talk room.

[0071] In the example shown in FIG. 10, the space 70 may be in the form of a paid cafe where a predetermined fee (e.g., 500 yen per 30 minutes) must be paid to enter the area R1 of the first attribute. In this case, a display medium (second object M3) (not shown) indicating the fee system may be placed on a wall (second object M3) in the space 70 related to the cafe. In this case, a user can stay in the area R1 of the first attribute by paying an extension fee, for example, every 30 minutes. A user who has not paid the extension fee may be automatically logged out (faded out) or may be made to leave the talk room. In this case, restrictions may be imposed on a user who has not paid the extension fee or a participant avatar M1 related to the user, such as a faint drawing of the participant avatar M1 (visibility for other users), a quieter voice (audibility of the voice for other users) from a moderator avatar M2 or the like in the talk room, or a speech from a moderator avatar M2 or the like in the talk room may not be converted into text information or the like. Payment of fees within the virtual space may be realized by consuming a predetermined medium (for example, consuming purchasable points or a specific virtual currency).

[0072] In the example shown in FIG. 11, talk rooms for a plurality of moderator avatars M2 may be set in the event venue. In this case, a display medium 1102R indicating a corresponding talk theme is associated with each of the plurality of moderator avatars M2 (two in FIG. 11). Each display medium 1102R may include text information indicating the corresponding talk theme. Instead of or in addition to the display medium 1102R indicating the corresponding talk theme, the moderator avatar M2 may be in the form of a character that clearly indicates or suggests (including association with) the talk theme. In this case, the moderator avatar M2 itself can function as a display medium indicating that the corresponding character is the talk theme. Such a configuration is suitable when the talk theme does not change. In this way, by setting a plurality of talk rooms related to each character in the event venue, conversations on the talk theme related to each character can be activated.

[0073] 11, each participant avatar M1 may be able to take a commemorative photo with the moderator avatar M2. In this case, a camera object M13 (second object M3) may be arranged in association with each moderator avatar M2. An image captured by the camera object M13 may be provided to a user associated with the corresponding participant avatar M1 in a manner that allows the user to view the image. The camera object M13 may also function as a virtual camera, and in this case, a video from the virtual camera may be used to generate a terminal image (see the talk room image H21 in FIG. 14) for viewing on a smartphone or the like.

[0074] In the example shown in FIG. 11, a pamphlet (second object M3) or an original drawing (second object M3) related to the corresponding event, a display object M10 (second object M3) on which a video of an interview can be viewed, and the like may be arranged on a wall (second object M3) in the space 70. In this case, a talk room caused by the second object M3 may be generated naturally. In addition, a chair or a desk (second object M3) on which an avatar can sit may be arranged in the space 70, and music of a sound source related to the corresponding event may be played. Such a chair or desk may appear when a talk room is generated. Note that the moderator avatar M2 and the participant avatar M1 in each area R1 shown in FIG. 11 can have a conversation between the moderator avatar M2 and the participant avatar M1 and / or between the participant avatars M1 themselves in each area R1.

[0075] FIG. 12 is an explanatory diagram of an example of the arrangement of each talk room according to the detail (hierarchy) of the talk theme. FIG. 12 shows various talk rooms in a space part 70 (reference numeral 70(2) in FIG. 12) in the form of a lobby adjacent to a space part 70 (reference numeral 70(1) in FIG. 12) in the form of an event venue such as a movie theater. In FIG. 12, each talk room is associated with each talk theme A to F. Each talk theme A to F may be related to an event at the event venue, and may be set in such a manner that the content becomes gradually more detailed from the entrance to the event venue (exit from the event venue to the lobby) toward the exit of the lobby. For example, in the example shown in FIG. 12, talk themes E and F may be more suitable for beginners than talk themes A and C. In this case, a user who has experienced an event at the event venue can gradually deepen his / her knowledge of the event by stopping by talk rooms in order from the time he / she leaves the event venue in the lobby until he / she heads toward the exit of the lobby. 12, the space section 70 in the form of a lobby is adjacent to the space section 70 in the form of an event venue such as a movie theater, but the present invention is not limited to this. For example, an avatar coming out of the space section 70 may be guided to a talk room (a space section 70 not adjacent to the space section 70 in the form of an event venue such as a movie theater) where a conversation on a related talk topic is taking place.

[0076] FIG. 13 is an explanatory diagram showing an example of a talk room selection screen for viewing on a smartphone or the like (an example of a terminal device 20).

[0077] In the example shown in FIG. 13, the talk room selection screen G1300 for viewing displays list information including selection items (distribution types of specific talk content being distributed or scheduled to be distributed) corresponding to various talk rooms.

[0078] The selection items G1301 corresponding to various talk rooms preferably include a thumbnail and a theme display G1302 (theme information) indicating the corresponding talk theme. The theme display G1302 may include text information or the like indicating the talk theme. This makes it possible to promote viewing and participation of each user in the conversation in the talk room. The number of selection items G1301 included in one screen may be appropriately set according to the screen size, and the talk room selection screen G1300 may allow a scroll operation or the like to change the selection items G1301 displayed.

[0079] Fig. 14 is a diagram showing an example of a talk room image H2 (image for terminal) for a participating user when the participating user enters a talk room via the talk room selection screen shown in Fig. 13. The talk room image H2 may be generated based on a virtual camera in a virtual space, may be generated by the studio units 30A and 30B, or may be generated based on an image captured by a camera of the terminal device 20. Figs. 14A and 14B are diagrams showing other examples of the talk room image H2 for a participating user.

[0080] In addition, the talk room image H2 may include a talk room image H21 that can be viewed without a head-mounted display (hereinafter also referred to as a "talk room image H21 for a smartphone" or simply "talk room image H21") (see Figure 14), as well as a talk room image for a host user and a talk room image for a participating user that can be viewed via a head-mounted display.

[0081] When entering a talk room via the talk room selection screen G1300, a participating user may be able to select either entering the room in a manner allowing conversation (e.g., entering the area R1 of the first attribute described above) or entering the room in a manner allowing only viewing (e.g., entering the area R2 of the second attribute described above). Alternatively, entry via the talk room selection screen G1300 may be set in advance as either entering the room in a manner allowing conversation (e.g., entering the area R1 of the first attribute described above) or entering the room in a manner allowing only viewing (e.g., entering the area R2 of the second attribute described above).

[0082] As shown in Fig. 14, Fig. 14A, and Fig. 14B, the talk room image H21 includes a theme display G11 (theme information) indicating the corresponding talk theme. The theme display G11 may include text information indicating the talk theme. This allows participating users to check the talk theme even after entering the room. Note that such a theme display G11 is suitable for cases where the talk theme for a talk room can change dynamically.

[0083] In the example shown in Figure 14, in addition to the theme display G11 indicating the talk theme, a heart-shaped gift object G12, a present-shaped gift object G12A, various comments G13 such as "This is my first time seeing this...", and an operation unit G109 for sending a request for collaborative distribution to other host users are displayed along with the moderator avatar M2.

[0084] Incidentally, in a terminal device 20 with a relatively small screen such as a smartphone, the participating avatar M1 may be expressed in a panel format as shown in FIG. 14A. Specifically, the participating avatar M1 may be drawn as an avatar icon in the image area G35. In this case, each of the avatar icons 350, 351, and 352 represents a virtual space to which the corresponding avatar belongs. In this case, each of the avatar icons 350, 351, and 352 may be associated with a corresponding user name (e.g., "User A", "User B", etc.). Also, each of the avatar icons 350, 351, and 352 may be associated with a microphone icon 360, 361, and 362. In this case, among the microphone icons 360, 361, and 362, the microphone icon corresponding to the user avatar M1 in the speaking state may be highlighted in a similar manner (e.g., enlarged in size, flashed, colored, etc.). In this case, the size of the microphone icon may be changed depending on the loudness (volume) of the voice.

[0085] Alternatively, the participant avatar M1 may be depicted in the form of avatar panels G371-G376 together with the moderator avatar M2 as shown in FIG. 14B. In this case, each of the avatar panels G371-G376 represents a virtual space to which the corresponding avatar belongs. In this case, the virtual space may be substantially represented in a two-dimensional display. In this case, among the avatar panels G371-G376, the avatar panel corresponding to the avatar in the speaking state may be highlighted in a similar manner (for example, by enlarging the size, blinking, coloring, etc.).

[0086] FIG. 15 is an explanatory diagram illustrating an example of a talk room selection screen for viewing on a head mounted display.

[0087] 15 shows a schematic top view of the field of view R500 from the user's viewpoint (when looking straight ahead), as well as a plurality of planar operation units G300 that are visible through a head mounted display (an example of a terminal device 20). In this case, the screen that the user can view through the head mounted display is the talk room selection screen for viewing when using the head mounted display.

[0088] The multiple planar operation units G300 function as selection items (distribution items of specific talk content being distributed or scheduled to be distributed) corresponding to various talk rooms. Therefore, the user can visually recognize list information including the multiple selection items (operation units G300) via the head mounted display. The user can then select a desired selection item from the multiple selection items (operation units G300) by gesture input (for example, a movement of reaching out to a desired selection item), etc.

[0089] The multiple planar operation units G300 preferably include a thumbnail (e.g., a thumbnail including an image of the moderator avatar M2) and a theme display G1502 (theme information) indicating the corresponding talk theme. The theme display G1502 may include text information or the like indicating the talk theme. This makes it possible to promote viewing and participation of each user in the conversation in the talk room.

[0090] The multiple planar operation units G300 are preferably arranged in a manner of forming multiple layers in front and behind. For example, the multiple planar operation units G300 may include a first group arranged in multiple rows along a first curved surface 501 around a predetermined reference axis, and a second group arranged in multiple rows along a second curved surface 502 around the same predetermined reference axis. In this case, the second curved surface 502 may be offset behind the first curved surface 501 as shown in FIG. 15. In this case, when viewed from the user's viewpoint, the multiple operation units G300 of the second group arranged along the second curved surface 502 (hereinafter also referred to as "operation unit G300-2" to distinguish from the first group) overlap behind the multiple operation units G300 of the first group arranged along the first curved surface 501 (hereinafter also referred to as "operation unit G300-1" to distinguish from the second group). In this case, when viewed from the user's viewpoint, the second group of operation units G300-2 may be partially visible from behind the first group of operation units G300-1. In this case, it is possible to let the user know of the existence of the operation units behind, and to efficiently increase the number of operation units that can catch the user's eye. Note that a third curved surface offset further behind the second curved surface may be set, and further planar operation units G300 may be arranged. In this way, any number of planar operation units G300 greater than or equal to two may be arranged in an overlapping manner when viewed from the user's viewpoint.

[0091] In addition, in the case of such a plurality of planar operation units G300 overlapping front and rear, the processing load related to drawing can be efficiently reduced while arranging a large number of operation units G300 so that the user can operate them. For example, it is also possible to reduce the processing load related to drawing as a whole by performing complete drawing of thumbnail images and real-time video only for the operation unit G300-1, while performing incomplete drawing (e.g., processing such as changing texture) for the operation unit G300-2. From a similar viewpoint, it is also possible to reduce the processing load related to drawing as a whole by performing complete drawing of thumbnail images and real-time video only for the operation unit G300-1 in the area R500 in front as seen from the user's viewpoint, while performing incomplete drawing (e.g., processing such as changing texture) for the operation unit G300-1 outside the area R500 in front. For example, by pre-caching or pre-loading data that is likely to become operation unit G300-1 in the front area R500 in the user's terminal device 20, it is possible to efficiently reduce the number of requests submitted via the network 3, the amount of requests imposed on the network 3 accordingly, and the computational resources used to respond to the requests while reducing latency. In this case, the data that is likely to become operation unit G300-1 in the front area R500 may be predicted based on the tendency of each user, or may be determined by machine learning based on artificial intelligence.

[0092] When viewed from the user's viewpoint, in the case where a plurality of operation units G300-2 of a second group arranged along the second curved surface 502 overlaps behind a plurality of operation units G300-1 of a first group arranged along the first curved surface 501, the user may be able to switch between the first group and the second group by a predetermined input of moving the hand in a predetermined manner. This makes it possible to efficiently arrange a large number of operation units G300 while improving operability through intuitive operation. Note that in a configuration in which such a plurality of planar operation units G300 are arranged, the user may be able to change the arrangement of the plurality of planar operation units G300 by a specific operation. This makes it possible to arrange the operation units G300 according to the user's preferences and tastes.

[0093] Next, with reference to FIG. 16 and subsequent figures, examples of functional configurations of the server device 10 and the terminal device 20 related to the above-mentioned talk theme will be described.

[0094] First, the functions of the server device 10 will be mainly described with reference to FIG. 16 to FIG.

[0095] FIG. 16 is a schematic block diagram showing the functions of the server device 10 related to the above-mentioned talk theme. FIG. 17 is an explanatory diagram showing an example of data in the talk history storage unit 140. FIG. 18 is an explanatory diagram showing an example of data in the talk situation storage unit 142. FIG. 19 is an explanatory diagram showing an example of data in the user information storage unit 144. FIG. 20 is an explanatory diagram of various tables. FIG. 21 is an explanatory diagram showing an example of data in the avatar information storage unit 146. FIG. 22 is an explanatory diagram of the hierarchical structure of talk themes. In FIG. 17 (as well as FIG. 18 and the like), "***" indicates a state in which some information is stored, and "..." indicates a state in which the same information is repeatedly stored.

[0096] As shown in FIG. 16, the server device 10 includes a talk history memory unit 140, a talk status memory unit 142, a user information memory unit 144, an avatar information memory unit 146, a talk data acquisition unit 150, a theme identification unit 152, a keyword extraction unit 154, a talk management unit 156, an avatar determination unit 158, a distribution processing unit 160, a setting processing unit 162, a user extraction unit 164, a guidance processing unit 166, a theme management unit 168, a parameter calculation unit 170, a terminal data acquisition unit 172, a terminal data transmission unit 174, and a conversation support processing unit 176.

[0097] 16, the talk history storage unit 140, the talk status storage unit 142, the user information storage unit 144, and the avatar information storage unit 146 can be realized by the server storage unit 12 of the server device 10 shown in Fig. 1. Also, the functions of each unit from the talk data acquisition unit 150 to the conversation support processing unit 176 can be realized by the server control unit 13 and the server communication unit 11 of the server device 10 shown in Fig. 1.

[0098] The talk history storage unit 140 stores history information of each talk room formed in the virtual reality generation system 1. In the example shown in Fig. 17, the talk history storage unit 140 associates each of the items of theme information, location information, avatar information, time information, and language information with each talk ID.

[0099] A talk ID may be assigned to each talk room. The talk room to which a talk ID is assigned may have any form, and the talk room to which a talk ID is assigned may include a talk room formed in the above-described space section 70 as well as a talk room formed in the above-described free space section 71. Furthermore, the talk room to which a talk ID is assigned may include a talk room for viewing on a smartphone or the like (see FIG. 14) as well as a talk room formed in the space section 70 or the like.

[0100] The theme information corresponds to a talk theme related to a conversation in a corresponding talk room, and indicates a talk theme identified by a theme identification unit 152 described later. When the talk theme changes in one talk room, multiple pieces of theme information may be associated with one talk ID. Alternatively, in a modified example, a new talk ID may be issued every time the talk theme changes.

[0101] The location information indicates the position of the corresponding talk room (position in a virtual space). For example, if the talk room is formed in the space section 70, the location information of the talk room may be position information (coordinate values) of the space section 70, or may be information identifying a corresponding one of the space sections 70. Furthermore, if the talk room is movable (for example, if it changes depending on the position of the moderator avatar M2), the location information may include a movement history.

[0102] Furthermore, for a talk room having an area R1 of a first attribute and an area R2 of a second attribute as described above, the location information may include information indicating the respective ranges of the area R1 of the first attribute and the area R2 of the second attribute.

[0103] The avatar information is information (e.g., corresponding user ID or avatar ID) representing a moderator avatar M2 in a corresponding talk room and each participating avatar M1 who has entered the corresponding talk room. The avatar information corresponding to one avatar may include detailed information such as the time when the avatar entered the room. The avatar information may also include the total number or total number of participating avatars M1, the frequency of conversations, the number of times of speech, etc. The avatar information may also include the participation attribute of each participating avatar M1 (attributes such as whether it is located in the area R1 of the first attribute or the area R2 of the second attribute). The avatar information may also include attribute information representing the attributes of each avatar. For example, the attribute information may be generated based on information registered in an account or profile (gender, favorite things, etc.), the first-person address, speech, the presence or absence of dialect, behavior history (behavior history in the virtual space), purchased items (items purchased in the virtual space), etc.

[0104] The time information indicates the start time and end time of the corresponding talk room. Note that the time information may be omitted for talk rooms that are always created.

[0105] The language information indicates the language of the conversation in the corresponding chat room. If the conversation is in two or more languages, the language information may include two or more languages. The language information may use a locale ID.

[0106] Information representing a situation (current status) in a currently formed talk room is stored in the talk status storage unit 142. In the example shown in Fig. 18, the talk status storage unit 142 associates each of the items of talk data, theme information, location information, avatar information, duration information, language information, activity level information, and participation information with each talk ID.

[0107] The talk data is data related to the entire content of the conversation currently taking place in the corresponding talk room. The talk data may be raw data before processing (i.e., raw speech log) or may be text data (converted into text).

[0108] The theme information indicates a talk theme related to a conversation in a corresponding talk room. However, the theme information in the talk status storage unit 142 indicates a current talk theme.

[0109] The location information indicates the location of the corresponding talk room. However, the location information in the talk status storage unit 142 indicates the location at the current time. Note that, in a specification in which the location of a talk room does not change, the location information in the talk status storage unit 142 may be omitted. Also, for a talk room having an area R1 of a first attribute and an area R2 of a second attribute as described above, the location information may include information indicating the respective ranges (current ranges) of the area R1 of the first attribute and the area R2 of the second attribute.

[0110] The avatar information is information (e.g., corresponding user IDs and avatar IDs) that represents a moderator avatar M2 in the corresponding talk room and each participating avatar M1 that has entered the corresponding talk room. However, the avatar information in the talk status storage unit 142 represents each avatar currently located in the talk room.

[0111] The duration information indicates the duration of the corresponding talk room (the time elapsed from the start time). Note that, for talk rooms whose talk themes have changed, the duration may be calculated for each talk theme.

[0112] The language information indicates the language of the conversation in the corresponding talk room. If the conversation is being held in two or more languages, the language information may include two or more languages.

[0113] The activity level information indicates the activity level of a conversation taking place in a corresponding talk room. The activity level may be the current value of an activity level parameter calculated by the parameter calculation unit 170, which will be described later.

[0114] The participation information is information indicating whether a user can participate in the corresponding chat room (whether or not the user can enter the room). In addition to whether or not a user can participate, the participation information may include information such as conditions for participation (for example, conditions such as OK if accompanied by a friend, conditions related to a limit on the number of people), etc. The participation information may also include information such as an entry fee.

[0115] Information about each user is stored in the user information storage unit 144. The information about each user may be generated, for example, when the user is registered, and may be updated appropriately thereafter. For example, in the example shown in Fig. 19, the user information storage unit 144 associates each user ID with the following items: user name, avatar ID, talk participation history, conversation information, keyword information, excluded word (prohibited word) information, friend information, and preference information.

[0116] The user ID is automatically generated when the user registers.

[0117] The user name is a name registered by each user himself / herself and is arbitrary.

[0118] The avatar ID is an ID representing an avatar used by a user. The avatar ID may be associated with avatar drawing information (see FIG. 21) for drawing the corresponding avatar. The avatar drawing information associated with one avatar ID may be added or edited based on an input from the corresponding user.

[0119] The talk participation history indicates information (for example, talk themes, etc.) about the talk rooms that the corresponding user has entered, and may be generated based on the data in the talk history storage unit 140 shown in FIG. 17. The talk themes may be used as conversation tags. In this case, the talk participation history may display conversation tags of conversations in which the corresponding user has previously participated in the corresponding user's profile. For conversations in which the user has previously participated, a predetermined number of conversation tags that are the top conversation tags in which the user has participated the most may be displayed in the profile. This makes it possible to effectively display and recognize the user's profile and information required by the user even in cases where all of the conversations cannot be displayed due to space limitations on the display unit 23 of the terminal device 20 or in terminal devices 20 with small display units 23 (such as mobile terminals such as smartphones). For conversations in which the user has previously participated, conversations in past talk rooms may be searched for using conversation tags as a key. By searching for users by conversation tags, users with similar interests can be found. You can then use the conversation tags to find users you want to become friends with and contact them directly, such as by chatting with them, or you can ask them where they are in the virtual space (for example, "I'm in the BB Cafeteria") and warp to that location.

[0120] The conversation information represents information about the content of a conversation made in a chat room that the corresponding user joined. The conversation information may be text data. The conversation information may also include information about the language spoken (e.g., a locale ID) and total broadcast time. The conversation information may also include information about the first-person address, language, dialect, etc.

[0121] The keyword information is information that represents keywords used in conversations that took place in a talk room that the corresponding user has joined. The keyword information may accurately represent the preferences of a user, and may be used in processing by the guidance processing unit 166, which will be described later.

[0122] The excluded word (prohibited word) information relates to the number of times each user has uttered an excluded word (prohibited word). The excluded words (prohibited words) may be determined by the administrator, or may be added by the moderator avatar M2 of the corresponding chat room. Note that for users who have never uttered an excluded word (prohibited word), information to that effect may be associated with the user.

[0123] The friend information may be information that can identify users who are friends with each other (for example, a user ID). The friend information may include information that indicates the presence or absence and the degree of interaction or friendship between users.

[0124] The preference information is the preference of the corresponding user and represents preferences related to talk topics. The preference information is optional and may include the user's preferred language settings and preferred keywords. In addition, the user may be able to set his / her favorite talk topics and disliked talk topics (talk topics that the user does not want to participate in) in advance, in which case the preference information may include such settings. In addition, the preference information may include user profile information. The preference information may be selected via a user interface generated on the terminal device 20 and provided to the server device 10 by a JSON (JavaScript Object Notation) request or the like.

[0125] The preference information may be automatically extracted based on conversation information, behavior history, and the like. For example, it may represent the characteristics of a talk room that a user frequently enters. For example, some users may have different preferences for the size of a talk room, such as a tendency to prefer a large talk room with a relatively large number of participants, or a tendency to prefer a small talk room with a relatively small number of participants, even if the talk theme is the same. In addition, some users may have different preferences for the size of a talk room, such as a tendency to prefer a talk room with a high level of activity (e.g., a talk room where each user makes a large number of comments and a high frequency of comments, and the conversation progresses actively, <e.g., abbreviated as "active talk room">), even if the talk theme is the same, or a tendency to prefer a talk room with a low level of activity (e.g., a talk room where each user makes a small number of comments and a low frequency of comments, and the conversation progresses quietly and leisurely, <e.g., abbreviated as "relaxed talk room">). Therefore, the preference information may include information representing such preference trends.

[0126] The avatar information storage unit 146 stores avatar drawing information for drawing the avatar of each user. In the example shown in FIG. 21, the avatar drawing information associates each avatar ID with a face part ID, a hairstyle part ID, a clothing part ID, and the like. The part information related to appearance, such as the face part ID, hairstyle part ID, and clothing part ID, is a parameter that characterizes the avatar, and may be selected by each user. For example, a plurality of types of information related to appearance, such as the face part ID, hairstyle part ID, and clothing part ID, related to the avatar, are prepared. In addition, with regard to the face part ID, a part ID is prepared for each type, such as face shape, eyes, mouth, and nose, and the information related to the face part ID may be managed as a combination of IDs of each part constituting the face. In this case, it is possible to draw each avatar not only on the server device 10 but also on the terminal device 20 side based on each ID related to appearance linked to each avatar ID.

[0127] The talk data acquisition unit 150 updates the talk data in the talk status storage unit 142 described above, based on a log (utterance log) of talks (utterances related to a conversation) occurring in a corresponding talk room for each currently formed talk room. That is, when the talk data acquisition unit 150 acquires a conversation-related input related to a conversation from a user for one talk room, the talk data acquisition unit 150 includes information of the conversation-related input in the talk data in the talk status storage unit 142 described above. Note that the update period of the talk data by the talk data acquisition unit 150 is arbitrary, but may be set to a relatively short period for talk rooms whose talk themes are likely to change (such as talk rooms with no defined talk themes or talk rooms that are naturally generated as described above). This allows changes in the talk room to be detected relatively quickly while reducing the load associated with the data update process.

[0128] The theme identification unit 152 identifies a talk theme in each currently formed talk room. That is, for each currently formed talk room, the theme is identified as a talk theme for a conversation taking place in the corresponding talk room. The manner in which the talk themes are displayed is not particularly limited, but as an example, multiple talk themes may be displayed. For example, the main theme may be set in advance by the administrator or a specific user, and other sub-themes may be identified and displayed by the theme identification unit 152 based on the content of the conversation.

[0129] For a talk room in which a talk theme is determined in advance, the theme identification unit 152 may monitor whether a conversation along the talk theme is continuing. Alternatively, the theme identification unit 152 may identify a more detailed talk theme (a lower level talk theme) for the talk theme. For example, if the predetermined talk theme is "Anime A," the more detailed talk theme may be "Character B in Anime A." In this way, the theme identification unit 152 may identify talk themes at a hierarchical level of granularity.

[0130] Furthermore, the theme identification unit 152 may initially identify a talk theme for a talk room in which the talk theme is not determined in advance. Thereafter, the theme identification unit 152 may monitor whether a conversation along the initially identified talk theme is continuing (including whether the talk theme has changed) in the same manner as for a talk room in which the talk theme is determined in advance. Furthermore, the theme identification unit 152 may identify a talk theme at a hierarchical level of granularity even for a talk room in which the talk theme is not determined in advance.

[0131] In this way, the theme identification unit 152 can also handle changes and refinements to the talk theme even in the same talk room. That is, even if a talk theme is set in advance, the content may change as the conversation expands, but since the theme identification unit 152 identifies the talk theme from the ongoing conversation, it becomes possible to present an accurate talk theme to the user in real time.

[0132] There are various methods for identifying the talk theme, and any method may be used. For example, the theme identification unit 152 may identify the talk theme by using a keyword extracted by the keyword extraction unit 154 described later. In this case, the theme identification unit 152 may identify the keyword itself as the talk theme, may identify a combination or fusion of two or more keywords as the talk theme, or may derive the talk theme from one or more keywords.

[0133] Alternatively, the theme identification unit 152 can use artificial intelligence to input talk data or a keyword described later and output (generate) a talk theme. In the case of artificial intelligence, this can be realized by implementing a convolutional neural network obtained by machine learning. In machine learning, for example, weights of a convolutional neural network that maximizes the accuracy of the talk theme identification result may be learned using performance data related to the talk data or performance data related to a keyword described later.

[0134] The talk theme identified by the theme identification unit 152 does not always need to be a specific word, and may be a summary of the conversation content or an excerpt of the conversation. The theme identification unit 152 may identify two or more talk themes (for example, two types of main talk theme and sub talk theme) for one talk room. For example, the two or more talk themes may have the above-mentioned hierarchical structure relationship.

[0135] The keyword extraction unit 154 identifies (extracts) a keyword for each currently formed talk room based on talk data (conversation-related input from each user) in the corresponding talk room. Any method for extracting a keyword may be used, for example, a morphological analysis engine (for example, "MeCab"). The keyword extraction unit 154 may generate a word list (or word-separated data) by dividing a character string related to the talk data into words using the morphological analysis engine. Then, the keyword extraction unit 154 may refer to the noun translation Tbl or the proper noun translation Tbl to determine whether a selected word in the word list meets the extraction condition, and if it does, extract the selected word and output (extract) it as a keyword. The keyword extraction unit 154 may also extract text with a high occurrence frequency and extract keywords by weighting.

[0136] In this case, the keyword extraction unit 154 may specify the keyword by using various tables (indicated as "Tbl" in FIG. 20) as shown in FIG. 20. In this case, various nouns are registered in the noun translation Tbl. In this case, each noun may be associated with a concept, a Japanese reading, a variant notation, a pictogram, or the like. For example, the noun "cat" may be associated with "Cat" as the concept, "neko" as the Japanese reading, and neko, cat, neko, chat, nuko, (=^x^=), or the like as variant notations or pictograms. In addition, various proper nouns are registered in the proper noun translation Tbl. In this case, each proper noun may be associated with a concept, a Japanese reading, a variant notation, a notation in another language, or the like. The noun translation Tbl and the proper noun translation Tbl may be referred to for each locale ID. In addition, the noun translation Tbl and the proper noun translation Tbl may be reinforced so as to be able to handle new words and named expressions. It is also possible to prepare a trend word Tbl with a high priority in advance. In this case, text corresponding to a word registered in advance as a trend word may be extracted as a keyword, or the text may be weighted highly. The trend word Tbl may include popular words within 24 hours for all users and top ranking words for the year. Although the noun translation Tbl and proper noun translation Tbl are mentioned above as various tables, the present invention is not limited to these, and tables for verbs, phrases, clauses, sentences, etc. may also be used. In this way, by using a table to identify keywords, it is possible to identify keywords that are aggregated into one even if the expression method varies from user to user. In addition, when a multilingual table is used, it is possible to identify corresponding foreign language keywords and present a talk topic in a foreign language to a foreign language user even in a conversation conducted in Japanese.

[0137] The excluded word Tbl may correspond to the excluded word (prohibited word) information in the user information storage unit 144 described above. The excluded words may include, in addition to the prohibited words, words that should not be extracted as keywords (e.g., greetings). The excluded word Tbl may be created by the administrator side, and in this case, it may be editable by a specific user, or may differ depending on the attributes of the talk room. In addition, the individual UserTbl may correspond to the user ID and conversation information (locale ID, total delivery time) in the user information storage unit 144 described above. The TalkSessionTbl may correspond to the data in the talk situation storage unit 142. The live speech log may correspond to the talk data in the talk situation storage unit 142. For example, the live speech log may include information on each item of time, talk ID, user ID, and character information in which the spoken content is converted into text. The character chat log may correspond to the talk data in the talk situation storage unit 142. For example, the character chat log may include information on each item of time, talk ID, user ID, and text.

[0138] The keyword extraction unit 154 writes the extracted keywords in the TalkThemeTbl and updates the TalkThemeTbl. The TalkThemeTbl may store a user ID, a keyword (including a noun, a verb, a phrase, a clause, a sentence, etc.), a number of utterances, and an occurrence frequency for each talk ID. When the number of keywords extracted by the keyword extraction unit 154 is relatively large, the keywords may be converted into concepts via the noun translation Tbl, and then narrowed down to a top predetermined number of concepts (for example, three) according to the frequency or number of occurrences of the same concept. In this case, the theme identification unit 152 can identify a talk theme based on the top predetermined number of concepts. In this case, the theme identification unit 152 may identify the top predetermined number of concepts themselves as talk themes, or may create a talk theme that combines the top predetermined number of concepts. The keyword extraction unit 154 uses the excluded word Tbl to check whether the extracted keywords are excluded words or not.

[0139] The processing period (such as the update period of TalkThemeTbl or TalkSessionTbl) of the keyword extraction process by the keyword extraction unit 154 is arbitrary, but may be set to a relatively short period for talk rooms whose talk themes are likely to change, similar to the update period of the talk data. That is, the keyword extraction process by the keyword extraction unit 154 may be executed every time the talk data is updated. This reduces the load associated with the data update process while allowing changes in the talk room to be detected relatively quickly. In this case, the talk data used for keyword extraction by the keyword extraction unit 154 may be refreshed (i.e., deleted once) every certain time (e.g., about 10 minutes), or may be constantly maintained for the most recent certain time (e.g., about 10 minutes) in a FIFO (First in First out) format.

[0140] The talk management unit 156 manages the state of each talk room. For example, the talk management unit 156 may determine a conversation establishment condition for detecting a conversation that may occur naturally and should form a talk room, other than a defined talk room such as the space unit 70. The conversation establishment condition may be, for example, arbitrary, and for example, for a specific talk content whose start time is specified in advance, the conversation establishment condition related to the talk content may be satisfied when the start time arrives. Also, for a specific talk content whose start time is not specified in advance, the conversation establishment condition may be satisfied when, for example, the following condition elements are satisfied.

[0141] (Condition element 1) Two or more avatars must be in a specified positional relationship (or in a position corresponding to the first attribute).

[0142] (Condition 2) There is conversation-related input from two or more avatar users.

[0143] (Condition element 3) The conditions for determining that a conversation is occurring must be met based on the interval between statements made by two or more avatars, the context, the distance between the two or more avatars (distance in virtual space), the line of sight between the two or more avatars, etc.

[0144] Furthermore, the talk management unit 156 may determine that the conversation establishment condition is established when a conversation between one user (avatar) and another user (avatar) continues for, for example, about three turns after the start of the conversation. In addition, the conversation establishment condition is not limited to the number of turns, and may be triggered by a conversation start instruction input by one user (for example, a talk room is formed when a button in a user interface for opening a talk room is selected) or by one user going to a predetermined location (for example, a talk room is formed when the user goes to a signboard as shown in FIG. 11 or a table as shown in FIG. 24).

[0145] When the conversation establishment condition is satisfied, the talk management unit 156 may set the above-mentioned first attribute region R1 and second attribute region R2.

[0146] Furthermore, the talk management unit 156 may determine a talk room termination condition. The talk room termination condition may be satisfied when a predetermined end time arrives, when a predetermined amount of time has elapsed, when the number of avatars in the talk room falls to a predetermined number (e.g., 1) or less, when the frequency of conversations in the talk room falls to a predetermined standard or less, etc.

[0147] The avatar determination unit 158 ​​determines a moderator avatar M2 (a predetermined avatar) in each talk room. That is, the avatar determination unit 158 ​​determines the moderator avatar M2 from among the avatars associated with the users who have established a conversation in one talk room.

[0148] The method of determining the moderator avatar M2 by the avatar determination unit 158 ​​is arbitrary. For example, in the examples shown in Fig. 7 and Fig. 8, the avatar determination unit 158 ​​may specify an avatar holding a poster, a flyer, or the like, as the moderator avatar M2. Furthermore, for a talk room that has been reserved in advance, the avatar that has been applied as the moderator avatar M2 may be specified as the moderator avatar M2.

[0149] For a naturally occurring talk room or a talk room that has been scheduled in advance and does not have a moderator avatar M2 assigned to it, the avatar determination unit 158 ​​may determine the moderator avatar M2 according to the conversation situation. For example, the avatar determination unit 158 ​​may determine the avatar associated with the most frequently speaking user as the moderator avatar M2.

[0150] Furthermore, when one talk room is split into multiple talk rooms, the avatar determination unit 158 ​​may determine a new moderator avatar M2 for each of the split talk rooms in the same manner as in the case of naturally occurring talk rooms.

[0151] Furthermore, when two or more talk rooms are merged, the avatar determination unit 158 ​​may determine one or more of the moderator avatars M2 of the talk rooms before the merger as a new moderator avatar M2 for the merged talk room. For example, when two or more talk rooms are merged, the avatar determination unit 158 ​​may determine the moderator avatar M2 of the talk room before the merger that has a larger size (e.g., the number of participating avatars M1 in the area R1 of the first attribute) as the new moderator avatar M2.

[0152] Furthermore, the avatar determination unit 158 ​​may determine the moderator avatar M2 in cooperation with the theme identification unit 152. For example, an avatar that frequently utters a keyword related to the talk theme identified by the theme identification unit 152 may be determined as the moderator avatar M2. In this case, the avatar that frequently utters a keyword related to the talk theme identified by the theme identification unit 152 becomes the moderator avatar M2, so the moderator avatar M2 associated with one talk room may change dynamically. Also, as described above, even when an avatar holding a poster, a flyer, or the like is identified as the moderator avatar M2, if avatars interested in the generated talk theme gather, the association between the avatar holding the poster, flyer, or the like and the talk theme may be released (i.e., the avatar holding the poster, flyer, or the like may no longer be the moderator avatar M2).

[0153] If it is not necessary to determine the moderator avatar M2, the avatar determination unit 158 ​​may be omitted. Also, the avatar determination unit 158 ​​may not function for a talk room for which it is not necessary to determine the moderator avatar M2.

[0154] The distribution processing unit 160 distributes one or more specific talk contents. In addition, the distribution processing unit 160 outputs list information including the distribution type of the specific talk content being distributed or scheduled to be distributed, as described above with reference to Figs. 13 and 15.

[0155] The setting processing unit 162 positions each talk room (an example of a predetermined position or area) in the virtual space. The positioning of the talk room in the virtual space may be realized, for example, by setting the range of the talk room or the coordinate values ​​(location) of the center position. For example, the setting processing unit 162 may position the talk rooms in the virtual space by setting a space section 70 for multiple talk rooms, as described above with reference to FIG. 5. The shape and size of the space section 70 (i.e., the shape and size of the talk rooms) are arbitrary, and the shape may be determined according to the shape of the talk, and the size may be determined according to the scale, such as the number of participating avatars M1.

[0156] The talk room related to the talk room image H21 (see FIG. 14) for viewing on a smartphone or the like may be positioned independently of the space portion 70 (the space portion within the virtual space in the world form).

[0157] The setting processing unit 162 may position the talk rooms in the virtual space in such a manner that a talk room is formed for each talk ID in the talk status storage unit 142 (i.e., for each talk topic of a currently ongoing conversation).

[0158] Furthermore, when multiple talk rooms are formed in a common virtual space, the setting processing unit 162 may change the distance between the talk rooms based on the relevance or dependency between the talk themes specified for the talk rooms. In this case, the closer the relevance between the talk themes of two talk rooms is, the shorter the distance between the talk rooms may be. Furthermore, when there is a subordinate relationship between the talk themes of two talk rooms (for example, there is a relationship between a higher level and a lower level of the talk themes specified hierarchically), the distance between the talk rooms may be shortened. This allows talk room changes, such as merging of talk rooms, to occur, and the expansion of interactions between users due to talk room changes can be promoted. When conversations on similar talk themes are being held in two or more talk rooms, merging may be more exciting, and such an effect can be expected. Alternatively, a talk room related to a lower level theme may be set in a nested manner within a talk room related to a higher level theme.

[0159] Furthermore, the setting processing unit 162 may change the position of a talk room based on a change in the talk theme. That is, when a talk theme related to a talk room changes, the setting processing unit 162 may change the position of the talk room. As a result, for example, with respect to two talk rooms, when the talk themes thereof become more related to each other, the distance between the talk rooms becomes shorter, and conversely, when the relatedness between the talk rooms becomes weaker, the distance between the talk rooms becomes longer.

[0160] Furthermore, the setting processor 162 may merge two or more talk rooms when a talk room merging condition is satisfied, or may separate one talk room into two or more talk rooms when a talk room separation condition is satisfied. The merging and separation conditions are arbitrary, but may merge talk rooms with the same or similar talk theme, merge talk rooms within a predetermined distance, or separate a talk room when multiple talk themes are identified in the talk room (i.e., when the talk room is divided into groups and conversations on different themes occur individually). When the merging and separation conditions are satisfied, the merging and separation of the talk rooms may be realized when a notification proposing the merging or separation of the talk rooms is presented to the moderator avatar M2 and an instruction to accept the proposal is input, or when the proposal notification is presented to all the participant avatars M1 and approval is obtained by majority vote.

[0161] In addition, the setting processing unit 162 may perform a notification process (such as an announcement of collaboration) to promote merging when there are two or more talk rooms with similar talk themes. This also applies to the distribution of specific talk content. When distributing specific talk content, a host user may not notice that another host user has started distributing on a similar theme. Such notification process makes other users aware that they "want to get excited about the same topic," which can avoid conflicts between host users and eliminate competition for viewers (participating users).

[0162] The user extraction unit 164 extracts a user to be guided. The user to be guided (synonymous with an avatar related to the user to be guided) may be a user who is preferably guided to a specific talk room, a user who is desired to be guided to a specific talk room, etc. The user extraction unit 164 may extract the user to be guided based on a guide request input from the user, or may automatically extract the avatar to be guided based on the movement of the avatar in the virtual space. For example, when the user extraction unit 164 detects an avatar that is estimated to be wandering around without finding a desired talk room, the avatar may be extracted as the avatar to be guided.

[0163] When the guidance target user is extracted by the user extraction unit 164, the guidance processing unit 166 determines (extracts) a talk room in which a conversation on the guide target talk topic is taking place from among multiple talk rooms currently formed for the guidance target user (talk rooms in which the guidance target user can participate). In other words, when multiple talk rooms are formed in a common virtual space, the guidance processing unit 166 determines a guide target talk topic for the guidance target user from among the multiple talk themes.

[0164] The talk topic to be introduced may be determined based on information about the user (data in the user information storage unit 144). For example, the induction processing unit 166 may determine the talk topic to be introduced based on conversation information associated with the user to be introduced. For example, the induction processing unit 166 may determine a talk topic including a keyword that is included with a relatively high frequency in the conversation information related to the user to be introduced as the talk topic to be introduced. In addition, the induction processing unit 166 may determine a talk topic including a keyword that is highly related to the keyword (for example, a keyword that is a subordinate concept to the keyword) based on the keyword included in the conversation information related to the user to be introduced as the talk topic to be introduced.

[0165] The guidance processing unit 166 may also determine the talk theme of the guidance target based on the preference information associated with the guidance target user. For example, the guidance processing unit 166 may determine a talk theme including a keyword that matches the preference information of the guidance target user as the talk theme of the guidance target. For the guidance target user associated with an avatar coming out of the space unit 70 in the form of an event venue such as a movie theater, the guidance processing unit 166 may determine a talk theme related to the event as the talk theme of the guidance target.

[0166] The induction processing unit 166 may determine multiple talk themes to be introduced to the one user to be guided. In this case, the induction processing unit 166 may prioritize the multiple talk themes to be introduced. For example, when the induction processing unit 166 determines multiple talk themes to be introduced to the one user to be guided, the induction processing unit 166 may prioritize the multiple talk themes to be introduced based on friend information. In this case, the prioritization may be realized in such a manner that a talk theme related to a talk room in which many users have a friend relationship with the one user to be guided is given a higher priority.

[0167] In addition, when talk themes are managed in a hierarchical structure (for example, a tree structure) as described later, the induction processing unit 166 may determine a talk theme at the upper side of the hierarchical structure as the talk theme to be initially guided, in a manner that allows the hierarchical structure to be traced from the upper side to the lower side in order. For example, in the example shown in FIG. 22, talk theme A is, for example, "anime", talk theme B is, for example, "xx's blade", talk theme C is, for example, "xx's fist", talk theme D is, for example, "character X appearing in xx's blade", talk theme G is, for example, "about the fight between character X appearing in xx's blade and boss Y", and so on, with a four-stage hierarchical structure (top, upper, middle, and lower as higher categories). In this case, when the induction processing unit 166 determines that one of the users to be guided is interested in anime based on the information about the user, the induction processing unit 166 may determine talk theme A "anime" as the talk theme to be initially guided.

[0168] When the guidance processing unit 166 determines a talk theme to be introduced for the one user to be guided, the guidance processing unit 166 may execute a guidance process to facilitate an avatar (hereinafter also referred to as a "guide target avatar M5") associated with the one user to be guided to reach a talk room (hereinafter also referred to as a "guide target talk room") associated with the talk theme to be introduced. The guidance process may be realized in cooperation with the terminal device 20 of the one user to be guided, as described later. For example, the guidance process may link the talk theme to be introduced or a talk room related to the talk theme to a "recommended" category (see FIG. 15) so that the talk theme is easily visible to the guide target user. Alternatively, the display medium (such as the display medium 302R in FIG. 3) or the theme display (such as the theme display G1302 in FIG. 13) showing the talk theme to be introduced may be emphasized more than others. Examples of the emphasis may include changing the color, enlarging the text, enlarging the picture, and attaching a recommendation mark. Other examples of the guidance process related to the talk theme to be introduced will be described later with reference to FIG. 25.

[0169] Furthermore, when multiple talk themes to be guided are determined for one user to be guided, the guidance processing unit 166 may execute guidance processing so that the guided avatar M5 can easily reach the guided talk room in the order of priority. Furthermore, when talk themes are managed in a hierarchical structure (e.g., a tree structure) as described below, the guidance processing unit 166 may execute guidance processing so that the guided avatar M5 can easily reach the guided talk room in a manner that allows the hierarchical structure to be traced from the upper side to the lower side in order.

[0170] The induction processing unit 166 may also determine the talk topic to be introduced based on other factors. For example, the induction to a specific talk content hosted by the hosting user may be promoted in response to payment of a fee from the hosting user. In this case, for example, the display medium representing the talk topic associated with the specific talk content may be made more prominent than others. Note that, when there are competing similar talk topics, the induction processing unit 166 may determine the talk topic to be introduced based on such factors.

[0171] In addition, the guidance processing unit 166 may execute auxiliary guidance processing by changing the display mode of the display medium showing the talk theme (for example, see the display medium 302R in FIG. 3) or the theme display showing the talk theme (for example, see the theme display G1302 in FIG. 13) in cooperation with the theme information output processing unit 256 of the terminal device 20 described later. For example, the theme information output processing unit 256 may change the visibility of the display medium showing the talk theme based on the preference information of a user to be guided. In this case, the theme information output processing unit 256 may change the visibility of the display medium showing the talk theme so that the talk theme matching the preference stands out.

[0172] When multiple conversations with different talk themes are taking place in the virtual space, the theme management unit 168 manages the multiple talk themes in a hierarchical structure in which the talk themes are branched into hierarchical structures, as described above with reference to Fig. 22. This allows the guidance processing by the guidance processing unit 166 described above to be realized in accordance with the hierarchical structure.

[0173] The parameter calculation unit 170 calculates the value of an activity parameter (an example of a predetermined parameter) that indicates the activity of a conversation in a talk room (i.e., the activity of the talk room). The parameter calculation unit 170 may calculate the activity parameter for one talk room based on the number (total number or cumulative number) of participating avatars M1 related to the one talk room, the speech frequency of each participating avatar, and the like. In this case, the value of the activity parameter may be calculated in such a manner that the activity level increases as the number of participating avatars M1 increases or the speech frequency increases. The parameter calculation unit 170 may also calculate the activity parameter based on the number (total number or cumulative number) of participating avatars M1 per unit time, and the like.

[0174] For talk rooms in which gifts can be sent, the parameter calculation unit 170 may further calculate (or correct) the value of the activity parameter based on the number and frequency of gift objects (see, for example, the heart-shaped gift object G12 in FIG. 14). The same applies to comments (such as comments from participating users) that have the same properties as gifts. If volume information (volume information) of each user's speech can be acquired, the parameter calculation unit 170 may calculate the value of the activity parameter in such a manner that the higher the volume, the higher the activity. The parameter calculation unit 170 may also calculate (or correct) the value of the activity parameter based on applause, laughter, cheers, and the like.

[0175] Furthermore, the parameter calculation unit 170 may calculate (or correct) the value of the activity parameter based on non-verbal information such as the motion of an avatar in a conversation. For example, the parameter calculation unit 170 may calculate the value of the activity parameter based on the frequency of the user's nodding movement, such that the higher the frequency of nodding, the higher the activity.

[0176] Furthermore, the parameter calculation section 170 may correct the value of the activity parameter for a talk room depending on the presence or absence of a specific avatar (for example, an avatar related to an influencer or a celebrity).

[0177] When the parameter calculation unit 170 calculates the value of the activity parameter for one talk room, it updates the data in the talk situation storage unit 142 based on the calculated value. The data related to the activity parameter in the talk situation storage unit 142 may be stored as time-series data. In this case, it is also possible to take into account changes and trends in activity (such as an upward or downward trend). The timing of the calculation of the activity parameter by the parameter calculation unit 170 for one talk room is arbitrary, but may be performed at a predetermined cycle, or may be performed when the number of participating avatars M1 changes, etc.

[0178] The terminal data acquisition unit 172 acquires various data for each terminal device 20 so that each terminal device 20 can realize various functions described below with reference to Fig. 23 to Fig. 27. The various data may include data in the talk situation storage unit 142, data representing the states (positions and movements) of various avatars, data relating to text information or voice information relating to various conversations, etc. The data representing the states (positions and movements) of various avatars may include motion information and position information (coordinates in virtual space) of each avatar.

[0179] The terminal data transmission unit 174 transmits various data acquired by the terminal data acquisition unit 172 to each terminal device 20. A part or all of the transmission data transmitted to each terminal device 20 may be different for each terminal device 20, or may be common. For example, only data related to the talk room in which the avatar related to one user exists may be transmitted to a terminal device 20 related to one user, from among data in the talk state storage unit 142 and data indicating the states of various avatars. Further details of the transmission data will be described in relation to the following description with reference to FIG. 23 to FIG. 27.

[0180] The conversation support processing unit 176 performs support processing for supporting various conversations in a talk room. The support processing is optional, but may, for example, identify digital content that matches a keyword in a conversation or a talk theme of a talk room, and play it on a display in the talk room (see, for example, a wall-mounted display object M10 in FIG. 10). For example, when a specific video is being talked about, the specific video is played. Such identification of digital content (digital content that matches a keyword in a conversation or a talk theme of a talk room) may be realized on the terminal device 20 side.

[0181] Next, the functions of the terminal device 20 will be mainly described with reference to FIG. 23 to FIG.

[0182] FIG. 23 is a schematic block diagram showing the functions of the terminal device 20 related to the above-mentioned talk theme.

[0183] In the following, the one terminal device 20 will be mainly described, but the same may be applied to the other terminal devices 20. In addition, in the following, a user and his / her avatar who uses the one terminal device 20 to be described will also be referred to as a self user or a self avatar, and other users or their avatars will also be referred to as other users or other avatars.

[0184] As shown in FIG. 23, the terminal device 20 includes an avatar information storage unit 240, a terminal data storage unit 242, a terminal data acquisition unit 250, an image generation unit 252, an information output unit 254, a theme information output processing unit 256, a distribution output unit 258, an activity output unit 260, a user input acquisition unit 262, a user input transmission unit 264, a guidance information output unit 266, and an auxiliary information output unit 268.

[0185] 23, the avatar information storage unit 240 and the terminal data storage unit 242 can be realized by the terminal storage unit 22 of the terminal device 20 shown in Fig. 1. Furthermore, the functions of each unit from the terminal data acquisition unit 250 to the auxiliary information output unit 268 can be realized by the terminal control unit 25 and the terminal communication unit 21 of the terminal device 20 shown in Fig. 1.

[0186] The avatar information storage unit 240 stores avatar information acquired by the terminal data acquisition unit 250 (described later). The avatar information may correspond to a part or all of the data in the avatar information storage unit 146 of the server device 10 shown in FIG.

[0187] The terminal data storage unit 242 stores terminal data acquired by a terminal data acquisition unit 250 described later. The terminal data may be data necessary for processing by each of an image generation unit 252, an information output unit 254, a theme information output processing unit 256, a distribution output unit 258, and an activity output unit 260 described later.

[0188] The terminal data acquisition unit 250 acquires terminal data based on the transmission data transmitted by the terminal data transmission unit 174 of the server device 10 described above. The terminal data acquisition unit 250 updates the data in the terminal data storage unit 242 based on the acquired terminal data. The timing of acquiring the terminal data is arbitrary, and the data that can change dynamically among the terminal data may be acquired at a predetermined cycle, or may be realized in a push or pull manner. For example, among the terminal data, data representing the state (position or movement) of the avatar and data related to character information or voice information related to conversation may be acquired at a predetermined cycle. On the other hand, among the terminal data, basic data of the virtual space such as the second object M3 may be updated at a relatively long cycle.

[0189] The image generating unit 252 generates a terminal image (an example of an image for terminal output) expressing the virtual space in which the user's own avatar is located. The image generating unit 252 may, for example, draw a portion of the virtual space excluding the avatar based on data in the terminal data storage unit 242. In this case, the viewpoint of the virtual camera related to the user's own avatar (own avatar) may be set and changed based on a user input from the user's own user via the input unit 24. Then, when one or more other avatars (other avatars to be drawn) are located within the field of view of the virtual camera, the image generating unit 252 draws the corresponding one or more other avatars based on avatar drawing information related to the corresponding one or more other avatars, which is data in the avatar information storage unit 146. Note that the viewpoint of the virtual camera related to the user's own avatar (own avatar) may be set as a default to the viewpoint of the user's own avatar's eyes, that is, a first-person viewpoint (see FIG. 25). However, the viewpoint of the virtual camera may be automatically changed according to the state of the user's avatar, such as being a third-person viewpoint when the user's avatar is moving and being a first-person viewpoint during a conversation (see FIG. 25).

[0190] It should be noted that, for example, when the moderator avatar M2 changes clothes (that is, when the ID related to the hairstyle or clothing is changed), the image generating unit 252 may update the appearance of the moderator avatar M2 accordingly.

[0191] The image generating unit 252 may express a change in position or movement of one or more other avatars based on information representing the state (position or movement) of one or more other avatars to be drawn, among the terminal data acquired by the terminal data acquiring unit 250. When expressing the mouth or facial movement of the other avatar when speaking, the image generating unit 252 may realize the expression in a manner synchronized with the voice information related to the other avatar.

[0192] Specifically, for example, when another avatar in the field of view of the virtual camera related to the user is in the form of a character facing forward, the image generating unit 252 may link the orientation of the other avatar to the orientation of the other user in such a manner that when the other user faces right, the corresponding other avatar faces right (or left), and when the other user faces down, the corresponding other avatar faces down. In this case, the orientation may be only the face, only the body, or a combination of these. This increases the consistency (linkage) of the orientation between the other avatar and the other user, and enables diversification of expression depending on the orientation of the other avatar.

[0193] Furthermore, when the other avatar is in the form of a character having a gaze direction, the image generating unit 252 may link the gaze direction of the other avatar to the gaze direction of the other user, such that when the other user gazes to the right, the gaze of the other avatar turns to the right (or left), and when the other user gazes downward, the gaze of the other avatar turns downward. Also, various eye movements such as blinking may be linked. Also, movements of the nose, mouth, etc. may be linked. This increases the consistency (linkage) of each part between the other avatar and the other user, and enables the other avatar to have a variety of facial expressions.

[0194] Furthermore, when the other avatar is in the form of a character having hands, the image generating unit 252 may link the hand movement of the other avatar to the hand movement of the other user in such a manner that when the other user raises his / her right hand, the other avatar raises his / her right hand (or left hand), and when the other user raises both hands, the other avatar raises both hands. Movements of each part of the hand, such as fingers, may also be linked. Other parts, such as feet, may also be linked in the same manner. This increases the consistency (linkage) between the other avatar and the other user, and enables diversification of expression by the movements of the parts of the other avatar.

[0195] In this embodiment, the rendering process of the image for the terminal is executed by the image generating unit 252 of the terminal device 20. In other embodiments, however, a part or all of the rendering process of the image for the terminal may be executed by the server device 10. For example, the rendering process may be realized by the browser processing the HTML document and various programs (Javascript) associated therewith received from the Web server forming the server device 10. That is, the server device 10 may generate the image generating data, and the terminal device 20 may render the image for the terminal based on the image generating data received from the server device 10. In such a configuration, the image generating data may be acquired from the server device 10 by the terminal data acquiring unit 250 each time. That is, the temporary storage of various data required in the terminal device 20 can be realized by the RAM (Random Access Memory) forming the terminal storage unit 22 of the terminal device 20. Various data are deployed in the RAM as a temporary storage function. In this case, for example, various data are downloaded based on the HTML document created in the server device 10, and the data is temporarily deployed in the RAM and used for processing (drawing, etc.) in the browser. When the browser is closed, the data expanded in the RAM is deleted. In a further modified example, a terminal image may be output in a streaming format based on the image data generated by the server device 10.

[0196] The information output unit 254 outputs text information or audio information viewable by the user himself / herself together with the terminal image generated by the image generation unit 252 based on a conversation-related input from each user associated with each avatar in the virtual space. In this case, the information output unit 254 determines a user to which the text information or audio information related to the conversation is to be output based on a positional relationship between each talk room in the virtual space and the position of the user himself / herself's avatar. In this case, the user to which the text information or audio information related to the conversation in one talk room is to be output may include the users related to each avatar in the one talk room. In this way, the information output unit 254 related to the user himself / herself (and the terminal device 20) may output text information or audio information viewable by the user himself / herself together with the terminal image only for the talk room in which the user himself / herself's avatar exists among the talk rooms in the virtual space.

[0197] Furthermore, when the user's avatar is located in a talk room to which the region R1 of the first attribute and the region R2 of the second attribute are associated, the information output unit 254 may change the output mode of character information or audio information related to the conversation based on the positional relationship of the user's avatar with respect to the region R1 of the first attribute and the region R2 of the second attribute. Specifically, the information output unit 254 may output character information or audio information related to the conversation in one talk room to the terminal device 20 of the user's own only when the user's avatar is located in the region R1 of the first attribute and the region R2 of the second attribute of the one talk room. Furthermore, when the user's avatar is located outside the region R2 of the second attribute in the one talk room, the information output unit 254 may output audio information related to the conversation in the one talk room at a relatively low volume to the terminal device 20 of the user's own.

[0198] Furthermore, when the user's avatar is located in the free space section 71, the information output unit 254 may output audio information related to conversations in nearby talk rooms at a predetermined volume to the user's terminal device 20. The predetermined volume may be changed according to the current value of an activity parameter of the corresponding talk room, etc., in such a manner that the higher the activity level of the corresponding talk room, the higher the volume becomes.

[0199] 13 and 15, the information output unit 254 outputs text information, audio information, and the like of the conversation related to the selected specific talk content together with a terminal image to the terminal device 20 related to the user, in cooperation with the distribution output unit 258. For example, in the example shown in FIG. 13, the information output unit 254 outputs text information, audio information, and the like of the conversation related to the specific talk content together with the talk room image H21 described above with reference to FIG. 14.

[0200] The theme information output processing unit 256 performs a theme information output process that includes theme information representing the talk theme identified by the theme identification unit 152 of the server device 10 in the terminal image. The output mode of the theme information is arbitrary, and is as described above with reference to, for example, FIG. 9, FIG. 10, FIG. 11, FIG. 13, FIG. 14, etc. For example, in the example shown in FIG. 10, if the avatar M7 about to enter the area R2 of the second attribute is the own avatar, when the display medium 1002R including the text information of "talk theme A" is within the field of view from the virtual camera related to the own avatar, the theme information output processing unit 256 draws the display medium 1002R in the terminal image (the terminal image for the user related to the own avatar).

[0201] When the theme information output processing unit 256 outputs a display medium (such as the display medium 302R in FIG. 3) or a theme display (such as the theme display G1302 in FIG. 13) showing the talk theme, the position and orientation in the terminal image do not necessarily have to match the position and orientation in the virtual space. For example, the display medium showing the talk theme may be output in the form of a billboard (always facing forward) as described above.

[0202] The theme information output processing unit 256 may change the display mode of the display medium showing the talk theme (for example, see the display medium 302R in FIG. 3) or the theme display showing the talk theme (for example, see the theme display G1302 in FIG. 13) based on the user's preference information, attribute information, etc. For example, the theme information output processing unit 256 may highlight the display medium showing the user's favorite talk theme, and conversely, display the display medium showing the user's least favorite talk theme in a small size or not displayed, based on the user's preference information, etc.

[0203] The distribution output unit 258 outputs a specific talk content selected by the user among the specific talk contents distributed by the distribution processing unit 160 of the server device 10. Note that the drawing when the specific talk content is output by the distribution output unit 258 may be realized in a manner similar to that of the image generation unit 252 described above.

[0204] The activity output unit 260 includes activity information (information indicating the activity of conversation) in the terminal image based on the activity information (see FIG. 18) in the terminal data acquired by the terminal data acquisition unit 250. The output mode of the activity information is arbitrary, but for example, the current value of the activity parameter may be output in a meter (gauge) representation.

[0205] Alternatively, the activity output unit 260 may realize an output indirectly indicating the current value of the activity parameter. For example, the activity output unit 260 may generate various effects according to the current value of the activity parameter. For example, the character information indicating the contents of the utterance may be colored with a specific color for a specific object in the chat room, or rising particles may be generated as a "magic circle effect." The particles may be expressed in a manner rising in the virtual space as shown in FIG. 24. In this case, an effect may be generated in a manner in which the number of rising particle objects M24 (second objects M3) increases as the activity level increases. The particle objects M24 may be generated by being triggered by a specific change (e.g., a sudden increase, etc.) in the value of the activity parameter.

[0206] In addition, the activity output unit 260 may change the display mode (for example, whether or not to blink, thickness, etc.) of the line (circle) separating the region R1 of the first attribute and / or the region R2 of the second attribute according to the current value of the activity parameter. The color of the line (circle) separating the region R1 of the first attribute and / or the region R2 of the second attribute may be selected by the user related to the moderator avatar M2, may be automatically set for each talk theme or for each higher category of the talk theme, or may be set for each language (locale ID). In addition, FIG. 24 illustrates a display medium 2402R representing a talk theme. In this case, the display medium 2402R may be in the form of a character string floating above the heads of the avatars having a conversation. For example, in the situation shown in FIG. 24, two avatars M26 standing and talking at a counter M34 arranged in a space such as a bar can see the display medium 2402R related to the conversation in which the particle object M24 rises, and can consult with each other about whether to participate in the conversation.

[0207] Furthermore, the activity level output section 260 may associate a tag of "active talk" with a talk room with a high activity level, and conversely, may associate a tag of "relaxed talk" with a quiet talk room.

[0208] The user input acquisition unit 262 acquires various inputs from the user via the input unit 24 of the terminal device 20. The input unit 24 may be realized, for example, by a user interface formed on a terminal image for the user.

[0209] Fig. 25 is a diagram showing an example of a user interface suitable for a virtual space in a world form in which an avatar can move around freely. Fig. 25 shows a terminal image G1700 in a state in which the avatar is talking to another avatar (in this case, the avatars related to user B and user C) from the first-person viewpoint of the avatar.

[0210] 25, the user interface includes a main interface 300, which includes a chair button 301, a like button 302, a ticket management button 303, a friend management button 304, and an exit button 305. In the example shown in Fig. 25, the terminal image also includes a conversation interface 309, which is another user interface.

[0211] The chair button 301 is operated when switching the state of the participant avatar M1 between a seated state and a non-seated state. For example, when each user wants to have a thorough conversation through the participant avatar M1, the user can generate a seating instruction to sit on the chair M4 by operating the chair button 301. In FIG. 25, the avatars M1 related to users B and C are seated on the chair M4.

[0212] For example, when the chair button 301 is operated when the participating avatar M1 is in a seated state, a release instruction is generated. In this case, the chair button 301 generates a different instruction (a seated instruction or a release instruction) when the participating avatar M1 is in a seated state and when the participating avatar M1 is in a movable state (e.g., a non-seated state). Note that when the participating avatar M1 is in a seated state, a similar effect to that of the participating avatar M1 being located in the first attribute region R1 may be realized.

[0213] The shape of the chair button 301 is arbitrary, but in the example shown in Fig. 25, it is in the shape of a chair. In this case, an intuitively easy-to-understand user interface can be realized. Note that the chair button 301 may be operable only when the user's avatar is located in a specific space such as the free space portion 71.

[0214] The chair button 301 for one participant avatar M1 may be drawn in a different manner when the state of the participant avatar M1 is a seated state and when the state of the participant avatar M1 is a movable state. For example, the color or shape of the chair button 301 may be different when the state of the participant avatar M1 is a seated state and when the state of the participant avatar M1 is a movable state. Alternatively, in a modified example, a button for instructing to sit and a button for instructing to release may be drawn separately. In this case, the button for instructing to sit may be drawn operable when the participant avatar M1 is in a movable state, and may be drawn inoperable when the participant avatar M1 is in a seated state. Also, the button for instructing to release may be drawn inoperable when the participant avatar M1 is in a movable state, and may be drawn operable when the participant avatar M1 is in a seated state.

[0215] The like button 302 is operated when giving a good evaluation or a gift, etc. to another participating avatar M1 via the participating avatar M1.

[0216] The ticket management button 303 is operated when outputting a ticket management screen (not shown) on which various ticket statuses can be viewed. The ticket may be a virtual reality medium that must be presented when entering a specific space 70 (for example, a talk room related to a specific paid talk content).

[0217] The friend management button 304 is operated when outputting a friend management screen (not shown) related to other participating avatars M1 who are friends with the participant avatar M1.

[0218] The exit button 305 is operated when making the participant avatar M1 exit the virtual space or the talk room.

[0219] The conversation interface 309 is an input interface for conversation-related input realized in a chat format using text and / or voice. In this case, a user can input voice (voice input from the input unit 24 in the form of a microphone) by operating a microphone icon 3091 to speak, and can also input text by inputting text into a text input area 3092. This enables conversation between users. Note that text may be drawn on each terminal image (each terminal image related to each user who is conversing) in a dialogue format that leaves a certain number of histories. In this case, for example, the text may be output separately from the image related to the virtual space, or may be output superimposed on the image related to the virtual space.

[0220] As described above, when the user's avatar is located in a talk room having a first attribute region R1 and a second attribute region R2, the conversation interface 309 may be activated (or displayed) only when the user's avatar is located in the first attribute region R1. The icon 3091 may be muted in response to an operation from the user. Even in this case, the user can converse with other users via text input.

[0221] FIG. 26 is an explanatory diagram of a part orientation operation input by a gesture. FIG. 26 shows a state in which the user performs a part orientation operation input by changing the direction of the face while holding the terminal device 20 in the hand. In this case, the terminal device 20 identifies the face of the user based on the face image of the user input via the terminal camera 24A, and generates operation input information including a part orientation operation input according to the direction of the identified face. Alternatively, the user may change the direction of the terminal device 20 while holding the terminal device 20 in the hand. In this case, the terminal device 20 may generate operation input information including a part orientation operation input according to the direction of the terminal device 20 based on the acceleration sensor 24B built in the terminal device 20.

[0222] The operation input by the gesture may be used to change the viewpoint of the virtual camera. For example, when the user changes the orientation of the terminal device 20 while holding the terminal device 20 in his / her hand, the viewpoint of the virtual camera may be changed according to the orientation. In this case, even when the user uses the terminal device 20 with a relatively small screen such as a smartphone, the width of the visual recognition area can be ensured in a manner similar to the way the user can view the surroundings through a head-mounted display.

[0223] The user input transmitting unit 264 transmits the various user inputs acquired by the user input acquiring unit 262 to the server device 10. Data based on some or all of the various user inputs from the user himself / herself thus transmitted to the server device 10 can be acquired as terminal data related to the terminal device 20 of the other user by the terminal data acquiring unit 250 of the terminal device 20 of the other user via the server device 10. Note that in a modified example, data exchange by P2P between the terminal device 20 of the user himself / herself and the terminal device 20 of the other user may be realized.

[0224] The guidance information output unit 266 functions when the user is extracted as a guidance target user. That is, the guidance information output unit 266 functions when the user's avatar is the guidance target avatar M5. The guidance information output unit 266 cooperates with the guidance processing unit 166 of the server device 10 described above to execute guidance processing that makes it easier for the user's avatar (the guidance target avatar M5) to reach the guidance target talk room.

[0225] Fig. 27 is a diagram showing an example of a terminal image for a user for explaining an example of the guidance process. Note that the guidance process shown in Fig. 27 is suitable for a virtual space in a world format in which an avatar can move around freely.

[0226] In FIG. 27, arrow lines 1300 and 1500 are drawn as guidance information in association with the user's own avatar (guide target avatar M5). In this case, the guidance information output unit 266 calculates a guidance route, which is a recommended route for moving to the guide target talk room, based on the positional relationship between the guide target avatar M5 and the guide target talk room. At this time, the guidance information output unit 266 may calculate a guidance route that does not pass through objects related to obstacles such as objects that cannot be passed through (i.e., a guidance route through which the guide target avatar M5 can move). Then, based on the calculated guidance route, the guidance information output unit 266 draws talk theme guidance information 1600 and 1700 (theme information) along the guidance route, as shown in FIG. 27, along with arrow lines 1300 and 1500. This allows the user associated with the guide target avatar M5 to easily understand that it is sufficient to move along the arrow line 1300 to the talk room related to the talk theme B, and that the distance is 100 m. Also, the user associated with the guide target avatar M5 can easily understand that the talk room associated with the talk theme C can be reached by moving along the line of the arrow 1500, and can also understand that the distance is 50 m. In FIG. 27, a warp area 1100 is set, and the user can efficiently move to the talk room associated with the talk theme C via the warp area 1100. The warp area 1100 may appear when the talk theme is managed in a hierarchical structure. In this case, the warp area 1100 may be set for each branch, and the user may be able to determine the branch destination for each warp area 1100. The guidance mode when the talk theme is managed in a hierarchical structure is not limited to this, and a conceptual branch map may be presented, or a door (second object M3) may be set instead of the warp area 1100. The conceptual branch map may be in the form of a board game or a train route map.

[0227] In the example shown in FIG. 27, distance information to the talk room to be introduced is output as a supplementary output. In addition to or instead of this, the number of friend users in the talk room to be introduced and activity level information may be output. In this case, the user can select a desired talk room from among multiple talk rooms to be introduced, taking into consideration not only the talk theme but also the distance and the presence or absence of friends. In addition, the guidance information output unit 266 may guide the user to interact with users who have many keywords matching the past talk rooms in addition to the friend users. For example, the guidance information output unit 266 may recommend that the user become friends with users who have many keywords matching the past talk rooms in the past, or may allow the user to move to a location near a user who has many keywords matching the past talk rooms in the virtual space by using a warp button (not shown). The notification of "recommended to become friends" may be notified to the display unit 23 of the user's terminal device 20. In addition, for the convenience of a novice user who has never participated in a conversation, when the user selects one or more talk topics to talk about, users who have previously participated in conversations on the talk topic may be extracted and notified of "recommended to become friends" or "move nearby", or the talk rooms may be presented. This allows a user who does not have any friends at first to effectively create an opportunity to start a conversation with a stranger.

[0228] The auxiliary information output unit 268 outputs various auxiliary information that is highly convenient for the user. For example, the auxiliary information output unit 268 may associate participation availability information (see data of the talk status storage unit 142 in FIG. 18) with each talk room. For example, whether participation is available or unavailable may be presented on the door (second object M3) of the talk room or on a screen before participating in the conversation. For example, a message board (second object M3) such as "Entry OK!", "Anyone can drop in!", or "Don't come in!" may be associated. Alternatively, the auxiliary information output unit 268 may make an unavailable talk room locked and inaccessible, or invisible. In that case, the auxiliary information output unit 268 may make it easier for an available talk room to be within the user's field of vision (within the field of vision of the virtual camera).

[0229] In addition, when the language of the conversation taking place in the talk room is different from the language of the user, the auxiliary information output unit 268 may output a translation of the text information or audio information (e.g., in the form of subtitles) in synchronization with the output of the text information or audio information related to the conversation.

[0230] Furthermore, the auxiliary information output unit 268 may present a talk theme for the after-party when a conversation on a specific talk theme ends. In this case, the remaining users (participants) may decide on the next theme. Alternatively, the auxiliary information output unit 268 may automatically suggest a next talk theme candidate based on the conversation information up to that point. Alternatively, the auxiliary information output unit 268 may present a similar talk theme from other existing conversation information.

[0231] Next, various operational examples of the virtual reality generation system 1 shown in FIG. 1 will be further described with reference to FIG. 28 onwards.

[0232] Fig. 28 is an explanatory diagram of the flow of operations from the creation of one talk room to the end of distribution. In Fig. 28, the horizontal axis represents time, and the flow of operations from the creation of one talk room to the end of distribution is shown in outline.

[0233] First, in step S180, a talk room is generated (formed). As described above, the talk room may be formed in response to a request (reservation, etc.) by a host user in the case of distribution of specific talk content, or may be formed naturally in the flow of conversation between avatars in the case of a virtual space in the form of a world, and the conditions for formation are arbitrary. When a talk room is generated (formed), a talk ID is assigned to the talk room, and the above-mentioned first attribute area R1 and second attribute area R2 may be appropriately defined.

[0234] When a talk room is generated (formed), a conversation / distribution state in the talk room is formed (S182). In this state, various processes are executed to identify a talk topic. Specifically, the content of the utterance is converted into text (indicated as "speech content STT" in the figure) (S1821), and through morphological analysis (S1822) and censorship (S1823), a talk topic is identified (and displayed) (S1824). Then, when a talk room disappearance condition is met (for example, when the distribution end time is reached), the distribution ends (S184). In the case of a virtual space in the form of a world, instead of ending the distribution, the talk room may disappear or be made available for other uses. In the case of a conversation by character input such as chat, the step of converting the content of the utterance into text (in the figure, "speech content STT") (S1821) among the above steps may be omitted.

[0235] Here, the conversion of the spoken content into text (S1821) and the morphological analysis (S1822) are executed by the server device 10, but may be executed by the terminal device 20. This distributes the processing costs related to various processes for identifying the talk theme, and reduces the load on the server device 10. In addition, the inspection (S1823) is preferably executed by the server device 10 in terms of management of various dictionaries such as the noun translation Tbl, but some of the processing may be executed by the terminal device 20. In addition, in the process of identifying and displaying the talk theme (S1824), the identification of the talk theme is preferably executed by the server device 10, but some of the processing may be executed by the terminal device 20. In addition, in the process of identifying and displaying the talk theme (S1824), the display (drawing) of the talk theme is preferably executed by the terminal device 20, but may be executed by the server device 10.

[0236] Figure 29 is a flow diagram showing an example of the operation of the terminal device 20A on the host side (content distribution side), the terminal device 20B on the participant side (content viewing side), and the server device 10 in the virtual reality generation system 1 shown in Figure 1 while a specific talk content is being distributed by a host side user (i.e., while a specific talk content is being viewed by a participant side user).

[0237] In FIG. 29, the left side shows the operations performed by one of the hosting terminal devices 20A, the center shows the operations performed by the server device 10 (here, one server device 10), and the right side shows the operations performed by one of the participating terminal devices 20B.

[0238] In step S210, the host user starts distribution according to the talk theme, and performs various actions (including speech actions related to conversation) to realize various actions of the moderator avatar M2. As a result, the host terminal device 20A generates host user information according to the various actions of the moderator avatar M2. The host terminal device 20A transmits such host user information to the server device 10 as terminal data related to the terminal device 20B. The host user information may be multiplexed with each other by any multiplexing method and transmitted to the server device 10, as long as the condition is satisfied that the correspondence between the information to be transmitted (transmitted) and the time stamp based on the reference time is clear in both the host terminal device 20A and the participant terminal device 20B. If such a condition is satisfied, the participant terminal device 20B can appropriately process the host user information according to the time stamp corresponding to the host user information when receiving it. Regarding the multiplexing method, the host user information may be transmitted via separate channels, or a part of the host user information may be transmitted via the same channel. The channel may include a time slot, a frequency band, and / or a spreading code, etc. The method for distributing a video (specific talk content) using a reference time may be realized in the manner disclosed in Japanese Patent No. 6803485, which is incorporated herein by reference.

[0239] Next, in parallel with the operation in step S210, in step S212, the host terminal device 20A continuously transmits host user information for drawing a talk room image H21 for the participating user to the participating terminal device 20B via the server device 10, and outputs a talk room image (not shown) for the host user to the host terminal device 20A.

[0240] The terminal device 20A on the host side can perform the operations in steps S210 and S212 in parallel with the operations in steps S214 to S222 described below.

[0241] Next, in step S214, the server device 10 transmits (transfers) the host user information that is continuously transmitted from the host terminal device 20A to the participant terminal device 20B.

[0242] In step S216, the participant terminal device 20B receives the host user information from the server device 10 and stores it in the terminal storage unit 22. In one embodiment, taking into consideration the possibility that voice information has a larger capacity than other information and / or the possibility that a failure will occur in the communication line, the participant terminal device 20B can temporarily store (buffer) the host user information received from the server device 10 in the terminal storage unit 22 (see FIG. 1).

[0243] In parallel with receiving and storing such host user information, in step S218, the participant terminal device 20B uses the host user information received and stored from the host terminal device 20A via the server device 10 to generate a talk room image H21 for the participant user and play back specific talk content.

[0244] In parallel with the operations in step S216 and step S218 described above, in step S220, the participant terminal device 20B generates participant user information and transmits the participant user information to the host terminal device 20A via the server device 10 as terminal data related to the terminal device 20A. The participant user information may be generated, for example, only when the participant user inputs a conversation-related input or performs an operation to give a gift.

[0245] In step S222, the server apparatus 10 transmits (transfers) the participant user information received from the participant terminal apparatus 20B to the host terminal apparatus 20A.

[0246] In step S224, the terminal device 20A on the host side can receive the participant user information via the server device 10.

[0247] In step S226, the host terminal device 20A can basically perform the same operation as in step S210. For example, the host terminal device 20A generates a drawing instruction and / or a gift drawing instruction for the participant avatar M1 based on the participant user information received in step S224, and draws the corresponding participant avatar M1 and / or gift object in the talk room image. Note that when an audio output instruction is generated in addition to the drawing instruction, drawing and audio output are performed.

[0248] In this manner, the process shown in FIG. 29 may be continuously executed until the distribution of the specific talk content by the host user is completed or until there are no more participating users of the specific talk content.

[0249] In the example shown in FIG. 29, the execution entity of each process can be changed in various ways as described above. For example, in the process of step S212, the process of generating a talk room image (not shown) for the hosting user may be realized by the server device 10 instead of the terminal device 20A. In addition, in the process of step S218, the process of generating a talk room image H21 for the participating user may be realized by the terminal device 20A or the server device 10. In this case, in step S216, data of the talk room image H21 for the participating user may be received instead of the hosting user information. In addition, in the process of step S226, the process of drawing a gift object in the talk room image (not shown) for the hosting user based on the participating user information may be realized by the server device 10 instead of the terminal device 20A.

[0250] In addition, in the example shown in Fig. 29, the roles of the host side (content distribution side) and the participant side (content viewing side) are distinguished, but the distinction between these roles does not need to be made. For example, in a world-type virtual space in which each avatar can move around freely, as described above, the distinction between the roles of the participant avatar M1 and the moderator avatar M2 is made for the sake of explanation, and there is no substantial difference between the avatars. In other words, in a virtual space in which each avatar can move around freely, each terminal image is an image showing the state of the virtual space from the viewpoint of each virtual camera, so there is no need to distinguish between roles.

[0251] Although the embodiments have been described in detail above with reference to the drawings, the specific configurations are not limited to the various embodiments described above, and also include designs within the scope of the gist of the present invention.

[0252] For example, in the above-described embodiment, each user can freely join talk rooms, but the talk rooms that users can join may differ depending on the attributes of the user, or special talk rooms such as private talk rooms may be set. For special talk rooms such as private talk rooms, a talk theme may not be specified, and even if a talk theme is specified, output of a theme display or the like (theme information) indicating the corresponding talk theme may be prohibited. Therefore, a display medium or the like indicating a talk theme may be output only for talk rooms that each user can freely join.

[0253] In the above-described embodiment, the language in the chat room may be fixed in response to a request from a host of an official event, etc. In this case, when a speech in a different language is detected, a notice regarding a warning about the language may be issued.

[0254] In the above embodiment, the talk theme associated with one talk room may change depending on the result of identification by the theme identification unit 152, but such a change may be prohibited based on, for example, a request or setting from the host user. In this case, even if the host user intentionally derails the topic during a conversation, the talk theme can be prevented from changing due to the derailment.

[0255] In addition, the above-described embodiment may be modified in the following manner, for example. Whether or not the display medium 302R (such as a signboard) displaying the talk topic is within the field of view of other users is determined, and an event hook or log is created to measure the effectiveness of the advertisement. For incentives such as paid users, the display medium 302R (such as a signboard) displaying the talk theme is highlighted with animation, illumination, etc., to make it larger and easier to see. In addition, when the display medium 302R is configured as a signboard, the signboard is usually placed at a fixed position, but in this case, the signboard may not be easily noticeable due to its relative relationship with other elements in the virtual space. In such a case, in order to make the signboard stand out in the same way as a signboard in the real space and improve the visibility of the signboard itself, a function called "decoration" may be given to the signboard regarding the talk theme. As a specific example of the decoration function, as described above, for the signboard, the size (area) of the signboard may be increased, the information surface may be animated (any URL such as YouTube or a video file may be given and displayed on the signboard), and effects such as illumination may be added around the information. Furthermore, when searching using a search function (for example, a "magnifying glass emoji") rather than in the virtual space, information and images of the event including the talk theme may be displayed using a specific keyword (a function similar to "listing advertisement (search-linked advertisement)"). When adding such a decorative function, an additional charge may be set. Participants in the talk topic are notified that the display medium 302R (such as a signboard) displaying the talk topic has come into view of other users, and that there is another user approaching the circle. ·The above notification automatically changes the orientation of the participating avatars toward the other users, and automatically plays an emote. An emote is a function that causes an avatar to take a pose (gesture) that is determined for each emotional expression. In this case, for example, participating avatars may clap their hands or send a "peace" sign in unison or separately in the direction of the approaching other users. In addition, for example, they may ask for a "handshake," or make a pose such as a "beckoning" or a "hug." On the other hand, when other users leave the circle, they may wave their hands to say "bye-bye," clasp their hands to say "sorry," or raise their hands to say "see you later." Note that the same pose may be perceived differently depending on the country (for example, a pose that is innocent in one country may be perceived as an insulting pose in another country), so the poses used may be considered to be appropriately corresponding to the emotional expression at that time for each nationality of the other users. The above-mentioned automatic emotes may classify the attributes of the other users according to tags such as "beginner", "looking for someone to talk to", "don't want to talk", topics, language attributes, etc. The above auto-emotes may be based on the current activity of the chat room conversation.

[0256] Regarding the above embodiment, the following supplementary notes are further disclosed. (Appendix 1) an image generating unit that generates an image for terminal output representing a virtual space including an avatar associated with each user; an information output unit that outputs text information or audio information that can be viewed by each user, together with the terminal output image, based on a conversation-related input from each user associated with an avatar in the virtual space; a theme identification unit that identifies a theme of a conversation based on the conversation-related input regarding a conversation between users based on the character information or the voice information output by the information output unit; and a theme information output processing unit that performs a theme information output process for including theme information indicating the theme of the conversation identified by the theme identification unit in the image for terminal output. (Appendix 2) The information processing system according to claim 1, wherein the theme information output processing unit determines a method of outputting the theme information to a user based on user information relating to the user. (Appendix 3) The information processing system described in Appendix 1 or 2, wherein when a conversation for which the theme information is output in response to an input instruction from a user is selected, the information output unit outputs to the user the text information or the audio information of the conversation related to the selected theme information. (Appendix 4) A distribution processing unit that distributes one or more predetermined digital contents and outputs list information including distribution items of the predetermined digital contents that are being distributed or are scheduled to be distributed, The information processing system according to claim 1 or 2, wherein the theme information output process includes associating the list information with the theme information indicating a theme of the conversation related to the specified digital content. (Appendix 5) The information processing system according to claim 4, wherein the distribution processing unit outputs the distribution type of the specified digital content in a form including a corresponding thumbnail. (Appendix 6) The information processing system according to claim 4 or 5, wherein the information output unit, when one of the specified digital contents is selected in response to an input instruction from a user, outputs to the one user the text information or the audio information of the conversation relating to the selected one of the specified digital contents. (Appendix 7) The information processing system according to any one of appendices 1 to 3, wherein the information output unit determines a user to which the text information or audio information related to the conversation is to be output based on a positional relationship between a predetermined position or area corresponding to the theme of the conversation in the virtual space and the position of each avatar. (Appendix 8) The information processing system according to claim 7, wherein the theme information output process includes associating a predetermined display medium related to the theme information with the predetermined position or area. (Appendix 9) an avatar determination unit that determines a predetermined avatar from among avatars associated with each user with whom the conversation is being held; The information processing system according to claim 7 or 8, wherein the theme information output process includes associating a predetermined display medium related to the theme information with the predetermined avatar. (Appendix 10) the predetermined position or area associated with the conversation theme includes a position or area of ​​a first attribute and a position or area of ​​a second attribute different from the first attribute, The information processing system of any one of Appendices 7 to 9, wherein the information output unit outputs the text information or the audio information to each user associated with one or more avatars located at the specified position or area based on the conversation-related input from only users associated with one or more avatars located at a position or area of ​​the first attribute, among the users associated with one or more avatars located at the specified position or area. (Appendix 11) The information processing system of claim 10, wherein the position or area of ​​the second attribute is set adjacent to the position or area of ​​the first attribute. (Appendix 12) An information processing system described in any one of appendix 7 to 11, further comprising a setting processing unit that, when multiple conversations with different themes are identified in a virtual space, corresponds the specified position or area to each of the conversation themes. (Appendix 13) The information processing system described in Appendix 12, wherein the setting processing unit changes the distance between the specified positions or areas corresponding to each theme based on the relevance or dependency between the conversation themes. (Appendix 14) The information processing system according to claim 12 or 13, wherein the theme identification unit monitors whether or not there is a change in the theme of the conversation. (Appendix 15) The information processing system according to claim 14, wherein the setting processing unit changes the specified position or area based on a change in the theme of the conversation. (Appendix 16) a user information storage unit that stores conversation information related to the conversation in which each user participated in association with each user; A user extraction unit that extracts users to be guided; The information processing system of any one of appendices 7 to 15, further comprising a guidance processing unit that, when a plurality of conversations on different themes are taking place in the virtual space, determines a theme to be guided to the one user to be guided from among the themes of the plurality of conversations based on the conversation information corresponding to the one user to be guided. (Appendix 17) The information processing system of claim 16, wherein the conversation information associated with a user is extracted based on the conversation-related input from the user. (Appendix 18) The information processing system described in Appendix 16 or 17, wherein the guidance processing unit makes it easier for an avatar corresponding to one of the users to be guided to reach the specified position or area corresponding to the theme of the guidance target. (Appendix 19) a theme management unit that manages the themes of the conversations in a hierarchical structure in which the themes of the conversations are branched in a hierarchical manner when the conversations are held in a virtual space on different themes; The information processing system according to any one of appendices 16 to 18, wherein the guidance processing unit determines a theme at a higher level in the hierarchical structure as an initial theme for the guidance target in a manner that allows one of the guidance target users to follow the hierarchical structure from the higher level to the lower level. (Appendix 20) 20. The information processing system according to any one of claims 1 to 19, wherein the theme identification unit includes a keyword extraction unit that extracts keywords based on the conversation-related input from each user. (Appendix 21) a parameter calculation unit that calculates a value of a predetermined parameter that indicates the conversation activity level; An information processing system according to any one of appendices 1 to 20, further comprising an activity output unit that includes information representing the activity level of the conversation in the image for terminal output based on the calculated value of the specified parameter. (Appendix 22) generating an image for terminal output representing a virtual space including an avatar associated with each user; outputting text information or audio information viewable by each user together with the terminal output image based on a conversation-related input from each user associated with an avatar in the virtual space; Identifying a topic of a conversation between users based on the output text information or the output voice information; An information processing method executed by a computer, comprising: including theme information representing the identified theme of the conversation in the image for terminal output. (Appendix 23) generating an image for terminal output representing a virtual space including an avatar associated with each user; outputting text information or audio information viewable by each user together with the terminal output image based on a conversation-related input from each user associated with an avatar in the virtual space; Identifying a topic of a conversation between users based on the output text information or the output voice information; theme information representing the identified theme of the conversation is included in the image for terminal output; A program that causes a computer to carry out processing. [Explanation of symbols]

[0257] 1 Virtual reality generation system 3. Network 10. Server equipment 11 Server Communication Section 12 Server memory section 13 Server control unit 20 Terminal Equipment 21 Terminal communication unit 22 Terminal memory section 23 Display section 24 Input section 24A Terminal Camera 24B Acceleration Sensor 25 Terminal control unit 30 Studio Units 70 Space section 71 Free space section 140 Chat history memory unit 142 Talk status memory unit 144 User information storage unit 146 Avatar information storage unit 150 Talk Data Acquisition Department 152 Theme Specific Section 154 Keyword Extraction Unit 156 Talk Management Department 158 Avatar Determination Department 160 Distribution Processing Unit 162 Setting processing section 164 User Extraction Unit 166 Induction Processing Unit 168 Theme Management Department 170 Parameter Calculation Unit 172 Terminal data acquisition unit 174 Data transmission unit for terminal 176 Conversation support processing unit 240 Avatar information storage unit 242 Data storage unit for terminal 250 Data Acquisition Unit for Terminals 252 Image Generation Unit 254 Information Output Section 256 Theme information output processing section 258 Distribution output section 260 Activity Output Unit 262 User Input Acquisition Unit 264 User Input Transmission Unit 266 Guidance information output section 268 Auxiliary Information Output Unit

Claims

1. a theme identification unit that identifies a theme of a conversation between users based on a conversation-related input from each user associated with an avatar in a virtual space, the conversation being held based on character information or audio information that is output so as to be viewable by each user; and a user information storage unit that stores information about the user in association with the user; A user extraction unit that extracts a user to be guided from the stored users; a guidance processing unit that determines a topic to be guided to the guidance target user based on information about the guidance target user extracted from the identified conversation topic, The guidance processing unit performs guidance processing for an avatar associated with the user to be guided to a predetermined position or area associated with the theme of the user to be guided, in a manner that allows the user to be guided to recognize the predetermined position or area associated with the theme of the user to be guided.

2. The information processing system according to claim 1 , wherein the guidance processing unit determines a theme of the guidance target for the guidance target user based on information about the user.

3. The information processing system according to claim 1 , wherein the guidance processing unit displays a theme of the guidance target in the virtual space.

4. a theme information output processing unit that performs a theme information output process for including theme information that indicates the theme of the conversation identified by the theme identification unit in an image for terminal output, The information processing system according to claim 1 , wherein the guidance processing unit, in cooperation with the theme information output processing unit, changes a display mode of a display medium representing the theme of the guidance target or a theme display indicating the theme of the guidance target.

5. a guidance information output unit that calculates a guidance route for moving to the predetermined position or area associated with the theme of the guidance target based on a positional relationship between an avatar associated with the guidance target user and the predetermined position or area associated with the theme of the guidance target; The information processing system according to claim 4 , wherein the guidance processing unit cooperates with the guidance information output unit to display the guidance route on an image for terminal output.

6. The information processing system according to claim 5 , wherein the guidance processing unit, in cooperation with the guidance information output unit, displays at least one of a direction and a distance from a position of an avatar associated with the user to be guided to the specified position or area based on the positional relationship.

7. an avatar determination unit that determines a specific avatar from among avatars associated with the user with whom the conversation is being held; a setting processing unit that associates the predetermined position or area with the theme of the conversation, The information processing system according to claim 1 , wherein the predetermined position or area is formed based on a position of the predetermined avatar.

8. The information processing system described in claim 7, wherein the specified locations or areas include a location or area of ​​a first attribute in which the details of the conversation can be viewed and one's own conversation can be held, and a location or area of ​​a second attribute in which the details of the conversation can be viewed but one's own conversation cannot be held.

9. The information processing system according to claim 7 , wherein the avatar determination unit, in cooperation with the theme identification unit, determines, as the predetermined avatar, an avatar that has a high utterance frequency of a keyword related to the theme identified by the theme identification unit.

10. The information processing system according to claim 1 , wherein the predetermined position or area moves in association with a movement of the predetermined avatar.

11. The information processing system according to claim 1 , wherein the predetermined position or area occurs due to a predetermined action of a user associated with the predetermined avatar.

12. 12. The information processing system according to claim 1, wherein the predetermined location or area includes a location or area requiring payment of a predetermined fee to enter.

13. 13. The information processing system according to claim 1, further comprising an information output unit that outputs text information or audio information viewable by a user together with an image for terminal output based on a conversation-related input from a user associated with an avatar in a virtual space, the information output unit determining a user to which the text information or audio information related to the conversation is to be output based on a positional relationship between the specified position or area and the position of the avatar.

14. The information processing system according to claim 1 , further comprising a parameter calculation unit that calculates a value of a predetermined parameter that indicates a conversation activity level.

15. The information processing system according to claim 14 , further comprising an activity level output unit that includes information representing the conversation activity level in an image for terminal output based on the calculated value of the predetermined parameter.

16. a theme identification step of identifying a theme of a conversation between users based on character information or audio information outputted so as to be viewable by each user based on a conversation-related input from each user associated with an avatar in a virtual space; a user information storage step of storing information about the user in association with the user; A user extraction step of extracting a user to be guided from the stored users; A guidance processing step of determining a guidance topic for the guidance target user based on information about the guidance target user extracted from the identified conversation topic, The guidance processing step is an information processing method executed by a computer, in which a guidance process is performed for an avatar associated with the user to be guided to a predetermined position or area associated with the theme of the target of guidance, in a manner that allows the user to be guided to recognize the predetermined position or area associated with the theme of the target of guidance.

17. a theme identification function that identifies a theme of a conversation between users based on a conversation-related input from each user associated with an avatar in a virtual space, the conversation being held based on text information or audio information that is output so as to be viewable by each user; and a user information storage function that stores information about the user in association with the user; A user extraction function for extracting users to be guided from the stored users; A guidance processing function for determining a topic to be guided to the guidance target user based on information about the guidance target user extracted from the identified topic of conversation, The guidance processing function is a program that executes a guidance process for an avatar associated with the user to be guided to a predetermined position or area associated with the theme of the user to be guided, in a manner that allows the user to be guided to recognize the predetermined position or area associated with the theme of the user to be guided.

Images