Program, information processing method, and information processing system

Abstract

To provide a technology for improving convenience of communication via a network and performing assistance.SOLUTION: An application information management section 60 acquires and manages information on avatars corresponding to respective users in a virtual space. A first detection section 61 detects starts of communication of the plurality of users associated with the respective avatars in the virtual space. A second detection section 62 detects termination of the communication. Depending on a result of detection at the first detection step and a result of detection at the second detection step, a proceedings generation section 63 determines start time and termination time of the communication, and generates information on the communication in a period of the communication.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a program, an information processing method, and an information processing system. [Background technology]

[0002] In recent years, the use of online communication such as video conferences and online meetings has been increasing. In such online communication, there is a strong demand for recording the content of the communication and creating minutes. For example, Patent Document 1 proposes a technology that can separately create minutes for all participants and minutes for individual group participants (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-71444 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, many of the conventional technologies including Patent Document 1 are based on the premise that participants gather at a predetermined time to hold a planned meeting, such as a video conference, and do not take into account unplanned, spontaneous communication, etc. However, in recent years, many opportunities have been provided for spontaneous online communication.

[0005] The present disclosure has been made in light of the above circumstances, and aims to provide a technology that improves and supports the convenience of communication via a network. [Means for solving the problem]

[0006] In order to achieve the above object, a program according to one aspect of the present disclosure comprises: On the computer, an acquisition step of acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection step of detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection step of detecting an end of the communication; a generating step of determining a start time and an end time of the communication according to a result of the detection by the first detecting step and a result of the detection by the second detecting step, and generating information about the communication during the period of the communication; It is a program that executes processing including the above. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a technology that improves and supports the convenience of communication via a network. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server that configures an information processing system according to an embodiment of the present disclosure. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a server and a user terminal that configure an information processing system according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a diagram illustrating an example of a communication function of an information processing system according to an embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram illustrating an example of a communication function of the information processing system according to an embodiment of the present disclosure, which is a diagram illustrating an example different from the example of FIG. 4. [Figure 6] FIG. 10 is a diagram for explaining an example of a minutes-taking function of an information processing system according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram for explaining an example of a minutes-creation function of the information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the example of FIG. 6. [Figure 8] FIG. 8 is a diagram for explaining an example of a minutes-creation function of the information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the examples of FIGS. 6 and 7. [Figure 9] FIG. 9 is a diagram for explaining an example of a minutes-creation function of the information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the examples of FIGS. 6 to 8. [Figure 10] FIG. 2 is a diagram illustrating an example of the flow of various processes executed by a server configuring an information processing system according to an embodiment of the present disclosure. [Figure 11] FIG. 6 is a diagram illustrating an example of a communication function provided by the information processing system according to an embodiment of the present disclosure, and is a diagram illustrating an example different from the examples of FIGS. 4 and 5. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0010] Prior to describing an embodiment of the present disclosure, a service provided by an information processing system according to an embodiment of the present disclosure (hereinafter referred to as "the system") will be described. The service provided by the system is, for example, a communication support service using a virtual space. Users can freely communicate with other users in the virtual space by freely combining and using the first to third conversation modes described below. Specifically, in the system, users can communicate with other users by performing various input operations on avatars and objects placed in the virtual space. Note that an avatar may be any display placed in the virtual space corresponding to each user, and may include any other display, such as an icon, hologram, pointer, shape, mark, pattern, character, etc. Furthermore, the avatar may be a two-dimensional display or a three-dimensional display.

[0011] The first conversation mode is a mode in which conversation is realized according to the positions of avatars placed in a virtual space, for example. In the first conversation mode, the volume of the output audio, etc. is changed according to the distance between the avatars corresponding to each user, realizing communication that is closer to a real-world environment. That is, in the first conversation mode, a user can realize communication with other users by changing the position of an avatar placed in a virtual space through an input operation. Details of conversation using the first conversation mode will be described later with reference to FIG. 4, etc.

[0012] The second conversation mode is a mode in which conversation is realized, for example, using conversation objects placed in a virtual space. In the second conversation mode, audio and other output is only provided to users corresponding to avatars connected to specific objects placed in the virtual space. That is, in the second conversation mode, a user can realize communication with other users by connecting (associating) an avatar with an object placed in the virtual space through an input operation. Details of conversations using the second conversation mode will be described later with reference to FIG. 5, etc.

[0013] The third conversation mode is a mode in which a conversation is realized, for example, by using a conversation conference room arranged in a virtual space. In the third conversation mode, audio and other output is only provided to the users corresponding to the avatars arranged in the conference room (entering the conference room). That is, in the third conversation mode, a user can realize communication with other users by entering (associating) an avatar into a conference room arranged in the virtual space through an input operation. Details of conversations using the third conversation mode will be described later with reference to FIG. 4, etc. An avatar is placed in the conference room, for example, by a user double-clicking on one of areas W1 to W4.

[0014] Note that conversations in the first to third conversation modes are not necessarily planned at a predetermined time, and many conversations occur spontaneously between multiple users. In such cases, the automatic minutes creation function, which is one of the additional functions of the present system, is effective. In this embodiment, an example of creating minutes for a conversation primarily using the second conversation mode will be described later with reference to Figures 6 to 9.

[0015] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present disclosure. 1 includes a server 1 and user terminals 2-1 to 2-n (n is any natural number equal to or greater than 1). The server 1 and user terminals 2-1 to 2-n are connected to each other via a predetermined network N such as the Internet. Note that the network N is not an essential component, and for example, NFC (Near Field Communication), Bluetooth (registered trademark), LAN (Local Area Network), etc. may also be used. In the following description, the user terminals 2-1 to 2-n will be collectively referred to as user terminal 2 unless there is a need to distinguish between them.

[0016] The server 1 is an information processing device managed by the provider of this system, etc. The server 1 is configured, for example, with a general-purpose PC (Personal Computer), etc. The server 1 acquires, for example, various input information (for example, input operation information and image and audio information, which will be described later) transmitted from each of the user terminals 2, and executes various processes.

[0017] The user terminal 2 is an information processing terminal used by a user who wishes to receive services to which this system is applied. The user terminal 2 is configured, for example, as a general-purpose PC, tablet, smartphone, etc. The user terminal 2 acquires various input information (for example, input operation information and image and audio information, which will be described later) via, for example, an application or software used to provide the various functions described above, and transmits this information to the server 1.

[0018] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server that configures an information processing system according to an embodiment of the present disclosure.

[0019] As shown in FIG. 2, the server 1 includes a control unit 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20.

[0020] The control unit 11 is configured with a microcomputer or the like including a CPU, a GPU, and a semiconductor memory, and executes various processes according to a program recorded in a ROM 12 or a program loaded from a storage unit 18 into a RAM 13 . The RAM 13 also stores data and the like necessary for the control unit 11 to execute various processes as appropriate.

[0021] The control unit 11, ROM 12, and RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to this bus 14. An output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

[0022] The output unit 16 is composed of a liquid crystal display, a speaker, etc., and outputs various information as images and sounds.

[0023] The input unit 17 is composed of a keyboard, a mouse, a microphone, various digital cameras, etc., and is used to input various information.

[0024] The storage unit 18 is configured with a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data.

[0025] The communication unit 19 communicates with other hardware and the like via a predetermined network N. The network N may include any method that allows mutual communication, including the Internet and Bluetooth (registered trademark).

[0026] The drive 20 is provided as needed. Removable media 31, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 31 by the drive 20 are installed in the storage unit 18 as needed. The removable media 31 can also store various data stored in the storage unit 18 in the same way as the storage unit 18.

[0027] FIG. 3 is a diagram illustrating an example of a functional configuration of a server and a user terminal that configure an information processing system according to an embodiment of the present disclosure.

[0028] First, we will explain an example of the functional configuration of the user terminal 2. As shown in Fig. 3, the control unit 100 of the user terminal 2 executes various programs to function as an input operation receiving unit 120, an avatar information management unit 121, a virtual space management unit 122, an image / audio management unit 123, and an output control unit 124. The input operation receiving unit 120 receives information on input operations performed by the user on the system (hereinafter referred to as "input operation information"). The input operation receiving unit 120 also transmits the received input operation information to the server 1. The input operation information referred to here includes, for example, information on the content of input operations in applications or software used to provide the various functions described above (for example, mouse click operations and input operations related to various keyboards), information on the time when various input operations were performed, and the like.

[0029] The avatar information management unit 121 acquires, via a communication unit (not shown), information on the placement position of each user's avatar (hereinafter referred to as "avatar placement information") transmitted from the server 1. Furthermore, the avatar information management unit 121 determines the placement position of the target user's avatar based on the input operation information acquired by the input operation reception unit 120, and transmits the information to the server 1 as avatar information.

[0030] The virtual space management unit 122 acquires information about the virtual space to be displayed to the user (hereinafter referred to as "virtual space information") transmitted from the server 1 via a communication unit (not shown). The virtual space management unit 122 generates an output image to be output to an output unit (not shown) of the user terminal 2 based on the input operation information acquired by the input operation reception unit 120, the avatar placement information acquired by the avatar information management unit 121, the acquired virtual space information, etc.

[0031] The image and audio management unit 123 acquires information about the image or audio that the user wishes to transmit (or send) (hereinafter referred to as "image and audio information"). The image and audio management unit 123 transmits the acquired image and audio information to the server 1. The image and audio management unit 123 also acquires image and audio information of other users transmitted from the server 1.

[0032] The output control unit 124 controls the output of various images, sounds, etc. (for example, image and sound information acquired by the image and sound management unit 123) to an output unit (not shown).

[0033] Next, an example of the functional configuration of the server 1 will be described. As shown in Fig. 3, the control unit 11 of the server 1 executes various programs to function as an application information management unit 60, a first detection unit 61, a second detection unit 62, a minutes generation unit 63, and a minutes management unit 64. Here, a minutes DB 300 is provided in one area of ​​the storage unit 18. The minutes DB 300 stores information related to the minutes generated by this system (hereinafter referred to as "minutes information").

[0034] The application information management unit 60 acquires and manages information relating to avatars in the virtual space corresponding to each user. Specifically, the application information management unit 60 includes a virtual space management unit 80, an avatar position management unit 81, an input operation information acquisition unit 82, and an image and audio information acquisition unit 83.

[0035] The virtual space management unit 80 generates a virtual space that can be presented to each user based on image information stored in a database (not shown) or the like, and transmits the generated image information as virtual space information to each user terminal 2. The virtual space information acquired by each user terminal 2 is presented to each user via a display unit (not shown).

[0036] The avatar position management unit 81 acquires the avatar position information transmitted from each user terminal 2 via the communication unit 19. Furthermore, the avatar position management unit 81 determines the placement position of each avatar based on the avatar information transmitted from each user terminal 2, and transmits avatar placement information indicating the placement of each avatar to other user terminals 2.

[0037] The input operation information acquisition unit 82 acquires the input operation information transmitted from each of the user terminals 2 via the communication unit 19 .

[0038] The image and audio information acquisition unit 83 acquires the image and audio information transmitted from each of the user terminals 2 via the communication unit 19. In addition, the image and audio information acquisition unit 83 transmits the acquired image and audio information to each of the user terminals 2 of the other users.

[0039] The first detection unit 61 detects the start of communication between the users associated with the avatars in the virtual space. The first detection unit 61 determines whether a conversation has started in the virtual space based on the avatar information acquired by the avatar position management unit 81, the input operation information acquired by the input operation information acquisition unit 82, the image and audio information acquired by the image and audio information acquisition unit 83, etc. In this embodiment, the first detection unit 61 determines that a conversation in the second conversation mode has begun in the virtual space when, for example, the second conversation mode is active and two or more avatars are connected to an object placed in the virtual space, based on input operation information acquired by the input operation information acquisition unit 82, etc.

[0040] The second detection unit 62 detects the end of the communication. The second detection unit 62 determines whether the ongoing conversation has ended based on the avatar information acquired by the avatar position management unit 81, the input operation information acquired by the input operation information acquisition unit 82, the image and audio information acquired by the image and audio information acquisition unit 83, etc. In this embodiment, the second detection unit 62 determines that the conversation in the second conversation mode that was being conducted has ended when the second conversation mode is engaged and the number of avatars connected to objects placed in the virtual space becomes zero, for example, based on input operation information acquired by the input operation information acquisition unit 82.

[0041] The minutes generation unit 63 determines the start time and end time of the communication based on the results of detection by the first detection step and the results of detection by the second detection step, and generates information about the communication during the period of the communication. The minutes generating unit 63 includes a start / end determining unit 90, an event management unit 91, and a time management unit 92. The start / end determining unit 90 determines the start time and end time of a conversation taking place in the virtual space based on, for example, the result of determination by the first detecting unit 61 and the result of determination by the second detecting unit 62. The event management unit 91 extracts various situation changes (hereinafter referred to as "events") that occurred during a conversation based on, for example, input operation information acquired by the input operation information acquisition unit 82 from the start time to the end time of the target conversation, and generates event information related to each event. Here, an event is an occurrence that indicates a change in the situation in a conversation, including the start or end of a conversation, such as an increase or decrease in the number of participants in the conversation, the exchange of text information (chat), the sharing of images or audio, whether or not the transcription function (converting audio information into text) is used, or the addition of a note. The time management unit 92 acquires and manages, for example, information relating to the time at which each event occurred. That is, when event information is generated by the event management unit 91, the time management unit 92 acquires information relating to the time at which each event occurred (hereinafter referred to as "time information"). Then, the time management unit 92 associates each piece of event information with the corresponding time information and manages them as chronological information. The generation of event information by the event management unit 91 and the acquisition of time information by the time management unit 92 may be performed in real time while the conversation is ongoing, or may be performed after the conversation has ended. The time management unit 92 may also use a timestamp or the like as appropriate when acquiring the time information.

[0042] The minutes generating unit 63 then compiles this information to generate information relating to the record of the target conversation (hereinafter referred to as "minutes information"). Note that the items and format of the minutes generated by the minutes generating unit 63 are arbitrary, but specific examples of items included in the minutes will be shown with reference to FIG. 9, for example.

[0043] The minutes management unit 64 manages the minutes information generated by the minutes generation unit 63 and stores the information in the minutes DB 300 etc. as appropriate. The minutes management unit 64 may also perform a search process on each of the minutes information it manages based on whether or not it is related to a predetermined keyword.

[0044] The first and third conversation modes of this system will be described with reference to FIG. 4 is a diagram illustrating an example of a communication function of an information processing system according to an embodiment of the present disclosure. In the following description, unless there is a particular need to distinguish between an avatar and a user operating the avatar, no distinction will be made. For example, simply referring to avatar A may refer to the user operating avatar A. 4, avatars A to D corresponding to each user are placed at predetermined positions in a virtual space (hereinafter referred to as "office space") that mimics a real-world office. In the first conversation mode of this system, conversations (input and output of voice information) are carried out according to the relative positions of the avatars thus placed in the office space. 4, avatars A and B are positioned close to each other, whereas avatars A and C are positioned relatively far apart. Avatars A and D are positioned even farther apart. Therefore, for example, a voice input by a user corresponding to avatar "A" is output loudly on the user terminal 2 of the user corresponding to avatar "B" and output softly on the user terminal 2 of the user corresponding to avatar "C." Note that the dotted line in Fig. 4 indicates the audible range of the voice of the user corresponding to avatar "A." Therefore, the voice of the user corresponding to "A" is not output on the user terminal 2 of the user corresponding to avatar "D." Also, in the example of Fig. 4, the effect displayed around avatar A indicates that the user corresponding to avatar A is currently inputting voice (speaking). In the example of Fig. 4, areas W1 to W4 simulating conference rooms are provided on the right side of the virtual space as separate areas within the virtual space. Each user can also use the conference room thus arranged within the virtual space to have a conversation in a third conversation mode. In the third conversation mode, conversations can be held only between users corresponding to avatars arranged within the conference room.

[0045] Next, a second conversation mode of the present system will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of a communication function of an information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the example of Fig. 4. In the second conversation mode of the present system, a conversation is conducted according to the relationship between a predetermined object placed in the office space and an avatar. In the example of Fig. 5, each of avatars D to F is connected via an arrow to object P placed in the virtual space. In this situation, each of the users corresponding to avatars D to F wishes to use the second conversation mode using object P, and each user is performing a command operation on object P (for example, clicking on object P). In the second conversation mode, all users associated with object P can have a conversation, regardless of the location of each avatar. Therefore, in the example of Figure 5, image and audio information input by any sender (for example, the user corresponding to avatar D) is output at the same volume as the input volume on the user terminal 2 of other users (for example, the users corresponding to avatars E and F), regardless of the distance between the respective avatars.

[0046] Furthermore, the present system not only provides a means for these conversations but also has a function of automatically creating information regarding the content of the conversations that have taken place (hereinafter referred to as "minutes" or "minutes information"). Therefore, with reference to FIGS. 6 to 9, an example of creating minutes of a conversation that has taken place via the present system will be described. All of FIGS. 6 to 9 are diagrams for explaining an example of a minutes-creation function of an information processing system according to an embodiment of the present disclosure. As described above, in this embodiment, an example of creating minutes of a conversation that has taken place in the second conversation mode will be described.

[0047] 6 shows a situation in which avatar G and avatar H are connected to object P placed in a virtual space by the operations of each user. For example, when two or more avatars are connected to a predetermined object as in the example of FIG. 6, the system determines that a conversation has started and begins preparations for creating minutes. In the example of FIG. 6, the system creates minutes assuming that a conversation has started between the user corresponding to avatar G and the user corresponding to avatar H. In contrast, in the example of FIG. 7, in addition to avatar G and avatar H, avatar I is also connected to object P. When the number of avatars connected to a given object increases as in FIG. 7, the system creates minutes assuming that a new user (e.g., the user corresponding to avatar I) has joined the ongoing conversation. Thereafter, as shown in FIG. 8, for example, when the number of avatars connected to object P decreases to 0, the system creates minutes assuming that the conversation taking place via object P has ended.

[0048] The minutes created through such a process are shown, for example, in Fig. 9. Fig. 9 is a diagram for explaining an example of a minutes creation function of an information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the examples in Figs. 6 to 8. The example in Figure 9 shows a series of events: "2024 / 4 / 1 / 9:00 A conversation began between users corresponding to avatars A and B," "2024 / 4 / 1 / 9:30 A new user corresponding to avatar C joined the conversation," "2024 / 4 / 1 / 9:45 A video file was shared during the conversation," and "2024 / 4 / 1 / 10:00 The number of participants dropped to zero and the conversation ended." The example in Figure 9 also includes audio information captured during the conversation and a text file containing the audio information converted into text. Each user can freely download this information and use it as a record of the conversation. The method by which this system converts audio information into text information is arbitrary and not limited. This system may convert audio information into text information using any existing application or the like.

[0049] 9, the system can also provide a search function for each of the created minutes. The system may also have a function for adding search tags to each of the created minutes. The system may also have a function for searching terms and the like contained in the text information of the minutes.

[0050] FIG. 10 is a diagram illustrating an example of the flow of various processes executed by a server configuring an information processing system according to an embodiment of the present disclosure.

[0051] In step S1, the application information management unit 60 acquires, via the communication unit 19, various types of information acquired from each of the user terminals 2 (for example, avatar information, input operation information, image and audio information, etc.).

[0052] In step S2, the first detection unit 61 determines whether a conversation has started in the virtual space based on the avatar information acquired by the avatar position management unit 81, the input operation information acquired by the input operation information acquisition unit 82, the image and audio information acquired by the image and audio information acquisition unit 83, etc. Specifically, the first detection unit 61 determines that a conversation between multiple users has started in the virtual space when the second conversation mode is active and two or more avatars are connected to an object placed in the virtual space, based on the input operation information acquired by the input operation information acquisition unit 82, for example. If two or more avatars are connected to an object placed in the virtual space, the first detection unit 61 determines YES in step S2, and the process proceeds to step S3. If two or more avatars are not connected to the object placed in the virtual space, the first detection unit 61 determines NO in step S2, and the process returns to step S1.

[0053] In step S3, the application information management unit 60 acquires, via the communication unit 19, various types of information acquired from each of the user terminals 2 (for example, avatar information, input operation information, image and audio information, etc.).

[0054] In step S4, the event management unit 91 generates event information regarding various changes in situations that occurred during the conversation based on the input operation information acquired by the input operation information acquisition unit 82, from the start time to the end time of the target conversation.

[0055] In step S5, the time management unit 92 acquires time information corresponding to each piece of event information generated by the event management unit 91. Also in step S5, the time management unit 92 associates each piece of event information with the corresponding time information and manages them as chronological information.

[0056] In step S6, the second detection unit 62 determines whether the ongoing conversation has ended based on the avatar information acquired by the avatar position management unit 81, the input operation information acquired by the input operation information acquisition unit 82, the image and audio information acquired by the image and audio information acquisition unit 83, etc. Specifically, the second detection unit 62 determines that the ongoing conversation has ended, for example, based on the input operation information acquired by the input operation information acquisition unit 82, when the second conversation mode is activated and the number of avatars connected to objects placed in the virtual space becomes zero. If the ongoing conversation has ended, the second detection unit 62 determines that step S6 is YES, and the process proceeds to step S7. If the ongoing conversation has not ended, the second detection unit 62 determines that the answer is NO in step S6, and the process returns to step S3.

[0057] In step S7, the start / end determination unit 90 determines the start time and end time of the conversation that was taking place in the virtual space based on the results of the determination by the first detection unit 61 and the results of the determination by the second detection unit 62.

[0058] In step S8, the minutes generating unit 63 generates minutes information for the target conversation based on various input operation information, various image and audio information, the start and end times of the conversation, various event information, various time information, etc. This completes the various processes executed by the server 1.

[0059] The above describes one embodiment of the present disclosure, but the present disclosure is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present disclosure are included in the present disclosure.

[0060] In the above embodiment, the minutes of the meeting generated by the system are described as being generated during communication in the second conversation mode, but this is not limited to this. The minutes of the meeting generated by the system may be generated during communication in the first conversation mode or the third conversation mode. When generating minutes of a communication in the first conversation mode, the system may, for example, determine the start and end of communication by assuming that communication is occurring when avatars placed in the virtual space are within a certain distance from each other, and generate minutes of the communication. Note that in this case, the distance between the avatars may be the same as or different from the audible range in the above-described embodiment. Furthermore, when generating minutes of a communication using the third conversation mode, the system may determine the start and end of the communication and generate the minutes based on, for example, the number of users (number of avatars) using a conference room or the like set up in a virtual space or the like.

[0061] Furthermore, although not explained in the above embodiment, the present system may also have a function to identify the user's location information using a function for identifying location information (e.g., a beacon, GPS, etc.) provided in each user terminal 2, and to change the placement position of the avatar in the virtual space based on that information. The system may also have a function for changing the placement position of an avatar in a virtual space based on login information, for example, via a QR code (registered trademark). In this way, the system can effectively reflect offline situations online and perform tasks such as creating minutes of meetings. Specifically, the system can automatically create minutes of a conversation between two offline users using a QR code (registered trademark) and one user connected only online. In other words, the system can be used even in situations where offline and online communication are combined. This allows the system to easily perform tasks such as creating minutes of meetings, which would be time-consuming if done offline only.

[0062] Furthermore, for example, in the above embodiment, the object placed in the virtual space is described as an object P for the connected avatars to converse with each other, but this is not limited thereto. The present system may also place any object with other functions. The present system may also place any object in the virtual space that can share any content, such as playing video images, participating in various games (such as shogi, Othello, or Werewolf), sharing video images (such as camera images or PC images), and playing advertisements.

[0063] In the above embodiment, the virtual space of the present system is described as a space simulating an office space, but is not limited thereto. The present system may employ, as a virtual space, spaces simulating, for example, an event venue, a party room, a restaurant, a matchmaking venue, a train station, a commercial facility (such as a supermarket or a convenience store), etc.

[0064] Furthermore, in the above-described embodiment, the present system has been described as including, for example, a chat function, an image and audio sharing function, a transcription function, a memo function, etc., but these are merely examples and are not limiting. For example, the present system may also include, as another function, a function for converting audio information contained in uploaded videos and images into text. For example, the present system may also include, as another function, a function for tagging the content of uploaded videos and images using technology such as machine learning. However, all of the various functions included in the present system are optional, and the present system may not include some or all of these functions.

[0065] In the above embodiment, the communication in the system is basically based on conversation (audio, etc.), but this is not limited to this. The system may also provide communication means based on, for example, video images (camera images, etc.) or text (chat, etc.).

[0066] In the above embodiment, the present system has been described as providing the first to third conversation modes, but this is not limited thereto. For example, the present system may provide a means of communication by any other method. Furthermore, the present system may not provide all of the functions of the first to third conversation modes.

[0067] In the above embodiment, the system has been described as determining that a conversation in the second conversation mode has started when two or more avatars are connected to a predetermined object, but the conditions for determining that a conversation has started are merely examples and are not limiting. For example, the system may determine that a conversation in the second conversation mode has started when two or more avatars are connected to a predetermined object and certain voice information or the like is input.

[0068] In the above embodiment, the system is described as determining that a conversation has ended when the number of avatars connected to an object placed in a virtual space becomes 0, but this is not limited thereto. For example, the system may determine that a conversation has ended when the number of avatars connected to an object placed in a virtual space becomes 1 or less.

[0069] Although not described in the above embodiment, the present system may issue a unique key when, for example, the start of communication is detected.

[0070] Also, although not explained in the above embodiment, the present system may have a function to capture the shared image every predetermined time (e.g., 30 seconds) when a user shares an image during communication, and add it to the minutes.

[0071] Furthermore, for example, although not described in the above-described embodiment (particularly the embodiment shown in FIG. 4), the concept of a field of view (orientation) may be adopted for the various icons described above. Specifically, for example, in the example of FIG. 11, small triangular icons (hereinafter referred to as "field of view icons") are displayed near avatars K and L. These field of view icons indicate the "field of view (orientation)" of each of avatars K and L. In the example of FIG. 11, the field of view icons are facing each other, which can be thought of as a situation in the real world where users are paying attention to each other and talking face to face. In such a case, for example, the user terminals 2 corresponding to each icon may output loud sounds to each other. Conversely, if the icons are not facing each other, the user terminals 2 may output quiet sounds.

[0072] The above-described series of processes can be executed by hardware or software. In other words, the functional configurations in FIG. 3 and the like are merely examples and are not particularly limited. That is, it is sufficient that the information processing system is provided with a function that can execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not limited to the example shown in Fig. 3. Furthermore, the location of the functional block is not limited to the example shown in Fig. 3, and may be arbitrary. Furthermore, one functional block may be configured by hardware alone, by software alone, or by a combination of these.

[0073] Furthermore, the number of various hardware components constituting this system and the number of users are optional, and the system may also include other hardware components.

[0074] Furthermore, the present system may be configured as a so-called cloud-based system, in which various processes are executed via the Web or the like, and the results of the processes are sent to various hardware.

[0075] Furthermore, when a series of processes is executed by software, the program that constitutes the software may be installed on a computer or the like from a network or a recording medium.

[0076] The computer may also be a computer that is built into dedicated hardware, or a computer that can execute various functions by installing various programs. That is, for example, the various hardware in the above-described embodiments may be freely adopted as any computer, any mobile terminal such as a smartphone, etc. Furthermore, any combination of types and contents of various input units and various output units may be adopted.

[0077] Furthermore, the recording medium containing such a program may not only be constituted by a removable medium (not shown) that is provided separately from the device main body in order to provide the program to the user, etc., but may also be constituted by a recording medium that is provided to the user in a state that it is pre-installed in the device main body.

[0078] In this specification, the steps of writing the program to be recorded on the recording medium may be executed in a time-series manner, or may be executed in parallel or individually. Also, some of the steps described in the above embodiments may be omitted.

[0079] In addition, in this specification, the term "system" refers to an overall device that is made up of a plurality of devices or a plurality of means.

[0080] The effects of this embodiment can be achieved even when these other embodiments are adopted. Furthermore, this embodiment can be combined with other embodiments, and other embodiments can be combined with each other as appropriate.

[0081] To summarize the above, an information processing system to which the present disclosure is applied can take on a variety of embodiments having the following configurations. That is, the program to which the present disclosure is applied is On the computer, an acquisition step (e.g., an application information management unit 60) of acquiring input information related to an avatar corresponding to each user in the virtual space; a first detection step (for example, a first detection unit 61) of detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection step (for example, a second detection unit 62) of detecting the end of the communication; a generating step (e.g., a minutes generating unit 63) of determining a start time and an end time of the communication according to a result of detection by the first detecting step and a result of detection by the second detecting step, and generating information about the communication during the communication period; Any program that executes a process including the above is sufficient.

[0082] The generating step may generate information including text information generated based on voice information related to the communication.

[0083] The first detection step may include issuing a predetermined identifier when the start of the communication is detected.

[0084] The generating step may also generate information about the communication that includes time information in the form of a timestamp.

[0085] In addition, the generating step may generate information including any information selected from information regarding the sharing of images in the communication, information regarding chat, information regarding file sharing, information regarding notes, and information regarding the enablement or disablement of various functions.

[0086] The program may further function as a search step of executing a search process for each piece of text information output in the communication based on whether the text information is related to a predetermined keyword.

[0087] The second detecting step may detect the end of the communication when the participation of the user becomes zero.

[0088] Another aspect of the present disclosure is 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection step of detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection step of detecting an end of the communication; a generating step of determining a start time and an end time of the communication according to a result of the detection by the first detecting step and a result of the detection by the second detecting step, and generating information about the communication during the period of the communication; The present invention may be an information processing method including the above.

[0089] Another aspect of the present disclosure is an acquisition means for acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection means for detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection means for detecting the end of the communication; a generating means for determining a start time and an end time of the communication according to a result of detection by the first detecting means and a result of detection by the second detecting means, and generating information about the communication during the period of the communication; The information processing system may include: [Explanation of symbols]

[0090] 1 server 11 Control section 60 Application Information Management Department 80 Virtual Space Management Department 81 Avatar Position Management Unit 82 Input operation information acquisition unit 83 Image and audio information acquisition unit 61 First detection unit 62 Second detection unit 63 Minutes Generation Department 90 Start / End Determination Section 91 Event Management Department 92 Time management department 64 Minutes Management Department 300 Minutes DB 2. User terminal 100 control section 120 Input operation reception unit 121 Avatar Information Management Department 122 Virtual Space Management Department 123 Video and audio control unit 124 Output control section

Claims

1. On the computer, an acquisition step of acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection step of detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection step of detecting an end of the communication; a generating step of determining a start time and an end time of the communication according to a result of the detection by the first detecting step and a result of the detection by the second detecting step, and generating information about the communication during the communication period; A program that executes processing including

2. the generating step generates information including text information generated based on voice information related to the communication. The program according to claim 1.

3. the first detection step includes issuing a predetermined identifier when the start of the communication is detected; The program according to claim 1.

4. the generating step generates information about the communication, the information including time information by a time stamp. The program according to claim 1.

5. the generating step generates information including any information selected from information regarding image sharing in the communication, information regarding chat, information regarding file sharing, information regarding memos, and information regarding whether various functions are enabled or disabled; The program according to claim 2.

6. a search step of executing a search process on each of the text information output in the communication based on whether the text information is related to a predetermined keyword; The program according to claim 2 , further comprising:

7. the second detection step detects the end of the communication when the participation of the user becomes 0; The program according to claim 1.

8. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection step of detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection step of detecting an end of the communication; a generating step of determining a start time and an end time of the communication according to a result of the detection by the first detecting step and a result of the detection by the second detecting step, and generating information about the communication during the communication period; An information processing method including:

9. an acquisition means for acquiring input information related to an avatar corresponding to each user in a virtual space; a first detection means for detecting the start of communication between a plurality of users associated with each of the plurality of avatars in the virtual space; a second detection means for detecting the end of the communication; a generating means for determining a start time and an end time of the communication in accordance with a result of detection by the first detecting means and a result of detection by the second detecting means, and generating information about the communication during the period of the communication; An information processing system comprising:

Images