Information processing device, control method, and control program

Abstract

An information processing device (100) provides a virtual space in which a first user and a second user have a voice conversation or a chat via a first avatar and a second avatar. The information processing device (100) comprises: a communication unit (140); a correspondence unit (150) that receives a secession request from a terminal used by the first user; and a control unit (160) that instructs the communication unit to take over the first avatar logged in by the first user on the basis of a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar.

Description

Information processing device, control method, and control program

[0001] The present disclosure relates to an information processing device, a control method, and a control program.

[0002] Many users are participating in the metaverse. Many users can communicate in the metaverse. For example, a technology for supporting communication between users has been proposed (see Patent Literature 1). The communication support system in Patent Literature 1 performs a matching process between a user and other users with whom the user has not had contact, based on the user's behavioral history.

[0003] Japanese Patent Application Laid-Open No. 2022-71467

[0004] The above matching process makes it possible to match with users who get along well. However, even if a match is made, there are cases where the user does not get along with the matched party. In such cases, the user wants to leave. However, if the user leaves on their own, the user will feel sorry for the matched party. If the user feels sorry, the user will refrain from participating in communication in the metaverse.

[0005] The purpose of this disclosure is to facilitate communication participation in the metaverse.

[0006] An information processing device according to one aspect of the present disclosure is provided. The information processing device provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar. The information processing device includes a communication unit, a communication unit that receives a withdrawal request from a terminal used by the first user, and a control unit that instructs the communication unit to take over the first avatar logged in by the first user based on a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar. The communication unit receives the instruction. If the first avatar and the second avatar have had a voice conversation, the communication unit conducts the conversation based on the conversation history. If the first avatar and the second avatar have had a chat conversation, the communication unit conducts the chat based on the chat history.

[0007] According to the present disclosure, it is possible to facilitate participation in communication in the metaverse.

[0008] FIG. 1 is a diagram illustrating a control system according to a first embodiment. FIG. 2 is a diagram illustrating hardware included in an information processing device according to the first embodiment. FIG. 3 is a block diagram illustrating functions of an information processing device according to the first embodiment. (A) to (C) are diagrams illustrating a specific example (part 1) of handover processing according to the first embodiment. FIG. 4 is a sequence diagram illustrating an example of handover processing according to the first embodiment. (A) to (C) are diagrams illustrating a specific example (part 2) of handover processing according to the first embodiment. FIG. 5 is a block diagram illustrating functions of an information processing device according to a second embodiment. (A) to (C) are diagrams illustrating a specific example of handover processing according to the second embodiment. FIG. 6 is a sequence diagram illustrating an example of handover processing according to the second embodiment.

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] 1 is a diagram showing a control system according to embodiment 1. The control system includes an information processing device 100 and terminals 200 to 204. The information processing device 100 and the terminals 200 to 204 communicate with each other via a network.

[0011] The information processing device 100 is a device that executes the control method. The information processing device 100 can provide services in the metaverse. The metaverse is also called a virtual space. The terminal 200 is a terminal used by user 1. The terminal 201 is a terminal used by user 2. The terminal 202 is a terminal used by user 3. The terminal 203 is a terminal used by user 4. The terminal 204 is a terminal used by user 5. For example, the terminals 200 to 204 are personal computers (PCs), smartphones, or tablet terminals. The terminals 200 to 204 may also be head-mounted displays (HMDs). FIG. 1 shows five terminals. The number of terminals is not limited to five.

[0012] Next, the hardware of the information processing device 100 will be described. Fig. 2 is a diagram showing the hardware of the information processing device of embodiment 1. The information processing device 100 is also called a computer. The information processing device 100 has a processor 101, a volatile storage device 102, and a non-volatile storage device 103.

[0013] The processor 101 controls the entire information processing device 100. For example, the processor 101 is a central processing unit (CPU) or a field programmable gate array (FPGA). The processor 101 may be a multiprocessor. The information processing device 100 may also include a processing circuit.

[0014] The volatile storage device 102 is a main storage device of the information processing device 100. For example, the volatile storage device 102 is a random access memory (RAM). The nonvolatile storage device 103 is an auxiliary storage device of the information processing device 100. For example, the nonvolatile storage device 103 is a hard disk drive (HDD) or a solid state drive (SSD).

[0015] Next, a description will be given of the functions of the information processing device 100. Fig. 3 is a block diagram showing the functions of the information processing device of embodiment 1. The information processing device 100 has a storage unit 110, a generation unit 120, a management unit 130, one or more communication units 140, a communication unit 150, and a control unit 160.

[0016] The storage unit 110 may be realized as a storage area secured in the volatile storage device 102 or the non-volatile storage device 103. The storage unit 110 may also be called a memory. Some or all of the generation unit 120, management unit 130, one or more communication units 140, communication unit 150, and control unit 160 may be realized by processing circuits. Furthermore, some or all of the generation unit 120, management unit 130, one or more communication units 140, communication unit 150, and control unit 160 may be realized as program modules executed by the processor 101. For example, the program executed by the processor 101 is also called a control program or a control program product. For example, the control program is recorded on a recording medium.

[0017] The storage unit 110 stores various information.

[0018] The generation unit 120 generates an environment in the metaverse. For example, the environment may be a lecture hall, a stadium, or the like. The generation unit 120 may periodically change the environment. The generation unit 120 may generate an environment in which communication via chat is possible. The generation unit 120 also generates multiple avatars in the metaverse. The generated avatars may be stationary avatars. The generated avatars may be movable avatars.

[0019] The management unit 130 manages the position and state of an avatar. The state of an avatar refers to the posture, movement, etc. of the avatar. The management unit 130 manages whether or not the avatar is in a logged-in state. An avatar being in a logged-in state means that a user is logged in to the avatar. In other words, an avatar being in a logged-in state means that a user is using the avatar. An avatar being in a logged-out state means that the communication unit 140 is using the avatar, or that no one is using the avatar. If no one is using the avatar, the management unit 130 may make the avatar transparent.

[0020] The management unit 130 groups multiple avatars. The management unit 130 may group multiple avatars based on the location of the avatar, the login time, or object information in the metaverse environment (e.g., the color of seats in a stadium).

[0021] In the information processing device 100, the communication unit 140 can take over the avatar that a user has logged in as. When the communication unit 140 is in charge of the avatar, it appears as if an AI (Artificial Intelligence) is in charge of the avatar when viewed from outside the information processing device 100. Therefore, in the following description, the communication unit 140 may be referred to as an AI. A specific example of the takeover process will be shown.

[0022] 4A to 4C are diagrams showing a specific example (part 1) of the handover process of the first embodiment. FIG. 4A shows avatars 10 to 13. Avatars 10 to 13 in FIG. 4A are in a logged-out state. The information processing device 100 provides the state in FIG. 4A to each terminal. This allows each user to recognize the state in FIG. 4A via each terminal.

[0023] A user can use a terminal to log in to an avatar that is in a logged-out state. For example, user 1 can use terminal 200 to log in to avatar 10 that is in a logged-out state. FIG. 4(B) shows a state in which users 1 to 3 are logged in to avatars 10 to 12. User 1 and user 2 can have a conversation via avatars 10 and 11.

[0024] The storage unit 110 stores a conversation history for each avatar. The communication method may be chat. The chat content may be output in a log-like format. In chat, only updated content may be output. In chat, only content updated within a certain period of time may be output. Furthermore, when chat is used, the storage unit 110 stores a chat history for each avatar.

[0025] The conversation history or chat history may be stored in an external device. The external device is a device that exists outside the information processing device 100. For example, the external device is a cloud server, an external memory, etc. The external device is not shown in the figure.

[0026] In this way, the information processing device 100 provides a virtual space in which a plurality of users can converse by voice or chat via a plurality of avatars.

[0027] When an avatar adjacent to an avatar in a logged-in state is in a logged-out state, the logged-out avatar is used by the AI ​​(i.e., the communication unit 140). In the example of FIG. 4, the avatar 13 adjacent to the logged-in avatar 12 is in a logged-out state. Therefore, the avatar 13 is used by the AI. In other words, the AI ​​is in charge of the avatar 13. This allows the user 3 to converse with the AI ​​via the avatars 12 and 13.

[0028] When the AI ​​(i.e., the communication unit 140) is having a conversation or chat, the communication unit 140 may use the generation AI. For example, the communication unit 140 requests the generation AI to generate a conversation response content or chat response content to the content of user 3's voice data or the chat content of user 3. This allows the communication unit 140 to acquire the conversation response content or chat response content. When the communication unit 140 acquires the conversation response content, it outputs voice data indicating the conversation response content. When the communication unit 140 acquires the chat response content, it outputs the chat response content.

[0029] Furthermore, when the communication unit 140 has a conversation or a chat, the communication unit 140 may generate the content of the conversation or the chat using the results of analyzing the speech content or the chat content of the other party (e.g., user 3). When the communication unit 140 has a conversation or a chat, the communication unit 140 may generate the content of the conversation or the chat using a database.

[0030] Here, it is assumed that User 1 does not get along with User 2. User 1 performs an operation to leave. For example, terminal 200 displays a screen including "Do you want to leave?" and an "OK button." When User 1 clicks the "OK button," terminal 200 transmits a request to leave to information processing device 100. In this way, terminal 200 can transmit a request to leave to information processing device 100.

[0031] The communication unit 150 receives a leave request from the terminal 200. The communication unit 150 transmits leave permission to the terminal 200. Alternatively, the communication unit 150 may not transmit leave permission to the terminal 200. The control unit 160 instructs the AI ​​(i.e., the communication unit 140) to take over the avatar 10 to which the user 1 is logged in, based on the conversation history between the avatar 10 and the avatar 11 or the chat history between the avatar 10 and the avatar 11. The communication unit 140 receives the instruction. The communication unit 140 is in charge of the avatar 10. If the avatar 10 and the avatar 11 have had a voice conversation, the communication unit 140 acquires the conversation history between the avatar 10 and the avatar 11 from the storage unit 110 or an external device, and conducts the conversation based on the conversation history. For example, the communication unit 140 analyzes the conversation history and generates voice data. Furthermore, the communication unit 140 may generate voice data using a generation AI, an analysis technique, or a database, and the conversation history. When the avatar 10 and the avatar 11 are chatting, the communication unit 140 acquires the chat history between the avatar 10 and the avatar 11 from the storage unit 110 or an external device, and chats based on the chat history. For example, the communication unit 140 analyzes the chat history and generates chat content. Furthermore, the communication unit 140 may generate chat content using a generation AI, an analysis technique, or a database, and the chat history. FIG. 4(C) shows a state in which the AI ​​(i.e., the communication unit 140) has taken over the avatar 10.

[0032] Note that when avatar 10 and avatar 11 are conversing by voice, it may be expressed as when user 1 and user 2 are conversing by voice. When avatar 10 and avatar 11 are conversing by chat, it may be expressed as when user 1 and user 2 are conversing by chat.

[0033] Here, user 1 is also referred to as the first user. User 2 is also referred to as the second user. Avatar 10 is also referred to as the first avatar. Avatar 11 is also referred to as the second avatar. The communication unit 140 that has taken over from avatar 10 is also referred to as the first communication unit.

[0034] Next, the handover process will be explained using a sequence diagram. FIG. 5 is a sequence diagram showing an example of the handover process according to the first embodiment. (Step ST101) User 1 of terminal 200 and user 2 of terminal 201 have a conversation by voice via avatars 10 and 11. The storage unit 110 stores the conversation history. (Step ST102) User 1 does not get along with user 2, so performs an operation to leave. Terminal 200 transmits a leave request to information processing device 100. (Step ST103) Communication unit 150 of information processing device 100 receives the leave request from terminal 200.

[0035] (Step ST104) The communication unit 150 of the information processing device 100 transmits permission to leave to the terminal 200. (Step ST105) The control unit 160 of the information processing device 100 instructs the communication unit 140 to take over the avatar 10 based on the conversation history between the avatar 10 and the avatar 11. The conversation history may be received from the terminal 200. (Step ST106) The communication unit 140 of the information processing device 100 converses with the user 2 of the avatar 11 via the avatar 10 based on the conversation history. Step ST105 may be executed before step ST104. Steps ST104 and ST105 may be executed in parallel.

[0036] Here, the matching process of Patent Document 1 makes it possible to match with users who get along well. However, even if matching is achieved, there are cases where the user does not get along with the matched partner. In such cases, the user wants to withdraw. However, if the user withdraws on their own, the user will feel sorry for the matched partner. If the user feels sorry, the user will refrain from participating in communication in the metaverse.

[0037] According to the first embodiment, when a user leaves the information processing device 100, the AI ​​takes over. Therefore, the user does not need to feel sorry for the matched partner. Therefore, the user does not need to refrain from participating in communication in the metaverse. Therefore, the information processing device 100 can make it easy to participate in communication in the metaverse.

[0038] The above describes the case where User 1 leaves. After leaving, User 1 may log in to another avatar. A specific example is shown below. Figures 6(A) to 6(C) are diagrams showing a specific example (part 2) of the takeover process in the first embodiment. Figures 6(A) and 6(B) are the same as Figures 4(A) and 4(B). Therefore, the description of Figures 6(A) and 6(B) will be omitted.

[0039] As shown in FIG. 6(B), the AI ​​(i.e., the communication unit 140) is having a voice conversation or chat with the user 3 via the avatar 12 and the avatar 13. The user 3 is also referred to as the third user. The communication unit 140 in charge of the avatar 13 is also referred to as the second communication unit. The avatar 12 is also referred to as the third avatar. The avatar 13 is also referred to as the fourth avatar.

[0040] Assume that user 1 does not get along with user 2. User 1 operates the terminal 200 to send a request to leave to the information processing device 100. As a result, the information processing device 100 executes a handover process. That is, the AI ​​takes over the avatar 10. When the communication unit 150 receives the request to leave from the terminal 200, it sends permission to leave to the terminal 200. For example, when the terminal 200 receives permission to leave from the information processing device 100, it displays a screen including the message "Do you want to log in to another avatar?" and an "OK button." When user 1 clicks the "OK button," the terminal 200 sends a request to the information processing device 100 to send information indicating an avatar in a logged-out state. The communication unit 150 sends information indicating an avatar in a logged-out state to the terminal 200. The terminal 200 displays information indicating that the avatar 13 is in a logged-out state. The terminal 200 may display an arrow as information indicating that the avatar 13 is in a logged-out state. In response to an operation by the user 1, the terminal 200 transmits a login request to the avatar 13 to the information processing device 100. The communication unit 150 transmits login permission to the terminal 200. This allows the user 1 to log in to the avatar 13. The communication unit 150 transmits virtual space information indicating the environment of the avatar 13 to the terminal 200. The communication unit 150 also transmits a conversation history between the avatar 12 and the avatar 13 or a chat history between the avatar 12 and the avatar 13 to the terminal 200 used by the user 1. The communication unit 150 may also transmit a summary of the conversation history between the avatar 12 and the avatar 13 or a summary of the chat history between the avatar 12 and the avatar 13 to the terminal 200 used by the user 1.

[0041] In this way, after leaving, the user 1 can log in to another avatar. Therefore, the information processing device 100 can activate communication in the metaverse.

[0042] Second Embodiment Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be mainly described. In the second embodiment, descriptions of commonalities with the first embodiment will be omitted. In the first embodiment, a case where an AI takes over when a user leaves was described. In the second embodiment, a case where another user takes over will be described.

[0043] First, the functions of the information processing device will be described. Fig. 7 is a block diagram showing the functions of the information processing device of embodiment 2. The information processing device 100a is a device that executes the control method. The information processing device 100a has a communication unit 150a and a control unit 160a. The information processing device 100a does not have a communication unit 140.

[0044] The communication unit 150a and the control unit 160a may be partially or entirely implemented by a processing circuit. Alternatively, the communication unit 150a and the control unit 160a may be partially or entirely implemented as a program module executed by the processor 101. For example, the program executed by the processor 101 is also referred to as a control program or a control program product. For example, the control program is recorded on a recording medium. The functions of the communication unit 150a and the control unit 160a will be described later.

[0045] Next, a specific example of a case where another user takes over will be shown. Figures 8(A) to 8(C) are diagrams showing a specific example of the takeover process in embodiment 2. Figure 8(A) is the same as Figure 4(A). Therefore, the description of Figure 8(A) will be omitted. Figure 8(B) shows a state in which users 1 to 4 are logged in to avatars 10 to 13. User 1 and user 2 converse via avatars 10 and 11. User 3 and user 4 converse via avatars 12 and 13.

[0046] Here, it is assumed that user 5 is waiting for an avatar to log out. For example, information indicating a user waiting for an avatar to log out is stored in storage unit 110. The information may also be stored in an external device. Note that the information indicating a user waiting for an avatar to log out has the same meaning as information indicating the terminal of the user waiting for an avatar to log out.

[0047] Assume that User 1 does not get along with User 2. User 1 performs an operation to leave, which causes terminal 200 to transmit a leave request to information processing device 100.

[0048] The communication unit 150a receives a leave request from the terminal 200. The communication unit 150a transmits leave permission to the terminal 200. The control unit 160a acquires information indicating users who are waiting for their avatars to log out from the storage unit 110 or an external device. The control unit 160a identifies the user 5 based on the information. The communication unit 150a transmits the conversation history between the avatar 10 and the avatar 11 or the chat history between the avatar 10 and the avatar 11, and a message indicating that the user 5 will take over the avatar 10, to the terminal 204 of the user 5. For example, if the avatar 10 and the avatar 11 are having a voice conversation, the communication unit 150a transmits the conversation history between the avatar 10 and the avatar 11 and a message indicating that the user 5 will take over the avatar 10 to the terminal 204. When the avatar 10 and the avatar 11 are chatting, the communication unit 150a transmits to the terminal 204 the chat history between the avatar 10 and the avatar 11 and a message indicating that the user 5 will take over the avatar 10. For example, the message is "The avatar 10 has logged out, so the user 5 should take over the avatar 10."

[0049] The terminal 204 displays the conversation history or chat history and the message. The user 5 uses the terminal 204 to perform a login operation to the avatar 10. The user 5 can take over the avatar 10 by visually checking the conversation history or chat history. FIG. 8(C) shows a state in which the user 5 has taken over the avatar 10. When the conversation history is received, the user 5 converses by voice via the avatar 10. When the chat history is received, the user 5 converses by chat via the avatar 10. Note that if the management unit 130 is managing the avatar 10 as being in a logged-in state at the time the communication unit 150a sends the message to the terminal 204, the user 5 does not need to perform a login operation to the avatar 10 using the terminal 204.

[0050] When displaying the conversation history or chat history and the message, the terminal 204 may display them for a certain period of time.

[0051] The communication unit 150a may transmit the sound data of the conversation history or chat history and the sound data of the message to the terminal 204. When the terminal 204 receives the sound data of the conversation history or chat history and the sound data of the message, the terminal 204 outputs the sound data from a speaker.

[0052] Here, user 1 is also referred to as the first user, user 2 is also referred to as the second user, user 5 is also referred to as the third user, avatar 10 is also referred to as the first avatar, and avatar 11 is also referred to as the second avatar.

[0053] Next, the handover process will be explained using a sequence diagram. FIG. 9 is a sequence diagram showing an example of the handover process according to the second embodiment. (Step ST111) User 1 of terminal 200 and user 2 of terminal 201 have a conversation by voice via avatars 10 and 11. The storage unit 110 stores the conversation history. (Step ST112) User 1 does not get along with user 2, so performs an operation to leave. The terminal 200 transmits a leave request to the information processing device 100a. (Step ST113) The communication unit 150a of the information processing device 100a receives the leave request from the terminal 200.

[0054] (Step ST114) The control unit 160a of the information processing device 100a acquires information indicating user 5 who is waiting for the avatar to log out from the storage unit 110. (Step ST115) The communication unit 150a of the information processing device 100a transmits permission to leave to the terminal 200. (Step ST116) The communication unit 150a of the information processing device 100a transmits to the terminal 204 the conversation history between avatar 10 and avatar 11 and a message indicating that user 5 will take over avatar 10. (Step ST117) User 5 of the terminal 204 converses with user 2 of avatar 11 via avatar 10 based on the conversation history.

[0055] According to the second embodiment, when a user leaves the information processing device 100a, another user takes over. Therefore, the leaving user does not need to feel sorry for the matched partner. Therefore, the user does not need to refrain from participating in communication in the metaverse. Therefore, the information processing device 100a makes it easy to participate in communication in the metaverse.

[0056] Furthermore, if there is an avatar in a logged-out state at the time of leaving, the user leaving may log in to that avatar as shown in Fig. 6. Note that if the user logs in to another avatar and conversation handover processing occurs, the conversation handover processing is similarly performed.

[0057] The control unit 160a may monitor for a predetermined time after the user 5 takes over the avatar 10 whether the takeover is being performed correctly. Specifically, the control unit 160a monitors whether the content of the user 5's utterances or chat content is based on the conversation history or chat history. If the takeover is not being performed correctly, the communication unit 150a transmits the conversation history or chat history to the terminal 204 again. This allows the user 5 to check the conversation history or chat history again. In this way, the information processing device 100a can allow the user 5 to perform the takeover correctly by providing the conversation history or chat history to the user 5 again.

[0058] Embodiment 3 Next, embodiment 3 will be described. In embodiment 3, differences from embodiments 1 and 2 will be mainly described. Furthermore, in embodiment 3, descriptions of matters common to embodiments 1 and 2 will be omitted.

[0059] In the first embodiment, the communication unit 140 conducts a conversation or chat based on a conversation history or a chat history. In the second embodiment, the user who has taken over the conversation conducts a conversation or chat based on a conversation history or a chat history. In the third embodiment, the communication unit 140 or the user who has taken over the conversation conducts a conversation or chat based on a summary of the conversation history or a summary of the chat history.

[0060] First, a case where the communication unit 140 conducts a conversation or chat based on a summary of a conversation history or a summary of a chat history will be described.

[0061] The control unit 160 generates a summary based on the conversation history or chat history. For example, the control unit 160 analyzes the conversation history or chat history. The control unit 160 identifies words with a high occurrence rate based on the analysis results. The control unit 160 generates a summary based on the words with a high occurrence rate. The control unit 160 may also obtain a summary by requesting a generation AI to generate a summary of the conversation history or a summary of the chat history. The control unit 160 instructs the communication unit 140 to take over the avatar based on the summary of the conversation history or the summary of the chat history. As a result, the communication unit 140 conducts a conversation or chat based on the summary of the conversation history or the summary of the chat history. Generating a summary in this manner reduces the amount of information. This reduces the processing burden on the communication unit 140.

[0062] Next, a case will be described in which the user who has taken over the conversation or chat function conducts a conversation or chat based on a summary of the conversation history or a summary of the chat history. As described above, the control unit 160a generates a summary based on the conversation history or the chat history. The control unit 160a may also obtain the summary by requesting the generation AI to generate a summary of the conversation history or the chat history. For example, the control unit 160a may request the generation AI to generate a summary such that the conversation history is summarized in three sentences.

[0063] Furthermore, the control unit 160a may generate a summary as follows: Let Ih be the amount of information that a human can recognize in a short time. Let IT be the amount of information in the summary. The control unit 160a generates a summary so that the relationship between Ih and IT satisfies equation (1).

[0064] Ih ≧ IT (1)

[0065] The information amount IT may also be calculated based on Shannon's information entropy formula: The information amount IT may also be calculated based on formula (2).

[0066] IT = Shannon information entropy of the text + weight based on human perception characteristics … (2)

[0067] For example, the weight based on human perceptual characteristics is calculated based on cognitive characteristics such as the ease of viewing text that is 13 characters or less, the ease of viewing bullet points, the ease of viewing important information when the text is in a different color, etc. For example, the weight based on human perceptual characteristics is calculated based on Equation (3).

[0068] Weight based on human perception = number of characters per line + number of lines - number of attention points for important parts ... (3)

[0069] The weights based on human perception characteristics may be optimized based on the user's attribute information. For example, if the user is elderly, the weights may be used to further reduce the summary information. The attribute information may be information registered by the user or information detected by a camera or the like. The control unit 160a may generate a summary of 13 characters or less or a summary containing only important characters.

[0070] The communication unit 150a transmits a summary of the conversation history or chat history and the message to the terminal of the user who is taking over. This reduces the amount of information displayed, allowing the user to quickly understand the content of the takeover.

[0071] The communication unit 150a may transmit audio data of the conversation history summary or chat history summary and audio data of the message to the terminal. If the handover is not performed correctly, the communication unit 150a may transmit the conversation history summary or chat history summary to the terminal again.

[0072] Embodiment 4 Next, embodiment 4 will be described. In embodiment 4, differences from embodiment 3 will be mainly described. Furthermore, in embodiment 4, descriptions of matters common to embodiment 3 will be omitted.

[0073] The control unit 160a acquires information that the target user will overlook during the handover from the storage unit 110 or an external device. For example, if the user overlooked certain information when taking over an avatar in the past, this information is information that the user will overlook during the handover. When the user performs the handover, the control unit 160a highlights the information that will be overlooked in the conversation history, the conversation history summary, the chat history, or the chat history summary based on the acquired information. For example, the control unit 160a highlights the information that the user will overlook in bold. The communication unit 150a transmits the highlighted information to the user's terminal. This allows the information processing device 100a to prevent the user from overlooking the information.

[0074] Embodiment 5 Next, embodiment 5 will be described. In embodiment 5, differences from embodiments 1 and 2 will be mainly described. Furthermore, in embodiment 5, descriptions of matters common to embodiments 1 and 2 will be omitted.

[0075] In the first and second embodiments, the case where the communication unit 140 or another user takes over the avatar has been described. In the fifth embodiment, the case where the communication unit 140 or another user takes over the personality of a predecessor will be described.

[0076] First, a case where the communication unit 140 takes over the personality of a predecessor will be described. For example, in the case of FIG. 4, a case where the communication unit 140 takes over the personality of user 1 will be described. The control unit 160 acquires information indicating the personality of the predecessor. For example, the control unit 160 acquires information indicating the personality of the predecessor from the storage unit 110. Note that "personality" may be rephrased as "characteristics."

[0077] Here, the process of generating information indicating the personality of a predecessor will be described. For example, the predecessor is assumed to be user 1. When user 1 and user 2 are conversing (i.e., in the state of FIG. 4(B)), the control unit 160 analyzes the content of user 1's conversation to generate information indicating user 1's personality. When user 1 and user 2 are chatting, the control unit 160 analyzes the content of user 1's chat to generate information indicating user 1's personality. The control unit 160 may request the generation AI to generate information indicating user 1's personality from the content of user 1's conversation or chat. In this way, information indicating the predecessor's personality is generated.

[0078] Specifically, if the predecessor was speaking, the information that indicates the predecessor's personality is the speaking style, formants, pitch, intonation, speaking speed, etc. If the predecessor was chatting, the information that indicates the predecessor's personality is the position of punctuation marks, characteristic expressions, typing speed, etc.

[0079] When the communication unit 140 takes over an avatar, it communicates in accordance with the predecessor's personality based on information indicating the predecessor's personality. Specifically, as shown in FIG. 4(C), it is assumed that the communication unit 140 has taken over avatar 10. It is assumed that the information indicating the predecessor's personality indicates user 1's speaking style. It is assumed that the communication unit 140 and user 2 are conversing verbally via avatars 10 and 11. When generating conversation content to be provided to user 2 (i.e., avatar 11), the communication unit 140 generates the conversation content taking user 1's speaking style into consideration.

[0080] Next, a case will be described in which the communication unit 140 and user 2 are chatting via avatars 10 and 11. The information indicating the predecessor's personality indicates that user 1 uses distinctive expressions. When generating chat content to provide to user 2 (i.e., avatar 11), the communication unit 140 generates the chat content taking into account user 1's distinctive expressions. In this way, the communication unit 140 communicates in accordance with the predecessor's personality. Therefore, the information processing device 100 can reduce the sense of discomfort that accompanies the handover.

[0081] Next, a case where another user inherits the personality of a predecessor will be described. For example, in the case of FIG. 8 , a case where user 5 inherits the personality of user 1 will be described. As shown in FIG. 8 (C), it is assumed that user 5 has inherited avatar 10. The control unit 160a acquires information indicating the personality of the predecessor. It is assumed that users 2 and 5 are conversing via voice via avatars 10 and 11. The communication unit 150a receives voice data of user 5 from the terminal 204. Based on the information indicating the personality of the predecessor, the control unit 160a adjusts the voice data to voice data corresponding to the personality of the predecessor. For example, it is assumed that the information indicating the personality of the predecessor indicates the speaking style of user 1. The control unit 160a adjusts the voice data of user 5 to the speaking style of user 1. The communication unit 150a transmits the adjusted voice data to the other party's terminal (e.g., the terminal 201 of user 2).

[0082] Next, a case will be described in which user 2 and user 5 are chatting via avatars 10 and 11. The control unit 160a acquires information indicating the personality of the predecessor. The communication unit 150a receives the chat content of user 5 from the terminal 204. Based on the information indicating the personality of the predecessor, the control unit 160a adjusts the chat content to match the personality of the predecessor. It is assumed that the information indicating the personality of the predecessor indicates that user 1 uses characteristic expressions. The control unit 160a adjusts the chat content of user 5 taking into account the characteristic expressions of user 1. The communication unit 150a transmits the adjusted chat content to the other party's terminal (e.g., user 2's terminal 201).

[0083] In this way, the information processing device 100a adjusts the voice data or chat content of the successor, taking into account the personality of the predecessor. Therefore, the information processing device 100a can reduce the sense of discomfort that accompanies the handover. Furthermore, for example, User 5 does not need to imitate User 1, the predecessor. Therefore, the burden on User 5 is reduced.

[0084] The information processing device 100 may also execute the same process when the user takes over the AI, as shown in Fig. 6. The process will be described using the case of Fig. 6.

[0085] The control unit 160 acquires information indicating the personality of the predecessor's communication unit 140. For example, this information is the same as the information indicating the personality of the predecessor described above. When the control unit 160 receives voice data of user 1, it adjusts the voice data to voice data that corresponds to the personality of the predecessor's communication unit 140, based on the information indicating the personality of the predecessor's communication unit 140. The communication unit 150 transmits the adjusted voice data to the terminal 202 used by user 3.

[0086] When the control unit 160 receives the chat content of the first user, it adjusts the chat content to match the personality of the predecessor's communication unit 140 based on information indicating the personality of the predecessor's communication unit 140. The communication unit 150 transmits the adjusted chat content to the terminal 202 used by user 3. In this way, the information processing device 100 can perform similar processing even when a user takes over the AI.

[0087] Sixth Embodiment Next, a sixth embodiment will be described. In the sixth embodiment, differences from the first and second embodiments will be mainly described. In the sixth embodiment, descriptions of the commonalities between the first and second embodiments will be omitted.

[0088] The control unit 160 performs matching when a user logs in to an avatar. For example, the control unit 160 identifies hobbies based on a conversation history. For example, the control unit 160 identifies hobbies based on words that frequently appear in conversations. The control unit 160 performs matching based on hobbies. The control unit 160 may perform matching based on speaking style, punctuation position, typing speed, formant, pitch, intonation, speaking speed, etc. The control unit 160 may perform matching based on user attributes. The control unit 160 may perform matching based on the intentions of an operator of the metaverse. The information processing device 100 can reduce the frequency of users dropping out.

[0089] Seventh Embodiment Next, a seventh embodiment will be described. In the seventh embodiment, differences from the first and second embodiments will be mainly described. In the seventh embodiment, descriptions of the commonalities between the first and second embodiments will be omitted.

[0090] The following explanation will be given for a case where a group conversation takes place. First, it is assumed that all avatars are in a logged-out state. The explanation will be given for a case where one user logs in to an avatar. It is assumed that user 1 logs in to avatar 10. Since avatar 11 is in a logged-out state, user 1 converses with the AI ​​(i.e., the communication unit 140) via avatars 10 and 11. Here, before user 1 logs in to avatar 10, avatar 10 is in a logged-out state, so avatar 10 is in charge of the AI. User 1 takes over avatar 10 based on the conversation history of the AI. The control unit 160 sets a priority in the conversation history. The priority is expressed by equation (4).

[0091] Priority = time elapsed since the last information + importance of the information + low level of freedom of conversation during handover... (4)

[0092] The communication unit 150 transmits information based on the priority in the conversation history to the terminal 200 of the user 1. This allows the user 1 to perform handover based on the information with the highest priority.

[0093] Next, assume that one avatar is in a logged-in state and another avatar is in a logged-out state. The user logs in to the other avatar. At the time the user logs in to the other avatar, the conversation history is stored in the storage unit 110. The control unit 160 sets a priority in the conversation history. The priority is expressed by equation (5).

[0094] Priority = time since last information + importance of information + ease of memorization of information... (5)

[0095] The communication unit 150 transmits information based on the priority in the conversation history to the terminal of the user who logs in. This allows the user to perform handover based on information that takes priority into consideration.

[0096] Next, assume that two or more avatars are logged in and another avatar is logged out. The user logs in to one of the other avatars. At the time the user logs in to the other avatar, the conversation history is stored in the storage unit 110. The control unit 160 sets a priority in the conversation history. The priority is expressed by equation (6).

[0097] Priority = (time elapsed since last information + importance of information + ease of memorization of information) × number of people × adjustment coefficient (6) The communication unit 150 transmits information based on the priority in the conversation history to the terminal of the user who logs in. This allows the user to take over based on information that takes priority into consideration.

[0098] The embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. Furthermore, the features of the embodiments can be combined with each other as appropriate.

[0099] 10-13 avatar, 100 information processing device, 100a information processing device, 101 processor, 102 volatile storage device, 103 non-volatile storage device, 110 storage unit, 120 generation unit, 130 management unit, 140 communication unit, 150 communication unit, 150a communication unit, 160 control unit, 160a control unit, 200-204 terminal.

Claims

1. An information processing device that provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar, comprising: a first communication unit; a communication unit that receives a request to leave from a terminal used by the first user; and a control unit that instructs the first communication unit to take over the first avatar that the first user is logged in to, based on a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar, wherein the first communication unit receives the instruction, and if the first avatar and the second avatar have had a voice conversation, carries out a conversation based on the conversation history, and if the first avatar and the second avatar have had a chat conversation, carries out a chat based on the chat history.

2. The information processing device according to claim 1, wherein the control unit instructs the first communication unit to take over the first avatar based on the summary of the conversation history or the summary of the chat history.

3. The information processing device according to claim 1 or 2, wherein the control unit acquires information indicating the personality of the first user, and the first communication unit, when taking over the first avatar, communicates in accordance with the personality of the first user based on the information indicating the personality of the first user.

4. An information processing device as described in claim 1, further comprising a second communication unit that conducts a voice conversation or a chat conversation with a third user via a third avatar and a fourth avatar, wherein when the first user logs in to the fourth avatar managed by the second communication unit, the communication unit transmits a conversation history between the third avatar and the fourth avatar or a chat history between the third avatar and the fourth avatar to a terminal used by the first user.

5. The information processing device according to claim 4, wherein when the first user logs in to the fourth avatar, the communication unit transmits a summary of the conversation history between the third avatar and the fourth avatar, or a summary of the chat history between the third avatar and the fourth avatar, to a terminal used by the first user.

6. An information processing device as described in claim 4 or 5, wherein the control unit acquires information indicating the personality of the second communication unit, and when voice data of the first user is received, adjusts the voice data to voice data that corresponds to the personality of the second communication unit based on the information indicating the personality of the second communication unit, and the communication unit transmits the adjusted voice data to a terminal used by the third user.

7. An information processing device as described in claim 4 or 5, wherein the control unit acquires information indicating the personality of the second communication unit, and when chat content of the first user is received, adjusts the chat content to chat content that corresponds to the personality of the second communication unit based on the information indicating the personality of the second communication unit, and the communication unit transmits the adjusted chat content to a terminal used by the third user.

8. An information processing device that provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar, the information processing device comprising: a communication unit that receives a request to leave from a terminal used by the first user who is logged in to the first avatar; and a control unit that acquires information indicating a third user who is waiting for the avatar to log out, wherein the communication unit transmits to the terminal used by the third user a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar, and a message indicating that the third user will take over the first avatar.

9. The information processing device according to claim 8, wherein the communication unit transmits the conversation history summary or the chat history summary and the message to the terminal.

10. The information processing device according to claim 8, wherein the control unit monitors whether the handover is being performed correctly for a predetermined time after the third user takes over the first avatar, and the communication unit again transmits the conversation history or the chat history to the terminal if the handover is not being performed correctly.

11. The information processing device according to claim 10, wherein the communication unit transmits the summary of the conversation history or the summary of the chat history to the terminal again if the handover has not been performed correctly.

12. An information processing device as described in any one of claims 8 to 11, wherein the control unit acquires information that the third user will overlook during handover, and based on the acquired information, highlights the information that will be overlooked in the conversation history, the summary of the conversation history, the chat history, or the summary of the chat history, and the communication unit transmits the highlighted information to the terminal.

13. An information processing device as described in any one of claims 8 to 12, wherein the control unit acquires information indicating the personality of the first user, and when voice data of the third user is received, adjusts the voice data to voice data that corresponds to the personality of the first user based on the information indicating the personality of the first user, and the communication unit transmits the adjusted voice data to a terminal used by the second user.

14. An information processing device as described in any one of claims 8 to 12, wherein the control unit acquires information indicating the personality of the first user, and when chat content of the third user is received, adjusts the chat content to chat content that corresponds to the personality of the first user based on the information indicating the personality of the first user, and the communication unit transmits the adjusted chat content to a terminal used by the second user.

15. The information processing device according to claim 8, wherein the control unit performs matching when a user logs in to an avatar.

16. The information processing device according to claim 8, wherein the control unit sets a priority in the conversation history, and the communication unit transmits information based on the priority in the conversation history to the terminal of the user who logs in.

17. A control method in which an information processing device provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar, the control method receiving a request to leave from a terminal used by the first user, and taking over the first avatar logged in by the first user based on a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar, and in taking over the first avatar, if the first avatar and the second avatar have had a voice conversation, the control method carries out a conversation based on the conversation history, and if the first avatar and the second avatar have had a chat conversation, the control method carries out a chat based on the chat history.

18. A control method comprising: an information processing device that provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar; receiving a request to leave from a terminal used by the first user who is logged in to the first avatar; acquiring information indicating a third user who is waiting for the avatar to log out; and transmitting to the terminal used by the third user a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar, and a message indicating that the third user will take over the first avatar.

19. A control program for an information processing device that provides a virtual space in which a first user and a second user have a voice conversation or a chat conversation via a first avatar and a second avatar, the control program receiving a request to leave from a terminal used by the first user, and taking over the first avatar logged in by the first user based on the conversation history between the first avatar and the second avatar or the chat history between the first avatar and the second avatar, and executing processing, wherein, in taking over the first avatar, if the first avatar and the second avatar have been conversing by voice, the control program carries out a conversation based on the conversation history, and if the first avatar and the second avatar have been conversing by chat, the control program carries out a chat based on the chat history.

20. A control program that causes an information processing device that provides a virtual space in which a first user and a second user have a voice conversation or chat conversation via a first avatar and a second avatar to execute the following process: receive a withdrawal request from a terminal used by the first user who is logged in to the first avatar; acquire information indicating a third user who is waiting for the avatar to log out; and send to the terminal used by the third user a conversation history between the first avatar and the second avatar or a chat history between the first avatar and the second avatar, and a message indicating that the third user will take over the first avatar.

Images