Metaverse digital avatar instant communication method, system, computer and storage medium

By establishing a mapping relationship between digital avatars and instant messaging applications in the metaverse through virtual instant messaging gateways and clients, the problem of digital avatars being unable to receive instant messages is solved, enabling instant messaging in the metaverse, improving efficiency and enhancing the immersive experience.

CN116233046BActive Publication Date: 2026-03-31ZHEJIANG NANOMICRO TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-07
Publication Date
2026-03-31

AI Technical Summary

Technical Problem

Digital avatars in the metaverse cannot receive messages from instant messaging software, forcing users to exit the metaverse to communicate, thus disrupting the immersive experience.

Method used

By establishing a mapping relationship between digital virtual avatars and instant messaging applications through virtual instant messaging gateways and virtual clients, the direct transmission of instant messages in the metaverse can be realized.

Benefits of technology

Users can communicate instantly within the metaverse without exiting, improving communication efficiency and enhancing the immersive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116233046B_ABST
    Figure CN116233046B_ABST
Patent Text Reader

Abstract

The application provides a metaverse digital avatar instant communication method, system, computer and storage medium, and the system comprises a system, including: a virtual instant communication gateway and a virtual client; the virtual instant communication gateway is used for generating the virtual client, acquiring a login state of a user, starting the virtual client, and is also used for storing a mapping relationship between an ID of a digital virtual avatar of the user and an ID of an instant communication application; the virtual client is used for acquiring an instant message in the instant communication application, sending the instant message to a digital virtual avatar of a recipient based on a mapping relationship between an ID of a digital virtual avatar of a recipient user and an ID of an instant communication application. Through the virtual client, the instant message in the instant communication application can be sent to the digital virtual avatar of the recipient user based on the mapping relationship between the ID of the digital virtual avatar and the ID of the instant communication application, instant communication of the user in the metaverse is realized, and the communication efficiency of the user in the metaverse is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of metaverse technology, and in particular to a metaverse digital avatar instant messaging method, system, computer, and storage medium. Background Technology

[0002] The metaverse (or virtual world) is a simulated environment in which users live as digital avatars (digital figures) and interact with other users through these avatars. Digital avatars, objects, and scenes in the metaverse are typically three-dimensional models. The virtual environment in the metaverse is a simulation of the real world, thus providing users with an immersive application experience.

[0003] Instant messaging is a widely used communication method on the Internet, allowing two or more people to exchange text messages, files, voice, and video messages in real time. Many instant messaging software programs allow users to log in from multiple devices, and user chat history is seamlessly synchronized.

[0004] Since the digital avatars in the metaverse are three-dimensional models and do not have physical devices, they cannot receive messages sent by instant messaging software in the physical world. Users need to exit the metaverse and enter the physical world to use instant messaging software, which disrupts the user's immersive experience. Summary of the Invention

[0005] Therefore, it is necessary to provide a metaverse digital avatar instant messaging method, system, computer, and storage medium to address the aforementioned technical problems.

[0006] A metaverse digital avatar instant messaging system includes: a virtual instant messaging gateway and a virtual client;

[0007] The virtual instant messaging gateway is used to generate the virtual client, obtain the user's login status and the activity status of the user's digital avatar, start the virtual client when the user is logged in, and the virtual instant messaging gateway is also used to store the mapping relationship between the user's digital avatar ID and the instant messaging application ID.

[0008] The virtual client is used to associate with the user's digital avatar and obtain instant messages from the instant messaging application. Based on the mapping relationship between the ID of the recipient user's digital avatar and the ID of the instant messaging application, the instant message is sent to the recipient's digital avatar.

[0009] In one embodiment, the virtual instant messaging gateway includes a virtual client management component and a digital identity awareness component;

[0010] The virtual client management component is used to generate the virtual client, obtain the user's login status, and start the virtual client when the user is logged in.

[0011] The digital avatar sensing component is used to detect the activity status of the user's digital virtual avatar. If the digital virtual avatar does not receive interactive messages from the user within a first preset time, or logs out of the metaverse, it exits the virtual client.

[0012] In one embodiment, the virtual client is used to establish a communication connection with an instant messaging server and obtain instant messages from the instant messaging application from the instant messaging server.

[0013] In one embodiment, the virtual client includes a message caching component, which is used to receive and temporarily store the instant message when the recipient's digital virtual avatar is in an exit or dormant state, and to send the instant message to the recipient's digital virtual avatar when the recipient's digital virtual avatar is in an active state.

[0014] In one embodiment, the virtual client includes a protocol conversion component, which is used to convert the format of the instant messaging application's instant messages into a format adapted to the digital avatar, and also to convert the format of the digital avatar's messages into a message format adapted to the instant messaging application.

[0015] A metaverse digital avatar instant messaging method includes:

[0016] Detect the user's login status;

[0017] When a user is logged in, a pre-generated virtual client is launched;

[0018] Retrieve the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID;

[0019] Use the virtual client to obtain instant messages in instant messaging applications;

[0020] Based on the mapping relationship between the recipient user's digital avatar ID and the instant messaging application ID, the instant message is sent to the recipient's digital avatar.

[0021] In one embodiment, the step of using the virtual client to obtain instant messages from an instant messaging application includes:

[0022] The virtual client establishes a communication connection with the instant messaging server and retrieves instant messages from the instant messaging server.

[0023] In one embodiment, the step of sending the instant message to the recipient's digital avatar includes:

[0024] Detect the state of the recipient's digital virtual avatar;

[0025] When the recipient's digital virtual avatar is in an exited or dormant state, the instant message is received and temporarily stored. When the recipient's digital virtual avatar is in an active state, the instant message is sent to the recipient's digital virtual avatar.

[0026] A computer device includes a memory and a processor, the memory storing a computer program, characterized in that the processor executes the computer program to perform the following steps:

[0027] Detect the user's login status;

[0028] When a user is logged in, a pre-generated virtual client is launched;

[0029] Retrieve the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID;

[0030] Use the virtual client to obtain instant messages in instant messaging applications;

[0031] Based on the mapping relationship between the recipient user's digital avatar ID and the instant messaging application ID, the instant message is sent to the recipient's digital avatar.

[0032] A computer-readable storage medium having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0033] Detect the user's login status;

[0034] When a user is logged in, a pre-generated virtual client is launched;

[0035] Retrieve the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID;

[0036] Use the virtual client to obtain instant messages in instant messaging applications;

[0037] Based on the mapping relationship between the recipient user's digital avatar ID and the instant messaging application ID, the instant message is sent to the recipient's digital avatar.

[0038] The aforementioned metaverse digital avatar instant messaging method, system, computer, and storage medium obtain instant messages from instant messaging applications through virtual clients. This enables the instant messages to be sent to the recipient user's digital avatar based on the mapping relationship between the digital avatar's ID and the instant messaging application's ID. This achieves instant communication for users in the metaverse without requiring them to exit the metaverse, greatly improving the user's communication efficiency in the metaverse and enhancing the user's immersive experience in the metaverse. Attached Figure Description

[0039] Figure 1A A block diagram of the logical structure of a metaverse digital avatar instant messaging system in one embodiment;

[0040] Figure 1B This is a logical connection structure diagram of a metaverse digital avatar instant messaging system in one embodiment.

[0041] Figure 1C This is a block diagram of the logical structure of a virtual instant messaging gateway in one embodiment;

[0042] Figure 1D This is a block diagram of the logical structure of a virtual client in one embodiment;

[0043] Figure 2 This is a flowchart illustrating a method for real-time communication of a metaverse digital avatar in one embodiment;

[0044] Figure 3A This is a schematic diagram illustrating the message forwarding process of a message caching component in one embodiment;

[0045] Figure 3B This is a schematic diagram of the message forwarding process of the message caching component in another embodiment;

[0046] Figure 4 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0048] Example 1

[0049] In this embodiment, as Figure 1A and Figure 1B As shown, a metaverse digital avatar instant messaging system is provided, including: a virtual instant messaging gateway 100 and a virtual client 110;

[0050] The virtual instant messaging gateway 100 is used to generate the virtual client 110, obtain the user's login status and the activity status of the user's digital virtual avatar, and start the virtual client 110 when the user is logged in. The virtual instant messaging gateway 100 is also used to store the mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID.

[0051] The virtual client 110 is used to associate with the user's digital avatar and obtain instant messages from the instant messaging application. Based on the mapping relationship between the ID of the recipient user's digital avatar and the ID of the instant messaging application, the instant message is sent to the recipient's digital avatar.

[0052] In this embodiment, a virtual instant messaging gateway 100 is set up in the metaverse system. The virtual instant messaging gateway 100 is a VIMG (Virtually Instant Messaging Gate). The number of users determines the size of the virtual instant messaging gateway 100. The virtual instant messaging gateway 100 can be a standalone server, a cluster of servers, a standalone computer, or an application on a server. The virtual instant messaging gateway 100 establishes a long TCP (Transfer Control Protocol) connection with the instant messaging server and maintains the connection by exchanging heartbeat packets, thus achieving communication with the instant messaging server.

[0053] A user's login status refers to their state of being logged into the metaverse. Simultaneously, when a user logs into the metaverse, they are also logging into their digital virtual avatar. This digital virtual avatar is the user's virtual image within the metaverse, or more specifically, the user's virtual user persona within the metaverse.

[0054] In this embodiment, each user's digital avatar has unique identification information, namely the digital avatar's ID (Identity). Each user's account in the instant messaging application is also unique identification information, namely the user's instant messaging application ID. The virtual instant messaging gateway 100 stores the correspondence between each user's digital avatar ID and the user's ID in the instant messaging application. The virtual instant messaging gateway 100 generates a virtual client 110 by allocating physical computing resources. The virtual client 110 is associated with the digital avatar. When a user logs into the metaverse, the virtual instant messaging gateway 100 starts the virtual client 110 and establishes a connection between the virtual client 110 and the instant messaging server.

[0055] In this way, the virtual client 110 can obtain the instant messages of users in the instant messaging application, determine the ID of the recipient's digital virtual avatar based on the recipient's ID corresponding to the instant message in the instant messaging application, and send the instant message to the digital virtual avatar corresponding to the recipient's digital virtual avatar ID.

[0056] In the above embodiments, the instant message in the instant messaging application is obtained through the virtual client 110, so that the instant message can be sent to the digital virtual avatar of the receiving user based on the mapping relationship between the ID of the digital virtual avatar and the ID of the instant messaging application. This realizes instant communication for the user in the metaverse without having to exit the metaverse, which greatly improves the communication efficiency of the user in the metaverse and enhances the immersive experience of the user in the metaverse.

[0057] In one embodiment, such as Figure 1C As shown, the virtual instant messaging gateway 100 includes a virtual client management component 120 and a digital avatar sensing component 130; the virtual client management component 120 is used to generate the virtual client 110, obtain the user's login status, and start the virtual client 110 when the user is logged in; the digital avatar sensing component 130 is used to detect the activity status of the user's digital avatar, and exit the virtual client 110 when the digital avatar does not receive interactive messages from the user within a first preset time or logs out of the metaverse.

[0058] In this embodiment, the virtual client management component 120 is used to manage the virtual client 110 and allocate and release physical computing resources on the virtual instant messaging gateway 100. Specifically, the virtual client management component 120 obtains the user's login status and the activity status of the digital virtual avatar in the metaverse through the digital sensing component. When a user registers in the metaverse for the first time, a virtual client 110 is created for the user. When the user logs into the metaverse, the virtual client 110 is started. The digital avatar sensing component 130 is connected to the virtual client management component 120. The digital sensing component detects the running status of the user's digital virtual avatar in the metaverse. When the digital virtual avatar does not receive interactive messages from the user within a first preset time, it indicates that the user has not interacted with the digital virtual avatar for a period of time, and then exits the virtual client 110. Alternatively, when the user logs out of the metaverse, the virtual client 110 is exited.

[0059] In one embodiment, the virtual instant messaging gateway 100 further includes a communication component for establishing a communication connection between the virtual instant messaging gateway 100 and the user's digital virtual avatar, and for managing the communication between the virtual instant messaging gateway 100 and the user's digital virtual avatar, including establishing or disconnecting the connection.

[0060] In one embodiment, the virtual client 110 is used to establish a communication connection with an instant messaging server and obtain instant messages from the instant messaging application from the instant messaging server.

[0061] In this embodiment, the virtual client 110 establishes a long TCP connection with the instant messaging server and is associated with the digital virtual avatar. In this way, the virtual client 110 can obtain the instant messages sent by the user on the instant messaging application from the instant messaging server and send them to the digital virtual avatar corresponding to the ID of the instant messaging application.

[0062] In one embodiment, such as Figure 1D As shown, the virtual client 110 includes a message caching component 140, which is used to receive and temporarily store the instant message when the recipient's digital virtual avatar is in an exit or dormant state, and to send the instant message to the recipient's digital virtual avatar when the recipient's digital virtual avatar is in an active state.

[0063] In this embodiment, an logged-out digital avatar indicates that the user is not logged into the metaverse or is offline, while a dormant digital avatar indicates that the user's digital avatar is not active in the metaverse. The message caching component 140 communicates with the instant messaging server, obtains and temporarily stores the instant message from the instant messaging server's message database. If the recipient's digital avatar is active, the instant message is forwarded to the recipient's digital avatar. When the recipient's digital avatar is logged out or dormant, it indicates that the user is not logged into the metaverse or the digital avatar is not active, so the instant message is temporarily stored until the user's digital avatar in the metaverse comes online, at which point the instant message is forwarded to that digital avatar.

[0064] The following two examples illustrate the process of a message caching component temporarily storing and forwarding real-time messages:

[0065] In one embodiment, such as Figure 3A As shown, when the recipient logs in from multiple points, the instant message is sent from the instant messaging server to the digital virtual avatar. The process is as follows:

[0066] 1. After an instant message is sent from the sender, it is forwarded through a message caching component, which includes a message synchronization library and a message storage library. The message caching component first saves the instant message to the message storage library for multi-terminal message roaming.

[0067] 2. Instant messages are saved to the message synchronization library.

[0068] 3. After the instant message is saved, the message caching component will directly push the instant message to online recipients.

[0069] 4. If online push fails or the recipient is offline, the recipient will proactively retrieve all unsynchronized messages from the message synchronization library of the message caching component.

[0070] 5. The virtual client pulls all historical messages for any session from the message repository.

[0071] 6. The virtual avatar pulls session messages from the virtual client.

[0072] In one embodiment, such as Figure 3B As shown, when the sender logs in from multiple locations, the instant message is sent from the instant messaging server to the digital virtual avatar. The process is as follows:

[0073] 1. After an instant message is sent from the sender, it is forwarded through the message caching component, which includes a message synchronization library and a message storage library. The message caching component will first save the instant message to the message storage library for multi-terminal message roaming.

[0074] In addition, the physical client and the virtual client synchronize the instant message to keep the same historical messages between them;

[0075] 2. Instant messages are saved to the message synchronization library;

[0076] 3. After the instant message is saved, the message caching component will directly select online push to push the instant message to online recipients;

[0077] 4. If online push fails or the recipient is offline, the recipient will proactively retrieve all unsynchronized messages from the message synchronization library of the message caching component.

[0078] In one embodiment, such as Figure 1D As shown, the virtual client includes a protocol conversion component 150, which is used to convert the format of the instant messaging application's instant messages into a format suitable for the digital virtual avatar, and also to convert the format of the digital virtual avatar's messages into a message format suitable for the instant messaging application.

[0079] In this embodiment, the protocol conversion component 150 is used to convert the format of instant messages into a format that can be read by digital virtual avatars. For example, the content of instant messages includes text, images, voice (audio), and video. The protocol conversion component 150 converts the format of text, images, voice (audio), and video in instant messages into a format that can be read by digital virtual avatars. It is also used to convert the format of messages from digital virtual avatars into a format that can be read by instant messaging applications and instant messaging servers, thereby realizing message forwarding between instant messaging application messages and digital virtual avatars.

[0080] In this embodiment, the protocol conversion component 150 is further configured to convert the format of the instant messaging application's instant messages into a format adapted to the digital virtual avatar, and the virtual client sends the converted instant messages to the digital virtual avatar; and to convert the format of the digital virtual avatar's messages into a message format adapted to the instant messaging application, and the virtual client sends the converted instant messages to the instant messaging application.

[0081] Specific limitations regarding the Metaverse Digital Avatar Instant Messaging System can be found in the limitations of the Metaverse Digital Avatar Instant Messaging Method below, and will not be repeated here. Each component or independent part of the aforementioned Metaverse Digital Avatar Instant Messaging System can be implemented wholly or partially through software, hardware, or a combination thereof. These components or independent parts can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each unit.

[0082] Example 2

[0083] In this embodiment, as Figure 2 As shown, a metaverse digital avatar instant messaging method is provided, including:

[0084] Step 210: Check the user's login status.

[0085] In this embodiment, the user's login status in the metaverse is detected, and it is determined whether the user has logged into the metaverse.

[0086] Step 220: When the user is logged in, start the pre-generated virtual client.

[0087] In this embodiment, the virtual client is generated by the virtual instant messaging gateway using the physical computing resources on the virtual instant messaging gateway. This virtual client is generated when a user first registers in the metaverse. Each user corresponds to one virtual client, and the number of virtual clients is set according to the number of users. When a user logs into the metaverse, the pre-generated virtual client is activated.

[0088] Step 230: Obtain the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID.

[0089] In this embodiment, the virtual instant messaging gateway stores the mapping relationship between the ID of each user's digital virtual avatar and the ID of the instant messaging application.

[0090] Step 240: Use the virtual client to obtain instant messages from the instant messaging application.

[0091] In this embodiment, the virtual client communicates with the instant messaging server and uses the virtual client to obtain the user's instant messages in the instant messaging application from the instant messaging server.

[0092] Step 250: Based on the mapping relationship between the ID of the recipient user's digital virtual avatar and the ID of the instant messaging application, the instant message is sent to the recipient's digital virtual avatar.

[0093] In this embodiment, based on the mapping relationship between the ID of the recipient user's digital virtual avatar and the ID of the instant messaging application, after obtaining the ID of the instant messaging application, the ID of the recipient user's digital virtual avatar corresponding to the ID of the instant messaging application is obtained, and the instant message is sent to the recipient's digital virtual avatar.

[0094] In the above embodiments, instant messages from instant messaging applications are obtained through virtual clients, enabling these instant messages to be sent to the recipient user's digital virtual avatar based on the mapping relationship between the ID of the digital virtual avatar and the ID of the instant messaging application. This achieves instant communication for the user in the metaverse without having to exit the metaverse, greatly improving the user's communication efficiency in the metaverse and enhancing the user's immersive experience in the metaverse.

[0095] In one embodiment, the step of obtaining instant messages from an instant messaging application using the virtual client includes: establishing a communication connection with an instant messaging server using the virtual client, and obtaining instant messages from the instant messaging application from the instant messaging server.

[0096] In this embodiment, the virtual client establishes a long TCP connection with the instant messaging server and is associated with the digital virtual avatar. In this way, the virtual client can obtain the instant messages sent by the user on the instant messaging application from the instant messaging server and send them to the digital virtual avatar corresponding to the ID of the instant messaging application.

[0097] In one embodiment, the step of sending the instant message to the recipient's digital virtual avatar includes: detecting the state of the recipient's digital virtual avatar; receiving and temporarily storing the instant message when the recipient's digital virtual avatar is in an exited or dormant state; and sending the instant message to the recipient's digital virtual avatar when the recipient's digital virtual avatar is in an active state.

[0098] In this embodiment, an logged-out digital avatar indicates that the user is not logged into the metaverse or is offline, while a dormant digital avatar indicates that the user's digital avatar is not active in the metaverse. In this embodiment, the instant message is obtained from and temporarily stored in the instant messaging server's message library. If the recipient's digital avatar is active, the instant message is forwarded to the recipient's digital avatar. When the recipient's digital avatar is logged out or dormant, it indicates that the user is not logged into the metaverse or the digital avatar is not active; in this case, the instant message is temporarily stored until the user's digital avatar comes online in the metaverse, at which point the instant message is forwarded to that digital avatar.

[0099] In one embodiment, the step of sending the instant message to the digital virtual avatar of the recipient includes: converting the format of the instant message of the instant messaging application into a format adapted to the digital virtual avatar, and having the virtual client send the converted instant message to the digital virtual avatar;

[0100] In one embodiment, the metaverse digital avatar instant messaging method further includes the steps of: converting the message format of the digital virtual avatar into a message format adapted to the instant messaging application, and having the virtual client send the converted instant message to the instant messaging application.

[0101] In this embodiment, the content of instant messages includes text, images, voice (audio), and video. The protocol conversion component converts the format of text, images, voice (audio), and video in the instant messages into a format that can be read by the digital virtual avatar. In addition, the format of the digital virtual avatar's messages can also be converted into a format that can be read by the instant messaging application and the instant messaging server. Thus, before the virtual client forwards the instant message from the instant messaging application to the digital virtual avatar, or before the virtual client forwards the message from the digital virtual avatar to the instant messaging application, the message format is converted so that the message can be read by the digital virtual avatar or the instant messaging application, thereby realizing message forwarding between the instant messaging application's messages and the digital virtual avatar.

[0102] It should be understood that, although Figure 2The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 2 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0103] Example 3

[0104] like Figure 1B As shown, a metaverse server cluster contains one or more servers, each managing a portion of space within the metaverse. Users interact with their corresponding digital avatars within the metaverse through a client. Instant Messaging (IM) software runs on physical communication devices (such as smartphones).

[0105] In the metaverse system, a virtual instant messaging gateway (VIMG) is set up. The VIMG can scale horizontally according to the number of users. The VIMG is used to establish a long TCP connection with the IM server and exchange heartbeat packets to maintain the connection.

[0106] After logging into Metaverse, users log in to VIMG (or register if it's their first time). VIMG stores the mapping relationship between the virtual avatar ID and the IM ID. A virtual IM client is launched on VIMG, which establishes a long TCP connection with the IM server and is associated with the corresponding digital virtual avatar. The virtual client acts as a relay, storing received / sent messages.

[0107] Virtual instant messaging gateways include:

[0108] Virtual Client Management Component: Obtains user login and digital identity activity status through the digital identity awareness component, allocates and releases physical computing resources on VIMG, and generates or terminates virtual clients.

[0109] Digital Identity Awareness Component: Monitors the operational status of the digital identity, such as whether the user has not interacted with the digital identity for a period of time, or whether the user has logged out of the metaverse, and then exits the virtual client. This digital identity awareness component is linked to the virtual client management component, and its status can be used for virtual client management.

[0110] Communication component: Used for communication management between the virtual instant messaging gateway and the digital avatar.

[0111] Virtual clients include:

[0112] Message caching component: Used to store messages obtained from the server-side message repository and push them to the virtual avatar or wait for the virtual avatar to retrieve the messages.

[0113] Protocol conversion component: Converts text, images, voice, video and other media formats in instant messages into formats readable by digital avatars in the metaverse, or converts text, images, voice, video and other media formats in instant messages into formats readable by IM.

[0114] like Figure 3A As shown, when the recipient logs in from multiple points, the instant message is sent from the instant messaging server to the digital virtual avatar. The process is as follows:

[0115] 1. After a message is sent by the sender, it is forwarded by the server. The server (which includes a message synchronization library and a message storage library) will first save the message to the message storage library for multi-terminal message roaming.

[0116] 2. Then the message is saved to the message synchronization library.

[0117] 3. After the message is persistently saved, online recipients will be directly selected for online push.

[0118] 4. If online push fails or the recipient is offline, the recipient will proactively retrieve all unsynchronized messages from the server's message synchronization library.

[0119] 5. The virtual client pulls all historical messages for any session from the message repository.

[0120] 6. The virtual avatar pulls session messages from the virtual client.

[0121] like Figure 3B As shown, when the sender logs in from multiple locations, the instant message is sent from the instant messaging server to the digital virtual avatar. The process is as follows:

[0122] 1. After the message is sent by the sender, it is forwarded by the server. The server (including the message synchronization library and the message storage library) will first save the message to the message storage library for multi-terminal message roaming.

[0123] In addition, the physical client and the virtual client synchronize the message so that the two clients keep the same historical messages;

[0124] 2. Then the message is saved to the message synchronization library;

[0125] 3. After the message is persistently saved, online recipients will be directly selected for online push;

[0126] 4. If online push fails or the recipient is offline, the recipient will proactively retrieve all unsynchronized messages from the server's message synchronization library.

[0127] Example 4

[0128] In this embodiment, a computer device is provided. Its internal structure diagram can be shown as follows: Figure 4 As shown, the computer device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs, and also deploys a database for storing user behavior data and user profiles. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with other computer devices that have deployed application software. When the computer program is executed by the processor, it implements a metaverse digital avatar instant messaging method. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0129] Those skilled in the art will understand that Figure 4 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0130] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, the processor executing the computer program to perform the following steps:

[0131] Detect the user's login status;

[0132] When a user is logged in, a pre-generated virtual client is launched;

[0133] Retrieve the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID;

[0134] Use the virtual client to obtain instant messages in instant messaging applications;

[0135] Based on the mapping relationship between the recipient user's digital avatar ID and the instant messaging application ID, the instant message is sent to the recipient's digital avatar.

[0136] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0137] The virtual client establishes a communication connection with the instant messaging server and retrieves instant messages from the instant messaging server.

[0138] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0139] Detect the state of the recipient's digital virtual avatar;

[0140] When the recipient's digital virtual avatar is in an exited or dormant state, the instant message is received and temporarily stored. When the recipient's digital virtual avatar is in an active state, the instant message is sent to the recipient's digital virtual avatar.

[0141] Example 5

[0142] In this embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, it performs the following steps:

[0143] Detect the user's login status;

[0144] When a user is logged in, a pre-generated virtual client is launched;

[0145] Retrieve the pre-stored mapping relationship between the user's digital virtual avatar ID and the instant messaging application ID;

[0146] Use the virtual client to obtain instant messages in instant messaging applications;

[0147] Based on the mapping relationship between the recipient user's digital avatar ID and the instant messaging application ID, the instant message is sent to the recipient's digital avatar.

[0148] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0149] The virtual client establishes a communication connection with the instant messaging server and retrieves instant messages from the instant messaging server.

[0150] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0151] Detect the state of the recipient's digital virtual avatar;

[0152] When the recipient's digital virtual avatar is in an exited or dormant state, the instant message is received and temporarily stored. When the recipient's digital virtual avatar is in an active state, the instant message is sent to the recipient's digital virtual avatar.

[0153] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0154] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0155] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A metaverse digital avatar instant messaging system, characterized in that, The application relates to a virtual instant communication gateway and a virtual client. The virtual instant communication gateway is used for generating the virtual client, obtaining the login state of a user and the active state of a digital virtual avatar of the user, starting the virtual client when the user is in the login state, and storing the mapping relationship between the ID of the digital virtual avatar of the user and the ID of an instant communication application. The virtual client is used for being associated with the digital virtual avatar of the user and obtaining instant messages in the instant communication application, sending the instant messages to the digital virtual avatar of a receiver based on the mapping relationship between the ID of the digital virtual avatar of the receiver and the ID of the instant communication application. The virtual client comprises a message cache component which is used for receiving and temporarily storing the instant messages when the digital virtual avatar of the receiver is in an exit or dormancy state, and sending the instant messages to the digital virtual avatar of the receiver when the digital virtual avatar of the receiver is in an active state. The process of temporarily storing and forwarding the instant messages by the message cache component comprises the following steps: When the receiver is multi-point logged in, the instant messages are sent to the digital virtual avatar by an instant message server, and the process comprises the following steps: (1) After the instant messages are sent from a sender, the instant messages are forwarded through a message cache component, the message cache component comprises a message synchronization library and a message storage library, the message cache component first saves the instant messages to the message storage library for multi-terminal message roaming; (2) The instant messages are saved to the message synchronization library; (3) After the saving of the instant messages is completed, the message cache component directly selects online to push the instant messages to the online receiver; (4) If the online pushing fails or the receiver is offline, the receiver actively pulls all unsynchronized messages from the message synchronization library of the message cache component; (5) The virtual client pulls all historical messages of any session from the message storage library; (6) The virtual avatar pulls the session messages from the virtual client; When the receiver is multi-point logged in, the instant messages are sent to the digital virtual avatar by an instant message server, and the process comprises the following steps: (1) After the instant messages are sent from a sender, the instant messages are forwarded through a message cache component, the message cache component comprises a message synchronization library and a message storage library, the message cache component first saves the instant messages to the message storage library for multi-terminal message roaming; the instant messages are synchronized between a physical client and the virtual client, so that the physical client and the virtual client keep the same historical messages; (2) The instant messages are saved to the message synchronization library; (3) After the saving of the instant messages is completed, the message cache component directly selects online to push the instant messages to the online receiver; (4) If the online pushing fails or the receiver is offline, the receiver actively pulls all unsynchronized messages from the message synchronization library of the message cache component; The virtual instant communication gateway comprises a virtual client management component and a digital avatar sensing component. The virtual client management component is used for generating the virtual client and obtaining the login state of a user, and starting the virtual client when the user is in the login state. ​ The digital avatar perception component is configured to detect an active state of the digital virtual avatar of the user, and when the digital virtual avatar does not obtain an interactive message of the user within a first preset time or logs out of the metaverse, the virtual client is exited.

2. The system of claim 1, wherein, The virtual client is configured to establish a communication connection with an instant messaging server, and obtain instant messages of the instant messaging application from the instant messaging server.

3. The system of claim 1, wherein, The virtual client comprises a protocol conversion component configured to convert a format of the instant messages of the instant messaging application into a format adapted to the digital virtual avatar, and convert a format of messages of the digital virtual avatar into a format adapted to the instant messaging application.

4. A metaverse digital avatar instant messaging method, characterized in that, The method comprises: detecting a login state of a user; when the user is in the login state, starting a pre-generated virtual client; obtaining a mapping relationship between an ID of a digital virtual avatar of the user and an ID of an instant messaging application; obtaining instant messages in the instant messaging application by using the virtual client; based on the mapping relationship between the ID of the digital virtual avatar of the receiving user and the ID of the instant messaging application, sending the instant messages to the digital virtual avatar of the receiving user; the step of sending the instant messages to the digital virtual avatar of the receiving user comprises: detecting a state of the digital virtual avatar of the receiving user; when the digital virtual avatar of the receiving user is in an exit or hibernation state, receiving and temporarily storing the instant messages, and when the digital virtual avatar of the receiving user is in an active state, sending the instant messages to the digital virtual avatar of the receiving user; wherein, the process of temporarily storing and forwarding instant messages by the message cache component comprises the following: when the receiving user is multi-point logged in, the instant messages are sent to the digital virtual avatar by the instant messaging server, and the process comprises: (1) after the instant messages are sent from the sending user, the message cache component forwards the instant messages, the message cache component comprises a message synchronization library and a message storage library, and the message cache component saves the instant messages to the message storage library first, for multi-terminal message roaming; (2) the instant messages are saved to the message synchronization library; (3) after the saving of the instant messages is completed, for the online receiving user, the message cache component directly selects the online receiving user to push the instant messages to the online receiving user; (4) if the online pushing fails or the receiving user is offline, the receiving user actively pulls all unsynchronized messages from the message synchronization library of the message cache component; (5) the virtual client pulls all historical messages of any session from the message storage library; (6) the virtual avatar pulls session messages from the virtual client; when the sending user is multi-point logged in, the instant messages are sent to the digital virtual avatar by the instant messaging server, and the process comprises: (1) after the instant messages are sent from the sending user, the message cache component forwards the instant messages, the message cache component comprises a message synchronization library and a message storage library, and the message cache component saves the instant messages to the message storage library first, for multi-terminal message roaming; the physical client and the virtual client synchronize the instant messages, so that the physical client and the virtual client keep the same historical messages; (2) the instant messages are saved to the message synchronization library; (3) After the instant message is saved, the message cache component directly selects online push to push the instant message to the online receiver if the receiver is online; (4) If the online push fails or the receiver is offline, the receiver actively pulls all unsynchronized messages from the message synchronization library of the message cache component; The virtual instant communication gateway comprises a virtual client management component and a digital avatar sensing component; The virtual client management component is configured to generate the virtual client, acquire a login state of a user, and start the virtual client when the user is in the login state. The digital avatar sensing component is configured to detect an active state of the digital virtual avatar of the user, and exit the virtual client when the digital virtual avatar does not obtain an interactive message of the user within a first preset time or logs out of the meta universe.

5. The method of claim 4, wherein, The step of obtaining the instant message in the instant communication application by using the virtual client comprises: establishing a communication connection with an instant communication server by using the virtual client, and obtaining the instant message of the instant communication application from the instant communication server. 6.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-5 when the computer program is executed by the processor. The processor executes the computer program to implement the steps of the method in any one of claims 4 to 5.

7. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 4 to 5.

Citation Information

Patent Citations

  • Communication method and device based on virtual character interaction interface and computer equipment

    CN111884914A

  • Instant messaging message sending method and device

    CN112737928A