Virtual interaction method and device, electronic equipment and readable storage medium

Abstract

The invention discloses a virtual interaction method and device, electronic equipment and a readable storage medium, the virtual interaction method and device are applied to a virtual interaction system, the virtual interaction system is in communication connection with a target terminal, and the virtual interaction method comprises the steps that a virtual interaction request sent by the target terminal is acquired, and the virtual interaction request carries user information; determining virtual character information and virtual space information according to the user information; sending the virtual character information and the virtual space information to the target terminal together, so that the target terminal respectively selects a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information; and controlling the target virtual character to perform virtual interaction in the virtual space. The technical problem of high interaction limitation of virtual interaction is solved.

Description

Technical Field

[0001] This application relates to the field of virtual reality technology, and particularly to a virtual interaction method, apparatus, electronic device, and readable storage medium. Background Art

[0002] With the continuous development of virtual reality technology, virtual social systems have emerged. Users can immerse themselves in virtual interaction in virtual scenes under low-latency conditions through virtual social systems, bringing a realistic experience as if they were on the scene. At the same time, the application scenarios of virtual social systems are also constantly innovating with the iteration of technologies such as 5G (5th Generation Mobile Communication Technology), VR (Virtual Reality), AR (Augmented Reality), and holography.

[0003] Currently, virtual social systems are often applied to public social scenarios. Usually, the verisimilitude between different user terminals is achieved by driving the facial expressions of virtual characters. To experience the verisimilitude of actions, corresponding virtual reality wearable devices need to be worn. However, in some virtual interaction scenarios, the users involved in virtual interaction do not necessarily own or are suitable for wearing virtual reality wearable devices. For example, a lonely elderly person in a home scenario lacks a sense of reality in virtual interaction in the virtual space due to not wearing a virtual reality wearable device, which may lead to a poor virtual interaction experience in this scenario. Therefore, the current limitations of virtual interaction are high. Summary of the Invention

[0004] The main purpose of this application is to provide a virtual interaction method, apparatus, electronic device, and readable storage medium, aiming to solve the technical problem of high limitations in virtual interaction.

[0005] To achieve the above object, this application provides a virtual interaction method applied to a virtual interaction system. The virtual interaction system is communicatively connected to a target terminal. The virtual interaction method includes:

[0006] Obtain a virtual interaction request sent by the target terminal, where the virtual interaction request carries user information;

[0007] Determine virtual character information and virtual space information according to the user information;

[0008] Send the virtual character information and the virtual space information to the target terminal together, so that the target terminal can respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information;

[0009] Control the target virtual character to perform virtual interaction in the virtual space.

[0010] To achieve the above object, the present application further provides a device applied to a virtual interaction system, the virtual interaction system being communicatively connected to a target terminal, the virtual interaction device comprising:

[0011] An acquisition module, configured to acquire a virtual interaction request sent by the target terminal, wherein the virtual interaction request carries user information;

[0012] A determination module, configured to determine virtual character information and virtual space information according to the user information;

[0013] A sending module, configured to jointly send the virtual character information and the virtual space information to the target terminal for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information;

[0014] A control module, configured to control the target virtual character to perform virtual interaction in the virtual space.

[0015] To achieve the above object, the present application further provides an electronic device, the electronic device comprising: at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions triggerable by the at least one processor, the instructions being triggered by the at least one processor so that the at least one processor can trigger the steps of the virtual interaction method as described above.

[0016] To achieve the above object, the present application provides a computer-readable storage medium, on which a program for implementing a virtual interaction method is stored, and the program for implementing the virtual interaction method is executed by a processor to implement the steps of the virtual interaction method as described above.

[0017] An embodiment of the present application provides a virtual interaction method. Applied to a virtual interaction system, the virtual interaction system being communicatively connected to a target terminal, the virtual interaction method comprising: acquiring a virtual interaction request sent by the target terminal, wherein the virtual interaction request carries user information; determining virtual character information and virtual space information according to the user information; jointly sending the virtual character information and the virtual space information to the target terminal for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information; controlling the target virtual character to perform virtual interaction in the virtual space.

[0018] In this way, when a user of a target terminal conducts virtual interaction, they can actively send an interaction request to the virtual interaction system connected by communication. Since the virtual interaction request carries user information, the virtual interaction system can then determine virtual character information and virtual space information based on the user information, and through the information interaction between the virtual character information and the virtual space information between the virtual interaction system and the target terminal, interactively generate a target virtual character and a virtual space on the target terminal, and finally control the target virtual character to conduct virtual interaction in the virtual space. Since the target virtual character and the virtual space are generated based on the user information of the target terminal, end-to-end information interaction between the virtual interaction system and the target terminal can be realized. The embodiment of the present application aims to bring a real immersive interaction experience through the virtual interaction of the target virtual character in the virtual space. At the same time, since the virtual interaction system directly controls the target virtual character to conduct virtual interaction in the virtual space and there are no physical part restrictions on the virtual interaction of the virtual character due to virtual realism, the embodiment of the present application achieves the purpose of full-range simulation in the virtual interaction process.

[0019] Compared with the need to wear corresponding virtual reality wearable devices for the realistic feeling in the experience actions in the related art, the embodiment of the present application reduces the interaction condition limitations for virtual interaction under high simulation. That is, since the embodiment of the present application overcomes the technical defect that the virtual interaction between the two interaction parties lacks a sense of reality in the virtual space due to not wearing virtual reality wearable devices, resulting in a poor virtual interaction effect and an interactive experience in this scenario, the interaction limitations for virtual interaction are thus reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0021] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0022] Figure 1 It is a schematic flowchart of the first embodiment of the virtual interaction method of the present application;

[0023] Figure 2 It is a functional framework diagram of the virtual interaction system in the first embodiment of the virtual interaction method of the present application;

[0024] Figure 3 It is an interactive scenario schematic diagram of the virtual interaction scenario in the first embodiment of the virtual interaction method of the present application;

[0025] Figure 4 It is the execution timing diagram for inviting associated users to perform virtual interaction in the first embodiment of the virtual interaction method of this application;

[0026] Figure 5 It is the synchronous timing diagram for virtual interaction among interactive users in the virtual space in the first embodiment of the virtual interaction method of this application;

[0027] Figure 6 It is the execution timing diagram for silent virtual interaction in the virtual space in the first embodiment of the virtual interaction method of this application;

[0028] Figure 7 It is the execution timing diagram for autonomous virtual interaction in the virtual space in the first embodiment of the virtual interaction method of this application;

[0029] Figure 8 It is the execution timing diagram for the generation of virtual characters and virtual spaces in the first embodiment of the virtual interaction method of this application;

[0030] Figure 9 It is the schematic flowchart of the second embodiment of the virtual interaction method of this application;

[0031] Figure 10 It is the execution timing diagram for a user to register and log in to the virtual interaction system in the second embodiment of the virtual interaction method of this application;

[0032] Figure 11 The structural schematic diagram of the virtual interaction device of this application;

[0033] Figure 12 It is the device structural schematic diagram of the hardware operating environment involved in the virtual interaction method in the embodiments of this application.

[0034] The realization of the purpose of this application, functional features and advantages will be further described with reference to the embodiments and the accompanying drawings. Specific embodiments

[0035] To make the above objects, features and advantages of this application more obvious and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of this application without creative efforts shall fall within the protection scope of this application.

[0036] Refer to Figure 1 , the embodiments of this application provide a virtual interaction method, which is applied to a virtual interaction system. The virtual interaction system is communicatively connected to a target terminal. In the first embodiment of the virtual interaction method of this application, the virtual interaction method includes:

[0037] Step S10: Obtain the virtual interaction request sent by the target terminal, where the virtual interaction request carries user information;

[0038] Step S20: Determine virtual character information and virtual space information according to the user information;

[0039] Step S30: Send the virtual character information and the virtual space information to the target terminal together, so that the target terminal can respectively select the target virtual character corresponding to the virtual character information and the virtual space corresponding to the virtual space information;

[0040] Step S40: Control the target virtual character to perform virtual interaction in the virtual space.

[0041] In this embodiment, it should be noted that during virtual interaction, the virtual interaction system usually focuses on video calls, which requires both parties of the video to be online. At the same time, in addition to the experience in voice and video effects, it is difficult for the two parties of the interaction to have a realistic experience in the offline interaction scenario. For example, a realistic experience in some body movements requires wearing corresponding virtual reality wearable devices. However, it is difficult to meet the above requirements in the home virtual interaction scenario, which makes the virtual interaction in some scenarios prone to a poor virtual interaction effect, that is, the current virtual interaction system can only bring an immersive interaction experience to the two parties of the interaction in some scenarios. Therefore, the current limitations of virtual interaction are high.

[0042] In addition, it should be noted that to solve the above defects, the embodiment of the present application designs an immersive virtual interaction system. The virtual interaction method adopted by the present application is applied to the virtual interaction system. The virtual interaction system can be deployed either in the cloud or on a local server. The embodiment of the present application does not limit this. The virtual interaction system is used to provide the implementation and capabilities of all functions during virtual interaction. For example, in an implementable manner, refer to Figure 2 , Figure 2It is a functional framework diagram of a virtual interaction system. Among them, the virtual interaction system is divided into five layers: the application layer, the interface layer, the service layer, the capability layer, and the basic layer. The application layer is used to assist the interaction terminal to complete virtual interaction applications. The interface layer may specifically include audio and video call interfaces, service operation interfaces, virtual space operation interfaces, platform docking interfaces, and video surveillance docking interfaces. The platform corresponding to the platform docking interface may specifically be the Internet Protocol (Interactive Personal) Television (IPTV) or the Over The Top (OTT) Internet application service platform, etc. The service layer may specifically include user management, role management, relative and friend management, space management, resource management, model management, and configuration management, etc. The capability layer can specifically provide audio and video processing capabilities, audio and video distribution capabilities, rendering capabilities, virtual character generation and driving capabilities, virtual space generation and processing capabilities, real-time two-way audio and video capabilities, space object synchronization and communication capabilities, recording and storage capabilities, and Artificial Intelligence (AI) processing capabilities, etc. The basic layer may specifically include cloud network base, storage, network, and rendering engine, etc. The above functions of the virtual interaction system can all be implemented through specific software and hardware modules. The virtual interaction system may specifically include a service interface gateway, a service processing module, a protocol conversion module, an audio and video interaction module, a media transceiver module, a media processing module, a virtual digital human processing module, and a virtual space processing module, etc. Among them, the service interface gateway is used to realize the docking between the virtual interaction system and the interaction terminal or a third-party system. By encrypting and decrypting the signaling, parsing the call interface of the application layer, and converting it into the standard interface of the system platform, at the same time encapsulating the external interface of the system platform to shield the differences between the application layer and the system layer, facilitating the expansion of the system's capabilities. The service processing module is used to provide capabilities such as full-process service logic processing, data storage, analysis, and system management, such as information management of virtual spaces, management of interactive users, resource management, management of interaction relationships, management of the mapping relationship between interactive users and virtual characters, virtual space template management, and permission management of virtual spaces. The protocol conversion module is used to convert various different protocols in the client input information signaling into the protocol signaling supported by the platform, including network protocols, audio and video protocols, and transmission protocols, etc. At the same time, the processing result is re-encapsulated into an external protocol signaling and returned to the calling application layer. The audio and video interaction module is used to provide audio and video interaction operation capabilities, including functions such as subtitles, voice or video calls, comments, likes, sending messages, real-time two-way communication, and sharing, etc. At the same time, interactive users can use the functions of this module to invite intended interactive users to enter the virtual space for virtual interaction. The intended interactive users enter the virtual space through the sharing link authorized by the interactive users.The media transceiver module is used to provide the ability of low-latency real-time upload and distribution of audio and video to ensure the real-time low-latency immersive on-site experience of the system. The media processing ability provides capabilities such as audio and video encoding and decoding, video rendering, recording, and storage. It can also support the intelligent recognition of third-party videos to identify the interactive users and actions in the videos and synchronize them to the virtual character processing module. The virtual character processing module can generate virtual character information. If the virtual interaction is evolved based on the IPTV platform, the virtual character information needs to be synchronized to the IPTV platform. The virtual character processing module includes three main sub-modules: modeling, driving, and rendering. Among them, the modeling module constructs the basis of the virtual character image by scanning the photos uploaded by the user. The driving module is responsible for driving the actions and expression capture of the virtual character. The rendering module adjusts the appearance of the virtual character with precision through rendering technology and adapts the performance and effects of the environment where the virtual human is located. The virtual character processing module can also support the synchronization of the family member information identified by the audio and video processing module to drive the corresponding virtual character actions in the virtual space. The virtual space processing module is used to provide basic functions such as the generation and management of the virtual space and the information synchronization of virtual space objects. Specifically, it can include capabilities such as virtual space modeling, presentation, rendering, and synchronization. The virtual space can be specifically divided into a server side and a client side. Among them, the server side provides information synchronization capabilities, synchronization operations, and rendering within the space. The synchronization operations can specifically be character action information synchronization, audio and video data synchronization, and content information synchronization, etc. Among them, the client side is usually deployed in the interactive user terminal, such as a smart phone, a computer, or a smart set-top box. It is responsible for the local rendering and presentation of the space model and communicates with the server side. If the computing power configuration of the terminal is low, the rendering can be performed on the server side and sent to the terminal for presentation. The virtual space processing module can specifically use virtual space processing technology, and the virtual space processing technology can specifically be the metaverse technology. For example, in an implementable manner, assume that the virtual interaction scenario is a virtual interaction home scenario. Refer to, Figure 3 , Figure 3 is a schematic diagram of the interaction scenario representing the virtual interaction scenario. Among them, the virtual interaction system can be respectively communicatively connected to the home video monitoring platform, the interactive terminal, and the IPTV platform. The interactive terminal can specifically be a computer, a TV, or a mobile terminal, etc. The virtual interaction system is deployed with a service interface gateway, a service processing module, a protocol conversion module, an audio and video interaction module, a virtual space module, a media transceiver module, a media processing module, and a virtual character module, etc.

[0043] In addition, it should be noted that virtual interaction depends on the information interaction between the user and the virtual interaction system based on the target terminal. The target terminal is used to represent the terminal for virtual interaction through the virtual interaction system, and can specifically be a computer, TV, mobile terminal, etc. The application layer of the virtual interaction system is deployed on the target terminal side, and specifically may include the entrance of the virtual interaction system and the entrance of self-service operations. The user operating the target terminal can upload the user's personal photos through self-service to generate virtual characters, and set virtual character relationships and manage virtual spaces, etc. While the interface layer of the virtual interaction system is responsible for interactive user access, interactive user communication, and docking with third-party platforms, it can also be responsible for forwarding and processing user access requests, as well as adapting and transmitting third-party system messages. The business layer can also be responsible for the management of users, resources, spaces, policies, permissions, etc., and business logic processing. The capability layer can also provide capabilities such as audio and video capabilities, virtual space capabilities, rendering, low-latency two-way transmission and distribution, and storage and recording capabilities. The basic layer can provide basic platform capabilities such as the underlying cloud network platform, network, storage, and rendering engine. For different scenarios of applying the virtual interaction method, when implemented based on different platforms, the corresponding services are different. For example, if it is an application scenario based on the IPTV platform, the IPTV platform provides an operation entrance for users to enter the virtual interaction system. Except for the shared user information, the virtual interaction system and the IPTV platform capabilities are completely decoupled. When promoting virtual interaction services, corresponding services can also be opened in the form of value-added service packages. Among them, users accessing the virtual interaction system can be specifically divided into administrators and ordinary users (users performing virtual interaction). The administrator is responsible for system management and has the highest system permissions. The administrator can add, delete, modify, and query user information, home space information, and system resources on the business management platform. Ordinary users access through the client for daily operations. Among them, the administrator does not participate in daily login and operations. For example, in an implementable manner, if the user enters the virtual interaction system through the target terminal based on the IPTV system, it can be directly synchronized to the virtual interaction system by the IPTV platform without the need for additional account opening. In the virtual interaction system, there can be a role of a virtual character butler, and the virtual character butler can be configured by the administrator of the virtual interaction system in the background and can interact with users performing virtual interaction in the virtual space throughout the process.

[0044] Additionally, it should be noted that the virtual interaction request is used to request virtual interaction, which can be specifically triggered by a preset operation executed by the user on the target terminal, or can also be triggered periodically by the target terminal. For example, in an implementable manner, after the user logs in to the virtual interaction system on the target terminal, the virtual interaction request can be triggered by clicking the "enter" button. The virtual interaction system receives the virtual interaction request initiated by the user through the service interface gateway and forwards it to the virtual space processing module for forwarding the request. The virtual space processing module and the virtual character processing module then perform corresponding logical processing based on the user information. Among them, the user information is used to represent the identity of the user, which can specifically be the user ID or user number, etc. The virtual character information is used to identify the virtual character that the user wants to perform virtual interaction with, and the virtual space is used to identify the virtual space that the user wants to perform virtual interaction in. It can be understood that the virtual interaction system can pre-create a preset number of virtual characters and virtual spaces. When the user performs virtual interaction based on the target terminal, the user can complete the virtual interaction based on the existing virtual characters and virtual spaces, or can also actively create virtual characters and virtual spaces to complete the virtual interaction. For example, in an implementable manner, the virtual interaction system pre-stores the mapping relationship between the user ID and the virtual interaction information, and the corresponding virtual interaction information can be queried through the user ID. Among them, the virtual interaction information can include virtual character information, virtual space information, and object synchronization information in the space, etc.

[0045] Additionally, it should be noted that after the virtual interaction system queries or generates the virtual character information and virtual space information, the virtual interaction system will send the virtual character information and virtual space information to the target terminal together, so that the application layer of the virtual interaction system can select the target virtual character and virtual space through the virtual character information and virtual space information. Among them, the target virtual character is used to represent the virtual image of the user, and the virtual space is used to represent the space where the target virtual character is located, which can specifically be indoors, in a venue, or outdoors, etc. The embodiments of the present application do not specifically limit the specific morphological characteristics of the target virtual character, nor do they specifically limit the environment and area of the virtual space. The virtual interaction performed by the target virtual character in the virtual space can specifically be to have a conversation or interaction with other virtual characters in the virtual space, or can also be various behaviors in the virtual space. For example, in an implementable manner, assuming that the virtual interaction scenario is a virtual home interaction scenario, after determining the user's target virtual character and virtual space, the user can use the target virtual character, carrying information such as relative attributes and names, to enter the virtual home to perform virtual interaction with other virtual characters in the virtual home, so as to achieve virtual interaction between different members within the family.

[0046] As an example, steps S10 to S40 include: receiving, through a service interface gateway, a virtual interaction request carrying user information sent by a user terminal; querying, using the user information as an index, virtual character information and virtual space information in a preset information mapping table; jointly sending the virtual character information and the virtual space information to the target terminal, so that the target terminal selects a target virtual character from a preset virtual character library based on the virtual character information, and selects a virtual space from a preset virtual space library based on the virtual space information, where the preset virtual character library is used to store a preset number of virtual characters, and the preset virtual space library is used to store a preset number of virtual spaces; generating a virtual interaction instruction based on a preset operation performed by the user on the target terminal, and controlling, according to the virtual interaction instruction, the target virtual character to perform a virtual interaction with other virtual characters in the virtual space.

[0047] In an implementable manner, the virtual interaction method is applied to a virtual home interaction scenario. The user triggers a virtual interaction request at the application layer of the virtual interaction system. The virtual interaction system returns virtual character information and virtual space information to the target terminal according to the user information in the virtual interaction request. Thus, the user terminal renders and presents a virtual home space and a virtual character image, and the user can enter the virtual home space with attached information such as relatives and names and perform virtual interactions.

[0048] In this way, when performing a virtual interaction through the virtual interaction system in the embodiment of the present application, the user actively initiates a virtual interaction request through the target terminal. Then, the virtual interaction system determines virtual character information for selecting a target virtual character and virtual space information for selecting a virtual space for the user, and feeds them back to the target terminal for the target terminal to render and present the target virtual character and the virtual space at the application layer. Finally, the virtual interaction system controls the target virtual character to perform a virtual interaction in the virtual space. Since the target virtual character and the virtual space are generated depending on the user information of the target terminal, end-to-end information interaction between the virtual interaction system and the target terminal can be realized. The embodiment of the present application aims to bring a real immersive interaction experience through the virtual interaction of the target virtual character in the virtual space. At the same time, since the virtual interaction system directly controls the target virtual character to perform a virtual interaction in the virtual space and there is no physical part limitation on the virtual interaction of the virtual character due to virtual realism, the embodiment of the present application achieves the purpose of full-range simulation of the virtual interaction process. That is, it overcomes the technical defect that the virtual interaction between the two parties in the virtual space lacks realism due to the non-wearing of virtual reality wearable devices, resulting in a poor virtual interaction effect in this scenario, and thus reduces the interaction limitation of performing virtual interactions.

[0049] Among them, the step of controlling the target virtual character to perform a virtual interaction in the virtual space includes:

[0050] Step A10: Obtain the associated interaction request sent by the target terminal, where the associated interaction request includes associated user information;

[0051] Step A20: Send an interaction invitation request to the associated terminal corresponding to the associated user information, and receive the invitation result feedback by the associated terminal according to the interaction invitation request;

[0052] Step A30: After detecting that the invitation result is an invitation success result, send the user association information between the target terminal and the associated terminal to the associated terminal for the associated terminal to generate an associated virtual character carrying the user association information;

[0053] Step A40: Control the target virtual character and the associated virtual character to perform virtual interaction in the virtual space.

[0054] In this embodiment, it should be noted that during the process of a user performing virtual interaction in the virtual space through a target virtual character, in addition to being able to perform virtual interaction with existing virtual characters in the virtual space, the target virtual character can also specify users who do not have corresponding virtual characters in the virtual space to enter the virtual space to perform virtual interaction with it. For example, a user can invite relatives and friends to enter a virtual family, and the associated interaction request can trigger the virtual interaction between the user corresponding to the target virtual character and the associated user. Among them, the associated interaction request is used to trigger virtual interaction with the associated user, and the associated user refers to a user who has an association relationship with the user of the target terminal. The association relationship can specifically be a family relationship, a friendship relationship, or a colleague relationship, etc. The associated terminal is used to represent the operation terminal of the associated user, and can specifically be a mobile phone, a computer, or a personal PC, etc. The interaction invitation request is used to invite virtual interaction, and the invitation result includes an invitation success result and an invitation failure result. After the invitation result is an invitation success result, an associated virtual character is generated through the user association information, thereby controlling the virtual interaction between the associated virtual character and the target virtual character. After the invitation result is an invitation failure result, an invitation failure prompt message can be presented on the preset display interface of the target terminal for the user to know that the invitation has failed. Among them, the associated user information is used to represent the identity of the associated user, and can specifically be an associated user ID, and the associated virtual character is used to represent the virtual image of the associated user, and the user association information is used to represent the association relationship between users, and can specifically be colleagues, relatives, or friends, etc.

[0055] As an example, steps A10 to A40: receiving, through a service interface gateway, an associated interaction request carrying user associated information sent by a user terminal; generating, according to the user associated information, an interaction invitation request, sending the interaction invitation request to an associated terminal identified by the associated user information, and receiving an invitation result fed back by the associated terminal according to the interaction invitation request, wherein the invitation result is specifically triggered by a preset operation performed by an associated user on the associated terminal; identifying the invitation result, and after identifying that the invitation result is an invitation success result, sending the user associated information between the target terminal and the associated terminal to the associated terminal specified, for the associated terminal to generate an associated virtual character carrying the user associated information. For example, in an implementable manner, the word "friend" is marked above the head portrait of the virtual associated character; controlling the target virtual character and the associated virtual character to perform virtual interaction in the virtual space.

[0056] In an implementable manner, it is assumed that the virtual interaction method is applied to a virtual home interaction scenario. Referring to Figure 4 , Figure 4It is an execution sequence diagram for indicating the invitation to associated users for virtual interaction. User A is the user of the target terminal, and User B is the associated user. The modules participating in the execution process of the virtual interaction system may include a service interface gateway, a service processing module, and an audio-video interaction module. The three-terminal interaction process among the target terminal, the device where the virtual interaction system is located, and the associated terminal is as follows: After the user logs in successfully on the target terminal, through the self-service function of the client, the associated terminal can be used to create a list of relatives and friends for invitation into the home space; the user sends an associated interaction request to the virtual interaction system through the self-service module; after receiving the associated interaction request, the service interface gateway forwards it to the audio-video interaction module; the audio-video interaction module sends a confirmation authentication text message for the invitation to relatives and friends to the associated terminal; after receiving the text message, the associated user makes a confirmation and can reply whether to pass on the associated terminal. When the reply is to pass, the associated terminal sends an interaction invitation request. When the reply is not to pass, it returns to continue obtaining the associated interaction request or ends the process. The interaction module returns the invitation result to the service interface gateway, and the interface gateway returns it to the client; after receiving the confirmation result, the client sets the relative relationship attribute information (user association information) through self-service, that is, the user association information between the target terminal and the associated terminal is obtained. It can be understood that this user association information can also be set in advance; the client submits the user association information to the service processing module through the service interface gateway; the user sends a request to invite the associated user into the virtual space through the service interface gateway on the client. Among them, the request can carry the relative user account; the service interface gateway forwards the interaction invitation request to the audio-video interaction module; the audio-video interaction module sends a space link text message to the associated terminal and receives the result feedback by the associated user after receiving the space link text message. If the associated user clicks on the link, an invitation success result is generated, and the client is automatically opened and enters the virtual space. If no feedback from the associated terminal is received within the preset time period, an invitation failure result is generated. If the associated virtual task has not been generated at this time, the associated user obtains the relative relationship information in the virtual space through the service gateway interface; the service interface gateway queries the user association information of the associated user through the service processing module and returns the user association information to the user end of the associated terminal; finally, the associated user enters the virtual space with the associated virtual character carrying the user association information to realize the virtual interaction between the target virtual character and the associated virtual character. Among them, the character image of the associated virtual character can be either the default image or the custom image. If the user of the target terminal or the associated user wants to delete the user with an associated relationship based on their own terminal, the administrator can manually delete it in the background of the virtual interaction system. Any terminal that conducts virtual interaction with the virtual interaction system can freely change the virtual character image representing its own identity.

[0057] In this way, through the information interaction among the target terminal, the virtual interaction system, and the associated terminal in the embodiments of the present application, the target terminal initiates an associated interaction request. Taking the virtual interaction system as a medium, it invites the associated user of the associated terminal to enter the virtual space in the form of a virtual character, and is able to control the virtual interaction between the target virtual character and the associated virtual character. That is, when a user wants to perform a realistic interaction with a specified user, they can actively initiate an associated interaction request, thereby completing the generation of the associated virtual character corresponding to the associated user with the assistance of the virtual interaction system, and finally achieving the purpose of virtual interaction between the target virtual character and the associated virtual character under the control of the virtual interaction system. Since the target virtual character is not limited to virtual interaction with the existing virtual characters in the virtual space, but can independently complete virtual interaction with the specified user in the virtual space, the interaction limitations of virtual interaction are reduced while the interaction flexibility of virtual interaction is improved.

[0058] Among them, the step of controlling the virtual interaction between the target virtual character and the associated virtual character in the virtual space includes:

[0059] Step B10, obtaining virtual interaction operations performed by at least one virtual character in the virtual space;

[0060] Step B20, generating corresponding interaction synchronization information according to the virtual interaction operations;

[0061] Step B30, sending the interaction synchronization information to the user terminals controlling each of the virtual characters for each of the user terminals to perform virtual interaction synchronization according to the interaction synchronization information.

[0062] In this embodiment, it should be noted that, in order to improve the interaction experience of virtual interaction between the user of the target terminal and the virtual interaction user, the embodiments of the present application do not limit the virtual interaction behavior between the target virtual character and the virtual character. Among them, the virtual interaction user can specifically be the associated user or the user corresponding to the existing virtual character in the virtual space, etc. For example, in an implementable manner, after the user of the target terminal and the virtual interaction user enter the virtual space, they can use the capabilities of the virtual home space processing module to perform various interactions, entertainments, and companionships, etc. Among them, the capabilities of the virtual home space processing module can be implemented based on the metaverse technology. The virtual interaction operation is used to represent the virtual interaction behavior, which can specifically be walking, jumping, or talking, etc. Among them, the virtual interaction behavior is not limited to behavioral actions, but can also be operations such as sharing or sending messages. The interaction synchronization information is used to achieve the synchronization of virtual interaction behaviors between interaction terminals, and the interaction synchronization information can specifically be audio-video information or spatial object information, etc.

[0063] As an example, steps B10 to B30 include: obtaining the walking operation of the target virtual character in the virtual space; generating corresponding interaction synchronization information according to the walking operation, where the interaction synchronization information may specifically be the walking distance and walking frequency under the walking operation, etc.; and sending the interaction synchronization information to the user terminals that control the virtual characters in the virtual space respectively, so that each user terminal can perform virtual interaction synchronization according to the interaction synchronization information.

[0064] In an implementable manner, assume that the virtual interaction method is applied to a virtual home interaction scenario. Refer to Figure 5 , Figure 5 FIG. is a synchronous timing diagram showing virtual interaction synchronization of each interactive user in the virtual space. Among them, user C is the user of the target terminal, user D is the associated user, and the modules of the virtual interaction system participating in the execution process may include a service interface gateway, a service processing module, and an audio-video interaction module. The three-terminal interaction process among the target terminal, the device where the virtual interaction system is located, and the virtual interaction terminal is as follows: The user of the target terminal and the virtual user terminal log in successfully and enter the virtual space; the virtual characters corresponding to the target virtual character and the virtual user perform virtual interaction operations in the virtual space, including conversations, entertainment, walking, etc.; after the virtual space module processes and obtains the interaction synchronization information, it sends the interaction synchronization information to all online users in the virtual space, where the interaction synchronization information includes audio-video information, spatial object information, etc.; in addition to behavioral actions, virtual characters in the virtual space can also perform operations such as sharing or sending messages during virtual interaction synchronization.

[0065] In this way, when the virtual interaction system recognizes that a virtual character in the virtual space performs a virtual interaction operation, it generates interaction synchronization information based on the virtual interaction operation, and finally sends the interaction synchronization information to the user terminals of different virtual characters in the virtual space, so that the virtual interaction operations performed in the virtual space received by different user terminals are synchronized. Since any virtual interaction operation performed by a virtual character in the virtual space felt by different user terminals is synchronized, it can bring the same virtual interaction experience to the users of different user terminals at the same time step, that is, the purpose of different users synchronously immersing in the virtual interaction operation is achieved. Therefore, while reducing the interaction limitations of virtual interaction, the interaction synchronization of virtual interaction is improved.

[0066] Among them, the virtual interaction system is communicatively connected to the video capture terminal, and the video capture terminal is deployed in the real space. The virtual interaction method further includes:

[0067] Step C10, obtaining the behavior image of the user to be interacted captured by the video capture terminal in the real space, where the behavior image carries behavior information;

[0068] Step C20: According to the behavior image, match a preset virtual character for the user to be interacted with in a preset virtual character library.

[0069] Step C30: Authenticate the identity of the user to be interacted with according to the preset virtual character to obtain the identity information of the user to be interacted with.

[0070] Step C40: Process the preset virtual character according to the behavior information and the identity information to obtain a specified virtual character.

[0071] Step C50: Control the specified virtual character to enter the virtual space.

[0072] In this embodiment, it should be noted that in some virtual scenarios, the two users performing virtual interaction do not need to perform virtual interaction in real time, but need an immersive companionship experience. Therefore, corresponding video acquisition means can be introduced to collect the real-time action conditions of the users, and then perform real-time simulation in the virtual space to achieve immersive companionship. For example, in a virtual family interaction scenario, there is an automatic silent companionship requirement for the elderly and children, that is, to accompany at any time without disturbing the daily life of relatives and friends. By collecting the videos of family members and intelligently identifying relatives and friends, the virtual character is synchronously driven to accompany immersively at any time, so as to discover and notify in case of abnormal situations.

[0073] In addition, it should be noted that the video acquisition terminal is used to collect the real-time video of the user to be interacted with, which can specifically be a video monitoring system or an intelligent device with a camera. The user to be interacted with refers to the user waiting for silent virtual interaction. The preset virtual character refers to the virtual character image preset for the user to be interacted with. The behavior information is used to identify behavior actions, which can specifically be walking or squatting, etc. The identity information is used to identify the identity, which can specifically be the ID of the virtual character or the number of the virtual character, etc. The specified virtual character is used to represent the virtual character obtained through specified processing. After controlling the specified virtual character to enter the virtual space, the user of the target terminal can achieve the purpose of silently accompanying the user to be interacted with. The real space refers to the space in the real world, such as indoors or the space with a certain positional relationship with the user to be interacted with in the real world.

[0074] As an example, steps C10 to C40: Obtain the real-time video collected by the video monitoring system deployed by the video capture terminal in the real space, extract video frames from the real-time video to obtain the behavior image of the user to be interacted with, where the behavior image carries behavior information; extract behavior features from the behavior image, and use the behavior features as an index to query the preset virtual character corresponding to the user to be interacted with in a preset virtual character library; authenticate the identity of the user to be interacted with according to the ID of the preset virtual character to obtain the identity information of the user to be interacted with, where the identity relationship information between the user of the target terminal and the user to be interacted with can be represented by the identity information; identify the identity information above the preset virtual character, and drive the preset virtual character based on the behavior information to obtain a specified virtual character; control the specified virtual character to enter the virtual space.

[0075] In an implementable manner, assume that the virtual interaction method is applied to a virtual home interaction scenario. Refer to Figure 6 , Figure 6 FIG. is an execution timing diagram showing silent virtual interaction in a virtual space, where user E is the user of the target terminal, user F is the virtual interaction user, and the modules of the virtual interaction system participating in the execution process may include a service interface gateway, a service processing module, and an audio-video interaction module. The three-terminal interaction process among the target terminal, the device where the virtual interaction system is located, and the virtual interaction terminal is as follows: Collect family member images through a video monitoring system with intelligent video capture capabilities; The user of the target terminal successfully logs in to the virtual interaction system as a companion user, and the virtual character corresponding to the companion user is located in the virtual space; Upload the collected video to the video processing module automatically through the service interface gateway of the virtual interaction system; The video processing module stores the video and performs intelligent identification on the user to be interacted with in the video to match the identified user with a preset virtual character; The video processing module matches the identified character feature information with the feature information stored in the library, and obtains the virtual character ID of the user to be interacted with after successful matching; Upload the queried virtual digital human ID to the service processing module for relative identity authentication; The service processing module performs identity authentication, obtains relative identity information, and automatically completes the login, and returns the identity information of the user to be interacted with to the video processing module; The video processing module intelligently identifies the behavior information and identity information and uploads them to the virtual character processing module for real-time driving; The virtual character processing module identifies the real actions of the user to be interacted with in the real-time video and synchronously drives the corresponding virtual character in real time; Automatically invite the driven virtual character into the virtual space to accompany the user to be interacted with without disturbing the user to be interacted with; If the user of the target terminal has a virtual interaction requirement with the user to be interacted with, virtual interaction can be performed in real time through the audio-video interaction module.

[0076] In this way, through the video capture capability provided by the video capture terminal in the embodiments of the present application, the real-time behaviors of the user to be interacted with are first captured. Then, through the virtual interaction system, the preset virtual character is matched, the user to be interacted with is authenticated, and the specified rendering presentation process is performed to obtain the specified virtual character. Finally, the specified virtual character is controlled to enter the virtual space, so as to achieve the purpose that the user of the target terminal can immerse in the real-time behaviors of the user to be interacted with in the virtual space. At the same time, for the user to be interacted with, they will not be disturbed by the immersive company needs of the user of the target terminal. Therefore, the purpose of silent virtual interaction with the user to be interacted with is achieved. Since there is no need for the user to be interacted with to enter the virtual interaction system, that is, the user of the target terminal as the accompanying party enters the virtual interaction system, immersive virtual company can be carried out, thus expanding the application scenarios of virtual interaction. Therefore, the interaction limitations of virtual interaction are reduced.

[0077] Wherein, after the step of controlling the specified virtual character to enter the virtual space, the virtual interaction method further includes:

[0078] Step D10, obtaining the interaction voice of the user to be interacted with;

[0079] Step D20, inputting the interaction text obtained by converting the interaction voice into a preset text prediction model, and predicting the reply content of the interaction text through the preset text prediction model to obtain a prediction result of the reply content;

[0080] Step D30, controlling the preset virtual management character to perform virtual interaction with the specified virtual character according to the reply voice obtained by converting the prediction result of the reply content.

[0081] In this embodiment, it should be noted that in some interaction scenarios, the user to be interacted actively demands an immersive virtual interaction experience. However, the user of the target terminal does not have time for real-time virtual interaction. For example, assume that the user to be interacted is an elderly person. When the elderly person is at home alone, they need active company to reduce loneliness. However, the user of the target terminal cannot provide company in real time. Then, a third-party platform can be introduced to provide virtual interaction capabilities, that is, the virtual interaction system independently realizes virtual interaction with the user terminal of the user to be interacted. Among them, the third-party platform can specifically be AIGC, and the object providing virtual interaction capabilities can specifically be ChatGPT of AIGC. The interaction voice can be specifically collected by the voice collection module of the user terminal operated by the user to be interacted and then sent to the virtual interaction system. The interaction text can be specifically obtained by converting the interaction voice with a preset text conversion model. The preset text prediction model is used to predict the reply content matching the interaction text. The reply content prediction result can specifically be a reply text matching the interaction text. The reply voice can be obtained by converting the reply text based on a preset voice conversion model. Among them, the preset virtual management character can specifically be an administrator.

[0082] As an example, steps D10 to D30 include: receiving the interaction voice of the user to be interacted; converting the interaction text according to a preset text conversion model to obtain a reply text, inputting the reply text into a preset text prediction model to predict the reply content of the interaction text, and obtaining a reply content prediction result; controlling the preset virtual management character to perform virtual interaction with the specified virtual character according to the reply voice obtained by converting the reply content prediction result.

[0083] In an implementable manner, assume that the virtual interaction method is applied to a virtual home interaction scenario. Refer to Figure 7 , Figure 7To represent the execution timing diagram of autonomous virtual interaction in a virtual space, where user G is the user of the target terminal, user H is the virtual interaction user, and the modules of the virtual interaction system participating in the execution process may include a service interface gateway, a service processing module, and an audio-video interaction module. The three-terminal interaction process among the target terminal, the device where the virtual interaction system is located, and the virtual interaction terminal is as follows: The user to be interacted logs in and enters the virtual space; by collecting the household user and driving the virtual character to perform actions in the virtual space, the robot butler can automatically communicate with the virtual character, such as saying hello, etc.; the user to be interacted sends the interaction voice to the audio-video interaction module of the virtual interaction system through voice communication; the audio-video interaction module forwards the interaction voice to the service interface gateway; the service interface gateway forwards the voice text to AIGC; AIGC automatically generates a reply text based on the interaction voice and returns the reply text to the audio-video interaction module; the audio-video interaction module converts the dialogue text into a reply voice and binds it to the robot butler, and outputs the reply voice through the robot butler, so as to complete the voice dialogue communication with the specified virtual character. It can be understood that on the AIGC platform, some tags can be set in advance for different family members for AIGC intelligent learning, and through continuous daily learning and accumulation, the generated dialogue can be made more accurate and real, so as to achieve the effect of accompanying dialogue with real people.

[0084] In this way, through the virtual interaction ability provided by the third-party platform in the embodiment of the present application, after the user to be interacted outputs the interaction voice, a reply voice matching the interaction voice can be automatically predicted and generated, and the virtual interaction needs of the user to be interacted can be met through the reply voice. That is, the virtual interaction with the user terminal of the user to be interacted can be independently realized based on the virtual interaction system, thereby avoiding the technical defect that the immersive virtual interaction needs of the user to be interacted cannot be met in some specific virtual interaction scenarios. That is, the applicable scenarios of the virtual interaction method for the immersive virtual reality interaction experience are further broadened, so the interaction limitation of virtual interaction is further reduced.

[0085] Wherein, the user information includes user identity information and user construction information, and the step of determining virtual character information and virtual space information according to the user information includes:

[0086] Step E10, query the pre-stored virtual character information and pre-stored virtual space information that match according to the user identity information;

[0087] Step E20, in the case of querying the pre-stored virtual character information and pre-stored virtual space information that match, use the pre-stored virtual character information as the virtual character information, and use the pre-stored virtual space information as the virtual space information;

[0088] Step E30, in the case where no matching pre-stored virtual character information and pre-stored virtual space information are queried, construct the virtual character information and the virtual space information respectively according to the user construction information.

[0089] In this embodiment, it should be noted that in the process of determining the virtual character information and the virtual space information, the virtual interaction system does not necessarily pre-store the virtual character information and the virtual space information that meet the user's virtual interaction requirements. That is, the user of the target terminal may need to open up a new virtual interaction space to perform virtual interactions different from the past, or may also need to perform the same virtual interactions as in the past. Therefore, the virtual character information and the virtual space information can be obtained based on different methods. Among them, the pre-stored virtual character information is used to represent the pre-stored virtual characters that meet the user's virtual interaction requirements, and the pre-stored virtual space information is used to represent the pre-stored virtual characters that meet the user's virtual interaction requirements. The query process can rely on the pre-established mapping relationship. The user identity information is used to represent the user's identity, which can specifically be the virtual character ID. The user construction information is used to construct virtual objects, and the virtual objects can specifically be virtual characters or virtual spaces, etc.

[0090] As an example, steps E10 and E30 include: using the user identity information as an index, querying the matching pre-stored virtual character information and pre-stored virtual space information respectively; in the case where the matching pre-stored virtual character information and pre-stored virtual space information are queried, using the pre-stored virtual character information as the virtual character information and using the pre-stored virtual space information as the virtual space information; in the case where no matching pre-stored virtual character information and pre-stored virtual space information are queried, construct the virtual character information and the virtual space information respectively according to the user construction information.

[0091] Among them, the user construction information includes a user image and a user instruction. The step of constructing the virtual character information and the virtual space information respectively according to the user construction information includes:

[0092] Step F10, extract features from the user image to obtain user body features;

[0093] Step F20, input the user body features into a preset virtual character generation model, and generate a virtual character through the preset virtual character generation model to obtain a default virtual character;

[0094] Step F30, construct the virtual character information for the default virtual character;

[0095] Step F40: Send the default template meta-information indicated by the user instruction to the target terminal, so that the target terminal sends a virtual space generation request to the virtual interaction system according to the default template meta-information;

[0096] Step F50: In response to the virtual space generation request, select a default virtual space template from a preset virtual space template library, and use the template information of the default virtual space template as the virtual space information.

[0097] In this embodiment, it should be noted that in the process of constructing virtual character information and virtual space information, it can be implemented depending on different user construction information. Among them, the user image is used to provide user body features, and the user body features can specifically be facial features or hand features, etc. The user instruction is used to indicate the selection of template meta-information, and the template meta-information is used to represent the elements that make up the virtual space template. The virtual space generation request is used to trigger the generation of a virtual space.

[0098] As an example, steps F10 to F50 include: extracting features from a specific area of the user image to obtain user facial features; inputting the user facial features into a preset virtual character generation model, and generating a default virtual character through the preset virtual character generation model; using the virtual character ID of the default virtual character as the virtual character information; sending the template meta-information indicated by the user instruction to the target terminal, so that the target terminal sends a virtual space generation request to the virtual interaction system according to the default template meta-information; in response to the virtual space generation request, select a default virtual space template from a preset virtual space template library, and use the template information of the default virtual space template as the virtual space information.

[0099] In an implementable manner, assume that the virtual interaction method is applied to a virtual home interaction scenario. Refer to Figure 8 , Figure 8Execution timing diagram generated for representing virtual characters and virtual spaces. Among them, User I is the client, and User H is the virtual interaction system. The modules of the client participating in the execution process include the terminal and the user self-service module. The modules of the virtual interaction system participating in the execution process may include the service interface gateway, the virtual character generation module, the service processing module, and the virtual space management module. The two-way interaction process between the client and the device where the virtual interaction system is located is as follows: 1) Generation process of virtual characters: The user of the target terminal logs in successfully on the target terminal; the user selects user self-service at the client self-service entrance; the user selects the virtual character generation function through the target terminal; the user uploads a photo to the service interface gateway through the self-service module; the service interface gateway uploads the photo to the virtual character generation module; the virtual character processing module generates a virtual character based on the photo and saves it. At the same time, it saves the feature information of the real person and returns the virtual character ID to the service interface gateway and the user client; the service interface gateway sends a mapping relationship request of the virtual character ID and the account to the service processing module; the service processing module saves the mapping relationship between the user account and the virtual character; 2) Generation process of virtual spaces: The system administrator uses the virtual space management module in the system management background to create a preset number of default space templates in advance; the user logs in and authenticates successfully on the target terminal; the user selects user self-service at the client self-service entrance; the user selects the function of selecting the home space template; the self-service module sends a space template selection request to the service interface gateway; the service interface gateway obtains the home space template metadata information from the virtual space management module. The virtual space management module returns the default template metadata information to the service interface gateway, and the service interface gateway returns it to the self-service module, and the self-service template returns it to the target terminal; the target terminal obtains the space template information from the virtual space management module according to the default template metadata information; after receiving the space template information, the target terminal renders and presents it through the virtual space client deployed on the target terminal for the user to select; the user selects a space template and uploads the space template ID to the self-service module; the self-service module synchronizes the space template ID to the service interface module; the service interface module forwards the synchronization message to the service processing module; the service processing module generates an association relationship between the space template ID and the user account and saves it in the user information; synchronizes the mapping relationship to the home digital space management module; the home digital space management module generates a space save mapping relationship.

[0100] In this way, in the process of determining virtual character information and virtual space information based on user information, if the virtual interaction system has pre-stored pre-stored virtual character information and pre-stored virtual space information, the virtual character information and virtual space information that meet the user's virtual interaction needs can be directly queried. If the virtual interaction system has not pre-stored virtual character information and virtual space information, virtual character information can be constructed based on the user image and virtual space information can be constructed based on the user instruction. That is, the determination of virtual character information and virtual space information for the user of the target terminal when facing different virtual interaction needs is satisfied. Furthermore, when the user conducts a virtual interaction experience based on the virtual interaction system, it is not necessary to solely rely on the existing virtual character information and virtual space information in the virtual interaction system to generate the target virtual character and virtual space. Therefore, it lays a foundation for reducing the interaction limitations in virtual interaction.

[0101] Further, referring to Figure 9 , in the second embodiment of the present application, for the same or similar content as in the above embodiment, reference can be made to the above introduction and will not be elaborated hereinafter. Before the step of obtaining the virtual interaction request sent by the target terminal, the virtual interaction method further includes:

[0102] Step G10, obtaining a login request sent by the target terminal, where the login request carries a login key;

[0103] After the key verification of the login key passes, extract the user identity information in the login key, and perform identity authentication on the target terminal according to the user identity information;

[0104] Step G20, after the identity authentication passes, generate an authentication identifier for the target terminal;

[0105] Step G30, generate a communication key according to the authentication identifier and the virtual object identity information of the target terminal;

[0106] Step G40, send the communication key to the target terminal for the target terminal to decrypt the communication key to obtain the virtual object identity information, where the virtual object identity information is used to represent the identity of the virtual object with virtual interaction permission of the target terminal.

[0107] In this embodiment, it should be noted that, to ensure the information security of virtual interaction by the user based on the virtual interaction system, a key mechanism can be established between the client and the server. For example, before the user of the target terminal realizes virtual interaction, the login authentication of the virtual interaction system needs to be completed, that is, the identity encryption authentication is performed during the login process. After the encryption authentication passes, it can be ensured that the subsequent virtual interaction process is always executed in a secure environment. The authentication identifier is used to identify the identity of the target terminal, which can specifically be a string. The virtual object identity information is used for the identity of the virtual object for which the target terminal has virtual interaction permissions, and specifically can include the user name, user virtual character ID, kinship identity information of the user in different virtual spaces, and the virtual space ID of the permissions owned by the user, etc.

[0108] As an example, steps G10 to G40 include: obtaining the login request sent by the target terminal, where the login request carries a login key, and the login key can specifically be an encrypted string generated by the user ID + timestamp + agreed decryption static token. The token is generated when the user registers to ensure the uniqueness of each user; performing key verification on the login key. After the key verification passes, extracting the user identity information in the login key and performing identity authentication on the target terminal according to the user identity information. The process of key verification can specifically be decrypting using the agreed key mechanism and verifying the token, and only after the verification is correct can the identity authentication be performed; after the identity authentication passes, generating an authentication identifier for the target terminal, where the authentication identifier can specifically be a dynamically generated usertoken; packaging the authentication identifier and the virtual object identity information of the target terminal together as a communication key; sending the communication key to the target terminal for the target terminal to obtain the virtual object identity information by decrypting the communication key, where the virtual object identity information is used to represent the identity of the virtual object for which the target terminal has virtual interaction permissions.

[0109] In this way, when the user logs in to the virtual interaction system based on the target terminal, first performs key verification through the pre-established key mechanism, and after the key verification passes, performs identity authentication on the target terminal. After the identity authentication passes, completes the transmission of the virtual object identity information based on the communication key, and thus can achieve the purpose of ensuring the information security of the user's virtual interaction, laying a foundation for reducing the interaction limitations of virtual interaction.

[0110] Among them, before the step of obtaining the login request sent by the target terminal, the virtual interaction method further includes:

[0111] Step H10, sending request authentication information to the target terminal according to the registration request sent by the target terminal;

[0112] Step H20: Receive the requested authentication result feedback by the target terminal according to the registration authentication information;

[0113] Step H30: After detecting that the requested authentication result is a requested authentication passed result, perform registration authentication processing on the target terminal to obtain a registration authentication result;

[0114] Step H40: Store the registration authentication result and send it to the target terminal.

[0115] In this embodiment, it should be noted that in order to facilitate users to directly log in to the virtual interaction system, a new registration function can be added to the virtual interaction system. The registration request is used to complete user identity registration. The requested authentication information is used to represent the identity of the terminal for registration, which can specifically be a mobile phone number or a registration number, etc. The requested authentication result is used to represent whether the authentication of the registration request passes, which can specifically be a requested authentication passed result or a requested authentication failed result. The authentication processing can specifically be the processing of binding or registration information for registration, etc. The registration authentication result is used to represent the user's registration information. While storing the user's registration information, a user token will also be generated, and the virtual interaction system will send the registration authentication result and the token to the target terminal together.

[0116] As an example, steps H10 to H40: Obtain the registration request sent by the target terminal, and according to the registration request, send requested authentication information to the target terminal; receive the requested authentication result feedback by the target terminal according to the registration authentication information; detect the requested authentication result, and after detecting that the requested authentication result is a requested authentication passed result, perform registration authentication processing on the target terminal; store the registration authentication result and send it to the target terminal.

[0117] In an implementable manner, assume that the virtual interaction method is applied to a virtual home interaction scenario. Refer to Figure 10 , Figure 10To represent the execution sequence diagram of user registration and login to the virtual interaction system. Among them, the execution process specifically involves three parties: the terminal, the IPTV platform, and the virtual interaction system. The modules of the virtual interaction system participating in the execution process may include the service interface gateway, the service processing module, and the virtual space processing module. The two-way interaction processes among the target terminal, the device where the virtual interaction system is located, and the IPTV platform are as follows: 1) The execution process of user registration for the virtual interaction system is as follows: The user opens the client, selects the registration function, fills in the registration account (usually a mobile phone number), sends a verification code, and after successful verification, sends a registration request to the service interface gateway; the service interface gateway forwards the registration request to the service platform; the service platform performs user registration processing, stores the user registration information, generates the user's token, and returns the registration result to the client; 2) The execution process of user login to the virtual interaction system is as follows: The system administrator completes the initialization settings of the system, sets the key generation rules, allocates the default home digital space template and system resources, etc. in the service background; the user opens the client and enters the account to log in when opening the virtual interaction system client; the user enters the user account in the client to log in. The user account can specifically be the mobile phone number during user registration, and a login authentication request is sent to the service interface gateway; after receiving the authentication message, the service interface gateway forwards it to the service processing module; the service processing module performs authentication and authorization processing on the user, first conducts key verification and then identity authentication. After passing, it generates a user token, and at the same time, the information returned to the client includes the user's basic information, that is, the virtual object identity information.

[0118] In this way, through the information interaction between the target terminal and the virtual interaction system, the virtual interaction system completes the request authentication of the target terminal based on the registration and authentication information, and finally stores and sends the registration and authentication results to the target terminal, so that the virtual interaction system completes the authentication of the target terminal, thus laying a foundation for the user to log in to the virtual interaction system.

[0119] An embodiment of the present application provides a method for logging in to a virtual interaction system. That is, obtain a login request sent by the target terminal, where the login request carries a login key; after the key verification of the login key passes, extract the user identity information in the login key, and perform identity authentication on the target terminal according to the user identity information; after the identity authentication passes, generate an authentication identifier for the target terminal; generate a communication key according to the authentication identifier and the virtual object identity information of the target terminal; send the communication key to the target terminal for the target terminal to decrypt the communication key to obtain the virtual object identity information, where the virtual object identity information is used to represent the identity of the virtual object with virtual interaction permissions of the target terminal. Since key verification is first performed when logging in to the virtual interaction system, and after the key verification passes, identity authentication is performed on the target terminal, and after the identity authentication passes, the transmission of the virtual object identity information is completed based on the communication key, the purpose of ensuring the information security of user virtual interaction can be achieved. Therefore, it lays a foundation for reducing the interaction limitations of virtual interaction.

[0120] To achieve the above object, referring to Figure 11 , the present application further provides a virtual interaction device, which is applied to a virtual interaction system, and the virtual interaction system is communicatively connected to a target terminal. The virtual interaction device includes:

[0121] An acquisition module 101, configured to acquire a virtual interaction request sent by the target terminal, where the virtual interaction request carries user information;

[0122] A determination module 102, configured to determine virtual character information and virtual space information according to the user information;

[0123] A sending module 103, configured to jointly send the virtual character information and the virtual space information to the target terminal for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information;

[0124] A control module 104, configured to control the target virtual character to perform virtual interaction in the virtual space.

[0125] Optionally, the control module 104 is further configured to:

[0126] Acquire an associated interaction request sent by the target terminal, where the associated interaction request includes associated user information;

[0127] Send an interaction invitation request to an associated terminal corresponding to the associated user information, and receive an invitation result fed back by the associated terminal according to the interaction invitation request;

[0128] After detecting that the invitation result is an invitation success result, send the user association information between the target terminal and the associated terminal to the associated terminal, so that the associated terminal can generate an associated virtual character carrying the user association information;

[0129] Control the target virtual character and the associated virtual character to perform virtual interaction in the virtual space.

[0130] Optionally, the control module 104 is further configured to:

[0131] Obtain virtual interaction operations performed by at least one virtual character in the virtual space;

[0132] Generate corresponding interaction synchronization information according to the virtual interaction operations;

[0133] Send the interaction synchronization information to the user terminals controlling the respective virtual characters, so that each user terminal can perform virtual interaction synchronization according to the interaction synchronization information.

[0134] Optionally, the virtual interaction system is communicatively connected to a video acquisition terminal, the video acquisition terminal is deployed in the real space, and the virtual interaction device is further configured to:

[0135] Obtain the behavior image of the user to be interacted collected by the video acquisition terminal in the real space, where the behavior image carries behavior information;

[0136] Match a preset virtual character for the user to be interacted in a preset virtual character library according to the behavior image;

[0137] Authenticate the identity of the user to be interacted according to the preset virtual character to obtain the identity information of the user to be interacted;

[0138] Process the preset virtual character according to the behavior information and the identity information to obtain a specified virtual character;

[0139] Control the specified virtual character to enter the virtual space.

[0140] Optionally, the virtual interaction device is further configured to:

[0141] Obtain the interaction voice of the user to be interacted;

[0142] Input the interaction text obtained by converting the interaction voice into a preset text prediction model, and predict the reply content of the interaction text through the preset text prediction model to obtain a reply content prediction result;

[0143] Controlling the reply voice obtained by converting the prediction result according to the reply content of the preset virtual management character to perform virtual interaction with the specified virtual character.

[0144] Optionally, the user information includes user identity information and user construction information, and the determining module 102 is further configured to:

[0145] Query the pre-stored virtual character information and pre-stored virtual space information that match according to the user identity information;

[0146] In the case of querying the pre-stored virtual character information and pre-stored virtual space information that match, using the pre-stored virtual character information as the virtual character information and using the pre-stored virtual space information as the virtual space information;

[0147] In the case of not querying the pre-stored virtual character information and pre-stored virtual space information that match, constructing the virtual character information and the virtual space information respectively according to the user construction information.

[0148] Optionally, the user construction information includes a user image and a user instruction, and the determining module 102 is further configured to:

[0149] Extract features from the user image to obtain user body features;

[0150] Input the user body features into a preset virtual character generation model, and generate a default virtual character through the preset virtual character generation model;

[0151] Construct the virtual character information for the default virtual character;

[0152] Send the default template meta-information indicated by the user instruction to the target terminal, so that the target terminal sends a virtual space generation request to the virtual interaction system according to the default template meta-information;

[0153] In response to the virtual space generation request, select a default virtual space template in a preset virtual space template library, and use the template information of the default virtual space template as the virtual space information.

[0154] Optionally, the virtual interaction device is further configured to:

[0155] Obtain a login request sent by the target terminal, where the login request carries a login key;

[0156] After the key check of the login key passes, extract the user identity information in the login key, and perform identity authentication on the target terminal according to the user identity information;

[0157] After the identity authentication is passed, generate an authentication identifier for the target terminal;

[0158] Generate a communication key according to the authentication identifier and the virtual object identity information of the target terminal;

[0159] Send the communication key to the target terminal for the target terminal to obtain the virtual object identity information by decrypting the communication key, where the virtual object identity information is used to represent the identity of the virtual object with which the target terminal has virtual interaction permissions.

[0160] Optionally, the virtual interaction device is further configured to:

[0161] Send request authentication information to the target terminal according to the registration request sent by the target terminal;

[0162] Receive the request authentication result fed back by the target terminal according to the registration authentication information;

[0163] After detecting that the request authentication result is a request authentication passed result, perform registration authentication processing on the target terminal to obtain a registration authentication result;

[0164] Store and send the registration authentication result to the target terminal.

[0165] The virtual interaction device provided in this application adopts the virtual interaction method in the above embodiment, and solves the technical problem of high interaction limitations in virtual interaction. Compared with the prior art, the beneficial effects of the virtual interaction device provided in the embodiment of this application are the same as those of the virtual interaction method provided in the above embodiment, and other technical features in this virtual interaction device are the same as those disclosed in the method of the above embodiment, and will not be elaborated here.

[0166] An embodiment of this application provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the virtual interaction method in the first embodiment above.

[0167] Refer to the following Figure 12 , which shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 12The electronic device shown is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0168] As Figure 12 shown, the electronic device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. In the RAM 1004, various programs and data required for the operation of the electronic device are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus.

[0169] Generally, the following systems may be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device may allow the electronic device to communicate with other devices wirelessly or wirelesly to exchange data. Although the figure shows an electronic device having various systems, it should be understood that it is not required to implement or include all the shown systems. More or fewer systems may be alternatively implemented or included.

[0170] Specifically, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 1009, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above functions defined in the methods of the embodiments of the present disclosure are executed.

[0171] The electronic device provided in this application adopts the virtual interaction method in the above embodiments, and solves the technical problem of high interaction limitations in virtual interaction. Compared with the prior art, the beneficial effects of the electronic device provided in the embodiments of this application are the same as those of the virtual interaction method provided in the above embodiments, and other technical features in this electronic device are the same as those disclosed in the above embodiment methods, which will not be elaborated here.

[0172] It should be understood that various parts of the present disclosure can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0173] As described above, the above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0174] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the virtual interaction method in the first embodiment above.

[0175] The computer-readable storage medium provided by the embodiments of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems, or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program, and this program can be used by or combined with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0176] The above computer-readable storage medium may be included in an electronic device; or it may exist separately without being assembled into the electronic device.

[0177] The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed by an electronic device, the electronic device is caused to: obtain a virtual interaction request sent by the target terminal, where the virtual interaction request carries user information; determine virtual character information and virtual space information according to the user information; send the virtual character information and the virtual space information to the target terminal together for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information; and control the target virtual character to perform virtual interaction in the virtual space.

[0178] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, execute as a stand-alone software package, execute partially on the user's computer and partially on a remote computer, or execute entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0179] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0180] The modules described in the embodiments of the present disclosure may be implemented in software or in hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.

[0181] The computer-readable storage medium provided by the present application stores computer-readable program instructions for performing the above virtual interaction method, solving the technical problem of high interaction limitations in virtual interaction. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiments of the present application are the same as those of the virtual interaction method provided by the above embodiments, and will not be elaborated here.

[0182] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be similarly included within the patent scope of the present application.

Claims

1. A virtual interaction method, characterized in that, it is applied to a virtual interaction system, the virtual interaction system is communicatively connected to a target terminal, and the virtual interaction method includes: Obtaining a virtual interaction request sent by the target terminal, wherein the virtual interaction request carries user information; Determining virtual character information and virtual space information according to the user information; Sending the virtual character information and the virtual space information to the target terminal together for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information; Controlling the target virtual character to perform virtual interaction in the virtual space.

2. The virtual interaction method according to claim 1, characterized in that, the step of controlling the target virtual character to perform virtual interaction in the virtual space includes: Obtaining an associated interaction request sent by the target terminal, wherein the associated interaction request includes associated user information; Sending an interaction invitation request to an associated terminal corresponding to the associated user information, and receiving an invitation result feedback by the associated terminal according to the interaction invitation request; After detecting that the invitation result is an invitation success result, sending user association information between the target terminal and the associated terminal to the associated terminal for the associated terminal to generate an associated virtual character carrying the user association information; Controlling the target virtual character and the associated virtual character to perform virtual interaction in the virtual space.

3. The virtual interaction method according to claim 2, characterized in that, the step of controlling the target virtual character and the associated virtual character to perform virtual interaction in the virtual space includes: Obtaining virtual interaction operations performed by at least one virtual character in the virtual space; Generating corresponding interaction synchronization information according to the virtual interaction operations; Sending the interaction synchronization information to user terminals controlling each of the virtual characters for each of the user terminals to perform virtual interaction synchronization according to the interaction synchronization information.

4. The virtual interaction method according to claim 1, characterized in that, the virtual interaction system is communicatively connected to a video capture terminal, the video capture terminal is deployed in the real space, and the virtual interaction method further includes: Obtaining a behavior image of a user to be interacted captured by the video capture terminal in the real space, wherein the behavior image carries behavior information; Matching a preset virtual character for the user to be interacted in a preset virtual character library according to the behavior image; Performing identity authentication on the user to be interacted according to the preset virtual character to obtain identity information of the user to be interacted; Processing the preset virtual character according to the behavior information and the identity information to obtain a specified virtual character; Controlling the specified virtual character to enter the virtual space.

5. The virtual interaction method according to claim 4, characterized in that, after the step of controlling the specified virtual character to enter the virtual space, the virtual interaction method further includes: Obtaining the interaction voice of the user to be interacted; Input the interactive text obtained by converting the interactive voice into a preset text prediction model, and predict the response content of the interactive text through the preset text prediction model to obtain a response content prediction result; Control the preset virtual management character to perform virtual interaction with the specified virtual character according to the response voice converted from the response content prediction result.

6. The virtual interaction method according to claim 1, wherein, the user information includes user identity information and user construction information, the step of determining virtual character information and virtual space information according to the user information includes: Query the pre-stored virtual character information and pre-stored virtual space information that match according to the user identity information; In the case where the pre-stored virtual character information and pre-stored virtual space information that match are found, use the pre-stored virtual character information as the virtual character information and the pre-stored virtual space information as the virtual space information; In the case where no pre-stored virtual character information and pre-stored virtual space information that match are found, construct the virtual character information and the virtual space information respectively according to the user construction information.

7. The virtual interaction method according to claim 6, wherein, the user construction information includes a user image and a user instruction, the step of constructing the virtual character information and the virtual space information respectively according to the user construction information includes: Extract features from the user image to obtain user body features; Input the user body features into a preset virtual character generation model, and generate a default virtual character through the preset virtual character generation model; Construct the virtual character information for the default virtual character; Send the default template meta-information indicated by the user instruction to the target terminal, so that the target terminal sends a virtual space generation request to the virtual interaction system according to the default template meta-information; In response to the virtual space generation request, select a default virtual space template from a preset virtual space template library, and use the template information of the default virtual space template as the virtual space information.

8. The virtual interaction method according to claim 1, wherein, Before the step of obtaining the virtual interaction request sent by the target terminal, the virtual interaction method further includes: Obtain a login request sent by the target terminal, where the login request carries a login key; After the key check of the login key passes, extract the user identity information in the login key, and authenticate the target terminal according to the user identity information; After the identity authentication passes, generate an authentication identifier for the target terminal; Generate a communication key according to the authentication identifier and the virtual object identity information of the target terminal; Send the communication key to the target terminal, so that the target terminal decrypts the communication key to obtain the virtual object identity information, where the virtual object identity information is used to represent the identity of the virtual object with virtual interaction permission of the target terminal.

9. The virtual interaction method according to claim 8, wherein, Before the step of obtaining the login request sent by the target terminal, the virtual interaction method further includes: Sending request authentication information to the target terminal according to the registration request sent by the target terminal; Receiving the request authentication result fed back by the target terminal according to the registration authentication information; After detecting that the request authentication result is a request authentication passed result, performing registration authentication processing on the target terminal to obtain a registration authentication result; Storing the registration authentication result and sending it to the target terminal.

10. A virtual interaction device Characterized in that Applied to a virtual interaction system, the virtual interaction system is communicatively connected to a target terminal, and the virtual interaction device includes: An acquisition module, configured to acquire a virtual interaction request sent by the target terminal, wherein the virtual interaction request carries user information; A determination module, configured to determine virtual character information and virtual space information according to the user information; A sending module, configured to jointly send the virtual character information and the virtual space information to the target terminal for the target terminal to respectively select a target virtual character corresponding to the virtual character information and a virtual space corresponding to the virtual space information; A control module, configured to control the target virtual character to perform virtual interaction in the virtual space.

11. An electronic device Characterized in that The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the steps of the virtual interaction method according to any one of claims 1 to 9.

12. A computer-readable storage medium Characterized in that A program for implementing the virtual interaction method is stored on the computer-readable storage medium, and the program for implementing the virtual interaction method is executed by a processor to implement the steps of the virtual interaction method according to any one of claims 1 to 9.

Images