Interaction method and device, electronic equipment, storage medium and product

Abstract

The invention provides an interaction method and device, electronic equipment, a storage medium and a product, and the method comprises the steps: obtaining a target virtual role in response to a triggering event for a target object, and enabling the target virtual role to be associated with a target user; the target object is displayed, the target object comprises an object area and a role area, and the role area comprises the target virtual role and / or auxiliary information attached to the target virtual role, the auxiliary information is generated based on at least one of content and / or operation indicated by the object area, the target user and the target virtual character. The method can improve the interaction efficiency, thereby improving the user interaction operation experience.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and specifically to an interactive method, device, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] Current application software, such as social software, content platforms, etc., can use pop-up windows to guide user operations.

[0003] However, the pop-up window style is single. For example, the existing pop-up window is only a rectangular frame or a bubble frame, which greatly limits the pop-up window function, affects the user's interactive operation experience, and leads to relatively low interaction efficiency. Summary of the invention

[0004] The embodiments of the present application provide an interactive method, device, electronic device, computer-readable storage medium, and computer program product, which are intended to improve interaction efficiency and thereby enhance user interaction operation experience.

[0005] In a first aspect, an embodiment of the present application provides an interactive method, comprising:

[0006] In response to a trigger event for a target object, obtaining a target virtual character, wherein the target virtual character is associated with a target user;

[0007] The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0008] In a second aspect, an embodiment of the present application further provides an interactive method, comprising:

[0009] Displaying a target interactive interface, wherein the target interactive interface includes a digital map;

[0010] In response to a trigger event for a target object in the digital map, a target virtual character is acquired, wherein the target virtual character is associated with a target user, wherein the target object includes a target pop-up window or a target floating layer;

[0011] The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0012] In a third aspect, an embodiment of the present application provides an interactive device, including:

[0013] An acquisition module, configured to acquire a target virtual character in response to a trigger event for a target object, wherein the target virtual character is associated with a target user;

[0014] A display module is used to display the target object, wherein the target object includes an object area and a character area, the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0015] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned interactive method.

[0016] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned interactive method.

[0017] Beneficial effects of the embodiments of the present application:

[0018] In this embodiment, the terminal device displays at least one target object, and the user can operate the at least one target object to generate a corresponding trigger event. The terminal device can respond to the trigger event of the target object and obtain the target virtual character, which can be a character associated with the terminal device user. After responding to the trigger event of the target object and obtaining the target virtual character, the terminal device can display the adjacent object area and character area corresponding to the target object. Therefore, compared with the interactive method of only displaying a pop-up window in the prior art, in this embodiment, in addition to using the object area to display the content corresponding to the target object, the character area adjacent to the object area can also be displayed, and the character area is used to display the virtual character of the target user and / or the auxiliary information attached to the virtual character, so as to achieve customized and personalized display for each user, so that the user can interact through the interactive content in the object area and the virtual character in the character area, which enhances the interactive fun, improves the interactive efficiency, and greatly improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 It is a schematic diagram of the process provided in the embodiments of the present application;

[0021] Figure 2 is a schematic diagram of a target interaction interface provided in an embodiment of the present application;

[0022] Figure 3 This is a schematic diagram of pet adoption in the target area provided in the embodiments of the present application;

[0023] Figure 4-1 is a schematic diagram of a pet photo taken in the object area provided in an embodiment of the present application;

[0024] Figure 4-2 is a schematic diagram of a group photo image provided in an embodiment of the present application;

[0025] Figure 5 is a schematic diagram of a target floating layer provided in an embodiment of the present application;

[0026] Figure 6 This is a schematic diagram of entering a live broadcast room in an object area provided in an embodiment of the present application;

[0027] Figure 7 is a schematic diagram of coupons in the object area provided in the embodiment of the present application;

[0028] Figure 8 This is a schematic diagram of the product details interface provided in the embodiment of the present application;

[0029] Fig. 9 is a schematic diagram of a store in the target area provided in an embodiment of the present application;

[0030] Fig.10 is a schematic diagram of the structure of an interactive device provided in an embodiment of the present application;

[0031] Fig.11 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application. In addition, it should be understood that the specific implementation methods described herein are only used to illustrate and explain the present application, and are not used to limit the present application. In the present application, unless otherwise specified, the directional words such as "upper" and "lower" used generally refer to the upper and lower parts of the device in actual use or working state, specifically the drawing direction in the drawings; while "inside" and "outside" refer to the outline of the device. At the same time, in the description of the embodiments of the present application, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0033] It can be understood that, in the present application, each embodiment of the above-mentioned interactive method can be executed by a terminal device, wherein the terminal device can be a terminal held by a user or other network devices such as a server.

[0034] In this application, according to the above background technology description, current application software, such as social software, content platforms, etc., can use pop-up windows to guide user operations. However, the pop-up window style is single, for example, the existing pop-up window is only a rectangular frame or a bubble frame, etc., resulting in only being able to use the display area of ​​the pop-up window to display interactive content to the user or display the prompt information sent by the platform to the user, etc., which greatly limits the pop-up window function, affects the interaction efficiency, and also affects the user interaction experience.

[0035] Because, in order to solve the above-mentioned technical problems, the present application proposes an interactive method, device, electronic device and computer-readable storage medium, aiming to realize customized display of pop-up windows.

[0036] Specifically, the interactive method in this application, such as Figure 1 As shown, the specific steps include:

[0037] S10, in response to a triggering event for a target object, obtaining a target virtual character, wherein the target virtual character is associated with a target user;

[0038] It should be noted that, in this embodiment, the target object may include pop-up windows, floating layers, comment boxes, and information prompt interfaces, etc., which are used to guide user operations and / or interact with users to meet users' various needs such as food, clothing, housing, transportation, and entertainment.

[0039] The target interaction interface in this embodiment is as follows Figure 2 As shown, the target interaction interface of the terminal device can display a map view, and at least one interactive object can be displayed in the digital map of the map view, such as "Dig", "Photo", etc. The user can operate the above interactive object, such as clicking or long pressing the above interactive object, and generate a corresponding trigger event. It is understandable that in addition to the above Figure 2 The target interaction interface shown, any interface generated and displayed during the interaction process of this embodiment can be used as the target interaction interface.

[0040] Furthermore, after obtaining the trigger event for the target object, the terminal device can respond to the trigger event and obtain the target virtual character.

[0041] It should be noted that, in this embodiment, the target virtual character can be a virtual character (ie, a virtual object) associated with the target user. For example, the target virtual character can be a virtual portrait character of the target user, or can be a pet of the target user (such as an electronic pet owned by the user).

[0042] For example, Figure 3 The target interaction interface shown displays multiple pets to be adopted. The user can select a pet through the interface, and the terminal device can use the pet selected by the user as the target virtual character and bind the pet to the user's account information.

[0043] S20, displaying a target object, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and wherein the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the virtual character.

[0044] In this embodiment, after responding to a triggering event for a target object and acquiring a target virtual character, the terminal device may display an object area and a character area corresponding to the target object.

[0045] It should be noted that, in this embodiment, the object area and the character area may be in the same interface, and the interface may cover part of the above target interaction interface. Figure 2 As shown in , if the target object is a pop-up window of "Pet Photo", then, Figure 4-1 As shown, the object area in this embodiment can be Figure 4-1The area displayed in the pop-up window shown in the figure may include interactive content corresponding to the target object, such as the image of the virtual character, the background environment of the virtual character, and the text description of the virtual character, etc. The area above the pop-up window is the character area, in which the target virtual character (such as Figure 4-1 The rabbit character shown in the figure) and auxiliary information about the character, such as "I want to take a photo!".

[0046] The auxiliary information in this embodiment can be generated based on at least one of the content and / or operation indicated by the object area, the target user, and the virtual character. For example, the terminal device can generate auxiliary information of the target virtual character based on at least one of the content and / or operation indicated by the object area, the user information and location information of the target user, and the character information of the target virtual character (such as animal type, cartoon character type, etc.), and the display style of the auxiliary information can be plain text, emoticons, images, or animations, etc., without limitation.

[0047] Among them, for the content and / or operation indicated by the above object area, if the target object is Figure 4-1 As shown in the figure, the content indicated by the object area is a pet photo, including virtual characters of other users with whom the target user interacts. The operation indicated by the object area may include "take a photo", so that the target user can operate the control "take a photo" as shown in the figure to take a photo with the target virtual character of the target user and the virtual characters of other users, and the display is as follows: Figure 4-2 Group photo image shown.

[0048] In one embodiment, the target object includes one or more of a pop-up window, a floating layer, a comment box, and an information prompt interface.

[0049] In this embodiment, the interactive object may be a pop-up window (such as Figure 4-1 As shown), floating layer (as Figure 5 as shown), comment box or message prompt box, etc.

[0050] Therefore, in this embodiment, the terminal device displays at least one target object, and the user can operate the at least one target object to generate a corresponding trigger event. The terminal device can respond to the trigger event of the target object and obtain the target virtual character, which can be a character associated with the terminal device user. After responding to the trigger event of the target object and obtaining the target virtual character, the terminal device can display the adjacent object area and character area corresponding to the target object. Therefore, compared with the interactive method of only displaying a pop-up window in the prior art, in this embodiment, in addition to using the object area to display the content corresponding to the target object, the character area adjacent to the object area can also be displayed, and the character area is used to display the virtual character of the target user and / or the auxiliary information attached to the virtual character, so as to realize the customized and personalized display of the object area for each user, so that the user can interact through the interactive content in the object area and the virtual character in the character area, which enhances the interactive fun, improves the interactive efficiency, and greatly improves the user experience.

[0051] In one embodiment, the character area further displays a visual element corresponding to the operation / content indicated by the object area, and / or the object area further displays an operation control including the visual element.

[0052] It should be noted that, in this embodiment, the visual element can be understood as an image mark corresponding to the operation / content indicated by the object area, for example, Figure 5 The target object shown, at this time the target object can be a floating layer, covering part of the target interaction interface.

[0053] The object area of ​​the target object can display interactive content, such as business information, user reviews, etc., and the character area can display the target virtual character (such as "puppy") and corresponding auxiliary information (such as "leave a wish here"). In addition, the character area can also display visual elements. For example, if the operation / content indicated by the object area is a temple, the visual element at this time can be an image logo representing "praying", such as a "lucky bag" image. This embodiment does not specifically limit the distance between the visual element and the target virtual character, and ensures that the visual element and the target virtual character present an integrated display effect. For example, Figure 5 The visual element shown may be located at the mouth of the target virtual character “Puppy”.

[0054] On this basis, in addition to displaying interactive content related to the triggering event, the object area can also display an operation control containing the above visual elements, so that the user can operate the operation control, for example Figure 5As shown, if the operation control is "leave a message and pray", the user can click the operation control to generate the corresponding operation. The terminal device can respond to the operation triggered by the user and display the message interface (not shown in the figure), so that the user can leave a message and pray on the message interface.

[0055] The interactive method in this embodiment may further include:

[0056] S30, obtaining a visual type corresponding to the operation / content indicated by the object area;

[0057] S40, searching for at least one visual element associated with the element type from a preset element library;

[0058] S50, if there is an associated visual element in the preset element library, setting the associated visual element as the visual element corresponding to the operation / content indicated by the object area;

[0059] S60, if there is no associated visual element in the preset element library, extract the object feature parameters of the operation / content indicated by the object area, and perform element rendering according to the object feature parameters to obtain the visual element corresponding to the operation / content indicated by the object area.

[0060] It should be noted that, in this embodiment, according to the above-mentioned embodiment, different types of trigger events will result in different displayed target objects. Figure 5 The target object shown is temple-related content, and the displayed visual element can be a "lucky bag" image logo. Figure 5 The target object shown is the coffee shop related content, and the displayed visual element may be a "coffee cup" image logo. At this time, the object area also displays an operation control "Buy a cup of coffee!" including the visual element, so that the user can click the operation control to jump to the coffee purchase interface.

[0061] Therefore, it can be understood that different operations / contents indicated by the object area correspond to different visual types. The terminal device can first obtain the element type corresponding to the operation / content indicated by the object area, and then query at least one visual element associated with the element type from the preset element library.

[0062] If there is an associated visual element in the preset element library, the terminal device can directly set the associated visual element as the visual element corresponding to the operation / content indicated by the object area; if there is no associated visual element in the preset element library, the terminal device can first extract the object feature parameters of the operation / content indicated by the object area, and then perform element rendering according to the object feature parameters to obtain the visual element corresponding to the operation / content indicated by the object area, wherein the object feature parameters may include keywords of the operation / content indicated by the object area, such as "Chenghuang Temple", etc.

[0063] In one embodiment, the distance between the character area and the object area is within a first preset range, and the first preset range indicates that the target virtual character and the interaction area are in an adjacent state.

[0064] The distance between the character area and the object area is within a second preset range, and the second preset range indicates the area range of the overlapping area between the target virtual character and the interaction area.

[0065] In this embodiment, the distance between the character area and the object area of ​​the target object is within a first preset range, and the first preset range is used to indicate that the target virtual character and the object area are in an adjacent state. It can be understood that the adjacent state in this embodiment can be that the target virtual character and the object area are in a close or close state.

[0066] For example, Figure 4-1 As shown, in the character area, a pet rabbit of the target user is displayed, and the pet rabbit can be located above the object area and close to the object area. Figure 4-1 The character area shown is displayed closely above the object area. The character area can also be displayed closely at other positions of the object area, such as below or to the side of the object area.

[0067] In addition, in the present embodiment, the distance between the character area and the object area of ​​the target object may also be within a second preset range, and the second preset range may be used to indicate the area range of the overlapping area between the target virtual character and the object area. If the distance between the character area and the object area is within the second preset range, the character area and the object area may present an overlapping display effect, and the overlapping area between the character area and the object area may be determined based on the above-mentioned second preset range, such as partial overlap between the two, or the character area is completely within the object area.

[0068] In one embodiment, before the step S20 of “displaying the target object”, the following steps may also be performed:

[0069] S70, acquiring interactive feature information corresponding to the target virtual character according to at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character;

[0070] S80, performing feature splicing on the interactive feature information to obtain an interactive dialogue text;

[0071] S90, inputting the interactive dialogue text into a preset language prediction model to obtain output auxiliary information of the target virtual character, wherein the language prediction model is obtained by training based at least on a character portrait of the target virtual character.

[0072] S100, receiving a feedback operation on the auxiliary information;

[0073] S110, based on the feedback operation, modifying the neural network weight value of the language prediction model.

[0074] In this embodiment, the terminal device can extract the interactive feature information corresponding to the target virtual character based on at least one of the content and / or operation indicated by the object area, the user information of the target user (such as user ID, user location information, etc.), and the target virtual character (such as the role type and role name of the character), and the above-mentioned interactive feature information includes but is not limited to the interactive operation type, the user information of the target user, the location information of the target virtual character, and the role parameters of the target virtual character.

[0075] Among them, according to the above description, if the target object is Figure 4-1 As shown, the content indicated by the above object area may include virtual characters of other users with whom the target user interacts. Correspondingly, the operation indicated by the object area may include "take a photo together", so that the target user can perform operations such as Figure 4-1 The control “Go to Group Photo” shown is used to take a group photo of the target virtual character of the target user and the virtual characters of other users.

[0076] Furthermore, the terminal device may perform feature splicing on the above-mentioned multiple interactive feature information to obtain interactive dialogue text, and input the interactive dialogue text into the pre-trained language prediction model to obtain auxiliary information of the target virtual character output by the language prediction model, for example, Figure 4-1 The auxiliary information shows "This is what dogs in Shenyang look like, I want to take a photo with them!".

[0077] It can be understood that, in this embodiment, the above-mentioned language prediction model can be trained based on at least the character portrait of the target virtual character. In addition, the initial language prediction model can also be trained in combination with user portraits of multiple users and object feature parameters corresponding to the target object (such as keywords of the target object, etc.).

[0078] In some embodiments, the auxiliary information may also be obtained by the following steps:

[0079] (1) obtaining interaction information between the target user and the target virtual character, wherein, according to the above description, the target virtual character is a virtual character that has a preset association relationship with the target user (such as a virtual character bound to the user account information of the target user); the interaction information may be various actions and conversation interaction information with the target virtual character in various scenarios;

[0080] (2) Obtain user profiles of target users;

[0081] (3) based on the above interaction information, obtaining at least part of the target memory from the historical memory of the target virtual character, where the historical memory may include short-term memory and / or event memory, where the short-term memory may include historical conversations between the target user and the target virtual character, and the event memory may be extracted from the historical conversations between the target user and the target virtual character;

[0082] (4) based on the above interaction information, user portrait, target memory, and interactive dialogue text obtained according to at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character, construct prompt information and input it into the above language prediction model corresponding to the target virtual character, wherein the language prediction model is trained based on at least the character portrait of the target virtual character; and the character portrait includes the character appearance attributes, the character personality, the character conversation method, and the world setting of the character target virtual scene;

[0083] (5) Generate auxiliary text attached to the target virtual character based on the above prompt information through a language prediction model.

[0084] Furthermore, according to the above description, the terminal device can display an object area and a character area containing the target virtual character and auxiliary information attached to the target virtual character. On this basis, in order to ensure that the auxiliary information of the target virtual character can first interact accurately with the user, an evaluation control for the auxiliary information can also be displayed, such as "satisfied", "unsatisfied" and "generally satisfied", so that the user can operate the evaluation control to trigger the corresponding feedback operation.

[0085] The terminal device can respond to the above feedback operation to obtain the model's prediction score for the auxiliary information, wherein the above evaluation controls may include: "satisfied", "unsatisfied" and "generally satisfied" controls, and the corresponding prediction scores are not the same. When the user triggers the "satisfied" control, the terminal device obtains the highest auxiliary information prediction score, the "unsatisfied" control corresponds to the lowest auxiliary information prediction score, and the "generally satisfied" control corresponds to an auxiliary information prediction score in between the two.

[0086] Furthermore, the terminal device can use the auxiliary information prediction score to correct the neural network weights of the language model so that the auxiliary information prediction score output by the corrected language prediction model is greater than a preset score threshold.

[0087] Through the above method, this embodiment can continuously optimize the language prediction model so that the auxiliary information of the target virtual character output by the language prediction model can be associated with the content and / or operation indicated by the object area, guide user operations, accurately predict user needs, and improve user interaction experience.

[0088] In one embodiment, the interactive method in this embodiment may further include:

[0089] S120, responding to a triggering operation on the target virtual character, identifying an operation type of the triggering operation;

[0090] S130, inputting the type identifier of the operation type into a character animation model to obtain an output character animation, and dynamically displaying the target virtual character according to the character animation, wherein the character animation model is obtained based on a plurality of pairs of operation types and corresponding character animation training.

[0091] In this embodiment, the user can operate the target virtual character, such as clicking a preset position of the target virtual character, such as the head position or the back position, to generate a corresponding trigger operation.

[0092] The terminal device can respond to the above trigger operation, identify the operation type of the trigger operation, and input the type identifier of the operation type into a pre-trained character animation model, and use the character animation model to generate a character animation corresponding to the type identifier, and then dynamically display the target virtual character according to the character animation.

[0093] For example, if the user clicks on the back of the target virtual character, the target virtual character can dynamically display a rolling animation.

[0094] In addition, in this embodiment, character interaction controls, such as "touch" and "pat" controls, can be displayed in adjacent positions of the target virtual character. Users can also click on the character interaction controls to generate corresponding trigger operations. For example, if the user clicks on the character interaction control "touch", the target virtual character can display an animation of the target virtual character wagging its tail.

[0095] In one embodiment, in the above S20, “displaying the object area and the character area corresponding to the target object” may include:

[0096] S201, displaying an object area of ​​the target object, and acquiring area size information and position information of the object area;

[0097] S202, determining the first preset range according to the area size information and the position information;

[0098] S203: Display the character area according to the first preset range and a preset orientation relative to the object area.

[0099] In this embodiment, the object area may be displayed in a pop-up window, and the pop-up window may be located at an upper layer of the target interactive interface, such as Figure 4-1 As shown, after the pop-up window is displayed, the target interactive interface at the lower layer can be displayed in a weakened manner. In addition, the object area can also be displayed in a floating layer manner.

[0100] Furthermore, the terminal device can obtain the area size information and position information of the object area, such as the size information such as the length and width of the area, and the position information of the edge of the object area.

[0101] On this basis, the first preset range can be determined according to the above region size information and position information, so that when the character region is displayed according to the first preset range, the character region is adjacent to or partially overlaps with the object region. Furthermore, the character region can be displayed according to the preset orientation of the first preset range relative to the region.

[0102] The above preset orientation can be understood as the orientation of the character area relative to the object area, for example Figure 4-1 As shown, the character area can be located directly above, to the upper left, etc. of the object area.

[0103] Similarly, in this embodiment, auxiliary information can also be displayed according to the second preset range and the preset position relative to the character area, for example, Figure 4-1 As shown, the auxiliary information is displayed at an adjacent position above the character area, or the auxiliary information can also be displayed adjacent to other preset positions of the character area, for example, adjacent to the upper left position of the character area.

[0104] In the above S10, “acquiring a target virtual character in response to a triggering event for a target object” may include:

[0105] S101, in response to a triggering event for the target object, identifying user account information of the target user;

[0106] S102, obtaining role parameters of a target virtual role bound to the user account information;

[0107] S103, performing image rendering according to the character parameters to obtain a target virtual character of a target user.

[0108] It should be noted that, in this embodiment, according to the above description, the target virtual character can be a character associated with the terminal device user, for example, the target virtual character can be a virtual portrait character of the target user, or can be a pet of the target user (an electronic pet owned by the user). Figure 3 The target interaction interface shown displays multiple pets to be adopted. The user can select a pet through the interface, and the terminal device can use the pet selected by the user as the target virtual character and bind the pet to the user's account information.

[0109] Therefore, in this embodiment, after the user triggers the target object in the target interactive interface and generates a corresponding trigger event, the terminal device can respond to the trigger event and identify the user account information of the target user, which can include the user ID of the target user, etc. The user ID is a unique identifier assigned by the terminal device to each user. Then, the role parameters of the target virtual character bound to the user account information, such as the role identity and the role image parameters, can be obtained, and the image can be rendered according to the role parameters to obtain the target virtual character of the target user.

[0110] After the above S101, “in response to a triggering event for the target object, identifying the user account information of the target user”, the following may also be included:

[0111] S104, if the user account information is not bound to the target virtual character, obtaining the role parameters of the preset default virtual character to perform image rendering to obtain the target virtual character of the target user;

[0112] S105, if the user account information is bound to multiple target virtual characters, then according to the creation time of the target virtual characters, the character parameters of the latest target virtual character are obtained for image rendering to obtain the target virtual character of the target user.

[0113] It is worth noting that in this embodiment, if the user account information is not bound to any target virtual character, the terminal device can jump to the following Figure 3 The target interaction interface through which the user can adopt a pet, and the terminal device can bind the pet adopted by the user to the user account information. In addition, when no target virtual character is bound under the user account information, the terminal device can also directly obtain the role parameters of the default virtual character for rendering, and set the rendered virtual character as the target virtual character. On this basis, if the user can change the above default virtual character, the target object for pet adoption in the target interaction interface can be triggered. Figure 3 Adopt a pet in the interface shown, and change the target virtual character after successful adoption.

[0114] In addition, if the user account information is bound to multiple target virtual characters, the character parameters of the latest target virtual character can be obtained according to the creation time of the target virtual character to perform image rendering and obtain the target virtual character of the target user.

[0115] Therefore, in general, this embodiment does not make specific limitations on the distance between the target virtual character and the object area, and the distance between the target virtual character and the auxiliary information, so that the target virtual character can be adjacent to or partially overlap with the object area, and the target virtual character can be adjacent to or partially overlap with the auxiliary information. The target virtual character, the auxiliary information, and the object area present an overall state. When interacting with the user through the object area, the character animation of the target virtual character can be customized to enhance the interest of the interaction. The interactive content in the object area can also be used to display auxiliary information to guide user operations and improve interaction efficiency.

[0116] In one embodiment, after the above S20, “displaying the target object”, the following may also be included:

[0117] S140, in response to a triggering operation on a live broadcast control in the object area, displaying a live broadcast room interface, wherein the live broadcast room interface includes a live broadcast screen, a host virtual character display area, and an audience virtual character display area;

[0118] S150: Displaying the host virtual character via the host virtual character display area, and displaying at least one audience virtual character in the live broadcast room via the audience virtual character display area.

[0119] S160, responding to the interactive event in the live broadcast room, displaying the character animation of the anchor virtual character and the character animation of the audience virtual character.

[0120] In this embodiment, according to the above description, the user can trigger the interactive object in the target interactive interface to generate a corresponding trigger event, and the terminal device can respond to the trigger event to display the object area, character area and auxiliary information corresponding to the target.

[0121] It is understandable that in this embodiment, there are multiple types of interactive objects, and the generated interactive events are also different, for example, Figure 2 The interactive object shown is "Dig", and the user can click or long press the interactive object, and the terminal device can respond to the user's trigger event, perform exploration operations, and display exploration results. The exploration results may include target objects such as live broadcasts, stores, coupons, and pet photos.

[0122] This embodiment takes the discovery of the live broadcast room as an example. Figure 6As shown, the interactive content in the object area displayed at this time may be the cover of the live broadcast room and the live broadcast control "Watch Now", and the user may click on the live broadcast control "Watch Now" to generate a corresponding trigger operation.

[0123] The terminal device can respond to the above trigger operation and display the live broadcast room interface, wherein the live broadcast room interface at least includes the live broadcast screen, the anchor virtual character display area and the audience virtual character display area.

[0124] Among them, the anchor virtual character display area can be used to display the anchor virtual character, and the audience virtual character display area can be used to display at least one audience virtual character in the live broadcast room.

[0125] It can be understood that only the target user's audience virtual character can be displayed in the audience virtual character display area, or, in addition to displaying the target user's audience virtual character, the present embodiment can also display the audience virtual characters of several viewers with greater live broadcast contributions in the audience virtual character display area according to the audience's live broadcast contribution (or audience activity), wherein the audience virtual character display area can be located at a corresponding position of the live broadcast room interface that does not block the live broadcast content, and the host virtual character display area can be located near the host, with a distance from the host in the live broadcast room interface less than a preset distance, and the preset distance can be flexibly adjusted according to the size of the live broadcast room interface, so that the host and the host virtual character are in an adjacent associated state.

[0126] It can be understood that live broadcast room events can include events triggered by the host and / or audience during the live broadcast process, such as when the host starts broadcasting, the audience enters the live broadcast room, the audience likes or comments on the host, etc., all of which can trigger corresponding live broadcast room events. In this embodiment, they can also be automatically triggered by the terminal device, such as reminders of user violations in the live broadcast room.

[0127] On this basis, the terminal device can respond to the above-mentioned live broadcast room events and display the character animation of the anchor's virtual character and the character animation of the audience's virtual character.

[0128] For example, the terminal device can render the character animation of the host's virtual character and the character animation of the audience's virtual character according to the above-mentioned live broadcast room events, so that the character animation of the host's virtual character and the character animation of the audience's virtual character can be dynamically adjusted. For example, when the audience enters the live broadcast room for the first time, the character animation of the host's virtual character can be a greeting to the audience's virtual character.

[0129] In the above S160, “responding to the live broadcast room interactive event, displaying the character animation of the anchor virtual character and the character animation of the audience virtual character” may include:

[0130] Step a, responding to the live broadcast entry event, obtaining character feature information and live broadcast information of the audience virtual character entering the live broadcast room;

[0131] Step b, generating prompt information for entering the live broadcast room according to the character feature information and the live broadcast information;

[0132] Step c, setting the live broadcast entry prompt information as auxiliary information of the anchor virtual character;

[0133] Step d: render the character animation of the anchor virtual character according to the auxiliary information, display the auxiliary information and the rendered character animation of the anchor virtual character adjacent to each other, and display the character feature information and the character animation of the audience virtual character adjacent to each other.

[0134] It should be noted that, in this embodiment, according to the above description, live broadcast room events may include events triggered by the host and / or audience during the live broadcast process, such as when the host starts broadcasting, the audience enters the live broadcast room, the audience likes or comments on the host, etc., all of which can trigger corresponding live broadcast room events. In this embodiment, they can also be automatically triggered by the terminal device, such as reminders of user violations in the live broadcast room.

[0135] When the live broadcast room event in this embodiment is specifically a live broadcast entry event, the live broadcast room entry event is an event triggered when a user enters the live broadcast room. For example, a live broadcast room entry event can be generated after the user enters the live broadcast room by clicking the above-mentioned live broadcast control "Watch Now".

[0136] The terminal device can respond to the live broadcast room entry event and obtain the role characteristic information of the audience virtual character entering the live broadcast room. The role characteristic information may include the name and location information of the audience virtual character. Furthermore, a prompt message for entering the live broadcast room can be generated based on the above role characteristic information, such as "Welcome someone from Guangdong to my live broadcast room". In addition, the live broadcast information of the live broadcast room can also be obtained, such as the product information and live broadcast duration of the normal live broadcast in the live broadcast room.

[0137] On this basis, the terminal device can generate prompt information for entering the live broadcast room based on the above-mentioned character feature information and live broadcast information, and set the prompt information as auxiliary information of the host's virtual character, so that the audience entering the live broadcast room can obtain information about the goods sold in the live broadcast room through the auxiliary information of the host's virtual character.

[0138] Furthermore, the terminal device can use the above auxiliary information to render the character animation of the anchor's virtual character, so that the character animation can make speaking expressions and movements.

[0139] On this basis, the terminal device can display the auxiliary information and the character animation rendered by the anchor virtual character adjacent to each other, and display the character feature information and the character animation of the audience virtual character adjacent to each other. It can be understood that the adjacent display in this embodiment represents that the distance between the two is less than the preset distance threshold, so that the display effect of the two is a whole.

[0140] In the above S160, “responding to the live broadcast room interactive event, displaying the character animation of the anchor virtual character and the character animation of the audience virtual character” may also include:

[0141] Step e, displaying a live comment box via the live broadcast room interface;

[0142] Step f, responding to a live comment event in the live comment box in the live room interface to obtain a live context;

[0143] Step g, generating auxiliary information of the host virtual character and auxiliary information of the audience virtual character of the current audience according to the host comments and audience comments in the live comment context;

[0144] Step h, rendering the character animation of the anchor virtual character according to the auxiliary information of the anchor virtual character, and rendering the character animation of the audience virtual character according to the auxiliary information of the audience virtual character;

[0145] Step i: displaying the auxiliary information of the anchor virtual character adjacent to the character animation rendered by the anchor virtual character, and displaying the auxiliary information of the audience virtual character adjacent to the character animation rendered by the audience virtual character.

[0146] According to the above description, live broadcast room events may include events triggered by the host and / or audience during the live broadcast process, such as when the host starts broadcasting, the audience enters the live broadcast room, the audience likes or comments on the host, etc., all of which can trigger corresponding live broadcast room events. In this embodiment, they can also be automatically triggered by the terminal device, such as reminders of user violations in the live broadcast room.

[0147] When the live broadcast room event in this embodiment is specifically a live broadcast comment event, the live broadcast comment event is an event triggered when a user enters the live broadcast room and makes a comment in the live broadcast room.

[0148] For example, after the audience enters the live broadcast room interface, the live broadcast room interface displays a live broadcast comment box. For example, the live broadcast comment box can be displayed in the lower left corner of the live broadcast room interface.

[0149] At this time, the user can enter a comment in the live comment box to generate a live comment event.

[0150] The terminal device can respond to the above live comment event and obtain the live comment context of the current audience interacting with the anchor in the live broadcast room. The live comment context includes the conversation information between the current audience and the anchor in the live broadcast room, including text information and / or image information.

[0151] Furthermore, the terminal device can extract the host's comments and audience's comments in the context of live commentary, generate auxiliary information of the host's virtual character based on the host's comments, and generate auxiliary information of the target user's virtual character based on the audience's comments, and can display the auxiliary information of the host's virtual character adjacent to the character animation rendered by the host's virtual character, and can display the auxiliary information of the audience's virtual character adjacent to the character animation rendered by the audience's virtual character.

[0152] Similarly, according to the above description, it can be understood that the adjacent display representations in this embodiment mean that the distance between the two is less than a preset distance threshold, so that the display effects of the two are a whole.

[0153] After the above S20, “displaying the target object”, the following may also be included:

[0154] Step A, in response to a triggering operation on a first commodity control in the object area, displaying a commodity activity information interface, wherein the commodity activity information interface displays a target virtual character of a target user and auxiliary information of the target virtual character adjacent to the character animation, wherein the auxiliary information is generated based on the commodity activity information;

[0155] Step B, responding to a commodity transaction operation on a commodity transaction control in the commodity activity information interface, and acquiring commodity transaction information;

[0156] Step C: rendering the character animation of the target virtual character according to the commodity transaction information, and updating the auxiliary information of the target virtual character.

[0157] According to the above description, the user can trigger the interactive object in the target interactive interface to generate a corresponding trigger event, and the terminal device can respond to the trigger event to display the object area, character area and auxiliary information of the target object. In this embodiment, there are multiple types of interactive objects, and the generated interactive events are also different, such as Figure 2 The interactive object shown is "Dig", and the user can click or long press the interactive object, and the terminal device can respond to the user's trigger event, perform the exploration operation, and display the exploration results, which may include live broadcasts, stores, coupons, pet photos, etc.

[0158] This embodiment takes the discovery of coupons as an example. Figure 7As shown, the object area in this embodiment displays the store graphic information corresponding to the voucher, and also displays the first product control and the second product control, for example, Figure 7 As shown, the first product control may be “Go to the store to have a look”, and the second product control may be “View coupons”.

[0159] On this basis, the user can operate the first commodity control to generate a corresponding trigger operation.

[0160] The terminal device can respond to the above operation and display a product activity information interface, wherein the product activity information interface displays the target virtual character of the target user. In addition, this embodiment can also display auxiliary information of the target virtual character. At this time, the auxiliary information can be generated based on the product activity information. The auxiliary information can be used to introduce the product activity information to the user and assist the user in making product purchase decisions.

[0161] Furthermore, the user can click on the commodity transaction control in the commodity activity information interface to purchase or add the commodity to the shopping cart, triggering the corresponding commodity transaction operation.

[0162] The terminal device can respond to the above-mentioned commodity transaction operation and obtain commodity transaction information. The commodity transaction information can include detailed information of the purchased commodity, the actual payment amount, etc., and then can render the character animation of the target virtual character based on the commodity transaction information, so that the character animation can display the expression and / or action of a successful purchase, etc., and can also update the auxiliary information of the target virtual character based on the commodity transaction information, so that the auxiliary information can display commodity transaction information such as detailed information of the purchased commodity and the actual payment amount.

[0163] After the above S20, “displaying the target object”, the following may also be included:

[0164] Step D, in response to a triggering operation on a second product control in the object area, displaying a product details interface, wherein the product details interface includes a digital map and a product details information floating layer, and a central area of ​​the digital map highlights a target product corresponding to the product details information;

[0165] Step E: in response to a triggering operation on a product collection control in the product detail information floating layer, displaying a character animation of a target virtual character of a target user via a control display area of ​​the product collection control.

[0166] It should be noted that, in this embodiment, according to the above description, if Figure 6 As shown, the object area in this embodiment displays the store graphic information corresponding to the voucher, and also displays the first product control and the second product control, for example, Figure 6 As shown, the second product control may be "View Coupon".

[0167] On this basis, the user can operate the second product control to generate a corresponding trigger operation.

[0168] The terminal device can respond to the above trigger operation and display the following Figure 8 The product details interface shown may include a digital map and a product details information floating layer, and the central area of ​​the digital map highlights the target product corresponding to the product details information.

[0169] On this basis, the user can click on the product collection control in the floating layer of the product details information and generate a corresponding trigger operation.

[0170] The terminal device can respond to the above trigger operation, render and display the character animation of the target virtual character of the target user in the control display area of ​​the product collection control, so that the character animation can display the actions and expressions of successful collection.

[0171] In addition, Fig. 9 As shown, this embodiment takes exploring a store as an example, and the object area in this embodiment displays the store's graphic information and also displays the first product control "Go to the store to have a look".

[0172] On this basis, the user can operate the first commodity control to generate a corresponding trigger operation.

[0173] The terminal device can respond to the above operation and display a commodity activity information interface, wherein the target virtual character of the target user is displayed on the commodity activity information interface. In addition, the present embodiment can also display auxiliary information of the target virtual character. At this time, the auxiliary information can be generated based on the commodity activity information, and the auxiliary information can be used to introduce the commodity activity information to the user and assist the user in making commodity purchase decisions. Furthermore, the user can click on the commodity transaction control in the commodity activity information interface to purchase or add the commodity to the shopping cart, triggering the corresponding commodity transaction operation. The terminal device can respond to the above commodity transaction operation and obtain commodity transaction information, which can include detailed information of the purchased commodity, actual payment amount, etc., and then can render the character animation of the target virtual character based on the commodity transaction information, so that the character animation can display the expression and / or action of successful purchase, etc., and can also update the auxiliary information of the target virtual character based on the commodity transaction information, so that the auxiliary information can display commodity transaction information such as detailed information of the purchased commodity and actual payment amount.

[0174] In another embodiment, according to the above description, this embodiment takes the discovery of pet photos as an example. Figure 4-1As shown, the interactive content in the object area may include virtual characters, which may include the target virtual character of the target user, and may also include virtual characters of other users with whom the target user interacts, etc. The object area may also include a group photo control "Go to Group Photo", and the user may operate the group photo control to generate a corresponding group photo operation. The customer may respond to the above group photo operation to take a group photo of the pet, and the group photo image will be displayed on the group photo interface.

[0175] Therefore, in this embodiment, the user can trigger the target object in the target interaction interface and generate a corresponding trigger event, and the terminal device can respond to the trigger event to display the object area, character area and auxiliary information, and then the user can perform corresponding operations on the corresponding controls in the object area, enter the live broadcast room, store to purchase goods, etc., which greatly enriches the function of the interaction box and improves the convenience of interaction based on the interaction box, thereby effectively improving the user interaction experience.

[0176] In one embodiment, the interactive method in this embodiment may further include:

[0177] Step F, displaying a target interaction interface, wherein the target interaction interface includes a digital map;

[0178] Step G, in response to a triggering event for a target object in the digital map, obtaining a target virtual character, wherein the target virtual character is associated with a target user, wherein the target object includes a target pop-up window or a target floating layer;

[0179] Step H, displaying the target object, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0180] In this embodiment, according to the above-mentioned embodiment, Figure 2 As shown, the terminal device can display a target interaction interface, which can include a data map. Multiple interactive objects can be displayed on the digital map, such as "Dig", "Take a Photo", etc., so that the user can operate the above interactive objects, such as clicking or long pressing the above interactive objects, and generate corresponding trigger events.

[0181] The terminal device can respond to the above triggering event, obtain the target virtual character associated with the target user, and then display the target object, wherein the target object can include the following: Figure 4-1 The target pop-up window shown, or Figure 5 The target overlay is shown.

[0182] It can be understood that whether it is a target pop-up window or a target floating layer, it contains an object area, a character area and auxiliary information attached to the target virtual character. Similarly, the auxiliary information can be generated based on at least one of the content and / or operation indicated by the object area, the target user, and the virtual character.

[0183] In this embodiment, the object area can be used to display the content corresponding to the target object, and the character area adjacent to the object area can also be displayed. The character area can be used to display the virtual character of the target user and / or auxiliary information attached to the virtual character, thereby achieving customized and personalized display of the object area for each user, allowing users to interact through the interactive content in the object area and the virtual characters in the character area, thereby enhancing the fun of interaction, improving interaction efficiency, and greatly improving user experience.

[0184] The interactive method in this embodiment is basically consistent with the various embodiments of the above-mentioned interactive method, and will not be described in detail here. Please refer to the above-mentioned embodiments for description.

[0185] This embodiment also provides an interactive device, which can be integrated into a terminal device, for example, Fig.10 As shown, the interactive device may include:

[0186] An acquisition module 1001 is used to acquire a target virtual character in response to a trigger event for a target object, wherein the target virtual character is associated with a target user;

[0187] The display module 1002 is used to display the target object, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0188] Optionally, the character area further displays a visual element corresponding to the operation / content indicated by the object area, and / or the object area further displays an operation control including the visual element.

[0189] Optionally, the interactive device in this embodiment further includes:

[0190] A second acquisition module, used to acquire an element type corresponding to the operation / content indicated by the object area;

[0191] A query module, used to query at least one visual element associated with the element type from a preset element library;

[0192] A setting module, configured to set the associated visual element as the visual element corresponding to the operation / content indicated by the object area if there is an associated visual element in the preset element library;

[0193] A rendering module is used to extract object feature parameters of the operation / content indicated by the object area if there is no associated visual element in the preset element library, and perform element rendering according to the object feature parameters to obtain a visual element corresponding to the operation / content indicated by the object area.

[0194] Optionally, the distance between the character area and the object area is within a first preset range, and the first preset range indicates that the target virtual character and the interaction area are in an adjacent state.

[0195] Optionally, the distance between the character area and the object area is within a second preset range, and the second preset range indicates the area range of the overlapping area between the target virtual character and the interaction area.

[0196] Optionally, the interactive device in this embodiment further includes:

[0197] A third acquisition module, configured to acquire interactive feature information corresponding to the target virtual character according to at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character;

[0198] A splicing module, used for performing feature splicing on the interactive feature information to obtain an interactive dialogue text;

[0199] The first input-output module is used to input the interactive dialogue text into a preset language prediction model to obtain output auxiliary information of the target virtual character, wherein the language prediction model is obtained by training based on at least a character portrait of the target virtual character.

[0200] Optionally, the interactive device in this embodiment further includes:

[0201] A receiving module, used for receiving a feedback operation on the auxiliary information;

[0202] A correction module is used to correct the neural network weight value of the language prediction model based on the feedback operation.

[0203] Optionally, the interactive device in this embodiment further includes:

[0204] An identification module, used to respond to a trigger operation on the target virtual character and identify an operation type of the trigger operation;

[0205] The second input-output module is used to input the type identifier of the operation type into the character animation model to obtain the output character animation, and dynamically display the target virtual character according to the character animation, wherein the character animation model is obtained based on multiple pairs of operation types and corresponding character animation training.

[0206] Optionally, the display module 1002 is further used for:

[0207] Displaying the object area via a preset pop-up window, and obtaining area size information and location information of the object area;

[0208] Determining the first preset range according to the area size information and the position information;

[0209] The character area is displayed according to the first preset range and a preset orientation relative to the object area.

[0210] Optionally, the acquisition module 1001 is further used to:

[0211] In response to a triggering event for the target object, identifying user account information of the target user;

[0212] Acquire role parameters of a target virtual role bound to the user account information;

[0213] Image rendering is performed according to the role parameters to obtain a target virtual role of a target user.

[0214] Optionally, the acquisition module 1001 is further used to:

[0215] If the user account information is not bound to the target virtual character, then obtaining the role parameters of the preset default virtual character to perform image rendering to obtain the target virtual character of the target user;

[0216] If the user account information is bound to multiple target virtual characters, the character parameters of the latest target virtual character are obtained according to the creation time of the target virtual character to perform image rendering to obtain the target virtual character of the target user.

[0217] Optionally, the interactive device in this embodiment further includes:

[0218] A first display module, configured to respond to a triggering operation on a live broadcast control in the object area and display a live broadcast room interface, wherein the live broadcast room interface includes a live broadcast screen, a host virtual character display area, and an audience virtual character display area;

[0219] The second display module is used to display the host virtual character via the host virtual character display area, and to display at least one audience virtual character in the live broadcast room via the audience virtual character display area.

[0220] The third display module is used to respond to the live broadcast room events and display the character animation of the anchor virtual character and the character animation of the audience virtual character.

[0221] Optionally, the live broadcast room event includes a live broadcast entry event, and the third display module is further used to:

[0222] In response to the live broadcast entry event, character feature information and live broadcast information of a virtual character of a viewer entering the live broadcast room are obtained;

[0223] Generate prompt information for entering the live broadcast room according to the character feature information and the live broadcast information;

[0224] Setting the prompt information as auxiliary information of the anchor virtual character;

[0225] According to the auxiliary information, the character animation of the anchor virtual character is rendered, and the auxiliary information and the rendered character animation of the anchor virtual character are displayed adjacent to each other, and the character feature information and the character animation of the audience virtual character are displayed adjacent to each other.

[0226] Optionally, the live broadcast room event includes a live broadcast comment event, and the third display module is further used to:

[0227] Displaying a live broadcast comment box via the live broadcast room interface;

[0228] In response to a live comment event of a live comment box in the live broadcast room interface, obtaining a live comment context corresponding to the current viewer;

[0229] Generating auxiliary information of the host virtual character and auxiliary information of the audience virtual character of the current audience according to the host comments and audience comments in the live comment context;

[0230] Rendering the character animation of the anchor virtual character according to the auxiliary information of the anchor virtual character, and rendering the character animation of the audience virtual character according to the auxiliary information of the audience virtual character;

[0231] The auxiliary information of the anchor virtual character is displayed adjacent to the character animation rendered by the anchor virtual character, and the auxiliary information of the audience virtual character is displayed adjacent to the character animation rendered by the audience virtual character.

[0232] Optionally, the interactive device in this embodiment further includes:

[0233] a fourth display module, configured to respond to a triggering operation on the first commodity control in the object area and display a commodity activity information interface, wherein the commodity activity information interface displays a target virtual character of a target user and auxiliary information of the target virtual character adjacent to the character animation, wherein the auxiliary information is generated based on the commodity activity information;

[0234] A fourth acquisition module, configured to respond to a commodity transaction operation on a commodity transaction control in the commodity activity information interface and acquire commodity transaction information;

[0235] An updating module is used to render the character animation of the target virtual character according to the commodity transaction information, and to update the auxiliary information of the target virtual character.

[0236] Optionally, the interactive device in this embodiment further includes:

[0237] a fifth display module, configured to respond to a triggering operation on a second product control in the object area and display a product details interface, wherein the product details interface includes a digital map and a product details information floating layer, and a central area of ​​the digital map highlights a target product corresponding to the product details information;

[0238] The sixth display module is used to respond to the triggering operation of the product collection control in the product detail information floating layer, and render and display the character animation of the target virtual character of the target user through the control display area of ​​the product collection control.

[0239] Optionally, the object area includes one or more of a pop-up window area, a comment area, and an information prompt area.

[0240] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0241] Accordingly, an embodiment of the present application further provides an electronic device, which may be a terminal, and the terminal may be a smart phone, a tablet computer, a laptop computer, a touch screen, a game console, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA) and other terminal devices. Alternatively, the electronic device may be a server.

[0242] like Fig.11 As shown, Fig.11A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1100 includes a processor 1101 having one or more processing cores, a memory 1102 having one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 is electrically connected to the memory 1102. It will be understood by those skilled in the art that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0243] The processor 1101 is the control center of the electronic device 1100, and uses various interfaces and lines to connect various parts of the entire electronic device 1100. By running or loading software programs and / or units stored in the memory 1102, and calling data stored in the memory 1102, the processor 1101 executes various functions of the electronic device 1100 and processes data, thereby monitoring the electronic device 1100 as a whole. The processor 1101 can be a processor CPU, a graphics processor GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0244] In the embodiment of the present application, the processor 1101 in the electronic device 1100 will load instructions corresponding to the processes of one or more application programs into the memory 1102 according to the following steps, and the processor 1101 will run the application programs stored in the memory 1102 to implement various functions, such as:

[0245] In response to a trigger event for a target object, obtaining a target virtual character, wherein the target virtual character is associated with a target user;

[0246] The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0247] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0248] Optional, such as Fig.11As shown, the electronic device 1100 further includes: a touch screen 1103, a radio frequency circuit 1104, an audio circuit 1105, an input unit 1106, and a power supply 1107. The processor 1101 is electrically connected to the touch screen 1103, the radio frequency circuit 1104, the audio circuit 1105, the input unit 1106, and the power supply 1107, respectively. Those skilled in the art can understand that Fig.10 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0249] The touch display screen 1103 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 1103 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-EmittingDiode) and the like. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection system and a touch controller. Among them, the touch detection system detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection system, converts it into the touch point coordinates, and then sends it to the processor 1101, and can receive the command sent by the processor 1101 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1101 to determine the type of touch event, and then the processor 1101 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1103 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 1103 can also be used as a part of the input unit 1106 to realize the input function.

[0250] The radio frequency circuit 1104 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals between the network device or other electronic devices.

[0251] The audio circuit 1105 can be used to provide an audio interface between the user and the electronic device through a speaker and a microphone. The audio circuit 1105 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1105 and converted into audio data, and then the audio data is output to the processor 1101 for processing, and then sent to another electronic device through the radio frequency circuit 1104, or the audio data is output to the memory 1102 for further processing. The audio circuit 1105 may also include an earplug jack to provide communication between an external headset and an electronic device.

[0252] The input unit 1106 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0253] The power supply 1107 is used to supply power to various components of the electronic device 1100. Optionally, the power supply 1107 can be logically connected to the processor 1101 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 1107 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0254] although Fig.11 Not shown, the electronic device 1100 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0255] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0256] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0257] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored. The computer program can be loaded by a processor to execute any one of the interactive methods provided in the embodiments of the present application. The computer program can execute the following steps of the interactive method:

[0258] In response to a trigger event for a target object, obtaining a target virtual character, wherein the target virtual character is associated with a target user;

[0259] The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

[0260] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0261] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0262] Since the computer program stored in the computer-readable storage medium can execute any one of the interactive methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the interactive methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0263] In the above-mentioned interactive device, computer-readable storage medium, and electronic device, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the above-mentioned interactive device, computer-readable storage medium, computer program product, electronic device and its corresponding units can refer to the description of the interactive method in the above embodiment, and will not be repeated here.

[0264] The above is a detailed introduction to an interactive method, system, electronic device, and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An interactive method, characterized in that: include: In response to a trigger event for a target object, obtaining a target virtual character, wherein the target virtual character is associated with a target user; The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

2. The interactive method according to claim 1, characterized in that: The character area further displays a visual element corresponding to the operation / content indicated by the object area, and / or the object area further displays an operation control including the visual element.

3. The interactive method according to claim 2, characterized in that: The method further comprises: Obtaining the element type corresponding to the operation / content indicated by the object area; Querying at least one visual element associated with the element type from a preset element library; If there is an associated visual element in the preset element library, setting the associated visual element as the visual element corresponding to the operation / content indicated by the object area; If there is no associated visual element in the preset element library, the object feature parameters of the operation / content indicated by the object area are extracted, and element rendering is performed according to the object feature parameters to obtain the visual element corresponding to the operation / content indicated by the object area.

4. The interactive method according to claim 1, characterized in that: The distance between the character area and the object area is within a first preset range, and the first preset range indicates that the target virtual character and the interaction area are in an adjacent state.

5. The interactive method according to claim 1, characterized in that: The distance between the character area and the object area is within a second preset range, and the second preset range indicates the area range of the overlapping area between the target virtual character and the interaction area.

6. The interactive method according to claim 1, characterized in that: The display of the target object, before, includes: Acquire interactive feature information corresponding to the target virtual character according to at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character; Performing feature splicing on the interactive feature information to obtain an interactive dialogue text; The interactive dialogue text is input into a preset language prediction model to obtain output auxiliary information of the target virtual character, wherein the language prediction model is trained based on at least a character portrait of the target virtual character.

7. The interactive method according to claim 6, characterized in that: After inputting the interactive dialogue text into a preset language model to obtain the output auxiliary information of the target virtual character, the method includes: receiving a feedback operation on the auxiliary information; Based on the feedback operation, the neural network weight value of the language prediction model is modified.

8. The interactive method according to claim 1, characterized in that: The method further comprises: In response to a triggering operation on the target virtual character, identifying an operation type of the triggering operation; The type identifier of the operation type is input into a character animation model to obtain an output character animation, and the target virtual character is dynamically displayed according to the character animation, wherein the character animation model is obtained based on a plurality of pairs of operation types and corresponding character animation training.

9. The interactive method according to claim 1, characterized in that: The displaying of the target object includes: Displaying the object area of ​​the target object, and obtaining area size information and position information of the object area; Determining the first preset range according to the area size information and the position information; The character area is displayed according to the first preset range and a preset orientation relative to the object area.

10. The interactive method according to claim 1, characterized in that: The step of obtaining a target virtual character in response to a triggering event for a target object includes: In response to a triggering event for the target object, identifying user account information of the target user; Acquire role parameters of a target virtual role bound to the user account information; Image rendering is performed according to the role parameters to obtain a target virtual role of a target user.

11. The interactive method according to claim 10, characterized in that: After identifying the user account information of the target user in response to the trigger event for the target object, the method includes: If the user account information is not bound to the target virtual character, then obtaining the role parameters of the preset default virtual character to perform image rendering to obtain the target virtual character of the target user; If the user account information is bound to multiple target virtual characters, the character parameters of the latest target virtual character are obtained according to the creation time of the target virtual character to perform image rendering to obtain the target virtual character of the target user.

12. The interactive method according to claim 1, characterized in that: After displaying the target object, the method further comprises: In response to a triggering operation on a live broadcast control in the object area, a live broadcast room interface is displayed, wherein the live broadcast room interface includes a live broadcast screen, a host virtual character display area, and an audience virtual character display area; The host virtual character is displayed via the host virtual character display area, and at least one audience virtual character in the live broadcast room is displayed via the audience virtual character display area. In response to live broadcast room events, character animations of the anchor virtual character and the audience virtual character are displayed.

13. The interactive method according to claim 12, characterized in that: The live broadcast room event includes a live broadcast entry event, and the response to the live broadcast room event to display the character animation of the anchor virtual character and the character animation of the audience virtual character includes: In response to the live broadcast entry event, character feature information and live broadcast information of a virtual character of a viewer entering the live broadcast room are obtained; Generate prompt information for entering the live broadcast room according to the character feature information and the live broadcast information; Setting the prompt information as auxiliary information of the anchor virtual character; According to the auxiliary information, the character animation of the anchor virtual character is rendered, and the auxiliary information and the rendered character animation of the anchor virtual character are displayed adjacent to each other, and the character feature information and the character animation of the audience virtual character are displayed adjacent to each other.

14. The interactive method according to claim 12, characterized in that: The live broadcast room event includes a live broadcast comment event, and the response to the live broadcast room event to display the character animation of the anchor virtual character and the character animation of the audience virtual character includes: Displaying a live broadcast comment box via the live broadcast room interface; In response to a live comment event of a live comment box in the live broadcast room interface, obtaining a live comment context corresponding to the current viewer; Generating auxiliary information of the host virtual character and auxiliary information of the audience virtual character of the current audience according to the host comments and audience comments in the live comment context; Rendering the character animation of the anchor virtual character according to the auxiliary information of the anchor virtual character, and rendering the character animation of the audience virtual character according to the auxiliary information of the audience virtual character; The auxiliary information of the anchor virtual character is displayed adjacent to the character animation rendered by the anchor virtual character, and the auxiliary information of the audience virtual character is displayed adjacent to the character animation rendered by the audience virtual character.

15. The interactive method according to claim 1, characterized in that: After displaying the target object, the method further comprises: In response to a triggering operation on a first commodity control in the object area, a commodity activity information interface is displayed, wherein the commodity activity information interface displays a target virtual character of a target user and auxiliary information of the target virtual character adjacent to the character animation, wherein the auxiliary information is generated based on the commodity activity information; In response to a commodity transaction operation on a commodity transaction control in the commodity activity information interface, obtaining commodity transaction information; According to the commodity transaction information, the character animation of the target virtual character is rendered, and the auxiliary information of the target virtual character is updated.

16. The interactive method according to claim 1, characterized in that: After displaying the target object, the method further comprises: In response to a triggering operation on a second product control in the object area, a product details interface is displayed, wherein the product details interface includes a digital map and a product details information floating layer, and a central area of ​​the digital map highlights a target product corresponding to the product details information; In response to a triggering operation on a product collection control in the product detail information floating layer, a character animation of a target virtual character of a target user is rendered and displayed via a control display area of ​​the product collection control.

17. The interactive method according to any one of claims 1 to 16, characterized in that: The target object includes one or more of a pop-up window, a floating layer, a comment box, and an information prompt interface.

18. An interactive method, characterized in that, include: Displaying a target interactive interface, wherein the target interactive interface includes a digital map; In response to a trigger event for a target object in the digital map, a target virtual character is acquired, wherein the target virtual character is associated with a target user, wherein the target object includes a target pop-up window or a target floating layer; The target object is displayed, wherein the target object includes an object area and a character area, wherein the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

19. An interactive device, characterized in that: include: An acquisition module, configured to acquire a target virtual character in response to a trigger event for a target object, wherein the target virtual character is associated with a target user; A display module is used to display the target object, wherein the target object includes an object area and a character area, the character area includes the target virtual character and / or auxiliary information attached to the target virtual character, and the auxiliary information is generated based on at least one of the content and / or operation indicated by the object area, the target user, and the target virtual character.

20. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any one of the methods of claims 1 to 18.

21. A computer-readable storage medium, characterized in that: It comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any one of the methods of claims 1 to 18.

22. A computer program product, characterized in that It includes a computer program, which is stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device executes the steps of any method described in claims 1 to 18.

Images