Interaction method and device for virtual scene, storage medium and program product

Abstract

The invention discloses an interaction method and device for a virtual scene, equipment, a storage medium and a program product, and belongs to the technical field of virtual world. The method comprises the following steps: displaying a scene interface of a virtual scene, wherein the virtual scene comprises a first virtual object controlled by the terminal equipment; in response to the received file acquisition operation, acquiring a target file corresponding to a second virtual object controlled by the server, the target file being a multimedia file obtained by performing multimedia data acquisition on a user; the target file is sent to the second virtual object; and updating and displaying an interaction picture of the second virtual object and the first virtual object in the scene interface, wherein interaction content corresponding to the interaction picture is associated with the user emotion in the target file.

Description

Technical Field

[0001] The present application relates to the technical field of virtual worlds, and particularly relates to an interaction method, device, storage medium, and program product for a virtual scene. Background Art

[0002] In an interaction method including a virtual scene, a virtual object controlled by a terminal can interact with a virtual object controlled by a server to increase the interaction fun of the virtual scene.

[0003] In the related art, an NPC (Non-Player Character) is usually set in a virtual scene to interact with a virtual object controlled by a user. In certain situations, the system will automatically send out the NPC to interact with the virtual object controlled by the user, so as to achieve a target task.

[0004] However, in the above solution, the NPC is sent out by the system, and the interaction method is single and not flexible enough, unable to meet the special needs of users, ultimately resulting in the failure to complete the target task or a low degree of task completion, thus affecting the interaction effect between the user and the virtual scene. Summary of the Invention

[0005] The present application provides an interaction method, device, equipment, storage medium, and program product for a virtual scene. The technical solutions are as follows:

[0006] According to one aspect of the present application, an interaction method for a virtual scene is provided. The method is executed by a terminal device and includes:

[0007] Display a scene interface of the virtual scene, where the virtual scene includes a first virtual object controlled by the terminal device;

[0008] In response to receiving a file acquisition operation, acquire a target file corresponding to a second virtual object controlled by a server, where the target file is a multimedia file obtained by collecting multimedia data of a user;

[0009] Send the target file to the second virtual object;

[0010] Update and display an interaction screen between the second virtual object and the first virtual object in the scene interface, where the interaction content corresponding to the interaction screen is associated with the user emotion in the target file.

[0011] According to another aspect of the present application, an interaction method for a virtual scene is provided. The method is executed by a server and includes:

[0012] Receive a target file corresponding to a second virtual object controlled by the server; the target file is obtained and sent by the terminal device when presenting a scene interface of the virtual scene and receiving a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device.

[0013] Identify the user emotion in the target file.

[0014] Send interaction information to the terminal device based on the user emotion, where the interaction information is used to instruct the terminal device to update and display an interaction picture of the second virtual object and the first virtual object in the scene interface, and the interaction content corresponding to the interaction picture is associated with the user emotion in the target file.

[0015] According to another aspect of the present application, there is provided an interaction device for a virtual scene, the device includes:

[0016] An interface display module, configured to display a scene interface of the virtual scene, where the virtual scene includes a first virtual object controlled by the terminal device.

[0017] A file acquisition module, configured to, in response to receiving a file acquisition operation, acquire a target file corresponding to a second virtual object controlled by the server, where the target file is a multimedia file obtained by performing multimedia data acquisition on a user.

[0018] A file sending module, configured to send the target file to the second virtual object.

[0019] An interaction update module, configured to update and display an interaction picture of the second virtual object and the first virtual object in the scene interface, where the interaction content corresponding to the interaction picture is associated with the user emotion in the target file.

[0020] In some embodiments, the file acquisition module is configured to,

[0021] In response to receiving a chat trigger operation, display a chat interface with the second virtual object.

[0022] In response to receiving the file acquisition operation performed in the chat interface, acquire the target file.

[0023] In some embodiments, the file acquisition module is configured to,

[0024] In response to receiving a trigger operation on an acquisition control displayed in the chat interface, start the multimedia data acquisition component of the terminal device to perform acquisition to obtain the target file; or,

[0025] In response to receiving a trigger operation on the file selection control displayed in the chat interface, display the collected multimedia files, and in response to receiving a selection operation on one or more of the multimedia files, obtain the file selected by the selection operation as the target file.

[0026] In some embodiments, the interactive content is associated with the emotional information of the user emotion in the target file; the emotional information includes at least one of an emotion type and a strength level of the emotion.

[0027] In some embodiments, the multimedia file includes at least one of the following files:

[0028] An audio file, a video file, an audio-video file, or a picture file.

[0029] In some embodiments, when the multimedia file includes at least one of an audio file and an audio-video file, the interactive content is further associated with the speech text in the target file.

[0030] In some embodiments, before sending the target file to the second virtual object, it further includes:

[0031] Display a preview interface of the target file, and the preview interface includes prompt information of the user emotion.

[0032] In some embodiments, the interactive content is further associated with the state of the first virtual object.

[0033] According to another aspect of the present application, there is provided an interactive device for a virtual scene, and the device includes:

[0034] A file receiving module, configured to receive a target file corresponding to a second virtual object controlled by the server; the target file is obtained and sent by the terminal device when displaying a scene interface of the virtual scene and receiving a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device;

[0035] An emotion recognition module, configured to recognize the user emotion in the target file;

[0036] An interactive control module, configured to send interaction information to the terminal device based on the user emotion, and the interaction information is used to instruct the terminal device to update and display an interaction picture of the second virtual object and the first virtual object in the scene interface, and the interactive content corresponding to the interaction picture is associated with the user emotion in the target file.

[0037] In some embodiments, the multimedia file includes at least one of the following files:

[0038] An audio file, a video file, an audio-video file, or an image file.

[0039] In some embodiments, when the multimedia file includes at least one of an audio file and an audio-video file, the sending of interaction information to the terminal device based on the user's emotion further includes:

[0040] Identifying the speech text in the target file;

[0041] Based on the user's emotion and the speech text, sending the interaction information to the terminal device.

[0042] In some embodiments, before sending the interaction information to the terminal device based on the user's emotion, it further includes:

[0043] Obtaining the state of the first virtual object;

[0044] The sending of the interaction information to the terminal device based on the user's emotion includes:

[0045] Based on the user's emotion and the state of the first virtual object, sending the interaction information to the terminal device.

[0046] In some embodiments, the sending of the interaction information to the terminal device based on the user's emotion includes:

[0047] Obtaining the strength level of the user's emotion;

[0048] In response to the strength level of the user's emotion reaching a level threshold, sending the interaction information to the terminal device.

[0049] In some embodiments, the sending of the interaction information to the terminal device based on the user's emotion includes:

[0050] Obtaining the emotion information of the user's emotion, where the emotion information includes at least one of an emotion type and the strength level of the emotion;

[0051] Based on the emotion information of the user's emotion, sending the interaction information to the terminal device.

[0052] According to another aspect of the present application, there is provided a computer device, which includes a processor and a memory. At least one instruction, at least one program, a code set, or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the interactive method for a virtual scene as described in the above aspect.

[0053] According to another aspect of the present application, there is provided a computer-readable storage medium storing at least one instruction, at least one program, a code set or an instruction set, which is loaded and executed by a processor to implement the interactive method for a virtual scene as described in the above aspect.

[0054] According to another aspect of the present application, there is provided a computer program product including computer instructions stored in a computer-readable storage medium. The processor reads and executes the computer instructions from the computer-readable storage medium to implement the interactive method for a virtual scene as described in the above aspect.

[0055] The beneficial effects brought by the technical solution provided by the present application at least include:

[0056] The terminal device obtains a target file corresponding to a second virtual object controlled by a server and sends the target file to the server that controls the second virtual object. The server updates and displays an interaction screen between the second virtual object and the first virtual object according to the content of the target file, where the interaction content corresponding to the interaction screen is associated with the user emotion in the target file; in this solution, the interaction content corresponding to the interaction screen is determined according to the user's emotion content, which improves the accuracy of the interaction content meeting the user's needs. On the other hand, the interaction content is determined through the user emotion content, which expands the way for the user to interact with the virtual scene and enhances the fun of the interaction, thereby improving the interaction effect between the user and the virtual scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0058] Figure 1 is a block diagram of the structure of a computer system provided by an exemplary embodiment of the present application;

[0059] Figure 2 is a flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of the present application;

[0060] Figure 3 is a flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of the present application;

[0061] Figure 4 is a flowchart of an interactive method for a virtual scene involved in an exemplary embodiment of the present application;

[0062] Figure 5 It is a flowchart of an interactive method for a virtual scene according to an exemplary embodiment of the present application;

[0063] Figure 6 It is a flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of the present application;

[0064] Figure 7 It is a flowchart of an interactive method for a virtual scene according to an exemplary embodiment of the present application;

[0065] Figure 8 It is a flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of the present application;

[0066] Figure 9 It is an interface diagram of selecting an NPC speaker according to an exemplary embodiment of the present application;

[0067] Figure 10 It is a schematic diagram of seeking help for video recording according to an exemplary embodiment of the present application;

[0068] Figure 11 It is a schematic diagram of seeking company for video recording according to an exemplary embodiment of the present application;

[0069] Figure 12 It is a schematic diagram of seeking company for video recording according to an exemplary embodiment of the present application;

[0070] Figure 13 It is a schematic diagram of the completion of video recording according to an exemplary embodiment of the present application;

[0071] Figure 14 It is a schematic diagram of sending video information according to an exemplary embodiment of the present application;

[0072] Figure 15 It is a schematic diagram of an NPC replying to send reinforcement troops according to an exemplary embodiment of the present application;

[0073] Figure 16 It is a schematic diagram of an NPC replying to send resource assistance according to an exemplary embodiment of the present application;

[0074] Figure 17 It is a schematic diagram of an NPC reinforcement force according to an exemplary embodiment of the present application;

[0075] Figure 18 It is a schematic diagram of an NPC accompanying force according to an exemplary embodiment of the present application;

[0076] Figure 19It is a schematic diagram of an NPC supply force involved in an exemplary embodiment of the present application;

[0077] Figure 20 It is a schematic diagram of the connection method of the quick add friend port for face recognition involved in an exemplary embodiment of the present application;

[0078] Figure 21 It is a flowchart of building a face recognition system involved in an exemplary embodiment of the present application;

[0079] Figure 22 It is a flowchart of sending a video information request for NPC assistance involved in an exemplary embodiment of the present application;

[0080] Figure 23 It is a flowchart of the system operation involved in an exemplary embodiment of the present application;

[0081] Figure 24 It is a block diagram of an interactive device for a virtual scene provided by an exemplary embodiment of the present application;

[0082] Figure 25 It is a block diagram of an interactive device for a virtual scene provided by an exemplary embodiment of the present application;

[0083] Figure 26 It is a block diagram of a computer device provided by an exemplary embodiment of the present application.

[0084] The accompanying drawings here are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. Detailed implementation manners

[0085] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0086] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0087] The terms used in this disclosure are for the purpose of describing particular embodiments only and are not intended to limit the disclosure. The singular forms "a", "the", and "said" used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0088] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions. For example, the object behaviors such as attack operations involved in this application are obtained under full authorization.

[0089] It should be understood that although the terms first, second, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this disclosure, the first parameter may also be referred to as the second parameter, and similarly, the second parameter may also be referred to as the first parameter. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0090] For ease of understanding, several terms related to this application are explained below.

[0091] 1) Virtual scene

[0092] A virtual scene is a virtual scene displayed (or provided) when an application runs on a terminal. The virtual scene can be a simulation environment scene of the real world, or a semi-simulated and semi-fictional three-dimensional environment scene, or a purely fictional three-dimensional environment scene. The virtual scene can be any one of a two-dimensional virtual scene, a 2.5D virtual scene, and a three-dimensional virtual scene. The following embodiments take the virtual scene as a three-dimensional virtual scene as an example for illustration, but are not limited thereto. Optionally, the virtual scene can also be used for virtual scene battles between at least two virtual characters. Optionally, the virtual scene can also be used for battles between at least two virtual characters using virtual props. Optionally, the virtual scene can also be used for battles between at least two virtual characters using virtual props within a target area range, and the target area range will continuously decrease as time passes in the virtual scene.

[0093] A virtual scene is usually generated by an application program in a computer device such as a terminal, and is displayed based on the hardware (such as a screen) in the terminal. The terminal can be a mobile terminal such as a smart phone, a tablet computer, or an e-book reader; or, the terminal can also be a personal computer device such as a notebook computer or a stationary computer.

[0094] 2) Virtual object

[0095] A virtual object refers to an object in a virtual scene. The virtual object can be at least one of a virtual person, a virtual character, a virtual animal, a virtual vehicle, a virtual building, and a virtual city. Optionally, when the virtual scene is a three-dimensional virtual scene, the virtual object is a three-dimensional solid model created based on the animation skeleton technology. Each virtual object has its own shape, volume, and orientation in the three-dimensional virtual scene, and occupies a part of the space in the three-dimensional virtual scene.

[0096] 3) SLG (Strategy Game)

[0097] A strategy game is a type of game that emphasizes players' decision-making and implementation of strategies, and often involves elements such as resource management, war strategies, and base construction.

[0098] 4) NPC (Non-Player Character)

[0099] In a game, virtual world, or interactive experience, an NPC is a character controlled by a game engine or program, rather than by a real player. These characters can be hostile, friendly, task-related, or just background characters in the virtual world.

[0100] Figure 1 The block diagram of a computer system provided by an exemplary embodiment of the present application is shown. The computer system 100 includes: a first terminal 110, a server 120, and a second terminal 130.

[0101] The first terminal 110 installs and runs a client 111 that supports virtual scenarios. The client 111 can be a multiplayer online battle program. When the first terminal runs the client 111, the user interface of the client 111 is displayed on the screen of the first terminal 110. The client 111 can be any one of a simulation program, a Virtual Reality (VR) application program, an Augmented Reality (AR) program, a three-dimensional map program, a virtual reality game, an augmented reality game, a Multiplayer Online Battle Arena Games (MOBA), and a SimulationGame (SLG). In this embodiment, it is exemplified that the client 111 is an SLG game. The first terminal 110 is a terminal used by the first user 112. The first user 112 uses the first terminal 110 to control the first virtual object located in the virtual scenario to perform activities. The first virtual object can be called the virtual object of the first user 112. The activities of the first virtual object include, but are not limited to, at least one of moving, jumping, teleporting, releasing skills, using items, adjusting body postures, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, and throwing. Schematically, the first virtual object is the first virtual object, such as a simulated character or an anime character.

[0102] The second terminal 130 installs and runs a client 131 that supports virtual scenarios. The client 131 can be a multiplayer online battle program. When the second terminal 130 runs the client 131, the user interface of the client 131 is displayed on the screen of the second terminal 130. The client can be any one of a simulation program, a battle royale shooting game, a VR application program, an AR program, a three-dimensional map program, a virtual reality game, an augmented reality game, a FPS, a TPS, a MOBA, and an SLG. In this embodiment, it is exemplified that the client is a MOBA game. The second terminal 130 is a terminal used by the second user 132. The second user 132 uses the second terminal 130 to control the second virtual object located in the virtual scenario to perform activities. The second virtual object can be called the virtual object of the second user 132. Schematically, the second virtual object is the second virtual object, such as a simulated character or an anime character.

[0103] Optionally, the first virtual object and the second virtual object are in the same virtual scenario. Optionally, the first virtual object and the second virtual object can belong to the same camp, the same team, the same organization, have a friendship relationship, or have temporary communication permissions. Optionally, the first virtual object and the second virtual object can belong to different camps, different teams, different organizations, or have a hostile relationship.

[0104] Optionally, the clients installed on the first terminal 110 and the second terminal 130 are the same, or the clients installed on the two terminals are of the same type on different operating system platforms (Android or iOS). The first terminal 110 can generally refer to one of multiple terminals, and the second terminal 130 can generally refer to another of the multiple terminals. This embodiment only takes the first terminal 110 and the second terminal 130 as examples for illustration. The device types of the first terminal 110 and the second terminal 130 are the same or different, and the device types include at least one of: smart phones, tablet computers, e-book readers, MP3 players, MP4 players, laptop computers, and desktop computers.

[0105] Figure 1 Only two terminals are shown in the figure, but in different embodiments, there are multiple other terminals 140 that can access the server 120. Optionally, there is also one or more terminals 140 that are terminals corresponding to developers. A development and editing platform for the client that supports virtual scenarios is installed on the terminals 140. Developers can edit and update the client on the terminals 140, and transmit the updated client installation package to the server 120 through a wired or wireless network. The first terminal 110 and the second terminal 130 can download the client installation package from the server 120 to update the client.

[0106] The first terminal 110, the second terminal 130, and the other terminals 140 are connected to the server 120 through a wireless network or a wired network.

[0107] The server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. The server 120 is used to provide background services for the client that supports the three-dimensional virtual scenario. Optionally, the server 120 undertakes the main computing work, and the terminal undertakes the secondary computing work; or, the server 120 undertakes the secondary computing work, and the terminal undertakes the main computing work; or, a distributed computing architecture is adopted between the server 120 and the terminal for collaborative computing.

[0108] In a schematic example, the server 120 includes a processor 122, a user account database 123, a battle service module 124, and a user-oriented input / output interface (I / O interface) 125. Among them, the processor 122 is used to load the instructions stored in the server 120 and process the data in the user account database 123 and the battle service module 124; the user account database 123 is used to store the data of the user accounts used by the first terminal 110, the second terminal 130, and other terminals 140, such as the avatar of the user account, the nickname of the user account, the combat power index of the user account, and the service area where the user account is located; the battle service module 124 is used to provide multiple battle rooms for users to conduct battles, such as 1V1 battles, 3V3 battles, 5V5 battles, etc.; the user-oriented I / O interface 125 is used to establish communication with the first terminal 110 and / or the second terminal 130 through a wireless network or a wired network to exchange data.

[0109] The methods provided in the subsequent embodiments of this application can be applied to, but are not limited to, at least one of the following scenarios: virtual reality applications, 3D map programs, simulation programs, Multiplayer Online Battle Arena Games (MOBA), Simulation Games (SLG), and multiplayer shooting survival games, etc. The following embodiments are illustrated by taking their applications in games as examples.

[0110] Figure 2 The flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of this application is shown. This method can be executed by a terminal device, and the terminal device can be Figure 1 the first terminal 110 or the second terminal 130 in the system shown, and this method includes:

[0111] Step 210: Display the scene interface of the virtual scene, and the virtual scene includes a first virtual object controlled by the terminal device.

[0112] Exemplarily, the first virtual object is the virtual object controlled by the user account logged in by the terminal, and the virtual scene can be used to provide virtual tactical competitions or virtual strategic confrontations between different virtual objects.

[0113] Exemplarily, the virtual scene may further include a second virtual object, and the second virtual object may be a teammate / camp object of the first virtual object, that is to say, the first virtual object and the second virtual object may be in a cooperative relationship.

[0114] Among them, the above-mentioned second virtual object may be a virtual object controlled by the server. For example, the second virtual object may be an NPC or an AI robot, etc.

[0115] Exemplarily, the first virtual object and the second virtual object may belong to different teams / camps; the team / camp to which the second virtual object belongs and the team / camp to which the first virtual object belongs may be in an adversarial relationship, which is not restricted in this application.

[0116] Exemplarily, the battle interface may also be a perspective screen under a free perspective, or the battle interface of the displayed virtual scene may be the perspective screen of the first virtual object, that is, the scene screen obtained by observing the virtual scene from the perspective of the first virtual object, which may be the first perspective or the third perspective.

[0117] Exemplarily, the first virtual object and the second virtual object belong to different virtual camps; the virtual camp to which the second virtual object belongs and the virtual camp to which the first virtual object belongs may be in a hostile relationship or a mutually neutral relationship, which is not restricted in this application.

[0118] Wherein, the user can control the first virtual object to perform virtual actions or make strategic / tactical decisions.

[0119] Exemplarily, the implementation manners for the user to control the first virtual object to perform virtual actions include but are not limited to at least one of the following: mouse / touch click, slide, rotation; for example: clicking on the touch screen or button, sliding on the touch screen or handle, rotating the terminal or handle.

[0120] Step 220: In response to receiving a file acquisition operation, acquire a target file corresponding to a second virtual object controlled by a server, where the target file is a multimedia file obtained by performing multimedia data acquisition on the user.

[0121] Wherein, the file corresponding to the above acquisition operation may be a file that has been recorded and saved by the user before performing the file acquisition operation, or a file directly recorded by the current user.

[0122] Step 230: Send the target file to the second virtual object.

[0123] After the terminal acquires the target file, it sends the target file to the server that controls the second virtual object.

[0124] Step 240: Update and display an interaction screen between the second virtual object and the first virtual object in the scene interface, where the interaction content corresponding to the interaction screen is associated with the user's emotion in the target file.

[0125] In an embodiment of the present application, after the terminal device receives a file, it obtains a target file corresponding to a second virtual object controlled by a server, and sends the target file to the server that controls the second virtual object. The server updates the display of the interaction screen between the second virtual object and the first virtual object according to the content of the target file, where the interaction content corresponding to the interaction screen is associated with the user's emotion in the target file; in this solution, the interaction content corresponding to the interaction screen is determined according to the user's emotion content, which improves the accuracy of the interaction content meeting the user's needs. On the other hand, the interaction content is determined through the user's emotion content, which expands the way for the user to interact with the virtual scene and enhances the fun of the interaction, thereby improving the interaction effect between the user and the virtual scene.

[0126] Please refer to Figure 3 , which shows a flowchart of an interaction method for a virtual scene provided by an exemplary embodiment of the present application. This method can be executed by a server, and the server can be Figure 1 the server 120 in the system shown, and this method includes:

[0127] Step 310: Receive a target file corresponding to a second virtual object controlled by the server.

[0128] The target file is obtained and sent by the terminal device when it displays the scene interface of the virtual scene and receives a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device.

[0129] Step 320: Identify the user's emotion in the target file.

[0130] Among them, the user's emotion in the above target file can be identified by a neural network set in the server, for example, at least one neural network among a convolutional neural network, a spatio-temporal 3D convolutional neural network, and a long short-term memory network.

[0131] Step 330: Send interaction information to the terminal device based on the user's emotion.

[0132] Among them, the server can determine the interaction content between the second virtual object and the first virtual object according to the user's emotion in the target file, and then send the interaction information corresponding to the interaction content to the terminal device.

[0133] For example, a corresponding relationship between the user's emotion and the interaction content can be preset in the above server, and the server can query the above corresponding relationship according to the user's emotion in the target file to determine the interaction content between the second virtual object and the first virtual object.

[0134] Alternatively, the above server may be pre - set with a machine - learning model for identifying interactive content. The server inputs the user's emotion in the target file into the machine - learning model and obtains the interactive content predicted and output by the machine - learning model between the second virtual object and the first virtual object.

[0135] The above - mentioned interaction information is used to instruct the terminal device to update and display the interaction picture of the second virtual object and the first virtual object in the scene interface, and the interactive content corresponding to the interaction picture is associated with the user's emotion in the target file.

[0136] Among them, the above - mentioned interaction information can be in at least one of the ways of text, audio, and video.

[0137] In the embodiment of the present application, after receiving the target file, the server identifies the user's emotion in the target file through a neural network, and then sends interaction information to the terminal device based on the user's emotion. On the one hand, the accuracy of user emotion recognition is improved, and on the other hand, the user's needs are determined according to the emotion recognition, and the determination result can be closer to the user's real needs, ensuring the interaction effect between the user and the virtual scene.

[0138] Based on the solutions shown in the above - mentioned various embodiments, please refer to Figure 4 which shows a flowchart of an interaction method for a virtual scene provided by an exemplary embodiment of the present application.

[0139] Among them, the terminal device may be Figure 1 the first terminal 110 or the second terminal 130 in the system shown, and the server may be Figure 1 the server 120 in the system shown, and the method includes:

[0140] Step 410: The terminal displays the scene interface of the virtual scene.

[0141] Among them, the virtual scene includes a first virtual object controlled by the terminal device.

[0142] Step 420: In response to receiving a file acquisition operation, the terminal acquires the target file corresponding to the second virtual object controlled by the server.

[0143] Among them, the target file is a multimedia file obtained by collecting multimedia data of the user.

[0144] Step 430: The terminal sends the target file to the second virtual object.

[0145] Step 440: The server receives the target file corresponding to the second virtual object controlled by the server.

[0146] Among them, the target file is obtained and sent by the terminal device when it is in the scene interface for displaying the virtual scene and receives a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device.

[0147] Step 450: The server identifies the user's emotion in the target file.

[0148] Step 460: The server sends interaction information to the terminal device based on the user's emotion.

[0149] Among them, the interaction information is used to instruct the terminal device to update and display the interaction picture of the second virtual object and the first virtual object in the scene interface, and the interaction content corresponding to the interaction picture is associated with the user's emotion in the target file.

[0150] Step 470: The terminal updates and displays the interaction picture of the second virtual object and the first virtual object in the scene interface.

[0151] Among them, the interaction content corresponding to the interaction picture is associated with the user's emotion in the target file.

[0152] In some embodiments of the present application, the interaction content is associated with the emotion information of the user's emotion in the target file; the emotion information includes at least one of the emotion type and the intensity level of the emotion.

[0153] Among them, the emotion type can be one of the emotion types such as happiness, sadness, anger, pain, despair, tension, anxiety, loneliness, boredom, mania, etc. used to represent the human mood state.

[0154] Among them, the manifestation form of the intensity level of the emotion can be in digital form, or in text form;

[0155] Exemplarily, when the manifestation form of the intensity level of the emotion type is in digital form, it can be any natural number from 1 to 10. The larger the number, the stronger the emotion. For example, compared with "anxiety: 1" and "anxiety: 10", the intensity of the emotion of "anxiety: 10" is stronger than that of "anxiety: 1"; in some other embodiments, the above numbers can also be inversely proportional to the intensity of the emotion, and the smaller the number, the stronger the emotion;

[0156] Exemplarily, when the manifestation form of the intensity level of the emotion type is in text form, it can be any one of "weak", "medium", and "strong", and the intensity of the emotion is consistent with the meaning expressed by the text.

[0157] The above emotion information includes at least one of the emotion type and the intensity level of the emotion. The emotion information can include one or more emotions. Among them, the emotion type and the intensity level of the emotion are displayed in a combined form. The emotion type and the intensity level of the emotion can be displayed side by side or in parallel.

[0158] The above interactive content is associated with the emotional information of the user's emotion in the target file, where the interactive content can be determined by the type of emotion with the highest intensity in the emotional information, or can be determined by comprehensive analysis of multiple emotion types. The interactive content can be one of the interactive contents such as encouragement, support, and chatting, and the presentation form of the interactive content can be one of the presentation forms such as voice, text, video, and picture.

[0159] For example, the current emotional information includes: "helpless: 10", "desperate: 8", "hungry: 13", and the interactive content can be text: "Deliver three hundred shi of grain."

[0160] In the embodiments of the present application, the interactive content is related to the emotional information of the user's emotion in the target file. The interactive content determined according to the user's emotion type and the refined emotional intensity is more delicate and closer to the real needs of the user, ensuring that the interactive content can best meet the user's needs and ensuring the accuracy of the interactive content, thereby effectively improving the interactive effect between the user and the virtual scene.

[0161] In some embodiments of the present application, the multimedia file includes at least one of the following files:

[0162] Audio file, video file, audio-video file, or picture file.

[0163] Among them, the above multimedia file can be obtained by one of the devices such as a digital camera, a video camera, a smart phone, an audio recording device, a television, a video camera, or a computer.

[0164] Among them, the format of the above audio file can be one of MP3 (MPEG Audio Layer III), WAV (Waveform Audio File Format), FLAC (Free Lossless Audio Codec), and AAC (Advanced Audio Coding);

[0165] Among them, the format of the above video file can be one of MP4 (MPEG-4 Part 14), AVI (Audio Video Interleave), MKV (Matroska Video), and WMV (Windows Media Video);

[0166] Among them, the format of the above audio-visual file can be one of MP4 (MPEG-4 Part 14), AVI (Audio Video Interleave), MKV (Matroska Video), and WMV (Windows Media Video);

[0167] Among them, the format of the above picture file can be one of JPEG (Joint Photographic Experts Group), PNG (Portable Network Graphics), GIF (Graphics Interchange Format), and TIFF (Tagged Image File Format).

[0168] In the embodiments of the present application, various types of multimedia files expand the acquisition types and acquisition channels of the target file, increasing the selectivity of the target file; on the other hand, acquiring files in multiple forms such as audio, video, and pictures expands the interaction forms between the user and the virtual scene.

[0169] In some embodiments of the present application, when the multimedia file includes at least one of an audio file and an audio-visual file, the interaction content is also associated with the speech text in the target file.

[0170] When the multimedia file contains at least one of an audio file and an audio-visual file, the terminal or the server can obtain the speech text corresponding to the audio in the current file, and the interaction content is also determined according to the speech text; for example, in the current audio-visual, the user appears very bored, and the emotion information is "bored: 10", and in this video, the user says "I'm very bored, please comfort me!", and the server recognizes the emotion information and the speech text, and the interaction content is humorous speech and text.

[0171] In the embodiments of the present application, the interaction content is also associated with the speech text in the target file, increasing the consideration factors for determining the interaction content other than the emotion information, expanding the determining factors of the interaction content, and improving the accuracy of the interaction content.

[0172] In some embodiments of the present application, the interaction content is also associated with the state of the first virtual object.

[0173] The above state can be at least one of the character state, environmental state, combat state, or level state of the first virtual object;

[0174] Among them, the character state of the first virtual object can be at least one of weak, hungry, cold, sick, disabled, healthy, and strong;

[0175] The environmental state of the first virtual object can be at least one of a desert, a glacier, and a forest;

[0176] The combat state in which the first virtual object fights with other virtual objects can be before the battle, during the battle, or after the battle;

[0177] The level state of the first virtual object can be novice, junior, intermediate, or advanced.

[0178] Exemplarily, when the emotion information is "helpless: level 10", the first virtual object is in the state before the battle, and the level state of the first virtual object is level 10, then the interaction content can be "dispatch three hundred thousand troops".

[0179] In the embodiment of the present application, the interaction content is determined through the status information of the first virtual object, which increases the consideration factors for determining the interaction content, expands the determinants of the interaction content, and improves the accuracy of the interaction content.

[0180] Based on Figure 4 the solution shown, please refer to Figure 5 , which shows a flowchart of an interaction method for a virtual scene provided by an exemplary embodiment of the present application. This method can be executed by a terminal device, and the terminal device can be Figure 1 the first terminal 110 or the second terminal 130 in the system shown in Figure 4 Step 420 in Figure 5 can be implemented as step 420a and step 420b, as shown in

[0181] Step 420a: In response to receiving a chat trigger operation, display a chat interface with the second virtual object.

[0182] The above-mentioned chat trigger operation can be triggered by a control on the terminal. For example, there is a control in any area of the terminal screen, and the control can be circular or other shapes. When the user long-presses or clicks the control, the chat operation is triggered.

[0183] The above-mentioned chat trigger operation can be triggered after the terminal's multimedia acquisition component collects a user instruction. For example, when the user says "help", the audio acquisition component in the terminal, such as a microphone, receives the instruction and then triggers the chat operation, and a chat interface is displayed on the terminal screen;

[0184] The above-mentioned chat trigger operation can be that the server actively triggers the chat operation and pops up the chat interface according to the state of the first virtual object. For example, when the first virtual object at the novice level is in a state of extreme hunger and the virtual environment where the first virtual object is located is a glacier, the server actively triggers the chat operation.

[0185] The above second virtual object may be at least one of a virtual person, a virtual character, a virtual pet, and a virtual item.

[0186] The above chat interface is a chat interface between the first virtual object controlled by the user and the second virtual object controlled by the server.

[0187] Step 420b: In response to receiving a file acquisition operation performed in the chat interface, acquire a target file.

[0188] In response to receiving a file acquisition operation performed in the chat interface, the terminal acquires a target file.

[0189] In the embodiments of the present application, the user first triggers a chat operation, the terminal displays the chat interface of the second virtual object, and then acquires the target file collected or selected through the chat interface, expanding the interaction method of the user actively with the virtual scene, increasing the possibility of the user's interaction with the virtual scene, and thus improving the interaction effect between the user and the virtual scene.

[0190] In a possible way, in response to receiving a trigger operation on the acquisition control displayed in the chat interface, start the multimedia data acquisition component of the terminal device for acquisition, and the terminal obtains the target file.

[0191] When the user performs a trigger operation on the acquisition control displayed in the chat interface, the multimedia data acquisition component of the terminal device acquires the user's image, voice, etc., and obtains the target file.

[0192] Wherein, the above multimedia data acquisition component may be at least one of a camera collector, a microphone collector, and a desktop screen collector.

[0193] Wherein, the above acquisition control may be in any area of the chat interface and is displayed in the form of a circle, a square or other shapes.

[0194] Wherein, the above trigger operation may be one of a long press or a single click on the acquisition control displayed in the chat interface by the user.

[0195] Wherein, the above acquisition operation may be that the user uses the terminal device to take a self-portrait, record a voice or record a video.

[0196] In another possible way, in response to receiving a trigger operation on the file selection control displayed in the chat interface, the terminal displays each acquired multimedia file, and in response to receiving a selection operation on one or more files among the multimedia files, acquires the file selected by the selection operation as the target file.

[0197] Among them, each of the collected multimedia files shown above can be various multimedia files related to the user himself / herself that the user captured, recorded, or saved using a terminal device before interacting with the virtual scene.

[0198] Among them, each of the collected multimedia files shown above can be files classified by one of the file type, file name, and file date.

[0199] Among them, the above selection operation can be a long - press operation or a click operation performed by the user on the screen of the terminal.

[0200] In summary, in the embodiment of the present application, the target file can be obtained either by starting the multimedia data collection component of the terminal device for collection so that the terminal obtains the target file, or by selecting and obtaining the target file from the collected multimedia files. Two ways of obtaining the target file are provided, expanding the ways of obtaining the target file. And both of the above two ways of interacting with the target file require the user to interact with the terminal. Therefore, the interaction effect between the user and the virtual scene is improved.

[0201] Based on Figure 4 the solution shown, please refer to Figure 6 , which shows a flowchart of an interactive method for a virtual scene provided by an exemplary embodiment of the present application. This method can be executed by a terminal device, and the terminal device can be Figure 1 the first terminal 110 or the second terminal 130 in the system shown Figure 4 There is also step 425 before step 430 in Figure 6 shown, and this method includes:

[0202] Step 425: Display a preview interface of the target file, and the preview interface contains prompt information about the user's emotion.

[0203] Among them, the prompt information about the user's emotion in the above preview interface is at least one of speech text, video, and audio.

[0204] When the user previews the target file, if there is a deviation between the prompt information in the target file and the content the user wants to express, the user can re - record a new target file or re - select an already generated target file.

[0205] In the embodiment of the present application, before the user sends the target file to the second virtual object, the target file can be previewed to ensure that the information shown in the target file is the information the user wants to convey. An additional verification process is added, ensuring that the file received by the second virtual object can accurately indicate the information the user wants to express, so as to correctly select the interaction content and correctly cooperate with the first virtual object controlled by the user, improving the cooperation efficiency.

[0206] In some embodiments, when the multimedia file includes at least one of an audio file and an audio-visual file, sending interaction information to a terminal device based on the user's emotion further includes:

[0207] The server recognizes the speech text in the target file; based on the user's emotion and the speech text, sends interaction information to the terminal device.

[0208] Among them, the recognition of the above speech text can be achieved through a deep learning model, such as one of a recurrent neural network, a long short-term memory network, or a Transformer model.

[0209] In the embodiments of the present application, after the server recognizes the speech text of the target file, it considers and judges in combination with two factors, the user's emotion and the speech text, determines the interaction information, and sends the interaction information to the terminal device. Under the judgment of the two factors, the possibility that the interaction information meets the user's interaction needs is improved, thereby improving the interaction effect between the user and the virtual scene.

[0210] Based on Figure 4 the scheme shown, please refer to Figure 7 , which shows a flowchart of an interaction method for a virtual scene provided by an exemplary embodiment of the present application. This method can be executed by a server, and the terminal device can be Figure 1 the server 120 in the system shown, Figure 4 before step 460, it further includes step 455. Before step 460, it further includes step 455, and step 460 can be implemented as step 460a:

[0211] Step 455: Obtain the state of the first virtual object.

[0212] Step 460a: Based on the user's emotion and the state of the first virtual object, send interaction information to the terminal device.

[0213] In the embodiments of the present application, after the server obtains the state of the first virtual object, it determines the interaction information in combination with two factors, the user's emotion and the state of the first virtual object controlled by the user, and sends the interaction information to the terminal device, ensuring that the interaction information can best meet the user's needs, thereby improving the experience of the user interacting with the virtual scene.

[0214] In some embodiments, sending interaction information to the terminal device based on the user's emotion includes:

[0215] The server obtains the strength level of the user's emotion; in response to the strength level of the user's emotion reaching a level threshold, sends interaction information to the terminal device.

[0216] Among them, the above-mentioned level threshold can be any natural integer from 1 to 10, and this level threshold can be configured by developers during development and design; for example, when developers configure that when the user's "fear" emotional state reaches level 5, an interaction message will be sent to the terminal device. At this time, if the user's recognized emotion is "fear: level 4", the server will not send an interaction message to the terminal; when the user's recognized emotion is "fear: level 6", the server sends an interaction message to the terminal.

[0217] In another possible implementation, developers configure that when the user's "fear" emotional state reaches level 5, an interaction message will be sent to the terminal device. At this time, if the user's recognized emotion is "fear: level 4", the server will also send an interaction message to the terminal, but the content of the message is "Unable to provide help".

[0218] In the embodiments of the present application, by judging the user's emotion level and the specified threshold and then sending interaction messages, unnecessary interaction content is reduced, the processing task of the server is reduced, the occupation of server resources is avoided, and the efficiency of interaction determination is improved.

[0219] Based on Figure 4 the solution shown, please refer to Figure 8 , which shows a flowchart of an interaction method for a virtual scene provided by an exemplary embodiment of the present application. This method can be executed by a server, and the terminal device can be Figure 1 the server 120 in the system shown Figure 4 In step 460, it can be implemented as step 460b and step 460c:

[0220] Step 460b: Obtain the emotion information of the user's emotion, where the emotion information includes at least one of the emotion type and the intensity level of the emotion.

[0221] Step 460c: Based on the emotion information of the user's emotion, send an interaction message to the terminal device.

[0222] In the embodiments of the present application, the interaction information is related to the emotion information of the user's emotion in the target file. The server determines the interaction information according to the user's emotion type and the refined intensity of the emotion. This interaction information is closer to the user's real needs, ensures that the interaction information can best meet the user's needs, ensures the accuracy of the interaction information, and thus can effectively improve the interactivity between the user and the virtual scene.

[0223] Based on the above Figures 2 to 8 solution shown, exemplarily, taking the above virtual scene as an SLG game as an example, the application methods of the solutions shown in the above embodiments of the present application are introduced below.

[0224] 1) Select an NPC speaker in the chat

[0225] Please refer to Figure 9 , which shows an interface diagram for selecting an NPC speaker involved in an exemplary embodiment of the present application.

[0226] When the player wants to send a request to the NPC, he can select the NPC's avatar in the chat interface 910 and click the shooting button to start recording the video information.

[0227] 2) Start recording video

[0228] The player clicks on the shooting interface, and the player points the camera at himself and starts to speak his request. The system will display the recognition keywords of the player's expression in real time according to the player's expression, helping the player to express his request more clearly to impress the NPC and get more help and support. For example, if the player wants to seek help from the NPC, he can show expressions such as pain, eagerness, pity, etc. Please refer to Figure 10 , which shows a schematic diagram of video recording for seeking help involved in an exemplary embodiment of the present application;

[0229] If players want to seek the company of NPCs to pass the boring early development time, they can show cute, sincere, pleading, interesting and other expressions. Please refer to Figure 11 , which shows a schematic diagram of video recording seeking companionship involved in an exemplary embodiment of the present application;

[0230] If the player has no expression and does not say anything, the video will have little effect. Figure 12 , which shows a schematic diagram of video recording seeking companionship involved in an exemplary embodiment of the present application.

[0231] 3) Send to NPC

[0232] After the player finishes recording, he can preview the recorded video, and then choose to send the video directly, or choose to go back and re-record.

[0233] Please refer to Figure 13 , which shows a schematic diagram of a video recording completion involved in an exemplary embodiment of the present application.

[0234] Please refer to Figure 14 , which shows a schematic diagram of sending video information involved in an exemplary embodiment of the present application.

[0235] 4) System identification and response

[0236] After the player sends a message to the system NPC, the system will identify and authenticate the message sent by the player, determine the player's requests and the urgency of the needs based on the video information, classify the player's emotions into levels, and finally make different responses and dispatch reinforcements and resource assistance of different levels.

[0237] Please refer to Figure 15 , which shows a schematic diagram of the NPC's reply to dispatch reinforcements in an exemplary embodiment of the present application.

[0238] Please refer to Figure 16 , which shows a schematic diagram of the NPC's reply to dispatch resource assistance in an exemplary embodiment of the present application.

[0239] 5) Appearance of troops

[0240] After the NPC's reply, a troop will be generated beside the player's main city or the troop. If the player hopes to get troop assistance, a troop with stronger combat power will appear and follow the player to fight. If the player hopes to get companionship, a troop equipped with a language system will follow the player's troop and interact and converse according to the game scenario. If the player hopes to get resource help, a supply transportation team will directly transport the supplies to the player's main city.

[0241] Please refer to Figure 17 , which shows a schematic diagram of the NPC's reinforcement troops in an exemplary embodiment of the present application.

[0242] Please refer to Figure 18 , which shows a schematic diagram of the NPC's companion troops in an exemplary embodiment of the present application.

[0243] Please refer to Figure 19 , which shows a schematic diagram of the NPC's supply troops in an exemplary embodiment of the present application.

[0244] The implementation method of this solution on the technical side is as follows:

[0245] Please refer to Figure 20 , which shows a schematic diagram of the connection method of the fast friend-adding port for face recognition in an exemplary embodiment of the present application. This technical solution is completed by the cooperation of the client and the server.

[0246] Please refer to Figure 21 , which shows a flowchart of the construction of the face recognition system in an exemplary embodiment of the present application. The entire technical solution is based on the technologies of face recognition and speech recognition.

[0247] Please refer to Figure 22 , which shows a flowchart of sending a video information request for NPC assistance in an exemplary embodiment of the present application.

[0248] 1) The server first collects and processes a large number of players' self - taken videos, establishes a video emotion recognition database, and builds a video emotion recognition and emotion intensity classification model.

[0249] 2) The mobile device pre - stores some database information and installs video emotion recognition and speech recognition modules. The pre - installed emotion recognition module on the mobile device can assist players in video recording.

[0250] 3) Player - 1's client uses the camera to record a video and sends the video information and the client's preliminary judgment result to the server.

[0251] 4) The server receives the video information and the preliminary judgment result sent by the client and conducts in - depth recognition and processing. By recognizing the text information in the speech and the emotion information in the video, it determines the player's emotion type, emotion level, and core request. Then the server sends the corresponding instruction information to the player's mobile device.

[0252] 5) After receiving the instruction sent by the server, the player's mobile device performs corresponding operations according to the instruction information, and dispatches troops that meet the player's request type and request intensity to appear near the player's main city.

[0253] Please refer to Figure 23 , which shows the flowchart of the system operation involved in an exemplary embodiment of the present application.

[0254] In summary, in the embodiment of the present application, this method customizes an exclusive NPC troop for players through video and audio recognition technologies. When players need it, they can send information to the NPC by sending a recorded video. The system determines the player's emotion and instructions by recognizing the emotion and requests in the video sent by the player, and assigns an exclusive NPC troop to the player for operations such as resource assistance and reinforcement dispatch. This design can enhance the player's sense of belonging in the early stage, low - cost enhance the interactive gameplay of the game, increase the fun of the game, and avoid player churn.

[0255] Please refer to Figure 24 , which shows the block diagram of an interactive device for a virtual scene provided by an exemplary embodiment of the present application. The device is controlled by a terminal and includes:

[0256] An interface display module 2401, which is used to display the scene interface of the virtual scene. The virtual scene includes a first virtual object controlled by the terminal device;

[0257] A file acquisition module 2402, which is used to respond to a received file acquisition operation and acquire a target file corresponding to a second virtual object controlled by the server. The target file is a multimedia file obtained by collecting multimedia data of the user;

[0258] A file sending module 2403, configured to send a target file to a second virtual object;

[0259] An interaction update module 2404, configured to update and display an interaction screen between the second virtual object and the first virtual object in a scene interface, and the interaction content corresponding to the interaction screen is associated with the user emotion in the target file.

[0260] In some embodiments, a file acquisition module 2402 is configured to,

[0261] In response to receiving a chat trigger operation, display a chat interface with the second virtual object;

[0262] In response to receiving a file acquisition operation performed in the chat interface, acquire a target file.

[0263] In some embodiments, a file acquisition module 2402 is configured to,

[0264] In response to receiving a trigger operation on an acquisition control displayed in the chat interface, start a multimedia data acquisition component of the terminal device to perform acquisition and obtain a target file; or,

[0265] In response to receiving a trigger operation on a file selection control displayed in the chat interface, display each acquired multimedia file, and in response to receiving a selection operation on one or more files among the multimedia files, acquire the file selected by the selection operation as the target file.

[0266] In some embodiments, the interaction content is associated with the emotion information of the user emotion in the target file; the emotion information includes at least one of an emotion type and a strength level of the emotion.

[0267] In some embodiments, the multimedia file includes at least one of the following files:

[0268] An audio file, a video file, an audio-video file, or a picture file.

[0269] In some embodiments, when the multimedia file includes at least one of an audio file and an audio-video file, the interaction content is further associated with the speech text in the target file.

[0270] In some embodiments, before sending the target file to the second virtual object, it further includes:

[0271] Display a preview interface of the target file, and the preview interface includes prompt information of the user emotion.

[0272] In some embodiments, the interaction content is further associated with the state of the first virtual object.

[0273] In summary, in the embodiments of the present application, after receiving a file, the terminal device obtains a target file corresponding to a second virtual object controlled by a server, and sends the target file to the server that controls the second virtual object. The server updates and displays an interaction screen between the second virtual object and the first virtual object according to the content of the target file, where the interaction content corresponding to the interaction screen is associated with the user emotion in the target file; in this solution, the interaction content corresponding to the interaction screen is determined according to the user's emotion content, which improves the accuracy of the interaction content meeting the user's needs. On the other hand, the interaction content is determined through the user emotion content, which expands the way for the user to interact with the virtual scene and enhances the fun of the interaction, thereby improving the interaction effect between the user and the virtual scene.

[0274] Please refer to Figure 25 , which shows a block diagram of an interaction device for a virtual scene provided by an exemplary embodiment of the present application. The device is controlled by a server and includes:

[0275] A file receiving module 1501, configured to receive a target file corresponding to a second virtual object controlled by a server; the target file is obtained and sent by the terminal device when displaying a scene interface of the virtual scene and receiving a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device;

[0276] An emotion recognition module 2502, configured to recognize the user emotion in the target file;

[0277] An information sending module 2503, configured to send interaction information to the terminal device based on the user emotion, where the interaction information is used to instruct the terminal device to update and display an interaction screen between the second virtual object and the first virtual object in the scene interface, and the interaction content corresponding to the interaction screen is associated with the user emotion in the target file.

[0278] In some embodiments, the multimedia file includes at least one of the following files:

[0279] An audio file, a video file, an audio-video file, or a picture file.

[0280] In some embodiments, when the multimedia file includes at least one of an audio file and an audio-video file, sending interaction information to the terminal device based on the user emotion further includes:

[0281] Recognizing the speech text in the target file;

[0282] Sending interaction information to the terminal device based on the user emotion and the speech text.

[0283] In some embodiments, before sending interaction information to the terminal device based on the user emotion, it further includes:

[0284] Obtain the status of the first virtual object;

[0285] Send interaction information to the terminal device based on the user's emotion, including:

[0286] Send interaction information to the terminal device based on the user's emotion and the status of the first virtual object.

[0287] In some embodiments, sending interaction information to the terminal device based on the user's emotion includes:

[0288] Obtain the intensity level of the user's emotion;

[0289] In response to the intensity level of the user's emotion reaching the level threshold, send interaction information to the terminal device.

[0290] In some embodiments, sending interaction information to the terminal device based on the user's emotion includes:

[0291] Obtain the emotion information of the user's emotion, where the emotion information includes at least one of the emotion type and the intensity level of the emotion;

[0292] Send interaction information to the terminal device based on the emotion information of the user's emotion.

[0293] In summary, in the embodiments of the present application, after receiving the target file, the server identifies the user's emotion in the target file through a neural network, and then sends interaction information to the terminal device based on the user's emotion. On the one hand, the accuracy of user emotion recognition is improved, and on the other hand, the user's needs are determined based on emotion recognition, and the determination result can be closer to the user's real needs, ensuring the interaction effect between the user and the virtual scene.

[0294] It should be noted that when the device provided in the above embodiments implements its functions, only the above-mentioned division of each functional module is used for illustration. In actual applications, the above functions can be allocated to different functional modules according to actual needs, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0295] Regarding the device in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method; the technical effects obtained by each module performing operations are the same as those in the embodiments related to the method, and will not be elaborated here.

[0296] Figure 26 The block diagram of a computer device 2600 provided by an exemplary embodiment of the present application is shown. The computer device 2600 may be a portable mobile terminal, such as a smart phone or a tablet computer. The computer device 2600 may also be referred to by other names such as a user device or a portable terminal.

[0297] Generally, the computer device 2600 includes a processor 2601 and a memory 2602.

[0298] The processor 2601 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. The processor 2601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), or PLA (Programmable Logic Array). The processor 2601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 2601 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 2601 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.

[0299] The memory 2602 may include one or more computer-readable storage media, and the computer-readable storage media may be tangible and non-transitory. The memory 2602 may further include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 2602 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 2601 to implement the control method of the virtual object provided in the embodiments of the present application.

[0300] In some embodiments, the computer device 2600 may further optionally include a peripheral device interface 2603 and at least one peripheral device. Specifically, the peripheral device includes at least one of a radio frequency circuit 2604, a touch display screen 2605, a camera 2606, an audio circuit 2607, and a power supply 2608.

[0301] In some embodiments, the computer device 2600 further includes one or more sensors 2609. The one or more sensors 2609 include, but are not limited to: an acceleration sensor 2610, a gyroscope sensor 2611, a pressure sensor 2612, an optical sensor 2613, and a proximity sensor 2614.

[0302] Those skilled in the art can understand that the structures shown above do not constitute a limitation on the computer device 2600, and it may include more or fewer components than shown in the figure, or combine certain components, or adopt different component arrangements.

[0303] In an exemplary embodiment, a chip is further provided. The chip includes programmable logic circuits and / or program instructions, and when the chip runs on a computer device, it is used to implement the above-mentioned interactive method for a virtual scene.

[0304] In an exemplary embodiment, a computer program product is further provided. The computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor reads and executes the computer instructions to implement the interactive method for a virtual scene provided by the above-mentioned method embodiments.

[0305] In an exemplary embodiment, a computer-readable storage medium is further provided. The computer-readable storage medium stores a computer program, and the computer program is loaded and executed by a processor to implement the interactive method for a virtual scene provided by the above-mentioned method embodiments.

[0306] Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium, and the above-mentioned storage medium can be a read-only memory, a disk, an optical disc, etc.

[0307] Those skilled in the art should be able to realize that in the above one or more examples, the functions described in the embodiments of the present application can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, where communication media includes any medium that facilitates the transfer of a computer program from one place to another. The storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0308] The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. An interactive method for a virtual scenario, characterized in that The method is executed by a terminal device, and the method includes: Displaying a scene interface of the virtual scene, where the virtual scene includes a first virtual object controlled by the terminal device; In response to receiving a file acquisition operation, acquiring a target file corresponding to a second virtual object controlled by a server, where the target file is a multimedia file obtained by collecting multimedia data of a user; Sending the target file to the second virtual object; Updating and displaying, in the scene interface, an interaction picture between the second virtual object and the first virtual object, where the interaction content corresponding to the interaction picture is associated with the user emotion in the target file.

2. The method according to claim 1, characterized in that, The acquiring, in response to receiving a file acquisition operation, a target file corresponding to a second virtual object includes: In response to receiving a chat trigger operation, displaying a chat interface with the second virtual object; In response to receiving the file acquisition operation performed in the chat interface, acquiring the target file.

3. The method according to claim 2, wherein The acquiring, in response to receiving the file acquisition operation performed in the chat interface, the target file includes: In response to receiving a trigger operation on a collection control displayed in the chat interface, starting a multimedia data collection component of the terminal device to perform collection to obtain the target file; or, In response to receiving a trigger operation on a file selection control displayed in the chat interface, displaying each collected multimedia file, and in response to receiving a selection operation on one or more files among the each multimedia file, acquiring the file selected by the selection operation as the target file.

4. The method according to any one of claims 1 to 3, characterized in that, The interaction content is associated with the emotion information of the user emotion in the target file; the emotion information includes at least one of an emotion type and a strength level of the emotion.

5. The method according to any one of claims 1 to 3, characterized in that The multimedia file includes at least one of the following files: An audio file, a video file, an audio-video file, or a picture file.

6. The method according to claim 5, wherein In a case where the multimedia file includes at least one of an audio file and an audio-video file, the interaction content is further associated with the speech text in the target file.

7. The method according to any one of claims 1 to 3, characterized in that Before sending the target file to the second virtual object, it further includes: Displaying a preview interface of the target file, where the preview interface includes prompt information of the user emotion.

8. The method according to any one of claims 1 to 3, characterized in that The interaction content is further associated with the state of the first virtual object.

9. An interactive method for a virtual scene, characterized in that, The method is executed by a server, and the method includes: Receiving a target file corresponding to a second virtual object controlled by the server; the target file is acquired and sent by the terminal device when displaying a scene interface of the virtual scene and receiving a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device; Identifying the user emotion in the target file; Sending interaction information to the terminal device based on the user emotion, where the interaction information is used to instruct the terminal device to update and display, in the scene interface, an interaction picture between the second virtual object and the first virtual object, where the interaction content corresponding to the interaction picture is associated with the user emotion in the target file.

10. The method according to claim 9, wherein The multimedia file includes at least one of the following files: An audio file, a video file, an audio-video file, or a picture file.

11. The method according to claim 10, wherein When the multimedia file includes at least one of an audio file and an audio-video file, the sending of interaction information to the terminal device based on the user's emotion further includes: Identifying the speech text in the target file; Based on the user's emotion and the speech text, sending the interaction information to the terminal device.

12. The method according to claim 9, wherein Before sending the interaction information to the terminal device based on the user's emotion, it further includes: Obtaining the state of the first virtual object; The sending of interaction information to the terminal device based on the user's emotion includes: Based on the user's emotion and the state of the first virtual object, sending the interaction information to the terminal device.

13. The method according to any one of claims 9 to 12, characterized in that, The sending of interaction information to the terminal device based on the user's emotion includes: Obtaining the strength level of the user's emotion; In response to the strength level of the user's emotion reaching a level threshold, sending the interaction information to the terminal device.

14. The method according to any one of claims 9 to 12, characterized in that, The sending of interaction information to the terminal device based on the user's emotion includes: Obtaining the emotion information of the user's emotion, where the emotion information includes at least one of an emotion type and a strength level of the emotion; Based on the emotion information of the user's emotion, sending the interaction information to the terminal device.

15. An interactive device for a virtual scene, characterized in that, The device includes: An interface display module, configured to display the scene interface of the virtual scene, where the virtual scene includes a first virtual object controlled by the terminal device; A file acquisition module, configured to, in response to receiving a file acquisition operation, acquire a target file corresponding to a second virtual object controlled by a server, where the target file is a multimedia file obtained by performing multimedia data acquisition on a user; A file sending module, configured to send the target file to the second virtual object; An interaction update module, configured to update and display, in the scene interface, an interaction picture between the second virtual object and the first virtual object, where the interaction content corresponding to the interaction picture is associated with the user's emotion in the target file.

16. An interactive device for a user's virtual scene, characterized in that, The device includes: A file receiving module, configured to receive a target file corresponding to a second virtual object controlled by the server; the target file is acquired and sent by the terminal device when displaying the scene interface of the virtual scene and receiving a file acquisition operation; the virtual scene includes a first virtual object controlled by the terminal device; An emotion recognition module, configured to recognize the user's emotion in the target file; An information sending module, configured to send interaction information to the terminal device based on the user's emotion, where the interaction information is used to instruct the terminal device to update and display, in the scene interface, an interaction picture between the second virtual object and the first virtual object, where the interaction content corresponding to the interaction picture is associated with the user's emotion in the target file.

17. A computer device, characterized in that, The computer device includes a processor and a memory, and the memory stores at least one computer instruction, and the at least one computer instruction is loaded and executed by the processor to implement the interactive method for a virtual scene according to any one of claims 1 to 14.

18. A computer-readable storage medium, characterized in that, At least one computer instruction is stored in the computer-readable storage medium, and the computer instruction is loaded and executed by a processor to implement the interactive method for a virtual scenario according to any one of claims 1 to 14.

19. A computer program product, characterized in that, The computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; the computer instructions are read and executed by a processor of a computer device to implement the interactive method for a virtual scenario according to any one of claims 1 to 14.

Images