Virtual character processing method and device, computer equipment and storage medium
By adjusting the posture of the virtual character in the metaverse virtual conversation scene, the problem of rigid actions of the virtual character is solved, and interactivity and authenticity are improved.
Patent Information
- Application Number
- CN202311323250.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-12
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2043-10-12
AI Technical Summary
In the prior art, virtual characters in meta-universe virtual conversation scenes have rigid actions, resulting in a single interaction method and poor interactivity and authenticity.
By obtaining the audio information and location information of the current speaking virtual character, as well as the location information of the virtual character of other listening users, the role posture of the virtual character of other listening users is adjusted to improve the flexibility of the virtual character.
It enriches the interaction methods between virtual objects and improves the interactivity and authenticity of virtual characters.
Smart Images

Figure CN119818938A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method, device, computer equipment and storage medium for processing a virtual character. Background Art
[0002] With the continuous development of computer communication technology, the widespread application of terminals such as smart phones, tablets and laptops, terminals are developing in a diversified and personalized direction, and are increasingly becoming indispensable electronic devices in people's lives and work. In order to meet people's needs for communication, virtual conversation scenes that can conduct conversational interactions on terminals have emerged. For example, users can use metaverse virtual conversation scenes to communicate. Metaverse virtual conversation scenes are a way for users to work in the metaverse. Through virtual reality technology, users can communicate, collaborate and work in digital virtual conversation scenes. Specifically, users can create conversation channels in virtual conversation scenes and invite other users to access the conversation channel for virtual conversations to meet the user's needs for multi-person communication.
[0003] At present, when a multi-person conversation is conducted in a virtual conversation scene of the metaverse, the virtual character corresponding to each user will be displayed in the virtual conversation scene, and each user can communicate and operate in the virtual conversation scene through the virtual character. However, in the prior art, the actions of the virtual characters corresponding to each user participating in the virtual conversation are all directed forward during the conversation, and the role actions of the virtual characters during the virtual conversation are rigid, resulting in a single interaction method between the virtual characters, and poor interactivity and authenticity of the virtual characters. Summary of the invention
[0004] The embodiments of the present application provide a method, apparatus, computer device and storage medium for processing a virtual character. By determining the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, the character postures of the virtual characters of other listening users are adjusted, thereby improving the flexibility of the virtual characters, enriching the interaction methods between virtual objects, and improving the interactivity and authenticity of the virtual characters.
[0005] The embodiment of the present application provides a method for processing a virtual character, wherein a virtual conversation interface is provided through a first terminal device, and the virtual conversation interface displays: a first conversation screen obtained by photographing a first virtual character controlled by the first terminal device in a virtual conversation scene according to a first shooting angle, wherein the first conversation screen includes at least part of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in a current virtual conversation, and the second virtual character is a virtual character controlled by a second terminal device, and the method includes:
[0006] Acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene;
[0007] Acquire second position information of the second virtual character;
[0008] adjusting a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character;
[0009] The second virtual character in the virtual conversation scene is controlled to execute the target character gesture, so that the second virtual character executing the target character gesture is displayed in the first conversation screen.
[0010] Accordingly, an embodiment of the present application further provides a virtual character processing device, which provides a virtual conversation interface through a first terminal device, wherein the virtual conversation interface displays: a first conversation screen obtained by photographing a first virtual character controlled by the first terminal device in a virtual conversation scene according to a first shooting angle, wherein the first conversation screen includes at least part of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in the current virtual conversation, wherein the second virtual character is a virtual character controlled by a second terminal device, and the virtual character processing device includes:
[0011] A first acquisition unit, configured to acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene;
[0012] A second acquiring unit, configured to acquire second position information of the second virtual character;
[0013] an adjusting unit, configured to adjust a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character;
[0014] A control unit is used to control the second virtual character in the virtual conversation scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in the first conversation screen.
[0015] Accordingly, an embodiment of the present application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, any of the methods for processing a virtual character as described above is implemented.
[0016] Accordingly, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, any of the methods for processing a virtual character as described above is implemented.
[0017] The embodiment of the present application provides a method, device, computer equipment and storage medium for processing a virtual character, by obtaining the audio information and first position information of the first virtual character currently speaking in the current virtual conversation, and playing the audio corresponding to the audio information in the virtual conversation scene; then, obtaining the second position information of the second virtual character; then, adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character; finally, controlling the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first conversation screen. The embodiment of the present application determines the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, and adjusts the character posture of the virtual characters of other listening users, thereby improving the flexibility of the virtual characters, enriching the interaction methods between virtual objects, and improving the interactivity and authenticity of the virtual characters. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 4 is a system schematic diagram of a virtual character processing device provided in an embodiment of the present application.
[0020] Figure 2 It is a flowchart of a method for processing a virtual character provided in an embodiment of the present application.
[0021] Figure 3 It is a scenario diagram of a method for processing a virtual character provided in an embodiment of the present application.
[0022] Figure 4 This is another scenario diagram of the method for processing a virtual character provided in an embodiment of the present application.
[0023] Figure 5 This is another scenario diagram of the method for processing a virtual character provided in an embodiment of the present application.
[0024] Figure 6This is another scenario diagram of the method for processing a virtual character provided in an embodiment of the present application.
[0025] Figure 7 It is a structural diagram of a virtual character processing device provided in an embodiment of the present application.
[0026] Figure 8 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0027] The technical solutions in the embodiments of the present disclosure will be described clearly and completely below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.
[0028] The embodiments of the present disclosure provide a method, device, computer equipment and storage medium for processing a virtual character. Specifically, the method for processing a virtual character of the embodiments of the present disclosure can be executed by a computer device, wherein the computer device can be a terminal or a server or other device. The terminal can be a terminal device such as a smart phone, a tablet computer, a laptop computer, a touch screen, a game console, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA), etc. The terminal can also include a client, which can be an application client, a browser client carrying an application, or an instant messaging client, etc. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.
[0029] For example, when the processing method of the virtual character is run on the terminal, the terminal device stores an application and is used to present a virtual conversation scene in the conversation screen. The terminal device is used to interact with the user through the virtual conversation interface, for example, by downloading and installing the application and running it through the terminal device. The terminal device may provide the virtual conversation interface to the user in a variety of ways, for example, it may be rendered and displayed on the display screen of the terminal device, or a graphical user interface may be presented through holographic projection. For example, the terminal device may include a touch display screen and a processor, the touch display screen is used to present a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface, the virtual conversation interface includes a conversation screen, and the processor is used to run the application, generate a virtual conversation interface, respond to operation instructions, and control the display of the virtual conversation interface on the touch display screen.
[0030] See also Figure 1 , Figure 1 A scene diagram of a processing system for a virtual character provided by an embodiment of the present disclosure. The system may include at least one terminal, at least one server, at least one database, and a network. The terminal held by the user can be connected to different servers through a network. The terminal is any device with computing hardware that can support and execute software products corresponding to the game. In addition, when the system includes multiple terminals, multiple servers, and multiple networks, different terminals can be connected to each other through different networks and different servers. The network can be a wireless network or a wired network, such as a wireless network such as a wireless local area network (WLAN), a local area network (LAN), a cellular network, a 2G network, a 3G network, a 4G network, a 5G network, etc. In addition, different terminals can also use their own Bluetooth network or hotspot network to connect to other terminals or to servers, etc. For example, multiple users can be online through different terminals and connected and synchronized with each other through appropriate networks to support multi-user conversations. In addition, the system may include multiple databases, multiple databases are coupled to different servers, and information related to the conversation environment can be continuously stored in the database when different users are online for multi-user conversations.
[0031] It should be noted that Figure 1 The scenario diagram of the virtual character processing system shown is merely an example. The virtual character processing system and scenario described in the embodiments of the present disclosure are intended to more clearly illustrate the technical solution of the embodiments of the present disclosure, and do not constitute a limitation on the technical solution provided by the embodiments of the present disclosure. A person of ordinary skill in the art can appreciate that with the emergence of new business scenarios, the technical solution provided by the embodiments of the present disclosure is equally applicable to similar technical problems.
[0032] Based on the above problems, the embodiments of the present disclosure provide a method, device, computer equipment and storage medium for processing virtual characters, which can improve the flexibility of virtual characters, enrich the interaction methods between virtual objects, and improve the interactivity and authenticity of virtual characters. The following are detailed descriptions. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.
[0033] The embodiment of the present disclosure provides a method for processing a virtual character, which can be executed by a terminal or a server. The embodiment of the present disclosure takes the execution of the method for processing a virtual character by a terminal as an example for explanation, and a virtual conversation interface can be provided by a terminal device, and the virtual conversation interface includes at least part of a virtual conversation scene, and at least two virtual characters located in the virtual conversation scene and participating in the current virtual conversation. Specifically, a virtual conversation interface can be provided by a first terminal device, and the virtual conversation interface displays: a first conversation screen obtained by photographing a first virtual character in a virtual conversation scene controlled by the first terminal device according to a first shooting angle, wherein the first conversation screen includes at least part of a virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in the current virtual conversation, and the second virtual character is a virtual character controlled by a second terminal device. Part of the virtual conversation scene is determined according to the visual perspective of the virtual character controlled by the terminal device, and the graphical user interface can also display part of the virtual characters, and the part of the virtual characters are virtual characters displayed in part of the virtual conversation scene, and the part of the virtual characters can be virtual characters in the same virtual conversation as the virtual character, or virtual characters in different virtual conversations with the virtual character, or other virtual characters without conversations that do not participate in any virtual conversations. In addition, the second terminal device can provide a virtual conversation interface through the second terminal device, and the virtual conversation interface displays: a second conversation screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual conversation scene according to the second shooting perspective, wherein the second conversation screen includes at least part of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in the current virtual conversation. The first shooting angle may be a angle of view for shooting from behind, in front of or above the first virtual character, for example, it may be a shooting angle of view for shooting from the front or behind of the first virtual character with the first virtual character as the center and the first preset value as the radius. The second shooting angle of view may be a angle of view for shooting from behind, in front of or above the second virtual character, for example, it may be a shooting angle of view for shooting from the front or behind of the second virtual character with the second virtual character as the center and the second preset value as the radius. This is only for illustration, and more possible implementation methods will not be elaborated here.
[0034] In the disclosed embodiment, the virtual conversation scene is a virtual environment displayed (or provided) when the application is running on the terminal. The virtual environment can be a simulation environment of the real world, a semi-simulation and semi-fictitious three-dimensional environment, or a purely fictitious three-dimensional environment. The virtual environment is used for a virtual conversation between at least two virtual characters, and there are virtual resources available for at least two virtual characters in the virtual environment. One or more virtual characters can be displayed in the virtual conversation scene. The virtual character can be a virtual character controlled by the user through the terminal, or a virtual character in the same virtual conversation as the virtual character, or a virtual character in a different virtual conversation with the virtual character, or other virtual characters without conversations that do not participate in any virtual conversations. In the virtual conversation scene, there can be virtual characters in the same virtual conversation as the virtual character, virtual characters in different virtual conversations with the virtual character, and virtual characters without conversations, which are exemplified here and are not limited thereto. A virtual character refers to an active object in a virtual environment. A virtual character refers to a virtual object in a game that is controlled by a user through a terminal.
[0035] See also Figure 2 , Figure 2 A flowchart of a method for processing a virtual character provided in an embodiment of the present application is provided. The specific process may be as follows: Steps 101 to 104:
[0036] 101 , obtaining audio information and first position information of a first virtual character who is currently speaking in the current virtual conversation, and playing audio corresponding to the audio information in the virtual conversation scene.
[0037] In an embodiment of the present application, a virtual conversation interface can be provided by a first terminal device, and the virtual conversation interface displays a first conversation screen obtained by photographing a first virtual character controlled by the first terminal device in a virtual conversation scene according to a first shooting perspective, wherein the first conversation screen includes at least a portion of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in the current virtual conversation, the second virtual character is a virtual character controlled by a second terminal device, and a virtual character is associated with a user conversation account participating in the current virtual conversation.
[0038] Specifically, before conducting a virtual conversation, the first user controlling the first virtual character can first determine the group of people who need to communicate. For example, the first user can click the control to apply for creating a virtual conversation in the virtual conversation scene to initiate the virtual conversation, and can invite the second user to join the same virtual conversation for communication by clicking the second virtual character corresponding to the second user in the virtual conversation scene, or the user identifier corresponding to the second user, wherein the second user is a user other than the first user in the virtual conversation scene. At this time, the client of the first user can send a request for virtual conversation creation to the server, and the server can record the user information of the second user selected by the first user, create a separate communication channel for the first user and multiple second users, and return it to the client of the first user and the client of the second user. Then, the user interface of the client of the first user and the client of the second user can be switched to a virtual conversation interface, and the position and viewing direction of the virtual character corresponding to the above user can be moved, and the virtual character corresponding to the above user can be changed into a circle, indicating that the current scene is a virtual conversation scene in which multiple users communicate together, thereby forming an initial conversation group.
[0039] In the above process, the virtual character corresponding to the first user and the virtual character corresponding to the second user are all virtual characters in the virtual world. Each virtual character can play the corresponding character animation. For example, the character animation is an animation that simulates a real person, such as standing with both hands vertically lowered, dynamic shaking of the character, and other animations.
[0040] Furthermore, when the first user invites the second user to join the same virtual conversation, at this time, when the second virtual character corresponding to the other second user is facing away from or not facing the first virtual character of the first user, the second virtual character can make a reaction animation, which can be the second virtual character turning its body and face toward the first virtual character, and attaching specified hand movements, such as clapping, waving hands, and other hand movements.
[0041] In an embodiment of the present application, the method further includes:
[0042] Displaying a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of a virtual conversation scene and a plurality of virtual characters located in the virtual conversation scene;
[0043] In response to a refusal to attend a meeting instruction from a target virtual character among the multiple virtual characters, determining a preset character posture corresponding to the refusal to attend a meeting instruction;
[0044] The target virtual character is controlled to perform the preset character gesture, so as to display the target virtual character performing the preset character gesture in the first conversation screen.
[0045] For example, see Figure 3 , the computer device may display a virtual conversation interface, in which a virtual conversation scene and a first virtual character, a second virtual character and a third virtual character in the virtual conversation scene are displayed, and the first virtual character, the second virtual character and the third virtual character are virtual characters in the same virtual conversation. At this time, since no virtual character speaks in the virtual conversation, the first virtual character, the second virtual character and the third virtual character are all default character actions, that is, the heads of the virtual characters are all facing forward. When the server receives the application for a virtual session sent by the client of the first user, it will send an application request to the second user corresponding to the second virtual character invited to join the same virtual session, and the second user corresponding to the third virtual character. If the second user of the third virtual character refuses to attend the session, the server receives a refusal to attend instruction sent by the client of the second user of the third virtual character, and in response to the refusal to attend instruction of the target virtual character among the multiple virtual characters, determines a preset character posture corresponding to the refusal to attend instruction; then, sends the preset character posture to the clients of all users to control the target virtual character to execute the preset character posture, so as to display the target virtual character executing the preset character posture in the session screen displayed by the clients of all users. The preset character posture can be a character posture such as shaking head or waving hands.
[0046] Specifically, when the server receives the application for the virtual session sent by the client of the first user, it will send an application request to the second user who is invited to join the same virtual session. When the invited second user agrees to participate in the virtual session, the client of the invited second user will send an invitation result of agreeing to join to the server. Then, the server will add the second user who agrees to participate and the first user to a separate channel. The second virtual characters of the remaining second users who do not agree to the invitation will make a rejection animation, which can be a shaking head or waving hand to reject the current invitation of the first user, and the second virtual character will turn its body back to the previous direction. Alternatively, the second virtual character corresponding to the second user may not play any animation.
[0047] In one embodiment, after the step of “obtaining audio information and first position information of the first virtual character currently speaking in the current virtual conversation”, the method may include:
[0048] Adjusting the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character;
[0049] The first virtual character in the virtual conversation scene is controlled to execute the target character action, so that the first virtual character executing the target character action is displayed in the first conversation screen.
[0050] Specifically, the step of “adjusting the designated role action of the first virtual role based on the audio information to obtain the target role action of the first virtual role” may include:
[0051] Adjusting the mouth movement of the first virtual character based on the audio information to obtain a target character lip movement of the first virtual character as a target character movement;
[0052] and / or
[0053] The hand movement of the first virtual character is adjusted based on the audio information to obtain a target hand movement of the first virtual character as a target character movement.
[0054] Furthermore, the step of “controlling the first virtual character in the virtual conversation scene to perform the target character action” may include:
[0055] When the target character action includes the target character lip movement, controlling the mouth of the first virtual character in the virtual conversation scene to perform the target character lip movement;
[0056] When the target character action includes the target hand action, the hand of the first virtual character in the virtual conversation scene is controlled to perform the target hand action.
[0057] Among them, the target character's lip movements can be lip movements pre-set for the virtual character, for example, the virtual character's mouth opens and closes regularly when the virtual character is speaking, until the user corresponding to the virtual character finishes speaking, and the lip movement also ends; the virtual character's mouth can also make lip movements corresponding to the audio information when the user is speaking, for example, the audio information is "Let's start the meeting", and the virtual character's lip movements make lip movements corresponding to "Let's start the meeting".
[0058] For example, see Figure 4, the computer device can display a virtual conversation interface, in which a virtual conversation scene, as well as a first virtual character, a second virtual character, and a third virtual character in the virtual conversation scene are displayed, and the first virtual character, the second virtual character, and the third virtual character are virtual characters in the same virtual conversation. At this time, when the computer device detects that the first virtual character can speak in the virtual conversation, the computer device can obtain the audio information and the first position information of the first virtual character who is currently speaking in the current virtual conversation, play the audio corresponding to the audio information in the virtual conversation scene, and the computer device adjusts the hand movement of the first virtual character based on the audio information to obtain the target hand movement of the specified virtual character as the target character movement, that is, the first virtual character performs a hand-raising movement. Among them, the target character movement can also be a rhythmic waving or swinging according to the user corresponding to the first virtual character when speaking.
[0059] In order to synchronously display the first virtual character performing the target character action to all clients participating in the current virtual session, after the step of "adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character", the method may include:
[0060] The target character action of the first virtual character is sent to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the second session screen on the virtual session interface provided by the second terminal device.
[0061] In order to make the virtual conversation scene more consistent with the real conversation scene, the step of "playing the audio corresponding to the audio information in the virtual conversation scene" may include:
[0062] Adjusting and processing the audio information based on the first position information and the second position information to obtain target spatial audio;
[0063] The target spatial audio is played in the virtual session scene.
[0064] Furthermore, the step of “adjusting and processing the audio information based on the first position information and the second position information to obtain the target spatial audio” may include:
[0065] Determine target distance information and sound source location information based on the first location information and the second location information;
[0066] adjusting the volume of the audio information based on the target distance information to obtain processed audio information;
[0067] A target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual conversation scene based on the sound source position information.
[0068] Specifically, the embodiment of the present application can adjust the volume of the audio information based on the target distance information to obtain processed audio information. For example, the virtual characters participating in the current virtual conversation in the virtual conversation scene include a first virtual character, a second virtual character and a third virtual character. The first virtual character is controlled by a first terminal device, the second virtual character is controlled by a second terminal device, and the third virtual character is controlled by a third terminal device. At this time, the first user corresponding to the first virtual character speaks through the first terminal device to generate audio information. Then, in the virtual conversation scene of the virtual conversation interface of the first terminal device, the target spatial audio with a first volume value is played. Then, the second terminal device obtains the second position information of the second virtual character and the first position information of the first virtual character, and determines the first target distance information and the sound source position information based on the first position information and the second position information. The first target distance information is the position distance between the first position information and the second position information. The first volume value of the audio information is adjusted based on the first target distance information to obtain audio information of a second volume value; the first target spatial audio is generated based on the audio information of the second volume value, and the first target spatial audio is played in a virtual conversation scene in a virtual conversation interface of the second terminal device based on the sound source position information; similarly, the third terminal device obtains the third position information of the third virtual character and the first position information of the first virtual character, determines the second target distance information and the sound source position information based on the first position information and the third position information, the second target distance information is the position distance between the first position information and the third position information, and adjusts the first volume value of the audio information based on the second target distance information to obtain audio information of a third volume value; the second target spatial audio is generated based on the audio information of the third volume value, and the second target spatial audio is played in the virtual conversation scene in the virtual conversation interface of the third terminal device based on the sound source position information. Among them, since the position distance corresponding to the first target distance information is smaller than the position distance corresponding to the second target distance information, the second volume value is greater than the third volume value, and the first volume value is greater than the second volume value, so that the volume value of the target space audio in the virtual conversation scene of the first virtual character is the largest, and the volume value of the target control audio in the virtual conversation scene of the virtual character that is closer to the first virtual character is greater, and the volume value of the target control audio in the virtual conversation scene of the virtual character that is farther away from the first virtual character is smaller.
[0069] 102. Obtain second position information of the second virtual character.
[0070] In an embodiment of the present application, after acquiring the second position information of the second virtual character, the first terminal device may send the audio information, the first position information, and the second position information to the second terminal device, so that the second terminal device adjusts the current character posture of the second virtual character based on the first position information and the second position information, obtains the target character posture of the second virtual character, controls the second virtual character in the virtual conversation scene to execute the target character posture, and displays the second virtual character executing the target character posture in the second conversation screen on the virtual conversation interface provided by the second terminal device, wherein the second conversation screen is a conversation screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual conversation scene according to the second shooting perspective; and the second terminal device may also determine the target distance information and the sound source position information based on the first position information and the second position information, and then adjust the volume of the audio information based on the target distance information to obtain the processed audio information, and finally, generate the target spatial audio based on the processed audio information, and play the target spatial audio in the virtual conversation scene based on the sound source position information.
[0071] In an embodiment of the present application, the first terminal device may obtain the position information of the second virtual character in the virtual conversation scene as the second position information. The first terminal device may receive the position information of the second virtual character in the virtual conversation scene sent by the second terminal device as the second position information.
[0072] 103 . Adjust the current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character.
[0073] For example, the target character posture of the second virtual character includes but is not limited to head rotation, synchronous body rotation and limb animation, among which the limb animation may include crossing legs, crossing arms across the chest, clapping hands, and giving thumbs up.
[0074] In the embodiment of the present application, the step of “adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character” may include:
[0075] determining a target adjustment direction based on the first position information and the second position information;
[0076] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.
[0077] Furthermore, the step of “controlling the second virtual character in the virtual conversation scene to perform the target character gesture” may include:
[0078] The head of the second virtual character in the virtual conversation scene is controlled to face the target head orientation.
[0079] Specifically, the virtual session interface of the second terminal device displays a first function control and a second function control, and a function control is associated with a direction determination logic. Before the step of “determining the target adjustment direction based on the first position information and the second position information”, the method may include:
[0080] The second terminal device determines, in response to a trigger operation on the first function control, a first direction determination logic corresponding to the first function control, and sends the first direction determination logic to the first terminal device, so that the first terminal device determines a first target adjustment direction based on the first position information, the second position information, and the first direction determination logic, wherein the first target adjustment direction is a direction in which the head of the second virtual character faces the first position corresponding to the first position information;
[0081] The determining the target adjustment direction based on the first position information and the second position information includes:
[0082] Based on the first position information, the second position information and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
[0083] In another specific embodiment, before the step of “determining the target adjustment direction based on the first position information and the second position information”, the method further includes:
[0084] The second terminal device determines the second direction determination logic corresponding to the second function control in response to the trigger operation on the second function control, and sends the second direction determination logic to the first terminal device, so that the first terminal device determines the second target adjustment direction based on the first position information, the second position information and the second direction determination logic, wherein the second target adjustment direction is: the direction in which the head of the second virtual character is facing away from the first position;
[0085] The determining the target adjustment direction based on the first position information and the second position information includes:
[0086] Based on the first position information, the second position information and a second direction determination logic, a second target adjustment direction is determined, wherein the second target adjustment direction is a direction in which the head of the second virtual character is facing away from the first position.
[0087] Specifically, determining the target adjustment direction based on the first position information and the second position information includes:
[0088] Receiving a first direction determination logic sent by the second terminal device;
[0089] Based on the first position information, the second position information and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
[0090] Optionally, determining the target adjustment direction based on the first position information and the second position information includes:
[0091] Receiving a second direction determination logic sent by the second terminal device;
[0092] Based on the first position information, the second position information and a second direction determination logic, a second target adjustment direction is determined, wherein the second target adjustment direction is a direction in which the head of the second virtual character is facing away from the first position.
[0093] Specifically, the embodiment of the present application can determine a first target adjustment direction based on the first position information, the second position information and a first preset head rule, wherein the first target adjustment direction is the direction in which the head of the second virtual character faces the first position.
[0094] For example, a computer device may display a virtual conversation interface, in which a virtual conversation scene is displayed, as well as a first virtual character, a second virtual character, and a third virtual character in the virtual conversation scene, wherein the first virtual character, the second virtual character, and the third virtual character are virtual characters in the same virtual conversation. At this time, when the computer device detects that the first virtual character can speak in the virtual conversation, the computer device may obtain the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, play the audio corresponding to the audio information in the virtual conversation scene, and the computer device may obtain the second position information of the second virtual character, the third position information of the third virtual character, and the first preset head rule, determine the first adjustment direction and the second adjustment direction, wherein the first adjustment direction faces the head of the second virtual character in the direction of the first position, and the second adjustment direction faces the head of the third virtual character in the direction of the first position.
[0095] Optionally, the embodiment of the present application may determine a second target adjustment direction based on the first position information, the second position information and a second preset head rule, wherein the second target adjustment direction is a direction in which the second virtual character's head is facing away from the first position.
[0096] In one embodiment, after the step of “adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character”, the method may include:
[0097] The target character gesture of the second virtual character is sent to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in a second session screen on the virtual session interface provided by the second terminal device, wherein the second session screen is a session screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual session scene according to a second shooting perspective.
[0098] 104 , controlling a second virtual character in the virtual conversation scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in the first conversation screen.
[0099] In an embodiment of the present application, the first terminal device may control the second virtual character in the virtual conversation scene to execute the target character gesture in response to a trigger instruction for the target character gesture.
[0100] For example, see Figure 5, the computer device can display a virtual conversation interface, in which a virtual conversation scene is displayed, and a first virtual character, a second virtual character, and a third virtual character in the virtual conversation scene, wherein the first virtual character, the second virtual character, and the third virtual character are virtual characters in the same virtual conversation. At this time, when the computer device detects that the first virtual character can speak in the virtual conversation, the computer device can obtain the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, and play the audio corresponding to the audio information in the virtual conversation scene, and the computer device can obtain the second position information of the second virtual character, the third position information of the third virtual character, and the first preset head rule, and determine the first adjustment direction and the second adjustment direction, wherein the first adjustment direction faces the head of the second virtual character to the direction of the first position, and the second adjustment direction faces the head of the third virtual character to the direction of the first position. Then, the computer device can control the heads of the second virtual character and the third virtual character in the virtual conversation scene to face the first virtual character based on the adjustment directions corresponding to the second virtual character and the third virtual character in the virtual conversation scene.
[0101] For example, see Figure 6, the computer device can display a virtual conversation interface, in which a virtual conversation scene is displayed, and a first virtual character, a second virtual character, and a third virtual character in the virtual conversation scene, wherein the first virtual character, the second virtual character, and the third virtual character are virtual characters in the same virtual conversation. At this time, when the computer device detects that the first virtual character can speak in the virtual conversation, the computer device can obtain the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, and play the audio corresponding to the audio information in the virtual conversation scene. When the computer device detects that the first virtual character can speak in the virtual conversation, the computer device can obtain the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, and play the audio corresponding to the audio information in the virtual conversation scene, and the computer device adjusts the hand movement of the first virtual character based on the audio information to obtain the target hand movement of the designated virtual character as the target character movement, and the target character movement includes but is not limited to the first virtual character performing a hand-raising movement, a hand-waving movement, or a head-turning movement. It should be noted that when the first virtual character speaks in the virtual conversation, the animation corresponding to the above target character movement may not be played. Among them, the animation played by the first virtual character can be based on audio settings, or it can be an animation actively played by the first user, and the animation can be a lip animation or an eye blinking animation. Furthermore, the computer device can obtain the second position information of the second virtual character, the third position information of the third virtual character, and the first preset head rule to determine the first adjustment direction and the second adjustment direction, wherein the first adjustment direction faces the head of the second virtual character to the direction of the first position, and the second adjustment direction faces the head of the third virtual character to the direction of the first position. Then, the computer device can control the heads of the second virtual character and the third virtual character in the virtual conversation scene to face the first virtual character based on the adjustment directions corresponding to the second virtual character and the third virtual character in the virtual conversation scene.
[0102] In a specific embodiment, after the first terminal device corresponding to the first virtual character (i.e., the speaker's terminal device) and the second terminal device corresponding to the second virtual character (i.e., the listener's terminal device) respectively obtain the target character posture of the second virtual character, the first terminal device can control the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first conversation screen of the virtual conversation interface provided by the first terminal device. At this time, the current first perspective conversion parameter can be obtained, and the first shooting perspective can be adjusted based on the first perspective conversion parameter to update and display the first conversation screen; at the same time, the second terminal device can control the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the second conversation screen of the virtual conversation interface provided by the second terminal device. At this time, the current second perspective conversion parameter can be obtained, and the second shooting perspective can be adjusted based on the second perspective conversion parameter to update and display the second conversation screen.
[0103] Specifically, the embodiment of the present application further provides a method for processing a virtual character, which is specifically used in a second terminal device, and the specific process can be as follows:
[0104] (1) The second terminal device receives a location information acquisition request sent by the first terminal device, wherein when the first terminal device detects that the first virtual character is speaking, a location information acquisition request is generated and sent to the second terminal device, so as to request the second terminal device to acquire the second location information of the second virtual character, and send the second location information of the second virtual character to the first terminal device.
[0105] (2) The second terminal device obtains the second location information of the second virtual character based on the location information acquisition request, and sends the second location information of the second virtual character to the first terminal device.
[0106] (3) The second terminal device receives the target character gesture of the second virtual character sent by the first terminal device, and the second terminal device controls the second virtual character in the virtual conversation scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in a second conversation screen on the virtual conversation interface provided by the second terminal device, wherein the second conversation screen is a conversation screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual conversation scene according to a second shooting perspective.
[0107] Optionally, the embodiment of the present application further provides a method for processing a virtual character, which is specifically used in a second terminal device, and the specific process may be as follows:
[0108] (1) The second terminal device receives the audio information and first position information of the first virtual character currently speaking in the current virtual conversation sent by the first terminal device.
[0109] (2) The second terminal device adjusts the current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character.
[0110] (3) The second terminal device controls the second virtual character in the virtual conversation scene to perform the target character gesture, so as to display the second virtual character performing the target character gesture in the second conversation screen on the virtual conversation interface provided by the second terminal device, wherein the second conversation screen is a conversation screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual conversation scene according to the second shooting angle. In addition, the second terminal device determines the target distance information and the sound source location information based on the first location information and the second location information, adjusts the volume of the audio information based on the target distance information, and obtains the processed audio information; then, generates the target spatial audio based on the processed audio information, and plays the target spatial audio in the virtual conversation scene displayed in the second conversation screen of the second terminal device based on the sound source location information.
[0111] Based on the above introduction, the following example will be used to further illustrate the virtual character processing method of the present application. The specific embodiment of the virtual character processing method is as follows:
[0112] (1) Before conducting a virtual conversation, the first user controlling the first virtual character may first determine the group of people who need to communicate. For example, the first user may click on the control to apply for creating a virtual conversation in the virtual conversation scene to initiate the virtual conversation, and may invite the second user to join the same virtual conversation for communication by clicking on the second virtual character corresponding to the second user in the virtual conversation scene, or the user identifier corresponding to the second user, wherein the second user is a user other than the first user in the virtual conversation scene. At this time, the client of the first user may send a request for creating a virtual conversation to the server, and the server may record the user information of the second user selected by the first user, create a separate communication channel for the first user and the multiple second users, and return it to the client of the first user and the client of the second user. Then, the user interface of the client of the first user and the client of the second user may be switched to the virtual conversation interface, and specifically, the position and viewing direction of the virtual character corresponding to the above user may be moved, for example, the virtual character corresponding to the above user may be changed into a circle (this is only an example, and more possible forms are not described here), indicating that the current scene is a virtual conversation scene in which multiple users communicate together, thereby forming an initial conversation group.
[0113] (2) After the initial conversation group is formed, if a new second user applies to join the virtual conversation, after the new second user applies to join the virtual conversation for discussion, the client of the new second user will send a request to join the conversation to the server. After receiving the request, the server will send a notification message to the organizer of the current virtual conversation, that is, the client of the first user, to ask the first user whether to agree to the new second user joining the current virtual conversation. At this time, the first virtual character corresponding to the organizer can play an animation, such as the first virtual character turning its body toward the virtual character of the user who applied to join.
[0114] If the first user refuses the new second user to join the current virtual session, the client of the first user will return the result information of refusing the second user to the server, and the server can send the result information of refusing to join to the client of the new second user to inform the new second user of the result of refusing to join the session. At this time, the first virtual character corresponding to the first user can also play the corresponding rejection animation, such as shaking head or waving hand animation. Alternatively, the first virtual character corresponding to the first user may not play the animation.
[0115] If the first user accepts the new second user to join the current virtual session, the client of the first user will return the result information of receiving the new second user to the server. The server can record the user information of the new second user, synchronize the user information to the channel corresponding to the virtual session, and then feedback to the clients of all users in the current virtual session. The clients of all users in the current virtual session will place the second virtual character of the new second user in the appropriate position in the virtual session scene, and modify and display the virtual session interface of the corresponding clients of all users to indicate that the second virtual character of the new second user has joined the virtual session scene corresponding to the virtual session, that is, the new second user has joined the communication group that he applied to join. Optionally, when the new second user joins the virtual session, all other users in the virtual session can selectively play animations, that is, they can play the welcome animation or not, wherein the welcome animation can make action animations such as welcoming, applauding or waving for the virtual character.
[0116] (3) In an embodiment of the present application, the first user who applies to create a virtual session can be used as the speaker, and the speaker is a user who has the right to speak in the virtual session. Furthermore, in the communication channel corresponding to the virtual session, other second users can apply to become the speaker and speak. For example, when a second user applies to speak, the second user's client will send a speaking application to the server. After receiving the speaking application, the server can mark the second user as the speaker and synchronize it to all clients in the virtual session so that all clients mark the second user as the speaker. Among them, the speaker can be a user in the virtual session who actively applies to become the speaker, or can be set when creating the virtual session. The specific setting method can be determined by the creator of the virtual session.
[0117] Optionally, when a second user applies for a speech, the second user's client will send a speech application to the server. After receiving the speech application, the server can send the speech application to the first user's client to inquire whether the first user agrees that the second user will become a new speaker. If the first user refuses the second user to become a new speaker, the first user's client will return the result information of refusing the second user to become a speaker to the server. The server can send the result information of refusing the second user to become a speaker to the second user's client to inform the new second user of the result of refusing the second user to become a speaker. If the first user agrees that the second user will become a new speaker, the first user's client will return the result information of agreeing that the second user will become a speaker to the server. The server can mark the second user as a speaker and synchronize it to all clients in the virtual session so that all clients mark the second user as a speaker.
[0118] (4) When the speaker is speaking on his corresponding client, the speaker's client will obtain the speaker's voice signal in real time through the speaker's microphone, and then the speaker's client will upload the voice information to the server in segments to ensure that there will be no lag. At the same time, the speaker's client will also synchronize the speaker's location information to the server. After receiving the voice signal, the server will distribute the voice signal to other listeners in the same virtual conversation channel and synchronize the speaker's location information to the listener's client, where the listener is all other users in the virtual conversation except the speaker. At this time, the speaker's virtual character will play a speech animation, such as the speaker's virtual character waving his hands, explaining, or moving his mouth. The speaker's client can send the above speech animation to the server so that the server will synchronize the speech animation to the clients of other users in the virtual conversation except the speaker's client.
[0119] (5) After other listeners receive the synchronization information from the server (including but not limited to the speaker's voice information and the speaker's location information), the spatial audio module of the listener's client will receive this synchronization information. Then, the spatial audio module of each listener's client will run separately. Here is the operation process of the spatial audio module of one listener: First, the spatial audio module will obtain the listener's location information, compare the received speaker's location information with the listener's location information, and obtain the relative distance and relative direction. If it is the first time to receive information, a spatial audio player will be deployed at the speaker's position in the listener's client, and a spatial audio receiver will be deployed in all listeners' clients. Specifically, the position of the virtual characters corresponding to all listeners in the virtual conversation scene can be determined, and a spatial audio receiver will be deployed at this position. The spatial audio receiver will set the received audio according to the relative distance and relative direction, and adjust the size of the audio in multiple channels, so that the user can get the spatial audio experience. Specifically, if the user's audio playback device supports stereo, the spatial audio receiver will automatically modify the size of multiple channels in stereo according to the relative distance and relative direction.
[0120] (6) After the spatial audio module calculates the relative distance and relative direction, it will also notify the animation playback module of the client and pass the relative position and relative distance to the inverse kinematics control module of the animation playback module. Inverse kinematics (IK) is a method of inferring the positions of other parent nodes based on the end nodes of the skeleton. Specifically, the shape of the entire skeleton is inverted based on the final positions and angles of certain child joints. The positions of the bones of the wrist and elbow can be inferred from the position of the hand. The above is only an example, and more methods will not be repeated here. At this time, the IK control module will adjust the position and angle of the joints of the child layer of the listener's virtual character based on the relative position and relative distance, and then adjust the joint position and angle of all parent layers through inverse kinematics, and mix the original running animation based on the joint masks, so as to control the facial orientation of the listener's virtual character so that it can twist its neck to look at the speaker's virtual character. The specific change effect is as follows: Figure 3 and Figure 5 shown.
[0121] For example, for the action of a virtual character turning its head, the IK control module modifies the position and angle of the virtual character's head, then modifies the position angle of the neck and neck according to the position of the head, and then modifies the position angle of the waist according to the position angle of the neck and neck, and mixes the above-mentioned modified parts with the whole-body animation to obtain the action of the virtual character turning its head.
[0122] For another example, when a virtual character waves its hands, the IK control module knows in advance the target position of the virtual character's fingers in the waving animation, and then, based on the target position, reversely transfers and modifies the position of the virtual character's palm and forearm, thereby forming an animation of the virtual character waving his hands.
[0123] (7) The remaining listeners respectively operate according to the spatial audio module and animation playback module of their own client to achieve the communication effect of the characters. In the embodiment of the present application, the virtual characters of the remaining listeners may not make any action during the lecture, or may make corresponding actions according to user needs. For example, the virtual characters of the remaining listeners may make actions such as clapping, waving hands, shaking heads, or giving thumbs up. When the virtual characters of the listeners make corresponding actions, the above action information may be sent to the server, and the server forwards the above action information to the clients of all other users in the virtual session for synchronization, so that the listeners in the clients of other users make corresponding actions.
[0124] In summary, the processing method of the virtual character provided in the embodiment of the present application can be performed by displaying a virtual conversation interface, wherein the virtual conversation interface includes at least part of a virtual conversation scene, and at least two virtual characters participating in the current virtual conversation in the virtual conversation scene, and a virtual character is associated with a user conversation account participating in the current virtual conversation; then, the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation are obtained, and the audio corresponding to the audio information is played in the virtual conversation scene; then, the second position information of the second virtual character controlled by the terminal is obtained; thereafter, the current character posture of the second virtual character is adjusted based on the first position information and the second position information to obtain the target character posture of the second virtual character; finally, in response to the trigger instruction for the target character posture, the second virtual character in the virtual conversation scene is controlled to execute the target character posture. The embodiment of the present application adjusts the character posture of the virtual characters of other listening users by determining the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, thereby improving the flexibility of the virtual characters, enriching the interaction mode between virtual objects, and improving the interactivity and authenticity of the virtual characters.
[0125] In order to better implement the above method, the embodiment of the present application may also provide a processing device for a virtual character, and the processing device for the virtual character may be specifically integrated in a computer device, for example, a computer device such as a terminal.
[0126] See also Figure 7 , Figure 7 A schematic diagram of a virtual character processing device provided in an embodiment of the present application, the device comprising:
[0127] A first acquisition unit 201 is used to acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene;
[0128] A second acquiring unit 202, configured to acquire second position information of the second virtual character;
[0129] An adjusting unit 203, configured to adjust a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character;
[0130] The control unit 204 is used to control the second virtual character in the virtual conversation scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in the first conversation screen.
[0131] In some embodiments, the processing device of the virtual character includes:
[0132] The first sending subunit is used to send the target character gesture of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to perform the target character gesture, so as to display the second virtual character performing the target character gesture in a second session screen on the virtual session interface provided by the second terminal device, wherein the second session screen is a session screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual session scene according to a second shooting perspective.
[0133] In some embodiments, the processing device of the virtual character includes:
[0134] A first determining subunit, configured to determine a target adjustment direction based on the first position information and the second position information;
[0135] The first adjustment subunit is configured to adjust the current head orientation of the second virtual character based on the target adjustment direction to obtain the target head orientation of the second virtual character.
[0136] In some embodiments, the processing device of the virtual character includes:
[0137] The first control subunit is used to control the head of the second virtual character in the virtual conversation scene to face the target head direction.
[0138] In some embodiments, the processing device of the virtual character includes:
[0139] A first receiving subunit, configured to receive a first direction determination logic sent by the second terminal device;
[0140] The second determination subunit is used to determine a first target adjustment direction based on the first position information, the second position information and a first direction determination logic, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
[0141] In some embodiments, the processing device of the virtual character includes:
[0142] A second receiving subunit, configured to receive a second direction determination logic sent by the second terminal device;
[0143] The third determination subunit is used to determine a second target adjustment direction based on the first position information, the second position information and a second direction determination logic, wherein the second target adjustment direction is: a direction in which the head of the second virtual character is facing away from the first position.
[0144] In some embodiments, the processing device of the virtual character includes:
[0145] A second adjustment subunit is used to adjust the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character;
[0146] The second control subunit is used to control the first virtual character in the virtual conversation scene to perform the target character action, so as to display the first virtual character performing the target character action in the first conversation screen.
[0147] In some embodiments, the processing device of the virtual character includes:
[0148] A third adjustment subunit is used to adjust the mouth movement of the first virtual character based on the audio information to obtain a target character lip movement of the first virtual character as a target character movement;
[0149] and / or
[0150] The third adjustment subunit is further used to adjust the hand movement of the first virtual character based on the audio information to obtain the target hand movement of the first virtual character as the target character movement.
[0151] In some embodiments, the processing device of the virtual character includes:
[0152] A third control subunit, configured to control the mouth of the first virtual character in the virtual conversation scene to perform the target character lip movement when the target character action includes the target character lip movement;
[0153] The third control subunit is further used to control the hand of the first virtual character in the virtual conversation scene to perform the target hand movement when the target character movement includes the target hand movement.
[0154] In some embodiments, the processing device of the virtual character includes:
[0155] The second sending sub-unit is used to send the target role action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target role action, so as to display the first virtual character performing the target role action in the second session screen on the virtual session interface provided by the second terminal device.
[0156] In some embodiments, the processing device of the virtual character includes:
[0157] A display subunit, configured to display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of a virtual conversation scene and a plurality of virtual characters located in the virtual conversation scene;
[0158] a fourth determining subunit, configured to respond to a refusal to attend the meeting instruction of a target virtual character among the plurality of virtual characters, and determine a preset character posture corresponding to the refusal to attend the meeting instruction;
[0159] The fourth control subunit is used to control the target virtual character to perform the preset character gesture, so as to display the target virtual character performing the preset character gesture in the first conversation screen.
[0160] In some embodiments, the processing device of the virtual character includes:
[0161] a fourth adjustment subunit, configured to adjust the audio information based on the first position information and the second position information to obtain a target spatial audio;
[0162] The first playing subunit is used to play the target spatial audio in the virtual conversation scene.
[0163] In some embodiments, the processing device of the virtual character includes:
[0164] a fifth determining subunit, configured to determine target distance information and sound source position information based on the first position information and the second position information;
[0165] a fifth adjustment subunit, configured to adjust the volume of the audio information based on the target distance information to obtain processed audio information;
[0166] The second playing subunit is used to generate target spatial audio based on the processed audio information, and play the target spatial audio in the virtual conversation scene based on the sound source position information.
[0167] The embodiment of the present application discloses a processing device for a virtual character, wherein the first acquisition unit 201 acquires the audio information and the first position information of the first virtual character who is currently speaking in the current virtual conversation, and plays the audio corresponding to the audio information in the virtual conversation scene; the second acquisition unit 202 acquires the second position information of the second virtual character; the adjustment unit 203 adjusts the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character; the control unit 204 controls the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character who executes the target character posture in the first conversation screen. The embodiment of the present application determines the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, and adjusts the character postures of the virtual characters of other listening users, thereby improving the flexibility of the virtual characters, enriching the interaction methods between virtual objects, and improving the interactivity and authenticity of the virtual characters.
[0168] Accordingly, the embodiment of the present application also provides a computer device, which may be a terminal or a server, and the terminal may be a smart phone, a tablet computer, a laptop computer, a touch screen, a game console, a personal computer (PC), a personal digital assistant (PDA), or other terminal devices. Figure 8 As shown, Figure 8 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. The computer device 300 includes a processor 301 having one or more processing cores, a memory 302 having one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 is electrically connected to the memory 302. Those skilled in the art will appreciate that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.
[0169] The processor 301 is the control center of the computer device 300. It uses various interfaces and lines to connect the various parts of the entire computer device 300, executes various functions of the computer device 300 and processes data by running or loading software programs and / or modules stored in the memory 302, and calling data stored in the memory 302, thereby monitoring the computer device 300 as a whole.
[0170] In the embodiment of the present application, the processor 301 in the computer device 300 will load instructions corresponding to the processes of one or more application programs into the memory 302 according to the following steps, and the processor 301 will run the application programs stored in the memory 302 to implement various functions:
[0171] Acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene;
[0172] Acquire second position information of the second virtual character;
[0173] adjusting a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character;
[0174] The second virtual character in the virtual conversation scene is controlled to execute the target character gesture, so that the second virtual character executing the target character gesture is displayed in the first conversation screen.
[0175] In one embodiment, after adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character, the method further includes:
[0176] The target character gesture of the second virtual character is sent to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in a second session screen on the virtual session interface provided by the second terminal device, wherein the second session screen is a session screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual session scene according to a second shooting perspective.
[0177] In one embodiment, the adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character includes:
[0178] determining a target adjustment direction based on the first position information and the second position information;
[0179] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.
[0180] In one embodiment, controlling the second virtual character in the virtual conversation scene to perform the target character gesture includes:
[0181] The head of the second virtual character in the virtual conversation scene is controlled to face the target head orientation.
[0182] In one embodiment, the virtual conversation interface displays a first function control and a second function control, and a function control is associated with a direction determination logic;
[0183] Before determining the target adjustment direction based on the first position information and the second position information, the method further includes:
[0184] In response to a trigger operation on the first function control, determining a first direction determination logic corresponding to the first function control;
[0185] The determining the target adjustment direction based on the first position information and the second position information includes:
[0186] Based on the first position information, the second position information and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
[0187] In one embodiment, before determining the target adjustment direction based on the first position information and the second position information, the method further includes:
[0188] In response to a trigger operation on the second function control, determining a second direction determination logic corresponding to the second function control;
[0189] The determining the target adjustment direction based on the first position information and the second position information includes:
[0190] Based on the first position information, the second position information and a second direction determination logic, a second target adjustment direction is determined, wherein the second target adjustment direction is a direction in which the head of the second virtual character is facing away from the first position.
[0191] In one embodiment, after obtaining the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, the method further includes:
[0192] Adjusting the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character;
[0193] The first virtual character in the virtual conversation scene is controlled to execute the target character action, so that the first virtual character executing the target character action is displayed in the first conversation screen.
[0194] In one embodiment, adjusting the designated role action of the first virtual character based on the audio information to obtain the target role action of the first virtual character includes:
[0195] Adjusting the mouth movement of the first virtual character based on the audio information to obtain a target character lip movement of the first virtual character as a target character movement;
[0196] and / or
[0197] The hand movement of the first virtual character is adjusted based on the audio information to obtain a target hand movement of the first virtual character as a target character movement.
[0198] In one embodiment, controlling the first virtual character in the virtual conversation scene to perform the target character action includes:
[0199] When the target character action includes the target character lip movement, controlling the mouth of the first virtual character in the virtual conversation scene to perform the target character lip movement;
[0200] When the target character action includes the target hand action, the hand of the first virtual character in the virtual conversation scene is controlled to perform the target hand action.
[0201] In one embodiment, after adjusting the designated role action of the first virtual character based on the audio information to obtain the target role action of the first virtual character, the method further includes:
[0202] The target character action of the first virtual character is sent to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the second session screen on the virtual session interface provided by the second terminal device.
[0203] In one embodiment, the method further comprises:
[0204] Displaying a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of a virtual conversation scene and a plurality of virtual characters located in the virtual conversation scene;
[0205] In response to a refusal to attend a meeting instruction from a target virtual character among the multiple virtual characters, determining a preset character posture corresponding to the refusal to attend a meeting instruction;
[0206] The target virtual character is controlled to perform the preset character gesture, so as to display the target virtual character performing the preset character gesture in the first conversation screen.
[0207] In one embodiment, playing the audio corresponding to the audio information in the virtual conversation scene includes:
[0208] Adjusting and processing the audio information based on the first position information and the second position information to obtain target spatial audio;
[0209] The target spatial audio is played in the virtual session scene.
[0210] In one embodiment, the adjusting and processing the audio information based on the first position information and the second position information to obtain the target spatial audio includes:
[0211] Determine target distance information and sound source location information based on the first location information and the second location information;
[0212] adjusting the volume of the audio information based on the target distance information to obtain processed audio information;
[0213] A target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual conversation scene based on the sound source position information.
[0214] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0215] Optional, such as Figure 8 As shown, the computer device 300 further includes: a touch screen 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. The processor 301 is electrically connected to the touch screen 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307, respectively. Those skilled in the art can understand that Figure 8 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0216] The touch display screen 303 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 303 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the computer device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-EmittingDiode) and the like. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 301, and can receive the command sent by the processor 301 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 301 to determine the type of touch event, and then the processor 301 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 303 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 303 can also be used as a part of the input unit 306 to realize the input function.
[0217] In the embodiment of the present application, the processor 301 executes the application to generate a graphical interface on the touch screen 303. The touch screen 303 is used to present the graphical interface and receive operation instructions generated by the user acting on the graphical interface.
[0218] The radio frequency circuit 304 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other computer devices through wireless communication, and to send and receive signals between the network device or other computer devices.
[0219] The audio circuit 305 can be used to provide an audio interface between the user and the computer device through a speaker and a microphone. The audio circuit 305 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 305 and converted into audio data, and then the audio data is output to the processor 301 for processing, and then sent to another computer device through the radio frequency circuit 304, or the audio data is output to the memory 302 for further processing. The audio circuit 305 may also include an earphone jack to provide communication between an external headset and the computer device.
[0220] The input unit 306 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0221] The power supply 307 is used to supply power to various components of the computer device 300. Optionally, the power supply 307 can be logically connected to the processor 301 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 307 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0222] although Figure 8 Not shown, the computer device 300 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.
[0223] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0224] As can be seen from the above, the computer device provided in this embodiment plays the audio corresponding to the audio information in the virtual conversation scene by acquiring the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation; then, acquiring the second position information of the second virtual character; then, adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character; finally, controlling the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first conversation screen. The embodiment of the present application determines the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, adjusts the character posture of the virtual characters of other listening users, improves the flexibility of the virtual characters, enriches the interaction methods between virtual objects, and improves the interactivity and authenticity of the virtual characters.
[0225] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0226] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer program can be loaded by a processor to execute the steps in any of the virtual character processing methods provided in the embodiments of the present application. For example, the computer program can execute the following steps:
[0227] Acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene;
[0228] Acquire second position information of the second virtual character;
[0229] adjusting a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character;
[0230] The second virtual character in the virtual conversation scene is controlled to execute the target character gesture, so that the second virtual character executing the target character gesture is displayed in the first conversation screen.
[0231] In one embodiment, after adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character, the method further includes:
[0232] The target character gesture of the second virtual character is sent to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in a second session screen on the virtual session interface provided by the second terminal device, wherein the second session screen is a session screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual session scene according to a second shooting perspective.
[0233] In one embodiment, the adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character includes:
[0234] determining a target adjustment direction based on the first position information and the second position information;
[0235] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.
[0236] In one embodiment, controlling the second virtual character in the virtual conversation scene to perform the target character gesture includes:
[0237] The head of the second virtual character in the virtual conversation scene is controlled to face the target head orientation.
[0238] In one embodiment, the virtual conversation interface displays a first function control and a second function control, and a function control is associated with a direction determination logic;
[0239] Before determining the target adjustment direction based on the first position information and the second position information, the method further includes:
[0240] In response to a trigger operation on the first function control, determining a first direction determination logic corresponding to the first function control;
[0241] The determining the target adjustment direction based on the first position information and the second position information includes:
[0242] Based on the first position information, the second position information and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
[0243] In one embodiment, before determining the target adjustment direction based on the first position information and the second position information, the method further includes:
[0244] In response to a trigger operation on the second function control, determining a second direction determination logic corresponding to the second function control;
[0245] The determining the target adjustment direction based on the first position information and the second position information includes:
[0246] Based on the first position information, the second position information and a second direction determination logic, a second target adjustment direction is determined, wherein the second target adjustment direction is a direction in which the head of the second virtual character is facing away from the first position.
[0247] In one embodiment, after obtaining the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, the method further includes:
[0248] Adjusting the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character;
[0249] The first virtual character in the virtual conversation scene is controlled to execute the target character action, so that the first virtual character executing the target character action is displayed in the first conversation screen.
[0250] In one embodiment, adjusting the designated role action of the first virtual character based on the audio information to obtain the target role action of the first virtual character includes:
[0251] Adjusting the mouth movement of the first virtual character based on the audio information to obtain a target character lip movement of the first virtual character as a target character movement;
[0252] and / or
[0253] The hand movement of the first virtual character is adjusted based on the audio information to obtain a target hand movement of the first virtual character as a target character movement.
[0254] In one embodiment, controlling the first virtual character in the virtual conversation scene to perform the target character action includes:
[0255] When the target character action includes the target character lip movement, controlling the mouth of the first virtual character in the virtual conversation scene to perform the target character lip movement;
[0256] When the target character action includes the target hand action, the hand of the first virtual character in the virtual conversation scene is controlled to perform the target hand action.
[0257] In one embodiment, after adjusting the designated role action of the first virtual character based on the audio information to obtain the target role action of the first virtual character, the method further includes:
[0258] The target character action of the first virtual character is sent to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the second session screen on the virtual session interface provided by the second terminal device.
[0259] In one embodiment, the method further comprises:
[0260] Displaying a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of a virtual conversation scene and a plurality of virtual characters located in the virtual conversation scene;
[0261] In response to a refusal to attend a meeting instruction from a target virtual character among the multiple virtual characters, determining a preset character posture corresponding to the refusal to attend a meeting instruction;
[0262] The target virtual character is controlled to perform the preset character gesture, so as to display the target virtual character performing the preset character gesture in the first conversation screen.
[0263] In one embodiment, playing the audio corresponding to the audio information in the virtual conversation scene includes:
[0264] Adjusting and processing the audio information based on the first position information and the second position information to obtain target spatial audio;
[0265] The target spatial audio is played in the virtual session scene.
[0266] In one embodiment, the adjusting and processing the audio information based on the first position information and the second position information to obtain the target spatial audio includes:
[0267] Determine target distance information and sound source location information based on the first location information and the second location information;
[0268] adjusting the volume of the audio information based on the target distance information to obtain processed audio information;
[0269] A target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual conversation scene based on the sound source position information.
[0270] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0271] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0272] Due to the computer program stored in the storage medium, the steps in any virtual character processing method provided in the embodiment of the present application can be executed, by obtaining the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, playing the audio corresponding to the audio information in the virtual conversation scene; then, obtaining the second position information of the second virtual character; then, adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character; finally, controlling the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first conversation screen. The embodiment of the present application determines the position information of the virtual character of the current speaking user and the position information of the virtual characters of other listening users, adjusts the character posture of the virtual characters of other listening users, improves the flexibility of the virtual characters, enriches the interaction mode between virtual objects, and improves the interactivity and authenticity of the virtual characters.
[0273] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0274] The above is a detailed introduction to a virtual character processing method, device, computer equipment and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the technical solution and its core idea of the present application. Ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or replace some of the technical features therein with equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for processing a virtual character, characterized in that: A virtual conversation interface is provided through a first terminal device, and the virtual conversation interface displays: a first conversation screen obtained by photographing a first virtual character controlled by the first terminal device in a virtual conversation scene according to a first shooting angle, wherein the first conversation screen includes at least part of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in a current virtual conversation, and the second virtual character is a virtual character controlled by a second terminal device, and the method includes: Acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene; Acquire second position information of the second virtual character; adjusting a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character; The second virtual character in the virtual conversation scene is controlled to execute the target character gesture, so that the second virtual character executing the target character gesture is displayed in the first conversation screen.
2. The method for processing a virtual character according to claim 1, characterized in that: After adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character, the method further includes: The target character gesture of the second virtual character is sent to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in a second session screen on the virtual session interface provided by the second terminal device, wherein the second session screen is a session screen obtained by photographing the second virtual character controlled by the second terminal device in the virtual session scene according to a second shooting perspective.
3. The method for processing a virtual character according to claim 1, characterized in that: The step of adjusting the current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character includes: determining a target adjustment direction based on the first position information and the second position information; The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.
4. The method for processing a virtual character according to claim 3, characterized in that: The controlling the second virtual character in the virtual conversation scene to execute the target character gesture comprises: The head of the second virtual character in the virtual conversation scene is controlled to face the target head orientation.
5. The method for processing a virtual character according to claim 3, characterized in that: The determining the target adjustment direction based on the first position information and the second position information includes: Receiving a first direction determination logic sent by the second terminal device; Based on the first position information, the second position information and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the head of the second virtual character faces the direction of the first position corresponding to the first position information.
6. The method for processing a virtual character according to claim 5, characterized in that: The determining the target adjustment direction based on the first position information and the second position information includes: Receiving a second direction determination logic sent by the second terminal device; Based on the first position information, the second position information and a second direction determination logic, a second target adjustment direction is determined, wherein the second target adjustment direction is a direction in which the head of the second virtual character is facing away from the first position.
7. The method for processing a virtual character according to claim 2, characterized in that: After obtaining the audio information and the first position information of the first virtual character currently speaking in the current virtual conversation, the method further includes: Adjusting the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character; The first virtual character in the virtual conversation scene is controlled to execute the target character action, so that the first virtual character executing the target character action is displayed in the first conversation screen.
8. The method for processing a virtual character according to claim 7, characterized in that: The step of adjusting the designated role action of the first virtual character based on the audio information to obtain a target role action of the first virtual character includes: Adjusting the mouth movement of the first virtual character based on the audio information to obtain a target character lip movement of the first virtual character as a target character movement; and / or The hand movement of the first virtual character is adjusted based on the audio information to obtain a target hand movement of the first virtual character as a target character movement.
9. The method for processing a virtual character according to claim 8, characterized in that: The controlling the first virtual character in the virtual conversation scene to perform the target character action includes: When the target character action includes the target character lip movement, controlling the mouth of the first virtual character in the virtual conversation scene to perform the target character lip movement; When the target character action includes the target hand action, the hand of the first virtual character in the virtual conversation scene is controlled to perform the target hand action.
10. The method for processing a virtual character according to claim 7, characterized in that: After adjusting the designated role action of the first virtual role based on the audio information to obtain the target role action of the first virtual role, the method further includes: The target character action of the first virtual character is sent to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the second session screen on the virtual session interface provided by the second terminal device.
11. The method for processing a virtual character according to claim 1, characterized in that: The method further comprises: Displaying a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of a virtual conversation scene and a plurality of virtual characters located in the virtual conversation scene; In response to a refusal to attend a meeting instruction from a target virtual character among the multiple virtual characters, determining a preset character posture corresponding to the refusal to attend a meeting instruction; The target virtual character is controlled to perform the preset character gesture, so as to display the target virtual character performing the preset character gesture in the first conversation screen.
12. The method for processing a virtual character according to claim 1, characterized in that: The playing of the audio corresponding to the audio information in the virtual conversation scene includes: Adjusting and processing the audio information based on the first position information and the second position information to obtain target spatial audio; The target spatial audio is played in the virtual session scene.
13. The method for processing a virtual character according to claim 12, characterized in that: The adjusting and processing the audio information based on the first position information and the second position information to obtain the target spatial audio includes: Determine target distance information and sound source location information based on the first location information and the second location information; adjusting the volume of the audio information based on the target distance information to obtain processed audio information; A target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual conversation scene based on the sound source position information.
14. A virtual character processing device, characterized in that: A virtual conversation interface is provided through a first terminal device, and the virtual conversation interface displays: a first conversation screen obtained by photographing a first virtual character controlled by the first terminal device in a virtual conversation scene according to a first shooting angle, wherein the first conversation screen includes at least part of the virtual conversation scene, and the first virtual character and the second virtual character located in the virtual conversation scene and participating in a current virtual conversation, and the second virtual character is a virtual character controlled by a second terminal device, and the apparatus includes: A first acquisition unit, configured to acquire audio information and first position information of a first virtual character currently speaking in the current virtual conversation, and play audio corresponding to the audio information in the virtual conversation scene; A second acquiring unit, configured to acquire second position information of the second virtual character; an adjusting unit, configured to adjust a current character posture of the second virtual character based on the first position information and the second position information to obtain a target character posture of the second virtual character; A control unit is used to control the second virtual character in the virtual conversation scene to execute the target character gesture, so as to display the second virtual character executing the target character gesture in the first conversation screen.
15. A computer device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the method for processing a virtual character according to any one of claims 1 to 13 is implemented.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for processing a virtual character according to any one of claims 1 to 13 is implemented.
Citation Information
Patent Citations
English learning and training device based on VR real scene dialogue
CN110299033A
Picture display method and device thereof and electronic equipment
CN113996062A
Conversation video creating method and related device
CN115115728A
Virtual object interaction method and device
CN115888111A
Virtual event venue system, virtual event venue generating system, virtual event venue generating method, and program
WO2023068157A1