Virtual role processing method and device, computer device, and storage medium

Abstract

Embodiments of the present application disclose a virtual role processing method and device, computer equipment and a storage medium, comprising: obtaining audio information and first position information of a first virtual role currently speaking in a current virtual conversation, and playing audio corresponding to the audio information in a virtual conversation scene; obtaining second position information of a second virtual role; adjusting a current role posture of the second virtual role based on the first position information and the second position information to obtain a target role posture of the second virtual role; and controlling the second virtual role in the virtual conversation scene to execute the target role posture to display the second virtual role executing the target role posture in the first conversation picture. Embodiments of the present application adjust the role posture of the virtual role based on the position information, improve the flexibility of the virtual role, enrich the interaction mode between virtual objects, and improve the interaction and reality of the virtual role.

Description

Technical Field

[0001] This application relates to the field of computer technology, specifically to a method, apparatus, computer device, and storage medium for processing virtual characters. Background Technology

[0002] With the continuous development of computer communication technology and the widespread use of terminals such as smartphones, tablets, and laptops, terminals are becoming increasingly diversified and personalized, becoming indispensable electronic devices in people's lives and work. To meet people's communication needs, virtual conversation scenarios enabling interactive conversations on terminals have emerged. For example, users can use the Metaverse virtual conversation scenario for communication. The Metaverse virtual conversation scenario is a way for users to work within a metaverse environment. Through virtual reality technology, users can communicate, collaborate, and work in a digital virtual conversation scenario. Specifically, users can create conversation channels within a virtual conversation scenario and invite other users to join those channels for virtual conversations, thus meeting their needs for multi-user communication.

[0003] Currently, in multi-user virtual conversations within a metaverse virtual conversation scenario, each user's corresponding virtual character is displayed, allowing for communication and interaction. However, in existing technologies, the virtual characters of each user in the virtual conversation are always facing forward during the conversation. This results in rigid character movements, a limited range of interaction methods, and poor interactivity and realism. Summary of the Invention

[0004] This application provides a method, apparatus, computer device, and storage medium for processing virtual characters. By determining the position information of the virtual character of the current speaker and the position information of the virtual characters of other listeners, the posture of the virtual characters of other listeners is adjusted, thereby improving the flexibility of virtual characters, enriching the interaction methods between virtual objects, and enhancing the interactivity and realism of virtual characters.

[0005] This application provides a method for processing virtual characters. A first terminal device provides a virtual conversation interface, which displays a first conversation frame captured from a first shooting perspective of a first virtual character controlled by the first terminal device within a virtual conversation scene. The first conversation frame includes at least a portion of the virtual conversation scene, and the first virtual character and a second virtual character participating in the current virtual conversation within the scene. The second virtual character is a virtual character controlled by a second terminal device. The method includes:

[0006] Obtain the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene;

[0007] Obtain the second location information of the second virtual character;

[0008] Based on the first location information and the second location information, the current character pose of the second virtual character is adjusted to obtain the target character pose of the second virtual character;

[0009] Control the second virtual character in the virtual session scene to execute the target character's posture, so as to display the second virtual character executing the target character's posture in the first session screen.

[0010] Accordingly, this application also provides a virtual character processing device, which provides a virtual conversation interface through a first terminal device. The virtual conversation interface displays: a first conversation frame obtained by shooting a first virtual character controlled by the first terminal device in a virtual conversation scene from a first shooting perspective. The first conversation frame includes at least a portion of the virtual conversation scene, and the first virtual character and a second virtual character participating in the current virtual conversation in the virtual conversation scene. The second virtual character is a virtual character controlled by a second terminal device. The virtual character processing device includes:

[0011] The first acquisition unit is used to acquire the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene;

[0012] The second acquisition unit is used to acquire the second location information of the second virtual character;

[0013] An adjustment unit is used to adjust the current pose of the second virtual character based on the first position information and the second position information to obtain the target pose of the second virtual character.

[0014] The control unit is used to control the second virtual character in the virtual session scene to perform the target character posture, so as to display the second virtual character performing the target character posture in the first session screen.

[0015] Accordingly, this application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, it implements the processing method for the virtual character as described above.

[0016] Accordingly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the virtual character processing method described above.

[0017] This application provides a method, apparatus, computer device, and storage medium for processing virtual characters. The method involves acquiring the audio information and first location information of a first virtual character currently speaking in a virtual session, and then playing the corresponding audio in the virtual session scene. Next, the method acquires the second location information of a second virtual character. Then, based on the first and second location information, the method adjusts the current pose of the second virtual character to obtain a target pose. Finally, the method controls the second virtual character in the virtual session scene to execute the target pose, thereby displaying the second virtual character executing the target pose in the first session screen. This application improves the flexibility of virtual characters by determining the location information of the virtual character of the currently speaking user and the location information of the virtual characters of other listening users, and adjusting the poses of the virtual characters of other listening users. This enriches the interaction methods between virtual objects and enhances the interactivity and realism of virtual characters. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of a virtual character processing device provided in an embodiment of this application.

[0020] Figure 2 This is a flowchart illustrating a method for processing virtual characters provided in an embodiment of this application.

[0021] Figure 3 This is a schematic diagram of a scenario for processing virtual characters provided in an embodiment of this application.

[0022] Figure 4 This is another scenario illustration of the virtual character processing method provided in the embodiments of this application.

[0023] Figure 5 This is another scenario illustration of the virtual character processing method provided in the embodiments of this application.

[0024] Figure 6This is another scenario illustration of the virtual character processing method provided in the embodiments of this application.

[0025] Figure 7 This is a schematic diagram of the structure of the virtual character processing device provided in the embodiments of this application.

[0026] Figure 8 This is a schematic diagram of the structure of the computer device provided in the embodiments of this application. Detailed Implementation

[0027] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0028] This disclosure provides a method, apparatus, computer device, and storage medium for processing virtual characters. Specifically, the virtual character processing method of this disclosure can be executed by a computer device, which can be a terminal or a server. The terminal can be a smartphone, tablet, laptop, touch screen, game console, personal computer (PC), personal digital assistant (PDA), or other terminal device. The terminal can also include a client, which can be an application client, a browser client carrying an application, or an instant messaging client. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0029] For example, when the processing method for the virtual character runs on a terminal, the terminal device stores an application and uses it to present a virtual session scene in the session screen. The terminal device is used to interact with the user through the virtual session interface, such as by downloading, installing, and running an application. The terminal device can provide the virtual session interface to the user in various ways, such as rendering it on the terminal device's display screen or presenting a graphical user interface via holographic projection. For example, the terminal device can include a touch screen and a processor. The touch screen is used to present the graphical user interface and receive operation commands generated by the user interacting with the graphical user interface. The virtual session interface includes a session screen, and the processor is used to run the application, generate the virtual session interface, respond to operation commands, and control the display of the virtual session interface on the touch screen.

[0030] Please see Figure 1 , Figure 1 This is a schematic diagram of a virtual character processing system provided in an embodiment of this disclosure. The system may include at least one terminal, at least one server, at least one database, and a network. A user's terminal can connect to different servers via the network. The terminal is any device with computing hardware capable of supporting and executing software products corresponding to the game. Furthermore, when the system includes multiple terminals, multiple servers, and multiple networks, different terminals can connect to each other through different networks and servers. The network can be a wireless network or a wired network, such as a wireless local area network (WLAN), local area network (LAN), cellular network, 2G network, 3G network, 4G network, 5G network, etc. Additionally, different terminals can also connect to other terminals or servers using their own Bluetooth networks or hotspot networks. For example, multiple users can connect online through different terminals via appropriate networks and synchronize with each other to support multi-user sessions. Furthermore, the system may include multiple databases coupled to different servers, and information related to the session environment can be continuously stored in the databases while different users are engaged in multi-user online sessions.

[0031] It should be noted that, Figure 1 The schematic diagram of the virtual character processing system shown is merely an example. The virtual character processing system and scenario described in this disclosure are intended to more clearly illustrate the technical solutions of this disclosure and do not constitute a limitation on the technical solutions provided in this disclosure. As those skilled in the art will know, with the emergence of new business scenarios, the technical solutions provided in this disclosure are also applicable to similar technical problems.

[0032] To address the aforementioned problems, this disclosure provides a method, apparatus, computer device, and storage medium for processing virtual characters, which can improve the flexibility of virtual characters, enrich the interaction methods between virtual objects, and enhance the interactivity and realism of virtual characters. These will be described in detail below. It should be noted that the order of description of the following embodiments is not intended to limit the preferred order of the embodiments.

[0033] This disclosure provides a method for processing virtual characters. This method can be executed by a terminal or a server. This disclosure uses the example of a virtual character processing method executed by a terminal. A virtual session interface can be provided by a terminal device. The virtual session interface includes at least a portion of a virtual session scene and at least two virtual characters participating in the current virtual session within the virtual session scene. Specifically, a virtual session interface can be provided by a first terminal device. The virtual session interface displays a first session frame captured from a first shooting perspective of a first virtual character controlled by the first terminal device within the virtual session scene. The first session frame includes at least a portion of the virtual session scene and the first and second virtual characters participating in the current virtual session within the virtual session scene. The second virtual character is a virtual character controlled by a second terminal device. In this system, some virtual session scenes are determined based on the viewing angle of the virtual character controlled by the terminal device. The graphical user interface can also display some virtual characters, which are those displayed in some virtual session scenes. These virtual characters can be those in the same virtual session as the first virtual character, those in different virtual sessions, or other virtual characters not participating in any virtual sessions. Additionally, the second terminal device can provide a virtual session interface displaying a second session frame captured from a second shooting angle, showing the second virtual character controlled by the second terminal device within the virtual session scene. This second session frame includes at least a portion of the virtual session scene and the first and second virtual characters participating in the current virtual session within that scene. The first shooting perspective can be a perspective that shoots from behind, in front of, or above the first virtual character. For example, it can be a shooting perspective that shoots from the front or behind the first virtual character with the first virtual character as the center and the first preset value as the radius. The second shooting perspective can be a perspective that shoots from behind, in front of, or above the second virtual character. For example, it can be a shooting perspective that shoots from the front or behind the second virtual character with the second virtual character as the center and the second preset value as the radius. This is just an example, and other possible implementation methods will not be elaborated here.

[0034] In this embodiment of the disclosure, a virtual session scene is a virtual environment displayed (or provided) by an application running on a terminal. This virtual environment can be a simulation of the real world, a semi-simulated / semi-fictional three-dimensional environment, or a purely fictional three-dimensional environment. This virtual environment is used for virtual sessions between at least two virtual characters and has virtual resources available to both characters. One or more virtual characters can be displayed in the virtual session scene. These virtual characters can be virtual characters controlled by the user through the terminal, virtual characters in the same virtual session as the virtual character, virtual characters in different virtual sessions as the virtual character, or other virtual characters not participating in any virtual sessions. A virtual session scene can simultaneously contain virtual characters in the same virtual session as the virtual character, virtual characters in different virtual sessions as the virtual character, and virtual characters without sessions; this is illustrative and not intended to be limiting. A virtual character refers to an active object in a virtual environment. A virtual character refers to a virtual object in a game controlled by the user through the terminal.

[0035] Please see Figure 2 , Figure 2 A flowchart illustrating a method for processing virtual characters provided in this application embodiment is shown. The specific process can be summarized in steps 101 to 104 as follows:

[0036] 101. Obtain the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene.

[0037] In this embodiment of the application, a virtual session interface can be provided by a first terminal device. The virtual session interface displays a first session image obtained by shooting a first virtual character controlled by the first terminal device in the virtual session scene from a first shooting perspective. The first session image includes at least a portion of the virtual session scene, and the first virtual character and the second virtual character participating in the current virtual session in the virtual session scene. The second virtual character is a virtual character controlled by a second terminal device, and a virtual character is associated with a user session account participating in the current virtual session.

[0038] Specifically, before initiating a virtual session, the first user controlling the first virtual character can first determine the group of people to communicate with. For example, the first user can initiate a virtual session by clicking the control to request the creation of a virtual session. They can also invite a second user to join the same virtual session by clicking the second virtual character or the user identifier of the second user. The second user refers to any user other than the first user in the virtual session. At this point, the first user's client can send a request to the server to create a virtual session. The server can record the user information of the second user selected by the first user, create a separate communication channel for the first user and multiple second users, and return it to both the first and second user's clients. Then, the user interface of both the first and second user's clients can be switched to the virtual session interface. Specifically, the position and viewpoint of the virtual characters corresponding to the users can be moved, transforming them into a circle, indicating that the current scenario is a virtual session where multiple users are communicating together, thus forming the initial group of people in the session.

[0039] In the above process, the virtual characters corresponding to the first user and the virtual characters corresponding to the second user are all virtual characters in the virtual world. Each virtual character can play corresponding character animations. For example, the character animation is an animation that simulates a real person, such as standing with both hands hanging down vertically, or a character swaying dynamically.

[0040] Furthermore, when the first user invites the second user to join the same virtual session, if the second virtual character corresponding to the other second user is facing away from or not facing the first user's first virtual character, the second virtual character can make a reaction animation. This reaction animation can be that the second virtual character turns its body and face toward the first virtual character and adds specified hand gestures, such as clapping or waving.

[0041] In this embodiment of the application, the method further includes:

[0042] Display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of the virtual conversation scene and multiple virtual characters located in the virtual conversation scene;

[0043] In response to a refusal to participate instruction from a target virtual character among the plurality of virtual characters, a preset character posture corresponding to the refusal to participate instruction is determined;

[0044] The target virtual character is controlled to perform the preset character posture, so as to display the target virtual character performing the preset character posture in the first session screen.

[0045] For example, please see Figure 3 The computer device can display a virtual session interface, which shows a virtual session scene and a first virtual character, a second virtual character, and a third virtual character located in that scene. The first, second, and third virtual characters are all virtual characters within the same virtual session. At this time, since no virtual character is speaking in the virtual session, the first, second, and third virtual characters all use default character actions, meaning their heads are all facing forward. When the server receives a virtual session request from the client of the first user, it sends request requests to the second user corresponding to the second virtual role and the second user corresponding to the third virtual role that were invited to join the same virtual session. If the second user of the third virtual role refuses to participate, the server receives a refusal instruction from the client of the second user of the third virtual role and responds to the refusal instruction of the target virtual role among the multiple virtual roles, determines the preset role posture corresponding to the refusal instruction, and then sends the preset role posture to the clients of all users to control the target virtual role to execute the preset role posture, so that the target virtual role executing the preset role posture is displayed in the session screen displayed on the clients of all users. The preset role posture can be a head shaking or hand waving, etc.

[0046] Specifically, after the server receives a virtual session request from the first user's client, it sends a request to the second user invited to join the same virtual session. Once the second user agrees, their client sends an acceptance message back to the server. The server then adds the first user and the second user to a separate channel. The second virtual characters of other users who disagree with the invitation will display a rejection animation, such as shaking their head or waving their hand, to refuse the first user's invitation. The second virtual character will then turn back to its previous position. Alternatively, the second user's second virtual character may not display any animation.

[0047] In one embodiment, after the step of "obtaining the audio information and first location information of the first virtual character currently speaking in the current virtual session", the method may include:

[0048] Based on the audio information, the designated character action of the first virtual character is adjusted to obtain the target character action of the first virtual character.

[0049] Control the first virtual character in the virtual session scene to perform the target character's action, so as to display the first virtual character performing the target character's action in the first session screen.

[0050] Specifically, the method for the step "adjusting the specified character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character" may include:

[0051] Based on the audio information, the mouth movements of the first virtual character are adjusted to obtain the target character mouth movements of the first virtual character, which are used as the target character movements.

[0052] and / or

[0053] Based on the audio information, the hand movements of the first virtual character are adjusted to obtain the target hand movement of the first virtual character, which is then used as the target character movement.

[0054] Furthermore, the method for the step "controlling the first virtual character in the virtual session scene to perform the target character action" may include:

[0055] When the target character's action includes the target character's lip-syncing action, the mouth of the first virtual character in the virtual conversation scene is controlled to perform the target character's lip-syncing action;

[0056] When the target character's action includes the target hand action, the hand of the first virtual character in the virtual session scene is controlled to perform the target hand action.

[0057] The target character's lip movements can be pre-set lip movements for the virtual character, such as the virtual character's mouth opening and closing rhythmically when the virtual character speaks, until the user corresponding to the virtual character finishes speaking, at which point the lip movements also end; or the virtual character's mouth can make lip movements corresponding to the audio information when the user speaks, for example, if the audio information is "Let's start the meeting," the virtual character's lip movements can make lip movements corresponding to "Let's start the meeting."

[0058] For example, please see Figure 4The computer device can display a virtual session interface, which shows a virtual session scene and a first virtual character, a second virtual character, and a third virtual character located in the virtual session scene. The first, second, and third virtual characters are virtual characters in the same virtual session. When the computer device detects that the first virtual character can speak in the virtual session, it can obtain the audio information and first location information of the first virtual character currently speaking in the virtual session. The computer device then plays the audio corresponding to the audio information in the virtual session scene. Based on the audio information, the computer device adjusts the hand movements of the first virtual character to obtain a target hand movement for the specified virtual character, which is then used as the target character movement, i.e., the first virtual character performs a hand-raising movement. The target character movement can also be a rhythmic waving or swinging motion based on the user corresponding to the first virtual character while speaking.

[0059] To synchronously display the first virtual character performing a target character action to all clients participating in the current virtual session, after the step "adjusting the specified character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character", the method may include:

[0060] Send the target character action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so that the first virtual character performing the target character action is displayed in the second session screen on the virtual session interface provided by the second terminal device.

[0061] To make the virtual conversation scenario more realistic, the method for step "playing the audio corresponding to the audio information in the virtual conversation scenario" may include:

[0062] The audio information is adjusted and processed based on the first location information and the second location information to obtain the target spatial audio;

[0063] The target space audio is played in the virtual session scenario.

[0064] Furthermore, the method for the step "adjusting the audio information based on the first location information and the second location information to obtain the target spatial audio" may include:

[0065] Based on the first location information and the second location information, the target distance information and the sound source location information are determined;

[0066] The volume of the audio information is adjusted based on the target distance information to obtain the processed audio information;

[0067] Target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual session scene based on the sound source location information.

[0068] Specifically, in this embodiment, the volume of the audio information can be adjusted based on the target distance information to obtain processed audio information. For example, in a virtual session scenario, the virtual characters participating in the current virtual session include a first virtual character, a second virtual character, and a third virtual character. The first virtual character is controlled by a first terminal device, the second virtual character is controlled by a second terminal device, and the third virtual character is controlled by a third terminal device. At this time, the first user corresponding to the first virtual character generates audio information by speaking through the first terminal device. Then, in the virtual session scenario of the virtual session interface of the first terminal device, the target spatial audio with a first volume value is played. Then, the second terminal device obtains the second position information of the second virtual character and the first position information of the first virtual character. Based on the first position information and the second position information, the first target distance information and the sound source position information are determined. The first target distance information is the positional distance between the first position information and the second position information. Based on the first target distance information, the first volume value of the audio information is adjusted to obtain audio information with a second volume value; based on the audio information with the second volume value, a first target spatial audio is generated, and the first target spatial audio is played in the virtual session scene of the virtual session interface of the second terminal device based on the sound source location information; similarly, the third terminal device obtains the third position information of the third virtual character and the first position information of the first virtual character, determines the second target distance information and the sound source location information based on the first position information and the third position information, the second target distance information being the positional distance between the first position information and the third position information, adjusts the first volume value of the audio information based on the second target distance information to obtain audio information with a third volume value; based on the audio information with the third volume value, a second target spatial audio is generated, and the second target spatial audio is played in the virtual session scene of the virtual session interface of the third terminal device based on the sound source location information. Since the location distance corresponding to the first target distance information is less than the location distance corresponding to the second target distance information, the second volume value is greater than the third volume value, and the first volume value is greater than the second volume value. Therefore, the volume value of the target space audio in the virtual conversation scene of the first virtual character is the largest, and the volume value of the target control audio in the virtual conversation scene of the virtual character that is closer to the first virtual character is the larger, and the volume value of the target control audio in the virtual conversation scene of the virtual character that is farther away from the first virtual character is the smaller.

[0069] 102, Obtain the second location information of the second virtual character.

[0070] In this embodiment, after obtaining the second location information of the second virtual character, the first terminal device can send audio information, the first location information, and the second location information to the second terminal device. This allows the second terminal device to adjust the current character posture of the second virtual character based on the first and second location information to obtain a target character posture. The second terminal device then controls the second virtual character in the virtual conversation scene to execute the target character posture, thereby displaying the second virtual character executing the target character posture in the second conversation screen on the virtual conversation interface provided by the second terminal device. The second conversation screen is a conversation screen captured by the second virtual character controlled by the second terminal device in the virtual conversation scene from a second shooting perspective. Furthermore, the second terminal device can also determine target distance information and sound source location information based on the first and second location information. Then, it adjusts the volume of the audio information based on the target distance information to obtain processed audio information. Finally, it generates target spatial audio based on the processed audio information and plays the target spatial audio in the virtual conversation scene based on the sound source location information.

[0071] In this embodiment, the first terminal device can obtain the location information of the second virtual character in the virtual session scene, as the second location information. The first terminal device can also receive the location information of the second virtual character in the virtual session scene sent by the second terminal device, as the second location information.

[0072] 103. Based on the first location information and the second location information, adjust the current character posture of the second virtual character to obtain the target character posture of the second virtual character.

[0073] For example, the target character posture of the second virtual character includes, but is not limited to, head rotation, synchronized body rotation, and limb animation, among which limb animation may include cross-legged, arms crossed over chest, clapping hands, and thumbs-up gestures.

[0074] In this embodiment of the application, the method for "adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character" may include:

[0075] The target adjustment direction is determined based on the first location information and the second location information;

[0076] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.

[0077] Furthermore, the method for the step "controlling the second virtual character in the virtual session scene to execute the target character pose" may include:

[0078] Control the head of the second virtual character in the virtual session scene to face the target head orientation.

[0079] Specifically, the virtual session interface of the second terminal device displays a first functional control and a second functional control. Each functional control is associated with a direction determination logic. Before the step of "determining the target adjustment direction based on the first location information and the second location information", the method may include:

[0080] In response to the trigger operation of the first functional control, the second terminal device determines the first direction determination logic corresponding to the first functional control and sends the first direction determination logic to the first terminal device, so that the first terminal device determines the first target adjustment direction based on the first location information, the second location information and the first direction determination logic, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first position corresponding to the first location information;

[0081] Determining the target adjustment direction based on the first location information and the second location information includes:

[0082] Based on the first location information, the second location information, and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first location corresponding to the first location information.

[0083] In another specific embodiment, before the step of "determining the target adjustment direction based on the first location information and the second location information", the method further includes:

[0084] In response to the trigger operation of the second functional control, the second terminal device determines the second direction determination logic corresponding to the second functional control and sends the second direction determination logic to the first terminal device, so that the first terminal device determines the second target adjustment direction based on the first location information, the second location information and the second direction determination logic, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first position;

[0085] Determining the target adjustment direction based on the first location information and the second location information includes:

[0086] Based on the first location information, the second location information, and the second direction determination logic, the second target adjustment direction is determined, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first location.

[0087] Specifically, determining the target adjustment direction based on the first location information and the second location information includes:

[0088] Receive the first direction determination logic sent by the second terminal device;

[0089] Based on the first location information, the second location information, and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first location corresponding to the first location information.

[0090] Optionally, determining the target adjustment direction based on the first location information and the second location information includes:

[0091] Receive the second direction determination logic sent by the second terminal device;

[0092] Based on the first location information, the second location information, and the second direction determination logic, the second target adjustment direction is determined, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first location.

[0093] Specifically, in this application embodiment, a first target adjustment direction can be determined based on the first location information, the second location information, and the first preset head rule, wherein the first target adjustment direction is the direction in which the head of the second virtual character faces the first location.

[0094] For example, a computer device can display a virtual session interface, which shows a virtual session scene and a first virtual character, a second virtual character, and a third virtual character located in the virtual session scene. The first, second, and third virtual characters are virtual characters in the same virtual session. When the computer device detects that the first virtual character can speak in the virtual session, it can obtain the audio information and first position information of the currently speaking first virtual character in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene. Furthermore, the computer device can obtain the second position information of the second virtual character, the third position information of the third virtual character, and a first preset head rule, and determine a first adjustment direction and a second adjustment direction. The first adjustment direction directs the second virtual character's head toward the first position, and the second adjustment direction directs the third virtual character's head toward the first position.

[0095] Optionally, in this application embodiment, a second target adjustment direction can be determined based on the first position information, the second position information, and the second preset head rule, wherein the second target adjustment direction is the direction in which the head of the second virtual character faces away from the first position.

[0096] In one embodiment, after the step of "adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character", the method may include:

[0097] The second terminal device sends the target character pose of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character pose, so that the second virtual character executing the target character pose is displayed in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting perspective.

[0098] 104. Control the second virtual character in the virtual session scene to execute the target character's posture, so as to display the second virtual character executing the target character's posture in the first session screen.

[0099] In this embodiment of the application, the first terminal device can respond to a trigger command for the pose of the target character and control the second virtual character in the virtual session scene to execute the pose of the target character.

[0100] For example, please see Figure 5The computer device can display a virtual session interface, which shows a virtual session scene and a first virtual character, a second virtual character, and a third virtual character located in the virtual session scene. The first, second, and third virtual characters are virtual characters in the same virtual session. When the computer device detects that the first virtual character can speak in the virtual session, it can obtain the audio information and first position information of the currently speaking first virtual character in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene. Furthermore, the computer device can obtain the second position information of the second virtual character, the third position information of the third virtual character, and a first preset head rule, and determine a first adjustment direction and a second adjustment direction. The first adjustment direction directs the second virtual character's head toward the first position, and the second adjustment direction directs the third virtual character's head toward the first position. Then, based on the adjustment directions corresponding to the second and third virtual characters in the virtual session scene, the computer device can control the heads of the second and third virtual characters in the virtual session scene to face the first virtual character.

[0101] For example, please see Figure 6The computer device can display a virtual session interface, which shows a virtual session scene and a first virtual character, a second virtual character, and a third virtual character located in the virtual session scene. The first, second, and third virtual characters are virtual characters in the same virtual session. When the computer device detects that the first virtual character can speak in the virtual session, it can acquire the audio information and first location information of the first virtual character currently speaking in the virtual session, and play the audio corresponding to the audio information in the virtual session scene. Furthermore, the computer device adjusts the hand movements of the first virtual character based on the audio information to obtain a target hand movement for the specified virtual character. This target character movement includes, but is not limited to, the first virtual character raising its hand, waving its hand, or turning its head back and forth. It should be noted that when the first virtual character speaks in the virtual session, the animation corresponding to the aforementioned target character movement may not be played. The animation played by the first virtual character can be based on audio settings or can be an animation actively selected by the first user. This animation can be lip-syncing or blinking animation. Furthermore, the computer device can acquire the second position information of the second virtual character, the third position information of the third virtual character, and a first preset head rule to determine a first adjustment direction and a second adjustment direction. The first adjustment direction directs the head of the second virtual character toward the first position, and the second adjustment direction directs the head of the third virtual character toward the first position. Then, based on the adjustment directions corresponding to the second and third virtual characters in the virtual session scene, the computer device can control the heads of the second and third virtual characters in the virtual session scene to face the first virtual character.

[0102] In one specific embodiment, after the first terminal device corresponding to the first virtual character (i.e., the speaker's terminal device) and the second terminal device corresponding to the second virtual character (i.e., the listener's terminal device) respectively obtain the target character posture of the second virtual character, the first terminal device can control the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first conversation screen of the virtual conversation interface provided by the first terminal device. At this time, the current first perspective conversion parameters can be obtained, and the first shooting perspective can be adjusted based on the first perspective conversion parameters to update the display of the first conversation screen. At the same time, the second terminal device can control the second virtual character in the virtual conversation scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the second conversation screen of the virtual conversation interface provided by the second terminal device. At this time, the current second perspective conversion parameters can be obtained, and the second shooting perspective can be adjusted based on the second perspective conversion parameters to update the display of the second conversation screen.

[0103] Specifically, this application also provides a method for processing virtual characters, specifically used in a second terminal device, and the specific process can be as follows:

[0104] (1) The second terminal device receives a location information acquisition request sent by the first terminal device. When the first terminal device detects that the first virtual character is speaking, it generates a location information acquisition request and sends it to the second terminal device to request the second terminal device to acquire the second location information of the second virtual character and send the second location information of the second virtual character to the first terminal device.

[0105] (2) The second terminal device obtains the second location information of the second virtual character based on the location information acquisition request, and sends the second location information of the second virtual character to the first terminal device.

[0106] (3) The second terminal device receives the target character posture of the second virtual character sent by the first terminal device, and the second terminal device controls the second virtual character in the virtual session scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting angle.

[0107] Optionally, this application embodiment also provides a method for processing virtual characters, specifically used in a second terminal device, and the specific process can be as follows:

[0108] (1) The second terminal device receives the audio information and first location information of the first virtual character currently speaking in the current virtual session sent by the first terminal device.

[0109] (2) The second terminal device adjusts the current character posture of the second virtual character based on the first location information and the second location information to obtain the target character posture of the second virtual character.

[0110] (3) The second terminal device controls a second virtual character in the virtual session scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen captured by the second virtual character controlled by the second terminal device in the virtual session scene from a second shooting perspective. Furthermore, the second terminal device determines target distance information and sound source location information based on the first location information and the second location information, adjusts the volume of the audio information based on the target distance information to obtain processed audio information; then, it generates target spatial audio based on the processed audio information, and plays the target spatial audio in the virtual session scene displayed in the second session screen of the second terminal device based on the sound source location information.

[0111] Based on the above description, the following examples will further illustrate the virtual character processing method of this application. Specific embodiments of this virtual character processing method are as follows:

[0112] (1) Before initiating a virtual session, the first user controlling the first virtual character can first determine the group of people to be communicated with. For example, the first user can initiate a virtual session by clicking the control to apply for the creation of a virtual session in the virtual session scene. The first user can also invite the second user to join the same virtual session for communication by clicking the second virtual character corresponding to the second user in the virtual session scene, or the user icon corresponding to the second user. The second user is any user other than the first user in the virtual session scene. At this time, the first user's client can send a request to the server to create a virtual session. The server can record the user information of the second user selected by the first user, create a separate communication channel for the first user and multiple second users, and return it to the first user's client and the second user's client. Then, the user interface of the first user's client and the second user's client can be switched to the virtual session interface. Specifically, the position and viewing direction of the virtual characters corresponding to the above users can be moved. For example, the virtual characters corresponding to the above users can be turned into a circle (this is just an example, and more possible forms are not described here), indicating that the current scene is a virtual session scene in which multiple users communicate together, thus forming the initial group of people in the session.

[0113] (2) After the initial group of users is formed, if a new second user requests to join the virtual session, the new second user's client will send a join request to the server after requesting to join the discussion. Upon receiving the join request, the server will send a notification message to the organizer of the current virtual session, i.e., the client of the first user, to inquire whether the first user agrees to the new second user joining the current virtual session. At this time, the first virtual character corresponding to the organizer can play an animation, such as the first virtual character turning its body towards the virtual character of the user who requested to join.

[0114] If the first user refuses to let a new second user join the current virtual session, the first user's client will return a rejection message to the server. The server can then send this rejection message to the new second user's client to inform them of the rejection. At this time, the first user's corresponding virtual character can play a rejection animation, such as a head shake or hand wave. Alternatively, the first user's virtual character may not play any animation.

[0115] If the first user receives a new second user joining the current virtual session, the first user's client will return a result message to the server indicating that the second user has joined. The server can record the new second user's user information and synchronize it to the corresponding channel of the virtual session. This information is then sent back to the clients of all users in the current virtual session. All users' clients will place the new second user's second virtual character in an appropriate position within the virtual session scene and modify the virtual session interface of all users' clients to indicate that the new second user's second virtual character has joined the virtual session scene, meaning the new second user has joined the group of people they requested to join. Optionally, when a new second user joins the virtual session, all other users in the virtual session can selectively play an animation, either a welcome animation or not. The welcome animation can include actions such as welcoming, clapping, or waving to the virtual character.

[0116] (3) In this embodiment, the first user applying to create a virtual session can be designated as the speaker, who is the user with the right to speak in the virtual session. Furthermore, in the communication channel corresponding to the virtual session, other second users can apply to become the speaker. For example, when a second user applies to speak, the second user's client sends a speaking request to the server. After receiving the speaking request, the server can mark the second user as the speaker and synchronize this to all clients in the virtual session, so that all clients mark the second user as the speaker. The speaker can be either actively applied for by a user in the virtual session or set when the virtual session is created. The specific setting method can be determined by the creator of the virtual session.

[0117] Optionally, when a second user requests to speak, the second user's client sends the request to the server. Upon receiving the request, the server can forward it to the first user's client to inquire whether the first user agrees to the second user becoming the new speaker. If the first user refuses, the first user's client returns a rejection message to the server. The server can then send this rejection message to the second user's client to inform them of the rejection. If the first user agrees, the first user's client returns an approval message to the server. The server can then mark the second user as the speaker and synchronize this information to all clients in the virtual session, ensuring all clients mark the second user as the speaker.

[0118] (4) When the speaker speaks on their corresponding client, the speaker's client will acquire the speaker's voice signal in real time through the speaker's microphone. Then, the speaker's client will upload the voice information to the server in segments to ensure that there is no lag. At the same time, the speaker's client will also synchronize the speaker's location information to the server. After receiving the voice signal, the server will distribute the voice signal to other listeners in the same virtual session channel and synchronize the speaker's location information to the listeners' clients. The listeners are all users in the virtual session except the speaker. At this time, the speaker's virtual character will play speaking animations, such as waving, explaining, or facial movements. The speaker's client can send the above speaking animations to the server so that the server can synchronize the speaking animations to the clients of other users in the virtual session except the speaker's client.

[0119] (5) After other listeners receive the synchronization information from the server (including but not limited to the speaker's voice information and location information), the spatial audio module of the listener's client will receive this synchronization information. Then, the spatial audio module of each listener's client will run separately. Here is an explanation of the operation process of one listener's spatial audio module: First, the spatial audio module will obtain the listener's location information, compare the received speaker's location information with the listener's location information, and obtain the relative distance and relative direction. If it is the first time receiving information, a spatial audio player will be deployed at the speaker's location in the listener's client, and a spatial audio receiver will be deployed in all listener's clients. Specifically, the location of the virtual character corresponding to each listener in the virtual session scene can be determined, and a spatial audio receiver can be deployed at that location. The spatial audio receiver will set the received audio according to the relative distance and relative direction, and adjust the audio volume of multiple channels, so that the user can get a spatial audio experience. Specifically, if the user's audio playback device supports stereo, the spatial audio receiver will automatically modify the volume of multiple channels in stereo according to the relative distance and relative direction.

[0120] (6) After the spatial audio module calculates the relative distance and direction, it also notifies the client's animation playback module to pass the relative position and distance to the inverse kinematics control module of the animation playback module. Inverse kinematics (IK) is a method of calculating the position of other parent nodes based on the terminal nodes of the skeleton. Specifically, it calculates the shape of the entire skeleton by inversely calculating the final position and angle of certain sub-joints. For example, the position of the wrist and elbow bones can be calculated by calculating the position of the hand. The above is just an example, and more methods will not be elaborated here. At this time, the IK control module will adjust the position and angle of the joints of the lowest layer on the listener's virtual character based on the relative position and distance. Then, it will adjust the position and angle of all parent joints through inverse kinematics. Based on the joint masking and mixing with the original running animation, it controls the face orientation of the listener's virtual character, so that it can turn its neck to look at the virtual character of the speaker. The specific change effect is as follows. Figure 3 and Figure 5 As shown.

[0121] For example, to perform a head-turning motion on a virtual character, the IK control module modifies the position and angle of the virtual character's head, then modifies the position and angle of the neck and cervical spine based on the head position, and then modifies the position and angle of the waist based on the position and angle of the neck and cervical spine. The modified parts are then blended with the full-body animation to obtain the head-turning motion of the virtual character.

[0122] For example, when a virtual character makes a waving gesture, the IK control module knows in advance the target position of the virtual character's fingers in the waving animation, and then modifies the position of the virtual character's palm and forearm based on the target position, thereby forming the animation of the virtual character waving.

[0123] (7) The remaining listeners operate according to their own client's spatial audio module and animation playback module to achieve the effect of communication between characters. In this embodiment, the virtual characters of the remaining listeners may not perform any actions during the listening process, or they may perform corresponding actions according to user needs. For example, the virtual characters of the remaining listeners may perform actions such as clapping, waving, shaking their heads, or giving a thumbs up. When the virtual character of a listener performs the corresponding action, the above action information can be sent to the server. The server forwards the above action information to the clients of all other users in the virtual session for synchronization, so that the listener in the clients of other users can perform the corresponding action.

[0124] In summary, the virtual character processing method provided in this application embodiment can be achieved by displaying a virtual session interface, wherein the virtual session interface includes at least a portion of the virtual session scene and at least two virtual characters participating in the current virtual session within the virtual session scene, with each virtual character associated with a user session account participating in the current virtual session; then, acquiring the audio information and first location information of the first virtual character currently speaking in the current virtual session, and playing the audio corresponding to the audio information in the virtual session scene; next, acquiring the second location information of the second virtual character controlled by the terminal; then, adjusting the current character posture of the second virtual character based on the first location information and the second location information to obtain the target character posture of the second virtual character; finally, responding to a trigger command for the target character posture, controlling the second virtual character in the virtual session scene to execute the target character posture. This application embodiment improves the flexibility of virtual characters, enriches the interaction methods between virtual objects, and enhances the interactivity and realism of virtual characters by determining the location information of the virtual character of the currently speaking user and the location information of the virtual characters of other listening users, and adjusting the character posture of the virtual characters of other listening users.

[0125] To better implement the above methods, embodiments of this application may also provide a virtual character processing device, which may be integrated into a computer device, such as a terminal or other computer device.

[0126] Please see Figure 7 , Figure 7 This application provides a schematic diagram of the structure of a virtual character processing device, which includes:

[0127] The first acquisition unit 201 is used to acquire the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene;

[0128] The second acquisition unit 202 is used to acquire the second location information of the second virtual character;

[0129] The adjustment unit 203 is used to adjust the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character.

[0130] Control unit 204 is used to control the second virtual character in the virtual session scene to perform the target character posture, so as to display the second virtual character performing the target character posture in the first session screen.

[0131] In some embodiments, the processing device for the virtual character includes:

[0132] The first sending subunit is used to send the target character posture of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting perspective.

[0133] In some embodiments, the processing device for the virtual character includes:

[0134] The first determining subunit is used to determine the target adjustment direction based on the first position information and the second position information;

[0135] The first adjustment subunit is used to adjust the current head orientation of the second virtual character based on the target adjustment direction to obtain the target head orientation of the second virtual character.

[0136] In some embodiments, the processing device for the virtual character includes:

[0137] The first control subunit is used to control the head orientation of the second virtual character in the virtual session scene towards the target head.

[0138] In some embodiments, the processing device for the virtual character includes:

[0139] The first receiving subunit is used to receive the first direction determination logic sent by the second terminal device;

[0140] The second determining subunit is used to determine the first target adjustment direction based on the first position information, the second position information, and the first direction determination logic, wherein the first target adjustment direction is the direction in which the head of the second virtual character faces the first position corresponding to the first position information.

[0141] In some embodiments, the processing device for the virtual character includes:

[0142] The second receiving subunit is used to receive the second direction determination logic sent by the second terminal device;

[0143] The third determining subunit is used to determine the second target adjustment direction based on the first position information, the second position information, and the second direction determination logic, wherein the second target adjustment direction is the direction in which the head of the second virtual character faces away from the first position.

[0144] In some embodiments, the processing device for the virtual character includes:

[0145] The second adjustment subunit is used to adjust the specified character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character.

[0146] The second control subunit is used to control the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the first session screen.

[0147] In some embodiments, the processing device for the virtual character includes:

[0148] The third adjustment subunit is used to adjust the mouth movements of the first virtual character based on the audio information to obtain the target character mouth movements of the first virtual character, which are used as the target character movements.

[0149] and / or

[0150] The third adjustment subunit is further configured to adjust the hand movements of the first virtual character based on the audio information to obtain the target hand movements of the first virtual character as the target character movements.

[0151] In some embodiments, the processing device for the virtual character includes:

[0152] The third control subunit is used to control the mouth of the first virtual character in the virtual conversation scene to perform the lip-syncing action of the target character when the target character's action includes the lip-syncing action of the target character;

[0153] The third control subunit is further configured to control the hand of the first virtual character in the virtual session scene to perform the target hand action when the target character action includes the target hand action.

[0154] In some embodiments, the processing device for the virtual character includes:

[0155] The second sending subunit is used to send the target character action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so as to display the first virtual character performing the target character action in the second session screen on the virtual session interface provided by the second terminal device.

[0156] In some embodiments, the processing device for the virtual character includes:

[0157] The display subunit is used to display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of the virtual conversation scene and multiple virtual characters located in the virtual conversation scene;

[0158] The fourth determining subunit is used to determine the preset character posture corresponding to the refusal instruction in response to the refusal instruction from the target virtual character among the plurality of virtual characters.

[0159] The fourth control subunit is used to control the target virtual character to perform the preset character posture, so as to display the target virtual character performing the preset character posture in the first session screen.

[0160] In some embodiments, the processing device for the virtual character includes:

[0161] The fourth adjustment subunit is used to adjust the audio information based on the first position information and the second position information to obtain the target spatial audio.

[0162] The first playback subunit is used to play the target space audio in the virtual session scenario.

[0163] In some embodiments, the processing device for the virtual character includes:

[0164] The fifth determining subunit is used to determine target distance information and sound source location information based on the first location information and the second location information;

[0165] The fifth adjustment subunit is used to adjust the volume of the audio information based on the target distance information to obtain the processed audio information;

[0166] The second playback subunit is used to generate target spatial audio based on the processed audio information, and to play the target spatial audio in the virtual session scene based on the sound source location information.

[0167] This application discloses a virtual character processing device. A first acquisition unit 201 acquires the audio information and first location information of a first virtual character currently speaking in the current virtual session, and plays the audio corresponding to the audio information in the virtual session scene. A second acquisition unit 202 acquires the second location information of the second virtual character. An adjustment unit 203 adjusts the current character posture of the second virtual character based on the first and second location information to obtain a target character posture. A control unit 204 controls the second virtual character in the virtual session scene to execute the target character posture, so that the second virtual character executing the target character posture is displayed in the first session screen. This application embodiment improves the flexibility of virtual characters, enriches the interaction methods between virtual objects, and enhances the interactivity and realism of virtual characters by determining the location information of the virtual character of the currently speaking user and the location information of the virtual characters of other listening users and adjusting the character postures of the virtual characters of other listening users.

[0168] Accordingly, this application also provides a computer device, which can be a terminal or a server. The terminal can be a smartphone, tablet computer, laptop computer, touch screen, game console, personal computer (PC), personal digital assistant (PDA), or other terminal device. Figure 8 As shown, Figure 8 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. The computer device 300 includes a processor 301 with one or more processing cores, a memory 302 with one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 and the memory 302 are electrically connected. Those skilled in the art will understand that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0169] The processor 301 is the control center of the computer device 300. It connects various parts of the computer device 300 through various interfaces and lines. By running or loading software programs and / or modules stored in the memory 302, and calling data stored in the memory 302, it performs various functions of the computer device 300 and processes data, thereby monitoring the computer device 300 as a whole.

[0170] In this embodiment, the processor 301 in the computer device 300 loads the instructions corresponding to the processes of one or more applications into the memory 302 according to the following steps, and the processor 301 runs the applications stored in the memory 302 to achieve various functions:

[0171] Obtain the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene;

[0172] Obtain the second location information of the second virtual character;

[0173] Based on the first location information and the second location information, the current character pose of the second virtual character is adjusted to obtain the target character pose of the second virtual character;

[0174] Control the second virtual character in the virtual session scene to execute the target character's posture, so as to display the second virtual character executing the target character's posture in the first session screen.

[0175] In one embodiment, after adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character, the method further includes:

[0176] The second terminal device sends the target character pose of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character pose, so that the second virtual character executing the target character pose is displayed in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting perspective.

[0177] In one embodiment, adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character includes:

[0178] The target adjustment direction is determined based on the first location information and the second location information;

[0179] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.

[0180] In one embodiment, controlling a second virtual character in the virtual session scene to execute the target character's pose includes:

[0181] Control the head of the second virtual character in the virtual session scene to face the target head orientation.

[0182] In one embodiment, the virtual session interface displays a first functional control and a second functional control, and each functional control is associated with a direction determination logic;

[0183] Before determining the target adjustment direction based on the first location information and the second location information, the method further includes:

[0184] In response to a trigger operation on the first functional control, a first direction determination logic corresponding to the first functional control is determined;

[0185] Determining the target adjustment direction based on the first location information and the second location information includes:

[0186] Based on the first location information, the second location information, and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first location corresponding to the first location information.

[0187] In one embodiment, before determining the target adjustment direction based on the first location information and the second location information, the method further includes:

[0188] In response to a trigger operation on the second functional control, determine the second direction determination logic corresponding to the second functional control;

[0189] Determining the target adjustment direction based on the first location information and the second location information includes:

[0190] Based on the first location information, the second location information, and the second direction determination logic, the second target adjustment direction is determined, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first location.

[0191] In one embodiment, after obtaining the audio information and first location information of the first virtual character currently speaking in the current virtual session, the method further includes:

[0192] Based on the audio information, the designated character action of the first virtual character is adjusted to obtain the target character action of the first virtual character.

[0193] Control the first virtual character in the virtual session scene to perform the target character's action, so as to display the first virtual character performing the target character's action in the first session screen.

[0194] In one embodiment, adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character includes:

[0195] Based on the audio information, the mouth movements of the first virtual character are adjusted to obtain the target character mouth movements of the first virtual character, which are used as the target character movements.

[0196] and / or

[0197] Based on the audio information, the hand movements of the first virtual character are adjusted to obtain the target hand movement of the first virtual character, which is then used as the target character movement.

[0198] In one embodiment, controlling a first virtual character in the virtual session scene to perform the target character's action includes:

[0199] When the target character's action includes the target character's lip-syncing action, the mouth of the first virtual character in the virtual conversation scene is controlled to perform the target character's lip-syncing action;

[0200] When the target character's action includes the target hand action, the hand of the first virtual character in the virtual session scene is controlled to perform the target hand action.

[0201] In one embodiment, after adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character, the method further includes:

[0202] Send the target character action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so that the first virtual character performing the target character action is displayed in the second session screen on the virtual session interface provided by the second terminal device.

[0203] In one embodiment, the method further includes:

[0204] Display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of the virtual conversation scene and multiple virtual characters located in the virtual conversation scene;

[0205] In response to a refusal to participate instruction from a target virtual character among the plurality of virtual characters, a preset character posture corresponding to the refusal to participate instruction is determined;

[0206] The target virtual character is controlled to perform the preset character posture, so as to display the target virtual character performing the preset character posture in the first session screen.

[0207] In one embodiment, playing the audio corresponding to the audio information in the virtual session scenario includes:

[0208] The audio information is adjusted and processed based on the first location information and the second location information to obtain the target spatial audio;

[0209] The target space audio is played in the virtual session scenario.

[0210] In one embodiment, adjusting the audio information based on the first location information and the second location information to obtain target spatial audio includes:

[0211] Based on the first location information and the second location information, the target distance information and the sound source location information are determined;

[0212] The volume of the audio information is adjusted based on the target distance information to obtain the processed audio information;

[0213] Target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual session scene based on the sound source location information.

[0214] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0215] Optional, such as Figure 8 As shown, the computer device 300 also includes: a touch screen display 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. The processor 301 is electrically connected to the touch screen display 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307. Those skilled in the art will understand that... Figure 8 The computer device structure shown does not constitute a limitation on the computer device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0216] The touch display screen 303 can be used to display a graphical user interface (GUI) and receive operation commands generated by the user interacting with the GUI. The touch display screen 303 may include a display panel and a touch panel. The display panel can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the computer device. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Optionally, the display panel can be configured using a liquid crystal display (LCD), organic light-emitting diode (OLED), or other similar technologies. The touch panel can be used to collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel), generate corresponding operation commands, and execute the corresponding program according to the operation commands. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch location and the signal generated by the touch operation, transmitting the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 301. It can also receive and execute commands from the processor 301. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it transmits the information to the processor 301 to determine the type of touch event. Subsequently, the processor 301 provides corresponding visual output on the display panel based on the type of touch event. In this embodiment, the touch panel and the display panel can be integrated into the touch display screen 303 to achieve input and output functions. However, in some embodiments, the touch panel and the touch display screen 303 can be implemented as two independent components to achieve input and output functions. That is, the touch display screen 303 can also be used as part of the input unit 306 to achieve input functions.

[0217] In this embodiment, a processor 301 executes an application to generate a graphical interface on a touch display screen 303. The touch display screen 303 is used to present the graphical interface and receive user commands generated by the graphical interface.

[0218] The radio frequency circuit 304 can be used to transmit and receive radio frequency signals to establish wireless communication with network devices or other computer devices, and to transmit and receive signals with network devices or other computer devices.

[0219] Audio circuitry 305 can be used to provide an audio interface between a user and a computer device via a speaker and a microphone. Audio circuitry 305 converts received audio data into electrical signals, transmits them to the speaker, and the speaker converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuitry 305, converted back into audio data, and output to processor 301 for processing. The audio data is then transmitted via radio frequency circuitry 304 to, for example, another computer device, or output to memory 302 for further processing. Audio circuitry 305 may also include an earphone jack to facilitate communication between peripheral headphones and the computer device.

[0220] The input unit 306 can be used to receive input numbers, characters, or user characteristic information (such as fingerprints, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0221] Power supply 307 is used to supply power to various components of computer device 300. Optionally, power supply 307 can be logically connected to processor 301 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. Power supply 307 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0222] although Figure 8 As not shown in the diagram, computer equipment 300 may also include a camera, sensor, wireless fidelity module, Bluetooth module, etc., which will not be described in detail here.

[0223] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0224] As can be seen from the above, the computer device provided in this embodiment obtains the audio information and first location information of the first virtual character currently speaking in the current virtual session, and plays the audio corresponding to the audio information in the virtual session scene; then, it obtains the second location information of the second virtual character; next, it adjusts the current character posture of the second virtual character based on the first location information and the second location information to obtain the target character posture of the second virtual character; finally, it controls the second virtual character in the virtual session scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first session screen. This embodiment of the application, by determining the location information of the virtual character of the currently speaking user and the location information of the virtual characters of other listening users, adjusts the character posture of the virtual characters of other listening users, thereby improving the flexibility of virtual characters, enriching the interaction methods between virtual objects, and improving the interactivity and realism of virtual characters.

[0225] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0226] Therefore, embodiments of this application provide a computer-readable storage medium storing a plurality of computer programs that can be loaded by a processor to execute steps in any of the virtual character processing methods provided in embodiments of this application. For example, the computer program can execute the following steps:

[0227] Obtain the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene;

[0228] Obtain the second location information of the second virtual character;

[0229] Based on the first location information and the second location information, the current character pose of the second virtual character is adjusted to obtain the target character pose of the second virtual character;

[0230] Control the second virtual character in the virtual session scene to execute the target character's posture, so as to display the second virtual character executing the target character's posture in the first session screen.

[0231] In one embodiment, after adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character, the method further includes:

[0232] The second terminal device sends the target character pose of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character pose, so that the second virtual character executing the target character pose is displayed in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting perspective.

[0233] In one embodiment, adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character includes:

[0234] The target adjustment direction is determined based on the first location information and the second location information;

[0235] The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.

[0236] In one embodiment, controlling a second virtual character in the virtual session scene to execute the target character's pose includes:

[0237] Control the head of the second virtual character in the virtual session scene to face the target head orientation.

[0238] In one embodiment, the virtual session interface displays a first functional control and a second functional control, and each functional control is associated with a direction determination logic;

[0239] Before determining the target adjustment direction based on the first location information and the second location information, the method further includes:

[0240] In response to a trigger operation on the first functional control, a first direction determination logic corresponding to the first functional control is determined;

[0241] Determining the target adjustment direction based on the first location information and the second location information includes:

[0242] Based on the first location information, the second location information, and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first location corresponding to the first location information.

[0243] In one embodiment, before determining the target adjustment direction based on the first location information and the second location information, the method further includes:

[0244] In response to a trigger operation on the second functional control, determine the second direction determination logic corresponding to the second functional control;

[0245] Determining the target adjustment direction based on the first location information and the second location information includes:

[0246] Based on the first location information, the second location information, and the second direction determination logic, the second target adjustment direction is determined, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first location.

[0247] In one embodiment, after obtaining the audio information and first location information of the first virtual character currently speaking in the current virtual session, the method further includes:

[0248] Based on the audio information, the designated character action of the first virtual character is adjusted to obtain the target character action of the first virtual character.

[0249] Control the first virtual character in the virtual session scene to perform the target character's action, so as to display the first virtual character performing the target character's action in the first session screen.

[0250] In one embodiment, adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character includes:

[0251] Based on the audio information, the mouth movements of the first virtual character are adjusted to obtain the target character mouth movements of the first virtual character, which are used as the target character movements.

[0252] and / or

[0253] Based on the audio information, the hand movements of the first virtual character are adjusted to obtain the target hand movement of the first virtual character, which is then used as the target character movement.

[0254] In one embodiment, controlling a first virtual character in the virtual session scene to perform the target character's action includes:

[0255] When the target character's action includes the target character's lip-syncing action, the mouth of the first virtual character in the virtual conversation scene is controlled to perform the target character's lip-syncing action;

[0256] When the target character's action includes the target hand action, the hand of the first virtual character in the virtual session scene is controlled to perform the target hand action.

[0257] In one embodiment, after adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character, the method further includes:

[0258] Send the target character action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so that the first virtual character performing the target character action is displayed in the second session screen on the virtual session interface provided by the second terminal device.

[0259] In one embodiment, the method further includes:

[0260] Display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of the virtual conversation scene and multiple virtual characters located in the virtual conversation scene;

[0261] In response to a refusal to participate instruction from a target virtual character among the plurality of virtual characters, a preset character posture corresponding to the refusal to participate instruction is determined;

[0262] The target virtual character is controlled to perform the preset character posture, so as to display the target virtual character performing the preset character posture in the first session screen.

[0263] In one embodiment, playing the audio corresponding to the audio information in the virtual session scenario includes:

[0264] The audio information is adjusted and processed based on the first location information and the second location information to obtain the target spatial audio;

[0265] The target space audio is played in the virtual session scenario.

[0266] In one embodiment, adjusting the audio information based on the first location information and the second location information to obtain target spatial audio includes:

[0267] Based on the first location information and the second location information, the target distance information and the sound source location information are determined;

[0268] The volume of the audio information is adjusted based on the target distance information to obtain the processed audio information;

[0269] Target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual session scene based on the sound source location information.

[0270] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0271] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0272] Because the computer program stored in the storage medium can execute the steps of any of the virtual character processing methods provided in this application embodiment, it obtains the audio information and first location information of the first virtual character currently speaking in the current virtual session, and plays the audio corresponding to the audio information in the virtual session scene; then, it obtains the second location information of the second virtual character; next, it adjusts the current character posture of the second virtual character based on the first location information and the second location information to obtain the target character posture of the second virtual character; finally, it controls the second virtual character in the virtual session scene to execute the target character posture, so as to display the second virtual character executing the target character posture in the first session screen. This application embodiment, by determining the location information of the virtual character of the currently speaking user and the location information of the virtual characters of other listening users, adjusts the character posture of the virtual characters of other listening users, thereby improving the flexibility of virtual characters, enriching the interaction methods between virtual objects, and improving the interactivity and realism of virtual characters.

[0273] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0274] The foregoing has provided a detailed description of a method, apparatus, computer device, and storage medium for processing virtual characters according to embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the technical solutions and core ideas of this application. Those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. These modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for processing virtual characters, characterized in that, A virtual conversation interface is provided through a first terminal device, the virtual conversation interface displaying: a first conversation frame obtained by capturing a first virtual character controlled by the first terminal device in a virtual conversation scene from a first shooting perspective, wherein the first conversation frame includes at least a portion of the virtual conversation scene, and the first virtual character and a second virtual character participating in the current virtual conversation in the virtual conversation scene, the second virtual character being a virtual character controlled by a second terminal device, the method including: Obtain the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene; Obtain the second location information of the second virtual character; Based on the first location information and the second location information, the current character posture of the second virtual character is adjusted to obtain the target character posture of the second virtual character. The target character posture includes at least one of the following: head rotation, synchronized body rotation, and limb animation. Control the second virtual character in the virtual session scene to execute the target character's posture, so as to display the second virtual character executing the target character's posture in the first session screen.

2. The method for processing virtual characters according to claim 1, characterized in that, After adjusting the current pose of the second virtual character based on the first and second location information to obtain the target pose of the second virtual character, the method further includes: The second terminal device sends the target character pose of the second virtual character to the second terminal device, so that the second terminal device controls the second virtual character in the virtual session scene to execute the target character pose, so that the second virtual character executing the target character pose is displayed in the second session screen on the virtual session interface provided by the second terminal device. The second session screen is a session screen obtained by shooting the second virtual character controlled by the second terminal device in the virtual session scene according to the second shooting perspective.

3. The method for processing virtual characters according to claim 1, characterized in that, The step of adjusting the current pose of the second virtual character based on the first location information and the second location information to obtain the target pose of the second virtual character includes: The target adjustment direction is determined based on the first location information and the second location information; The current head orientation of the second virtual character is adjusted based on the target adjustment direction to obtain the target head orientation of the second virtual character.

4. The method for processing virtual characters according to claim 3, characterized in that, Controlling the second virtual character in the virtual session scene to execute the target character's pose includes: Control the head of the second virtual character in the virtual session scene to face the target head orientation.

5. The method for processing virtual characters according to claim 3, characterized in that, Determining the target adjustment direction based on the first location information and the second location information includes: Receive the first direction determination logic sent by the second terminal device; Based on the first location information, the second location information, and the first direction determination logic, a first target adjustment direction is determined, wherein the first target adjustment direction is: the direction in which the head of the second virtual character faces the first location corresponding to the first location information.

6. The method for processing virtual characters according to claim 5, characterized in that, Determining the target adjustment direction based on the first location information and the second location information includes: Receive the second direction determination logic sent by the second terminal device; Based on the first location information, the second location information, and the second direction determination logic, the second target adjustment direction is determined, wherein the second target adjustment direction is: the direction in which the head of the second virtual character faces away from the first location.

7. The method for processing virtual characters according to claim 2, characterized in that, After obtaining the audio information and first location information of the first virtual character currently speaking in the current virtual session, the method further includes: Based on the audio information, the designated character action of the first virtual character is adjusted to obtain the target character action of the first virtual character. Control the first virtual character in the virtual session scene to perform the target character's action, so as to display the first virtual character performing the target character's action in the first session screen.

8. The method for processing virtual characters according to claim 7, characterized in that, The step of adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character includes: Based on the audio information, the mouth movements of the first virtual character are adjusted to obtain the target character mouth movements of the first virtual character, which are used as the target character movements. and / or Based on the audio information, the hand movements of the first virtual character are adjusted to obtain the target hand movement of the first virtual character, which is then used as the target character movement.

9. The method for processing virtual characters according to claim 8, characterized in that, Controlling the first virtual character in the virtual session scene to execute the target character's action includes: When the target character's action includes the target character's lip-syncing action, the mouth of the first virtual character in the virtual conversation scene is controlled to perform the target character's lip-syncing action; When the target character's action includes the target hand action, the hand of the first virtual character in the virtual session scene is controlled to perform the target hand action.

10. The method for processing virtual characters according to claim 7, characterized in that, After adjusting the designated character action of the first virtual character based on the audio information to obtain the target character action of the first virtual character, the method further includes: Send the target character action of the first virtual character to the second terminal device, so that the second terminal device controls the first virtual character in the virtual session scene to perform the target character action, so that the first virtual character performing the target character action is displayed in the second session screen on the virtual session interface provided by the second terminal device.

11. The method for processing virtual characters according to claim 1, characterized in that, The method further includes: Display a virtual conversation interface, wherein the virtual conversation interface includes at least a portion of the virtual conversation scene and multiple virtual characters located in the virtual conversation scene; In response to a refusal to participate instruction from a target virtual character among the plurality of virtual characters, a preset character posture corresponding to the refusal to participate instruction is determined; The target virtual character is controlled to perform the preset character posture, so as to display the target virtual character performing the preset character posture in the first session screen.

12. The method for processing virtual characters according to claim 1, characterized in that, Playing the audio corresponding to the audio information in the virtual session scenario includes: The audio information is adjusted and processed based on the first location information and the second location information to obtain the target spatial audio; The target space audio is played in the virtual session scenario.

13. The method for processing virtual characters according to claim 12, characterized in that, The step of adjusting the audio information based on the first location information and the second location information to obtain the target spatial audio includes: Based on the first location information and the second location information, the target distance information and the sound source location information are determined; The volume of the audio information is adjusted based on the target distance information to obtain the processed audio information; Target spatial audio is generated based on the processed audio information, and the target spatial audio is played in the virtual session scene based on the sound source location information.

14. A processing device for virtual characters, characterized in that, A virtual conversation interface is provided through a first terminal device. The virtual conversation interface displays: a first conversation scene captured from a first shooting perspective, showing a first virtual character controlled by the first terminal device in the virtual conversation scene. The first conversation scene includes at least a portion of the virtual conversation scene, and the first virtual character and a second virtual character participating in the current virtual conversation within the virtual conversation scene. The second virtual character is a virtual character controlled by the second terminal device. The device includes: The first acquisition unit is used to acquire the audio information and first location information of the first virtual character currently speaking in the current virtual session, and play the audio corresponding to the audio information in the virtual session scene; The second acquisition unit is used to acquire the second location information of the second virtual character; An adjustment unit is used to adjust the current character posture of the second virtual character based on the first position information and the second position information to obtain the target character posture of the second virtual character. The target character posture includes at least one of the following: head rotation, synchronized body rotation, and limb animation. The control unit is used to control the second virtual character in the virtual session scene to perform the target character posture, so as to display the second virtual character performing the target character posture in the first session screen.

15. A computer device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements the method for processing virtual characters as described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the method for processing virtual characters as described in any one of claims 1 to 13.

Images