Virtual character control method and device, electronic equipment and readable storage medium

By providing first and second virtual characters in a virtual environment, players can control the game through manual operation and voice commands, combined with automatic action execution, which solves the problems of simple and complex game operation and voice control delay, and improves the efficiency of human-computer interaction.

CN118454233BActive Publication Date: 2026-03-17NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-30
Publication Date
2026-03-17

AI Technical Summary

Technical Problem

In existing technologies, game operation controls are simple and complex, and voice control methods are difficult to keep up with the rapid changes in games, resulting in low efficiency of human-computer interaction.

Method used

By providing a first virtual character and a second virtual character in a virtual environment, players can control the first virtual character with control commands and the second virtual character with voice control commands. When no voice control commands are received, the second virtual character will automatically perform virtual actions.

Benefits of technology

It enriches the ways players can control the game, reduces the delay of voice control commands, improves the efficiency of human-computer interaction, and ensures the timeliness of operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118454233B_ABST
    Figure CN118454233B_ABST
Patent Text Reader

Abstract

The present disclosure provides a virtual role control method and device, electronic equipment and a readable storage medium, in response to a control instruction for a first virtual role, controlling the first virtual role to perform a corresponding virtual action; in response to a voice control instruction for a second virtual role, controlling the second virtual role to perform a corresponding virtual action; in the case where no voice control instruction for the second virtual role is received, controlling the second virtual role to automatically perform a virtual action. In this way, the player can control the virtual role through the control instruction while controlling other virtual roles to perform virtual actions through the voice control instruction, enriching the player's control method, and for virtual roles that can be controlled through voice control instructions, when no voice control instruction from the player is received, the virtual action will also be automatically performed, reducing the delay of voice control instruction operation, ensuring the timeliness of the operation while enriching the player's operation method, which helps to improve the efficiency of human-computer interaction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of human-computer interaction technology, and in particular to methods, devices, electronic devices, and readable storage media for controlling virtual characters. Background Technology

[0002] With the development of the internet, more and more games are appearing before players. In the process of game interaction, players need to control virtual characters to perform virtual behaviors in a virtual environment in order to complete game tasks. In related technologies, most of the player's operation in the game is still manually input through controls displayed on the terminal device or external input devices. Some complex instructions require complex input operations to complete. The monotonous operation form and the existence of complex operations will cause discomfort to players.

[0003] To address the issue of simplistic and complex operation controls, a voice-based control method has been proposed. Players can directly issue control commands via voice, which alleviates the simplistic and complex nature of input operations to some extent. However, in the heat of battle, control opportunities are fleeting. Voice control requires an additional voice recognition step to identify the player's intentions and complete the operation. Voice control struggles to keep up with the rapid changes within the game, resulting in slow voice control feedback and low human-computer interaction efficiency. Summary of the Invention

[0004] In view of this, the purpose of this disclosure is to provide a method, device, electronic device, and readable storage medium for controlling virtual characters. Players can control virtual characters with control commands and control other virtual characters to perform virtual actions with voice control commands, which enriches the player's control methods. Furthermore, for virtual characters that can be controlled by voice control commands, they will automatically perform virtual actions even when they do not receive voice control commands from the player, reducing the delay of voice control command operations. This enriches the player's control methods while ensuring the timeliness of operations, and helps to improve the efficiency of human-computer interaction.

[0005] In a first aspect, embodiments of this disclosure provide a method for controlling a virtual character, the method comprising:

[0006] Provide a first virtual character and a second virtual character in a virtual environment;

[0007] In response to the control command for the first virtual character, control the first virtual character to perform the corresponding virtual action;

[0008] In response to voice control commands for the second virtual character, the system controls the second virtual character to perform corresponding virtual actions based on the voice control commands.

[0009] In the absence of voice control commands for the second virtual character, control the second virtual character to automatically perform virtual actions.

[0010] Secondly, embodiments of this disclosure also provide a control device for a virtual character, the control device comprising:

[0011] A virtual character providing module is used to provide a first virtual character and a second virtual character in a virtual environment;

[0012] The first virtual character control module is used to respond to control commands for the first virtual character and control the first virtual character to perform corresponding virtual actions.

[0013] A voice control module is used to respond to voice control commands for the second virtual character and control the second virtual character to perform corresponding virtual actions according to the voice control commands;

[0014] The non-voice control module is used to control the second virtual character to automatically perform virtual actions when no voice control command is received for the second virtual character.

[0015] Thirdly, embodiments of this disclosure also provide an electronic device, including: a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the virtual character control method as described in any of the first aspects.

[0016] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the virtual character control method as described in any of the first aspects.

[0017] The virtual character control method, apparatus, electronic device, and readable storage medium provided in this disclosure provide a first virtual character and a second virtual character in a virtual environment; responding to control commands for the first virtual character, the first virtual character is controlled to perform corresponding virtual actions; responding to voice control commands for the second virtual character, the second virtual character is controlled to perform corresponding virtual actions according to the voice control commands; and when no voice control commands are received for the second virtual character, the second virtual character is controlled to automatically perform virtual actions. In this way, players can control virtual characters with control commands while simultaneously controlling other virtual characters to perform virtual actions with voice control commands, enriching the player's control methods. Furthermore, for virtual characters that can be controlled with voice commands, virtual actions will be automatically performed even when no voice control commands are received from the player, reducing the delay of voice control command operations. This enriches the player's control methods while ensuring the timeliness of operations, helping to improve human-computer interaction efficiency.

[0018] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0019] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. It should be understood that the following drawings only show some embodiments of this disclosure and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 A flowchart illustrating a method for controlling a virtual character provided in an embodiment of this disclosure;

[0021] Figure 2 This is a schematic diagram illustrating the process of a voice-controlled virtual character performing virtual actions according to an embodiment of this disclosure;

[0022] Figure 3 This is a schematic diagram of the processing flow for voice-controlled virtual characters to perform virtual behaviors, provided in an embodiment of this disclosure.

[0023] Figure 4 This is a schematic diagram of the triggering process of an active event provided in an embodiment of this disclosure;

[0024] Figure 5 This is a schematic diagram of the process flow for guiding intent provided in the embodiments of this disclosure;

[0025] Figure 6 One of the schematic diagrams of the graphical user interface provided in the embodiments of this disclosure;

[0026] Figure 7 This is a second schematic diagram of a graphical user interface provided in an embodiment of the present disclosure;

[0027] Figure 8 This is a third schematic diagram of a graphical user interface provided in an embodiment of this disclosure;

[0028] Figure 9 This is a schematic diagram of the structure of a virtual character control device provided in an embodiment of the present disclosure;

[0029] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. Based on the embodiments of this disclosure, every other embodiment obtained by those skilled in the art without inventive effort falls within the scope of protection of this disclosure.

[0031] Glossary:

[0032] (1) Graphical User Interface

[0033] A graphical user interface (GUI) is a human-computer interaction display format that allows users to manipulate icons, icons, or menu options on the screen using input devices such as a mouse or keyboard. It also allows users to manipulate icons or menu options on the touch screen of a touch terminal by performing touch operations to select commands, launch programs, or perform other tasks.

[0034] (2) Virtual Environment

[0035] A virtual environment is a game scene displayed (or provided) by an application while it is running on a terminal or server; that is, the scene used during normal gameplay. In other words, a virtual environment refers to the virtual game controls that house virtual characters during gameplay. These virtual characters can move, release skills, and perform other actions within the game scene under the control of user (i.e., player) commands issued to the terminal device. Optionally, the game scene can be a simulation of the real world, a semi-simulated / semi-fictional virtual environment, or a purely fictional virtual environment. The game scene can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual environment. The virtual environment can include elements such as sky, land, and ocean, with the land including environmental elements such as deserts and cities. The game scene is the scene where the user controls the complete game logic of the virtual character. Optionally, the game scene can also be used for game scene battles between at least two virtual characters, and the game scene has virtual resources available for use by at least two virtual characters. For example, a game scene can include any one or more of the following elements: game background elements, game object elements, game item elements, and game resource elements.

[0036] (3) Virtual characters:

[0037] This refers to a controllable dynamic object within a game scene. Optionally, this dynamic object can be a virtual character, virtual animal, anime character, etc. The virtual character is a character controlled by the player through an input device (e.g., a terminal device), or an artificial intelligence (AI) trained and set up for battle in a virtual environment, or a non-player character (NPC) set up for battle in a game scene. Optionally, the virtual character can include virtual figures competing in the game scene. Optionally, the number of virtual characters in the game scene battle is preset or dynamically determined based on the number of clients joining the battle; this disclosure does not limit this. In one possible implementation, the user can control the virtual character to move within the virtual environment, for example, controlling the virtual character to run, jump, crawl, etc., and can also control the virtual character to use skills and virtual items provided by the application to fight against other virtual characters.

[0038] In an optional implementation, various cloud applications, such as cloud gaming, can run under the cloud interaction system. Taking cloud gaming as an example, cloud gaming refers to a gaming method based on cloud computing. In the cloud gaming operating mode, the game program's execution and the game screen presentation are separated. The storage and execution of the virtual character's control methods are completed on the cloud gaming server. The client device is used for data reception, transmission, and game screen presentation. For example, the client device can be a display device with data transmission capabilities located close to the user, such as a mobile terminal, television, computer, or PDA; however, the information processing is performed by the cloud gaming server in the cloud. When playing the game, the player operates the client device to send operation commands to the cloud gaming server. The cloud gaming server runs the game according to the operation commands, encodes and compresses the game screen and other data, returns it to the client device via the network, and finally, the client device decodes and outputs the game screen.

[0039] In an optional implementation, taking a game as an example, the local terminal device stores the game program and is used to display the game screen. The local terminal device is used to interact with the player through a graphical user interface (GUI), i.e., conventionally by downloading, installing, and running the game program via an electronic device. The local terminal device can provide the GUI to the player in various ways, such as rendering it on the terminal's display screen or providing it to the player via holographic projection. For example, the local terminal device can include a display screen for displaying the GUI, which includes game screens, and a processor for running the game, generating the GUI, and controlling the display of the GUI on the display screen.

[0040] In one possible implementation, this invention provides a method for controlling a virtual character, which provides a graphical user interface through a terminal device. The terminal device can be a local terminal device (such as a local touch terminal) or a client device in the aforementioned cloud interaction system. The following description uses the example of the virtual character control method running on a local terminal device (hereinafter referred to as the terminal device).

[0041] Please see Figure 1 , Figure 1 This is a flowchart illustrating a method for controlling a virtual character as provided in an embodiment of this disclosure. Figure 1 As shown in the embodiments of this disclosure, the method for controlling a virtual character includes:

[0042] S101. Provide a first virtual character and a second virtual character in a virtual environment.

[0043] S102. Respond to the control command for the first virtual character and control the first virtual character to perform the corresponding virtual action.

[0044] S103. Respond to the voice control command for the second virtual character, and control the second virtual character to perform the corresponding virtual action according to the voice control command.

[0045] S104. In the absence of receiving a voice control command for the second virtual character, control the second virtual character to automatically perform virtual actions.

[0046] The virtual character control method provided in this embodiment allows players to control virtual characters with manual commands and control other virtual characters to perform virtual actions with voice commands, enriching the player's control methods. Furthermore, for virtual characters that can be controlled by voice commands, they will automatically perform virtual actions even when they do not receive voice commands from the player, reducing the delay of voice command operations. This enriches the player's control methods while ensuring the timeliness of operations, and helps to improve the efficiency of human-computer interaction.

[0047] The exemplary steps of the embodiments of this disclosure are described below:

[0048] S101. Provide a first virtual character and a second virtual character in a virtual environment.

[0049] In this embodiment of the disclosure, players can control virtual characters to move in a virtual environment or interact with other virtual characters in the virtual environment (e.g., fight; or cooperate with each other).

[0050] In one possible implementation, the first virtual character can be a virtual character controlled by a player. The player can control the first virtual character through triggering operations, and all virtual actions performed by the first virtual character in the virtual environment are controlled by the player.

[0051] Among them, the control commands for the first virtual character are non-voice control commands, that is, the control of the first virtual character is carried out through the player's trigger operation.

[0052] In one possible implementation, the first virtual character and the second virtual character are virtual characters belonging to the same faction. The first virtual character can cooperate with the second virtual character to complete virtual tasks in the virtual environment. Specifically, the second virtual character can be a teammate of the first virtual character. The second virtual character can cooperate with the first virtual character to complete corresponding virtual tasks in the virtual environment, such as resource searching, vigilance, rescue, combat, assembly, retreat, and other tasks or actions.

[0053] In one possible example, when the first virtual character is fighting against an enemy virtual character in a virtual environment, the second virtual character can cooperate with the first virtual character to complete the battle. For example, the second virtual character can assist the first virtual character in fighting against the enemy virtual character, or assist in attacking the enemy virtual character while the first virtual character is fighting against the enemy virtual character. The second virtual character can also help heal the first virtual character. Specifically, when the first virtual character is injured in the battle against the enemy virtual character, the second virtual character can heal the first virtual character.

[0054] In another possible example, the second virtual character can also assist the first virtual character in completing other auxiliary virtual tasks while the first virtual character is performing the first virtual task; for example, while the first virtual character is performing the main task, the second virtual character can assist in completing tasks such as searching for supplies and guarding.

[0055] The second virtual character can be controlled by the player via voice commands or by automatic control logic. Automatic control can be achieved through artificial intelligence (AI) or by using behavior trees and pre-set tables. By analyzing the player's historical control logic and the historical control methods in different scenarios within the virtual environment, and considering the relationships between different behaviors (continuous relationships, auxiliary relationships, etc.), different control logics are preset, and AI executes these preset control logics.

[0056] In one possible implementation, when the second virtual character is controlled by the player's voice control commands, the same terminal device receives control commands for the first virtual character and voice control commands for the second virtual character.

[0057] Specifically, the terminal device is equipped with a touch control device (such as a touch screen, or an external input device: keyboard, mouse, game controller, etc.) to receive trigger operations, and a device to receive voice control commands (such as a microphone, etc.). Players can control a first virtual character to perform virtual actions in the virtual environment by issuing non-voice control commands through the terminal device. At the same time, they can control a second virtual character to perform virtual actions in the virtual environment by issuing voice control commands through the same terminal device. Players can control both the first and second virtual characters through a single terminal device, which facilitates player control operations and helps improve human-computer interaction efficiency.

[0058] The control methods for the first virtual character and the second virtual character will be explained below.

[0059] S102. Respond to the control command for the first virtual character and control the first virtual character to perform the corresponding virtual action.

[0060] In this embodiment of the disclosure, a player can control a first virtual character to perform movement and / or attack actions in a virtual environment through operation commands directed at the first virtual character. Responding to the operation commands directed at the first virtual character and controlling the first virtual character to perform corresponding virtual actions includes: responding to the operation commands directed at the first virtual character and controlling the first virtual character to perform virtual actions according to the operation commands directed at the first virtual character.

[0061] Specifically, the control methods also include:

[0062] a1: Provides attack control area and movement control area in the graphical user interface.

[0063] In one possible implementation, the step "responding to a control command for the first virtual character and controlling the first virtual character to perform a corresponding virtual action" includes:

[0064] b1: In response to movement control commands targeting the attack control area, control the first virtual character to perform movement actions in the virtual environment.

[0065] b2: Responds to attack control commands targeting the attack control area, and controls the first virtual character to perform attack actions in the virtual environment.

[0066] In this embodiment of the disclosure, the motion control area can be an area displayed in a graphical user interface, and the motion control area includes at least one motion control control. The display shape of the motion control area can be a preset shape (rectangle, circle, etc.), or it can be consistent with the shape of the motion control control.

[0067] In another possible implementation, the motion control area can also be an area hidden in the graphical user interface. In this case, the motion control controls contained in the motion control area can be displayed in the graphical user interface or hidden in the graphical user interface.

[0068] Regardless of the display method mentioned above, the response range of the movement control area is greater than or equal to the control response range of the movement control control. The response range of the movement control area can be preset during the game settings process. For example, the response range of the movement control area can be within the preset range of the movement control control.

[0069] In one possible implementation, the player's movement control commands for the movement control area can be either touch operations or click operations on the movement control area.

[0070] For example, when the terminal device is a mobile terminal, touch operations (long press, click, or swipe) are performed on the mobile control area; when the terminal device is a PC, operations on the mobile control area can be performed by clicking on the mobile control area via an external input device (such as a mouse, keyboard, or game controller).

[0071] For example, taking the virtual joystick in the game settings as the motion control control, the virtual joystick is generally located in the lower left corner of the graphical user interface. Players control the target virtual character to move in the game scene according to the player's control by sliding operations (sliding position and sliding distance) on the virtual joystick. The area occupied by the entire virtual joystick in the graphical user interface can be the response range of the entire motion control area. In another example, a rectangular area can be set with the virtual joystick as the center, and this rectangular area can be defined as the motion control area (this rectangular area can be displayed in the graphical user interface or hidden in the graphical user interface).

[0072] In one possible implementation, the attack control area can also be an area that includes at least one attack control. Players can control the virtual character to perform the attack behavior of the attack control corresponding to the touch operation by touching any attack control in the attack control area.

[0073] In one possible implementation, the first virtual character may be a virtual character that cannot be controlled by voice commands. In this case, all control commands for the first virtual character are issued by the player through non-voice commands. Alternatively, the first virtual character may be a virtual character that can be controlled by both non-voice commands and voice commands. In this case, if both non-voice commands and voice commands are received from the player for the first virtual character, the non-voice commands should be used as the primary means to control the first virtual character to perform virtual actions in the virtual environment.

[0074] In another possible implementation, for the second virtual character, the player can control the second virtual character to perform corresponding virtual actions through voice control commands. When no voice control commands are received from the player, the second virtual character is not completely still in the virtual environment, but can automatically perform virtual actions in the virtual environment according to the automatic control logic. The control logic of the second virtual character in different control modes will be described below.

[0075] In one possible implementation, the virtual character is controlled via voice commands.

[0076] S103. Respond to the voice control command for the second virtual character, and control the second virtual character to perform the corresponding virtual action according to the voice control command.

[0077] In this embodiment of the disclosure, the voice control command for the second virtual character can be received through the voice acquisition device of the terminal device, and after receiving the control command for the second virtual character, the control command is issued to the second virtual character.

[0078] It is worth noting that players can control more than one second virtual character to perform virtual actions in the virtual environment at the same time through voice control commands. When issuing voice control commands, players can specify the second virtual character to be controlled and the control intention (what virtual action to be performed by the second virtual character) in the voice control commands.

[0079] For example, the voice control command given by the player could be "Xiao A, I need to check if there are any enemy virtual characters around." Based on the above voice control command, it can be known that the player needs to control a second virtual character named "Xiao A" to perform the virtual action of "checking if there are any enemy virtual characters around".

[0080] In one possible implementation, after receiving a voice control command from the player, it is necessary to determine whether the second virtual character can perform the corresponding virtual action and how to perform the corresponding virtual action based on the voice control command and the character attributes of the second virtual character.

[0081] Specifically, the step "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands" includes:

[0082] c1: Based on voice control commands and the character attributes of the second virtual character, control the second virtual character to perform virtual actions in the virtual environment through automatic control logic.

[0083] In this embodiment, after the player issues a voice control command, it can be determined whether the second virtual character has the conditions to perform the virtual action corresponding to the voice control command based on the character attributes of the second virtual character. If it is determined that the second virtual character has the conditions to perform the virtual action corresponding to the voice control command, the automatic control logic controls the second virtual character to perform the virtual action corresponding to the voice control command in the virtual environment. If it is determined that the second virtual character does not have the conditions to perform the virtual action corresponding to the voice control command, the automatic control logic controls the second virtual character not to perform or to partially perform the corresponding virtual action.

[0084] In this embodiment of the disclosure, the character attributes of the second virtual character may include at least one of the following: the health points of the second virtual character, the action setting method of the second virtual character (i.e., the character type of the second virtual character), and the personality attributes of the second virtual character.

[0085] For example, the second virtual character's health points represent its current health status. If the second virtual character's current health points are greater than a preset health point threshold, it is determined that the second virtual character has the ability to perform virtual actions corresponding to voice control commands. The automatic control logic controls the second virtual character to perform virtual actions corresponding to voice control commands in the virtual environment. If the second virtual character's current health points are less than the preset health point threshold (for example, the second virtual character is in a virtual death state such as being defeated), it is determined that the second virtual character does not have the conditions to perform virtual actions corresponding to voice control commands, and will not be able to execute the voice control commands issued by the player (for example, commands to attack enemy virtual characters). The action settings for the second virtual character can be based on the character's attributes. For example, if the second virtual character is set as a rescuer (a virtual character with rescue-related skills), and the player instructs the second virtual character to use an attack skill to fight an enemy virtual character head-on, the second virtual character may not have the conditions to execute the virtual action corresponding to the voice control command. Therefore, it cannot complete the player's voice control command. When the second virtual character does not currently have the conditions to execute the player's voice control command, it may not execute or only partially execute the player's voice control command. Besides rescuer-type characters, the second virtual character's role type can also be a ranged attack type character (e.g., possessing ranged attack skills or moves), a support type character (e.g., a virtual character that can enhance the combat damage or abilities of other virtual characters), and so on. The game system can configure or generate personality attributes for the second virtual character. For example, regarding combat style, it can be aggressive or conservative; an aggressive personality is more likely to accept commands to attack enemy virtual characters than a conservative personality. Similarly, it can be configured to have a high or low command acceptance rate; a high command acceptance rate makes the character more likely to accept commands than a low command acceptance rate.

[0086] For example, if the player's current voice control command is to control the second virtual character to release a certain skill, and the second virtual character's skill is currently in the cooldown phase, the second virtual character does not have the conditions to execute the virtual action corresponding to the voice control command. In this case, the second virtual character cannot immediately execute the voice control command issued by the player.

[0087] In another possible implementation, when controlling the second virtual character to perform virtual actions according to the voice control commands given by the player, in addition to referring to the character attributes of the second virtual character, environmental information of the virtual environment can also be referenced to determine how to control the second virtual character to perform the corresponding virtual actions.

[0088] Specifically, the step "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands" includes:

[0089] d1: Based on voice control commands and environmental information of the virtual environment, the second virtual character is controlled to perform virtual actions in the virtual environment through automatic control logic.

[0090] In this embodiment of the disclosure, the environmental information of the virtual environment may include information about the virtual environment itself (e.g., road settings in the virtual environment, task point settings in the virtual environment, etc.); it may also include the role attributes of teammate virtual characters who are in the same camp as the first virtual character and the second virtual character; and it may also include the role attributes of enemy virtual characters who are in the opposing camp as the first virtual character and the second virtual character.

[0091] In one possible implementation, if the voice control command issued by the player does not match the environmental information settings in the virtual environment, or if the voice control command issued by the player conflicts with the virtual action currently being performed by the teammate's virtual character, or if the virtual action corresponding to the voice control command issued by the player cannot be performed due to the obstruction of the enemy's virtual character, then the second virtual character does not have the conditions to execute the player's voice control command. In this case, the second virtual character may not execute or may not fully execute the player's voice control command.

[0092] For example, if the player's current voice control command is for the second virtual character to find an item at a target location, but there are multiple enemy virtual characters at the target location, the second virtual character cannot reach the target location to find the item while avoiding the enemy virtual characters. In this case, the second virtual character will not execute the player's voice control command. If the current voice control command is to rescue the injured first virtual character, but the teammate virtual character's health is lower than the first virtual character's health, then the second virtual character will prioritize rescuing the teammate virtual character.

[0093] In another possible implementation, when controlling the second virtual character to perform virtual actions in the virtual environment via voice control commands, the second virtual character's character attributes and the environment information of the virtual environment can be referenced simultaneously to control the second virtual character.

[0094] Specifically, the step "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands" further includes:

[0095] e1: Based on the voice control command, the environment information of the virtual environment, and the role attributes of the second virtual character, the automatic control logic controls the second virtual character to perform virtual actions corresponding to the voice control command in the virtual environment.

[0096] In one possible implementation, after receiving a voice control command from a player, the system can first determine whether the second virtual character has the subjective conditions to execute the voice control command based on the character attributes of the second virtual character, and then determine whether the second virtual character has the objective conditions to execute the voice control command based on the environmental information of the virtual environment, thereby determining whether the second virtual character has the conditions to execute the player's voice control command.

[0097] For example, if the player's current voice control command is to control the second virtual character to attack target location A, the system first determines whether the second virtual character's health is sufficient to support the attack based on the character's attributes. If the second virtual character's health is greater than a preset health threshold, the second virtual character is in a "full health" state and can carry out the attack mission. At this time, if the system determines that there are a large number of enemy virtual characters around the second virtual character, and other virtual characters of the same faction cannot immediately defeat the second virtual character, then the system determines that the second virtual character does not have the objective conditions to execute the voice control command, and the second virtual character will not execute the voice control command issued by the player.

[0098] In one possible implementation, in order to more accurately control the second virtual character to perform corresponding virtual actions, the player's voice control commands need to be semantically analyzed to determine the player's control intention. This allows for faster and more accurate control of the second virtual character to perform the corresponding virtual actions. Therefore, when the player controls the second virtual character to perform virtual actions through voice control commands, the player's voice control commands need to be accurately analyzed. The following will describe in detail the process of analyzing the player's voice control commands and converting them into control of the virtual actions of the second virtual character.

[0099] Specifically, the step "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands" includes:

[0100] f1: Based on voice control commands, determine the action control intent corresponding to the voice control commands.

[0101] f2: Based on the action control intent, determine whether the second virtual character can execute the action control intent.

[0102] f3: If the second virtual character can execute the action control intention, the automatic control logic controls the second virtual character to execute virtual actions corresponding to the voice control command in the virtual environment.

[0103] In this embodiment of the disclosure, after receiving a voice control command from a player, the voice control command needs to be analyzed to determine the action control intent within it. Based on the action control intent, it is determined whether the second virtual character can execute the corresponding action control intent and how to execute it. The action control intent corresponding to the voice control command will be described below.

[0104] Specifically, the step "based on voice control commands, determine the action control intent corresponding to the voice control commands" includes:

[0105] g1: Converts the collected voice control commands into text control information.

[0106] g2: Determine the action control intent based on text control information, context information corresponding to other voice control commands associated with the voice control commands, and environmental information of the virtual environment.

[0107] In this embodiment of the disclosure, the module for processing the player's voice control commands can be divided into an automatic speech recognition (ASR) processing module, a natural language understanding (NLU) module, and a text-to-speech (TTS) speech synthesis module, etc. The processing flow of the player's voice operation voice is completed through the cooperation between different modules.

[0108] Specifically, the ASR (Automatic Speech Recognition) module primarily provides real-time (streaming) and non-real-time (non-streaming) speech recognition services. It accurately identifies keywords in voice control commands, such as character names and game control terms, thus converting the player's voice commands into text control information. The NLU (Natural Language Processing) module, upon receiving the text control information processed by the ASR module, parses the true meaning of the voice control commands. Based on various contexts and virtual environment information, it generates a set of action commands that match the player's intentions. These parsed action commands are then transmitted to the TTS (Text-to-Speech) module, which reconstitutes the text information into speech. This speech signal is then played back, allowing the player to instantly understand the system's accuracy in understanding their commands. Through the coordinated processing of these modules, accurate parsing and response to the player's voice control commands can be achieved.

[0109] Furthermore, after the ASR voice processing module, NLU natural language processing module, and TTS voice synthesis module parse and understand the voice control commands issued by the player and complete the voice interaction with the player, it is necessary to control the second virtual character to perform corresponding virtual actions. This can be done through a pre-stored combat model or character behavior model to control the virtual character to perform virtual actions.

[0110] Among them, the combat model or character behavior model introduces control logic from the perspective of multiple participants, such as interaction and cooperation, which enhances the logic and playability of the game itself, provides a certain degree of operational convenience, and helps to improve the efficiency of human-computer interaction.

[0111] In one possible implementation, after determining the text control information, the action control intention for the second virtual character is determined by combining the environmental information of the virtual environment, the character attributes of the second virtual character, and the context information of other voice control commands associated with the voice operation command issued by the current player.

[0112] In order to more accurately determine the action control intention in the player's voice control commands, it is necessary to refer to the player's other voice control commands within a preset time period and combine them with contextual information to understand the player's action control intention.

[0113] For example, based on the analysis of the player's current voice operation command, it can be seen that the player's action control intention is "X, attack", but the player does not know the target of the second virtual character X. According to the other voice operation commands previously issued by the player, the action intention of the player's previous voice operation command was "prepare to attack character M together". Therefore, combined with the context information, it can be seen that the player's current voice operation command is to control the second virtual character X to attack the virtual character M.

[0114] In one possible implementation, in order to more accurately analyze the player's action control intentions, it is necessary to combine the analysis with contextual information. That is, the voice information (the player's original voice control instructions, the converted text control information, and the parsed action instructions) obtained during the processing by the ASR voice processing module, the NLU natural language processing module, and the TTS voice synthesis module should all be saved so that the player's action intentions can be analyzed again later.

[0115] Furthermore, to ensure that the memory usage is not excessive, you can choose to retain the context information for a preset number of rounds. For example, you can retain the context information for only 20 rounds. After retaining the information for 20 rounds, you can delete the historical context information that is far removed from the current time in order to save storage space.

[0116] In one possible implementation, once the voice control command issued by the player is determined, it is necessary to determine whether the second virtual character can execute the current action control intention based on the environmental information of the virtual environment and the character attributes of the second virtual character (the specific method for determining whether the second virtual character can execute the current action intention is as described above and will not be repeated here), and after determining that the second virtual character can execute the action control intention, control the second virtual character to execute the corresponding virtual action.

[0117] In one possible implementation, as mentioned above, players can simultaneously control more than one second virtual character to perform virtual actions in the virtual environment through voice control commands. Therefore, while analyzing the player's action control intention in the voice control commands, it is also necessary to determine the specific target virtual character that the player needs to control, so as to control the target virtual character in the player's voice control commands to perform the player's action control intention.

[0118] In one possible implementation, after receiving a voice control command from the player, the second virtual character automatically executes the player's action control intention. That is, after the player issues a virtual action target, the second virtual character will automatically execute the virtual action according to preset logic. During this process, the player no longer needs to participate in the control process of the second virtual character.

[0119] Meanwhile, when players control a second virtual character to perform virtual actions in a virtual scene using voice commands, in order to enhance the player's interactive immersion, the second virtual character can respond to the player's voice commands while performing virtual actions, further improving the efficiency of human-computer interaction.

[0120] Specifically, after the step of "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands", the control method further includes:

[0121] h1: Displays the second virtual character's response to voice control commands.

[0122] In this embodiment, the response information can be divided into two types. One type is when the second virtual character indicated in the player's voice control command can execute the action control intention in the player's voice control command. In this case, the response information can be used to reply to the player while executing the virtual action. The other type is when the second virtual character indicated in the player's voice control command cannot complete the action control intention in the player's voice control command, or when there is no second virtual character specified by the player. In this case, it is also necessary to communicate and interact with the player through the response information to indicate the current situation.

[0123] The response information includes at least one of the following: voice response information and text response information.

[0124] Specifically, when the response information is a voice response, the response information can be played to the player through the terminal device operated by the player, so as to complete the communication and interaction with the player through the response information; when the response information is a text response, the text information of the communication response between the player and the second virtual character can be displayed in text form in the voice response display area of ​​the graphical user interface.

[0125] In one possible implementation, the second virtual character can respond to the player's voice control commands by executing the player's intention to control actions in the voice commands. To further enhance the immersiveness and realism of the interaction, the response can be based on the voice of the second virtual character.

[0126] Specifically, the step "displaying the second virtual character's response to voice control commands" includes:

[0127] i1: Based on the pre-stored role attributes of the second virtual character, generate and display the response information corresponding to the second virtual character; or,

[0128] i2: Based on the character attributes of the second virtual character, synthesize the response information corresponding to the second virtual character and display the response information.

[0129] In this embodiment of the disclosure, if it is determined that the second virtual character indicated in the voice control command issued by the player can perform the action control intention in the player's voice control command, the voice information of the second virtual character can be determined from the database of the character attributes of the second virtual character in advance, and a response information can be generated based on the voice information and the determined response information.

[0130] In addition to the voice processing system, a configuration system can also be used simultaneously. The configuration system configures the basic information of different virtual characters in different virtual scenes in the game, including but not limited to: the attribute configuration of virtual characters (e.g., the character's attack parameters, configured voice information, etc.). In order to ensure the convenience and efficiency of searching for virtual character information, the configured information can be stored in the storage system Redis (Remote Dictionary Server).

[0131] Specifically, Redis is a key-value storage system. Using the identifier of the virtual character (character nickname or character design number) as the key, the corresponding character information can be found in Redis. When it is determined that a response needs to be made to the player's voice control commands based on the second virtual character, the voice information of the second virtual character can be determined from Redis, and the response information can be synthesized based on the voice of the second virtual character to reply to the player.

[0132] For example, if the player's voice control command is "Virtual character X, attack towards position D", then if the voice of virtual character X is pre-stored, the response message "Received, immediately attack towards position D" can be synthesized based on the voice of virtual character X, and played through the voice playback device of the terminal device in the voice of virtual character X; at the same time, the text response message "Virtual character X, attack towards position D" and virtual character X: "Received, immediately attack towards position D" is displayed in the graphical user interface.

[0133] In another possible implementation, if the voice information of the current second virtual character is not stored in Redis, the response information can be synthesized based on the character attributes of the second virtual character and the TTS speech synthesis module.

[0134] Specifically, if the second virtual character is a male virtual character, a male voice response message can be generated through the TTS speech synthesis module and played through the terminal device.

[0135] In another possible implementation, if the second virtual character specified in the player's voice control command is unable to perform the action control intention in the player's voice control command, or if the second virtual character specified by the player does not exist, the current situation can also be communicated to the player through response information.

[0136] Specifically, if the second virtual character is unable to execute the action control intention in the player's voice control command, the second virtual character can respond to the player's voice control command based on the voice tone of the second virtual character to inform the player that it cannot be completed at present and to propose a solution.

[0137] For example, if the player's voice control command is "Virtual character X, attack towards position D", and at this time, by judging the virtual character D's own health, it is determined that the virtual character D cannot complete the attack operation, then a response message can be generated: "Current status is insufficient to complete the attack on position D. Please wait a moment, and attack immediately after the status is restored", and played through the terminal device.

[0138] The method for determining the voice response information is the same as the method for determining the response information of the second virtual character that can execute the player's voice control commands, and will not be repeated here.

[0139] In another possible implementation, if there is no second virtual character for the player's voice control commands, a system prompt can be synthesized using a TTS voice synthesis module and played through a terminal device to prompt the player to check if the currently issued control commands are correct.

[0140] For example, if a player's voice control command is "Virtual character X, attack towards position D", but virtual character D does not exist in the virtual environment, the voice response could be the system voice "Virtual character D does not currently exist, please verify the control command". At the same time, the text response displayed in the graphical user interface could be highlighted (e.g., the text information is highlighted or bolded) to indicate to the player that the virtual character requested in the voice control command does not currently exist, preventing the player from issuing incorrect commands without realizing it, thus delaying the game's progress and further improving the efficiency of human-computer interaction.

[0141] In one possible implementation, if a player can control a second virtual character to perform virtual actions in a virtual environment using voice commands, then when the player has not issued a voice command, a voice interaction prompt can be proactively displayed after a preset active event is triggered to indicate that the player can control the second virtual character using voice commands.

[0142] Specifically, the control methods also include:

[0143] j1: Responds to the triggering of active events and displays voice interaction prompts.

[0144] In this embodiment of the disclosure, the same voice interaction prompts may also include both voice prompts and text prompts. By prompting players to make voice interaction prompts in different ways, the types of prompts can be enriched, the probability of players receiving prompts can be increased, and players can be prevented from missing prompts, which helps to improve the efficiency of human-computer interaction.

[0145] In one possible implementation, if no voice control command from the player for the second virtual character is received, it may be because the player has not turned on the voice acquisition device of the terminal device, or it may be that the player has turned on the voice acquisition device of the terminal device but has not yet issued a voice command. In this case, it is necessary to prompt the player to issue a voice control command through voice interaction prompts.

[0146] In one possible implementation, the active event includes at least one of the following:

[0147] The second virtual character receives a blocking action from another virtual character, the first virtual character's health is less than a preset health threshold, the second virtual character's health is less than a preset health threshold, the first virtual character performs an attack operation against another virtual character, the current game ends, the time without receiving voice control commands exceeds a preset time threshold, and the first virtual character enters a preset health state.

[0148] In one possible implementation, regarding virtual characters in a game, if the second virtual character performs an attack that requires charging, and this charging process is interrupted by a block by an enemy virtual character, the player needs to issue a voice control command to control the second virtual character to take defensive measures against the enemy. Similarly, if the first virtual character's health falls below a preset health threshold or enters a preset health state without the second virtual character noticing, the player also needs to use voice control commands to control the second virtual character to rescue the first virtual character or to notify the second virtual character of the first virtual character's current status. Furthermore, if the second virtual character's health falls below the preset health threshold, the player also needs to use voice control commands to notify other virtual characters of the second virtual character's current status. When the first virtual character is performing an attack (either a single attack or multiple consecutive attacks) against other virtual characters, and the player is currently controlling the first virtual character, if it's necessary to control the second virtual character to coordinate with the first virtual character's attack, the player also needs to use voice control commands to control the second virtual character.

[0149] In another possible implementation, for the game itself or the player, if the game has ended (the player's team has won or lost), the player needs to use voice control commands to stop the virtual character's virtual actions. If the player does not receive voice control commands within a preset time period, it is necessary to consider whether the player is not focused on the current control or whether the player is unsure whether the second virtual character can be controlled by voice commands. In this case, voice interaction prompts can be used to prompt the player to operate by voice commands.

[0150] The preset life threshold and preset time threshold can be set according to historical information and setting requirements. For example, the preset life threshold can be 50% of the total life threshold, and the preset time threshold can be set to 10 seconds / 30 seconds. The specific setting method is not specifically limited here.

[0151] In one possible implementation, when generating voice interaction prompts, in order to make the player understand the intention of the interaction control more clearly, it is necessary to synthesize the voice interaction prompts based on the specific active event type at present.

[0152] Specifically, the step "In response to the triggering of an active event, display voice interaction prompts" includes:

[0153] k1: Based on the event type of the active event, synthesize and display voice interaction prompts; or,

[0154] k2: Based on the event type to which the active event belongs, determine the target virtual role involved in the event type;

[0155] k3: Generate and display voice interaction prompts based on the pre-stored character attributes of the target virtual character.

[0156] In one possible implementation, the voice prompts need to accurately indicate to the player the specific event requiring voice control commands, so as to ensure that the player can accurately issue the corresponding voice control commands and respond promptly to the situation in the virtual environment.

[0157] In this embodiment of the disclosure, similarly, a configuration system can be simultaneously configured in addition to the voice processing system. The configuration system configures the basic information of different virtual characters in different virtual scenes in the game, including but not limited to: the attribute configuration of the virtual characters (e.g., the character's attack parameters, configured voice information, etc.). In order to ensure the convenience and efficiency of searching for virtual character information, the configured information can be stored in the storage system Redis.

[0158] Specifically, Redis is a key-value storage system. Using the identifier of the virtual character (character nickname or character design number) as the key, the corresponding character information can be found in Redis. When it is determined that voice interaction prompts need to be given to the player based on the second virtual character, the voice information of the second virtual character can be determined from Redis, and voice interaction prompts can be displayed based on the voice of the second virtual character and the type of active event.

[0159] For example, if the current health of the first virtual character is less than 50%, then, by combining the event type and the voice information of the first virtual character, a voice interaction prompt message "My health is decreasing, continue rescue, please send a second virtual character to rescue" can be generated and played in the voice of the first virtual character through the voice playback device of the terminal device; at the same time, the text response message "The health of the first virtual character is decreasing, continue rescue, please send a second virtual character to rescue" can be displayed in the graphical user interface.

[0160] In another possible implementation, if the corresponding voice information is not stored in Redis, voice interaction prompts can be synthesized based on the role attributes of the target virtual character involved in the event type, combined with the TTS voice synthesis module.

[0161] Specifically, if the target virtual character is a female virtual character, a female voice response message can be generated through a TTS speech synthesis module and played through the terminal device.

[0162] In one possible implementation, if the player has any questions about the current control method, the player can also trigger an intention-guided control method through voice control commands.

[0163] Specifically, the step "responding to voice control commands for the second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands" further includes:

[0164] l1: Based on voice control commands, control the second virtual character to perform virtual actions according to the combat intentions guided by the voice control commands.

[0165] In this embodiment of the disclosure, the method for determining the guiding combat intention can be to convert the collected voice control commands into text control information; and to determine the guiding combat intention based on the text control information, the context information corresponding to other voice control commands associated with the voice control commands, and the environmental information of the virtual environment.

[0166] In one possible implementation, after determining the text control information, the combat intention for the second virtual character is determined by combining the environmental information of the virtual environment, the character attributes of the second virtual character, and the context information of other voice control commands associated with the voice operation commands issued by the current player.

[0167] In order to more accurately determine the action control intention in the player's voice control commands, it is necessary to refer to the player's other voice control commands within a preset time period and combine them with contextual information to understand the player's intention to guide the battle.

[0168] Specifically, the method for determining the intention to guide combat is the same as the method for determining the intention to control actions, and will not be elaborated further here.

[0169] Furthermore, it is necessary to determine whether the player's voice control commands indicate a guiding combat intention. If such an intention exists, the second virtual character can be controlled to perform virtual actions based on that intention, and the process of the second virtual character performing virtual actions according to the guiding combat intention can be displayed in the graphical user interface.

[0170] Specifically, the step "based on voice control commands, controlling the second virtual character to execute virtual actions according to the combat intentions guided by the voice control commands" includes:

[0171] m1: Based on voice control commands, detect whether there is any intention to guide combat in the voice control commands.

[0172] m2: If the voice control command contains a guiding combat intention, control the second virtual character to perform virtual actions according to the guiding combat intention.

[0173] In this embodiment of the disclosure, the method for determining the intention to guide combat can be based on the processing of the NLU natural language processing module. Multiple keywords corresponding to the intention to guide combat are pre-stored in the NLU natural language processing module. If the text control information converted from the player's voice control command contains the pre-stored keywords, it is determined that the player currently has the intention to guide combat.

[0174] For example, keywords may include "guidance," "leading," "current behavior is incorrect," etc. If the player's voice control command is analyzed as "virtual character X's current combat skill is used at an incorrect time and needs to be corrected," it is determined that the player's voice control command contains a guiding combat intention. At this time, the combat logic of virtual character X can be controlled according to the player's subsequent voice control commands. For example, if the player's voice control command is "use skill A now," then the virtual character X will be controlled to use skill A to attack.

[0175] In another possible implementation, if there is no guiding combat intention in the player's current voice control commands, then guiding combat information can be displayed to enter the tutorial process.

[0176] Specifically, the control methods also include:

[0177] n1: If the voice control commands do not contain any guidance on combat intent, display guidance information on combat.

[0178] In one possible implementation, if it is determined that there is no intention to guide combat in the current voice control commands, then guidance combat information can be displayed through the terminal settings, and the player can be communicated and interacted with through the guidance combat information to enter the guided tutorial mode.

[0179] The same combat guidance information includes both voice-guided combat information and text-guided combat information.

[0180] Specifically, the guided response information is displayed through the following steps:

[0181] o1: Based on the selected virtual guide role, synthesize and display the guide response information; or,

[0182] o2: Based on the pre-stored role attributes of the virtual guide character, generate and display the guide response information.

[0183] In this embodiment of the disclosure, the guiding virtual character is a second virtual character and is also controlled by the player through voice control commands. The guiding virtual character can be randomly selected from the second virtual characters or determined based on the player's historical interaction information. For example, the guiding virtual character is the character that the player has controlled the most times.

[0184] In this embodiment of the disclosure, similarly, a configuration system can be simultaneously configured in addition to the voice processing system. The configuration system configures the basic information of different virtual characters in different virtual scenes in the game, including but not limited to: the attribute configuration of the virtual characters (e.g., the character's attack parameters, configured voice information, etc.). In order to ensure the convenience and efficiency of searching for virtual character information, the configured information can be stored in the storage system Redis.

[0185] Specifically, Redis is a key-value storage system. Using the virtual character's identifier (character nickname or character design number) as the key, the corresponding character information can be found in Redis. After determining the virtual character to guide, the voice information of the virtual character to guide can be determined from Redis, and the guidance response information can be displayed based on the voice of the virtual character to guide.

[0186] Similarly, the guidance response information can be voice guidance information played through the terminal device, or it can be text guidance information displayed in the form of text within a preset area of ​​the terminal's graphical user interface.

[0187] In another possible implementation, if the voice information of the virtual guide is not stored in Redis, the response information can be synthesized based on the role attributes of the virtual guide and the TTS speech synthesis module.

[0188] Specifically, if the virtual character being guided is female, a female voice can be generated using a TTS (Text-to-Speech) speech synthesis module and played through the terminal device.

[0189] In another possible implementation, if no voice control command is received for the second virtual character, the second virtual character can perform virtual actions in the virtual scene according to the automatic control logic.

[0190] S104. In the absence of receiving a voice control command for the second virtual character, control the second virtual character to automatically perform virtual actions.

[0191] In this embodiment, the second virtual character can be controlled through automatic control logic, which controls the second virtual character to automatically perform virtual actions. This control can be achieved through artificial intelligence (AI) or by using a behavior tree and a preset configuration table. By analyzing the player's historical control logic and the historical control methods of different scenes in the virtual environment, and combining the relationships between different behaviors (continuity relationships, restraint relationships, etc.), different control logics are preset, and AI or similar technologies are used to execute these preset control logics.

[0192] In one possible implementation, for example, the second virtual character is automatically controlled to perform movement actions in the virtual environment through automatic control logic, and the second virtual character can be directly controlled to perform movement actions in the virtual environment according to the selected route.

[0193] The selected route can be chosen based on historical information of the route selected by the player at the same location during the player's historical operations. For example, the route with the highest historical selection frequency can be selected as the control route of the self-control logic. Alternatively, it can be planned based on the historical information of the route selected by the player at the same location during the player's historical operations, combined with the actual situation in the current virtual environment (whether there are enemy virtual characters on the same route, whether there are pick-up items on the same route, etc.), so as to control the movement to move on a relatively safe route.

[0194] For example, the way to combine the historical information of the route selected at the same location during the player's historical operation with the actual situation in the current virtual environment can be as follows: According to the player's historical operation, the frequently used action routes include route 1, route 2 and route 3, and the frequency of use is route 2 > route 1 > route 3. However, according to the current virtual environment, there are a large number of enemy virtual characters on the inevitable path of route 2. In this case, after comprehensive consideration, the movement action will be controlled by automatic control logic to perform the movement action on route 1.

[0195] In one possible implementation, in addition to the second virtual character, other virtual characters may be included in the same faction as the first virtual character. These virtual characters can also be controlled by the player's voice commands.

[0196] Specifically, the control methods also include:

[0197] p1: Provide a third virtual character in a virtual environment.

[0198] p2: Responds to voice control commands for the third virtual character and controls the third virtual character to perform corresponding virtual actions according to the voice control commands.

[0199] p3: Control the third virtual character to automatically perform virtual actions when no voice control command is received for the third virtual character.

[0200] In one possible implementation, the third virtual character and the first virtual character are virtual characters belonging to the same faction. The third virtual character can cooperate with the first virtual character and the second virtual character to complete virtual tasks in the virtual environment.

[0201] The third virtual character can be controlled by the player through voice commands or by automatic control logic. The specific control method for the third virtual character is the same as that for the second virtual character, and will not be repeated here.

[0202] Optionally, the first virtual character is configured to respond to non-voice control commands but not to respond to voice control commands; the second and / or third virtual characters are configured to respond to voice control commands but not to respond to non-voice control commands. For example, players can control the first virtual character using non-voice control methods such as touch, keyboard, mouse, or gamepad, but cannot control it using voice control. Players cannot control the second and / or third virtual characters using non-voice control methods such as touch, keyboard, mouse, or gamepad, but can control them using voice control.

[0203] Optionally, the first virtual character is configured to respond to both non-voice control commands and voice control commands; the second and / or third virtual characters are configured to respond to voice control commands but not to respond to non-voice control commands. For example, players can control the first virtual character using non-voice control methods such as touch, keyboard, mouse, or gamepad, or they can control it using voice control. Players cannot control the second and / or third virtual characters using non-voice control methods such as touch, keyboard, mouse, or gamepad, but they can control them using voice control.

[0204] Optionally, both the first and second virtual characters can be controlled through the same terminal device. For example, the terminal device used by the player can provide multiple control methods, such as touch control, voice control, keyboard control, mouse control, and gamepad control. The terminal device can integrate touch input components (e.g., touchscreen, touchpad), voice input components (e.g., microphone), keyboard, mouse, and gamepad; it can also be externally connected to touch input components, voice input components, keyboard, mouse, and gamepad.

[0205] Similarly, the first and third virtual characters can be controlled through the same terminal device.

[0206] In one possible implementation, players can control a second and a third virtual character simultaneously via voice commands, or they can control the second and third virtual characters individually. To ensure the targeted and accurate control of the virtual characters, players need to specify the target of the current voice operation when issuing the voice command.

[0207] Specifically, players can specify the character identifier of the virtual character they are controlling in voice control commands, such as the virtual character's nickname and number.

[0208] In another possible implementation, the execution entity of this embodiment can also be an interaction between a terminal and a server. Through information exchange between the server and the terminal, the server executes the judgment process of the player's control commands and voice control commands, and the virtual character control method provided by this embodiment is executed through display on the terminal. Taking the player controlling the second virtual character to perform virtual actions through voice control commands as an example, the specific execution process is as follows:

[0209] Please see Figure 2 , Figure 2 This is a flowchart illustrating the process of a voice-controlled virtual character performing virtual actions according to an embodiment of this disclosure. The flowchart illustrates the process of a server controlling a virtual character to perform virtual actions. Figure 2 As shown, after receiving voice input from a player via a terminal device, the server collects the audio stream of the player's voice and performs speech recognition based on the audio stream. Simultaneously, it segments the text information from the speech recognition results into sentences and inputs the segmented text into a pre-trained large language model. The large language model, combined with the virtual character's behavior, analyzes the player's voice control commands and controls the second virtual character to perform corresponding virtual actions, outputting the behavioral performance (the corresponding behavioral performance is displayed through the terminal device's graphical user interface). Simultaneously, the large language model, based on the analyzed text information, derives text response information for the player's voice control commands. Then, based on the text response information and the virtual character's vocal timbre information, it synthesizes a response message, which is played through the terminal device's voice playback device.

[0210] Specifically, please refer to Figure 3 , Figure 3 This is a schematic diagram of the processing flow for voice-controlled virtual characters to perform virtual behaviors, as provided in the embodiments of this disclosure. Figure 3As shown, the player's voice information is collected by the voice acquisition device of the terminal device (client) and transmitted to the server backend at a preset frequency. After receiving the voice data sent by the terminal device, the server processes the voice data and reports it to the ASR module for processing. The ASR module obtains the voice text corresponding to the voice data. At the same time, it obtains the corresponding context information, virtual environment information, and virtual character attributes from the voice data. The context information, virtual environment information, and virtual character attributes are then submitted to the NLU module for processing. The NLU module's processing yields the corresponding decision information. Based on the determined decision, the player selects the response content. The analysis determines the player's control target and whether a decision target exists. If no decision target exists, a corresponding prompt is returned and displayed on the terminal device, indicating that the current control command cannot be executed and requesting confirmation. If a decision target exists, a corresponding response is generated based on the target's voice information and displayed on the terminal device. The acquisition of the target's voice information can be achieved through collaborative processing by the configuration system. This involves importing configured response rules, character voice information, and other relevant data. The configuration system's tasks are divided into character call configuration, active event configuration, and intent response information. Simultaneously, the cache is cleared at a preset frequency, and the corresponding voice information is stored in the storage system. The storage system outputs the corresponding character voice and decision information to participate in the synthesis of the response speech. The original speech information, textualized sentences, and parsed action instructions generated during this process are also stored. If the virtual character's voice information is not present in the cache, the TTS module is called to synthesize the speech, which is then played through the terminal device. The corresponding text response information is displayed in the terminal device's graphical user interface.

[0211] Specifically, please refer to Figure 4 , Figure 4 This is a schematic diagram of the triggering process of an active event provided in an embodiment of this disclosure, such as... Figure 4As shown, by analyzing the character's behavior and the player's behavior on the terminal device, the triggering active event is determined. After the active event is determined, the terminal device establishes a communication connection with the server and sends the virtual environment data and the currently occurring active event information (type and number of active events) to the server. The server determines the response configuration based on the current event type and generates voice interaction prompts based on the obtained target voice information, which are then played and / or displayed as text information on the terminal device. Similarly, the acquisition of the target voice information can be processed collaboratively by the configuration system, importing the configured response rules, character voice information, etc., and dividing the tasks configured by the configuration system into character call configuration, active event configuration, and intent response information. At the same time, the cache is cleared according to a preset frequency, and the corresponding voice information is stored in the storage system. The storage system outputs the corresponding character voice and decision information to participate in the synthesis of the response voice, and stores the original voice information, textualized sentences, and parsed action instructions generated in this process. If the virtual character's voice information does not exist in the cache, the TTS module needs to be called to synthesize the voice, which is then played through the terminal device, and the corresponding text response information is displayed in the graphical user interface of the terminal device.

[0212] Specifically, please refer to Figure 5 , Figure 5 This is a schematic diagram of the processing flow for guiding intent provided in the embodiments of this disclosure, such as... Figure 5As shown, the player's voice information is collected by the voice acquisition device of the terminal device (client) and transmitted to the server backend at a preset frequency. After receiving the voice data sent by the terminal device, the server processes the voice data and reports it to the ASR module for further processing. The ASR module obtains the corresponding voice text, and simultaneously acquires the corresponding context information, virtual environment information, and virtual character attributes from the voice data. The context information, virtual environment information, and virtual character attributes are then submitted to the NLU module for processing. Combined with the processing of the NLU module, the corresponding decision information is obtained. The system determines whether there is a guiding combat intention in the currently collected voice information. If there is a guiding combat intention, the system commands the corresponding combat logic and displays the specific combat process through the terminal device. If there is no guiding combat intention, the system enters the guidance mode and randomly selects a target virtual character. The system retrieves the voice information of the target virtual character to generate guiding combat information, which is then played via voice and / or displayed as text on the terminal device. Similarly, the acquisition of the target virtual character's voice information can be processed collaboratively by the configuration system, importing configured response rules, character voice information, etc., and dividing the tasks configured by the configuration system into character call configuration, active event configuration, and intent response information. Simultaneously, the cache is cleared at a preset frequency, and the corresponding voice information is stored in the storage system. The storage system outputs the corresponding character voice and decision information to participate in the synthesis of response voice, while also storing the original voice information, textualized sentences, and parsed action commands generated during this process. If the virtual character's voice information is not present in the cache, the TTS module is called to synthesize voice, which is then played via the terminal device, and the corresponding text response information is displayed in the terminal device's graphical user interface.

[0213] In another possible implementation, the display scheme of the graphical user interface of the terminal device is described; please refer to [link to relevant documentation]. Figure 6 , Figure 6 One of the schematic diagrams of the graphical user interface provided in the embodiments of this disclosure, such as Figure 6 As shown, the graphical user interface 600 includes a first virtual character 610 and a second virtual character 620. Players can control the first virtual character 610 to move in the virtual environment by touching the movement control controls 631 in the movement control area 630 displayed in the graphical user interface 600; at the same time, players can control the first virtual character 610 to perform attack actions in the virtual environment by using the attack controls 641 in the attack control area 640; and at the same time, when no voice control command is received from the player, the second virtual character 620 automatically performs virtual actions (e.g., movement actions) in the virtual environment.

[0214] For further details, please refer to Figure 7, Figure 7 This is a second schematic diagram of the graphical user interface provided in the embodiments of this disclosure, as shown below. Figure 7 As shown, if the player's voice control command "Xiaobai, go to the forest to find supplies" is received, the second virtual character 620 is displayed in the graphical user interface 600, showing an animation of the second virtual character 620 moving towards the forest 650 and searching for supplies. Furthermore, the voice response message "Okay, I'll go find them right away" is played through the terminal device; at the same time, the text response message is displayed in the text response area 660 of the graphical user interface 600.

[0215] For further details, please refer to Figure 8 , Figure 8 This is a third schematic diagram of the graphical user interface provided in the embodiments of this disclosure, as shown below. Figure 8 As shown, if the current health value of the first virtual character 610 is lower than the preset threshold, the terminal device plays the voice of the second virtual character, "Xiao Hong's health value is low, please provide treatment." The voice interaction prompt information is displayed in the text response area 660 of the graphical user interface 600, guiding the player to use voice interaction to control the second virtual character to perform treatment.

[0216] The virtual character control method provided in this disclosure provides a first virtual character and a second virtual character in a virtual environment; responding to control commands for the first virtual character, the first virtual character is controlled to perform corresponding virtual actions; responding to voice control commands for the second virtual character, the second virtual character is controlled to perform corresponding virtual actions according to the voice control commands; and when no voice control commands are received for the second virtual character, the second virtual character is controlled to automatically perform virtual actions. In this way, players can control virtual characters with control commands while simultaneously controlling other virtual characters to perform virtual actions with voice control commands, enriching the player's control methods. Furthermore, for virtual characters that can be controlled with voice commands, virtual actions will be automatically performed even when no voice control commands are received from the player, reducing the delay of voice control command operations. This enriches the player's control methods while ensuring the timeliness of operations, helping to improve human-computer interaction efficiency.

[0217] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of a control device for a virtual character provided in an embodiment of this disclosure. Figure 9 As shown, the control device 900 includes:

[0218] Virtual character providing module 910 is used to provide a first virtual character and a second virtual character in a virtual environment;

[0219] The first virtual character control module 920 is used to respond to control commands for the first virtual character and control the first virtual character to perform corresponding virtual actions.

[0220] The voice control module 930 is used to respond to voice control commands for the second virtual character and control the second virtual character to perform corresponding virtual actions according to the voice control commands.

[0221] The non-voice control module 940 is used to control the second virtual character to automatically perform virtual actions when no voice control command for the second virtual character is received.

[0222] In one possible implementation, the control commands for the first virtual character are non-voice control commands.

[0223] In one possible implementation, the first virtual character and the second virtual character are virtual characters belonging to the same faction.

[0224] In one possible implementation, control commands for a first virtual character and voice control commands for a second virtual character are received through the same terminal device.

[0225] In one possible implementation, the control device 900 further includes a virtual character providing control module (not shown in the figure), which is used for:

[0226] Provide a third virtual role in a virtual environment;

[0227] Respond to voice control commands for a third virtual character, and control the third virtual character to perform corresponding virtual actions according to the voice control commands;

[0228] Without receiving voice control commands for the third virtual character, control the third virtual character to automatically perform virtual actions.

[0229] In one possible implementation, when the voice control module 930 responds to a voice control command for the second virtual character and controls the second virtual character to perform corresponding virtual actions according to the voice control command, the voice control module 930 is used to:

[0230] Based on voice control commands and the character attributes of the second virtual character, the automatic control logic controls the second virtual character to perform virtual actions in the virtual environment.

[0231] In one possible implementation, when the voice control module 930 responds to a voice control command for the second virtual character and controls the second virtual character to perform corresponding virtual actions according to the voice control command, the voice control module 930 is used to:

[0232] Based on voice control commands and environmental information of the virtual environment, the second virtual character is controlled to perform virtual actions in the virtual environment through automatic control logic.

[0233] In one possible implementation, the control device 900 further includes a response information display module (not shown in the figure), which is used for:

[0234] Display the second virtual character's response to voice control commands;

[0235] The response information includes at least one of the following:

[0236] Voice response information and text response information.

[0237] In one possible implementation, the control device 900 further includes a voice interaction prompt module (not shown in the figure), which is used for:

[0238] In response to proactive events, display voice interaction prompts.

[0239] In one possible implementation, the active event includes at least one of the following:

[0240] The second virtual character receives a blocking action from another virtual character, the first virtual character's health is less than a preset health threshold, the second virtual character's health is less than a preset health threshold, the first virtual character performs an attack operation against another virtual character, the current game ends, the time without receiving voice control commands exceeds a preset time threshold, and the first virtual character enters a preset health state.

[0241] In one possible implementation, when the voice control module 930 responds to a voice control command for the second virtual character and controls the second virtual character to perform corresponding virtual actions according to the voice control command, the voice control module 930 is used to:

[0242] Based on voice control commands, control the second virtual character to perform virtual actions according to the combat intentions guided by the voice control commands.

[0243] In one possible implementation, when the voice control module 930 is used to control a second virtual character to perform virtual actions according to the combat intentions guided by the voice control commands, the voice control module 930 is used to:

[0244] Based on voice control commands, detect whether there is any intention to guide combat in the voice control commands;

[0245] If the voice control command contains a guiding combat intention, control the second virtual character to perform virtual actions according to the guiding combat intention.

[0246] In one possible implementation, the control device 900 further includes a guided combat information display module (not shown in the figure), which is used for:

[0247] If the voice control commands do not indicate any intention to guide the battle, then display the battle guidance information.

[0248] In one possible implementation, the control device 900 further includes a region providing module (not shown in the figure), which is used for:

[0249] The graphical user interface provides attack control area and movement control area.

[0250] In one possible implementation, when the first virtual character control module 920 responds to a control command for the first virtual character and controls the first virtual character to perform a corresponding virtual action, the first virtual character control module 920 is used to:

[0251] Responding to movement control commands targeting the attack control area, control the first virtual character to perform movement actions in the virtual environment;

[0252] In response to attack control commands targeting the attack control area, control the first virtual character to perform attack actions in the virtual environment.

[0253] In one possible implementation, when the voice control module 930 responds to a voice control command for the second virtual character and controls the second virtual character to perform corresponding virtual actions according to the voice control command, the voice control module 930 is used to:

[0254] Based on voice control commands, determine the action control intent corresponding to the voice control commands;

[0255] Based on the action control intent, determine whether the second virtual character can execute the action control intent;

[0256] If the second virtual character can execute the action control intention, the automatic control logic controls the second virtual character to perform virtual actions corresponding to the voice control command in the virtual environment.

[0257] In one possible implementation, when the voice control module 930 is used to determine the action control intent corresponding to the voice control command based on the voice control command, the voice control module 930 is used to:

[0258] The collected voice control commands are converted into text control information;

[0259] The action control intent is determined based on text control information, context information corresponding to other voice control commands associated with the voice control commands, and environmental information of the virtual environment.

[0260] In one possible implementation, when displaying the response information display module for the second virtual character's response to voice control commands, the response information display module is used to:

[0261] Based on the pre-stored role attributes of the second virtual character, generate and display the corresponding response information for the second virtual character; or,

[0262] Based on the character attributes of the second virtual character, synthesize and display the corresponding response information for the second virtual character.

[0263] In one possible implementation, when the voice interaction prompt module displays voice interaction prompt information in response to the triggering of an active event, the voice interaction prompt module is used to:

[0264] Based on the event type of the active event, synthesize and display voice interaction prompts; or,

[0265] Based on the event type to which the active event belongs, identify the target virtual character involved in the event type;

[0266] Based on the pre-stored character attributes of the target virtual character, generate and display voice interaction prompts.

[0267] In one possible implementation, the guidance combat information display module is used to display guidance response information through the following steps:

[0268] Based on the selected virtual guide role, synthesize and display the guide response information; or,

[0269] Based on the pre-stored role attributes of the virtual guide character, generate and display the guide response information.

[0270] The virtual character control device provided in this embodiment offers a first virtual character and a second virtual character in a virtual environment. It responds to control commands for the first virtual character, controlling the first virtual character to perform corresponding virtual actions; it responds to voice control commands for the second virtual character, controlling the second virtual character to perform corresponding virtual actions according to the voice control commands; and it controls the second virtual character to automatically perform virtual actions when no voice control commands are received. In this way, players can control virtual characters with control commands while simultaneously controlling other virtual characters to perform virtual actions with voice control commands, enriching the player's control methods. Furthermore, for virtual characters that can be controlled with voice commands, they will automatically perform virtual actions even when no voice control commands are received from the player, reducing the delay of voice control command operations. This enriches the player's control methods while ensuring the timeliness of operations, helping to improve human-computer interaction efficiency.

[0271] Please see Figure 10 , Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Figure 10 As shown, the electronic device 1000 includes a processor 1010, a memory 1020, and a bus 1030.

[0272] The memory 1020 stores machine-readable instructions executable by the processor 1010. When the electronic device 1000 is running, the processor 1010 communicates with the memory 1020 via the bus 1030, causing the processor 1010 to execute the following instructions during operation:

[0273] Provide a first virtual character and a second virtual character in a virtual environment;

[0274] Responding to control commands for the first virtual character, control the first virtual character to perform corresponding virtual actions;

[0275] Responding to voice control commands for the second virtual character, and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands;

[0276] Without receiving voice control commands for the second virtual character, control the second virtual character to automatically perform virtual actions.

[0277] In one possible implementation, the control commands for the first virtual character are non-voice control commands.

[0278] In one possible implementation, the first virtual character and the second virtual character are virtual characters belonging to the same faction.

[0279] In one possible implementation, control commands for a first virtual character and voice control commands for a second virtual character are received through the same terminal device.

[0280] In one possible implementation, the instructions executed by the processor 1010 further include:

[0281] Provide a third virtual role in a virtual environment;

[0282] Respond to voice control commands for a third virtual character, and control the third virtual character to perform corresponding virtual actions according to the voice control commands;

[0283] Without receiving voice control commands for the third virtual character, control the third virtual character to automatically perform virtual actions.

[0284] In one possible implementation, the instructions executed by the processor 1010, in response to a voice control command for the second virtual character, control the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0285] Based on voice control commands and the character attributes of the second virtual character, the automatic control logic controls the second virtual character to perform virtual actions in the virtual environment.

[0286] In one possible implementation, the instructions executed by the processor 1010, in response to a voice control command for the second virtual character, control the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0287] Based on voice control commands and environmental information of the virtual environment, the second virtual character is controlled to perform virtual actions in the virtual environment through automatic control logic.

[0288] In one possible implementation, the instructions executed by the processor 1010 further include:

[0289] Display the second virtual character's response to voice control commands;

[0290] The response information includes at least one of the following:

[0291] Voice response information and text response information.

[0292] In one possible implementation, the instructions executed by the processor 1010 further include:

[0293] In response to proactive events, display voice interaction prompts.

[0294] In one possible implementation, the active event includes at least one of the following:

[0295] The second virtual character receives a blocking action from another virtual character, the first virtual character's health is less than a preset health threshold, the second virtual character's health is less than a preset health threshold, the first virtual character performs an attack operation against another virtual character, the current game ends, the time without receiving voice control commands exceeds a preset time threshold, and the first virtual character enters a preset health state.

[0296] In one possible implementation, the instructions executed by the processor 1010, in response to a voice control command for the second virtual character, and controlling the second virtual character to perform corresponding virtual actions according to the voice control command, further include:

[0297] Based on voice control commands, control the second virtual character to perform virtual actions according to the combat intentions guided by the voice control commands.

[0298] In one possible implementation, the instructions executed by the processor 1010 include controlling the second virtual character to perform virtual actions according to the combat intentions guided by the voice control instructions, based on voice control commands, including:

[0299] Based on voice control commands, detect whether there is any intention to guide combat in the voice control commands;

[0300] If the voice control command contains a guiding combat intention, control the second virtual character to perform virtual actions according to the guiding combat intention.

[0301] In one possible implementation, the instructions executed by the processor 1010 further include:

[0302] If the voice control commands do not indicate any intention to guide the battle, then display the battle guidance information.

[0303] In one possible implementation, the instructions executed by the processor 1010 further include:

[0304] The graphical user interface provides attack control area and movement control area.

[0305] In one possible implementation, the instructions executed by the processor 1010, in response to a control instruction for the first virtual character, control the first virtual character to perform a corresponding virtual action, including:

[0306] Responding to movement control commands targeting the attack control area, control the first virtual character to perform movement actions in the virtual environment;

[0307] In response to attack control commands targeting the attack control area, control the first virtual character to perform attack actions in the virtual environment.

[0308] In one possible implementation, the instructions executed by the processor 1010, in response to a voice control command for the second virtual character, control the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0309] Based on voice control commands, determine the action control intent corresponding to the voice control commands;

[0310] Based on the action control intent, determine whether the second virtual character can execute the action control intent;

[0311] If the second virtual character can execute the action control intention, the automatic control logic controls the second virtual character to perform virtual actions corresponding to the voice control command in the virtual environment.

[0312] In one possible implementation, the instructions executed by the processor 1010 include determining the action control intent corresponding to the voice control command based on the voice control command, including:

[0313] The collected voice control commands are converted into text control information;

[0314] The action control intent is determined based on text control information, context information corresponding to other voice control commands associated with the voice control commands, and environmental information of the virtual environment.

[0315] In one possible implementation, the instructions executed by the processor 1010 display the response information of the second virtual character to the voice control command, including:

[0316] Based on the pre-stored role attributes of the second virtual character, generate and display the corresponding response information for the second virtual character; or,

[0317] Based on the character attributes of the second virtual character, synthesize and display the corresponding response information for the second virtual character.

[0318] In one possible implementation, the instructions executed by the processor 1010, in response to the triggering of an active event, display voice interaction prompt information, including:

[0319] Based on the event type of the active event, synthesize and display voice interaction prompts; or,

[0320] Based on the event type to which the active event belongs, identify the target virtual character involved in the event type;

[0321] Based on the pre-stored character attributes of the target virtual character, generate and display voice interaction prompts.

[0322] In one possible implementation, the instructions executed by the processor 1010 display the boot response information through the following steps:

[0323] Based on the selected virtual guide role, synthesize and display the guide response information; or,

[0324] Based on the pre-stored role attributes of the virtual guide character, generate and display the guide response information.

[0325] Through the above methods, players can control virtual characters with commands and simultaneously control other virtual characters to perform virtual actions via voice commands, enriching the player's control methods. Furthermore, virtual characters controllable by voice commands will automatically execute virtual actions even without receiving voice commands from the player, reducing latency and ensuring timely responses while enhancing player control options, thus improving human-computer interaction efficiency. Additionally, the system will respond to and interact with players after they issue voice commands, increasing player immersion and further improving human-computer interaction efficiency.

[0326] This disclosure also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the following instructions:

[0327] Provide a first virtual character and a second virtual character in a virtual environment;

[0328] Responding to control commands for the first virtual character, control the first virtual character to perform corresponding virtual actions;

[0329] Responding to voice control commands for the second virtual character, and controlling the second virtual character to perform corresponding virtual actions according to the voice control commands;

[0330] Without receiving voice control commands for the second virtual character, control the second virtual character to automatically perform virtual actions.

[0331] In one possible implementation, the control commands for the first virtual character are non-voice control commands.

[0332] In one possible implementation, the first virtual character and the second virtual character are virtual characters belonging to the same faction.

[0333] In one possible implementation, control commands for a first virtual character and voice control commands for a second virtual character are received through the same terminal device.

[0334] In one possible implementation, the instructions executed by the computer-readable storage medium further include:

[0335] Provide a third virtual role in a virtual environment;

[0336] Respond to voice control commands for a third virtual character, and control the third virtual character to perform corresponding virtual actions according to the voice control commands;

[0337] Without receiving voice control commands for the third virtual character, control the third virtual character to automatically perform virtual actions.

[0338] In one possible implementation, the instructions executable by the computer-readable storage medium include, in response to a voice control command for a second virtual character, controlling the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0339] Based on voice control commands and the character attributes of the second virtual character, the automatic control logic controls the second virtual character to perform virtual actions in the virtual environment.

[0340] In one possible implementation, the instructions executable by the computer-readable storage medium include, in response to a voice control command for a second virtual character, controlling the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0341] Based on voice control commands and environmental information of the virtual environment, the automatic control logic controls the second virtual character to perform virtual actions corresponding to the voice control commands in the virtual environment.

[0342] In one possible implementation, the instructions executed by the computer-readable storage medium further include:

[0343] Display the second virtual character's response to voice control commands;

[0344] The response information includes at least one of the following:

[0345] Voice response information and text response information.

[0346] In one possible implementation, the instructions executed by the computer-readable storage medium further include:

[0347] In response to proactive events, display voice interaction prompts.

[0348] In one possible implementation, the active event includes at least one of the following:

[0349] The second virtual character receives a blocking action from another virtual character, the first virtual character's health is less than a preset health threshold, the second virtual character's health is less than a preset health threshold, the first virtual character performs an attack operation against another virtual character, the current game ends, the time without receiving voice control commands exceeds a preset time threshold, and the first virtual character enters a preset health state.

[0350] In one possible implementation, the instructions executable by the computer-readable storage medium, in response to a voice control command for a second virtual character and controlling the second virtual character to perform corresponding virtual actions according to the voice control command, further include:

[0351] Based on voice control commands, control the second virtual character to perform virtual actions according to the combat intentions guided by the voice control commands.

[0352] In one possible implementation, the instructions executed by the computer-readable storage medium, based on voice control instructions, control a second virtual character to perform virtual actions according to the combat intentions guided by the voice control instructions, including:

[0353] Based on voice control commands, detect whether there is any intention to guide combat in the voice control commands;

[0354] If the voice control command contains a guiding combat intention, control the second virtual character to perform virtual actions according to the guiding combat intention.

[0355] In one possible implementation, the instructions executed by the computer-readable storage medium further include:

[0356] If the voice control commands do not indicate any intention to guide the battle, then display the battle guidance information.

[0357] In one possible implementation, the instructions executed by the computer-readable storage medium further include:

[0358] The graphical user interface provides attack control area and movement control area.

[0359] In one possible implementation, the instructions executable by the computer-readable storage medium, in response to a control instruction for a first virtual character, control the first virtual character to perform a corresponding virtual action, including:

[0360] Responding to movement control commands targeting the attack control area, control the first virtual character to perform movement actions in the virtual environment;

[0361] In response to attack control commands targeting the attack control area, control the first virtual character to perform attack actions in the virtual environment.

[0362] In one possible implementation, the instructions executable by the computer-readable storage medium include, in response to a voice control command for a second virtual character, controlling the second virtual character to perform corresponding virtual actions according to the voice control command, including:

[0363] Based on voice control commands, determine the action control intent corresponding to the voice control commands;

[0364] Based on the action control intent, determine whether the second virtual character can execute the action control intent;

[0365] If the second virtual character can execute the action control intention, the automatic control logic controls the second virtual character to perform virtual actions corresponding to the voice control command in the virtual environment.

[0366] In one possible implementation, the instructions executed by the computer-readable storage medium, based on the voice control instructions, determine the action control intent corresponding to the voice control instructions, including:

[0367] The collected voice control commands are converted into text control information;

[0368] The action control intent is determined based on text control information, context information corresponding to other voice control commands associated with the voice control commands, and environmental information of the virtual environment.

[0369] In one possible implementation, the instructions executed by the computer-readable storage medium display response information of the second virtual character in response to voice control commands, including:

[0370] Based on the pre-stored role attributes of the second virtual character, generate and display the corresponding response information for the second virtual character; or,

[0371] Based on the character attributes of the second virtual character, synthesize and display the corresponding response information for the second virtual character.

[0372] In one possible implementation, the instructions executed by the computer-readable storage medium, in response to the triggering of an active event, display voice interaction prompts, including:

[0373] Based on the event type of the active event, synthesize and display voice interaction prompts; or,

[0374] Based on the event type to which the active event belongs, identify the target virtual character involved in the event type;

[0375] Based on the pre-stored character attributes of the target virtual character, generate and display voice interaction prompts.

[0376] In one possible implementation, the instructions executed by the computer-readable storage medium display boot response information through the following steps:

[0377] Based on the selected virtual guide role, synthesize and display the guide response information; or,

[0378] Based on the pre-stored role attributes of the virtual guide character, generate and display the guide response information.

[0379] Through the above methods, players can control virtual characters with commands and simultaneously control other virtual characters to perform virtual actions via voice commands, enriching the player's control methods. Furthermore, virtual characters controllable by voice commands will automatically execute virtual actions even without receiving voice commands from the player, reducing latency and ensuring timely responses while enhancing player control options, thus improving human-computer interaction efficiency. Additionally, the system will respond to and interact with players after they issue voice commands, increasing player immersion and further improving human-computer interaction efficiency.

[0380] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0381] In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the coupling or direct coupling or communication connection shown or discussed may be through some communication interface; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0382] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0383] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0384] If the functionality is implemented as a software functional unit and sold or used as an independent product, it can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0385] Finally, it should be noted that the above embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. A control method of a virtual character, characterized by, The control method comprises: providing a first virtual character and a second virtual character in a virtual environment; controlling the first virtual character to perform a corresponding virtual action in response to a control instruction for the first virtual character; in response to a voice control instruction for the second virtual character, determining whether the second virtual character has a condition for performing a virtual action corresponding to the voice control instruction according to the voice control instruction, a character attribute of the second virtual character, and environment information of the virtual environment, and if so, controlling the second virtual character to perform the corresponding virtual action through automatic control logic, and if not, controlling the second virtual character not to perform or partially perform the corresponding virtual action through automatic control logic; wherein the character attribute of the second virtual character comprises at least one of the following: a life value of the second virtual character, an action setting mode of the second virtual character, and a personality attribute of the second virtual character; the personality attribute of the second virtual character is generated or configured by a game system to represent the acceptance degree of the second virtual character to the voice control instruction; the environment information of the virtual environment comprises at least one of the following: information of the virtual environment itself, a character attribute of a teammate virtual character in the same camp as the first virtual character and the second virtual character, and a character attribute of an enemy virtual character in an enemy camp as the first virtual character and the second virtual character; controlling the second virtual character to automatically perform a virtual action in the case where no voice control instruction for the second virtual character is received; the control method further comprises: in response to triggering of a proactive event, displaying voice interaction prompt information to prompt a player to control the second virtual character through a voice control instruction; the proactive event comprises at least one of the following: the second virtual character receiving a block action of another virtual character, the life value of the first virtual character being less than a preset life threshold, the life value of the second virtual character being less than a preset life threshold, the first virtual character performing an attack operation on the other virtual character, the current game session ending, the time of not receiving the voice control instruction being greater than a preset time threshold, and the first virtual character entering a preset life state.

2. The control method according to claim 1, characterized by, The control instruction for the first virtual character is a non-voice control instruction.

3. The control method according to claim 1, characterized by, The first virtual character and the second virtual character are virtual characters in the same camp.

4. The control method according to claim 1, characterized by, The control instruction for the first virtual character and the voice control instruction for the second virtual character are received through the same terminal device.

5. The control method according to claim 1, characterized by, the control method further comprises: providing a third virtual character in a virtual environment; controlling the third virtual character to perform a corresponding virtual action according to a voice control instruction for the third virtual character in response to the voice control instruction for the third virtual character; In a case where no voice control instruction for the third virtual role is received, the third virtual role is controlled to automatically perform a virtual action.

6. The control method according to claim 1, characterized by The response to the voice control instruction for the second virtual role comprises: According to the voice control instruction and the role attribute of the second virtual role, the second virtual role is controlled to perform a virtual action in the virtual environment through automatic control logic.

7. The control method according to claim 1, characterized by, The response to the voice control instruction for the second virtual role comprises: According to the voice control instruction and the environment information of the virtual environment, the second virtual role is controlled to perform a virtual action in the virtual environment through automatic control logic.

8. The control method according to claim 6, characterized by, After the response to the voice control instruction for the second virtual role, the second virtual role is controlled to perform a corresponding virtual action according to the voice control instruction, the control method further comprises: The second virtual role displays response information to the voice control instruction; The response information comprises at least one of the following: Voice response information, text response information.

9. The control method according to claim 1, characterized by, The response to the voice control instruction for the second virtual role, the second virtual role is controlled to perform a corresponding virtual action according to the voice control instruction, further comprises: Based on the voice control instruction, the second virtual role is controlled to perform the virtual action according to the guidance battle intention of the voice control instruction.

10. The control method according to claim 9, characterized by, The response to the voice control instruction for the second virtual role, the second virtual role is controlled to perform a corresponding virtual action according to the voice control instruction, further comprises: Based on the voice control instruction, it is detected whether there is a guidance battle intention in the voice control instruction; If there is a guidance battle intention in the voice control instruction, the second virtual role is controlled to perform the virtual action according to the guidance battle intention.

11. The control method according to claim 10, characterized by, The control method further comprises: If there is no guidance battle intention in the voice control instruction, guidance battle information is displayed.

12. The control method according to claim 1, characterized by, The control method further comprises: Attack control area and movement control area are provided in the graphical user interface; The response to the control instruction for the first virtual role, the first virtual role is controlled to perform a corresponding virtual action, comprises: In response to the movement control instruction for the attack control area, the first virtual role is controlled to perform a movement action in the virtual environment; In response to the attack control instruction for the attack control area, the first virtual role is controlled to perform an attack action in the virtual environment.

13. The control method according to claim 8, characterized by, The response to the voice control instruction for the second virtual role, the second virtual role is controlled to perform a corresponding virtual action according to the voice control instruction, comprises: Based on the voice control instruction, the action control intention corresponding to the voice control instruction is determined; Based on the action control intention, it is determined whether the second virtual role can perform the action control intention; If the second virtual character is capable of performing the action control intention, the second virtual character is controlled to perform a virtual action corresponding to the voice control instruction in the virtual environment through automatic control logic.

14. The control method according to claim 13, characterized by, The determining of the action control intention corresponding to the voice control instruction based on the voice control instruction comprises: converting the collected voice control instruction into text control information; determining the action control intention based on the text control information, context information corresponding to other voice control instructions associated with the voice control instruction, and environment information of the virtual environment.

15. The control method according to claim 13, characterized by, The displaying of the response information of the second virtual character to the voice control instruction comprises: generating the response information corresponding to the second virtual character based on the pre-stored role attribute of the second virtual character, and displaying the response information; or, generating the response information corresponding to the second virtual character based on the role attribute of the second virtual character, and displaying the response information.

16. The control method according to claim 1, characterized by The displaying of the voice interaction prompt information in response to the triggering of the proactive event comprises: generating the voice interaction prompt information based on the event type to which the proactive event belongs, and displaying the voice interaction prompt information; or, determining a target virtual character involved in the event type based on the event type to which the proactive event belongs; generating the voice interaction prompt information based on the pre-stored role attribute of the target virtual character, and displaying the voice interaction prompt information.

17. The control method according to claim 11, wherein The displaying of the guide response information comprises: generating the guide response information based on the selected guide virtual character, and displaying the guide response information; or, generating the guide response information based on the pre-stored role attribute of the guide virtual character, and displaying the guide response information. The control device comprises:

18. A control device for a virtual character, characterized by a virtual character providing module configured to provide a first virtual character and a second virtual character in a virtual environment; a first virtual character control module configured to control the first virtual character to perform a corresponding virtual action in response to a control instruction for the first virtual character; a voice control module configured to, in response to a voice control instruction for the second virtual character, determine whether the second virtual character has a condition for performing a virtual action corresponding to the voice control instruction according to the voice control instruction, a role attribute of the second virtual character, and environment information of the virtual environment, control the second virtual character to perform the corresponding virtual action through automatic control logic if it is determined that the second virtual character has the condition for performing the virtual action corresponding to the voice control instruction, and control the second virtual character not to perform or partially perform the corresponding virtual action through automatic control logic if it is determined that the second virtual character does not have the condition for performing the virtual action corresponding to the voice control instruction. ​ The role attribute of the second virtual role includes at least one of the following: a life value of the second virtual role, a motion setting mode of the second virtual role, and a personality attribute of the second virtual role. The personality attribute of the second virtual role is generated or configured by a game system and represents an acceptance degree of the second virtual role to the voice control instruction. The environment information of the virtual environment includes at least one of the following: information of the virtual environment itself, a role attribute of a teammate virtual role in the same camp as the first virtual role and the second virtual role, and a role attribute of an enemy virtual role in an enemy camp of the first virtual role and the second virtual role. The non-voice control module is configured to control the second virtual role to automatically perform a virtual action when no voice control instruction for the second virtual role is received. The control device further includes a voice interaction prompt module configured to: In response to triggering of a proactive event, display voice interaction prompt information to prompt a player to control the second virtual role through a voice control instruction. The proactive event includes at least one of the following: The second virtual role receives a parry action of another virtual role, the life value of the first virtual role is less than a preset life threshold, the life value of the second virtual role is less than a preset life threshold, the first virtual role performs an attack operation on the other virtual role, a current game session ends, a time of not receiving the voice control instruction is greater than a preset time threshold, and the first virtual role enters a preset life state.

19. An electronic device, comprising: The control device includes: A processor, a storage medium, and a bus. The storage medium stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the storage medium communicate through the bus. The processor executes the machine-readable instructions to perform the steps of the virtual role control method according to any one of claims 1 to 17.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program. When the computer program is run by the processor, the steps of the virtual role control method according to any one of claims 1 to 17 are performed.

Citation Information

Patent Citations

  • Task guiding method and device in virtual scene, equipment, medium and program product

    CN114247141A

  • Custom voice control of video game character

    US20200384362A1