Virtual character man-machine interaction method, device and equipment and storage medium

Abstract

The invention discloses a human-computer interaction method, device and equipment for a virtual character and a storage medium, and belongs to the technical field of human-computer interaction. The method comprises the following steps: displaying an observation picture of a virtual environment; playing the environment sound of the position of the first virtual character in the virtual environment, wherein the environment sound comprises the use sound of the virtual prop; and under the condition that the environment sound exceeds the bearing threshold of the first virtual character, presenting that the first virtual character is in an auditory impaired state in a visual effect and / or an auditory effect. The auditory impaired state is presented through the visual effect and / or the auditory effect, negative effects are caused on information in the virtual environment obtained in a man-machine interaction mode, the state that the perception ability of physiological organs is reduced after sound stimulation in the real world can be simulated, and the immersion feeling of the virtual environment is improved.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a human-computer interaction method, apparatus, device and storage medium for a virtual character. Background Technology

[0002] In applications that provide virtual environments, it is often necessary to control virtual characters to perform activities within the virtual environment, such as walking, driving, climbing, picking up items, and fighting.

[0003] In related technologies, taking virtual shooting props for virtual competition as an example, virtual characters change positions in a virtual environment and launch virtual attacks on enemy virtual characters to achieve virtual competition.

[0004] However, when performing virtual competitions using related technologies, the virtual characters remain in a stable state, failing to simulate the state of physiological organs in the real world after being stimulated by external stimuli. This results in a lack of immersion in the virtual environment, and how to improve the immersion of the virtual environment is an urgent problem to be solved. Summary of the Invention

[0005] This application provides a human-computer interaction method, apparatus, device, and storage medium for virtual characters, the technical solution of which is as follows:

[0006] According to one aspect of this application, a human-computer interaction method for a virtual character is provided, the method being executed by a terminal, the method comprising:

[0007] Displays the view of the virtual environment;

[0008] Play ambient sounds at the location of the first virtual character in the virtual environment, including the sounds of using virtual props;

[0009] If the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character will be presented as having hearing impairment through visual and / or auditory effects.

[0010] According to another aspect of this application, a human-computer interaction device for virtual characters is provided, the device comprising:

[0011] The display module is used to display the observation screen of the virtual environment;

[0012] An audio module is used to play ambient sounds at the location of the first virtual character in the virtual environment, including the sounds of using virtual props.

[0013] The display module is further configured to visually present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, and / or the audio module is further configured to auditorily present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold.

[0014] In an optional design of this application, the display module is further configured to:

[0015] When the ambient sound exceeds the tolerance threshold of the first virtual character, a degraded image of the virtual environment is displayed. The degraded image is the observation result of the first virtual character in the hearing-impaired state of the virtual environment, and the image quality of the degraded image is lower than that of the observed image.

[0016] In an alternative design of this application, the display module is further used for at least one of the following:

[0017] The first area in the degraded image is shown to be obscured;

[0018] The virtual items located in the second area of ​​the degraded image show ghosting;

[0019] The third region in the degraded image is overlaid with the first color;

[0020] A blurring effect is displayed in the fourth region of the degraded image;

[0021] The degraded image is displayed at a first resolution, which is lower than the second resolution of the observed image.

[0022] In an optional design of this application, the audio module is further configured to:

[0023] When the ambient sound exceeds the tolerance threshold of the first virtual character, interference audio is played. The interference audio is the audio played by the first virtual character in the hearing impairment state, and the audio quality of the interference audio is lower than that of the ambient sound.

[0024] In an alternative design of this application, the audio module is further used for at least one of the following:

[0025] If the ambient sound exceeds the tolerance threshold of the first virtual character, the ambient sound is replaced with a first interference audio. The first interference audio is obtained by performing sound effect degradation on the ambient sound. The sound effect degradation method includes at least one of reducing the sampling rate, reducing the audio bit depth, and adding echo.

[0026] If the ambient sound exceeds the tolerance threshold of the first virtual character, a second interference audio, which is noise audio, is superimposed on the current sound.

[0027] In an optional design of this application, the ambient sound includes the sound of the virtual environment at the current moment, and the ambient sound exceeding the tolerance threshold of the first virtual character includes:

[0028] At the current moment, the instantaneous intensity of the ambient sound exceeds a first threshold.

[0029] In an optional design of this application, the ambient sound includes the sound of the virtual environment at the current moment and at least one historical moment, and the ambient sound exceeding the tolerance threshold of the first virtual character includes:

[0030] The first sum exceeds the second threshold, where the first sum is the sum of the sound intensities of the virtual environment at the current moment and at least one historical moment.

[0031] Wherein, the sound intensity of the virtual environment at the current moment and at least one historical moment exceeds a third threshold, the third threshold is less than the second threshold, and the duration between each historical moment and the current moment is less than a duration threshold.

[0032] In an optional design of this application, the second threshold is the difference between the virtual hearing value of the first virtual character at the current moment and the hearing impairment value; the device further includes:

[0033] The processing module is used to determine the virtual hearing value at the current moment as the sum of the first historical hearing value and the recovered hearing value when all m differences are not greater than 0. The first historical hearing value is the virtual hearing value of the first historical moment adjacent to the current moment.

[0034] The m differences correspond one-to-one with the m information groups. Each of the m information groups includes historical hearing values ​​from two adjacent historical moments. The m information groups are constructed based on historical hearing values ​​from m+1 historical moments. The difference corresponding to each information group is the difference between the historical hearing value from the previous moment and the historical hearing value from the subsequent moment.

[0035] In an alternative design of this application, the audio module is further used for at least one of the following:

[0036] In response to the virtual shooting prop being in a firing state, a first ambient sound at the location of the first virtual character is played, the first ambient sound including the firing sound effect of the virtual shooting prop;

[0037] In response to the virtual explosive prop being in a triggered state, a second ambient sound at the location of the first virtual character is played, the second ambient sound including the explosion sound effect of the virtual explosive prop.

[0038] In an optional design of this application, the ambient sound also includes the virtual activity sound of the virtual character, and the audio module is further used for at least one of the following:

[0039] In response to a virtual attack on the second virtual character, a third ambient sound is played, which also includes an alarm sound from the second virtual character;

[0040] In response to the third virtual character being injured, a fourth ambient sound is played, which also includes the third virtual character's cry for help.

[0041] In an optional design of this application, the ambient sound includes virtual weather sound effects of the virtual environment, and the audio module is further used for:

[0042] In response to the virtual environment being in a first weather condition, a fifth environmental sound is played, the fifth environmental sound also including the weather sound effects of the first weather condition.

[0043] In an optional design of this application, the device further includes:

[0044] The display module is further configured to, in response to the first virtual character being equipped with protective gear, visually present the first virtual character being in the hearing-impaired state when the sound correction exceeds the correction threshold, and / or the audio module is further configured to auditorily present the first virtual character being in the hearing-impaired state when the sound correction exceeds the correction threshold.

[0045] Wherein, the protective prop is a wearable prop for the first virtual character and / or a virtual accessory for a virtual shooting prop; the sound intensity of the corrected sound is less than the sound intensity of the ambient sound, and / or, the tolerance threshold exceeds the correction threshold.

[0046] In an optional design of this application, the device further includes:

[0047] The acquisition module is used to acquire the correction coefficient corresponding to the protective item in response to the first virtual character being equipped with the protective item;

[0048] The processing module is configured to correct the sound intensity of the ambient sound based on the correction coefficient to obtain the sound intensity of the corrected sound; and / or, correct the tolerance threshold based on the correction coefficient to obtain the corrected threshold.

[0049] In an optional design of this application, the display module is further configured to:

[0050] If the ambient sound exceeds the first virtual character's tolerance threshold, a prompt icon indicating that the first virtual character is in a state of hearing impairment will be displayed.

[0051] According to another aspect of this application, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set being loaded and executed by the processor to implement the human-computer interaction method for virtual characters as described above.

[0052] According to another aspect of this application, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, code set, or instruction set is stored therein, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the human-computer interaction method for virtual characters as described above.

[0053] According to another aspect of this application, a computer program product is provided, the computer program product including computer instructions stored in a computer-readable storage medium, wherein a processor reads from the computer-readable storage medium and executes the computer instructions to implement the human-computer interaction method for virtual characters as described above.

[0054] The beneficial effects of the technical solution provided in this application include at least the following:

[0055] By causing the first virtual character to experience auditory impairment when the ambient sound exceeds its tolerance threshold, the first virtual character is subjected to sound stimuli in the virtual environment that exceed its tolerance capacity. The auditory impairment state is presented through visual and / or auditory effects, which negatively impacts the acquisition of information from the virtual environment through human-computer interaction. This can simulate the decline in the perceptual ability of physiological organs after being stimulated by sound in the real world, thereby improving the immersion of the virtual environment. Attached Figure Description

[0056] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0057] Figure 1This is a schematic diagram of a computer system provided in an exemplary embodiment of this application;

[0058] Figure 2 This is a schematic diagram of a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application;

[0059] Figure 3 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0060] Figure 4 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0061] Figure 5 This is a schematic diagram of a screen provided in an exemplary embodiment of this application;

[0062] Figure 6 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0063] Figure 7 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0064] Figure 8 This is a schematic diagram of virtual hearing values ​​provided in an exemplary embodiment of this application;

[0065] Figure 9 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0066] Figure 10 This is a flowchart of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application;

[0067] Figure 11 This is a schematic diagram of a virtual environment provided in an exemplary embodiment of this application;

[0068] Figure 12 This is a structural block diagram of a human-computer interaction device for virtual characters provided in an exemplary embodiment of this application;

[0069] Figure 13 This is a structural block diagram of a terminal provided in an exemplary embodiment of this application.

[0070] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0072] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0073] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0074] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the observation screen, environmental sound and other information involved in this application were obtained with full authorization.

[0075] It should be understood that although the terms first, second, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, a first parameter may also be referred to as a second parameter without departing from the scope of this disclosure, and similarly, a second parameter may also be referred to as a first parameter. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0076] Figure 1 A structural block diagram of a computer system provided in an exemplary embodiment of this application is shown. The computer system 100 includes: a first terminal 110, a server 120, and a second terminal 130.

[0077] The first terminal 110 has a client 111 installed and running that supports a virtual environment. This client 111 can be a multiplayer online battle arena (MOBA) program. When the first terminal runs the client 111, the user interface of the client 111 is displayed on the screen of the first terminal 110. The client 111 can be any of the following: battle royale shooting game, virtual reality (VR) application, augmented reality (AR) program, 3D mapping program, virtual reality game, augmented reality game, casual game, party game, first-person shooter (FPS) game, third-person shooter (TPS) game, multiplayer online battle arena (MOBA) game, or simulation game (SLG). In this embodiment, an FPS game is used as an example. The first terminal 110 is the terminal used by the first user 112. The first user 112 uses the first terminal 110 to control a first virtual character located in a virtual environment to perform activities. The first virtual character can be referred to as the virtual character of the first user 112. The activities of the first virtual character include, but are not limited to, at least one of the following: moving, jumping, teleporting, releasing skills, using items, adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, and throwing. For illustrative purposes, the first virtual character is a virtual character, such as a realistic or anime character.

[0078] The second terminal 130 has a client 131 installed and running that supports a virtual environment. This client 131 can be a multiplayer online battle arena (MOBA) program. When the second terminal 130 runs the client 131, the user interface of the client 131 is displayed on the screen of the second terminal 130. This client can be any of the following: battle royale shooting game, VR application, AR program, 3D map program, virtual reality game, augmented reality game, FPS, TPS, MOBA, or SLG. In this embodiment, a MOBA game is used as an example. The second terminal 130 is the terminal used by the second user 132. The second user 132 uses the second terminal 130 to control a second virtual character located in the virtual environment. This second virtual character can be referred to as the virtual character of the second user 132. For illustrative purposes, the second virtual character is a virtual character, such as a realistic character or an anime character.

[0079] Optionally, the first virtual character and the second virtual character reside in the same virtual environment. Optionally, the first virtual character and the second virtual character may belong to the same faction, the same team, the same organization, have a friend relationship, or have temporary communication permissions. Optionally, the first virtual character and the second virtual character may belong to different factions, different teams, different organizations, or have an adversarial relationship.

[0080] Optionally, the clients installed on the first terminal 110 and the second terminal 130 are the same, or the clients installed on the two terminals are the same type of client on different operating system platforms (Android or iOS). The first terminal 110 can refer to one of multiple terminals, and the second terminal 130 can refer to another of multiple terminals. This embodiment only uses the first terminal 110 and the second terminal 130 as examples. The device types of the first terminal 110 and the second terminal 130 may be the same or different, and these device types include at least one of the following: smartphones, tablets, e-book readers, MP3 players, MP4 players, laptops, and desktop computers.

[0081] Figure 1 Only two terminals are shown in the diagram, but in different embodiments, multiple other terminals 140 can access the server 120. Optionally, one or more terminals 140 may also be terminals corresponding to developers, on which a development and editing platform for clients supporting virtual environments is installed. Developers can edit and update the client on the terminal 140 and transmit the updated client installation package to the server 120 via wired or wireless network. The first terminal 110 and the second terminal 130 can download the client installation package from the server 120 to update the client.

[0082] The first terminal 110, the second terminal 130, and other terminals 140 are connected to the server 120 via a wireless network or a wired network.

[0083] Server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Server 120 is used to provide backend services for clients supporting a 3D virtual environment. Optionally, server 120 undertakes the main computing work, and the terminal undertakes the secondary computing work; or, server 120 undertakes the secondary computing work, and the terminal undertakes the main computing work; or, server 120 and the terminal use a distributed computing architecture for collaborative computing.

[0084] In an illustrative example, server 120 includes processor 122, user account database 123, battle service module 124, and user-facing input / output interface (I / O interface) 125. Processor 122 loads instructions stored in server 120 and processes data in user account database 123 and battle service module 124. User account database 123 stores data about user accounts used by first terminal 110, second terminal 130, and other terminals 140, such as user account avatars, nicknames, combat power indices, and the service area where the user account is located. Battle service module 124 provides multiple battle rooms for users to play, such as 1v1, 3v3, and 5v5 battles. User-facing I / O interface 125 establishes communication and exchanges data with first terminal 110 and / or second terminal 130 via wireless or wired network.

[0085] The methods provided in this application can be applied to at least one of the following scenarios, but are not limited to: virtual reality applications, 3D map programs, casual games, party games, first-person shooter (FPS) games, third-person shooter (TPS) games, multiplayer online battle arena (MOBA) games, multiplayer shooting survival games, etc. The following embodiments are examples of applications in games.

[0086] Figure 2 A schematic diagram of a human-computer interaction method for virtual characters provided in an exemplary embodiment of this application is shown.

[0087] Terminal 210 displays the first interface 310 and plays the first audio 331; terminal 210 is the control terminal of the first virtual character 301; for example, terminal 210 can be implemented as Figure 1 Any terminal in the computer system shown, such as the first terminal 110.

[0088] Figure 2 Taking a first-person shooter game as an example, the first interface 310 is obtained from the perspective of the first virtual character 301 observing the virtual environment. The first interface 310 only displays the hands of the first virtual character 301, and the first virtual character 301 holds a virtual shooting prop 302. Under different perspectives, more body parts of the first virtual character 301 can be displayed.

[0089] The first audio 331 played by terminal 210 is ambient sound in the virtual environment, which includes the sound of using the virtual shooting prop 302, such as the sound effect of firing the virtual shooting prop 302.

[0090] When the virtual shooting prop 302 is fired, if the ambient sound exceeds the tolerance threshold, the second interface 320 is displayed and the superimposed second audio 332 and third audio 333 are played.

[0091] When the ambient sound exceeds the tolerance threshold of the first virtual character 301, the first virtual character 301 is in a state of hearing impairment. In this state of hearing impairment, it has a negative impact on obtaining information from the virtual environment through human-computer interaction.

[0092] In the second interface 320, virtual objects in the virtual environment are displayed with ghosting, taking the virtual car 322 as an example; in the first interface 310, the edges of the virtual car 322 are clear, and the edges of the rectangular shape of the car body, the cylindrical shape of the wheels, the headlights on the front of the car, the license plate, etc. are clear; the first interface 310 can clearly distinguish the edges of the virtual car 322 and clearly display the shape of each part of the car.

[0093] In the second interface 320, the virtual car 322 has a ghosting effect, making it impossible to identify the real edges of the virtual car 332. Due to the ghosting, the shape display of the virtual car 322 is also adversely affected, such as the inability to clearly identify the shape of the headlights of the virtual car 332. This increases the difficulty of observing the details of virtual objects and increases the difficulty of obtaining information in the virtual environment through human-computer interaction in terms of visual effects.

[0094] The second audio 332 is the ambient sound in the virtual environment at the moment the second interface 320 is displayed. The third audio is noise audio, such as a buzzing sound. When the second audio 332 and the third audio 333 are played together, the third audio 333 interferes with the second audio 332, increasing the difficulty of obtaining information from the virtual environment through human-computer interaction in terms of auditory effect.

[0095] By presenting the state of hearing impairment through visual and auditory effects, the first virtual character's observation of the virtual environment is reduced. This can simulate the decline in the perception ability of physiological organs after being stimulated by sound in the real world, thereby improving the immersion of the virtual environment.

[0096] Figure 3 A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. The method includes:

[0097] Step 510: Display the observation screen of the virtual environment;

[0098] For example, a virtual environment is a virtual space in which a first virtual character performs virtual activities; for instance, the first virtual character launches a virtual attack in a virtual game to achieve virtual competition. A virtual environment can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual environment.

[0099] For example, the observation screen is a view of the virtual environment obtained from the perspective of a first virtual character; in some examples, the observation screen is obtained by observing the virtual environment through a virtual camera; correspondingly, the observation screen is obtained by observing the virtual environment through a virtual camera corresponding to the first virtual character. The virtual camera can observe the virtual environment from perspectives such as first-person and third-person. The observation screen is then displayed to the controller of the terminal (such as a player in a game application) to show the observation results of the virtual environment.

[0100] In some examples, the terminal executing this embodiment is typically a terminal with control permissions for the first virtual character, but it is also possible that it is a terminal used by a spectator watching the first virtual character perform virtual activities.

[0101] Step 520: Play the ambient sound of the location of the first virtual character in the virtual environment;

[0102] Ambient sounds include the sounds of using virtual props. Virtual props can be carried by the first virtual character or other virtual characters in the virtual environment, or they can be deployed in the virtual environment and used automatically. This application does not restrict the ownership or usage of virtual props.

[0103] For example, the ambient sound played by the terminal is the sound propagating from the virtual environment to the location of the first virtual character. The propagation of sound in the virtual environment simulates the laws of sound propagation in the real world. For example, sound gradually attenuates during propagation, and the attenuation of sound follows the principle of decreasing with the square of the distance. The intensity of sound is inversely proportional to the square of the distance.

[0104] Step 530: When the ambient sound exceeds the first virtual character's tolerance threshold, present the first virtual character as having hearing impairment through visual and / or auditory effects;

[0105] When ambient sound exceeds the tolerance threshold of the first virtual character, the first virtual character is in a state of hearing impairment. Hearing impairment is a state of decreased virtual hearing caused by ambient sound stimulation exceeding the first virtual character's tolerance. In this state, hearing impairment negatively impacts the acquisition of information from the virtual environment through human-computer interaction. In this embodiment, the hearing impairment state is presented through visual and / or auditory effects.

[0106] In one example, the first virtual character's hearing impairment is caused by ambient sounds in the virtual environment exceeding a tolerable threshold; it is unrelated to whether the first virtual character is within the effective range of a virtual item or skill. The ambient sounds included in the virtual item usage sounds are supplementary representations to simulate the sound effects of corresponding items in the real world, not the actual effects of the virtual items. For example, with a virtual shooting item, the usage sound is to simulate the sound of a real-world fireable weapon; the effect of the virtual shooting item is to fire virtual projectiles and cause virtual damage, not to play the usage sound of the virtual shooting item.

[0107] For example, visual effects are typically presented through the terminal's display screen, while auditory effects are typically implemented through the terminal's audio circuitry. Presenting a state of hearing impairment through visual and auditory effects can simulate the decline in the physiological perception of hearing after external stimuli in the real world. The following will describe the presentation of a state of hearing impairment through visual and auditory effects using separate embodiments.

[0108] In summary, the method provided in this embodiment, when the ambient sound exceeds the tolerance threshold of the first virtual character, causes the first virtual character to be in a state of hearing impairment due to the sound stimulation in the virtual environment exceeding the first virtual character's tolerance capacity; presenting the hearing impairment state with visual and / or auditory effects, negatively impacting the acquisition of information in the virtual environment through human-computer interaction, can simulate the state of decreased perception ability of physiological organs after being stimulated by sound in the real world, thereby improving the immersion of the virtual environment.

[0109] Next, we will introduce the state of hearing impairment presented by visual and auditory effects through the following two examples.

[0110] Figure 4 A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. That is, in Figure 3 In the illustrated embodiment, step 530 can be implemented as step 532:

[0111] Step 532: If the ambient sound exceeds the tolerance threshold of the first virtual character, display a degraded virtual environment.

[0112] When the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character is in a state of hearing impairment. The degraded image is the first virtual character's observation of the virtual environment while in a state of hearing impairment; it is the image displayed on the terminal while in a state of hearing impairment.

[0113] The image quality of the degraded screen is lower than that of the observed screen. Image quality includes, but is not limited to, at least one of sharpness, color, and dynamic range. This embodiment does not limit the content of the degraded screen; for example, in response to a movement operation on the first virtual object, the content of the degraded screen is different from the content of the observed screen displayed in step 510.

[0114] When the first virtual character is in a state of hearing impairment, the display of low-quality degraded images simulates the decline in perception after being stimulated by sound in the real world; in the state of hearing impairment, the way of visual observation to obtain information in the virtual environment is negatively affected.

[0115] In one alternative implementation, the degraded visuals of the virtual environment are described below. Displaying the degraded visuals of the virtual environment can be implemented in at least one of the following ways:

[0116] • The first area in the degraded display is obscured;

[0117] For example, the first region is part or all of the degraded image; the first region is typically an area located at the edge of the degraded image. The first region is occluded, and the observation of the virtual environment cannot be presented within the first region. (See reference) Figure 5 In subimage (a), the first region 601 is the area in subimage (a) that is displayed as completely black. The first region 601 is located at the edge of subimage (a). Filling the first region 601 with black would prevent the representation of the virtual environment. For example, Figure 5 Displaying the first region 601 as black is merely an example; the first region can also be filled with other opaque colors.

[0118] The first area is occluded to reduce the area used to present the virtual environment in the degraded image, thereby reducing the first virtual character's observation effect on the virtual environment and simulating the decline in the perception ability of physiological organs after being stimulated by sound in the real world.

[0119] • Virtual items located in the second area of ​​the degraded screen appear ghosted;

[0120] Similarly, the second region is part or all of the degraded image. This second region is typically an area located at the edge of the degraded image, or an area containing virtual objects. In the second region, the ghosting of virtual objects overlaps with the virtual objects in the degraded image, increasing the difficulty for the observer in the degraded image to judge the edge positions of virtual objects and observe their detailed features, thus reducing the first virtual character's perception of the virtual environment. (Reference) Figure 5In subgraph (b), the second region is the entire area of ​​subgraph (b). Virtual items in subgraph (b) exhibit ghosting. Figure 2 The article already introduced the ghosting effect of virtual cars, so I won't repeat it here.

[0121] The virtual objects in the second area have ghosting, which increases the difficulty of recognizing virtual objects in the degraded image, thereby reducing the first virtual character's observation effect on the virtual environment and simulating the state of decreased sensory ability of physiological organs after being stimulated by sound in the real world.

[0122] • The third area in the degraded image is overlaid with the first color;

[0123] For example, the third region is part or all of the degraded image, and the third region is usually the area located in the center of the degraded image. In the third region, by overlaying the first color, the difficulty of observing the true color of the virtual objects in the third region is increased; furthermore, the overlaid first color can mask virtual objects in the third region whose true color is similar to the first color, increasing the difficulty of identifying virtual objects with similar colors.

[0124] For example, the first color could be a pre-set color, such as red, to simulate the decreased perception caused by blood rushing to the head after sound stimulation in the real world. The first color could also be determined from a virtual image, such as displaying the color with the largest area in the viewing area, to simulate the decreased color perception after sound stimulation in the real world, where only the largest area of ​​color can be recognized. (Reference) Figure 5 In the sub-image (c), the third region 603 is an elliptical region displayed as a diagonal fill in the sub-image (c), and the third region 603 is located in the central part of the sub-image (c); for example, the first color of the third region 603 is semi-transparent, and the first color and the virtual environment can be superimposed and displayed simultaneously.

[0125] The third area is overlaid with the first color, which reduces the observation effect of the first virtual character on the virtual environment by increasing the difficulty of observing the real colors of virtual objects in the degraded picture, and simulates the state of decreased perception ability of physiological organs after being stimulated by sound in the real world.

[0126] • A blur effect is displayed in the fourth area of ​​the degraded image;

[0127] For example, the fourth region is part or all of the degraded image. It should be noted that, as described above, the degraded image can simultaneously include multiple regions from the first to the fourth. When the degraded image includes multiple regions from the first to the fourth, there can be overlap between different regions. Furthermore, two different regions can be completely identical; for example, both the third and fourth regions are the entirety of the degraded image, meaning the degraded image not only has the first color superimposed but also displays a blurred effect. This application does not impose any limitations on this.

[0128] For example, in the fourth region, the details of the virtual environment cannot be displayed. Only the blurred outline and the color of the blurred boundary can be obtained, which greatly compresses the amount of information of the virtual environment that can be presented in the fourth region and reduces the observation effect of the first virtual character on the virtual environment.

[0129] The blurring effect displayed in the second area includes, but is not limited to, at least one of Gaussian blur, mean blur, and bilateral blur.

[0130] • Display the degraded image at the first resolution;

[0131] For example, the first resolution is lower than the second resolution of the observed image; by displaying the degraded image at a low resolution, the image details in the degraded image are lost by reducing the resolution, and the image details cannot be observed, thereby reducing the first virtual character's observation effect on the virtual environment, simulating the state of decreased perception ability of physiological organs after being stimulated by sound in the real world.

[0132] In summary, the method provided in this embodiment, by placing the first virtual character in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, and presenting the hearing impairment state with visual effects by displaying a degraded image of the virtual environment, provides a way to implement a low-image-quality degraded image. Compared with observing the image, this reduces the observation effect of the virtual environment, can simulate the state of decreased perception of physiological organs after being stimulated by sound in the real world, and improves the immersion of the virtual environment.

[0133] Figure 6 A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. That is, in Figure 3 In the illustrated embodiment, step 530 can be implemented as step 534:

[0134] Step 534: If the ambient sound exceeds the first virtual character's tolerance threshold, play interfering audio;

[0135] When the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character is in a state of hearing impairment; the interference audio is the sound audio in the virtual environment acquired by the first virtual character when it is in a state of hearing impairment; the interference audio is the audio played by the first virtual character when it is in a state of hearing impairment.

[0136] The audio quality of the interfering audio is lower than that of the ambient sound. Audio quality includes, but is not limited to, at least one of the following: the amount of information carried in the audio, the sampling rate, and the audio bit depth. This embodiment does not limit the audio content of the interfering audio; for example, as time goes on, the virtual activities performed in the virtual environment are different, and the corresponding sounds in the virtual environment are also different.

[0137] When the first virtual character is in a state of hearing impairment, low-quality interference audio is played to simulate the state of decreased perception after being stimulated by sound in the real world; in the state of hearing impairment, it has a negative impact on the way of hearing to obtain information in the virtual environment.

[0138] In one alternative implementation, the interfering audio is described as follows, and step 534 in this embodiment can be implemented as at least one of the following:

[0139] • If the ambient sound exceeds the tolerance threshold of the first virtual character, replace the ambient sound with the first interference audio.

[0140] The first interference audio is obtained by performing sound effect degradation on the ambient sound. The sound effect degradation methods include at least one of reducing the sampling rate, reducing the audio bit depth, and adding echo. By performing sound effect degradation on the ambient sound, the first interference audio is obtained, which reduces the clarity of the original sound in the virtual environment and reduces the efficiency of obtaining information in the virtual environment by hearing.

[0141] The audio degradation method that reduces the sampling rate increases the spacing between two adjacent frames in the first interference audio, reducing the detail of the sound sampling. The audio degradation method that reduces the audio bit depth reduces the dynamic range and precision of the first interference audio, losing sound detail information. The audio degradation method that adds echo causes the original sound in the virtual environment and the superimposed echo to intertwine, increasing the difficulty of distinguishing the original sound in the virtual environment.

[0142] By replacing ambient sounds with a first interfering audio, the efficiency of acquiring information in the virtual environment through hearing is reduced, simulating the decline in the perceptual ability of physiological organs after being stimulated by sound in the real world.

[0143] • If the ambient sound exceeds the tolerance threshold of the first virtual character, play a second interference audio overlay on top of the current sound;

[0144] For example, the second interfering audio is noise audio, which is usually a sound with a constant audio amplitude and / or audio frequency, such as a buzzing sound, but it does not exclude sounds with a periodic cycle of audio amplitude and / or audio frequency, such as a buzzing sound or breathing sound with a periodic change in intensity.

[0145] By superimposing a second interfering audio on top of the current sound, the difficulty of distinguishing the original sound in the virtual environment is increased, the efficiency of obtaining information in the virtual environment by hearing is reduced, and the state of decreased perception ability of physiological organs after being stimulated by sound in the real world is simulated.

[0146] In one example, the current sound is the ambient sound in the virtual environment; in another example, the current sound is the first interference audio described above. That is, the two implementation methods in this embodiment can be executed simultaneously.

[0147] In summary, the method provided in this embodiment, by causing the first virtual character to be in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, presents the hearing impairment state with auditory effects by playing interfering audio; compared to ambient sound, by superimposing noise or weakening the original sound in the virtual environment, the efficiency of obtaining information in the virtual environment through auditory means is reduced, which can simulate the state of decreased perception ability of physiological organs after being stimulated by sound in the real world, and improve the immersion of the virtual environment.

[0148] Next, the ambient sounds of the virtual environment will be introduced as follows:

[0149] Figure 7 A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. That is, in Figure 3 In the illustrated embodiment, step 520 can be implemented as at least one of steps 522 and 524:

[0150] Step 522: In response to the virtual shooting prop being in the firing state, play the first ambient sound of the location of the first virtual character;

[0151] Referring to the introduction of step 520 above, ambient sounds include the sounds of using virtual props. The sounds of using virtual props are information obtained in the virtual environment through hearing, and are also the source of auditory stimulation when simulating the state of physiological organs after being stimulated by the outside world in the real world.

[0152] In this embodiment, the ambient sound is the first ambient sound, which includes the firing sound effect of the virtual shooting prop; the virtual prop used in the virtual environment is the virtual shooting prop. This embodiment does not restrict the user of the virtual shooting prop. The user of the virtual shooting prop can be the first virtual character, other virtual characters in the virtual environment, or there may be no user of the virtual shooting prop. The virtual shooting prop is automatically put into firing state after the virtual character is detected.

[0153] In this embodiment, the sound effect of the virtual shooting prop props propagates from the location of the virtual shooting props, and the intensity of the sound effect propagates is negatively correlated with the distance from the first virtual character to the location of the virtual shooting props.

[0154] For example, if the intensity of the sound effect is less than the resolution threshold, the sound effect will no longer be played, meaning that the sound effect of the virtual shooting prop cannot be obtained at the location of the first virtual object.

[0155] Optionally, the sound effects also include the flight sound of virtual projectiles fired from the virtual shooting prop, to simulate the sound of a projectile rubbing against the air in the real world. Correspondingly, the intensity of the sound effects is the sum of the intensity of a first sound effect propagating from the location of the virtual shooting prop and the intensity of a second sound effect. The intensity of the second sound effect is negatively correlated with the distance between the first virtual character and the first ray; the first ray is a ray that propagates along the firing direction of the virtual shooting prop, originating from its location.

[0156] Step 524: In response to the virtual explosive prop being in the triggered state, play the second ambient sound of the location of the first virtual character;

[0157] In this embodiment, the second ambient sound includes the explosion sound effects of virtual explosive props; the virtual props used in the virtual environment are virtual explosive props; similar to step 522, this embodiment does not restrict the user of the virtual explosive props. For example, virtual explosive props can be virtual grenades or other props directly carried by the virtual character, or virtual shells of virtual artillery or other virtual props operated by the virtual character; this embodiment does not restrict the type of virtual explosive props.

[0158] It should be noted that playing explosion sound effects does not require the first virtual character to be within the effective range of the virtual explosion item. Similar to the impact sound effects, explosion sound effects propagate from the location of the virtual explosion item, and the intensity of the explosion sound effect is negatively correlated with the distance from the first virtual character to the triggering location of the virtual explosion item. When the intensity of the explosion sound effect exceeds the resolution threshold, ambient sounds including the explosion sound effect of the virtual explosion item will be played.

[0159] In one alternative implementation, ambient sound also includes the virtual activity sounds of the virtual character. Figure 7 In addition to the illustrated embodiments, at least one of the following is also included:

[0160] • In response to a virtual attack on a second virtual character, play a third ambient sound.

[0161] In this implementation, the ambient sound includes the virtual activity sound of the virtual character, and extends the virtual activity sound to the source of auditory stimulation when simulating the state of physiological organs after being stimulated by external stimuli in the real world.

[0162] In this step, the third ambient sound also includes the warning sound of the second virtual character. The warning sound of the second virtual character is played in response to the second virtual character being virtually attacked, and can simulate the stress response of being attacked in the real world as shouting a warning. The played warning sound corresponds to a high-intensity, sharp-sounding auditory stimulation effect in the real world.

[0163] For example, the sound content of the warning sound is usually the pronunciation of preset text, such as "Be careful, someone is attacking", or it can be the pronunciation of text obtained by filling the slot according to the direction of the virtual attack. For example, after being attacked by a virtual grenade, the help sound is: "Be careful, I was hit by a grenade", where "grenade" is the text slot filled according to the type of virtual attack.

[0164] • In response to the third virtual character being injured, a fourth ambient sound is played;

[0165] In this step, the fourth ambient sound also includes the distress call of the third virtual character. This distress call is played in response to the third virtual character being injured, and it simulates the real-world distress response of shouting for help when injured. The played distress call corresponds to a high-intensity, repetitive auditory stimulus in the real world.

[0166] For example, the content of the cry for help is usually the pronunciation of a preset text, such as "Help me, please help me," or it can be determined according to the specific injury. For example, when suffering a scrape, the cry for help is "Help me, I need bandages"; when suffering virtual magic damage, the cry for help is "Help me, I need to get away from here."

[0167] In another alternative implementation, ambient sounds include virtual weather sound effects for the virtual environment. Figure 7 Based on the illustrated embodiments, it also includes:

[0168] • Responding to the virtual environment being in the first weather condition, play the fifth environmental sound;

[0169] In this implementation, the fifth environmental sound also includes the weather sound effects of the first weather, extending the virtual weather sound effects to the source of auditory stimulation when simulating the state of physiological organs after being stimulated by external stimuli in the real world.

[0170] For example, the first weather condition is typically severe weather (or extreme weather), such as heavy rain, strong winds, or thunderstorms. Correspondingly, the virtual weather sound effect for heavy rain is the sound of dense raindrops, for strong winds it's the sound of howling wind, and for thunderstorms it's the sound of lightning. These virtual weather sound effects can simulate the auditory effects of real-world weather, and they have a prolonged, stimulating auditory effect.

[0171] Next, we will introduce the tolerance threshold of the first virtual character.

[0172] In one example, ambient sound includes the sound of the virtual environment at the current moment; correspondingly, the tolerance threshold of the first virtual character is implemented as the first threshold.

[0173] The environmental sound exceeding the first virtual character's tolerance threshold, as described in steps 530, 532, and 534 above, can be implemented as follows:

[0174] • At the current moment, the instantaneous intensity of the ambient sound exceeds the first threshold.

[0175] When ambient sound includes the sound of the virtual environment at the current moment, only the ambient sound at the current moment is considered to be whether it exceeds the first threshold. If the instantaneous intensity of the ambient sound exceeds the first threshold, the first virtual object is in a state of hearing impairment. It is possible to determine whether the first virtual object is in a state of hearing impairment with a small amount of data from a single moment, which reduces the computing power requirements of the terminal device and saves computing resources in heavy-load scenarios where the terminal needs to perform virtual environment rendering.

[0176] In another example, the ambient sound includes the sound of the virtual environment at the current moment and at least one historical moment; correspondingly, the tolerance threshold of the first virtual character is implemented as a second threshold;

[0177] The environmental sound exceeding the first virtual character's tolerance threshold, as described in steps 530, 532, and 534 above, can be implemented as follows:

[0178] • The first sum exceeds the second threshold. The first sum is the sum of the sound intensities of the virtual environment at the current moment and at least one historical moment.

[0179] For example, when the ambient sound includes the sound of the virtual environment at the current moment and at least one historical moment, the intensity of the ambient sound at multiple moments is considered, which can simulate the persistent negative effects of external stimuli on physiological organs in the real world, such as prolonged tinnitus.

[0180] Specifically, the sound intensity of the virtual environment exceeds a third threshold at the current moment and at least one historical moment, and the third threshold is less than the second threshold. The third threshold is used to filter the moments that stimulate the virtual hearing of the first virtual object, simulating that in the real world, the auditory organs are not damaged by common low-stimulation sounds (such as the sound of people talking), but are damaged by high-intensity strong-stimulation sounds (such as the roar of an airplane).

[0181] At least one historical moment must have a duration less than a duration threshold between it and the current moment; for example, 3 seconds. All moments that negatively impact the virtual hearing of the first virtual character must occur within 3 seconds prior to the current moment. The duration threshold indicates the maximum duration of the hearing impairment state after the first virtual object moves away from a position where the sound intensity exceeds a third threshold at a given moment. The hearing impairment state is persistent and does not disappear instantly after moving away from high-intensity ambient sounds. It simulates the persistence of hearing impairment in the real world, where tinnitus continues for a period of time even after moving away from noise.

[0182] For example, the significance of visual and / or auditory effects is positively correlated with the degree to which the first sum exceeds the second threshold; referring to the above description, when the terminal displays a degraded image, the image quality of the degraded image decreases as the degree to which the first sum exceeds the second threshold increases, for example, the number of ghosts in the degraded image increases, and the area of ​​the ghosted region increases; when the terminal plays interfering audio, if the interfering audio is noise audio, the sound intensity of the interfering audio increases as the degree to which the first sum exceeds the second threshold increases; if the interfering audio is degraded ambient sound, the degree of degradation of the ambient sound increases as the degree to which the first sum exceeds the second threshold increases.

[0183] Furthermore, based on this implementation, the second threshold is the difference between the virtual hearing value of the first virtual character at the current moment and the hearing impairment value; the hearing impairment value is the dividing threshold for whether the first virtual character is in a state of hearing impairment, also known as the hearing threshold.

[0184] Correspondingly, in Figure 3 The illustrated embodiment further includes: when all m differences are not greater than 0, determining the virtual hearing value at the current moment as the sum of the first historical hearing value and the recovered hearing value;

[0185] The first historical hearing value is the virtual hearing value of the first historical moment adjacent to the current moment; the restored hearing value is usually preset. For example, if all m differences are not greater than 0, the virtual hearing value is increased by the restored hearing value at each moment.

[0186] Each of the m differences corresponds one-to-one with one of the m information groups. Each of the m information groups includes the historical hearing values ​​of two adjacent historical moments.

[0187] The m information groups are constructed based on the historical hearing values ​​at m+1 historical moments. The first information group is constructed based on the two historical hearing values ​​at the first and second moments of the m+1 historical moments. The second information group is constructed based on the two historical hearing values ​​at the second and third moments. The nth information group is constructed based on the two historical hearing values ​​at the nth and n+1th moments. And so on, to construct the m information groups.

[0188] The difference for each information group is the difference between the historical hearing value at the previous time step and the historical hearing value at the next time step. For example, in the first information group above, the difference is the difference between the historical hearing value at the first time step and the historical hearing value at the second time step.

[0189] If the difference between the information groups is not greater than 0, then at subsequent historical moments, the first virtual character is not subjected to environmental sound stimuli exceeding the third threshold, and the first virtual character moves away from high-intensity environmental sounds. If all m differences are not greater than 0, the first virtual character continues to move away from high-intensity environmental sounds, and a restored hearing value is added based on the first historical hearing value to achieve automatic recovery of the virtual hearing value. Optionally, such as... Figure 8 As shown, the virtual hearing value of the first virtual character has an upper limit of 652 and a lower limit of 654; the hearing impairment value of 656 is the threshold between the upper limit of 652 and the lower limit of 654, indicating whether the first virtual character is in a state of hearing impairment. The virtual hearing value of 658 indicates the virtual hearing ability of the first virtual character at the current moment. Referring to the above description, the second threshold 659 is the difference between the virtual hearing value of 658 and the hearing impairment value of 656 at the current moment.

[0190] If the virtual hearing value of the first virtual character recovers from 658 to the maximum hearing value of 652, no further hearing value recovery will occur; if the virtual hearing value of the first virtual character decreases from 658 to the minimum hearing value of 654, no further decrease will occur. This is understandable. Figure 8 The diagram illustrating the virtual hearing value can be displayed on the terminal, or it can be used as an example of calculating the virtual hearing value and not displayed on the terminal.

[0191] Figure 9A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. That is, in Figure 3 Based on the illustrated embodiment, step 540 is also included:

[0192] Step 540: In response to the first virtual character being equipped with protective gear, if the sound correction exceeds the correction threshold, present the first virtual character as having hearing impairment through visual and / or auditory effects.

[0193] For example, protective props are wearable props for the first virtual character (such as virtual headphones, virtual noise-canceling headgear, etc.), and / or virtual accessories for virtual shooting props (such as virtual silencers, etc.);

[0194] For a description of hearing impairment, visual effects, and auditory effects, please refer to the various embodiments above; they will not be repeated here.

[0195] For example, the intensity of the corrected sound is less than the intensity of the ambient sound, and / or the tolerance threshold exceeds the correction threshold. It can be seen that, with protective gear equipped, the ambient sound intensity is reduced compared to when protective gear is not equipped; or a more lenient correction threshold is used to determine whether the first virtual character is in a state of hearing impairment. For example, a more lenient threshold is used to indicate that a stronger stimulus (such as higher sound intensity, longer sound duration, etc.) is required to exceed the correction threshold compared to the tolerance threshold.

[0196] For example, in this embodiment, step 530, which presents the first virtual character as having impaired hearing through visual and / or auditory effects when the ambient sound exceeds the first virtual character's tolerance threshold, is performed without the character being equipped with protective gear.

[0197] In one alternative implementation, the following is included before step 535:

[0198] • In response to the first virtual character being equipped with protective items, obtain the correction coefficient corresponding to the protective items;

[0199] Each protective item has a corresponding correction factor, which indicates the protective effect of the protective item on the hearing of the first virtual character. Taking the correction factor as a product to correct for ambient sound and / or tolerance threshold as an example, as the protective effect of the protective item on the first virtual character increases, the correction factor decreases.

[0200] • Correct the ambient sound intensity based on the correction factor to obtain the corrected sound; and / or, correct the tolerance threshold based on the correction factor to obtain the corrected threshold;

[0201] For example, the correction factor is used to correct ambient sound and / or tolerance threshold through a product method; the corrected sound intensity is obtained by calculating the product of the correction factor and the ambient sound intensity. The correction threshold is obtained by calculating the product of the correction factor and the tolerance threshold. It is understood that correcting the sound and correcting the threshold, at least one of these, can achieve a situation where the first virtual character is less likely to be in a state of hearing impairment compared to a character without protective gear.

[0202] In summary, the method provided in this embodiment offers a protective device for the virtual hearing of the first virtual character, which can modify the sound intensity of ambient sounds and / or set a threshold. Compared to not being equipped with a protective device, which requires a stronger sound stimulus to put the first virtual character in a state of hearing impairment, this method can simulate the devices that protect the auditory organs in the real world, thereby improving the immersion of the virtual environment.

[0203] Figure 10 A flowchart illustrating a human-computer interaction method for a virtual character provided in an exemplary embodiment of this application is shown. This method can be executed by a terminal. That is, in Figure 3 Based on the illustrated embodiment, step 535 is also included:

[0204] Step 535: If the ambient sound exceeds the first virtual character's tolerance threshold, display a prompt icon indicating that the first virtual character is in a state of hearing impairment;

[0205] For example, the prompt icon is used to indicate that the first virtual character is in a state of hearing impairment, as described above, where the hearing impairment state is presented through visual and / or auditory effects. In a virtual environment, scenarios that present degraded visuals or play interfering audio through auditory means are not limited to a state of hearing impairment.

[0206] For example, a virtual electronic device can interfere with the virtual headphones worn by the first virtual character. When the first virtual character approaches the virtual electronic device, an electronic interference sound effect is played. This electronic interference sound effect is similar to the interference audio played when the first virtual character is in a hearing-impaired state. To indicate to the player that the current auditory effect is caused by the first virtual character being in a hearing-impaired state, a prompt icon indicating that the first virtual character is in a hearing-impaired state is displayed.

[0207] For example, a prompt icon is overlaid on the screen showing the virtual environment when the user is hearing impaired. Figure 11 A schematic diagram of a virtual environment provided by an exemplary embodiment of this application is shown. A prompt icon 335 is overlaid on a degraded screen 330 where ghosting exists; exemplaryly, the prompt icon 335 includes an ear shape to graphically indicate that the first virtual character is in a state of hearing impairment.

[0208] In summary, the method provided in this embodiment, by displaying a prompt icon indicating hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, visually indicates that the first virtual character is in a hearing-impaired state; it also indicates to the player that the visual and / or auditory effects are presented because the first virtual character is in a hearing-impaired state, thereby improving the efficiency of the player in identifying that the first virtual character is in a hearing-impaired state.

[0209] In one application scenario, the application that provides the virtual environment is a shooting game program, such as at least one of battle royale shooting games, TPS, or FPS.

[0210] • Displays the observation screen of the virtual environment;

[0211] For example, a virtual environment provides space for multiple virtual characters to perform virtual competitions. For example, virtual characters in a virtual environment attack enemy virtual objects by firing virtual shooting props to achieve virtual competition.

[0212] For example, the virtual environment provides virtual buildings (such as houses, garages, etc.) and virtual obstacles (such as rocks, boxes, etc.) to provide cover for virtual characters. The virtual environment may also include pickable virtual shooting props for virtual characters to collect and use.

[0213] • Play ambient sounds from the virtual environment;

[0214] Ambient sounds include the firing sounds of virtual shooting props, which can be carried by the first virtual character or other virtual characters in the virtual environment, or can be deployed in the virtual environment for automatic use.

[0215] • When the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character is presented as having hearing impairment through visual and / or auditory effects;

[0216] When the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character is stimulated by the ambient sound, including the firing sound of virtual shooting props. The stimulation of the firing sound exceeds the first virtual character's tolerance, causing the first virtual character to be in a state of hearing impairment.

[0217] For example, the hearing impairment state is presented visually by displaying a degraded image of the virtual environment. The degraded image is the observation of the virtual environment by the first virtual character in a hearing impairment state.

[0218] Virtual objects in the degraded image exhibit ghosting, with the ghosting overlapping with the degraded image itself. This increases the difficulty for the observer to judge the edges of virtual objects and observe their details, reducing the first virtual character's perception of the virtual environment. This simulates the decline in sensory perception caused by sound stimulation in the real world. In a state of hearing impairment, the ability to acquire information from the virtual environment through visual observation is negatively affected.

[0219] For example, to present a hearing-impaired state through auditory effects, interfering audio is played. The interfering audio is the audio played by the first virtual character in the hearing-impaired state. The interfering audio is noise, such as a buzzing sound.

[0220] The current sound is the ambient sound in the virtual environment at the moment the first virtual character is in a state of hearing impairment. Adding interfering audio over this current sound increases the difficulty of distinguishing the original sounds in the virtual environment, reduces the efficiency of acquiring information from the virtual environment through hearing, and simulates the decline in the perceptual ability of physiological organs after being stimulated by sound in the real world. In a state of hearing impairment, this negatively impacts the acquisition of information from the virtual environment through hearing.

[0221] Those skilled in the art will understand that the above embodiments can be implemented independently, or the above embodiments can be freely combined to create new embodiments to implement the human-computer interaction method for virtual characters of this application.

[0222] Figure 12 A structural block diagram of a human-computer interaction device for a virtual character provided in an exemplary embodiment of this application is shown. The device includes:

[0223] Display module 810 is used to display the observation screen of the virtual environment;

[0224] Audio module 820 is used to play ambient sounds at the location of the first virtual character in the virtual environment, including the sounds of using virtual props;

[0225] The display module 810 is further configured to visually present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, and / or the audio module 820 is further configured to auditorily present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold.

[0226] In an optional implementation of this embodiment, the display module 810 is further configured to:

[0227] When the ambient sound exceeds the tolerance threshold of the first virtual character, a degraded image of the virtual environment is displayed. The degraded image is the observation result of the first virtual character in the hearing-impaired state of the virtual environment, and the image quality of the degraded image is lower than that of the observed image.

[0228] In an optional implementation of this embodiment, the display module 810 is further configured to perform at least one of the following:

[0229] The first area in the degraded image is shown to be obscured;

[0230] The virtual items located in the second area of ​​the degraded image show ghosting;

[0231] The third region in the degraded image is overlaid with the first color;

[0232] A blurring effect is displayed in the fourth region of the degraded image;

[0233] The degraded image is displayed at a first resolution, which is lower than the second resolution of the observed image.

[0234] In an optional implementation of this embodiment, the audio module 820 is further configured to:

[0235] When the ambient sound exceeds the tolerance threshold of the first virtual character, interference audio is played. The interference audio is the audio played by the first virtual character in the hearing impairment state, and the audio quality of the interference audio is lower than that of the ambient sound.

[0236] In an optional implementation of this embodiment, the audio module 820 is further used for at least one of the following:

[0237] If the ambient sound exceeds the tolerance threshold of the first virtual character, the ambient sound is replaced with a first interference audio. The first interference audio is obtained by performing sound effect degradation on the ambient sound. The sound effect degradation method includes at least one of reducing the sampling rate, reducing the audio bit depth, and adding echo.

[0238] If the ambient sound exceeds the tolerance threshold of the first virtual character, a second interference audio, which is noise audio, is superimposed on the current sound.

[0239] In an optional implementation of this embodiment, the ambient sound includes the sound of the virtual environment at the current moment, and the ambient sound exceeding the tolerance threshold of the first virtual character includes:

[0240] At the current moment, the instantaneous intensity of the ambient sound exceeds a first threshold.

[0241] In an optional implementation of this embodiment, the ambient sound includes the sound of the virtual environment at the current moment and at least one historical moment, and the ambient sound exceeding the tolerance threshold of the first virtual character includes:

[0242] The first sum exceeds the second threshold, where the first sum is the sum of the sound intensities of the virtual environment at the current moment and at least one historical moment.

[0243] Wherein, the sound intensity of the virtual environment at the current moment and at least one historical moment exceeds a third threshold, the third threshold is less than the second threshold, and the duration between each historical moment and the current moment is less than a duration threshold.

[0244] In an optional implementation of this embodiment, the second threshold is the difference between the virtual hearing value of the first virtual character at the current moment and the hearing impairment value; the device further includes:

[0245] The processing module 830 is used to determine the virtual hearing value at the current moment as the sum of the first historical hearing value and the recovered hearing value when all m differences are not greater than 0. The first historical hearing value is the virtual hearing value at the first historical moment adjacent to the current moment.

[0246] The m differences correspond one-to-one with the m information groups. Each of the m information groups includes historical hearing values ​​from two adjacent historical moments. The m information groups are constructed based on historical hearing values ​​from m+1 historical moments. The difference corresponding to each information group is the difference between the historical hearing value from the previous moment and the historical hearing value from the subsequent moment.

[0247] In an optional implementation of this embodiment, the audio module 820 is further used for at least one of the following:

[0248] In response to the virtual shooting prop being in a firing state, a first ambient sound at the location of the first virtual character is played, the first ambient sound including the firing sound effect of the virtual shooting prop;

[0249] In response to the virtual explosive prop being in a triggered state, a second ambient sound at the location of the first virtual character is played, the second ambient sound including the explosion sound effect of the virtual explosive prop.

[0250] In an optional implementation of this embodiment, the ambient sound further includes the virtual activity sound of the virtual character, and the audio module 820 is further used for at least one of the following:

[0251] In response to a virtual attack on the second virtual character, a third ambient sound is played, which also includes an alarm sound from the second virtual character;

[0252] In response to the third virtual character being injured, a fourth ambient sound is played, which also includes the third virtual character's cry for help.

[0253] In an optional implementation of this embodiment, the ambient sound includes virtual weather sound effects of the virtual environment, and the audio module 820 is further configured to:

[0254] In response to the virtual environment being in a first weather condition, a fifth environmental sound is played, the fifth environmental sound also including the weather sound effects of the first weather condition.

[0255] In an optional implementation of this embodiment, the apparatus further includes:

[0256] The display module 810 is further configured to, in response to the first virtual character being equipped with protective gear, visually present the first virtual character being in the hearing-impaired state when the sound correction exceeds the correction threshold, and / or the audio module 820 is further configured to auditorily present the first virtual character being in the hearing-impaired state when the sound correction exceeds the correction threshold.

[0257] Wherein, the protective prop is a wearable prop for the first virtual character and / or a virtual accessory for a virtual shooting prop; the sound intensity of the corrected sound is less than the sound intensity of the ambient sound, and / or, the tolerance threshold exceeds the correction threshold.

[0258] In an optional implementation of this embodiment, the apparatus further includes:

[0259] The acquisition module 840 is used to acquire the correction coefficient corresponding to the protective item in response to the first virtual character being equipped with the protective item.

[0260] The processing module 830 is configured to correct the sound intensity of the ambient sound based on the correction coefficient to obtain the sound intensity of the corrected sound; and / or, correct the tolerance threshold based on the correction coefficient to obtain the corrected threshold.

[0261] In an optional implementation of this embodiment, the display module 810 is further configured to:

[0262] If the ambient sound exceeds the first virtual character's tolerance threshold, a prompt icon indicating that the first virtual character is in a state of hearing impairment will be displayed.

[0263] It should be noted that the device provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules according to actual needs, that is, the content structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0264] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments of the relevant method; the technical effects achieved by each module performing its operation are the same as the technical effects in the embodiments of the relevant method, and will not be elaborated here.

[0265] This application also provides a computer device, which includes a processor and a memory, wherein the memory stores a computer program; the processor is used to execute the computer program in the memory to implement the human-computer interaction method for virtual characters provided in the above method embodiments.

[0266] Figure 13 A structural block diagram of a terminal provided in an exemplary embodiment of this application is shown. The terminal 1900 may be a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 1900 may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other names.

[0267] Typically, terminal 1900 includes a processor 1901 and a memory 1902. Processor 1901 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 1901 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1901 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1901 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1901 may also include an AI (Artificial Intelligence) processor, which handles computational operations related to machine learning.

[0268] The memory 1902 may include one or more computer-readable storage media, which may be non-transitory. The memory 1902 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1902 is used to store at least one instruction, which is executed by the processor 1901 to implement the human-computer interaction method for virtual characters provided in the method embodiments of this application.

[0269] In some embodiments, the terminal 1900 may also optionally include a peripheral device interface 1903 and at least one peripheral device. The processor 1901, memory 1902, and peripheral device interface 1903 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1903 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1904, a touch display screen 1905, a camera assembly 1906, an audio circuit 1907, and a power supply 1908.

[0270] Peripheral interface 1903 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1901 and memory 1902. In some embodiments, processor 1901, memory 1902 and peripheral interface 1903 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1901, memory 1902 and peripheral interface 1903 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0271] The radio frequency (RF) circuit 1904 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1904 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1904 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1904 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1904 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1904 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0272] The touch display screen 1905 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 1905 also has the energy to collect touch signals on or above its surface. These touch signals can be input as control signals to the processor 1901 for processing. In this case, the touch display screen 1905 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one touch display screen 1905, which is used as the front panel of the terminal 1900; in other embodiments, there may be at least two touch display screens, respectively disposed on different surfaces of the terminal 1900 or in a folded design; in still other embodiments, the touch display screen 1905 may be a flexible display screen, disposed on a curved surface or a folded surface of the terminal 1900. Furthermore, the touch display screen 1905 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The touch display 1905 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0273] The camera assembly 1906 is used to acquire images or videos. Optionally, the camera assembly 1906 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting for VR (Virtual Reality) shooting, or other fusion shooting functions by fusion of the main camera and the wide-angle camera. In some embodiments, the camera assembly 1906 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0274] The audio circuit 1907 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting them into electrical signals that are input to the processor 1901 for processing, or to the radio frequency circuit 1904 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1900. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1901 or the radio frequency circuit 1904 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1907 may also include a headphone jack.

[0275] Power supply 1908 is used to power the various components in terminal 1900. Power supply 1908 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1908 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0276] In some embodiments, the terminal 1900 further includes one or more sensors 1909. The one or more sensors 1909 include, but are not limited to: an accelerometer 1910, a gyroscope 1911, a pressure sensor 1912, an optical sensor 1913, and a proximity sensor 1914.

[0277] Accelerometer 1910 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established by terminal 1900. For example, accelerometer 1910 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 1901 can control touchscreen 1905 to display the user interface in landscape or portrait view based on the gravitational acceleration signal collected by accelerometer 1910. Accelerometer 1910 can also be used for game or user motion data acquisition. Gyroscope 1911 can detect the orientation and rotation angle of terminal 1900. Gyroscope 1911 can work in conjunction with accelerometer 1910 to acquire 3D user actions on terminal 1900. Based on the data collected by gyroscope 1911, processor 1901 can perform the following functions: motion sensing (e.g., changing the UI based on user tilt), image stabilization during shooting, game control, and inertial navigation.

[0278] The pressure sensor 1912 can be disposed on the side bezel of the terminal 1900 and / or on the lower layer of the touch display screen 1905. When the pressure sensor 1912 is disposed on the side bezel of the terminal 1900, it can detect the user's grip signal on the terminal 1900, and the processor 1901 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1912. When the pressure sensor 1912 is disposed on the lower layer of the touch display screen 1905, the processor 1901 can control the operable controls on the UI interface based on the user's pressure operation on the touch display screen 1905. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0279] An optical sensor 1913 is used to collect ambient light intensity. In one embodiment, the processor 1901 can control the display brightness of the touch screen 1905 based on the ambient light intensity collected by the optical sensor 1913. Specifically, when the ambient light intensity is high, the display brightness of the touch screen 1905 is increased; when the ambient light intensity is low, the display brightness of the touch screen 1905 is decreased. In another embodiment, the processor 1901 can also dynamically adjust the shooting parameters of the camera assembly 1906 based on the ambient light intensity collected by the optical sensor 1913.

[0280] The proximity sensor 1914, also known as a distance sensor, is typically located on the front panel of the terminal 1900. The proximity sensor 1914 is used to detect the distance between the user and the front of the terminal 1900. In one embodiment, when the proximity sensor 1914 detects that the distance between the user and the front of the terminal 1900 is gradually decreasing, the processor 1901 controls the touchscreen display 1905 to switch from a screen-on state to a screen-off state; when the proximity sensor 1914 detects that the distance between the user and the front of the terminal 1900 is gradually increasing, the processor 1901 controls the touchscreen display 1905 to switch from a screen-off state to a screen-on state.

[0281] Those skilled in the art will understand that the above structure does not constitute a limitation on the terminal 1900, and may include more or fewer components than illustrated, or combine certain components, or employ different component arrangements.

[0282] In an exemplary embodiment, a chip is also provided, the chip including programmable logic circuitry and / or program instructions, which, when the chip is run on a computer device, are used to implement the human-computer interaction method for virtual characters described above.

[0283] In an exemplary embodiment, a computer program product is also provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions to implement the human-computer interaction method for virtual characters provided in the above-described method embodiments.

[0284] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores a computer program that is loaded and executed by a processor to implement the human-computer interaction method for virtual characters provided in the above-described method embodiments.

[0285] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0286] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0287] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A human-computer interaction method for virtual characters, characterized in that, The method is executed by a terminal, and the method includes: Displays the view of the virtual environment; Play ambient sounds at the location of the first virtual character in the virtual environment, including the sounds of using virtual props; If the ambient sound exceeds the first virtual character's tolerance threshold, the first virtual character will be presented as having hearing impairment through visual and / or auditory effects.

2. The method according to claim 1, characterized in that, The step of visually representing the first virtual character as having hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold includes: When the ambient sound exceeds the tolerance threshold of the first virtual character, a degraded image of the virtual environment is displayed. The degraded image is the observation result of the first virtual character in the hearing-impaired state of the virtual environment, and the image quality of the degraded image is lower than that of the observed image.

3. The method according to claim 2, characterized in that, The display of the degraded image of the virtual environment includes at least one of the following: The first area in the degraded image is shown to be obscured; The virtual items located in the second area of ​​the degraded image show ghosting; The third region in the degraded image is overlaid with the first color; A blurring effect is displayed in the fourth region of the degraded image; The degraded image is displayed at a first resolution, which is lower than the second resolution of the observed image.

4. The method according to claim 1, characterized in that, The step of presenting the first virtual character as having hearing impairment through auditory effects when the ambient sound exceeds the first virtual character's tolerance threshold includes: When the ambient sound exceeds the tolerance threshold of the first virtual character, interference audio is played. The interference audio is the audio played by the first virtual character in the hearing impairment state, and the audio quality of the interference audio is lower than that of the ambient sound.

5. The method according to claim 4, characterized in that, When the ambient sound exceeds the tolerance threshold of the first virtual character, playing interfering audio includes at least one of the following: If the ambient sound exceeds the tolerance threshold of the first virtual character, the ambient sound is replaced with a first interference audio. The first interference audio is obtained by performing sound effect degradation on the ambient sound. The sound effect degradation method includes at least one of reducing the sampling rate, reducing the audio bit depth, and adding echo. If the ambient sound exceeds the tolerance threshold of the first virtual character, a second interference audio, which is noise audio, is superimposed on the current sound.

6. The method according to any one of claims 1 to 5, characterized in that, The ambient sound includes the sound of the virtual environment at the current moment, and the ambient sound exceeding the tolerance threshold of the first virtual character includes: At the current moment, the instantaneous intensity of the ambient sound exceeds a first threshold.

7. The method according to any one of claims 1 to 5, characterized in that, The ambient sounds include the sounds of the virtual environment at the current moment and at least one historical moment. The ambient sounds exceeding the tolerance threshold of the first virtual character include: The first sum exceeds the second threshold, where the first sum is the sum of the sound intensities of the virtual environment at the current moment and at least one historical moment. Wherein, the sound intensity of the virtual environment at the current moment and at least one historical moment exceeds a third threshold, the third threshold is less than the second threshold, and the duration between each historical moment and the current moment is less than a duration threshold.

8. The method according to claim 7, characterized in that, The second threshold is the difference between the virtual hearing value of the first virtual character at the current moment and the hearing impairment value; the method further includes: If all m differences are not greater than 0, the virtual hearing value at the current moment is determined as the sum of the first historical hearing value and the recovered hearing value, where the first historical hearing value is the virtual hearing value at the first historical moment adjacent to the current moment. The m differences correspond one-to-one with the m information groups. Each of the m information groups includes historical hearing values ​​from two adjacent historical moments. The m information groups are constructed based on historical hearing values ​​from m+1 historical moments. The difference corresponding to each information group is the difference between the historical hearing value from the previous moment and the historical hearing value from the subsequent moment.

9. The method according to any one of claims 1 to 5, characterized in that, Playing ambient sounds at the location of the first virtual character in the virtual environment includes at least one of the following: In response to the virtual shooting prop being in a firing state, a first ambient sound at the location of the first virtual character is played, the first ambient sound including the firing sound effect of the virtual shooting prop; In response to the virtual explosive prop being in a triggered state, a second ambient sound at the location of the first virtual character is played, the second ambient sound including the explosion sound effect of the virtual explosive prop.

10. The method according to claim 9, characterized in that, The ambient sound also includes the virtual activity sound of the virtual character, and the method further includes at least one of the following: In response to a virtual attack on the second virtual character, a third ambient sound is played, which also includes an alarm sound from the second virtual character; In response to the third virtual character being injured, a fourth ambient sound is played, which also includes the third virtual character's cry for help.

11. The method according to claim 9, characterized in that, The ambient sounds include virtual weather sound effects of the virtual environment, and the method further includes: In response to the virtual environment being in a first weather condition, a fifth environmental sound is played, the fifth environmental sound also including the weather sound effects of the first weather condition.

12. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to the first virtual character being equipped with protective gear, if the sound correction exceeds the correction threshold, the first virtual character is presented as being in the state of hearing impairment through visual and / or auditory effects. The protective gear is a wearable item for the first virtual character and / or a virtual accessory for a virtual shooting item. Wherein, the sound intensity of the corrected sound is less than the sound intensity of the ambient sound, and / or, the tolerance threshold exceeds the correction threshold.

13. The method according to claim 12, characterized in that, The method further includes: In response to the first virtual character being equipped with the protective item, obtain the correction coefficient corresponding to the protective item; The sound intensity of the ambient sound is corrected based on the correction coefficient to obtain the sound intensity of the corrected sound; and / or, the tolerance threshold is corrected based on the correction coefficient to obtain the corrected threshold.

14. The method according to any one of claims 1 to 5, characterized in that, The method further includes: If the ambient sound exceeds the first virtual character's tolerance threshold, a prompt icon indicating that the first virtual character is in a state of hearing impairment will be displayed.

15. A human-computer interaction device for virtual characters, characterized in that, The device includes: The display module is used to display the observation screen of the virtual environment; An audio module is used to play ambient sounds at the location of the first virtual character in the virtual environment, including the sounds of using virtual props. The display module is further configured to visually present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold, and / or the audio module is further configured to auditorily present that the first virtual character is in a state of hearing impairment when the ambient sound exceeds the first virtual character's tolerance threshold.

16. A computer device, characterized in that, The computer device includes: a processor and a memory, wherein the memory stores at least one program; the processor is configured to execute the at least one program in the memory to implement the human-computer interaction method for virtual characters as described in any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that, The readable storage medium stores executable instructions, which are loaded and executed by a processor to implement the human-computer interaction method for virtual characters as described in any one of claims 1 to 14.

18. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium. The processor reads and executes the computer instructions from the computer-readable storage medium to implement the human-computer interaction method for virtual characters as described in any one of claims 1 to 14.

Images