Sound effect processing method and apparatus, storage medium, and electronic device

By merging the motor sound source and the external speaker sound source to generate a layered sound effect structure, the problem of low simulation performance of motor sound effects in vehicle simulation games is solved, achieving realistic sound reproduction and resource saving.

CN117244247BActive Publication Date: 2026-08-04NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-29
Publication Date
2026-08-04

AI Technical Summary

Technical Problem

In vehicle simulation driving/racing games, the simulation design performance of electric motor sound effects for electric vehicles and hybrid vehicles is relatively low, leading to increased game development resource costs.

Method used

By merging the motor sound source and external speaker sound source of the virtual mobile vehicle, a vehicle sound source is generated, and its layered sound effect structure is processed to control the vehicle sound source to play the target sound effect.

Benefits of technology

It effectively reproduces the realistic sounds of virtual mobile vehicles, saves game resource consumption, achieves smooth game audio playback, and improves the performance of motor sound source simulation design.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117244247B_ABST
    Figure CN117244247B_ABST
Patent Text Reader

Abstract

This application discloses a sound effect processing method, apparatus, storage medium, and electronic device. The method includes: determining the physical parameters of a virtual mobile vehicle; determining, based on the vehicle type of the virtual mobile vehicle, whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source; and controlling the vehicle sound source to play the target sound effect. This application solves the technical problem of low design performance in simulating the sound effects of virtual mobile vehicles in related technologies.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of sound source simulation, and more specifically, to a sound effect processing method, apparatus, storage medium, and electronic device. Background Technology

[0002] Currently, vehicle simulation / racing games need to achieve the unique sound effects of electric motors in electric and hybrid vehicles. These sound effects need to include the sound of the motor rotating, as well as sounds designed by the designers and emitted through external speakers. The sound of the motor rotating is produced by the rotation of the motor's rotor and shaft. The sound emitted through the external speakers is the "motor sound" played from both inside and outside the vehicle's cabin. In games where multiple vehicles compete simultaneously, equipping each vehicle with external speakers at the front and rear undoubtedly increases the cost of game development, resulting in lower performance in simulating the sound effects of virtual moving vehicles.

[0003] There is currently no effective solution to the above problems. Summary of the Invention

[0004] This disclosure provides at least some embodiments of a sound processing method, apparatus, storage medium, and electronic device to at least address the technical problem of low design performance in simulating sound effects for virtual mobile vehicles in related technologies.

[0005] According to one embodiment of this disclosure, a sound effect processing method is provided. The method includes: determining the physical parameters of a virtual mobile vehicle; determining whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; and controlling the vehicle sound source to play the target sound effect.

[0006] According to one embodiment of this disclosure, a sound effect processing device is also provided, the device comprising: a parameter determination module for determining physical parameters of a virtual mobile vehicle; a sound source determination module for determining whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; a sound effect filtering module for generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source if a vehicle sound source is configured on the virtual mobile vehicle, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; and a sound effect playback module for controlling the vehicle sound source to play the target sound effect.

[0007] According to one embodiment of the present disclosure, a computer-readable storage medium is also provided, which stores a computer program, wherein the computer program is configured to execute the sound effect processing method described above when run by a processor.

[0008] According to one embodiment of this disclosure, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the sound effect processing method described in any of the preceding claims.

[0009] In at least some embodiments of this disclosure, the physical parameters of the virtual mobile vehicle are determined; based on the vehicle type of the virtual mobile vehicle, it is determined whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, a target sound effect corresponding to the physical parameters is generated based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; and the vehicle sound source is controlled to play the target sound effect. It is noteworthy that by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle to obtain the vehicle sound source, and then simplifying the sound emitted by the vehicle sound source into layers to obtain at least one layer of sound effect structure, the physical parameters during the movement of the virtual mobile vehicle can be responded to. This not only effectively restores the real sound of the virtual mobile vehicle, but also significantly saves game resource consumption, allowing the game audio to play smoothly. This achieves the technical effect of improving the design performance of motor sound source simulation, and thus solves the technical problem of low design performance in the simulation of sound effects of virtual mobile vehicles in related technologies. Attached Figure Description

[0010] The accompanying drawings, which are included to provide a further understanding of this disclosure and form part of this application, illustrate exemplary embodiments of this disclosure and are used to explain this disclosure, but do not constitute an undue limitation of this disclosure. In the drawings:

[0011] Figure 1 This is a hardware structure block diagram of a mobile terminal according to an embodiment of the sound effect processing method of the present disclosure;

[0012] Figure 2 This is a flowchart of a sound effect processing method according to one embodiment of the present disclosure;

[0013] Figure 3 This is a schematic diagram of the hierarchical structure division according to one embodiment of the present disclosure;

[0014] Figure 4 This is a schematic diagram illustrating the multi-level division of the rear motor sound source of a vehicle according to one embodiment of the present disclosure;

[0015] Figure 5 This is a schematic diagram illustrating a single-level division of the sound source of the front motor of a vehicle according to one embodiment of the present disclosure;

[0016] Figure 6 This is a schematic diagram of the intermediate level sound effect structure for dividing the rear motor sound source of a vehicle into multiple levels according to one embodiment of the present disclosure.

[0017] Figure 7 This is a schematic diagram illustrating the adjustment of volume at different sound levels by means of motor power according to one embodiment of the present disclosure;

[0018] Figure 8 This is a schematic diagram illustrating the adjustment of low-pass filtering for different sound levels by means of motor power according to one embodiment of the present disclosure;

[0019] Figure 9 This is a schematic diagram illustrating the modulation of sound frequency by vehicle speed according to one embodiment of the present disclosure;

[0020] Figure 10 This is a spectrogram of the sound emitted by the motor and speaker of a vehicle during acceleration according to one embodiment of the present disclosure;

[0021] Figure 11 This is a structural block diagram of a sound effect processing apparatus according to one embodiment of the present disclosure;

[0022] Figure 12 This is a schematic diagram of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0023] To enable those skilled in the art to better understand the present disclosure, the technical solutions of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present disclosure, and not all embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present disclosure.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] In one possible implementation, in the context of sound source simulation, commonly used in vehicle simulation driving / racing games, it is necessary to realize the sound effects unique to the electric motors of electric vehicles and hybrid vehicles. This sound effect needs to include the sound emitted by the motor rotation, as well as the sound designed by the designer and emitted through the vehicle's external speakers. After practical experience and careful research, the inventors still found the technical problem of low design performance in motor sound source simulation. Based on this, this disclosure proposes a sound effect processing method. The technical concept involves merging the motor sound source and the external speaker sound source of a virtual mobile vehicle to obtain a vehicle sound source. Then, the sound emitted by the vehicle sound source is layered and simplified to obtain at least one layer of sound effect structure. This allows for a response to the physical parameters during the movement of the virtual mobile vehicle, effectively restoring the realistic sound of the virtual mobile vehicle and significantly reducing game resource consumption, enabling smooth playback of game audio. This achieves the technical effect of improving the design performance of motor sound source simulation, thereby solving the technical problem of low design performance in simulating the sound effects of virtual mobile vehicles in related technologies.

[0026] The sound effect processing method in one embodiment of this disclosure can run on a local terminal device or a server. When the sound effect processing method runs on a server, the method can be implemented and executed based on a cloud interaction system, wherein the cloud interaction system includes a server and a client device.

[0027] In an optional implementation, various cloud applications, such as cloud gaming, can run under the cloud interaction system. Taking cloud gaming as an example, cloud gaming refers to a gaming method based on cloud computing. In the cloud gaming operating mode, the game program and the game screen presentation are separated. The storage and execution of sound effects processing methods are completed on the cloud gaming server. The client device is used for data reception, transmission, and game screen presentation. For example, the client device can be a display device with data transmission capabilities located close to the user, such as a mobile terminal, television, computer, or PDA; however, the information processing is performed by the cloud gaming server in the cloud. When playing the game, the player operates the client device to send operation commands to the cloud gaming server. The cloud gaming server runs the game according to the operation commands, encodes and compresses game screen data, returns it to the client device via the network, and finally, the client device decodes and outputs the game screen.

[0028] In an alternative implementation, taking a game as an example, the local terminal device stores the game program and is used to display the game screen. The local terminal device is used to interact with the player through a graphical user interface, that is, conventionally downloading, installing, and running the game program via an electronic device. The local terminal device can provide the graphical user interface to the player in various ways, such as rendering it on the terminal's display screen, or providing it to the player through holographic projection.

[0029] For example, the local terminal device may be a mobile terminal, a computer terminal, or a similar computing device, and may include a display screen and a processor. The display screen is used to present a graphical user interface, which includes game graphics, and the processor is used to run the game, generate the graphical user interface, and control the display of the graphical user interface on the display screen.

[0030] Taking a mobile terminal as an example, the mobile terminal can be a smartphone, tablet computer, PDA, mobile internet device, PAD, game console, and other terminal devices. Figure 1 This is a hardware structure block diagram of a mobile terminal for an embodiment of a sound effect processing method according to this disclosure. Figure 1 As shown, a mobile terminal may include one or more ( Figure 1 (Only one is shown in the image) A processor 102 and a memory 104 for storing data. Optionally, the mobile terminal may also include a transmission device 106, an input / output device 108, and a display device 110.

[0031] Those skilled in the art will understand that Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the mobile terminal described above. For example, the mobile terminal may also include components that are more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0032] According to one embodiment of this disclosure, an embodiment of a sound effect processing method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0033] In one possible implementation, this disclosure provides a sound effect processing method. Figure 2 This is a flowchart of a sound effect processing method according to one embodiment of the present disclosure, such as... Figure 2 As shown, the method includes the following steps:

[0034] Step S202: Determine the physical parameters of the virtual mobile vehicle.

[0035] Specifically, the aforementioned virtual mobile vehicle can be used to refer to a mobile vehicle controlled by the player in a game. It can be a virtual vehicle in a vehicle simulation driving game or a virtual vehicle in a racing game. There are no specific limitations on the application scenarios of virtual mobile vehicles. The aforementioned virtual vehicle can be an electric vehicle or a hybrid electric vehicle, but it is not limited to these.

[0036] The physical parameters mentioned above can be used to represent parameters obtained during the control of virtual mobile vehicles, and may include, but are not limited to, one of the following: speed parameters, motor speed parameters, and throttle opening parameters.

[0037] In one alternative embodiment, in a vehicle racing game or other game that includes virtual mobile vehicles, during the process of controlling the movement of the virtual mobile vehicle, it is necessary to determine the physical parameters of the virtual mobile vehicle, such as its speed, motor speed, and throttle opening. Since the sound effect of the sound source of the motor changes accordingly with the vehicle's speed, motor speed, or throttle opening during the movement of the virtual mobile vehicle, it is necessary to further generate the corresponding sound effect by determining the physical parameters of the virtual mobile vehicle.

[0038] In another alternative embodiment, the aforementioned physical parameters such as speed, motor speed, and throttle opening can be obtained by reading game data.

[0039] Step S204: Based on the vehicle type of the virtual mobile vehicle, determine whether the virtual mobile vehicle is equipped with a vehicle sound source, wherein the vehicle sound source is obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle.

[0040] Specifically, the vehicle type mentioned above can be used to represent the drive type of the virtual mobile vehicle, which can be fuel-powered, electric-powered, or hybrid-electric. No specific limitation is made on the vehicle type here.

[0041] It should be noted that different types of virtual mobile vehicles are equipped with different electric motors. For example, fuel-powered virtual mobile vehicles do not have electric motors, while electric-powered virtual mobile vehicles need to be driven by front and rear electric motors. That is, electric-powered virtual mobile vehicles have two electric motors. Therefore, different numbers of vehicle sound sources can be pre-configured for different vehicle types. For example, fuel-powered virtual mobile vehicles do not have electric motors, so there is no need to configure vehicle sound sources for fuel-powered virtual mobile vehicles.

[0042] Furthermore, to further simplify the number of vehicle sound sources, external speakers and coaxial motor sound sources can be combined into a single vehicle sound source configured on the virtual mobile vehicle. For example, for an electrically driven virtual mobile vehicle, which has two motors located on the front and rear axles respectively, the front motor sound source on the front axle can be combined with an external speaker to obtain the front motor sound source, and the rear motor sound source on the rear axle can be combined with an external speaker to obtain the rear motor sound source. In this case, the virtual mobile vehicle has two vehicle sound sources. By combining motor sound sources and external speaker sound sources, the number of sound sources in the game can be reduced, thereby reducing game performance overhead.

[0043] In one optional embodiment, if the virtual mobile vehicle is a fuel-powered type, it is determined that no vehicle sound source is configured on the virtual mobile vehicle; if the virtual mobile vehicle is an electric-powered type, it is determined that a vehicle sound source is configured on the virtual mobile vehicle; if the virtual mobile vehicle is a hybrid electric type, it is determined that a vehicle sound source is configured on the virtual mobile vehicle.

[0044] Step S206: If the virtual mobile vehicle is equipped with a vehicle sound source, a target sound effect corresponding to the physical parameters is generated based on at least one layer of sound effect structure pre-configured for the vehicle sound source. The at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source.

[0045] Specifically, the aforementioned at least one sound effect structure can be used to represent a sound effect structure pre-configured by the user. The user can layer the real sound effects according to actual needs, based on physical parameters such as motor speed or vehicle speed, to obtain at least one sound effect structure. Each layer of the sound effect structure can be divided into multiple timbre segments, or it can be composed of one or more timbre segments as needed. No specific limitation is made here; different timbre segments can be obtained based on physical parameters.

[0046] The aforementioned target sound effects can be used to represent the final sound effects that the vehicle's sound source needs to output.

[0047] It should be noted that real vehicles often produce a lot of sound effects. In order to simulate the sound effects produced by real vehicles and reduce the resource consumption of the game, the sound effects emitted by the motor source and the real sound effects emitted by the external speaker source of the real vehicle can be layered in advance, simplifying a large number of sound effects into at least one layer of sound effect structure.

[0048] For example, Figure 3 This is a schematic diagram illustrating the hierarchical structure division according to one embodiment of this disclosure. For example... Figure 3 As shown, a sound effect sample instance is simplified into four layers: Layer 1 - Motor Layer, Layer 2 - Speaker Layer, Layer 3 - Speaker Layer, and Layer 4 - Speaker Layer. Since the timbre of the sound produced by the motor varies at different motor speeds, the sound in each layer may need to switch between different loop samples depending on the motor speed. For example, Loop 1, Loop 2, and Loop 3 in Layer 1, or Loop 1, Loop 2, and Loop 3 in Layer 2. Meanwhile, the Bass Loop in Layer 3 represents the low-frequency portion of the sound effect sample instance, and the Hiss Loop in Layer 4 represents the noise portion of the sound effect sample instance.

[0049] based on Figure 3 The sound samples for a specific vehicle model are simplified, and loops are differentiated based on engine speed. For example, there could be three loops corresponding to 200Hz, 500Hz, and 1000Hz. Sound designs are created for different engine speeds, and the samples are then integrated into different speed ranges. Different layers of sound are superimposed. The number of layers is determined by the design. For instance, a vehicle model might have both the actual motor sound and the designed speaker sound. Therefore, in implementation, the actual motor sound would be designed on Track 1, and the speaker sound on Tracks 2, 3, and 4. The total sound effect of the vehicle's sound source is achieved by superimposing these four layers of sound.

[0050] In addition, in actual use, the selection will be flexible according to the situation, as long as the total number of tracks is controlled below 3. During implementation, the layering and organizational structure may be chosen based on the actual listening experience of the vehicle. For example, if the sound of a vehicle's actual motor is not obvious, the layered structure of the actual motor can be ignored (deleted) during the design, and only the layered structure of the speakers can be implemented; if a good listening effect can be achieved with a 3-layer structure instead of a 4-layer structure, it is not necessarily necessary to pile up 4 layers; the choice of whether to use a single loop or multiple loops in a certain layer is also flexible and depends on the design.

[0051] For example, since the game's main perspective is a rear-end view, in order to save resources during the game development process, only one layer of sound effect structure is configured for the front motor of the virtual mobile vehicle, while multiple layers of sound effect structure are configured for the rear motor of the virtual mobile vehicle. Figure 4 This is a schematic diagram illustrating the multi-level division of the rear motor sound source of a vehicle according to one embodiment of the present disclosure. Figure 5 This is a schematic diagram illustrating a single-level division of the sound source of the front motor of a vehicle according to one embodiment of this disclosure. For example... Figure 4 As shown, a three-layer sound effect structure is configured for the rear motor sound source of the virtual mobile vehicle, including a low-frequency Bass sound effect structure, a mid-frequency Hi sound effect structure, and a high-frequency Lo sound effect structure. Figure 5 As shown, a sound effect structure is configured for the front motor of the virtual mobile vehicle.

[0052] Step S208: Control the vehicle's sound source to play the target sound effect.

[0053] Specifically, after generating the target sound effect, the vehicle sound source can be controlled to play the target sound effect.

[0054] In summary, a graphical user interface (GUI) is provided via a terminal device. The GUI displays at least a portion of a virtual scene and at least one virtual mobile vehicle. The method includes: if a control command is executed on the virtual mobile vehicle, determining the physical parameters of the virtual mobile vehicle; based on the vehicle type of the virtual mobile vehicle, determining whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source; and controlling the vehicle sound source to play the target sound effect. It is noteworthy that by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle to obtain the vehicle sound source, and then simplifying the sound emitted by the vehicle sound source into layers to obtain at least one layer of sound effect structure, the physical parameters during the movement of the virtual mobile vehicle can be responded to. This not only effectively restores the real sound of the virtual mobile vehicle, but also significantly saves game resource consumption, enabling smooth playback of game audio. This achieves the technical effect of improving the design performance of motor sound source simulation, thereby solving the technical problem of low design performance of motor sound source simulation in related technologies.

[0055] Optionally, based on at least one layer of sound effect structure pre-configured for the vehicle sound source, a target sound effect corresponding to the physical parameters is generated, including: generating an initial timbre corresponding to the physical parameters based on any one layer of sound effect structure in the at least one layer of sound effect structure; and generating a target sound effect based on the initial timbre corresponding to the at least one layer of sound effect structure.

[0056] Specifically, the initial timbre mentioned above can be used to represent one or more loop timbres pre-divided in the sound effect structure.

[0057] In one optional embodiment, an initial timbre corresponding to any layer of sound effect structure can be generated based on the real-time physical parameters of the virtual mobile vehicle. The physical parameters here can be the motor speed or the speed of the virtual mobile vehicle; in this disclosure, the speed of the virtual mobile vehicle is used as an example. Then, based on the initial timbre corresponding to any layer of sound effect structure, a target sound effect corresponding to at least one layer of sound effect structure is generated.

[0058] Optionally, based on any one layer of sound effect structure in at least one layer of sound effect results, an initial timbre corresponding to the physical parameters is generated, including: determining the target timbre corresponding to the physical parameters from any one layer of sound effect structure; if the target timbre is a single timbre, determining the target timbre as the initial timbre; if the target timbre is multiple timbres, determining the mixing ratio of the target timbre from any one layer of sound effect structure, and mixing the target timbres according to the mixing ratio to obtain the initial timbre.

[0059] Specifically, the target timbre mentioned above can be used to represent one or more loop timbres that the user has pre-divided for any layer of sound effect structure.

[0060] It should be noted that, in order to ensure that the simulated sound effects are closer to real sound effects, different timbres can be mixed, and users can set the mixing ratio of different target timbres in advance.

[0061] In one optional embodiment, during the process of generating the initial timbre corresponding to the physical parameters based on any one layer of sound effect structure in at least one layer of sound effect results, the target timbre corresponding to the physical parameters can be determined from any pre-configured layer of sound effect structure, and the corresponding initial timbre can be determined based on the number of target timbres. If the target timbre is a single timbre, it can be directly determined as the initial timbre; if the target timbre is multiple timbres, it is necessary to read the mixing ratio of the multiple timbres pre-configured by the user, and mix the target timbres based on the mixing ratio to obtain the initial timbre.

[0062] For example, such as Figure 4 As shown, by separately scheduling the sound effect structure names of each part, corresponding initial timbres can be generated. Each level can be divided into multiple loop timbres based on different motor speeds, allowing for a more continuous timbre transition when the sound switches between different speeds; for example... Figure 5 As shown, this layer of sound effect structure contains two loop timbres. Different loop timbres are represented by a curve; the horizontal axis represents different vehicle speeds, the vertical axis represents the mixing ratio of the timbres, and the intersection of the two curves represents the intersection area between the loops, corresponding to... Figure 3 The region between Loop1 and Loop2, or the region between Loop2 and Loop3.

[0063] Figure 6 This is a schematic diagram of the intermediate level sound effect structure for multi-level division of the rear motor sound source of a vehicle according to one embodiment of this disclosure. Figure 6 As shown, this sound effect structure contains two loop timbres. If there is only one timbre, the mixing ratio of that timbre is 100%, meaning the target timbre is directly determined as the initial timbre. If there are two timbres, the mixing ratio of the two timbres can be determined based on physical parameters. For example, as... Figure 6 As shown, at a speed of 15, the two curves have a first intersection point, and the corresponding timbre values ​​are both 50%. Therefore, the mixing ratio of the two target timbres can be determined as 1:1, and the two target timbres can be mixed to obtain the initial timbre.

[0064] Optionally, generating a target sound effect based on the initial timbre corresponding to at least one sound effect structure includes: if a first sound effect structure is pre-configured for the vehicle sound source, determining the initial timbre corresponding to the first sound effect structure as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, superimposing the initial timbre corresponding to the multiple second sound effect structures to obtain the target sound effect.

[0065] Specifically, the aforementioned first sound effect structure can be used to represent a layer of sound effect structure pre-configured for the vehicle's sound source.

[0066] The aforementioned second sound effect structure can be used to represent a multi-layer sound effect structure pre-configured for the vehicle's sound source. The second sound effect structure may be the same as or different from the first sound effect structure. Here, the first sound effect structure and the second sound effect structure are distinguished only based on the difference in the number of configurations.

[0067] In one optional embodiment, if the user has pre-configured only one sound effect structure for the vehicle sound source, the timbre corresponding to that layer of sound effect structure can be directly determined as the initial timbre; if the user has pre-configured multiple sound effect structures for the vehicle sound source, since there is only one target sound effect, the multiple initial timbres corresponding to the multiple layers of sound effect structures can be superimposed to obtain the target sound effect described above.

[0068] Optionally, generating a target sound effect based on an initial timbre corresponding to at least one layer of sound effect structure includes: determining adjustment parameters corresponding to physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain the target timbre; and obtaining the target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0069] Specifically, the aforementioned adjustment parameters can be used to represent parameters for adjusting different layers of sound effect structure, including but not limited to volume parameters, audio parameters, and low-pass filter parameters.

[0070] Generally, the sound of a real electric motor is different when it is under load (pedal pressed) and when it is rotating due to inertia (pedal released); the sound of an artistically designed electric motor will also vary depending on changes in multiple physical quantities such as power and load. In order to simulate this change, the volume of different sound levels and low-pass wave effects are adjusted based on the physical parameters of the electric motor power calculated in the game.

[0071] Figure 7This is a schematic diagram illustrating the adjustment of volume at different sound levels by means of motor power according to one embodiment of this disclosure. Figure 7 As shown, this is a line graph showing how the volume of different sound levels changes with the motor power value. When the motor power gradually increases from 0 to approximately 1.1, the volume is gradually increased back to 0. When the motor power gradually increases from 1.1, the corresponding volume value remains unchanged at 0.

[0072] Figure 8 This is a schematic diagram illustrating the adjustment of low-pass filtering for different sound levels by means of motor power, according to one embodiment of this disclosure. Figure 8 As shown, the graph shows the changes in low-pass filter parameters at different sound levels as the motor power value changes. When the motor power gradually increases from 0 to approximately 1.1, the low-pass filter parameter decreases from 45 to 0. When the motor power gradually increases from 1.1, the corresponding low-pass filter parameter remains unchanged at 0.

[0073] Optionally, determining the adjustment parameters corresponding to the physical parameters from any layer of sound effect structure includes: obtaining at least one adjustment curve from any layer of sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining the target curve corresponding to the physical parameters from at least one adjustment curve; and reading the adjustment parameters corresponding to the physical parameters from the target curve.

[0074] Specifically, at least one of the aforementioned adjustment curves can be used to represent the curve corresponding to the adjustment parameters pre-configured for any layer of sound effect structure, and different adjustment curves can be adjusted based on different physical parameters.

[0075] In one optional embodiment, at least one adjustment curve in any layer of sound effect structure can be obtained, wherein different adjustment curves represent the correspondence between physical parameters and adjustment parameter values. By determining the target curve corresponding to the physical parameter from at least one adjustment curve, the adjustment parameter corresponding to the physical parameter can be determined based on the target curve, and then the initial timbre can be adjusted based on the adjustment parameter.

[0076] Figure 9 This is a schematic diagram illustrating the modulation of sound frequency by vehicle speed according to one embodiment of this disclosure. Figure 9 As shown, this includes five adjustment curves within any single sound effect layer: the curve showing the relationship between motor power and low-pass filter parameters, the curve showing the relationship between motor power and audio parameters, the curve showing the relationship between vehicle speed and audio parameters, the curve showing the relationship between motor power and volume parameters, and the curve showing the relationship between vehicle speed and volume parameters. For example... Figure 9The diagram illustrates the adjustment curve relating vehicle speed to audio parameters. By marking this adjustment curve as the target curve, the adjustment parameter corresponding to the physical parameter can be determined. For example, if the vehicle speed value corresponding to the physical parameter is 200, the corresponding audio parameter value is approximately 500, and the audio parameter is then adjusted based on this value.

[0077] It's important to note that the frequency of the sound increases with vehicle speed, and the volume curves for different layers will differ. Some layers may emphasize low-speed performance, while others may emphasize high-speed performance; therefore, the specific curve depends on the sound design requirements. In addition, physical parameters such as motor power and vehicle speed can be adjusted sequentially to obtain the corresponding target curves, thereby determining the adjustment parameters for those physical parameters.

[0078] Optionally, the method further includes: obtaining the real sound effects of the real mobile vehicle corresponding to the virtual mobile vehicle; determining the sound effect characteristics of the real sound effects; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effects.

[0079] Specifically, the aforementioned realistic sound effects can be used to represent the sound effects emitted by a real moving vehicle during its movement.

[0080] The aforementioned sound effect characteristics can be used to represent the characteristics of realistic sound effects, including but not limited to volume, audio, and other characteristics.

[0081] In one optional embodiment, during the process of configuring the sound effect structure for the vehicle sound source, the real sound effect of the real mobile vehicle corresponding to the virtual mobile vehicle can be obtained, and then the volume, audio and other characteristics of the real sound effect can be analyzed to obtain the sound effect characteristics of the real sound effect, so that at least one layer of sound effect structure can be configured for the vehicle sound source based on the sound effect characteristics and the real sound effect.

[0082] Figure 10 This is a spectrogram of the sound emitted by the motor and speaker of a vehicle during acceleration, according to one embodiment of this disclosure. Figure 10 As shown, based on the actual sound characteristics of the vehicle, the sound is divided into layers. Based on the energy distribution characteristics observed in the spectrogram, the sound is broken down into three parts: the lowest bass frequency (marked ①), a mid-frequency sine wave (marked ②), and three high-frequency overtone curves that form harmonic relationships (marked ③). Therefore, the sound effect of the car's electric motor can be well reproduced using these three layers of sound samples.

[0083] Optionally, the sound characteristics of the real sound effects are determined, including: constructing a spectrogram of the real sound effects; and determining the energy distribution characteristics in the spectrogram as the sound characteristics.

[0084] Specifically, such as Figure 10 As shown, the multiple curves constitute the spectrogram of the actual sound effect. Because the energy distribution characteristics of these curves differ, the actual sound characteristics of the vehicle can be hierarchically divided according to the different frequencies corresponding to these different energy distribution characteristics. Figure 10 The three layers of sound effect samples were used to determine the sound effect characteristics corresponding to each layer of sound effect samples.

[0085] Optionally, based on the characteristics of the sound effects, at least one layer of sound effect structure is configured for the vehicle sound source, including: if the vehicle sound source is located on the front wheel connecting axle of the virtual mobile vehicle, an audio structure is configured for the vehicle sound source based on the real sound effects; if the vehicle sound source is located on the rear wheel connecting axle of the virtual mobile vehicle, the real sound effects are hierarchically divided based on the characteristics of the real sound effects, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structure contain different timbres.

[0086] Specifically, since the game's main perspective is a rear-end collision view, it's more reasonable to omit the front motor, which is farther from the camera lens. If the vehicle's sound source is located on the front wheel axle of the virtual moving vehicle, then only one layer of audio structure needs to be configured for the vehicle's sound source based on realistic sound effects. If the vehicle's sound source is located on the rear wheel axle of the virtual moving vehicle, thus satisfying the rear-end collision view in the game, then the realistic sound effects need to be layered based on their characteristics, and multiple layers of audio structure need to be configured for the vehicle's sound source to ensure better reproduction of realistic sound effects and enhance the user's gaming experience.

[0087] Optionally, based on the vehicle type of the virtual mobile vehicle, determining whether the virtual mobile vehicle is equipped with a vehicle sound source includes: if the vehicle type is a fuel vehicle, determining that the virtual mobile vehicle is not equipped with a vehicle sound source; if the vehicle type is a hybrid vehicle, determining that the virtual mobile vehicle is equipped with one vehicle sound source, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determining that the virtual mobile vehicle is equipped with two vehicle sound sources, wherein the two vehicle sound sources are located on the front axle and the rear axle of the virtual mobile vehicle, respectively.

[0088] Specifically, if the vehicle type is a fuel-powered vehicle, since there is no electric motor module on the vehicle, it is determined that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, only one sound source (rear motor sound source) is usually configured, because hybrid vehicles have an engine unit, and the electric motor is relatively less important, which can further save resources; if the vehicle type is an electric vehicle, two electric motor sound sources will be configured, one at the front axle and one at the rear axle, respectively. For example, the front motor sound source faces forward and the rear motor sound source faces backward.

[0089] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this disclosure.

[0090] This embodiment also provides a sound effect processing device for implementing the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0091] Figure 11 This is a structural block diagram of a sound effect processing apparatus according to one embodiment of the present disclosure, such as... Figure 11 As shown, the device includes:

[0092] The parameter determination module 1102 is used to determine the physical parameters of the virtual mobile vehicle;

[0093] The sound source determination module 1104 is used to determine whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle. The vehicle sound source is obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle.

[0094] The sound effect filtering module 1106 is used to generate target sound effects corresponding to physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source if the virtual mobile vehicle is equipped with a vehicle sound source. The at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source.

[0095] The sound effect playback module 1108 is used to control the vehicle's sound source to play the target sound effect.

[0096] Optionally, the sound effect filtering module 1106 includes: an initial timbre generation module, used to generate a target timbre corresponding to physical parameters based on any one layer of sound effect structure in at least one layer of sound effect structure; and a target sound effect generation module, used to generate a target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0097] Optionally, the initial timbre generation module includes: a target timbre determination module, used to determine the original timbre corresponding to the physical parameters from any layer of sound effect structure; a first initial timbre determination module, used to determine the original timbre as the target timbre if the original timbre is a single timbre; and a second initial timbre determination module, used to determine the mixing ratio of the original timbre from any layer of sound effect structure if the original timbre is multiple timbres, and to mix the original timbres according to the mixing ratio to obtain the target timbre.

[0098] Optionally, the target sound effect generation module includes: a first target sound effect determination module, used to determine the target timbre corresponding to the first sound effect structure as the target sound effect if a first sound effect structure is configured in advance for the vehicle sound source; and a second target sound effect determination module, used to superimpose the target timbre corresponding to the multiple second sound effect structures to obtain the target sound effect if multiple second sound effect structures are configured in advance for the vehicle sound source.

[0099] Optionally, the target sound effect generation module further includes: an adjustment parameter determination module, used to determine the adjustment parameters corresponding to the physical parameters from any layer of sound effect structure; a target timbre acquisition module, used to adjust the target timbre based on the adjustment parameters to obtain the adjusted timbre; and a target sound effect acquisition module, used to obtain the target sound effect based on the adjusted timbre corresponding to at least one layer of sound effect structure.

[0100] Optionally, the adjustment parameter determination module includes: an adjustment curve acquisition module, used to acquire at least one adjustment curve in any layer of sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; a target curve determination module, used to determine the target curve corresponding to the physical parameter from at least one adjustment curve; and an adjustment parameter reading module, used to read the adjustment parameter corresponding to the physical parameter from the target curve.

[0101] Optionally, the device further includes: a real sound effect acquisition module for acquiring the real sound effect of the real mobile vehicle corresponding to the virtual mobile vehicle; a sound effect characteristic determination module for determining the sound effect characteristics of the real sound effect; and a sound effect structure configuration module for configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effect.

[0102] Optionally, the sound effect characteristic determination module includes: a spectrogram construction module for constructing a spectrogram of a realistic sound effect; and a sound effect characteristic determination module for determining the energy distribution characteristics in the spectrogram as sound effect characteristics.

[0103] Optionally, the sound effect structure configuration module includes: a first configuration module, used to configure an audio structure for the vehicle sound source based on real sound effects if the vehicle sound source is located on the front wheel connecting axle of the virtual mobile vehicle; and a second configuration module, used to divide the real sound effects into layers based on the sound effect characteristics of the real sound effects if the vehicle sound source is located on the rear wheel connecting axle of the virtual mobile vehicle, and configure a multi-layer audio structure for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0104] Optionally, the sound source determination module includes: a first determination module, configured to determine that if the vehicle type is a fuel-powered vehicle, no vehicle sound source is configured on the virtual mobile vehicle; a second determination module, configured to determine that if the vehicle type is a hybrid vehicle, one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; and a third determination module, configured to determine that if the vehicle type is an electric vehicle, two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are located on the front axle and the rear axle of the virtual mobile vehicle, respectively.

[0105] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0106] Embodiments of this disclosure also provide a computer-readable storage medium storing a computer program configured to perform the steps in any of the above method embodiments when executed.

[0107] Optionally, in this embodiment, the computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0108] Optionally, in this embodiment, the computer-readable storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.

[0109] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0110] S1, determine the physical parameters of the virtual mobile vehicle;

[0111] S2, based on the vehicle type of the virtual mobile vehicle, determine whether the virtual mobile vehicle is equipped with a vehicle sound source, wherein the vehicle sound source is obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle.

[0112] S3, if the virtual mobile vehicle is equipped with a vehicle sound source, generate the target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source.

[0113] S4 controls the vehicle's sound source to play the target sound effect.

[0114] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: generating an initial timbre corresponding to physical parameters based on any one of the at least one sound effect structure; and generating a target sound effect based on the initial timbre corresponding to at least one sound effect structure.

[0115] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: determining the target timbre corresponding to the physical parameters from any layer of sound effect structure; if the target timbre is a single timbre, determining the target timbre as the initial timbre; if the target timbre is multiple timbres, determining the mixing ratio of the target timbre from any layer of sound effect structure, and mixing the target timbres according to the mixing ratio to obtain the initial timbre.

[0116] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: if a first sound effect structure is pre-configured for the vehicle sound source, the initial timbre corresponding to the first sound effect structure is determined as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, the initial timbre corresponding to the multiple second sound effect structures is superimposed to obtain the target sound effect.

[0117] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: determining adjustment parameters corresponding to physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain a target timbre; and obtaining a target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0118] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: obtaining at least one adjustment curve in any layer of sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining the target curve corresponding to the physical parameter from the at least one adjustment curve; and reading the adjustment parameter corresponding to the physical parameter from the target curve.

[0119] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: obtaining the real sound effects of the real mobile vehicle corresponding to the virtual mobile vehicle; determining the sound effect characteristics of the real sound effects; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effects.

[0120] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: constructing a spectrogram of realistic sound effects; determining the energy distribution characteristics in the spectrogram as sound effect characteristics.

[0121] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: if the vehicle sound source is located on the front wheel connecting axle of the virtual mobile vehicle, configure an audio structure for the vehicle sound source based on the real sound effects; if the vehicle sound source is located on the rear wheel connecting axle of the virtual mobile vehicle, divide the real sound effects into layers based on the sound effect characteristics of the real sound effects, and configure a multi-layer audio structure for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0122] Optionally, the aforementioned computer-readable storage medium is further configured to store program code for performing the following steps: if the vehicle type is a fuel-powered vehicle, determine that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, determine that one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determine that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are located on the front axle and the rear axle of the virtual mobile vehicle, respectively.

[0123] In the computer-readable storage medium of this embodiment, a sound effect processing method is provided. By merging the motor sound source and the external speaker sound source of a virtual mobile vehicle to obtain a vehicle sound source, the sound emitted by the vehicle sound source is then layered and simplified to obtain at least one layer of sound effect structure. This enables the response to the physical parameters during the movement of the virtual mobile vehicle. It can not only effectively restore the real sound of the virtual mobile vehicle, but also significantly save game resource consumption, enabling smooth playback of game audio. This achieves the technical effect of improving the design performance of motor sound source simulation, thereby solving the technical problem of low design performance in the simulation of sound effects of virtual mobile vehicles in related technologies.

[0124] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0125] In exemplary embodiments of this application, a computer-readable storage medium stores a program product capable of implementing the methods described above in this embodiment. In some possible implementations, various aspects of the embodiments of this disclosure may also be implemented as a program product including program code, which, when the program product is run on a terminal device, causes the terminal device to perform the steps according to various exemplary embodiments of this disclosure described in the "Exemplary Methods" section above.

[0126] The program product for implementing the above-described method according to embodiments of the present disclosure may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on a terminal device, such as a personal computer. However, the program product of the embodiments of the present disclosure is not limited thereto. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0127] The aforementioned program product may take the form of any combination of one or more computer-readable media. Such computer-readable storage media may be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples (not exhaustive) of computer-readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0128] It should be noted that the program code contained on the computer-readable storage medium can be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0129] Embodiments of this disclosure also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0130] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0131] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0132] S1, determine the physical parameters of the virtual mobile vehicle;

[0133] S2, based on the vehicle type of the virtual mobile vehicle, determine whether the virtual mobile vehicle is equipped with a vehicle sound source, wherein the vehicle sound source is obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle.

[0134] S3, if the virtual mobile vehicle is equipped with a vehicle sound source, generate the target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source.

[0135] S4 controls the vehicle's sound source to play the target sound effect.

[0136] Optionally, the processor may also be configured to perform the following steps via a computer program: generating an initial timbre corresponding to physical parameters based on any one layer of the sound effect structure in at least one layer of the sound effect structure; and generating a target sound effect based on the initial timbre corresponding to at least one layer of the sound effect structure.

[0137] Optionally, the processor may also be configured to perform the following steps via a computer program: determine the target timbre corresponding to the physical parameters from any layer of sound effect structure; if the target timbre is a single timbre, determine the target timbre as the initial timbre; if the target timbre is multiple timbres, determine the mixing ratio of the target timbre from any layer of sound effect structure, and mix the target timbres according to the mixing ratio to obtain the initial timbre.

[0138] Optionally, the processor may also be configured to perform the following steps via a computer program: if a first sound effect structure is pre-configured for the vehicle sound source, the initial timbre corresponding to the first sound effect structure is determined as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, the initial timbre corresponding to the multiple second sound effect structures is superimposed to obtain the target sound effect.

[0139] Optionally, the processor may also be configured to perform the following steps via a computer program: determining the adjustment parameters corresponding to the physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain the target timbre; and obtaining the target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0140] Optionally, the processor may also be configured to perform the following steps via a computer program: acquiring at least one adjustment curve in any layer of sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining the target curve corresponding to the physical parameter from at least one adjustment curve; and reading the adjustment parameter corresponding to the physical parameter from the target curve.

[0141] Optionally, the processor may also be configured to perform the following steps via a computer program: acquiring the real sound effects of the real mobile vehicle corresponding to the virtual mobile vehicle; determining the sound effect characteristics of the real sound effects; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effects.

[0142] Optionally, the processor described above can also be configured to perform the following steps via a computer program: constructing a spectrogram of realistic sound effects; and determining the energy distribution characteristics in the spectrogram as sound effect characteristics.

[0143] Optionally, the processor can also be configured to perform the following steps via a computer program: if the vehicle sound source is located on the front wheel connecting axle of the virtual mobile vehicle, configure an audio structure for the vehicle sound source based on the real sound effects; if the vehicle sound source is located on the rear wheel connecting axle of the virtual mobile vehicle, divide the real sound effects into layers based on the sound effect characteristics of the real sound effects, and configure a multi-layer audio structure for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0144] Optionally, the processor may also be configured to perform the following steps via a computer program: if the vehicle type is a fuel-powered vehicle, determine that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, determine that one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determine that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are located on the front axle and the rear axle of the virtual mobile vehicle, respectively.

[0145] In the electronic device of this embodiment, a sound effect processing method is provided. By merging the motor sound source and the external speaker sound source of a virtual mobile vehicle to obtain a vehicle sound source, the sound emitted by the vehicle sound source is then layered and simplified to obtain at least one layer of sound effect structure. This enables the response to the physical parameters during the movement of the virtual mobile vehicle. It can not only effectively restore the real sound of the virtual mobile vehicle, but also significantly save game resource consumption, enabling smooth playback of game audio. This achieves the technical effect of improving the design performance of motor sound source simulation, thereby solving the technical problem of low design performance in simulating the sound effects of virtual mobile vehicles in related technologies.

[0146] Figure 12 This is a schematic diagram of an electronic device according to an embodiment of the present disclosure. Figure 12 As shown, the electronic device 1200 is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0147] like Figure 12 As shown, the electronic device 1200 is presented in the form of a general-purpose computing device. The components of the electronic device 1200 may include, but are not limited to: at least one processor 1210, at least one memory 1220, a bus 1210 connecting different system components (including memory 1220 and processor 1210), and a display 1240.

[0148] The memory 1220 stores program code that can be executed by the processor 1210, causing the processor 1210 to perform the steps described in the method section of the embodiments of this application according to various exemplary implementations of this disclosure.

[0149] The memory 1220 may include a readable medium in the form of volatile memory cells, such as random access memory (RAM) 12201 and / or cache memory 12202, and may further include read-only memory (ROM) 12203, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.

[0150] In some instances, memory 1220 may also include programs / utilities 12204 having a set (at least one) of program modules 12205, including but not limited to: an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Memory 1220 may further include memory remotely located relative to processor 1210, which can be connected to electronic device 1200 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0151] Bus 1210 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, peripheral bus, graphics acceleration port, processor 1210, or a local bus using any of the various bus structures.

[0152] The display 1240 may be, for example, a touch screen liquid crystal display (LCD) that allows a user to interact with the user interface of the electronic device 1200.

[0153] Optionally, the electronic device 1200 can also communicate with one or more external devices 1300 (e.g., keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 1200, and / or any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via the input / output (I / O) interface 1250. Furthermore, the electronic device 1200 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via the network adapter 1260. Figure 12 As shown, network adapter 1260 communicates with other modules of electronic device 1200 via bus 1210. It should be understood that, although... Figure 12 As not shown, other hardware and / or software modules may be used in conjunction with electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0154] The aforementioned electronic device 1200 may further include: a keyboard, a cursor control device (such as a mouse), an input / output interface (I / O interface), a network interface, a power supply, and / or a camera.

[0155] Those skilled in the art will understand that Figure 12The structure shown is for illustrative purposes only and does not limit the structure of the electronic device described above. For example, the electronic device 1200 may also include components that are more... Figure 12 The more or fewer components shown, or having the same Figure 1 Different configurations are shown. The memory 1220 can be used to store computer programs and corresponding data, such as the computer program and corresponding data corresponding to the sound effect processing method in this embodiment. The processor 1210 executes various functional applications and data processing by running the computer program stored in the memory 1220, thereby implementing the aforementioned sound effect processing method.

[0156] In the above embodiments of this disclosure, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0157] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0158] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0159] Furthermore, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0160] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0161] The above description is only a preferred embodiment of this disclosure. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principles of this disclosure, and these improvements and modifications should also be considered within the scope of protection of this disclosure.

Claims

1. An audio processing method, characterized by, include: Determine the physical parameters of the virtual mobile vehicle; Based on the vehicle type of the virtual mobile vehicle, it is determined whether the virtual mobile vehicle is equipped with a vehicle sound source, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle. If the virtual mobile vehicle is equipped with the vehicle sound source, the target sound effect corresponding to the physical parameters is generated based on at least one layer of sound effect structure pre-configured for the vehicle sound source. The at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source. Control the vehicle's sound source to play the target sound effect.

2. The method of claim 1, wherein, Based on at least one layer of sound effect structure pre-configured for the vehicle's sound source, the target sound effect corresponding to the physical parameters is generated, including: Based on any one of the at least one sound effect structure, generate the target timbre corresponding to the physical parameters; The target sound effect is generated based on the target timbre corresponding to the at least one layer of sound effect structure.

3. The method of claim 2, wherein, Based on any one layer of the at least one sound effect structure, generating the target timbre corresponding to the physical parameters includes: From any one of the sound effect structures, determine the original timbre corresponding to the physical parameters; If the original timbre is a single timbre, then the original timbre is determined to be the target timbre; If the original timbre consists of multiple timbres, the mixing ratio of the original timbres is determined from any layer of the sound effect structure, and the original timbres are mixed according to the mixing ratio to obtain the target timbre.

4. The method of claim 2, wherein, Based on the target timbre corresponding to the at least one layer of sound effect structure, the target sound effect is generated, including: If a first sound effect structure is pre-configured for the vehicle sound source, the target timbre corresponding to the first sound effect structure is determined to be the target sound effect; If multiple second sound effect structures are pre-configured for the vehicle sound source, the target timbre corresponding to the multiple second sound effect structures is superimposed to obtain the target sound effect.

5. The method of claim 2, wherein, Based on the target timbre corresponding to the at least one layer of sound effect structure, the target sound effect is generated, including: From any one of the sound effect layers, determine the adjustment parameters corresponding to the physical parameters; The target timbre is adjusted based on the adjustment parameters to obtain the adjusted timbre; The target sound effect is obtained based on the adjusted timbre corresponding to the at least one layer of sound effect structure.

6. The method of claim 5, wherein, From any layer of the sound effect structure, determine the adjustment parameters corresponding to the physical parameters, including: Obtain at least one adjustment curve from any layer of the sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; Determine the target curve corresponding to the physical parameter from the at least one adjustment curve; The adjustment parameters corresponding to the physical parameters are read from the target curve.

7. The method of claim 1, wherein, The method further includes: Obtain the authentic sound effects of the real mobile vehicle corresponding to the virtual mobile vehicle; Determine the sound characteristics of the actual sound effects; Based on the sound effect characteristics and the real sound effect, at least one layer of sound effect structure is configured for the vehicle sound source.

8. The method of claim 7, wherein, Determining the sound effect characteristics of the real sound effect includes: Construct the spectrogram of the real sound effect; The energy distribution characteristics in the spectrogram are defined as the sound effect characteristics.

9. The method of claim 7, wherein, Based on the aforementioned sound effect characteristics, the vehicle sound source is configured with at least one layer of sound effect structure, including: If the vehicle sound source is located on the front wheel connecting axle of the virtual mobile vehicle, an audio structure is configured for the vehicle sound source based on the real sound effect; If the vehicle sound source is located on the rear wheel connecting axle of the virtual mobile vehicle, the real sound effect is divided into layers based on the sound effect characteristics of the real sound effect, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structure contain different timbres.

10. The method of claim 1, wherein, Based on the vehicle type of the virtual mobile vehicle, determining whether the virtual mobile vehicle is equipped with a vehicle sound source includes: If the vehicle type is a fuel vehicle, it is determined that the virtual mobile vehicle is not equipped with the vehicle sound source. If the vehicle type is a hybrid vehicle, it is determined that a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; If the vehicle type is an electric vehicle, it is determined that the virtual mobile vehicle is equipped with two vehicle sound sources, wherein the two vehicle sound sources are located on the front axle and the rear axle of the virtual mobile vehicle, respectively.

11. An audio processing apparatus, characterized by comprising: include: The parameter determination module is used to determine the physical parameters of the virtual mobile vehicle; The sound source determination module is used to determine whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle. The sound effect filtering module is used to generate a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source if the virtual mobile vehicle is equipped with the vehicle sound source. The at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source. The sound effect playback module is used to control the vehicle's sound source to play the target sound effect.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the method described in any one of claims 1 to 10 when run by a processor. 13.An electronic device comprising a memory and a processor, the electronic device characterized by, The memory stores a computer program, and the processor is configured to run the computer program to perform the method as described in any one of claims 1 to 10.