Sound effect processing method and apparatus, and storage medium and electronic apparatus

Abstract

A sound effect processing method, comprising: determining a physical parameter of a virtual mobile carrier; on the basis of the carrier type of the virtual mobile carrier, determining whether a carrier sound source is provided on the virtual mobile carrier, wherein the carrier sound source is a sound source obtained by combining an electric motor sound source of the virtual mobile carrier and an external loudspeaker sound source; if a carrier sound source is provided on the virtual mobile carrier, on the basis of at least one layer of sound effect structure pre-configured for the carrier sound source, generating a target sound effect corresponding to the physical parameter; and controlling the carrier sound source to play the target sound effect.

Description

Sound effect processing method, device, storage medium and electronic device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application number 202311101202.0, filed on August 29, 2023, entitled “Sound Effect Processing Method, Device, Storage Medium and Electronic Device”, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to the field of sound source simulation, and in particular to a sound effect processing method, a sound effect processing device, a storage medium, and an electronic device. Background Art

[0004] Currently, vehicle driving / racing simulation games require the implementation of sound effects unique to the electric motors of electric and hybrid vehicles. This sound effect must include the sound produced by the motor's rotation, as well as designer-designed sounds produced through the vehicle's external speakers. The motor's rotational sound is produced by the rotation of the motor's rotor and shaft, while the sound produced through the vehicle's external speakers is the "motor sound" played through the vehicle's cabin and external speakers. In a game with multiple vehicles competing simultaneously, equipping each vehicle with external speakers at the front and rear undoubtedly increases game development costs, resulting in lower performance in simulating and designing sound effects for virtual moving vehicles.

[0005] To address the above-mentioned problems, no effective solutions have been proposed so far.

[0006] Summary of the Invention

[0007] At least some embodiments of the present disclosure provide a sound effect processing method, device, storage medium and electronic device to at least solve the technical problem of low design performance for simulating sound effects of virtual mobile vehicles in related technologies.

[0008] A first aspect of an embodiment of the present disclosure provides a sound effect processing method, the method comprising: determining physical parameters of a virtual mobile vehicle; determining whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source; and controlling the vehicle sound source to play the target sound effect.

[0009] The second aspect of the embodiments of the present disclosure also provides a sound effect processing device, which includes: a parameter determination module, configured to determine the physical parameters of a virtual mobile vehicle; a sound source determination module, configured to determine whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; a sound effect screening module, configured to generate a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source if a vehicle sound source is configured on the virtual mobile vehicle, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source; and a sound effect playing module, configured to control the vehicle sound source to play the target sound effect.

[0010] A third aspect of the embodiments of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute any of the above-mentioned sound effect processing methods when executed by a processor.

[0011] A fourth aspect of the embodiments of the present disclosure further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any of the above-mentioned sound effect processing methods.

[0012] The sound effect processing method, sound effect processing device, storage medium and electronic device provided by the embodiments of the present disclosure determine the physical parameters of a virtual mobile vehicle; based on the vehicle type of the virtual mobile vehicle, determine whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if a vehicle sound source is configured on the virtual mobile vehicle, generate a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effects emitted by the motor sound source and the sound effects emitted by the external speaker sound source; and control the vehicle sound source to play the target sound effect. It is easy to notice that by merging the motor sound source of the virtual mobile vehicle and the external speaker sound source to obtain the vehicle sound source, and then layering and streamlining the sound emitted by the vehicle sound source to obtain at least one layer of sound effect structure, it is possible to respond to the physical parameters of the virtual mobile vehicle during its movement. This not only effectively restores the real sound of the virtual mobile vehicle, but also greatly saves game resource overhead, allowing the game audio to play smoothly, achieving the technical effect of improving the design performance of the motor sound source simulation, and thus solving the technical problem of low design performance in simulating the sound effects of virtual mobile vehicles in related technologies. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of the present disclosure. The exemplary embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the drawings:

[0014] FIG1 is a hardware structure block diagram of a mobile terminal according to a sound effect processing method of an embodiment of the present disclosure;

[0015] FIG2 is a flow chart of a method for processing sound effects according to one embodiment of the present disclosure;

[0016] FIG3 is a schematic diagram of hierarchical structure division according to one embodiment of the present disclosure;

[0017] FIG4 is a schematic diagram of multi-level division of the rear motor sound source of a vehicle according to one embodiment of the present disclosure;

[0018] FIG5 is a schematic diagram of dividing the front motor sound source of a vehicle into a single level according to one embodiment of the present disclosure;

[0019] FIG6 is a schematic diagram of a middle-level sound effect structure of a multi-level division of a rear motor sound source of a vehicle according to one embodiment of the present disclosure;

[0020] FIG7 is a schematic diagram of adjusting the volume of different sound levels by using motor power according to one embodiment of the present disclosure;

[0021] FIG8 is a schematic diagram of adjusting low-pass filtering of different sound levels by motor power according to one embodiment of the present disclosure;

[0022] FIG9 is a schematic diagram of modulating sound frequency by vehicle speed according to one embodiment of the present disclosure;

[0023] FIG10 is a spectrogram of the sound emitted by the motor and the speaker when the vehicle accelerates according to one embodiment of the present disclosure;

[0024] FIG11 is a structural block diagram of a sound effect processing device according to one embodiment of the present disclosure;

[0025] FIG12 is a schematic diagram of an electronic device according to one embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the embodiments described are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] In one possible embodiment, in the context of sound source simulation, typically used in vehicle driving / racing simulation games, it is necessary to achieve the unique sound effects of the electric motors on electric and hybrid vehicles. This sound effect needs to include the sound produced by the motor rotation, as well as the sound designed by the designer and emitted by the vehicle's external speakers. After practice and careful research, the inventors still found that the design performance of motor sound source simulation is still low. Based on this, the embodiments of the present disclosure propose a sound effect processing method. The technical concept adopted is to combine the motor sound source of a virtual mobile vehicle and the sound source of an external speaker to obtain a vehicle sound source, and then layer and streamline the sound emitted by the vehicle sound source to obtain at least one layer of sound effect structure. This method can respond to the physical parameters of the virtual mobile vehicle during movement. This method can not only effectively restore the realistic sound of the virtual mobile vehicle, but also significantly save game resource overhead, allowing smooth game audio playback, thereby achieving the technical effect of improving the design performance of motor sound source simulation, thereby solving the technical problem of low design performance of virtual mobile vehicle sound effect simulation in the related art.

[0029] The sound effect processing method in one embodiment of the present disclosure can be run on a local terminal device or a server. When the sound effect processing method is run on a server, the method can be implemented and executed based on a cloud interaction system, wherein the cloud interaction system includes a server and a client device.

[0030] In an optional embodiment, various cloud applications, such as cloud gaming, can be run under the cloud interaction system. Taking cloud gaming as an example, cloud gaming refers to a gaming method based on cloud computing. In the cloud gaming operating mode, the main body running the game program and the main body presenting the game screen are separated. The storage and operation of the sound effect processing method are completed on the cloud gaming server. The client device is used to receive and send data and present the game screen. For example, the client device can be a display device with data transmission capabilities close to the user, such as a mobile terminal, television, computer, PDA, etc.; however, it is the cloud gaming server in the cloud that performs information processing. When playing the game, the player operates the client device to send operation instructions to the cloud gaming server. The cloud gaming server runs the game according to the operation instructions, encodes and compresses the game screen and other data, and returns it to the client device via the network. Finally, the client device decodes and outputs the game screen.

[0031] In an alternative embodiment, taking a game as an example, a local terminal device stores the game program and is used to present the game screen. The local terminal device is used to interact with the player via a graphical user interface (GUI), i.e., the game program is downloaded, installed, and run via a conventional electronic device. The local terminal device can present the GUI to the player in a variety of ways, such as rendering it on the terminal's display screen or presenting it to the player via holographic projection.

[0032] For example, the local terminal device can be a mobile terminal, a computer terminal or a similar computing device, which may include a display screen and a processor, wherein the display screen is used to present a graphical user interface, the graphical user interface includes a game screen, and the processor is used to run the game, generate the graphical user interface and control the display of the graphical user interface on the display screen.

[0033] Taking running on a mobile terminal as an example, the mobile terminal can be a smartphone, tablet computer, PDA, mobile Internet device, PAD, game console and other terminal devices. Figure 1 is a hardware structure block diagram of a mobile terminal for a sound effect processing method according to an embodiment of the present disclosure. As shown in Figure 1, the mobile terminal may include one or more (only one is shown in Figure 1) processors 102 and a memory 104 for storing data. Optionally, the mobile terminal may also include a transmission device 106, an input and output device 108, and a display device 110.

[0034] Those skilled in the art will appreciate that the structure shown in FIG1 is merely illustrative and does not limit the structure of the mobile terminal. For example, the mobile terminal may include more or fewer components than shown in FIG1 , or have a configuration different from that shown in FIG1 .

[0035] According to one embodiment of the present disclosure, an embodiment of a sound effect processing method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] In one possible implementation, an embodiment of the present disclosure provides a method for processing sound effects. FIG2 is a flowchart of the method for processing sound effects according to one embodiment of the present disclosure. As shown in FIG2 , the method includes the following steps:

[0037] Step S202: determining the physical parameters of the virtual mobile vehicle.

[0038] Specifically, the above-mentioned virtual mobile vehicle can be used to represent a movable vehicle controlled by a player in a game. It can be a virtual vehicle in a vehicle simulation driving or a virtual vehicle in a racing game. The application scenarios of the virtual mobile vehicle are not specifically limited here, and the above-mentioned virtual vehicle can be an electric vehicle or a hybrid vehicle, but is not limited to this.

[0039] The above-mentioned physical parameters can be used to represent parameters obtained during the process of controlling the virtual mobile vehicle, and may include but are not limited to one of the following: speed parameters, motor speed parameters, and throttle opening parameters.

[0040] In an optional embodiment, in a vehicle racing game or other game that includes a virtual moving vehicle, in the process of controlling the movement of the virtual moving vehicle, it is necessary to determine the physical parameters of the virtual moving vehicle, such as the speed, motor speed, and throttle opening. Since the sound effect of the sound source where the virtual moving vehicle is located will change accordingly with the physical parameters such as the vehicle speed, motor speed, or throttle opening during the movement of the virtual moving vehicle, it is necessary to further generate the corresponding sound effects by determining the physical parameters of the virtual moving vehicle.

[0041] In another optional embodiment, the above-mentioned physical parameters such as speed, motor speed, and throttle opening can be obtained by reading game data.

[0042] Step S204: Based on the vehicle type of the virtual mobile vehicle, determine whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source of the virtual mobile vehicle and the external speaker sound source.

[0043] Specifically, the above-mentioned vehicle type can be used to represent the driving type of the virtual mobile vehicle, that is, it can be a fuel-driven type, an electric-driven type, or a hybrid-driven type. The vehicle type is not specifically limited here.

[0044] It should be noted that, since different types of virtual mobile vehicles are equipped with different motors, for example, a virtual mobile vehicle of the fuel-driven type does not have an electric motor, and a virtual mobile vehicle of the electric-driven type needs to be driven by the front and rear electric motors, that is, the virtual mobile vehicle of the electric-driven type has two electric motors. Therefore, different numbers of vehicle sound sources can be pre-configured for virtual mobile vehicles of different vehicle types. For example, a virtual mobile vehicle of the fuel-driven type does not have an electric motor, so there is no need to configure a vehicle sound source for the virtual mobile vehicle of the fuel-driven type.

[0045] In addition, in order to further simplify the number of vehicle sound sources, the external speaker and the coaxial motor sound source can be merged as the vehicle sound source configured on the virtual mobile vehicle. For example, for an electric drive type virtual mobile vehicle, the virtual mobile vehicle has two motors, located on the front and rear axles respectively. Therefore, the front motor sound source of the front axle can be merged with the external speaker to obtain the front motor sound source, and the rear motor sound source of the rear axle can be merged with the external speaker to obtain the rear motor sound source. At this time, the virtual mobile vehicle is configured with two vehicle sound sources. By merging the motor sound source and the external speaker sound source, the number of sound sources in the game can be saved, thereby reducing the game performance overhead.

[0046] In an optional embodiment, if the vehicle type of the virtual mobile vehicle is a fuel-driven type, it is determined that the virtual mobile vehicle is not equipped with a vehicle sound source; if the vehicle type of the virtual mobile vehicle is an electric-driven type, it is determined that the virtual mobile vehicle is equipped with a vehicle sound source; if the vehicle type of the virtual mobile vehicle is a hybrid-driven type, it is determined that the virtual mobile vehicle is equipped with a vehicle sound source.

[0047] Step S206: If a vehicle sound source is configured on the virtual mobile vehicle, a target sound effect corresponding to the physical parameter is generated based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source.

[0048] Specifically, the at least one layer of sound effect structure described above can be used to represent a pre-configured sound effect structure by the user. Based on physical parameters such as motor speed or vehicle speed, the user can layer the real sound effects to obtain at least one sound effect structure. Each layer of the sound effect structure can be divided into multiple timbre segments, or alternatively, the sound effect structure can be composed of one or more timbre segments, without specific limitations. Different timbre segments can be derived based on physical parameters.

[0049] The target sound effect mentioned above can be used to indicate the sound effect that the vehicle sound source ultimately needs to output.

[0050] It should be noted that real vehicles often produce many sound effects. In order to simulate the sound effects emitted by real vehicles and reduce game resource overhead, the sound effects emitted by the motor sound source of the real vehicle and the real sound effects emitted by the external speaker sound source can be layered in advance, simplifying a large number of sound effects into at least one layer of sound effect structure.

[0051] Exemplarily, FIG3 is a schematic diagram of the hierarchical structure division according to one embodiment of the present disclosure. As shown in FIG3, a sound effect sample instance is simplified into four layers, including the first layer - motor layer, the second layer - speaker, the third layer - speaker and the fourth layer - speaker. Since the timbre of the sound emitted by the motor at different motor speeds is different, the sound of each layer may need to switch different loop samples as the motor speed changes, such as Loop 1, Loop 2 and Loop 3 in the first layer, or Loop 1, Loop 2 and Loop 3 in the second layer. At the same time, the Bass Loop in the third layer represents the low-frequency part of the sound effect sample instance, and the Hiss Loop in the fourth layer represents the noise part of the sound effect sample instance.

[0052] Based on Figure 3, the sound effect samples of a certain vehicle model are simplified. Loops are differentiated according to the speed. For example, the speed can be divided into three loops, corresponding to 200hz, 500hz, and 1000hz respectively. By designing sounds for different speeds, the samples are then integrated into different speed ranges according to the speed. Different layers of sound are superimposed on each other. At the same time, the number of hierarchical structures is determined by the design. For example, a certain vehicle model has both the sound of the actual motor and the sound designed to be played by the speaker. Therefore, in implementation, the actual motor sound will be designed in Track 1, and the speaker sound will be designed in Tracks 2, 3, and 4. The superposition of these four layers of sound creates the total sound effect of the vehicle sound source.

[0053] In addition, in actual use, the choice will be flexible according to the situation, as long as the total number of tracks is controlled below 3. During implementation, the hierarchy and organizational structure may be selected based on the actual listening experience of the vehicle. For example, if the sound of the actual motor of a certain car is not obvious, the structure of the actual motor layer can be ignored (deleted) during the design, and only the speaker layer structure can be used; if a good listening effect can be achieved with a 3-layer structure instead of a 4-layer structure, it is not necessary to stack all 4 layers; in the structural selection of a certain layer, the use of a single loop or multiple loops can also be flexibly selected according to the design.

[0054] For example, since the main perspective of the game is a rear-end perspective, in order to save resource overhead during the game development process, only one layer of sound effect structure is pre-configured for the front motor of the virtual mobile vehicle, and a multi-layer sound effect structure is configured for the rear motor of the virtual mobile vehicle. Figure 4 is a schematic diagram of multi-level division of the sound source of the rear motor of a vehicle according to one embodiment of the present disclosure. Figure 5 is a schematic diagram of single-level division of the sound source of the front motor of a vehicle according to one embodiment of the present disclosure. As shown in Figure 4, three layers of sound effect structures are configured for the sound source of the rear motor of the virtual mobile vehicle, including a low-frequency Bass sound effect structure, a mid-frequency Hi sound effect structure, and a high-frequency Lo sound effect structure. As shown in Figure 5, a layer of sound effect structure is configured for the front motor of the virtual mobile vehicle.

[0055] Step S208: Control the vehicle sound source to play the target sound effect.

[0056] Specifically, after generating the above-mentioned target sound effect, the vehicle sound source can be controlled to play the target sound effect.

[0057] In summary, a graphical user interface is provided through a terminal device, and the content displayed by the graphical user interface includes at least part of a virtual scene and at least one virtual mobile vehicle. The method includes: if a control instruction is executed on the virtual mobile vehicle, determining the physical parameters of the virtual mobile vehicle; based on the vehicle type of the virtual mobile vehicle, determining whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle; if the virtual mobile vehicle is configured with a vehicle sound source, generating a target sound effect corresponding to the physical parameters based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; controlling the vehicle sound source to play the target sound effect. It is easy to notice that by merging the motor sound source of the virtual mobile vehicle and the external speaker sound source to obtain the vehicle sound source, and then layering and streamlining the sound emitted by the vehicle sound source to obtain at least one layer of sound effect structure, it is possible to respond to the physical parameters of the virtual mobile vehicle during its movement. This not only effectively restores the real sound of the virtual mobile vehicle, but also greatly saves game resource overhead, allowing the game audio to play smoothly, achieving the technical effect of improving the design performance of the motor sound source simulation, and thus solving the technical problem of low design performance of the motor sound source simulation in related technologies.

[0058] Optionally, based on at least one layer of sound effect structure pre-configured for the vehicle sound source, a target sound effect corresponding to the physical parameter is generated, including: generating an initial timbre corresponding to the physical parameter based on any one layer of the at least one layer of sound effect structure; generating a target sound effect based on the initial timbre corresponding to the at least one layer of sound effect structure.

[0059] Specifically, the aforementioned initial timbre can be used to represent one or more loop timbre segments pre-divided in the sound effect structure.

[0060] In an optional embodiment, an initial timbre corresponding to any one of at least one layer of sound effect structures can be generated based on the real-time physical parameters of the virtual vehicle. The physical parameters here can be motor speed or the speed of the virtual vehicle. In this disclosure, the speed of the virtual vehicle is used as an example. Furthermore, based on the initial timbre corresponding to any one layer of sound effect structures, a target sound effect corresponding to at least one layer of sound effect structures is generated.

[0061] Optionally, based on any layer of sound effect structure in at least one layer of sound effect results, an initial timbre corresponding to the physical parameters is generated, including: determining the target timbre corresponding to the physical parameters from any layer of sound effect structure; if the target timbre is one timbre, determining the target timbre as the initial timbre; if the target timbre is multiple timbres, determining the mixing ratio of the target timbres from any layer of sound effect structure, and mixing the target timbres according to the mixing ratio to obtain the initial timbre.

[0062] Specifically, the target timbre mentioned above can be used to represent one or more loop timbre segments pre-divided by the user for any layer of sound effect structure.

[0063] It should be noted that in order to ensure that the simulated sound effects are closer to the real sound effects, different timbres can be mixed, and users can set the mixing ratio of different target timbres in advance.

[0064] In an optional embodiment, when generating an initial timbre corresponding to a physical parameter based on any one layer of sound effect structure in at least one layer of sound effect results, a target timbre corresponding to the physical parameter can be determined from any pre-configured layer of sound effect structure, and the corresponding initial timbre can be determined based on the number of target timbres. If the target timbre is a single timbre, the target timbre can be directly determined as the initial timbre; if the target timbre is multiple timbres, the user's pre-configured mixing ratio of the multiple timbres must be read, and the target timbres must be mixed based on the mixing ratio to obtain the initial timbre.

[0065] For example, as shown in Figure 4, by separately scheduling the sound effect structure names of each part, the corresponding initial timbre can be generated. Each level can be divided into multiple loop timbres based on different motor speeds according to actual needs, ensuring a more continuous timbre transition when switching between different speeds. As shown in Figure 5, this layer of sound effect structure contains two loop timbres. Different loop timbres are represented by a curve, with the horizontal axis representing different vehicle speeds and the vertical axis representing the timbre mixing ratio. The intersection of the two curves represents the intersection between loops, corresponding to the area between Loop 1 and Loop 2, or the area between Loop 2 and Loop 3 in Figure 3.

[0066] FIG6 is a schematic diagram of the sound effect structure of the middle level for multi-level division of the rear motor sound source of the vehicle according to one embodiment of the present disclosure. As shown in FIG6 , the sound effect structure includes two loop timbres. If there is only one timbre, the mixing ratio of the timbre is 100%, that is, the target timbre is directly determined to be the initial timbre; if there are two timbres, the mixing ratio of the two timbres can be determined based on physical parameters. For example, as shown in FIG6 , when the vehicle speed is 15, the two curves have a first intersection point, and the corresponding timbre values ​​are both 50%, then the mixing ratio of the two target timbres can be determined to be 1:1, and then the two target timbres are mixed to obtain the initial timbre.

[0067] Optionally, a target sound effect is generated based on the initial timbre corresponding to at least one layer of sound effect structure, including: if a first sound effect structure is pre-configured for the vehicle sound source, the initial timbre corresponding to the first sound effect structure is determined as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, the initial timbre corresponding to the multiple second sound effect structures are superimposed to obtain the target sound effect.

[0068] Specifically, the first sound effect structure mentioned above can be used to represent a layer of sound effect structure pre-configured for the vehicle sound source.

[0069] The above-mentioned second sound effect structure can be used to represent a multi-layer sound effect structure pre-configured for the vehicle sound source, wherein the second sound effect structure can be the same as the first sound effect structure or different from the first sound effect structure. Here, the first sound effect structure and the second sound effect structure are distinguished only based on the different configuration quantities.

[0070] In an optional embodiment, if the user has pre-configured only one sound effect structure for the vehicle sound source, the timbre corresponding to the layer of sound effect structure can be directly determined as the initial timbre; if the user has pre-configured multiple sound effect structures for the vehicle sound source, since there is only one target sound effect, the multiple initial timbres corresponding to the multiple layers of sound effect structures can be superimposed to obtain the above-mentioned target sound effect.

[0071] Optionally, a target sound effect is generated based on an initial timbre corresponding to at least one layer of sound effect structure, including: determining adjustment parameters corresponding to physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain a target timbre; and obtaining a target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0072] Specifically, the aforementioned adjustment parameters may be used to represent parameters for adjusting different layers of sound effect structures, including but not limited to volume parameters, audio parameters, and low-pass filter parameters.

[0073] Generally, a real motor produces different sounds when working under load (pedal depressed) and when rotating by inertia (pedal released). Similarly, the motor sounds designed for art will also vary depending on changes in multiple physical quantities, such as power and load. To simulate these changes, we adjust the volume of different sound levels and use a low-pass wave effect based on the motor's power parameters calculated in-game.

[0074] Figure 7 is a schematic diagram illustrating how the volume of different sound levels is adjusted by motor power according to one embodiment of the present disclosure. As shown in Figure 7, the volume of different sound levels changes with motor power. As the motor power increases from 0 to approximately 1.1, the adjusted volume gradually increases to 0. As the motor power increases from 1.1, the corresponding volume remains at 0.

[0075] Figure 8 is a schematic diagram illustrating how low-pass filtering for different sound levels is adjusted by motor power, according to one embodiment of the present disclosure. As shown in Figure 8, the line graph shows how low-pass filtering for different sound levels changes with motor power. As motor power increases from 0 to approximately 1.1, the low-pass filter parameter decreases from 45 to 0. As motor power increases from 1.1, the corresponding low-pass filter parameter remains unchanged at 0.

[0076] Optionally, determining the adjustment parameters corresponding to the physical parameters from any layer of the sound effect structure includes: obtaining at least one adjustment curve in any layer of the sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining the target curve corresponding to the physical parameters from at least one adjustment curve; and reading the adjustment parameters corresponding to the physical parameters from the target curve.

[0077] Specifically, the at least one adjustment curve mentioned above can be used to represent a curve corresponding to an adjustment parameter pre-configured for any layer of the sound effect structure, and different adjustment curves can be adjusted based on different physical parameters.

[0078] In an optional embodiment, at least one adjustment curve in any layer of the sound effect structure can be obtained, wherein different adjustment curves represent the correspondence between physical parameters and adjustment parameter values. By determining the target curve corresponding to the physical parameter from at least one adjustment curve, the adjustment parameter corresponding to the physical parameter can be determined based on the target curve, and then the initial timbre can be adjusted based on the adjustment parameter.

[0079] FIG9 is a schematic diagram of modulating sound frequency by vehicle speed according to one embodiment of the present disclosure. As shown in FIG9 , five adjustment curves are included in any layer of the sound effect structure, namely, an adjustment curve for the correspondence between motor power and low-pass filter parameters, an adjustment curve for the correspondence between motor power and audio parameters, an adjustment curve for the correspondence between vehicle speed and audio parameters, an adjustment curve for the correspondence between motor power and volume parameters, and a correspondence between vehicle speed and volume parameters. For example, FIG9 shows an adjustment curve for the correspondence between vehicle speed and audio parameters. When the adjustment curve for the correspondence between vehicle speed and audio parameters is marked as a target curve, the adjustment parameter corresponding to the physical parameter can be determined. For example, when the vehicle speed value corresponding to the physical parameter is 200, the audio parameter value corresponding to the adjustment parameter is approximately 500, and the audio parameter is then adjusted based on the parameter value 500.

[0080] It's important to note that the frequency of the sound increases with vehicle speed, and the volume curves for different layers vary. Some layers may emphasize low-speed performance, while others emphasize high-speed performance, so the specific curve depends on the sound design needs. Furthermore, physical parameters such as motor power and vehicle speed can be adjusted sequentially to obtain corresponding target curves, which can then determine the adjustment parameters corresponding to these physical parameters.

[0081] Optionally, the method also includes: obtaining real sound effects of a real moving vehicle corresponding to the virtual moving vehicle; determining the sound effect characteristics of the real sound effects; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effects.

[0082] Specifically, the above-mentioned real sound effects can be used to represent the sound effects emitted by a real moving vehicle during movement.

[0083] The above-mentioned sound effect characteristics can be used to represent the characteristics of real sound effects, including but not limited to volume, audio frequency and other characteristics.

[0084] In an optional embodiment, in the process of configuring the sound effect structure for the vehicle sound source, the real sound effect of the real mobile vehicle corresponding to the virtual mobile vehicle can be obtained, and then the volume, audio and other characteristics of the real sound effect can be analyzed to obtain the sound effect characteristics of the real sound effect, so that at least one layer of sound effect structure can be configured for the vehicle sound source based on the sound effect characteristics and the real sound effect.

[0085] Figure 10 is a spectrogram of the sound produced by the motor and speakers during acceleration, according to one embodiment of the present disclosure. As shown in Figure 10, a hierarchical division is made based on the actual sound characteristics of the vehicle. Based on the energy distribution characteristics observed on the spectrogram, the sound is decomposed into three components: the bass at the bottom (marked ①), a mid-frequency sine wave (marked ②), and three high-frequency harmonic curves (corresponding to ③) that are mutually harmonic. Therefore, these three layers of sound samples can effectively reproduce the sound effects of the vehicle's motor.

[0086] Optionally, determining the sound effect characteristics of the real sound effect includes: constructing a spectrogram of the real sound effect; and determining energy distribution characteristics in the spectrogram as the sound effect characteristics.

[0087] Specifically, as shown in Figure 10, the multiple curves constitute the sound spectrum of the real sound effect. Since the energy distribution characteristics of the multiple curves are different, the actual sound characteristics of the vehicle can be hierarchically divided according to the different frequencies corresponding to different energy distribution characteristics, obtaining the three layers of sound effect samples in Figure 10, and then determining the sound effect characteristics corresponding to each layer of sound effect samples.

[0088] Optionally, based on the sound effect characteristics, at least one layer of sound effect structure is configured for the vehicle sound source, including: if the vehicle sound source is located on the front wheel connecting shaft of the virtual mobile vehicle, a layer of audio structure is configured for the vehicle sound source based on the real sound effect; if the vehicle sound source is located on the rear wheel connecting shaft of the virtual mobile vehicle, the real sound effect is hierarchically divided based on the sound effect characteristics of the real sound effect, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0089] Specifically, since the game's primary perspective is a rear-end collision, it makes more sense to forgo the front motor, which is farther from the camera lens. If the vehicle sound source is located on the front wheel axle of the virtual moving vehicle, only one layer of audio structure needs to be configured for the vehicle sound source based on the real sound effects. However, if the vehicle sound source is located on the rear wheel axle of the virtual moving vehicle, which satisfies the rear-end collision perspective in the game, the real sound effects need to be hierarchically divided based on their characteristics, and a multi-layer audio structure needs to be configured for the vehicle sound source to ensure a better reproduction of the real sound effects and enhance the user's gaming experience.

[0090] Optionally, based on the vehicle type of the virtual mobile vehicle, it is determined whether a vehicle sound source is configured on the virtual mobile vehicle, including: if the vehicle type is a fuel vehicle, determining that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, determining that one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determining that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are respectively located on the front axle and the rear axle of the virtual mobile vehicle.

[0091] Specifically, if the vehicle type is a fuel vehicle, since there is no electric motor module on the vehicle, it is determined that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, often only one sound source (rear motor sound source) is configured, because hybrid vehicles have engine units and electric motors are relatively less important, which can further save resources; if the vehicle type is an electric vehicle, two front and rear electric motor sound sources will be configured, placed on the front and rear axles respectively. For example, the front motor sound source faces forward and the rear motor sound source faces backward.

[0092] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present disclosure.

[0093] This embodiment also provides a sound effect processing device for implementing the above-mentioned embodiments and preferred implementations. Details already described will not be repeated here. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.

[0094] FIG11 is a structural block diagram of a sound effect processing device according to one embodiment of the present disclosure. As shown in FIG11 , the device includes:

[0095] The parameter determination module 1102 is configured to determine the physical parameters of the virtual mobile vehicle;

[0096] The sound source determination module 1104 is configured to determine whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by combining a motor sound source of the virtual mobile vehicle and a sound source of an external speaker;

[0097] The sound effect filtering module 1106 is configured to generate a target sound effect corresponding to the physical parameter based on at least one layer of sound effect structure pre-configured for the vehicle sound source if a vehicle sound source is configured on the virtual mobile vehicle, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source;

[0098] The sound effect playing module 1108 is configured to execute control of the vehicle sound source to play the target sound effect.

[0099] Optionally, the sound effect screening module 1106 includes: an initial timbre generation module, configured to generate a target timbre corresponding to a physical parameter based on any one layer of the sound effect structure in at least one layer; and a target sound effect generation module, configured to generate a target sound effect based on a target timbre corresponding to at least one layer of the sound effect structure.

[0100] Optionally, the initial timbre generation module includes: a target timbre determination module, configured to determine the original timbre corresponding to the physical parameters from any layer of sound effect structure; a first initial timbre determination module, configured to determine the original timbre as the target timbre if the original timbre is one timbre; a second initial timbre determination module, configured to determine the mixing ratio of the original timbres from any layer of sound effect structure if the original timbre is multiple timbres, and mix the original timbres according to the mixing ratio to obtain the target timbre.

[0101] Optionally, the target sound effect generation module includes: a first target sound effect determination module, configured to execute if a first sound effect structure is pre-configured for the vehicle sound source, and determine the target timbre corresponding to the first sound effect structure as the target sound effect; a second target sound effect determination module, configured to execute if multiple second sound effect structures are pre-configured for the vehicle sound source, and superimpose the target timbres corresponding to the multiple second sound effect structures to obtain the target sound effect.

[0102] Optionally, the target sound effect generation module also includes: an adjustment parameter determination module, configured to determine the adjustment parameters corresponding to the physical parameters from any layer of sound effect structure; a target timbre acquisition module, configured to adjust the target timbre based on the adjustment parameters to obtain the adjusted timbre; a target sound effect acquisition module, configured to obtain the target sound effect based on the adjustment timbre corresponding to at least one layer of sound effect structure.

[0103] Optionally, the adjustment parameter determination module includes: an adjustment curve acquisition module, configured to execute acquisition of at least one adjustment curve in any layer of the sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; a target curve determination module, configured to execute determination of a target curve corresponding to a physical parameter from at least one adjustment curve; and an adjustment parameter reading module, configured to execute reading of an adjustment parameter corresponding to a physical parameter from a target curve.

[0104] Optionally, the device also includes: a real sound effect acquisition module, configured to acquire the real sound effect of the real mobile vehicle corresponding to the virtual mobile vehicle; a sound effect characteristic determination module, configured to determine the sound effect characteristics of the real sound effect; and a sound effect structure configuration module, configured to configure at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effect.

[0105] Optionally, the sound effect characteristic determination module includes: a spectrogram construction module configured to execute construction of a spectrogram of a real sound effect; and a sound effect characteristic determination module configured to execute determination of energy distribution characteristics in the spectrogram as sound effect characteristics.

[0106] Optionally, the sound effect structure configuration module includes: a first configuration module, configured to execute if the vehicle sound source is located on the front wheel connecting shaft of the virtual mobile vehicle, and configure a layer of audio structure for the vehicle sound source based on the real sound effect; a second configuration module, configured to execute if the vehicle sound source is located on the rear wheel connecting shaft of the virtual mobile vehicle, and divide the real sound effect into levels based on the sound effect characteristics of the real sound effect, and configure a multi-layer audio structure for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0107] Optionally, the sound source determination module includes: a first determination module, configured to determine that no vehicle sound source is configured on the virtual mobile vehicle if the vehicle type is a fuel vehicle; a second determination module, configured to determine that a vehicle sound source is configured on the virtual mobile vehicle if the vehicle type is a hybrid vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; a third determination module, configured to determine that two vehicle sound sources are configured on the virtual mobile vehicle if the vehicle type is an electric vehicle, wherein the two vehicle sound sources are respectively located on the front axle and the rear axle of the virtual mobile vehicle.

[0108] It should be noted that the above modules can be implemented through software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0109] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when run.

[0110] Optionally, in this embodiment, the above-mentioned computer-readable storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0111] Optionally, in this embodiment, the computer-readable storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

[0112] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0113] S1, determine the physical parameters of the virtual mobile vehicle;

[0114] S2, based on the vehicle type of the virtual mobile vehicle, determining whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by combining a motor sound source of the virtual mobile vehicle and a sound source of an external speaker;

[0115] S3, if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameter based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering sound effects emitted by a motor sound source and sound effects emitted by an external speaker sound source;

[0116] S4, controls the vehicle sound source to play the target sound effect.

[0117] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: generating an initial timbre corresponding to a physical parameter based on any one of at least one layer of sound effect structure; and generating a target sound effect based on the initial timbre corresponding to at least one layer of sound effect structure.

[0118] Optionally, the above-mentioned computer-readable storage medium is also configured to store program codes for executing the following steps: determining the target timbre corresponding to the physical parameters from any layer of the sound effect structure; if the target timbre is one timbre, determining the target timbre as the initial timbre; if the target timbre is multiple timbres, determining the mixing ratio of the target timbres from any layer of the sound effect structure, and mixing the target timbres according to the mixing ratio to obtain the initial timbre.

[0119] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: if a first sound effect structure is pre-configured for the vehicle sound source, the initial timbre corresponding to the first sound effect structure is determined as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, the initial timbre corresponding to the multiple second sound effect structures is superimposed to obtain the target sound effect.

[0120] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: determining adjustment parameters corresponding to physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain a target timbre; and obtaining a target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0121] Optionally, the computer-readable storage medium is further configured to store program code for executing the following steps: obtaining at least one adjustment curve in any layer of the sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining a target curve corresponding to the physical parameter from at least one adjustment curve; and reading the adjustment parameter corresponding to the physical parameter from the target curve.

[0122] Optionally, the computer-readable storage medium is also configured to store program codes for executing the following steps: obtaining the real sound effects of the real moving vehicle corresponding to the virtual moving vehicle; determining the sound effect characteristics of the real sound effects; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effects.

[0123] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: constructing a spectrogram of a real sound effect; and determining energy distribution characteristics in the spectrogram as sound effect characteristics.

[0124] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: if the vehicle sound source is located on the front wheel connecting shaft of the virtual mobile vehicle, a layer of audio structure is configured for the vehicle sound source based on the real sound effect; if the vehicle sound source is located on the rear wheel connecting shaft of the virtual mobile vehicle, the real sound effect is hierarchically divided based on the sound effect characteristics of the real sound effect, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0125] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: if the vehicle type is a fuel vehicle, determining that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, determining that one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determining that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are respectively located on the front axle and the rear axle of the virtual mobile vehicle.

[0126] In the computer-readable storage medium of this embodiment, a sound effect processing method is provided, which obtains a vehicle sound source by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle, and then the sound emitted by the vehicle sound source is layered and streamlined to obtain at least one layer of sound effect structure, so as to respond to the physical parameters of the virtual mobile vehicle during movement. It can not only effectively restore the real sound of the virtual mobile vehicle, but also greatly save game resource overhead, so that the game audio can be played smoothly, achieving the technical effect of improving the design performance of the motor sound source simulation, and thus solving the technical problem of low design performance of simulating the sound effects of virtual mobile vehicles in related technologies.

[0127] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0128] In exemplary embodiments of the present disclosure, a computer-readable storage medium stores a program product capable of implementing the aforementioned method of the present embodiment. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product comprising program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to execute the steps described in the "Exemplary Method" section of the present embodiment according to various exemplary embodiments of the present disclosure.

[0129] According to an embodiment of the present disclosure, a program product for implementing the above-mentioned method can be a portable compact disc read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the embodiment of the present disclosure is not limited thereto. In the embodiment of the present disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0130] The program product may be implemented in any combination of one or more computer-readable media. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive) of computer-readable storage media include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0131] It should be noted that the program code contained in the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any appropriate combination of the above.

[0132] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0133] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0134] Optionally, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0135] S1, determine the physical parameters of the virtual mobile vehicle;

[0136] S2, based on the vehicle type of the virtual mobile vehicle, determining whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by combining a motor sound source of the virtual mobile vehicle and a sound source of an external speaker;

[0137] S3, if a vehicle sound source is configured on the virtual mobile vehicle, generating a target sound effect corresponding to the physical parameter based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering sound effects emitted by a motor sound source and sound effects emitted by an external speaker sound source;

[0138] S4, controls the vehicle sound source to play the target sound effect.

[0139] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: generating an initial timbre corresponding to a physical parameter based on any one layer of the sound effect structure in at least one layer; generating a target sound effect based on the initial timbre corresponding to at least one layer of the sound effect structure.

[0140] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: determine the target timbre corresponding to the physical parameters from any layer of the sound effect structure; if the target timbre is one timbre, determine the target timbre as the initial timbre; if the target timbre is multiple timbres, determine the mixing ratio of the target timbres from any layer of the sound effect structure, and mix the target timbres according to the mixing ratio to obtain the initial timbre.

[0141] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: if a first sound effect structure is pre-configured for the vehicle sound source, the initial timbre corresponding to the first sound effect structure is determined as the target sound effect; if multiple second sound effect structures are pre-configured for the vehicle sound source, the initial timbre corresponding to the multiple second sound effect structures is superimposed to obtain the target sound effect.

[0142] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: determining the adjustment parameters corresponding to the physical parameters from any layer of sound effect structure; adjusting the initial timbre based on the adjustment parameters to obtain the target timbre; and obtaining the target sound effect based on the target timbre corresponding to at least one layer of sound effect structure.

[0143] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: obtaining at least one adjustment curve in any layer of the sound effect structure, wherein different adjustment curves are used to characterize the correspondence between different physical parameters and different adjustment parameter values; determining the target curve corresponding to the physical parameter from at least one adjustment curve; and reading the adjustment parameter corresponding to the physical parameter from the target curve.

[0144] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: obtaining the real sound effect of the real moving vehicle corresponding to the virtual moving vehicle; determining the sound effect characteristics of the real sound effect; and configuring at least one layer of sound effect structure for the vehicle sound source based on the sound effect characteristics and the real sound effect.

[0145] Optionally, the processor may also be configured to execute the following steps through a computer program: constructing a spectrogram of a real sound effect; and determining energy distribution characteristics in the spectrogram as sound effect characteristics.

[0146] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: if the vehicle sound source is located on the front wheel connecting shaft of the virtual mobile vehicle, a layer of audio structure is configured for the vehicle sound source based on the real sound effect; if the vehicle sound source is located on the rear wheel connecting shaft of the virtual mobile vehicle, the real sound effect is divided into levels based on the sound effect characteristics of the real sound effect, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structures contain different timbres.

[0147] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: if the vehicle type is a fuel vehicle, determine that no vehicle sound source is configured on the virtual mobile vehicle; if the vehicle type is a hybrid vehicle, determine that one vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on the rear axle of the virtual mobile vehicle; if the vehicle type is an electric vehicle, determine that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are respectively located on the front axle and the rear axle of the virtual mobile vehicle.

[0148] In the electronic device of this embodiment, a sound effect processing method is provided, which obtains a vehicle sound source by merging the motor sound source and the external speaker sound source of the virtual mobile vehicle, and then the sound emitted by the vehicle sound source is layered and streamlined to obtain at least one layer of sound effect structure, thereby responding to the physical parameters of the virtual mobile vehicle during movement. It can not only effectively restore the real sound of the virtual mobile vehicle, but also greatly save game resource overhead, so that the game audio can be played smoothly, achieving the technical effect of improving the design performance of the motor sound source simulation, and thus solving the technical problem of low design performance of simulating the sound effects of virtual mobile vehicles in related technologies.

[0149] FIG12 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG12 , the electronic device 1200 is merely an example and should not limit the functions and scope of use of the embodiment of the present disclosure.

[0150] As shown in FIG12 , electronic device 1200 is implemented as a general-purpose computing device. Components of electronic device 1200 may include, but are not limited to, the aforementioned at least one processor 1210 , the aforementioned at least one memory 1220 , a bus 1210 connecting various system components (including memory 1220 and processor 1210 ), and a display 1240 .

[0151] The memory 1220 stores program codes, which can be executed by the processor 1210 , so that the processor 1210 executes the steps described in the method section of the embodiment of the present disclosure according to various exemplary embodiments of the present disclosure.

[0152] The memory 1220 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 12201 and / or a cache memory unit 12202, and may further include a read-only memory unit (ROM) 12203, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.

[0153] In some examples, the memory 1220 may also include a program / utility 12204 having a set (at least one) of program modules 12205. Such program modules 12205 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. The memory 1220 may further include a memory remotely located relative to the processor 1210. These remote memories may be connected to the electronic device 1200 via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0154] The bus 1210 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a local bus to the processor 1210, or a bus using any of a variety of bus architectures.

[0155] The display 1240 may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the electronic device 1200 .

[0156] Optionally, the electronic device 1200 may also communicate with one or more external devices 1300 (e.g., a keyboard, a pointing device, a Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 1200, and / or any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., a router, a modem, etc.). Such communication may occur via an input / output (I / O) interface 1250. Furthermore, the electronic device 1200 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 1260. As shown in FIG12 , the network adapter 1260 communicates with other modules of the electronic device 1200 via the bus 1210. It should be understood that, although not shown in FIG12 , other hardware and / or software modules may be used in conjunction with the electronic device 1200, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0157] The electronic device 1200 may further include: a keyboard, a cursor control device (such as a mouse), an input / output interface (I / O interface), a network interface, a power supply and / or a camera.

[0158] Those skilled in the art will appreciate that the structure shown in FIG12 is merely illustrative and does not limit the structure of the electronic device described above. For example, the electronic device 1200 may further include more or fewer components than those shown in FIG12 , or have a configuration different from that shown in FIG1 . The memory 1220 may be used to store computer programs and corresponding data, such as the computer program and corresponding data corresponding to the sound effect processing method in the embodiment of the present disclosure. The processor 1210 executes various functional applications and data processing by running the computer program stored in the memory 1220, thereby implementing the above-mentioned sound effect processing method.

[0159] In the above embodiments of the present disclosure, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0160] In the several embodiments provided in the present disclosure, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only exemplary. For example, the division of the units can be a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0161] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0162] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0163] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the relevant technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0164] The above is only a preferred embodiment of the present disclosure. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present disclosure. These improvements and modifications should also be regarded as within the scope of protection of the present disclosure.

Claims

1. A sound effect processing method, comprising: Determining physical parameters of the virtual mobile vehicle; Based on the vehicle type of the virtual mobile vehicle, determining whether a vehicle sound source is configured on the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by combining a motor sound source of the virtual mobile vehicle and an external speaker sound source; If the vehicle sound source is configured on the virtual mobile vehicle, a target sound effect corresponding to the physical parameter is generated based on at least one layer of sound effect structure pre-configured for the vehicle sound source, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; Control the vehicle sound source to play the target sound effect.

2. The method according to claim 1, wherein: Generating the target sound effect corresponding to the physical parameter based on at least one layer of sound effect structure pre-configured for the vehicle sound source includes: Based on any one of the at least one layer of sound effect structure, generating a target timbre corresponding to the physical parameter; The target sound effect is generated based on the target timbre corresponding to the at least one layer of sound effect structure.

3. The method according to claim 2, wherein: Generating the target timbre corresponding to the physical parameter based on any one layer of the sound effect structure in the at least one layer of sound effect results includes: Determining the original timbre corresponding to the physical parameter from any one layer of the sound effect structure; If the original timbre is a timbre, determining the original timbre as the target timbre; If the original timbre is a plurality of timbres, a mixing ratio of the original timbres is determined from any one layer of the sound effect structure, and the original timbres are mixed according to the mixing ratio to obtain the target timbre.

4. The method according to claim 2, wherein: Generating the target sound effect based on the target timbre corresponding to the at least one layer of sound effect structure includes: If a first sound effect structure is configured in advance for the vehicle sound source, determining the target timbre corresponding to the first sound effect structure as the target sound effect; If a plurality of second sound effect structures are pre-configured for the vehicle sound source, the target timbres corresponding to the plurality of second sound effect structures are superimposed to obtain the target sound effect.

5. The method according to claim 2, wherein: Generating the target sound effect based on the target timbre corresponding to the at least one layer of sound effect structure includes: Determining, from any one layer of the sound effect structure, an adjustment parameter corresponding to the physical parameter; Adjusting the target timbre based on the adjustment parameter to obtain an adjusted timbre; The target sound effect is obtained based on the adjusted timbre corresponding to the at least one layer of sound effect structure.

6. The method according to claim 5, wherein: Determining, from any one layer of the sound effect structure, an adjustment parameter corresponding to the physical parameter, comprises: Obtaining at least one adjustment curve in any layer of the sound effect structure, wherein different adjustment curves are used to represent the corresponding relationship between different physical parameters and different adjustment parameter values; Determining a target curve corresponding to the physical parameter from the at least one adjustment curve; The adjustment parameter corresponding to the physical parameter is read from the target curve.

7. The method according to claim 1, wherein: The method further comprises: Acquire the real sound effect of the real moving vehicle corresponding to the virtual moving vehicle; Determining the sound effect characteristics of the real sound effect; Based on the sound effect characteristics and the real sound effect, at least one layer of sound effect structure is configured for the vehicle sound source.

8. The method according to claim 7, wherein: Determining the sound effect characteristics of the real sound effect includes: Constructing a spectrogram of the real sound effect; The energy distribution characteristics in the spectrogram are determined as the sound effect characteristics.

9. The method according to claim 7, wherein: Based on the sound effect characteristics, configuring the at least one layer of sound effect structure for the vehicle sound source includes: If the vehicle sound source is located on the front wheel connecting shaft of the virtual mobile vehicle, a layer of audio structure is configured for the vehicle sound source based on the real sound effect; If the vehicle sound source is located on the rear wheel connecting shaft of the virtual mobile vehicle, the real sound effect is divided into levels based on the sound effect characteristics of the real sound effect, and a multi-layer audio structure is configured for the vehicle sound source, wherein different layers of audio structures contain different timbres.

10. The method according to claim 1, wherein: Determining whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle includes: If the vehicle type is a fuel vehicle, determining that the vehicle sound source is not configured on the virtual mobile vehicle; If the vehicle type is a hybrid vehicle, determining that one of the vehicle sound sources is configured on the virtual mobile vehicle, wherein the vehicle sound source is located on a rear axle of the virtual mobile vehicle; If the vehicle type is an electric vehicle, it is determined that two vehicle sound sources are configured on the virtual mobile vehicle, wherein the two vehicle sound sources are respectively located on the front axle and the rear axle of the virtual mobile vehicle.

11. A sound effect processing device, comprising: A parameter determination module, configured to determine the physical parameters of the virtual mobile vehicle; a sound source determination module, configured to determine whether a vehicle sound source is configured on the virtual mobile vehicle based on the vehicle type of the virtual mobile vehicle, wherein the vehicle sound source is a sound source obtained by combining a motor sound source of the virtual mobile vehicle and an external speaker sound source; A sound effect screening module is configured to generate a target sound effect corresponding to the physical parameter based on at least one layer of sound effect structure pre-configured for the vehicle sound source if the vehicle sound source is configured on the virtual mobile vehicle, wherein the at least one layer of sound effect structure is a hierarchical structure obtained by layering the sound effect emitted by the motor sound source and the sound effect emitted by the external speaker sound source; The sound effect playing module is configured to control the vehicle sound source to play the target sound effect.

12. A computer-readable storage medium having a computer program stored therein, wherein: The computer program is configured to execute the method according to any one of claims 1 to 10 when executed by a processor.

13. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 10.

Images