Simulated sound wave enhancement method, electronic equipment and computer readable storage medium

Abstract

The invention discloses a simulated sound enhancement method, electronic equipment and a computer readable storage medium. The simulated sound enhancement method comprises the steps of performing sound simulation processing according to acquired vehicle state data and preset sound source data to obtain target sound source data; matching a target sound source space trajectory from preset sound source space trajectories according to the data type of the target sound source data; and performing spatial rendering processing based on the target sound source spatial trajectory and the target sound source data to obtain a target simulated sound. The three-dimensional sense of the simulated sound in the vehicle can be enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of sound wave processing, and in particular to a method for simulating sound wave enhancement, an electronic device, and a computer-readable storage medium. Background Art

[0002] As electric vehicles become more popular, the noise generated by vehicles while driving has been significantly reduced. However, the lack of the sound of traditional fuel engines has reduced the dynamics of the driving experience, especially in the field of high-performance electric vehicles, where users' demand for simulated sound waves is increasing.

[0003] Currently, the method of sound superposition is used to simulate sound wave playback, which leads to the problem that the simulated sound wave sounds thin and has a weak sense of space.

[0004] Therefore, there is an urgent need for a simulated sound wave enhancement method that can enhance the spatial stereoscopic sense of simulated sound waves. Summary of the invention

[0005] In order to solve the above-mentioned problems existing in the prior art, the present application provides a simulated sound wave enhancement method, an electronic device and a computer-readable storage medium, which can enhance the three-dimensional sense of the simulated sound waves in the car.

[0006] To solve the above problems, the present application provides a simulated sound wave enhancement method, which includes: performing sound wave simulation processing according to the acquired vehicle status data and preset sound wave source data to obtain target sound wave source data; matching the target sound source spatial trajectory from the preset sound source spatial trajectory according to the data type of the target sound wave source data; performing spatial rendering processing based on the target sound source spatial trajectory and the target sound wave source data to obtain the target simulated sound wave.

[0007] In some embodiments, the step of performing spatial rendering processing based on the target sound source spatial trajectory and the target sound wave source data to obtain the target simulated sound wave includes: determining the target gain data of the target sound wave source data in each speaker according to the position information of the speaker in the target sound source spatial trajectory; determining the target simulated sound wave according to the target sound wave source data and the target gain data of the corresponding target sound wave source data in each speaker.

[0008] In some embodiments, the step of determining the target gain data of the target sound wave source data in each speaker according to the position information of the speaker in the target sound source space trajectory includes: determining the position information of the virtual sound image according to the position information of each speaker in the target sound source space trajectory; determining the target gain data of the target sound wave source data in each speaker according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image.

[0009] In some embodiments, the position information of the speaker includes a virtual distance and a real distance between the driver and the speaker, and the position information of the virtual sound image includes the distance between the virtual sound image and the driver; the step of determining the target gain data of the target sound wave source data at each speaker according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image includes: determining the initial gain data of the target sound wave source data at each speaker according to the virtual distance between the driver and each speaker and the distance between the virtual sound image and the driver; determining the real gain data of the target sound wave source data at the corresponding speaker according to the distance difference between the virtual distance and the real distance and the initial gain data of the target sound wave source data at the corresponding speaker; normalizing the real gain data of the target sound wave source data at each speaker to obtain the target gain data of the target sound wave source data at each speaker.

[0010] In some embodiments, the step of determining the target simulated sound wave based on each target sound wave source data and the target gain data of each speaker corresponding to the target sound wave source data includes: determining the product of each target sound wave source data and the target gain data of the target speaker corresponding to the target sound wave source data as the initial simulated sound wave of the target sound wave source data in the target speaker; and taking the sum of the initial simulated sound waves of each target sound wave source data in the target speaker as the target simulated sound wave of each target sound wave source data in the target speaker.

[0011] In some embodiments, the step of matching the target sound source spatial trajectory from the preset sound source spatial trajectory according to the data type of the target sound source data includes: matching the data type of the target sound source data with the trajectory label of the preset sound source spatial trajectory to obtain a matching result; in response to the matching result indicating a match between the data type of the target sound source data and the trajectory label of the preset sound source spatial trajectory, the corresponding preset sound source spatial trajectory is determined as the target sound source spatial trajectory.

[0012] In some embodiments, the sound simulation processing is performed based on the acquired vehicle status data and preset sound source data to obtain target sound source data; initial sound source data is determined from the preset sound source data based on the vehicle status data; and the initial sound source data is subjected to speed and tone changing processing based on the vehicle status data to obtain the target sound source data.

[0013] In some embodiments, the vehicle status data includes vehicle speed and / or vehicle load, and the sound source data includes tone and / or sound pressure level; the vehicle speed is positively correlated with the tone in the target sound source data, and the vehicle load is positively correlated with the sound pressure level in the target sound source data.

[0014] To solve the above problem, the present application provides an electronic device, including: a processor and a memory, wherein the memory stores a computer program, and the processor is used to execute the computer program to implement the above method.

[0015] To solve the above problems, the present application provides a computer-readable storage medium on which program instructions are stored, and the above method is implemented when the program instructions are executed by a processor.

[0016] In the technical solution provided in the embodiment of the present application, sound wave simulation processing is performed according to the acquired vehicle state data and preset sound wave source data to obtain target sound wave source data; the target sound source spatial trajectory is matched from the preset sound source spatial trajectory according to the data type of the target sound wave source data; spatial rendering processing is performed based on the target sound source spatial trajectory and the target sound wave source data to obtain the target simulated sound wave. On the one hand, the spatial rendering processing of the simulated sound wave is performed according to the target sound wave source data matched with the vehicle state data and the target sound source spatial trajectory corresponding to the target sound wave source data, and the spatial layout of the simulated sound wave in the cabin can be changed according to the vehicle state data, so that the user in the cabin is immersed in the target simulated sound wave and the sense of reality of the simulated sound wave experience is enhanced; on the other hand, the spatial rendering of the target sound wave source data is performed according to the target sound source spatial trajectory corresponding to the target sound wave source data, and the separate layout of multiple sound source data of multiple sound source spatial trajectories is realized, which can enhance the stereoscopic sense of the target simulated sound wave.

[0017] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 is a flow chart of a method for simulating sound wave enhancement shown in an exemplary embodiment of the present application;

[0020] Figure 2 yes Figure 1A schematic flow chart of an exemplary embodiment of step S130 in the method for enhancing simulated sound waves shown;

[0021] Figure 3 is a schematic diagram of the layout of a loudspeaker for simulating the spatial trajectory of a target sound source in a method for simulating sound wave enhancement according to an exemplary embodiment of the present application;

[0022] Figure 4 It is a schematic diagram of the overall framework of the simulated sound wave enhancement system provided by the present application;

[0023] Figure 5 It is a structural schematic diagram of an embodiment of the electronic device of the present application;

[0024] Figure 6 It is a structural diagram of an embodiment of the computer storage medium of the present application. DETAILED DESCRIPTION

[0025] The present application is further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present application, but are not intended to limit the scope of the present application. Similarly, the following examples are only some embodiments of the present application rather than all embodiments, and all other embodiments obtained by those of ordinary skill in the art without making creative work are within the scope of protection of the present application.

[0026] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0027] This application proposes a method for simulating sound wave enhancement. For details, please refer to Figure 1 , Figure 1 It is a flow chart of a method for simulating sound wave enhancement shown in an exemplary embodiment of the present application.

[0028] The execution subject of the simulated sound wave enhancement method may be a terminal device or a server or other processing device, wherein the terminal device may be a user equipment (UE), a computer, a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. The execution subject of the simulated sound wave enhancement method may also be a simulated sound wave enhancement system. In some possible implementations, the simulated sound wave enhancement method may be implemented by a processor calling a computer-readable instruction stored in a memory.

[0029] The following uses the simulated sound wave enhancement system as the execution subject to explain the simulated sound wave enhancement method of the embodiment of the present application. Specifically, the simulated sound wave enhancement method of the embodiment includes the following steps:

[0030] Step S110, performing sound simulation processing according to the acquired vehicle state data and preset sound source data to obtain target sound source data.

[0031] The vehicle status data can provide feedback on the operating status of the vehicle. For example, the vehicle status data can be data such as vehicle speed or vehicle load. The vehicle load can be a pedal opening or torque.

[0032] Preset sound source data refers to pre-set sound source data. Exemplarily, the preset sound source data can be a traditional engine sound source, such as internal combustion engine noise, exhaust sound, and engine sound, etc.; it can also be a sci-fi electronic sound source, such as a sci-fi acceleration sound of a spacecraft, a sci-fi acceleration sound of a vehicle, etc.

[0033] The target sound source data refers to the sound source data after sound simulation processing based on the vehicle state data and the preset sound source data.

[0034] The simulated sound wave enhancement system of the embodiment of the present application can perform sound wave simulation processing on the preset sound wave source data according to the vehicle status data to obtain the target sound wave source data. Exemplarily, the simulated sound wave enhancement system can adjust the tone in the preset sound wave source data according to the vehicle speed in the vehicle status data to obtain the target sound wave source data. Among them, the vehicle speed in the vehicle status data is positively correlated with the tone in the preset sound wave source data. In another exemplary embodiment, the simulated sound wave enhancement system can adjust the sound pressure level in the preset sound wave source data according to the vehicle speed in the vehicle status data to obtain the target sound wave source data. Among them, the vehicle speed in the vehicle status data is positively correlated with the sound pressure level in the preset sound wave source data.

[0035] Further, considering that there are multiple preset sound source data, if the sound wave simulation is performed directly on multiple preset sound source data according to the vehicle status data, the simulated target sound source data may be more complicated, because the sound source data may be a traditional engine sound source such as internal combustion engine noise, or a sci-fi electronic sound source such as a sci-fi acceleration sound of a spacecraft. In this regard, the simulated sound wave enhancement system of the embodiment of the present application can determine the initial sound source data from the preset sound source data according to the vehicle status data, and perform speed change and modulation processing on the initial sound source data according to the vehicle status data to obtain the target sound source data. Among them, the initial sound source data may refer to the sound source data that matches the vehicle status data, for example, a traditional engine sound source or a sci-fi electronic sound source. It should be noted that the vehicle status data may include vehicle speed or vehicle load, and the sound source data may include tone or sound pressure level. During the speed change and modulation processing, the vehicle speed is positively correlated with the tone in the target sound source data, and the vehicle load is positively correlated with the sound pressure level in the target sound source data.

[0036] Step S120, matching the target sound source space trajectory from the preset sound source space trajectory according to the data type of the target sound source data.

[0037] The data type of the target sound source data may be engine noise, internal combustion engine sound, exhaust sound, or the like.

[0038] The preset sound source space trajectory refers to the sound and image trajectory of various sound wave sound source data that are preset.

[0039] The target sound source spatial trajectory refers to a preset sound source spatial trajectory that matches the target sound wave sound source data.

[0040] The simulated sound wave enhancement system matches the target sound source space trajectory from the preset sound source space trajectory according to the data type of the target sound wave sound source data. Exemplarily, the simulated sound wave enhancement system matches the data type of the target sound wave sound source data with the trajectory label of the preset sound source space trajectory to obtain a matching result; in response to the matching result representing a match between the data type of the target sound wave sound source data and the trajectory label of the preset sound source space trajectory, the corresponding preset sound source space trajectory is determined as the target sound source space trajectory. Among them, the trajectory label represents the standard data type of the sound wave sound source data that needs to be played for each preset sound source space trajectory.

[0041] Step S130, performing spatial rendering processing based on the target sound source spatial trajectory and the target sound wave source data to obtain the target simulated sound wave.

[0042] The spatial rendering process is to change the spatial layout of the sound source data and realize the separate layout of multiple sound source spatial trajectories and multiple sound source data.

[0043] The simulated sound wave enhancement system performs spatial rendering processing based on the target sound source spatial trajectory and the target sound wave source data, so as to achieve the effect of playing the target sound wave source data in the virtual sound and image corresponding to the target sound source spatial trajectory, so that the people in the car are immersed in the simulated sound waves, thereby increasing the realism of the target simulated sound wave experience.

[0044] It can be seen that the simulated sound wave enhancement method of the embodiment of the present application performs sound wave simulation processing according to the acquired vehicle state data and the preset sound wave sound source data to obtain the target sound wave sound source data; matches the target sound source spatial trajectory from the preset sound source spatial trajectory according to the data type of the target sound wave sound source data; performs spatial rendering processing based on the target sound source spatial trajectory and the target sound wave sound source data to obtain the target simulated sound wave. On the one hand, the spatial rendering processing of the simulated sound wave is performed according to the target sound wave sound source data matched with the vehicle state data and the target sound source spatial trajectory corresponding to the target sound wave sound source data, and the spatial layout of the simulated sound wave in the cabin can be changed according to the vehicle state data, so that the user in the cabin is immersed in the target simulated sound wave and the sense of reality of the simulated sound wave experience is enhanced; on the other hand, the spatial rendering of the target sound wave sound source data is performed according to the target sound source spatial trajectory corresponding to the target sound wave sound source data, and the separate layout of multiple sound source data of multiple sound source spatial trajectories is realized, which can enhance the stereoscopic sense of the target simulated sound wave.

[0045] Based on the above embodiments, the present application further describes how to perform spatial rendering processing. For details, please refer to Figure 2 , Figure 2 yes Figure 1 Schematic diagram of an exemplary embodiment of step S130 in the simulated sound wave enhancement method shown in FIG. Specifically, step S130 performs spatial rendering processing based on the target sound source spatial trajectory and the target sound wave sound source data, and the process of obtaining the target simulated sound wave may also include the following steps:

[0046] Step S210, determining target gain data of the target sound wave source data in each speaker according to the position information of the speaker in the target sound source spatial trajectory.

[0047] The target sound source spatial trajectory is distributed with loudspeakers. For example, see Figure 3 , Figure 3 A speaker 1 and a speaker 2, ie, a first speaker and a second speaker, are provided in the vehicle.

[0048] The target gain data can be understood as the distribution ratio of the target sound source data in each speaker of the target sound source space trajectory.

[0049] The simulated sound wave enhancement system determines the target gain data of the target sound wave source data in each speaker according to the position information of each speaker in the target sound source space trajectory. Specifically, the simulated sound wave enhancement system determines the position information of the virtual sound image according to the position information of each speaker in the target sound source space trajectory; and determines the target gain data of the target sound wave source data in each speaker according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image.

[0050] For determining the position information of the virtual sound image according to the position information of each speaker in the target sound source space trajectory, for example, the speaker vector can be determined according to the speaker position information, and then the vector of the virtual sound image can be determined according to the vector of each speaker, and then the position information of the virtual sound image can be determined according to the vector of the virtual sound image. Figure 3 The target sound source space trajectory includes speaker 1 and speaker 2, that is, the first speaker and the second speaker. The coordinate system is established with the main driver as the origin. The coordinates of the first speaker are (I 1x , I 1y ), the coordinates of the second speaker are (I 2x , I 2y ), then the vector of the first speaker is I1=[I 1x , I 1y ] T , the vector of the second speaker is I2=[I 2x , I 2y ] T , the vector of virtual sound image p = [p x , p y ] T =I1+I2. It should be noted that, in other embodiments, the position information of the virtual sound image may also be preset according to the target sound source space trajectory, that is, the position information of the virtual sound image corresponding to each sound source space trajectory is predetermined.

[0051] For the method of determining the target gain data of the target sound wave sound source data in each speaker according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image, it can be determined according to the sound image positioning algorithm (Vector Base Amplitude Panning, VBAP) for example. Among them, the sound image positioning algorithm is used to distribute the target sound wave sound source data to each speaker corresponding to the target sound source space trajectory to simulate the direction and distance of the virtual sound source and achieve accurate positioning of the sound. Specifically, the simulated sound wave enhancement system determines the initial gain data of the target sound wave sound source data in each speaker according to the virtual distance between the main driver and each speaker and the distance between the virtual sound image and the main driver; determines the real gain data of the target sound wave sound source data in the corresponding speaker according to the distance difference between the virtual distance and the real distance and the initial gain data of the target sound wave sound source data in the corresponding speaker; the real gain data of the target sound wave sound source data in each speaker is normalized to obtain the target gain data of the target sound wave sound source data in each speaker.

[0052] For details, please refer to the method for determining the initial gain data of the target sound source data at each speaker according to the virtual distance between the main driver and each speaker and the distance between the virtual sound image and the main driver. Figure 3 In an embodiment of the present application, a circle can be drawn with the driver's seat as the center and the distance between the driver's seat and the virtual sound image as the radius, and the intersection of the rays of the driver's seat and the speaker on the circle can be used as the virtual speaker, that is, the virtual position of the speaker.

[0053] Specifically, the determination of the initial gain data satisfies the following formula:

[0054]

[0055] Wherein, g1 represents the initial gain data of the first speaker, g2 represents the initial gain data of the second speaker, and p x The horizontal axis of the virtual sound image, p y Represents the vertical coordinate of the virtual sound image, aI 1x represents the virtual horizontal coordinate of the first speaker, that is, the horizontal coordinate of the first virtual speaker, aI 1y represents the virtual ordinate of the first speaker, which can also be understood as the ordinate of the first virtual speaker. 2x represents the virtual horizontal coordinate of the second speaker, that is, the horizontal coordinate of the second virtual speaker, bI 2y Represents the virtual vertical coordinate of the second speaker, that is, the horizontal and vertical coordinates of the second virtual speaker.

[0056] Furthermore, considering that the initial gain data determined above is applied to the first virtual speaker and the second virtual speaker, rather than the real first speaker and the second speaker, in order to improve the authenticity of the spatial rendering, the simulated sound wave enhancement system of the embodiment of the present application needs to process the initial gain data of the first speaker and the second speaker to determine the real gain data of the first speaker and the second speaker. Specifically, the simulated sound wave enhancement system determines the real gain data of the first speaker and the second speaker based on the sound wave attenuation mode and the relationship between sound pressure and sound amplitude.

[0057] Specifically, the sound wave attenuation process satisfies the following formula:

[0058]

[0059] Among them, Δ represents the attenuation of sound waves, and r represents the distance between the virtual sound image and the main driver.

[0060] Specifically, the relationship between sound pressure and sound amplitude satisfies the following formula:

[0061]

[0062] Among them, g represents the initial gain data, which can be the initial gain data g1 of the first speaker or the initial gain data g2 of the second speaker; g′ represents the actual gain data of the speaker, which can be the actual gain data g′1 of the first speaker or the actual gain data g′2 of the second speaker.

[0063] It can be understood that the determination of the actual gain data of the first speaker and the second speaker satisfies the following formula:

[0064]

[0065] Among them, r represents the distance between the virtual sound image and the main driver, g represents the initial gain data, which can be the initial gain data g1 of the first speaker or the initial gain data g2 of the second speaker, and g′ represents the real gain data of the speaker, which can be the real gain data g′1 of the first speaker or the real gain data g′2 of the second speaker.

[0066] Furthermore, in order to ensure that the energy of the virtual sound image reconstructed by multiple speakers is equal to the energy of a single sound source signal, the simulated sound wave enhancement system of the embodiment of the present application normalizes the real gain data of the speakers to ensure that the sound loudness of the virtual sound image relative to the original speakers remains unchanged. Specifically, the simulated sound wave enhancement system can determine a normalization factor based on the real gain data of the first speaker and the real gain data of the second speaker, and determine the ratio between the real gain data of the speaker and the normalization factor as the target gain data of each speaker.

[0067] Specifically, the calculation of the normalization factor satisfies the following formula:

[0068]

[0069] Wherein, g0 represents a normalization factor, g′1 represents actual gain data g′1 of the first speaker, and g′2 represents actual gain data of the second speaker.

[0070] Specifically, the target gain data of the first speaker satisfies the following formula:

[0071]

[0072] Wherein, g′1 represents the target gain data of the second speaker, g′1 represents the actual gain data of the second speaker, and g0 represents the normalization factor.

[0073] Specifically, the target gain data of the second speaker satisfies the following formula:

[0074]

[0075] Wherein, g″2 represents the target gain data of the second speaker, g′2 represents the actual gain data of the second speaker, and g0 represents the normalization factor.

[0076] Step S220, determining a target simulated sound wave according to each target sound wave source data and target gain data of each speaker corresponding to the target sound wave source data.

[0077] The target simulated sound wave refers to the simulated sound wave that needs to be played on the loudspeaker of the target sound source space trajectory.

[0078] The simulated sound wave enhancement system can determine the product of each target sound wave source data and the target gain data of the corresponding target sound wave source data in the target speaker as the initial simulated sound wave of the target sound wave source data in the target speaker; and the sum of the initial simulated sound waves of each target sound wave source data in the target speaker as the target simulated sound wave of each target sound wave source data in the target speaker. That is to say, when different target sound wave source data are played in the same speaker at the same time, the output of the speaker Among them, elements 1 to n represent different target sound source data. Characterizes the target gain data of different target sound source data in the same speaker, and n represents the target sound source data.

[0079] It can be seen that the simulated sound wave enhancement method of the embodiment of the present application determines the target gain data of the target sound wave source data in each speaker according to the position information of the speaker in the target sound source spatial trajectory; determines the target simulated sound wave according to each target sound wave source data and the target gain data of the corresponding target sound wave source data in each speaker, thereby realizing the separate layout of multiple sound wave source data in multiple sound source spatial trajectories and enhancing the three-dimensional sense of the target simulated sound wave.

[0080] For a detailed description of the above embodiments, please refer to Figure 4 , Figure 4 The overall framework diagram of the simulated sound wave enhancement system is shown in the figure. The simulated sound wave enhancement system includes a simulated sound wave module, a spatial trajectory mapping module, and an audio-visual positioning spatial rendering module. Specifically, the simulated sound wave enhancement system obtains vehicle status data, wherein the vehicle status data includes vehicle speed, pedal opening, and torque, etc.; the vehicle status data such as vehicle speed, pedal opening, and torque are input into the simulated sound wave module, and the simulated sound wave module performs sound wave simulation processing according to the vehicle status data and the preset sound wave source data, obtains the target sound wave source data, and outputs the target sound wave source data, that is, Figure 4 The material track in the simulation sound wave enhancement system inputs the target sound wave sound source data output by the simulation sound wave module into the space trajectory mapping module, and the space trajectory mapping module matches the target sound source space trajectory from the preset sound source space trajectory according to the data type of the target sound wave sound source data, and inputs the matched sound source space trajectory into the sound image positioning space rendering module; then the sound image positioning space rendering module performs space rendering processing based on the target sound source space trajectory and the target sound wave sound source data to obtain the target simulated sound wave, so that the target simulated sound wave is played in the speaker corresponding to the target sound source space trajectory, so as to enhance the three-dimensional sense of the simulated sound wave in the car.

[0081] The simulated sound wave enhancement system of the embodiment of the present application performs sound wave simulation processing according to the acquired vehicle state data and preset sound wave source data to obtain target sound wave source data; matches the target sound source spatial trajectory from the preset sound source spatial trajectory according to the data type of the target sound wave source data; performs spatial rendering processing based on the target sound source spatial trajectory and the target sound wave source data to obtain the target simulated sound wave. On the one hand, the spatial rendering processing of the simulated sound wave is performed according to the target sound wave source data matched with the vehicle state data and the target sound source spatial trajectory corresponding to the target sound wave source data, and the spatial layout of the simulated sound wave in the cabin can be changed according to the vehicle state data, so that the user in the cabin is immersed in the target simulated sound wave and the experience of the simulated sound wave is enhanced; on the other hand, the spatial rendering of the target sound wave source data is performed according to the target sound source spatial trajectory corresponding to the target sound wave source data, and the separate layout of multiple sound source data of multiple sound source spatial trajectories is realized, which can enhance the stereoscopic sense of the target simulated sound wave.

[0082] In one embodiment of the present application, Figure 4 The various modules in the simulated sound wave enhancement system shown can be individually or completely combined into one or several units to constitute, or one (some) of the units can be further divided into multiple functionally smaller sub-units to achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In actual applications, the functions of one module can also be implemented by multiple units, or the functions of multiple modules can be implemented by one unit. In other embodiments of the present application, the display range prediction device can also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0083] The above method is applied in electronic equipment. Figure 5 , Figure 5 1 is a schematic diagram of the structure of an embodiment of an electronic device of the present application, in which the electronic device 50 of the present embodiment includes a processor 51 and a memory 52. ​​The memory 52 stores a computer program, and the processor 51 is used to execute the computer program to implement the above-mentioned simulated sound wave enhancement method.

[0084] The processor 51 may be an integrated circuit chip with signal processing capability. The processor 51 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0085] The simulated sound wave enhancement method of the above embodiment can be presented in the form of a computer program. The present application proposes a computer storage medium carrying the computer program. Figure 6 , Figure 6 1 is a schematic diagram of the structure of an embodiment of a computer storage medium of the present application. In this embodiment, the computer storage medium 60 includes a computer program 61, which can be executed to implement the above-mentioned simulated sound wave enhancement method.

[0086] The computer storage medium 60 of this embodiment can be a medium that can store program instructions, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, or it can also be a server that stores the program instructions. The server can send the stored program instructions to other devices for execution, or it can also execute the stored program instructions by itself.

[0087] If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, the personal information processing rules are notified by obvious signs / information, and the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0088] In addition, if the above functions are implemented in the form of software functions and sold or used as independent products, they can be stored in a storage medium readable by a mobile terminal, that is, the present application also provides a storage device storing program data, the program data can be executed to implement the method of the above embodiment, and the storage device can be, for example, a USB flash drive, an optical disk, a server, etc. In other words, the present application can be embodied in the form of a software product, which includes a number of instructions for enabling a smart terminal to execute all or part of the steps of the method described in each embodiment.

[0089] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradicting each other.

[0090] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0091] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0092] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (which can be a personal computer, server, network device or other system that can fetch instructions from the instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0093] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for enhancing simulated sound waves, characterized in that: The method comprises: Performing sound wave simulation processing according to the acquired vehicle status data and preset sound wave source data to obtain target sound wave source data; Matching a target sound source spatial trajectory from a preset sound source spatial trajectory according to the data type of the target sound wave sound source data; Spatial rendering processing is performed based on the target sound source spatial trajectory and the target sound wave sound source data to obtain the target simulated sound wave.

2. The method for enhancing simulated sound waves according to claim 1, characterized in that: The step of performing spatial rendering processing based on the target sound source spatial trajectory and the target sound wave sound source data to obtain the target simulated sound wave comprises: Determine the target gain data of the target sound wave sound source data at each speaker according to the position information of the speaker in the target sound source spatial trajectory; The target simulated sound wave is determined according to each target sound wave source data and the target gain data of each speaker corresponding to the target sound wave source data.

3. The method for enhancing simulated sound waves according to claim 2, characterized in that: The step of determining the target gain data of the target sound wave sound source data at each speaker according to the position information of the speaker in the target sound source spatial trajectory comprises: Determine the position information of the virtual sound image according to the position information of each loudspeaker in the target sound source spatial trajectory; The target gain data of the target sound wave sound source data in each speaker is determined according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image.

4. The method for enhancing simulated sound waves according to claim 3, characterized in that: The position information of the speaker includes a virtual distance and a real distance between the driver and the speaker, and the position information of the virtual sound image includes a distance between the virtual sound image and the driver; The step of determining the target gain data of the target sound wave sound source data in each speaker according to the position information of each speaker in the target sound source space trajectory and the position information of the virtual sound image comprises: Determining initial gain data of the target sound source data at each speaker according to the virtual distance between the driver and each speaker and the distance between the virtual sound image and the driver; Determining the actual gain data of the target sound source data at the corresponding speaker according to the distance difference between the virtual distance and the actual distance and the initial gain data of the target sound source data at the corresponding speaker; The actual gain data of the target sound source data at each loudspeaker is normalized to obtain the target gain data of the target sound source data at each loudspeaker.

5. The method for enhancing simulated sound waves according to claim 2, characterized in that: The step of determining the target simulated sound wave according to each target sound wave source data and the target gain data of each speaker corresponding to the target sound wave source data comprises: Determine the product of each target sound wave source data and the target gain data of the target speaker corresponding to the target sound wave source data as the initial simulated sound wave of the target sound wave source data in the target speaker; The sum of the initial simulated sound waves of each target sound wave source data in the target speaker is used as the target simulated sound wave of each target sound wave source data in the target speaker.

6. The method for enhancing simulated sound waves according to claim 1, characterized in that: The step of matching the target sound source spatial trajectory from the preset sound source spatial trajectory according to the data type of the target sound wave sound source data comprises: Matching the data type of the target sound source data with the trajectory label of the preset sound source spatial trajectory to obtain a matching result; In response to the matching result indicating that the data type of the target sound source data matches the trajectory label of the preset sound source spatial trajectory, the corresponding preset sound source spatial trajectory is determined as the target sound source spatial trajectory.

7. The method for enhancing simulated sound waves according to claim 1, characterized in that: The sound wave simulation processing is performed according to the acquired vehicle state data and the preset sound wave source data to obtain the target sound wave source data; Determining initial sound source data from the preset sound source data according to the vehicle state data; The initial sound source data is subjected to speed and pitch change processing according to the vehicle state data to obtain the target sound source data.

8. The method for enhancing simulated sound waves according to claim 7, characterized in that: The vehicle status data includes vehicle speed and / or vehicle load, and the sound source data includes tone and / or sound pressure level; the vehicle speed is positively correlated with the tone in the target sound source data, and the vehicle load is positively correlated with the sound pressure level in the target sound source data.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores a computer program, and the processor is used to execute the computer program to implement the method according to any one of claims 1 to 8.

10. A computer-readable storage medium having program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images