Sound wave playing method, and apparatus and smart driving device
By triggering different sound waves according to the operating status of the brake pedal and the accelerator pedal in new energy vehicles, the problem of users lacking perceived sound wave feedback when driving is solved, and the immersion and authenticity of the driving experience are improved.
Patent Information
- Application Number
- PCT/CN2024/130817
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-22
- Filing Date
- 2024-11-08
- Publication Date
- 2025-05-30
AI Technical Summary
New energy vehicles lack engine cylinders and exhaust physical systems, resulting in users lacking perceived sound feedback when driving, affecting the immersive driving experience. The existing sound wave simulation effect is single and cannot match the user's operations.
By determining the pedal depth and duration of the brake pedal and accelerator pedal, the playback of the accumulator, the ejection, the acceleration, and the deceleration, the sound of the engine is simulated and the matching between the sound wave and the user's operation is enhanced.
It improves the immersion and driving fun of users during driving, enhances the authenticity and matching of sound wave playback, and improves the user experience.
Smart Images

Figure CN2024130817_30052025_PF_FP_ABST
Abstract
Description
Sound wave playing method, device and intelligent driving equipment
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 22, 2023, with application number 202311572878.8 and application name “A sound wave playback method, device and intelligent driving device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of vehicles, and more specifically, to a sound wave playback method, device, and intelligent driving equipment. Background Art
[0003] Although automobiles are developing in the direction of new energy, due to the lack of engine cylinders and exhaust physical systems in new energy vehicles, users lack perceptible sound feedback following the pedals when driving in the car, which actually greatly affects the driver's immersive driving experience. To address this, the vehicle's driving parameters are usually obtained to simulate the sound waves, and the car's speakers are used to actively emit sound waves to improve the user experience. However, the current sound wave simulation effect is single and can only meet some application scenarios. It cannot match the user's operation, which in turn leads to a decline in the user's driving experience. Based on this, how to improve the sound wave playback effect so that the sound wave can match the user's operation has become a technical problem that needs to be solved urgently.
[0004] Summary of the Invention
[0005] The present application provides a sound wave playback method, device and intelligent driving equipment, which ensure that users can also feel the sound of the engine when driving a new energy vehicle, enhance the user's immersion and driving pleasure during the driving process, and help improve the user experience.
[0006] In a first aspect, a sound wave playing method is provided, the method comprising: determining the depression depth of a brake pedal and the depression depth of an accelerator pedal; and playing a charging sound wave when the vehicle speed is 0, the depression depth of the brake pedal is greater than a first threshold, and the depression depth of the accelerator pedal is greater than a second threshold.
[0007] In an embodiment of the present application, the vehicle can play the charging sound when the vehicle speed is 0 and the depth of the user's simultaneous pressing of the accelerator pedal and the brake pedal meets the conditions, so that the user can feel the sound of the engine even when driving a new energy vehicle, thereby enhancing the user's immersion and driving pleasure during the driving process and helping to improve the user experience.
[0008] In addition, the charging sound wave is not simulated, but a preset sound wave, so the charging sound wave effect will be more realistic. At the same time, by setting the trigger condition to play the charging sound wave, the timing of playing the charging sound wave can be more consistent with the user's operation.
[0009] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: determining the duration during which the brake pedal's depression depth is greater than the first threshold and the accelerator pedal's depression depth is greater than the second threshold; when the duration is less than n seconds, where n>0, the method further includes: adjusting the pitch of the charging sound upward.
[0010] In an embodiment of the present application, the vehicle can adjust the tone of the charging sound according to the duration that the user simultaneously steps on the accelerator pedal and the brake pedal, so that the user can better feel the changes in the charging sound, thereby enhancing the user's immersion and driving pleasure during the driving process, and helping to improve the user experience.
[0011] In combination with the first aspect, in certain implementations of the first aspect, when the duration is greater than n seconds and less than m seconds, where m>0, the method further includes: adjusting the pitch of the charging sound wave upward within n seconds so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is maintained at q times within n seconds to m seconds.
[0012] In an embodiment of the present application, the vehicle can adjust the tone of the charging sound according to the duration that the user simultaneously steps on the accelerator pedal and the brake pedal, so that the user can better feel the changes in the charging sound, thereby enhancing the user's immersion and driving pleasure during the driving process, and helping to improve the user experience.
[0013] In combination with the first aspect, in certain implementations of the first aspect, when the duration is greater than m seconds, the method further includes: adjusting the pitch of the charging sound wave upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is maintained at q times from n seconds to m seconds; when the duration reaches m seconds, stopping playing the charging sound wave with the pitch adjusted to q times.
[0014] In an embodiment of the present application, the vehicle can adjust the tone of the charging sound according to the duration that the user simultaneously steps on the accelerator pedal and the brake pedal, so that the user can better feel the changes in the charging sound, thereby enhancing the user's immersion and driving pleasure during the driving process, and helping to improve the user experience.
[0015] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: detecting that the brake pedal is released and / or the accelerator pedal is released, and stopping playing the charging sound.
[0016] In combination with the first aspect, in certain implementations of the first aspect, when playing the charging sound, or after stopping playing the charging sound, wherein, after playing the charging sound, the depression depth of the brake pedal is greater than the first threshold and the depression depth of the accelerator pedal is greater than the second threshold, the method further includes: detecting that the brake pedal is released, and playing a launch sound.
[0017] In an embodiment of the present application, when the vehicle switches from a state where both the accelerator pedal and the brake pedal are stepped on to a state where the brake pedal is released, a catapult sound can be played, thereby enhancing the user's immersion and driving pleasure during driving and helping to improve the user experience.
[0018] In combination with the first aspect, in certain implementations of the first aspect, before the brake pedal is released, the depression depth of the accelerator pedal is greater than a third threshold, and the third threshold is greater than the second threshold.
[0019] In an embodiment of the present application, when the vehicle switches from a state where both the accelerator pedal and the brake pedal are stepped on to a state where the brake pedal is released and the accelerator pedal is deeply stepped on, a catapult sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0020] In combination with the first aspect, in certain implementations of the first aspect, after playing the ejection sound, the method further includes: when it is determined that the vehicle is in an accelerating state based on the vehicle speed and / or power speed, playing an acceleration sound.
[0021] In an embodiment of the present application, when the vehicle is in an accelerating state, the acceleration sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0022] In combination with the first aspect, in some implementations of the first aspect, the method further includes: when it is detected that a first preset condition is met, stopping playing the acceleration sound.
[0023] In combination with the first aspect, in certain implementations of the first aspect, the first preset condition includes one or more of the following: the vehicle switches from the acceleration state to the constant speed state; the duration of playing the acceleration sound is greater than a fourth threshold.
[0024] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when it is determined that the vehicle is in a deceleration state based on the vehicle speed and / or power speed, playing a deceleration sound.
[0025] In an embodiment of the present application, when the vehicle is in a deceleration state, the deceleration sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0026] In combination with the first aspect, in some implementations of the first aspect, the method further includes: when it is detected that a second preset condition is met, stopping playing the deceleration sound.
[0027] In combination with the first aspect, in certain implementations of the first aspect, the second preset condition includes one or more of the following: the vehicle switches from the deceleration state to the constant speed state; the duration of playing the deceleration sound is greater than the fifth threshold; the vehicle speed is reduced to 0.
[0028] In combination with the first aspect, in certain implementations of the first aspect, when the speed of the vehicle decelerates to less than a sixth threshold, the method further includes: detecting that the brake pedal is released and the accelerator pedal is stepped on and the stepping depth is greater than a seventh threshold, and playing the ejection sound.
[0029] In an embodiment of the present application, when the vehicle speed is slow and it is detected that the user has stepped deeply on the accelerator pedal, a catapult sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during driving, and helps to improve the user experience.
[0030] In a second aspect, a device is provided, which is applied to a controller of an intelligent driving device. The device includes a detection unit and a processing unit, and is used to execute the first aspect or any possible implementation of the first aspect.
[0031] In a third aspect, a device is provided, comprising at least one processor coupled to at least one memory, wherein the at least one processor is used to execute a computer program or instruction stored in the at least one memory so that the device performs the first aspect or any possible implementation of the first aspect.
[0032] In a fourth aspect, an intelligent driving device is provided, which includes the apparatus in any possible implementation of the second aspect or the third aspect.
[0033] In combination with the fourth aspect, in some implementations of the fourth aspect, the intelligent driving device is a vehicle.
[0034] In a fifth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in any one of the possible implementations of the first aspect.
[0035] It should be noted that the above-mentioned computer program code may be stored in whole or in part on a first storage medium, wherein the first storage medium may be packaged together with the processor or separately from the processor.
[0036] In a sixth aspect, a computer-readable medium is provided, wherein the computer-readable medium stores instructions. When the instructions are executed by a processor, the processor implements the method in any possible implementation of the first aspect.
[0037] In a seventh aspect, a chip is provided, which includes a circuit for executing the method in any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] FIG1 is a functional schematic diagram of an intelligent driving device provided in an embodiment of the present application.
[0039] FIG2 is a schematic flow chart of a sound wave playback method provided in an embodiment of the present application.
[0040] FIG3 is a schematic block diagram of an apparatus provided in an embodiment of the present application.
[0041] FIG4 is a schematic block diagram of an apparatus according to an embodiment of the present application. DETAILED DESCRIPTION
[0042] The technical solution in this application will be described below with reference to the accompanying drawings.
[0043] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.
[0044] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0045] Figure 1 is a functional block diagram of an intelligent driving device provided in an embodiment of the present application. As shown in Figure 1, the intelligent driving device 100 may include a perception system 120, a display device 130 and a computing platform 150, wherein the perception system 120 may include several sensors for sensing information about the environment surrounding the intelligent driving device 100. For example, the perception system 120 may include a positioning system, and the positioning system may be a global positioning system (GPS), or a Beidou system or other positioning system. For another example, the perception system 120 may also include one or more of an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera device. Among them, the camera device may include a camera device arranged at a rearview mirror, and the camera device may include but is not limited to a fisheye camera and a wide-angle camera.
[0046] The display device 130 in the cockpit is mainly divided into two categories: the first is the vehicle-mounted display screen; the second is a projection display screen, such as a head-up display (HUD). The vehicle-mounted display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, such as the digital instrument panel and the central control screen. A head-up display, also known as a head-up display system, is primarily used to display driving information such as speed and navigation on a display device in front of the driver (such as the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by the driver's gaze shift, and improves driving safety and comfort. HUDs include, for example, combined head-up display (C-HUD) systems, windshield head-up display (W-HUD) systems, and augmented reality head-up display (AR-HUD) systems. The display device may also include a human-machine interface (HMI) to prompt the user when switching between planning modes.
[0047] Some or all functions of the intelligent driving device 100 can be controlled by a computing platform 150. The computing platform 150 may include processors 151 to 15n. A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with the ability to read and execute instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. The logical relationships of the hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions, and some or all of the processors 151 to 15n may call the instructions in the memory to implement corresponding functions.
[0048] The intelligent driving devices involved in this application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment, etc. For example, the intelligent driving device can be a vehicle, which is a vehicle in a broad sense, and can be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiment of this application does not specifically limit the type of vehicle. For another example, the vehicle can be a vehicle such as an airplane or a ship. The following is an example of an intelligent driving device being a vehicle.
[0049] Although automobiles are trending toward new energy vehicles, the lack of engine cylinders and exhaust physics means users lack perceptible acoustic feedback from pedal strokes while driving, significantly impacting the driver's immersive driving experience. To address this, sound simulation is often used, using the car's speakers to actively generate sound waves to enhance the user experience. However, current sound simulations offer limited effectiveness, only meeting certain application scenarios and failing to align with user input, resulting in a diminished driving experience.
[0050] Currently, it's possible to simulate car noise using sine waves. The basic principle of this technology is to convert the car engine's sound signal into a sine wave and then adjust factors such as the sine wave's frequency, amplitude, and phase to simulate the car's noise. Specifically, this method first requires collecting the car engine's sound signal, analyzing and processing it. Then, leveraging the characteristics of sine waves, these signals are converted into sine waves. The sine wave is then adjusted and simulated using computer software or hardware. Finally, the simulated noise is played through speakers or audio equipment.
[0051] However, due to the relatively simple waveform of the sine wave, the simulated sound waves often lack the complexity and variability of real car sounds.
[0052] Currently, it's also possible to simulate car noise using audio slicing and pitch shifting technology. The basic principle of this technology is to convert the car engine sound signal into audio segments and then pitch-shift each audio segment. Specifically, this sound simulation method first requires collecting the car engine sound signal, analyzing and processing it. Then, using the characteristics of audio slicing and pitch shifting technology, these sound signals are converted into audio segments, and the pitch of each audio segment is shifted. During this process, the effect of the simulated sound can be changed by adjusting the pitch shifting parameters. Finally, the simulated sound is played through speakers or audio equipment.
[0053] However, since the same pitch changes in all frequency bands during audio slicing, it is impossible to achieve different pitch changes in different frequency bands. Therefore, it is only suitable for sound wave effects with uniform speed and small pitch variation span.
[0054] Currently, car noise simulation can also be achieved through audio particle extraction technology. The basic principle of this technology is to convert the car engine sound signal into audio particles and extract features from each audio particle to obtain a characteristic representation of the audio file. Machine learning algorithms are then used to classify or identify the extracted features to produce a simulated car noise. Specifically, this noise simulation method first requires collecting the car engine sound signal, analyzing and processing it. Then, leveraging the characteristics of audio particle extraction technology, these sound signals are converted into audio particles, and features are extracted from each audio particle. Different feature extraction methods can be used in this process, such as spectral features, time domain features, etc. Finally, machine learning algorithms are used to classify or identify the extracted features to produce a simulated car noise.
[0055] However, when audio particle extraction technology simulates car sounds, it is bound to the car speed, and the acceleration effect is fixed.
[0056] The above-mentioned sound wave simulation method cannot be applied to all user operations, so the generated sound waves may not match the user's actual operation, which in turn leads to a decline in user experience.
[0057] Based on this, the embodiment of the present application provides a sound wave playback method, which adds charging sound effects and ejection sound effects, enriches the sound wave playback effect, and helps to improve the user experience.
[0058] FIG2 shows a schematic flow chart of a sound wave playback method provided by an embodiment of the present application. The method shown in FIG2 can be executed by the intelligent driving device 100 shown in FIG1 . The following description is based on an example in which the intelligent driving device 100 is executed and the intelligent driving device is a vehicle. As shown in FIG2 , the method includes:
[0059] S201, determining the depression depth of the brake pedal and the depression depth of the accelerator pedal.
[0060] In some embodiments, the vehicle may obtain depth information of the brake pedal and depth information of the accelerator pedal, wherein the depth information of the brake pedal is used to indicate the depression depth of the brake pedal, and the depth information of the accelerator pedal is used to indicate the depression depth of the accelerator.
[0061] In some embodiments, the depth information of the brake pedal and the depth information of the accelerator pedal can be represented by controller area network (CAN) signals. It is easy to understand that different CAN signal values represent different pedaling depths.
[0062] For example, the brake pedal depth information is CAN signal #1, which indicates the brake pedal's depression depth. The accelerator pedal depth information is CAN signal #2, which indicates the accelerator pedal's depression depth. A value of 1 in CAN signal #1 corresponds to a brake pedal depression depth of 1%. A value of 50 in CAN signal #2 corresponds to a accelerator pedal depression depth of 50%.
[0063] It should be understood that the numerical values involved in the above examples are only examples and should not be understood as specific limitations on the embodiments of the present application.
[0064] It should also be understood that the use of percentages to express the trampling depth in the above examples is merely an example and should not be construed as a specific limitation on the embodiments of the present application. For example, in other embodiments of the present application, the trampling depth may also be expressed in units of length. For example, the trampling depth may be 1 cm, 2 cm, etc.
[0065] In some embodiments, the vehicle can obtain brake pedal depth information and accelerator pedal depth information, and then determine the brake pedal depression depth and accelerator pedal depression depth based on the brake pedal depth information and accelerator pedal depth information. In other words, the vehicle can directly determine the brake pedal depression depth and accelerator pedal depression depth.
[0066] In some embodiments, the depth information of the brake pedal and the depth information of the accelerator pedal can be obtained when the vehicle is in an initialization startup state.
[0067] It is understandable that when the vehicle is in the initialization start state, the vehicle speed is 0 km / h.
[0068] S202: Determine whether the brake pedal's depression depth is greater than a first threshold, and whether the accelerator pedal's depression depth is greater than a second threshold.
[0069] After determining the brake pedal and accelerator pedal depression depths, the vehicle can determine whether the brake pedal depression depth is greater than a first threshold and whether the accelerator pedal depression depth is greater than a second threshold. If both the brake pedal depression depth and the accelerator pedal depression depth are greater than the first threshold and the second threshold, step S203 can be performed; otherwise, no action is taken. In other words, step S203 is only performed if both the brake pedal depression depth and the accelerator pedal depression depth are greater than their corresponding thresholds.
[0070] In some embodiments, the first threshold and the second threshold may be the same.
[0071] In some embodiments, the first threshold and the second threshold may be different.
[0072] As described above, the brake pedal and accelerator pedal depression depths determined by the vehicle can be directly represented by their respective depression depths or indirectly represented by their respective depth information values. Therefore, the first threshold and the second threshold can correspond to either the depression depth or the depth information value.
[0073] For example, if the first threshold and the second threshold are the same, that is, 10, i.e., the first threshold and the second threshold correspond to depth information values, the vehicle determines that the depth information value of the brake pedal is 20 and the depth information value of the accelerator pedal is 25, and both are greater than 10, then the vehicle can proceed to S203.
[0074] For another example, assuming the first threshold and the second threshold are the same, that is, the first threshold and the second threshold are 10%, that is, the first threshold and the second threshold correspond to the pedaling depth. The vehicle determines that the value of the brake pedal depth information is 20, and the value of the accelerator pedal depth information is 25. The vehicle can determine that the brake pedal pedal pedaling depth is 20% based on the brake pedal depth information, and the accelerator pedal pedal pedaling depth is 25% based on the accelerator pedal depth information. If both values are greater than 10, the vehicle can proceed to S203.
[0075] S203, play charging sound wave.
[0076] The vehicle determines that the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold, and can play a charging sound.
[0077] In some embodiments, the charged sound wave may be a preset sound wave.
[0078] For example, the charging sound wave may be preset by the vehicle manufacturer or by the manufacturer providing the vehicle's operating system when the vehicle leaves the factory.
[0079] Exemplarily, the charging sound wave may be uploaded by a user.
[0080] For example, the vehicle has multiple charging sound waves preset, and the vehicle can determine the corresponding sound wave according to the user's selection.
[0081] For example, the vehicle has pre-set charging sound #1 and charging sound #2. The user can select charging sound #1 as the charging sound to be played, so that the vehicle can play charging sound #1 when it determines that the value of the depth information of the brake pedal is greater than the first threshold and the value of the depth information of the accelerator pedal is greater than the second threshold.
[0082] It can be understood that the charging sound wave reflects the sound of the engine speed of a vehicle equipped with an engine, which increases from slow to fast when both the accelerator and brake pedals are pressed and the vehicle is in place. This charging sound wave allows users to feel the engine sound even when driving a new energy vehicle, enhancing the user's driving immersion and helping to improve the user experience.
[0083] In an embodiment of the present application, the vehicle can play the charging sound when the vehicle speed is 0 and the depth of the user's simultaneous pressing of the accelerator pedal and the brake pedal meets the conditions, so that the user can feel the sound of the engine even when driving a new energy vehicle, thereby enhancing the user's immersion and driving pleasure during the driving process and helping to improve the user experience.
[0084] In some embodiments, since the charging sound wave is preset, when playing the charging sound wave, the surrounding sound audio effect component can be used to play the charging sound wave.
[0085] In some embodiments, the method further comprises:
[0086] S204: Determine a duration during which the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold.
[0087] It should be noted that there is no specific order for S203 and S204; the vehicle can execute S203 and S204 simultaneously. That is, when the vehicle plays the charging sound, it will calculate the duration of time that the brake pedal's depression depth exceeds the first threshold and the accelerator pedal's depression depth exceeds the second threshold.
[0088] According to the duration, there are several possible situations.
[0089] When the duration is less than n seconds, the method further includes:
[0090] S205, adjust the pitch of the charging sound wave upwards.
[0091] When the vehicle detects that the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold for less than n seconds, the pitch of the charging sound can be adjusted upward while playing the charging sound, where n>0.
[0092] In some embodiments, it can be understood that the multiple by which the pitch of the charging sound wave is adjusted upward may be related to the duration.
[0093] For example, if the duration is 1 second, the pitch of the charging sound wave will be adjusted upward by 1.5 times.
[0094] For another example, taking the duration as 2 seconds, when the duration reaches 1 second, the pitch of the charging sound wave is adjusted upward by 2 times.
[0095] In some embodiments, n=3.
[0096] When the duration is greater than or equal to n seconds and less than m seconds, the method further includes:
[0097] S206, adjusting the pitch of the charging sound wave upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, and the pitch of the charging sound wave is kept adjusted to q times within n seconds to m seconds.
[0098] When the vehicle detects that the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold for a duration greater than or equal to n seconds and less than m seconds, the pitch of the charging sound wave can be adjusted upward first. When n seconds pass, the pitch of the charging sound wave is adjusted upward by q times, and after n seconds, the pitch of the charging sound wave is maintained at the pitch corresponding to n seconds, where m>0, q>0.
[0099] In some embodiments, m=10.
[0100] When the duration is greater than or equal to m seconds, the method further includes:
[0101] S207, adjusting the pitch of the charging sound wave upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, and the pitch of the charging sound wave is kept adjusted to q times within n seconds to m seconds.
[0102] S208, when the duration reaches m seconds, stop playing the charging sound wave with the pitch adjusted to q times.
[0103] When the vehicle detects that the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold for a duration greater than or equal to m seconds, the pitch of the charging sound wave can be adjusted upward first. When n seconds pass, the pitch of the charging sound wave is adjusted upward by q times, and after n seconds, the pitch of the charging sound wave is maintained at the pitch corresponding to n seconds. Then, when the duration reaches m seconds, the charging sound wave can be stopped.
[0104] It is understandable that when the vehicle detects that the accelerator pedal or brake pedal is released, the charging sound can be stopped.
[0105] In an embodiment of the present application, the vehicle can adjust the tone of the charging sound according to the duration that the user simultaneously steps on the accelerator pedal and the brake pedal, so that the user can better feel the changes in the charging sound, thereby enhancing the user's immersion and driving pleasure during the driving process, and helping to improve the user experience.
[0106] In some embodiments, while the vehicle is playing the charging sound, or after the charging sound stops playing, wherein after the charging sound is played, the brake pedal and the accelerator pedal are in a stepped state, the method further includes:
[0107] S209: Detecting that the brake pedal is released, playing the ejection sound.
[0108] For example, when the vehicle is playing a charging sound, that is, the brake pedal is depressed to a depth greater than a first threshold and the accelerator pedal is depressed to a depth greater than a second threshold, and it is detected that the brake pedal is released, the vehicle can play a launching sound.
[0109] For another example, if the vehicle stops playing the charging sound, but the brake pedal's depression depth is still greater than the first threshold and the accelerator pedal's depression depth is still greater than the second threshold, the vehicle can play the launch sound when the brake pedal is released. In other words, if the brake pedal's depression depth is greater than the first threshold and the accelerator pedal's depression depth is greater than the second threshold for more than m seconds, the vehicle stops playing the charging sound after m seconds. When the brake pedal is released after m seconds, the vehicle can play the launch sound.
[0110] It can be understood that the ejection sound reflects the sound made by the engine when a vehicle equipped with an engine is ejected and started.
[0111] In an embodiment of the present application, when the vehicle switches from a state where both the accelerator pedal and the brake pedal are stepped on to a state where the brake pedal is released, a catapult sound can be played, thereby enhancing the user's immersion and driving pleasure during driving and helping to improve the user experience.
[0112] In some embodiments, before the brake pedal is released, the depression depth of the accelerator pedal is greater than a third threshold, and the third threshold is greater than the second threshold.
[0113] In an embodiment of the present application, when the vehicle switches from a state where both the accelerator pedal and the brake pedal are stepped on to a state where the brake pedal is released and the accelerator pedal is deeply stepped on, a catapult sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0114] For example, when the vehicle is playing a charging sound, the brake pedal is depressed at a depth of depth #1, which is greater than a first threshold, and the accelerator pedal is depressed at a depth of depth #2, which is greater than a third threshold. When the brake pedal is detected to be released, the vehicle can play a launch sound.
[0115] For another example, the vehicle is playing the charging sound, where the brake pedal is depressed at a depth of depth #1, which is greater than the first threshold, and the accelerator pedal is depressed at a depth of depth #2, which is less than the third threshold but greater than the second threshold. At this time, it is detected that the brake pedal is released, and the vehicle will not play the ejection sound.
[0116] In some embodiments, the ejection sound wave may also be a preset sound wave.
[0117] When the brake pedal is released, the vehicle begins to accelerate because the accelerator pedal is still depressed. In some embodiments, after playing the launch sound, the method further includes: playing the acceleration sound when it is determined that the vehicle is in an accelerating state based on the vehicle speed and / or power speed.
[0118] The vehicle can obtain the vehicle speed and / or power speed, and play the acceleration sound when it is determined that the vehicle is in an accelerating state based on the vehicle speed and / or power speed.
[0119] It can be understood that the acceleration sound reflects the sound made by the engine when a vehicle equipped with an engine accelerates.
[0120] In an embodiment of the present application, when the vehicle is in an accelerating state, the acceleration sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0121] In addition, since the vehicle plays the acceleration sound after determining that the vehicle has actually started to accelerate, it can better meet the user's feelings.
[0122] In some embodiments, the acceleration sound wave may also be a preset sound wave.
[0123] In some embodiments, the method further includes: when it is detected that a first preset condition is met, stopping playing the acceleration sound.
[0124] In the embodiment of the present application, the first preset condition is not specifically limited, and several possible implementation methods are exemplarily introduced below.
[0125] Exemplarily, the first preset condition is that the vehicle switches from an accelerating state to a constant speed state.
[0126] For example, the first preset condition is that the duration of playing the acceleration sound wave is greater than a fourth threshold value. For example, the fourth threshold value is 25 seconds.
[0127] When the accelerator pedal is released and the brake pedal is depressed, the vehicle begins to decelerate. In some embodiments, the method further includes:
[0128] When the vehicle is determined to be in a deceleration state based on the vehicle speed and / or power speed, a deceleration sound is played.
[0129] The vehicle can obtain the vehicle speed and / or power speed, and play the deceleration sound when it is determined that the vehicle is in a deceleration state based on the vehicle speed and / or power speed.
[0130] It can be understood that the deceleration sound reflects the sound made by the engine when a vehicle equipped with an engine decelerates.
[0131] In an embodiment of the present application, when the vehicle is in a deceleration state, the deceleration sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during the driving process, and helps to improve the user experience.
[0132] In addition, since the vehicle plays the deceleration sound after determining that the vehicle has actually started to decelerate, it can better meet the user's feelings.
[0133] In some embodiments, the deceleration sound wave may also be a preset sound wave.
[0134] In some embodiments, the method further includes: stopping playing the deceleration sound when it is detected that a second preset condition is met.
[0135] In the embodiment of the present application, the second preset condition is not specifically limited, and several possible implementation methods are exemplarily introduced below.
[0136] Exemplarily, the second preset condition is that the vehicle switches from a deceleration state to a constant speed state.
[0137] Exemplarily, the second preset condition is that the duration of playing the deceleration sound is greater than the fifth threshold.
[0138] Exemplarily, the second preset condition is that the vehicle speed is reduced to 0.
[0139] When the accelerator pedal is released and the brake pedal is stepped on, the vehicle starts to decelerate. When the vehicle speed drops to less than a sixth threshold, in some embodiments, the method further includes: detecting that the brake pedal is released and the accelerator pedal is stepped on and the stepping depth is greater than a seventh threshold, and playing a launch sound.
[0140] For example, when the vehicle speed decreases to 10 km / h, the vehicle detects that the user releases the brake pedal and steps on the accelerator pedal with a stepping depth greater than 60%, and a ejection sound wave can be played.
[0141] In an embodiment of the present application, when the vehicle speed is slow and it is detected that the user has stepped deeply on the accelerator pedal, a catapult sound can be played, which is more realistic, enhances the user's immersion and driving pleasure during driving, and helps to improve the user experience.
[0142] The above description of the sound wave playback method provided by the embodiment of the present application is described in detail in conjunction with Figure 2. In the various embodiments of the present application, unless otherwise specified or logically conflicting, the terms and / or descriptions between the various embodiments are consistent and can be referenced from each other. The technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.
[0143] The apparatus provided in the embodiments of the present application will be described in detail below with reference to Figures 3 and 4. It should be understood that the description of the apparatus embodiment corresponds to the description of the method embodiment, and therefore, for matters not described in detail, reference can be made to the method embodiment above, and for the sake of brevity, no further description will be given here.
[0144] Fig. 3 shows a schematic block diagram of an apparatus 300 provided in an embodiment of the present application, and the apparatus 300 may include units for executing the method in Fig. 2. Furthermore, each unit in the apparatus 300 is for implementing the corresponding process of the method embodiment in Fig. 2.
[0145] Specifically, the device 300 includes a detection unit 310 and a processing unit 320 .
[0146] The detection unit 310 is used to determine the depression depth of the brake pedal and the depression depth of the accelerator pedal;
[0147] The processing unit 320 is configured to play a charging sound when the vehicle speed is 0, the brake pedal's depression depth is greater than a first threshold, and the accelerator pedal's depression depth is greater than a second threshold.
[0148] In some embodiments, the detection unit 310 is further configured to determine a duration in which the brake pedal's depression depth is greater than a first threshold and the accelerator pedal's depression depth is greater than a second threshold.
[0149] The processing unit 320 is further configured to adjust the pitch of the charging sound wave upward when the duration is less than n seconds.
[0150] In some embodiments, the processing unit 320 is further configured to adjust the pitch of the charging sound wave upward within n seconds when the duration is greater than n seconds and less than m seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is maintained at q times from n seconds to m seconds.
[0151] In some embodiments, the processing unit 320 is further configured to, when the duration is greater than m seconds, adjust the pitch of the charging sound wave upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is maintained at q times from n seconds to m seconds;
[0152] When the duration reaches m seconds, the charging sound wave stops playing and the pitch is adjusted to q times.
[0153] In some embodiments, the detection unit 310 is further configured to detect whether the brake pedal is released and / or the accelerator pedal is released.
[0154] The processing unit 320 is further configured to stop playing the charging sound when the brake pedal is released and / or the accelerator pedal is released.
[0155] In some embodiments, when the charging sound is playing, or after the charging sound stops playing, wherein, after the charging sound is playing, the depression depth of the brake pedal is greater than the first threshold and the depression depth of the accelerator pedal is greater than the second threshold, the detection unit 310 is also used to detect whether the brake pedal is released.
[0156] The processing unit 320 is further configured to play a launching sound when the brake pedal is released.
[0157] In some embodiments, before the brake pedal is released, the depression depth of the accelerator pedal is greater than a third threshold, and the third threshold is greater than the second threshold.
[0158] In some embodiments, after playing the ejection sound, the detection unit 310 is further configured to detect the vehicle speed and / or power rotation speed.
[0159] The processing unit 320 is further configured to play an acceleration sound when determining that the vehicle is in an accelerating state based on the vehicle speed and / or power rotation speed.
[0160] In some embodiments, the detection unit 310 is further configured to detect whether a first preset condition is satisfied.
[0161] The processing unit 320 is further configured to stop playing the acceleration sound when a first preset condition is met.
[0162] In some embodiments, the first preset condition includes one or more of the following: the vehicle switches from an acceleration state to a constant speed state; the duration of playing the acceleration sound is greater than a fourth threshold.
[0163] In some embodiments, the processing unit 320 is further configured to play a deceleration sound when determining that the vehicle is in a deceleration state based on the vehicle speed and / or power rotational speed.
[0164] In some embodiments, the detection unit 310 is further configured to detect whether a second preset condition is satisfied.
[0165] The processing unit 320 is further configured to stop playing the deceleration sound when a second preset condition is met.
[0166] In some embodiments, the second preset condition includes one or more of the following: the vehicle switches from a deceleration state to a constant speed state; the duration of playing the deceleration sound is greater than a fifth threshold; the vehicle speed is reduced to 0.
[0167] In some embodiments, when the speed of the vehicle decelerates to less than the sixth threshold, the detection unit 310 is further configured to detect whether the brake pedal is released and whether the accelerator pedal is stepped on and the stepping depth is greater than a seventh threshold.
[0168] The processing unit 310 is further configured to play a launching sound when the brake pedal is released and the accelerator pedal is stepped on and the stepping depth is greater than a seventh threshold.
[0169] In a specific implementation, the actions performed by the detection unit 310 and / or the processing unit 320 may be implemented by one processor, or may also be implemented by multiple processors. In a specific implementation, the apparatus 300 may also be a chip in a controller of a vehicle.
[0170] In an embodiment of the present application, a processor is a circuit with a signal processing capability. In one implementation, the processor can implement a certain function through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the processor loads a configuration document to implement the process of hardware circuit configuration, which can be understood as a process in which the processor loads instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.
[0171] FIG4 is another schematic block diagram of an apparatus provided in an embodiment of the present application. The apparatus 400 shown in FIG4 may include: a processor 410, a transceiver 420, and a memory 430. The processor 410, the transceiver 420, and the memory 430 are connected via an internal connection path. The memory 430 is used to store instructions, and the processor 410 is used to execute the instructions stored in the memory 430 to implement the methods in the above embodiments. Optionally, the memory 430 may be coupled to the processor 410 via an interface or integrated with the processor 410.
[0172] It should be noted that the transceiver 420 may include but is not limited to a transceiver device such as an input / output interface to implement communication between the device 400 and other devices or a communication network.
[0173] The memory 430 may be a ROM, a static storage device, a dynamic storage device or a RAM.
[0174] The transceiver 420 uses a transceiver device such as but not limited to a transceiver to implement communication between the apparatus 400 and other devices or a communication network, so as to receive / send data / information used to implement the methods in the above embodiments.
[0175] The device 400 may also be used to execute the actions executed by the above-mentioned diagnostic device, or may also be used to execute the actions executed by the controller of the intelligent driving device.
[0176] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer implements the methods in the above embodiments of the present application.
[0177] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer implements the methods in the above embodiments of the present application.
[0178] An embodiment of the present application also provides a chip, including a circuit, for executing the methods in the above embodiments of the present application.
[0179] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0180] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is a kind of association relationship that describes associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In this application, "at least one" refers to one or more, and "more than one" refers to two or more. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0181] In the embodiments of this application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity, or content of the described objects. The use of prefixes such as ordinal numbers in the embodiments of this application to distinguish description objects does not constitute a limitation on the described objects. For a statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary limitation.
[0182] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0183] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.
[0184] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0185] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0186] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A method for playing sound waves, characterized in that: The method comprises: Determine the brake pedal and accelerator pedal depression depth; When the speed of the vehicle is 0, the depression depth of the brake pedal is greater than a first threshold, and the depression depth of the accelerator pedal is greater than a second threshold, a charging sound is played.
2. The method according to claim 1, characterized in that: The method further comprises: Determine a duration during which the depression depth of the brake pedal is greater than the first threshold and the depression depth of the accelerator pedal is greater than the second threshold; When the duration is less than n seconds, where n>0, the method further includes: Adjusts the pitch of said charging sound upward.
3. The method according to claim 2, characterized in that When the duration is greater than n seconds and less than m seconds, where m>0, the method further includes: The pitch of the charging sound wave is adjusted upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is kept adjusted to q times within n seconds to m seconds.
4. The method according to claim 2 or 3, characterized in that: When the duration is greater than m seconds, the method further includes: Adjust the pitch of the charging sound wave upward within n seconds, so that when the duration reaches n seconds, the pitch of the charging sound wave is adjusted to q times, q>0, and the pitch of the charging sound wave is kept adjusted to q times within n seconds to m seconds; When the duration reaches m seconds, stop playing the charging sound wave with the pitch adjusted to q times.
5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: When it is detected that the brake pedal is released and / or the accelerator pedal is released, the playing of the power storage sound wave is stopped.
6. The method according to any one of claims 1 to 5, characterized in that When the charging sound wave is played, or after the charging sound wave is stopped, wherein after the charging sound wave is played, the pedaling depth of the brake pedal is greater than the first threshold and the pedaling depth of the accelerator pedal is greater than the second threshold, the method further includes: It is detected that the brake pedal is released and a launching sound is played.
7. The method according to claim 6, characterized in that Before the brake pedal is released, the depression depth of the accelerator pedal is greater than a third threshold, and the third threshold is greater than the second threshold.
8. The method according to claim 7, characterized in that After playing the ejection sound wave, the method further includes: When it is determined that the vehicle is in an accelerating state according to the vehicle speed and / or power rotation speed of the vehicle, an acceleration sound is played.
9. The method according to claim 8, characterized in that The method further comprises: When it is detected that the first preset condition is met, the playing of the acceleration sound wave is stopped.
10. The method according to claim 9, characterized in that The first preset condition includes one or more of the following: The vehicle switches from the acceleration state to a constant speed state; The duration of playing the acceleration sound wave is greater than a fourth threshold.
11. The method according to any one of claims 8 to 10, characterized in that The method further comprises: When it is determined that the vehicle is in a deceleration state according to the vehicle speed and / or power rotation speed of the vehicle, a deceleration sound is played.
12. The method according to claim 11, characterized in that The method further comprises: When it is detected that the second preset condition is met, the playing of the deceleration sound wave is stopped.
13. The method according to claim 12, characterized in that The second preset condition includes one or more of the following: The vehicle switches from the deceleration state to a constant speed state; The duration of playing the deceleration sound wave is greater than a fifth threshold; The speed of the vehicle is reduced to 0.
14. The method according to any one of claims 11 to 13, characterized in that When the speed of the vehicle decelerates to be less than a sixth threshold, the method further includes: When it is detected that the brake pedal is released and the accelerator pedal is stepped on and the stepping depth is greater than a seventh threshold, the ejection sound is played.
15. A device, characterized in that: A controller applied to an intelligent driving device, the device comprising a detection unit and a processing unit, for executing the method as claimed in any one of claims 1 to 14.
16. A device, characterized in that: The device comprises at least one processor coupled to at least one memory, wherein the at least one processor is configured to execute a computer program or instruction stored in the at least one memory so as to enable the device to perform the method according to any one of claims 1 to 14.
17. An intelligent driving device, characterized in that: Comprising the device of claim 15 or 16.
18. A computer-readable storage medium, characterized in that: Instructions are stored thereon, and when the instructions are executed by a processor, the processor implements the method according to any one of claims 1 to 14.
19. A chip, characterized in that: The chip comprises a circuit for executing the method according to any one of claims 1 to 14.
Citation Information
Patent Citations
Automobile engine sound simulation method and system
CN109808593A
Linkage control method and device for vehicle ejection starting, vehicle and storage medium
CN115402317A
Virtual sound providing apparatus and method for electric vehicle
CN115610318A
Electric vehicle sound wave control method and device, electronic equipment and storage medium
CN117087539A
Sound playing method and device and intelligent driving equipment
CN117698569A